2024-09-14T11:00:01.739 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T11:00:01.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:00:01.851 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169 branch: main description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904169' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOowGXUeoaCD7YeS4bsJr/tllPEwKPEI8DBxlCHcGUf6lc1lq97g8/pzorKuv4r5DveYX2qsaAt9Z6Sw8zWyfNs= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2gcATkmHB2RV4a9l0cL2WTmT5cxfT3w++E5QMhVHDMVdHCxcMjrl7sNBT1RFt4VkuulVW09b0RcVF+dfkQPfw= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T11:00:01.851 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T11:00:01.852 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T11:00:01.852 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T11:00:01.854 INFO:teuthology.task.internal:Checking packages... 2024-09-14T11:00:01.874 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T11:00:01.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T11:00:01.874 INFO:teuthology.packaging:ref: None 2024-09-14T11:00:01.874 INFO:teuthology.packaging:tag: None 2024-09-14T11:00:01.874 INFO:teuthology.packaging:branch: main 2024-09-14T11:00:01.874 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:00:01.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T11:00:02.093 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T11:00:02.095 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T11:00:02.102 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T11:00:02.102 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T11:00:02.148 INFO:teuthology.task.internal:Saving configuration 2024-09-14T11:00:02.165 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T11:00:02.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T11:00:02.197 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:55:01.865292', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOowGXUeoaCD7YeS4bsJr/tllPEwKPEI8DBxlCHcGUf6lc1lq97g8/pzorKuv4r5DveYX2qsaAt9Z6Sw8zWyfNs='} 2024-09-14T11:00:02.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:55:01.867253', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2gcATkmHB2RV4a9l0cL2WTmT5cxfT3w++E5QMhVHDMVdHCxcMjrl7sNBT1RFt4VkuulVW09b0RcVF+dfkQPfw='} 2024-09-14T11:00:02.217 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T11:00:02.224 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:00:02.224 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:00:02.224 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T11:00:02.299 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4d89f412d0>, signals=[15]) 2024-09-14T11:00:02.299 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T11:00:02.306 INFO:teuthology.task.internal:Opening connections... 2024-09-14T11:00:02.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:00:02.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:00:02.387 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:00:02.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:00:02.462 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T11:00:02.469 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-09-14T11:00:02.487 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-09-14T11:00:02.488 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-09-14T11:00:02.545 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-09-14T11:00:02.545 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-09-14T11:00:02.545 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-09-14T11:00:02.545 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:00:02.545 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-09-14T11:00:02.545 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:00:02.546 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:00:02.547 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-09-14T11:00:02.565 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-09-14T11:00:02.583 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-09-14T11:00:02.583 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T11:00:02.641 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-09-14T11:00:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-09-14T11:00:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T11:00:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-09-14T11:00:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T11:00:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T11:00:02.642 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T11:00:02.642 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-09-14T11:00:02.664 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T11:00:02.677 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T11:00:02.704 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T11:00:02.704 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:00:02.707 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-09-14T11:00:02.723 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T11:00:02.731 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T11:00:02.731 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:00:02.764 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-09-14T11:00:02.789 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T11:00:02.847 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T11:00:02.862 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T11:00:02.862 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T11:00:02.863 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:00:02.863 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T11:00:02.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:02.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:02.880 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-09-14T11:00:02.880 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-14T11:00:02.937 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:00:02.937 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.14.0-503.el9.x86_64 2024-09-14T11:00:02.937 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum install -y kernel 2024-09-14T11:00:02.938 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-503.el9.x86_64 2024-09-14T11:00:02.938 INFO:teuthology.task.kernel:Running kernel on smithi028: 5.14.0-503.el9.x86_64 2024-09-14T11:00:02.938 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum install -y kernel 2024-09-14T11:00:05.443 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-14T11:00:07.347 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-14T11:00:08.835 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-14T11:00:12.189 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 20 MB 00:03 2024-09-14T11:00:13.253 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-14T11:00:14.720 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-14T11:00:15.583 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-14T11:00:20.306 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:04 2024-09-14T11:00:21.005 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T11:00:21.782 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-14T11:00:22.553 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T11:00:23.028 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:00:23.028 INFO:teuthology.orchestra.run.smithi204.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:00:23.112 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-14T11:00:23.118 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-14T11:00:23.118 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-09-14T11:00:23.118 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout:Install 4 Packages 2024-09-14T11:00:23.119 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:00:23.120 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 79 M 2024-09-14T11:00:23.120 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 126 M 2024-09-14T11:00:23.120 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-14T11:00:23.315 INFO:teuthology.orchestra.run.smithi204.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 286 kB/s | 23 kB 00:00 2024-09-14T11:00:24.140 INFO:teuthology.orchestra.run.smithi204.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-14T11:00:25.707 INFO:teuthology.orchestra.run.smithi204.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-14T11:00:26.266 INFO:teuthology.orchestra.run.smithi204.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-14T11:00:26.266 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:00:26.266 INFO:teuthology.orchestra.run.smithi204.stdout:Total 25 MB/s | 79 MB 00:03 2024-09-14T11:00:26.950 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-14T11:00:27.307 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-14T11:00:27.307 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-14T11:00:28.192 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-14T11:00:28.282 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-14T11:00:28.283 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-14T11:00:30.282 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:00:30.282 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:00:30.386 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:00:30.391 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:00:30.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:00:30.392 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-09-14T11:00:30.392 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-14T11:00:30.392 INFO:teuthology.orchestra.run.smithi028.stdout:Install 4 Packages 2024-09-14T11:00:30.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:00:30.392 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 79 M 2024-09-14T11:00:30.393 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 126 M 2024-09-14T11:00:30.393 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-09-14T11:00:30.746 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-14T11:00:31.044 INFO:teuthology.orchestra.run.smithi028.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-09-14T11:00:31.394 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:00:31.492 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:31.885 INFO:teuthology.orchestra.run.smithi028.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-14T11:00:32.535 INFO:teuthology.orchestra.run.smithi028.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-14T11:00:33.228 INFO:teuthology.orchestra.run.smithi028.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-14T11:00:33.228 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:00:33.228 INFO:teuthology.orchestra.run.smithi028.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-14T11:00:33.939 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-09-14T11:00:34.297 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:34.306 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-09-14T11:00:34.306 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-09-14T11:00:34.439 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:35.311 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-09-14T11:00:35.311 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-09-14T11:00:37.904 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-09-14T11:00:38.563 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:00:38.645 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:39.288 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:39.323 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:00:41.436 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:41.564 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:44.153 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:00:46.683 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:46.722 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:00:51.870 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:22.455 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:22.495 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:22.878 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:22.879 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:01:22.879 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:01:22.879 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:01:23.706 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:23.706 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:01:23.706 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-14T11:01:23.706 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:23.706 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:23.706 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:01:23.707 INFO:teuthology.orchestra.run.smithi204.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:23.707 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:01:23.707 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-14T11:01:24.050 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:24.134 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:24.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:24.134 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:01:24.134 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:01:24.134 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:01:24.134 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T11:01:24.135 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:01:24.135 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:24.193 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:24.193 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:24.193 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-09-14T11:01:24.225 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-09-14T11:01:24.225 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.06 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 82.el9 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Group : Unspecified 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 8274670 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : builder@centos.org 2024-09-14T11:01:24.226 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : CentOS 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:01:24.227 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:01:24.228 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:01:24.228 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:01:24.228 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:01:24.874 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-09-14T11:01:26.258 INFO:teuthology.orchestra.run.smithi204.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:01:26.289 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-09-14T11:01:26.291 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-14T11:01:26.307 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.hUd9RSB6Lg 2024-09-14T11:01:26.307 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hUd9RSB6Lg 2024-09-14T11:01:26.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.hUd9RSB6Lg 2024-09-14T11:01:26.520 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.hUd9RSB6Lg is 6KB 2024-09-14T11:01:26.572 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.hUd9RSB6Lg 2024-09-14T11:01:26.588 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:01:26.652 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:01:26.652 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:01:26.652 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:01:26.653 INFO:teuthology.orchestra.run.smithi204.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:01:26.653 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:01:26.810 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-09-14T11:01:31.061 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:31.109 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:31.420 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:31.420 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:01:31.420 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:01:31.421 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:01:32.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:32.271 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:01:32.271 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-09-14T11:01:32.271 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:32.271 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:32.271 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:01:32.272 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:32.272 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:01:32.272 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-09-14T11:01:32.629 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:32.715 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:32.715 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:32.715 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:01:32.715 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:01:32.716 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:01:32.716 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T11:01:32.716 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi028.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:01:32.716 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:32.774 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:32.774 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:32.774 DEBUG:teuthology.orchestra.run.smithi028:> sudo rpm -qi grub2-tools 2024-09-14T11:01:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:Name : grub2-tools 2024-09-14T11:01:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:Epoch : 1 2024-09-14T11:01:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:Version : 2.06 2024-09-14T11:01:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:Release : 82.el9 2024-09-14T11:01:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: x86_64 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Group : Unspecified 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Size : 8274670 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:License : GPLv3+ 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Packager : builder@centos.org 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Vendor : CentOS 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Summary : Support tools for GRUB. 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout:Description : 2024-09-14T11:01:32.817 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:01:32.818 INFO:teuthology.orchestra.run.smithi028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:01:32.818 INFO:teuthology.orchestra.run.smithi028.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:01:32.818 INFO:teuthology.orchestra.run.smithi028.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:01:32.818 INFO:teuthology.orchestra.run.smithi028.stdout:hardware devices. 2024-09-14T11:01:32.818 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:01:32.818 INFO:teuthology.orchestra.run.smithi028.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:01:32.819 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:01:32.819 INFO:teuthology.task.kernel:Updating grub on smithi028 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:01:32.819 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:01:33.469 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-09-14T11:01:34.877 INFO:teuthology.orchestra.run.smithi028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:01:34.900 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-09-14T11:01:34.902 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-09-14T11:01:34.958 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.HW9NMJMXI9 2024-09-14T11:01:34.958 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HW9NMJMXI9 2024-09-14T11:01:35.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.HW9NMJMXI9 2024-09-14T11:01:35.289 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.HW9NMJMXI9 is 6KB 2024-09-14T11:01:35.337 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.HW9NMJMXI9 2024-09-14T11:01:35.351 DEBUG:teuthology.orchestra.run.smithi028:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:01:35.423 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:01:35.423 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:01:35.423 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:01:35.423 INFO:teuthology.orchestra.run.smithi028.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:01:35.424 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:01:35.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo shutdown -r now 2024-09-14T11:01:56.829 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T11:01:56.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:01:56.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:05.585 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T11:02:05.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:02:05.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:15.361 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-14T11:02:24.065 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-09-14T11:02:24.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:02:24.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:27.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-14T11:02:33.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:02:33.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:36.129 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-09-14T11:02:39.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:02:39.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:48.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:02:48.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:51.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-09-14T11:02:57.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-14T11:03:06.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:03:06.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:06.561 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-09-14T11:03:06.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:03:06.993 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:03:06.994 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-09-14T11:03:07.009 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:03:07.009 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:03:07.009 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:03:07.009 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:03:08.010 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T11:03:08.010 DEBUG:teuthology.orchestra.run.smithi028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:03:08.081 INFO:teuthology.orchestra.run.smithi028.stdout:ttyS1 2024-09-14T11:03:08.113 DEBUG:teuthology.parallel:result is None 2024-09-14T11:03:12.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:03:12.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:13.198 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-14T11:03:13.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:03:13.569 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:03:13.569 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-14T11:03:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:03:13.584 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:03:13.584 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:03:13.584 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:03:14.586 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T11:03:14.586 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:03:14.727 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-09-14T11:03:14.753 DEBUG:teuthology.parallel:result is None 2024-09-14T11:03:14.753 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T11:03:14.760 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T11:03:14.760 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:03:14.764 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:03:14.807 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T11:03:14.816 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T11:03:14.860 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T11:03:14.861 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:03:14.864 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:03:14.923 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T11:03:14.930 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T11:03:14.930 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:03:14.941 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:03:14.968 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:14.980 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:15.019 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:15.045 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:15.050 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T11:03:15.061 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T11:03:15.061 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:03:15.064 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:03:15.130 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T11:03:15.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T11:03:15.144 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:03:15.148 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:03:15.197 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:15.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:15.291 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:15.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:15.415 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:03:15.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:03:15.483 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:15.523 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:15.579 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:15.664 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:15.703 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:03:15.703 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:03:15.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-09-14T11:03:15.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-09-14T11:03:15.821 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:03:15.891 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:03:16.332 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T11:03:16.340 INFO:teuthology.task.internal:Starting timer... 2024-09-14T11:03:16.340 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T11:03:16.388 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T11:03:16.436 DEBUG:teuthology.orchestra.run.smithi028:> sudo service auditd rotate 2024-09-14T11:03:16.502 INFO:teuthology.orchestra.run.smithi028.stdout:Rotating logs: 2024-09-14T11:03:16.504 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-09-14T11:03:16.548 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-09-14T11:03:16.550 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T11:03:16.550 DEBUG:teuthology.orchestra.run.smithi028:> /usr/sbin/getenforce 2024-09-14T11:03:16.591 INFO:teuthology.orchestra.run.smithi028.stdout:Permissive 2024-09-14T11:03:16.592 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-09-14T11:03:16.617 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-09-14T11:03:16.617 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi028.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-09-14T11:03:16.617 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:03:16.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:16.660 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:03:16.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:16.686 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T11:03:16.686 DEBUG:teuthology.orchestra.run.smithi028:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:03:16.734 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:03:16.768 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T11:03:16.778 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T11:03:16.792 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T11:03:16.793 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:07:04.443 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-09-14T11:07:04.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:07:04.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:04.527 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-09-14T11:07:04.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-09-14T11:07:04.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:07:04.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:04.683 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-14T11:07:04.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-14T11:07:04.766 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:07:04.777 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:07:04.778 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:07:04.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:07:04.782 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:07:04.782 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:07:04.810 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:07:04.825 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:07:04.835 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:07:04.850 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:07:04.850 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: ntpd: command not found 2024-09-14T11:07:04.862 INFO:teuthology.orchestra.run.smithi028.stdout:506 Cannot talk to daemon 2024-09-14T11:07:04.875 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-09-14T11:07:04.876 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:07:04.886 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-09-14T11:07:04.891 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:07:04.901 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:07:04.915 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:07:04.957 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:07:04.961 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:07:04.961 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-09-14T11:07:04.962 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.962 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.962 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.962 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.971 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:07:04.975 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:07:04.975 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-14T11:07:04.975 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.975 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.975 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.976 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:04.977 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:07:04.984 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:07:04.984 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:07:04.984 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:07:04.985 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:07:04.990 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:07:04.990 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:07:04.990 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:07:04.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:07:04.993 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:07:04.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:07:05.137 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:07:05.138 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:07:05.147 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:07:05.147 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:07:05.249 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:07:05.249 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:07:05.249 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:07:05.255 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:07:05.255 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:07:05.255 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:07:05.277 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:07:05.277 DEBUG:teuthology.orchestra.run.smithi028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:07:05.281 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:07:05.281 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:07:05.345 DEBUG:teuthology.orchestra.run.smithi028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:07:05.346 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:07:05.421 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:07:05.422 DEBUG:teuthology.orchestra.run.smithi028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:07:05.486 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-09-14T11:07:05.487 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-09-14T11:07:05.488 INFO:teuthology.orchestra.run.smithi028.stdout:check_obsoletes = 1 2024-09-14T11:07:05.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum clean all 2024-09-14T11:07:05.725 INFO:teuthology.orchestra.run.smithi204.stdout:45 files removed 2024-09-14T11:07:05.733 INFO:teuthology.orchestra.run.smithi028.stdout:45 files removed 2024-09-14T11:07:05.752 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:07:05.760 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:07:06.309 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-14T11:07:06.327 INFO:teuthology.orchestra.run.smithi028.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-14T11:07:06.602 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T11:07:06.602 INFO:teuthology.orchestra.run.smithi028.stdout:ceph noarch packages 105 kB/s | 24 kB 00:00 2024-09-14T11:07:06.861 INFO:teuthology.orchestra.run.smithi028.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-14T11:07:06.869 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-14T11:07:07.647 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-14T11:07:07.827 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.2 MB 00:00 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-14T11:07:09.754 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-14T11:07:13.830 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-14T11:07:14.221 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-14T11:07:15.564 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-14T11:07:16.472 INFO:teuthology.orchestra.run.smithi204.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-14T11:07:16.668 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-14T11:07:17.293 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-14T11:07:22.224 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T11:07:22.758 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-14T11:07:24.671 INFO:teuthology.orchestra.run.smithi028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:24.672 INFO:teuthology.orchestra.run.smithi028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:24.771 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout:====================================================================================================== 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout:====================================================================================================== 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:07:24.794 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:07:24.795 INFO:teuthology.orchestra.run.smithi028.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrading: 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:24.796 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:07:24.797 INFO:teuthology.orchestra.run.smithi028.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:07:24.798 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:07:24.799 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:07:24.800 INFO:teuthology.orchestra.run.smithi028.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:07:24.801 INFO:teuthology.orchestra.run.smithi028.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:07:24.802 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:07:24.803 INFO:teuthology.orchestra.run.smithi028.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:07:24.804 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:07:24.805 INFO:teuthology.orchestra.run.smithi028.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:07:24.806 INFO:teuthology.orchestra.run.smithi028.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:07:24.807 INFO:teuthology.orchestra.run.smithi028.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:07:24.808 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:07:24.809 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:07:24.810 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:07:24.811 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:07:24.812 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:07:24.813 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:07:24.814 INFO:teuthology.orchestra.run.smithi028.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout:Installing weak dependencies: 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:07:24.815 INFO:teuthology.orchestra.run.smithi028.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:07:24.816 INFO:teuthology.orchestra.run.smithi028.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout:====================================================================================================== 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout:Install 284 Packages 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrade 2 Packages 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:07:24.817 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 327 M 2024-09-14T11:07:24.818 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-09-14T11:07:25.119 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:25.120 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:25.213 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================== 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================== 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:07:25.234 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:07:25.236 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:07:25.237 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:07:25.238 INFO:teuthology.orchestra.run.smithi204.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:07:25.239 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:07:25.240 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:07:25.241 INFO:teuthology.orchestra.run.smithi204.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:07:25.242 INFO:teuthology.orchestra.run.smithi204.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:07:25.243 INFO:teuthology.orchestra.run.smithi204.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:07:25.244 INFO:teuthology.orchestra.run.smithi204.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:07:25.245 INFO:teuthology.orchestra.run.smithi204.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:07:25.246 INFO:teuthology.orchestra.run.smithi204.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:07:25.247 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:07:25.248 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:07:25.249 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:07:25.250 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:07:25.251 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:07:25.252 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:07:25.253 INFO:teuthology.orchestra.run.smithi204.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:07:25.254 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:07:25.255 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-09-14T11:07:25.256 INFO:teuthology.orchestra.run.smithi204.stdout:====================================================================================================== 2024-09-14T11:07:25.256 INFO:teuthology.orchestra.run.smithi204.stdout:Install 284 Packages 2024-09-14T11:07:25.256 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 2 Packages 2024-09-14T11:07:25.256 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:07:25.256 INFO:teuthology.orchestra.run.smithi028.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-09-14T11:07:25.257 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 327 M 2024-09-14T11:07:25.257 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-09-14T11:07:25.859 INFO:teuthology.orchestra.run.smithi028.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.4 MB/s | 900 kB 00:00 2024-09-14T11:07:25.960 INFO:teuthology.orchestra.run.smithi028.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.4 MB/s | 145 kB 00:00 2024-09-14T11:07:26.034 INFO:teuthology.orchestra.run.smithi204.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-09-14T11:07:26.343 INFO:teuthology.orchestra.run.smithi028.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 4.0 MB/s | 5.5 MB 00:01 2024-09-14T11:07:26.618 INFO:teuthology.orchestra.run.smithi204.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.5 MB/s | 900 kB 00:00 2024-09-14T11:07:26.660 INFO:teuthology.orchestra.run.smithi028.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-09-14T11:07:26.709 INFO:teuthology.orchestra.run.smithi204.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.5 MB/s | 145 kB 00:00 2024-09-14T11:07:26.843 INFO:teuthology.orchestra.run.smithi028.stdout:(6/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 2.7 MB/s | 2.4 MB 00:00 2024-09-14T11:07:27.035 INFO:teuthology.orchestra.run.smithi204.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 4.1 MB/s | 5.5 MB 00:01 2024-09-14T11:07:27.352 INFO:teuthology.orchestra.run.smithi204.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-09-14T11:07:27.510 INFO:teuthology.orchestra.run.smithi028.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 5.6 MB/s | 4.8 MB 00:00 2024-09-14T11:07:27.569 INFO:teuthology.orchestra.run.smithi204.stdout:(6/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 2.8 MB/s | 2.4 MB 00:00 2024-09-14T11:07:28.727 INFO:teuthology.orchestra.run.smithi204.stdout:(7/286): ceph-common-19.3.0-4907.ga2782315.el9. 7.2 MB/s | 22 MB 00:03 2024-09-14T11:07:28.794 INFO:teuthology.orchestra.run.smithi204.stdout:(8/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 3.3 MB/s | 4.8 MB 00:01 2024-09-14T11:07:28.869 INFO:teuthology.orchestra.run.smithi204.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 336 kB/s | 25 kB 00:00 2024-09-14T11:07:29.077 INFO:teuthology.orchestra.run.smithi028.stdout:(8/286): ceph-radosgw-19.3.0-4907.ga2782315.el9 7.0 MB/s | 11 MB 00:01 2024-09-14T11:07:29.161 INFO:teuthology.orchestra.run.smithi028.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 303 kB/s | 25 kB 00:00 2024-09-14T11:07:29.680 INFO:teuthology.orchestra.run.smithi028.stdout:(10/286): ceph-common-19.3.0-4907.ga2782315.el9 4.6 MB/s | 22 MB 00:04 2024-09-14T11:07:29.772 INFO:teuthology.orchestra.run.smithi028.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 348 kB/s | 32 kB 00:00 2024-09-14T11:07:29.919 INFO:teuthology.orchestra.run.smithi204.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 9.2 MB/s | 11 MB 00:01 2024-09-14T11:07:30.011 INFO:teuthology.orchestra.run.smithi204.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 347 kB/s | 32 kB 00:00 2024-09-14T11:07:30.047 INFO:teuthology.orchestra.run.smithi028.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 2.7 MB/s | 756 kB 00:00 2024-09-14T11:07:30.156 INFO:teuthology.orchestra.run.smithi028.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.5 MB/s | 161 kB 00:00 2024-09-14T11:07:30.187 INFO:teuthology.orchestra.run.smithi204.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 4.2 MB/s | 756 kB 00:00 2024-09-14T11:07:30.273 INFO:teuthology.orchestra.run.smithi028.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.1 MB/s | 127 kB 00:00 2024-09-14T11:07:30.287 INFO:teuthology.orchestra.run.smithi204.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.6 MB/s | 161 kB 00:00 2024-09-14T11:07:30.387 INFO:teuthology.orchestra.run.smithi204.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.2 MB/s | 127 kB 00:00 2024-09-14T11:07:30.456 INFO:teuthology.orchestra.run.smithi028.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 2.7 MB/s | 508 kB 00:00 2024-09-14T11:07:30.840 INFO:teuthology.orchestra.run.smithi028.stdout:(16/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 4.3 MB/s | 17 MB 00:03 2024-09-14T11:07:30.932 INFO:teuthology.orchestra.run.smithi028.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 494 kB/s | 45 kB 00:00 2024-09-14T11:07:31.023 INFO:teuthology.orchestra.run.smithi028.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.5 MB/s | 143 kB 00:00 2024-09-14T11:07:31.029 INFO:teuthology.orchestra.run.smithi204.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 792 kB/s | 508 kB 00:00 2024-09-14T11:07:31.090 INFO:teuthology.orchestra.run.smithi028.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.4 MB/s | 161 kB 00:00 2024-09-14T11:07:31.216 INFO:teuthology.orchestra.run.smithi028.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 2.5 MB/s | 320 kB 00:00 2024-09-14T11:07:31.341 INFO:teuthology.orchestra.run.smithi028.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 2.4 MB/s | 305 kB 00:00 2024-09-14T11:07:31.408 INFO:teuthology.orchestra.run.smithi028.stdout:(22/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.5 MB/s | 99 kB 00:00 2024-09-14T11:07:31.475 INFO:teuthology.orchestra.run.smithi028.stdout:(23/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.3 MB/s | 85 kB 00:00 2024-09-14T11:07:31.663 INFO:teuthology.orchestra.run.smithi204.stdout:(16/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 4.2 MB/s | 17 MB 00:04 2024-09-14T11:07:31.746 INFO:teuthology.orchestra.run.smithi204.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 543 kB/s | 45 kB 00:00 2024-09-14T11:07:31.825 INFO:teuthology.orchestra.run.smithi028.stdout:(24/286): librgw2-19.3.0-4907.ga2782315.el9.x86 4.0 MB/s | 5.5 MB 00:01 2024-09-14T11:07:31.830 INFO:teuthology.orchestra.run.smithi204.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.7 MB/s | 143 kB 00:00 2024-09-14T11:07:31.900 INFO:teuthology.orchestra.run.smithi028.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.2 MB/s | 171 kB 00:00 2024-09-14T11:07:31.914 INFO:teuthology.orchestra.run.smithi204.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 1.9 MB/s | 161 kB 00:00 2024-09-14T11:07:31.967 INFO:teuthology.orchestra.run.smithi028.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 513 kB/s | 34 kB 00:00 2024-09-14T11:07:32.031 INFO:teuthology.orchestra.run.smithi204.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 2.7 MB/s | 320 kB 00:00 2024-09-14T11:07:32.051 INFO:teuthology.orchestra.run.smithi028.stdout:(27/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.8 MB/s | 154 kB 00:00 2024-09-14T11:07:32.173 INFO:teuthology.orchestra.run.smithi204.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 2.1 MB/s | 305 kB 00:00 2024-09-14T11:07:32.248 INFO:teuthology.orchestra.run.smithi204.stdout:(22/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.3 MB/s | 99 kB 00:00 2024-09-14T11:07:32.318 INFO:teuthology.orchestra.run.smithi028.stdout:(28/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 3.8 MB/s | 3.2 MB 00:00 2024-09-14T11:07:32.348 INFO:teuthology.orchestra.run.smithi204.stdout:(23/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 853 kB/s | 85 kB 00:00 2024-09-14T11:07:33.273 INFO:teuthology.orchestra.run.smithi204.stdout:(24/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 3.4 MB/s | 3.2 MB 00:00 2024-09-14T11:07:33.349 INFO:teuthology.orchestra.run.smithi204.stdout:(25/286): librgw2-19.3.0-4907.ga2782315.el9.x86 2.4 MB/s | 5.5 MB 00:02 2024-09-14T11:07:33.374 INFO:teuthology.orchestra.run.smithi204.stdout:(26/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-14T11:07:33.408 INFO:teuthology.orchestra.run.smithi204.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 587 kB/s | 34 kB 00:00 2024-09-14T11:07:33.441 INFO:teuthology.orchestra.run.smithi204.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.2 MB/s | 154 kB 00:00 2024-09-14T11:07:34.012 INFO:teuthology.orchestra.run.smithi028.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 4.4 MB/s | 7.4 MB 00:01 2024-09-14T11:07:34.127 INFO:teuthology.orchestra.run.smithi028.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 2.4 MB/s | 291 kB 00:00 2024-09-14T11:07:34.193 INFO:teuthology.orchestra.run.smithi028.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 741 kB/s | 49 kB 00:00 2024-09-14T11:07:34.252 INFO:teuthology.orchestra.run.smithi028.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 282 kB/s | 16 kB 00:00 2024-09-14T11:07:34.386 INFO:teuthology.orchestra.run.smithi028.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 2.1 MB/s | 285 kB 00:00 2024-09-14T11:07:34.636 INFO:teuthology.orchestra.run.smithi028.stdout:(34/286): cephadm-19.3.0-4907.ga2782315.el9.noa 3.1 MB/s | 784 kB 00:00 2024-09-14T11:07:34.770 INFO:teuthology.orchestra.run.smithi028.stdout:(35/286): ModemManager-glib-1.20.2-1.el9.x86_64 2.5 MB/s | 335 kB 00:00 2024-09-14T11:07:34.811 INFO:teuthology.orchestra.run.smithi028.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 2.0 MB/s | 85 kB 00:00 2024-09-14T11:07:34.853 INFO:teuthology.orchestra.run.smithi028.stdout:(37/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-14T11:07:34.867 INFO:teuthology.orchestra.run.smithi204.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 5.2 MB/s | 7.4 MB 00:01 2024-09-14T11:07:34.904 INFO:teuthology.orchestra.run.smithi028.stdout:(38/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 5.1 MB/s | 262 kB 00:00 2024-09-14T11:07:34.946 INFO:teuthology.orchestra.run.smithi028.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 1.9 MB/s | 80 kB 00:00 2024-09-14T11:07:34.992 INFO:teuthology.orchestra.run.smithi204.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 2.3 MB/s | 291 kB 00:00 2024-09-14T11:07:35.050 INFO:teuthology.orchestra.run.smithi204.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 850 kB/s | 49 kB 00:00 2024-09-14T11:07:35.092 INFO:teuthology.orchestra.run.smithi204.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 394 kB/s | 16 kB 00:00 2024-09-14T11:07:35.155 INFO:teuthology.orchestra.run.smithi028.stdout:(40/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 4.6 MB/s | 14 MB 00:03 2024-09-14T11:07:35.159 INFO:teuthology.orchestra.run.smithi204.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 4.2 MB/s | 285 kB 00:00 2024-09-14T11:07:35.188 INFO:teuthology.orchestra.run.smithi028.stdout:(41/286): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-14T11:07:35.238 INFO:teuthology.orchestra.run.smithi028.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 323 kB/s | 27 kB 00:00 2024-09-14T11:07:35.272 INFO:teuthology.orchestra.run.smithi028.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-14T11:07:35.322 INFO:teuthology.orchestra.run.smithi028.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-09-14T11:07:35.373 INFO:teuthology.orchestra.run.smithi028.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-14T11:07:35.393 INFO:teuthology.orchestra.run.smithi204.stdout:(34/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 7.1 MB/s | 14 MB 00:01 2024-09-14T11:07:35.427 INFO:teuthology.orchestra.run.smithi204.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 2.9 MB/s | 784 kB 00:00 2024-09-14T11:07:35.431 INFO:teuthology.orchestra.run.smithi028.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-14T11:07:35.498 INFO:teuthology.orchestra.run.smithi028.stdout:(47/286): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-14T11:07:35.565 INFO:teuthology.orchestra.run.smithi028.stdout:(48/286): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-14T11:07:35.599 INFO:teuthology.orchestra.run.smithi028.stdout:(49/286): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-09-14T11:07:35.649 INFO:teuthology.orchestra.run.smithi028.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-14T11:07:36.166 INFO:teuthology.orchestra.run.smithi028.stdout:(51/286): ceph-test-19.3.0-4907.ga2782315.el9.x 7.2 MB/s | 50 MB 00:07 2024-09-14T11:07:36.294 INFO:teuthology.orchestra.run.smithi204.stdout:(36/286): ceph-test-19.3.0-4907.ga2782315.el9.x 6.8 MB/s | 50 MB 00:07 2024-09-14T11:07:36.319 INFO:teuthology.orchestra.run.smithi204.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 95 kB/s | 85 kB 00:00 2024-09-14T11:07:36.353 INFO:teuthology.orchestra.run.smithi204.stdout:(38/286): ModemManager-glib-1.20.2-1.el9.x86_64 349 kB/s | 335 kB 00:00 2024-09-14T11:07:36.461 INFO:teuthology.orchestra.run.smithi204.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-14T11:07:36.495 INFO:teuthology.orchestra.run.smithi204.stdout:(40/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 246 kB/s | 49 kB 00:00 2024-09-14T11:07:36.603 INFO:teuthology.orchestra.run.smithi204.stdout:(41/286): libpciaccess-0.16-7.el9.x86_64.rpm 249 kB/s | 27 kB 00:00 2024-09-14T11:07:36.633 INFO:teuthology.orchestra.run.smithi028.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 629 kB/s | 650 kB 00:01 2024-09-14T11:07:36.741 INFO:teuthology.orchestra.run.smithi028.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 655 kB/s | 71 kB 00:00 2024-09-14T11:07:36.858 INFO:teuthology.orchestra.run.smithi028.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 2.5 MB/s | 302 kB 00:00 2024-09-14T11:07:36.900 INFO:teuthology.orchestra.run.smithi028.stdout:(55/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 714 kB/s | 523 kB 00:00 2024-09-14T11:07:36.904 INFO:teuthology.orchestra.run.smithi204.stdout:(42/286): libquadmath-11.5.0-2.el9.x86_64.rpm 637 kB/s | 191 kB 00:00 2024-09-14T11:07:36.946 INFO:teuthology.orchestra.run.smithi204.stdout:(43/286): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-14T11:07:36.971 INFO:teuthology.orchestra.run.smithi204.stdout:(44/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 402 kB/s | 262 kB 00:00 2024-09-14T11:07:36.975 INFO:teuthology.orchestra.run.smithi028.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 2.4 MB/s | 283 kB 00:00 2024-09-14T11:07:37.021 INFO:teuthology.orchestra.run.smithi204.stdout:(45/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 802 kB/s | 94 kB 00:00 2024-09-14T11:07:37.063 INFO:teuthology.orchestra.run.smithi204.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-14T11:07:37.084 INFO:teuthology.orchestra.run.smithi028.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 802 kB/s | 87 kB 00:00 2024-09-14T11:07:37.130 INFO:teuthology.orchestra.run.smithi204.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-14T11:07:37.181 INFO:teuthology.orchestra.run.smithi204.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-14T11:07:37.193 INFO:teuthology.orchestra.run.smithi028.stdout:(58/286): apache-commons-lang3-3.12.0-6.el9.noa 1.9 MB/s | 559 kB 00:00 2024-09-14T11:07:37.218 INFO:teuthology.orchestra.run.smithi028.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-09-14T11:07:37.239 INFO:teuthology.orchestra.run.smithi204.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-14T11:07:37.298 INFO:teuthology.orchestra.run.smithi204.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-14T11:07:37.310 INFO:teuthology.orchestra.run.smithi028.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 199 kB/s | 23 kB 00:00 2024-09-14T11:07:37.335 INFO:teuthology.orchestra.run.smithi028.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-14T11:07:37.365 INFO:teuthology.orchestra.run.smithi204.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-14T11:07:37.419 INFO:teuthology.orchestra.run.smithi028.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 137 kB/s | 15 kB 00:00 2024-09-14T11:07:37.444 INFO:teuthology.orchestra.run.smithi028.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 984 kB/s | 107 kB 00:00 2024-09-14T11:07:37.457 INFO:teuthology.orchestra.run.smithi204.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.9 MB/s | 650 kB 00:00 2024-09-14T11:07:37.507 INFO:teuthology.orchestra.run.smithi204.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-14T11:07:37.527 INFO:teuthology.orchestra.run.smithi028.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 492 kB/s | 53 kB 00:00 2024-09-14T11:07:37.561 INFO:teuthology.orchestra.run.smithi028.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T11:07:37.574 INFO:teuthology.orchestra.run.smithi204.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 4.4 MB/s | 302 kB 00:00 2024-09-14T11:07:37.608 INFO:teuthology.orchestra.run.smithi204.stdout:(55/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.1 MB/s | 523 kB 00:00 2024-09-14T11:07:37.633 INFO:teuthology.orchestra.run.smithi204.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-14T11:07:37.636 INFO:teuthology.orchestra.run.smithi028.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 563 kB/s | 61 kB 00:00 2024-09-14T11:07:37.670 INFO:teuthology.orchestra.run.smithi028.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 260 kB/s | 28 kB 00:00 2024-09-14T11:07:37.675 INFO:teuthology.orchestra.run.smithi204.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 8.2 MB/s | 559 kB 00:00 2024-09-14T11:07:37.709 INFO:teuthology.orchestra.run.smithi204.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-14T11:07:37.734 INFO:teuthology.orchestra.run.smithi204.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-09-14T11:07:37.753 INFO:teuthology.orchestra.run.smithi028.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 963 kB/s | 113 kB 00:00 2024-09-14T11:07:37.759 INFO:teuthology.orchestra.run.smithi204.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 464 kB/s | 23 kB 00:00 2024-09-14T11:07:37.784 INFO:teuthology.orchestra.run.smithi204.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T11:07:37.804 INFO:teuthology.orchestra.run.smithi028.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 3.8 MB/s | 525 kB 00:00 2024-09-14T11:07:37.810 INFO:teuthology.orchestra.run.smithi204.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-14T11:07:37.835 INFO:teuthology.orchestra.run.smithi204.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-14T11:07:37.860 INFO:teuthology.orchestra.run.smithi204.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T11:07:37.886 INFO:teuthology.orchestra.run.smithi204.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-14T11:07:37.911 INFO:teuthology.orchestra.run.smithi204.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:07:37.929 INFO:teuthology.orchestra.run.smithi028.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-14T11:07:37.936 INFO:teuthology.orchestra.run.smithi204.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 561 kB/s | 28 kB 00:00 2024-09-14T11:07:37.962 INFO:teuthology.orchestra.run.smithi204.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-14T11:07:37.963 INFO:teuthology.orchestra.run.smithi028.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 4.6 MB/s | 980 kB 00:00 2024-09-14T11:07:38.004 INFO:teuthology.orchestra.run.smithi204.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 7.7 MB/s | 525 kB 00:00 2024-09-14T11:07:38.046 INFO:teuthology.orchestra.run.smithi204.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 11 MB/s | 980 kB 00:00 2024-09-14T11:07:38.046 INFO:teuthology.orchestra.run.smithi028.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.7 MB/s | 325 kB 00:00 2024-09-14T11:07:38.080 INFO:teuthology.orchestra.run.smithi028.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2024-09-14T11:07:38.088 INFO:teuthology.orchestra.run.smithi204.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 9.1 MB/s | 781 kB 00:00 2024-09-14T11:07:38.189 INFO:teuthology.orchestra.run.smithi028.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 199 kB/s | 22 kB 00:00 2024-09-14T11:07:38.221 INFO:teuthology.orchestra.run.smithi204.stdout:(72/286): adwaita-icon-theme-40.1.1-3.el9.noarc 13 MB/s | 12 MB 00:00 2024-09-14T11:07:38.247 INFO:teuthology.orchestra.run.smithi204.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 1.6 MB/s | 325 kB 00:00 2024-09-14T11:07:38.272 INFO:teuthology.orchestra.run.smithi028.stdout:(75/286): flatpak-1.12.9-1.el9.x86_64.rpm 7.6 MB/s | 1.7 MB 00:00 2024-09-14T11:07:38.280 INFO:teuthology.orchestra.run.smithi204.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 1.1 MB/s | 218 kB 00:00 2024-09-14T11:07:38.298 INFO:teuthology.orchestra.run.smithi028.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 673 kB/s | 73 kB 00:00 2024-09-14T11:07:38.305 INFO:teuthology.orchestra.run.smithi204.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 369 kB/s | 22 kB 00:00 2024-09-14T11:07:38.331 INFO:teuthology.orchestra.run.smithi204.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-14T11:07:38.356 INFO:teuthology.orchestra.run.smithi204.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-14T11:07:38.381 INFO:teuthology.orchestra.run.smithi028.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-14T11:07:38.398 INFO:teuthology.orchestra.run.smithi204.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 9.8 MB/s | 1.7 MB 00:00 2024-09-14T11:07:38.423 INFO:teuthology.orchestra.run.smithi204.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-14T11:07:38.449 INFO:teuthology.orchestra.run.smithi204.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-14T11:07:38.474 INFO:teuthology.orchestra.run.smithi204.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-14T11:07:38.490 INFO:teuthology.orchestra.run.smithi028.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-14T11:07:38.499 INFO:teuthology.orchestra.run.smithi204.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-14T11:07:38.525 INFO:teuthology.orchestra.run.smithi204.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 9.2 MB/s | 473 kB 00:00 2024-09-14T11:07:38.550 INFO:teuthology.orchestra.run.smithi204.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-14T11:07:38.575 INFO:teuthology.orchestra.run.smithi204.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 680 kB/s | 34 kB 00:00 2024-09-14T11:07:38.634 INFO:teuthology.orchestra.run.smithi204.stdout:(86/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.9 MB/s | 3.0 MB 00:00 2024-09-14T11:07:38.676 INFO:teuthology.orchestra.run.smithi204.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-14T11:07:38.690 INFO:teuthology.orchestra.run.smithi028.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 445 kB/s | 89 kB 00:00 2024-09-14T11:07:38.701 INFO:teuthology.orchestra.run.smithi204.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 496 kB/s | 33 kB 00:00 2024-09-14T11:07:38.760 INFO:teuthology.orchestra.run.smithi204.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 12 MB/s | 2.2 MB 00:00 2024-09-14T11:07:38.810 INFO:teuthology.orchestra.run.smithi204.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 21 MB/s | 2.3 MB 00:00 2024-09-14T11:07:38.835 INFO:teuthology.orchestra.run.smithi204.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.9 MB/s | 219 kB 00:00 2024-09-14T11:07:38.869 INFO:teuthology.orchestra.run.smithi204.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 11 MB/s | 657 kB 00:00 2024-09-14T11:07:38.936 INFO:teuthology.orchestra.run.smithi204.stdout:(93/286): gtk3-3.24.31-5.el9.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-09-14T11:07:38.970 INFO:teuthology.orchestra.run.smithi204.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 4.6 MB/s | 632 kB 00:00 2024-09-14T11:07:38.995 INFO:teuthology.orchestra.run.smithi204.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 770 kB/s | 45 kB 00:00 2024-09-14T11:07:39.020 INFO:teuthology.orchestra.run.smithi204.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T11:07:39.032 INFO:teuthology.orchestra.run.smithi028.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 364 kB/s | 124 kB 00:00 2024-09-14T11:07:39.045 INFO:teuthology.orchestra.run.smithi204.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.0 MB/s | 413 kB 00:00 2024-09-14T11:07:39.113 INFO:teuthology.orchestra.run.smithi204.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 15 MB/s | 3.5 MB 00:00 2024-09-14T11:07:39.149 INFO:teuthology.orchestra.run.smithi028.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-09-14T11:07:39.171 INFO:teuthology.orchestra.run.smithi204.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 22 MB/s | 3.3 MB 00:00 2024-09-14T11:07:39.197 INFO:teuthology.orchestra.run.smithi204.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 156 kB/s | 13 kB 00:00 2024-09-14T11:07:39.222 INFO:teuthology.orchestra.run.smithi204.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T11:07:39.247 INFO:teuthology.orchestra.run.smithi204.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 478 kB/s | 24 kB 00:00 2024-09-14T11:07:39.301 INFO:teuthology.orchestra.run.smithi204.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 4.7 MB/s | 377 kB 00:00 2024-09-14T11:07:39.331 INFO:teuthology.orchestra.run.smithi204.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 424 kB/s | 35 kB 00:00 2024-09-14T11:07:39.356 INFO:teuthology.orchestra.run.smithi204.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 3.0 MB/s | 168 kB 00:00 2024-09-14T11:07:39.382 INFO:teuthology.orchestra.run.smithi204.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-09-14T11:07:39.407 INFO:teuthology.orchestra.run.smithi204.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 482 kB/s | 24 kB 00:00 2024-09-14T11:07:39.432 INFO:teuthology.orchestra.run.smithi204.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 615 kB/s | 31 kB 00:00 2024-09-14T11:07:39.457 INFO:teuthology.orchestra.run.smithi204.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 456 kB/s | 23 kB 00:00 2024-09-14T11:07:39.483 INFO:teuthology.orchestra.run.smithi204.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 395 kB/s | 20 kB 00:00 2024-09-14T11:07:39.508 INFO:teuthology.orchestra.run.smithi204.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-14T11:07:39.533 INFO:teuthology.orchestra.run.smithi204.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 298 kB/s | 15 kB 00:00 2024-09-14T11:07:39.559 INFO:teuthology.orchestra.run.smithi204.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 566 kB/s | 28 kB 00:00 2024-09-14T11:07:39.584 INFO:teuthology.orchestra.run.smithi204.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 427 kB/s | 21 kB 00:00 2024-09-14T11:07:39.609 INFO:teuthology.orchestra.run.smithi204.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-14T11:07:39.635 INFO:teuthology.orchestra.run.smithi204.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-09-14T11:07:39.660 INFO:teuthology.orchestra.run.smithi204.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 607 kB/s | 30 kB 00:00 2024-09-14T11:07:39.685 INFO:teuthology.orchestra.run.smithi204.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-14T11:07:39.710 INFO:teuthology.orchestra.run.smithi204.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 635 kB/s | 32 kB 00:00 2024-09-14T11:07:39.736 INFO:teuthology.orchestra.run.smithi204.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-14T11:07:39.761 INFO:teuthology.orchestra.run.smithi204.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-14T11:07:39.786 INFO:teuthology.orchestra.run.smithi204.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-14T11:07:39.812 INFO:teuthology.orchestra.run.smithi204.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 615 kB/s | 31 kB 00:00 2024-09-14T11:07:39.845 INFO:teuthology.orchestra.run.smithi204.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-14T11:07:39.871 INFO:teuthology.orchestra.run.smithi204.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-14T11:07:39.874 INFO:teuthology.orchestra.run.smithi028.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 653 kB/s | 473 kB 00:00 2024-09-14T11:07:39.896 INFO:teuthology.orchestra.run.smithi204.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 730 kB/s | 37 kB 00:00 2024-09-14T11:07:39.921 INFO:teuthology.orchestra.run.smithi204.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-14T11:07:39.947 INFO:teuthology.orchestra.run.smithi204.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T11:07:39.972 INFO:teuthology.orchestra.run.smithi204.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-14T11:07:39.989 INFO:teuthology.orchestra.run.smithi204.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-14T11:07:40.006 INFO:teuthology.orchestra.run.smithi204.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 1.2 MB/s | 41 kB 00:00 2024-09-14T11:07:40.040 INFO:teuthology.orchestra.run.smithi204.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T11:07:40.056 INFO:teuthology.orchestra.run.smithi204.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 869 kB/s | 44 kB 00:00 2024-09-14T11:07:40.073 INFO:teuthology.orchestra.run.smithi204.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-09-14T11:07:40.074 INFO:teuthology.orchestra.run.smithi028.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 322 kB/s | 64 kB 00:00 2024-09-14T11:07:40.115 INFO:teuthology.orchestra.run.smithi204.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-14T11:07:40.141 INFO:teuthology.orchestra.run.smithi204.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-14T11:07:40.150 INFO:teuthology.orchestra.run.smithi028.stdout:(84/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.6 MB/s | 3.0 MB 00:01 2024-09-14T11:07:40.166 INFO:teuthology.orchestra.run.smithi204.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-14T11:07:40.183 INFO:teuthology.orchestra.run.smithi028.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 314 kB/s | 34 kB 00:00 2024-09-14T11:07:40.200 INFO:teuthology.orchestra.run.smithi204.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-14T11:07:40.225 INFO:teuthology.orchestra.run.smithi204.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 760 kB/s | 45 kB 00:00 2024-09-14T11:07:40.259 INFO:teuthology.orchestra.run.smithi204.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 3.4 MB/s | 206 kB 00:00 2024-09-14T11:07:40.284 INFO:teuthology.orchestra.run.smithi204.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-14T11:07:40.310 INFO:teuthology.orchestra.run.smithi204.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.8 MB/s | 198 kB 00:00 2024-09-14T11:07:40.335 INFO:teuthology.orchestra.run.smithi204.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 708 kB/s | 36 kB 00:00 2024-09-14T11:07:40.360 INFO:teuthology.orchestra.run.smithi204.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-14T11:07:40.385 INFO:teuthology.orchestra.run.smithi204.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-14T11:07:40.419 INFO:teuthology.orchestra.run.smithi204.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-14T11:07:40.444 INFO:teuthology.orchestra.run.smithi204.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 571 kB/s | 33 kB 00:00 2024-09-14T11:07:40.469 INFO:teuthology.orchestra.run.smithi204.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-09-14T11:07:40.495 INFO:teuthology.orchestra.run.smithi204.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 257 kB/s | 13 kB 00:00 2024-09-14T11:07:40.520 INFO:teuthology.orchestra.run.smithi204.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 831 kB/s | 42 kB 00:00 2024-09-14T11:07:40.546 INFO:teuthology.orchestra.run.smithi204.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-14T11:07:40.571 INFO:teuthology.orchestra.run.smithi204.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-14T11:07:40.596 INFO:teuthology.orchestra.run.smithi204.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-14T11:07:40.622 INFO:teuthology.orchestra.run.smithi204.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 718 kB/s | 36 kB 00:00 2024-09-14T11:07:40.647 INFO:teuthology.orchestra.run.smithi204.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T11:07:40.672 INFO:teuthology.orchestra.run.smithi204.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-14T11:07:40.697 INFO:teuthology.orchestra.run.smithi204.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-09-14T11:07:40.722 INFO:teuthology.orchestra.run.smithi204.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-14T11:07:40.773 INFO:teuthology.orchestra.run.smithi204.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 20 MB/s | 1.5 MB 00:00 2024-09-14T11:07:40.798 INFO:teuthology.orchestra.run.smithi204.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 120 kB/s | 9.0 kB 00:00 2024-09-14T11:07:40.840 INFO:teuthology.orchestra.run.smithi204.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 7.6 MB/s | 517 kB 00:00 2024-09-14T11:07:40.866 INFO:teuthology.orchestra.run.smithi204.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-14T11:07:40.891 INFO:teuthology.orchestra.run.smithi204.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-14T11:07:40.925 INFO:teuthology.orchestra.run.smithi204.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 338 kB/s | 11 kB 00:00 2024-09-14T11:07:40.975 INFO:teuthology.orchestra.run.smithi204.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-14T11:07:41.078 INFO:teuthology.orchestra.run.smithi204.stdout:(166/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 41 MB/s | 8.8 MB 00:00 2024-09-14T11:07:41.103 INFO:teuthology.orchestra.run.smithi204.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-14T11:07:41.129 INFO:teuthology.orchestra.run.smithi204.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 725 kB/s | 36 kB 00:00 2024-09-14T11:07:41.154 INFO:teuthology.orchestra.run.smithi204.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 914 kB/s | 46 kB 00:00 2024-09-14T11:07:41.179 INFO:teuthology.orchestra.run.smithi204.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 643 kB/s | 32 kB 00:00 2024-09-14T11:07:41.205 INFO:teuthology.orchestra.run.smithi204.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 765 kB/s | 38 kB 00:00 2024-09-14T11:07:41.255 INFO:teuthology.orchestra.run.smithi204.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.2 MB/s | 163 kB 00:00 2024-09-14T11:07:41.275 INFO:teuthology.orchestra.run.smithi028.stdout:(86/286): gstreamer1-plugins-base-1.22.1-2.el9. 2.1 MB/s | 2.2 MB 00:01 2024-09-14T11:07:41.392 INFO:teuthology.orchestra.run.smithi028.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 283 kB/s | 33 kB 00:00 2024-09-14T11:07:41.447 INFO:teuthology.orchestra.run.smithi204.stdout:(173/286): openblas-openmp-0.3.26-2.el9.x86_64. 18 MB/s | 4.9 MB 00:00 2024-09-14T11:07:41.539 INFO:teuthology.orchestra.run.smithi204.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 704 kB/s | 200 kB 00:00 2024-09-14T11:07:41.564 INFO:teuthology.orchestra.run.smithi204.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.5 MB/s | 183 kB 00:00 2024-09-14T11:07:41.598 INFO:teuthology.orchestra.run.smithi204.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-14T11:07:41.632 INFO:teuthology.orchestra.run.smithi204.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-14T11:07:41.657 INFO:teuthology.orchestra.run.smithi204.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-14T11:07:41.682 INFO:teuthology.orchestra.run.smithi204.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-14T11:07:41.708 INFO:teuthology.orchestra.run.smithi204.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-14T11:07:41.733 INFO:teuthology.orchestra.run.smithi204.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-14T11:07:41.758 INFO:teuthology.orchestra.run.smithi204.stdout:(182/286): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-14T11:07:41.783 INFO:teuthology.orchestra.run.smithi204.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-14T11:07:41.862 INFO:teuthology.orchestra.run.smithi204.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 19 MB/s | 1.9 MB 00:00 2024-09-14T11:07:41.893 INFO:teuthology.orchestra.run.smithi204.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.7 MB/s | 192 kB 00:00 2024-09-14T11:07:41.910 INFO:teuthology.orchestra.run.smithi204.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 550 kB/s | 26 kB 00:00 2024-09-14T11:07:41.927 INFO:teuthology.orchestra.run.smithi204.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.7 MB/s | 60 kB 00:00 2024-09-14T11:07:41.944 INFO:teuthology.orchestra.run.smithi204.stdout:(188/286): plexus-containers-component-annotati 544 kB/s | 18 kB 00:00 2024-09-14T11:07:41.986 INFO:teuthology.orchestra.run.smithi204.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-14T11:07:42.011 INFO:teuthology.orchestra.run.smithi204.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 504 kB/s | 34 kB 00:00 2024-09-14T11:07:42.045 INFO:teuthology.orchestra.run.smithi204.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 4.2 MB/s | 254 kB 00:00 2024-09-14T11:07:42.087 INFO:teuthology.orchestra.run.smithi204.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-14T11:07:42.137 INFO:teuthology.orchestra.run.smithi204.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-14T11:07:42.162 INFO:teuthology.orchestra.run.smithi204.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-14T11:07:42.204 INFO:teuthology.orchestra.run.smithi204.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-14T11:07:42.238 INFO:teuthology.orchestra.run.smithi204.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-14T11:07:42.409 INFO:teuthology.orchestra.run.smithi028.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 648 kB/s | 1.4 MB 00:02 2024-09-14T11:07:42.605 INFO:teuthology.orchestra.run.smithi204.stdout:(197/286): java-11-openjdk-headless-11.0.20.1.1 11 MB/s | 39 MB 00:03 2024-09-14T11:07:42.639 INFO:teuthology.orchestra.run.smithi204.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 1.5 MB/s | 679 kB 00:00 2024-09-14T11:07:42.664 INFO:teuthology.orchestra.run.smithi204.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-14T11:07:42.689 INFO:teuthology.orchestra.run.smithi204.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-14T11:07:42.714 INFO:teuthology.orchestra.run.smithi204.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 511 kB/s | 26 kB 00:00 2024-09-14T11:07:42.740 INFO:teuthology.orchestra.run.smithi204.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-14T11:07:42.765 INFO:teuthology.orchestra.run.smithi204.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-14T11:07:42.790 INFO:teuthology.orchestra.run.smithi204.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 694 kB/s | 35 kB 00:00 2024-09-14T11:07:42.849 INFO:teuthology.orchestra.run.smithi204.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-14T11:07:42.899 INFO:teuthology.orchestra.run.smithi204.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 4.4 MB/s | 222 kB 00:00 2024-09-14T11:07:42.991 INFO:teuthology.orchestra.run.smithi204.stdout:(207/286): python3-babel-2.9.1-2.el9.noarch.rpm 7.9 MB/s | 6.0 MB 00:00 2024-09-14T11:07:43.016 INFO:teuthology.orchestra.run.smithi204.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 660 kB/s | 77 kB 00:00 2024-09-14T11:07:43.042 INFO:teuthology.orchestra.run.smithi204.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 842 kB/s | 42 kB 00:00 2024-09-14T11:07:43.067 INFO:teuthology.orchestra.run.smithi204.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-14T11:07:43.101 INFO:teuthology.orchestra.run.smithi204.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.6 MB/s | 159 kB 00:00 2024-09-14T11:07:43.126 INFO:teuthology.orchestra.run.smithi204.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-09-14T11:07:43.151 INFO:teuthology.orchestra.run.smithi204.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T11:07:43.185 INFO:teuthology.orchestra.run.smithi204.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 915 kB/s | 54 kB 00:00 2024-09-14T11:07:43.252 INFO:teuthology.orchestra.run.smithi204.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 10 MB/s | 5.1 MB 00:00 2024-09-14T11:07:43.277 INFO:teuthology.orchestra.run.smithi204.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-14T11:07:43.311 INFO:teuthology.orchestra.run.smithi204.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-14T11:07:43.328 INFO:teuthology.orchestra.run.smithi204.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 715 kB/s | 36 kB 00:00 2024-09-14T11:07:43.345 INFO:teuthology.orchestra.run.smithi204.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-14T11:07:43.362 INFO:teuthology.orchestra.run.smithi204.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-09-14T11:07:43.404 INFO:teuthology.orchestra.run.smithi204.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 8.5 MB/s | 510 kB 00:00 2024-09-14T11:07:43.429 INFO:teuthology.orchestra.run.smithi204.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-14T11:07:43.463 INFO:teuthology.orchestra.run.smithi204.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-14T11:07:43.488 INFO:teuthology.orchestra.run.smithi204.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-14T11:07:43.513 INFO:teuthology.orchestra.run.smithi204.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-14T11:07:43.555 INFO:teuthology.orchestra.run.smithi204.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-14T11:07:43.589 INFO:teuthology.orchestra.run.smithi204.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-14T11:07:43.614 INFO:teuthology.orchestra.run.smithi204.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 907 kB/s | 53 kB 00:00 2024-09-14T11:07:43.640 INFO:teuthology.orchestra.run.smithi204.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T11:07:43.665 INFO:teuthology.orchestra.run.smithi204.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-14T11:07:43.690 INFO:teuthology.orchestra.run.smithi204.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-09-14T11:07:43.715 INFO:teuthology.orchestra.run.smithi204.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-14T11:07:43.757 INFO:teuthology.orchestra.run.smithi204.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 5.2 MB/s | 358 kB 00:00 2024-09-14T11:07:43.783 INFO:teuthology.orchestra.run.smithi204.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 633 kB/s | 42 kB 00:00 2024-09-14T11:07:43.816 INFO:teuthology.orchestra.run.smithi204.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.4 MB/s | 385 kB 00:00 2024-09-14T11:07:43.850 INFO:teuthology.orchestra.run.smithi204.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.0 MB/s | 134 kB 00:00 2024-09-14T11:07:43.884 INFO:teuthology.orchestra.run.smithi204.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-14T11:07:43.909 INFO:teuthology.orchestra.run.smithi204.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T11:07:43.951 INFO:teuthology.orchestra.run.smithi204.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 7.4 MB/s | 505 kB 00:00 2024-09-14T11:07:44.001 INFO:teuthology.orchestra.run.smithi204.stdout:(240/286): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-14T11:07:44.169 INFO:teuthology.orchestra.run.smithi204.stdout:(241/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-14T11:07:44.227 INFO:teuthology.orchestra.run.smithi204.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-09-14T11:07:44.253 INFO:teuthology.orchestra.run.smithi204.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-14T11:07:44.278 INFO:teuthology.orchestra.run.smithi204.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-14T11:07:44.295 INFO:teuthology.orchestra.run.smithi204.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-14T11:07:44.312 INFO:teuthology.orchestra.run.smithi204.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-14T11:07:44.345 INFO:teuthology.orchestra.run.smithi204.stdout:(247/286): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-14T11:07:44.371 INFO:teuthology.orchestra.run.smithi204.stdout:(248/286): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-14T11:07:44.421 INFO:teuthology.orchestra.run.smithi204.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 19 MB/s | 839 kB 00:00 2024-09-14T11:07:44.457 INFO:teuthology.orchestra.run.smithi204.stdout:(250/286): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-14T11:07:44.480 INFO:teuthology.orchestra.run.smithi204.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T11:07:44.513 INFO:teuthology.orchestra.run.smithi204.stdout:(252/286): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-14T11:07:44.538 INFO:teuthology.orchestra.run.smithi204.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-14T11:07:44.564 INFO:teuthology.orchestra.run.smithi204.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-14T11:07:44.597 INFO:teuthology.orchestra.run.smithi204.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-14T11:07:44.623 INFO:teuthology.orchestra.run.smithi204.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-14T11:07:44.682 INFO:teuthology.orchestra.run.smithi204.stdout:(257/286): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-14T11:07:44.707 INFO:teuthology.orchestra.run.smithi204.stdout:(258/286): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-14T11:07:44.732 INFO:teuthology.orchestra.run.smithi204.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-14T11:07:44.757 INFO:teuthology.orchestra.run.smithi204.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-14T11:07:44.782 INFO:teuthology.orchestra.run.smithi204.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-14T11:07:44.808 INFO:teuthology.orchestra.run.smithi204.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-14T11:07:44.833 INFO:teuthology.orchestra.run.smithi204.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-14T11:07:44.858 INFO:teuthology.orchestra.run.smithi204.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-14T11:07:44.884 INFO:teuthology.orchestra.run.smithi204.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:07:44.909 INFO:teuthology.orchestra.run.smithi204.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:07:44.934 INFO:teuthology.orchestra.run.smithi204.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T11:07:44.976 INFO:teuthology.orchestra.run.smithi204.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-14T11:07:45.002 INFO:teuthology.orchestra.run.smithi204.stdout:(269/286): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-14T11:07:45.027 INFO:teuthology.orchestra.run.smithi204.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 325 kB/s | 16 kB 00:00 2024-09-14T11:07:45.052 INFO:teuthology.orchestra.run.smithi204.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-14T11:07:45.078 INFO:teuthology.orchestra.run.smithi204.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-14T11:07:45.103 INFO:teuthology.orchestra.run.smithi204.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T11:07:45.128 INFO:teuthology.orchestra.run.smithi204.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T11:07:45.154 INFO:teuthology.orchestra.run.smithi204.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-14T11:07:45.179 INFO:teuthology.orchestra.run.smithi204.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-14T11:07:45.221 INFO:teuthology.orchestra.run.smithi204.stdout:(277/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-14T11:07:45.246 INFO:teuthology.orchestra.run.smithi204.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-14T11:07:45.271 INFO:teuthology.orchestra.run.smithi204.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-14T11:07:45.297 INFO:teuthology.orchestra.run.smithi204.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-14T11:07:45.322 INFO:teuthology.orchestra.run.smithi204.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:07:45.347 INFO:teuthology.orchestra.run.smithi204.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:07:45.373 INFO:teuthology.orchestra.run.smithi204.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-14T11:07:45.423 INFO:teuthology.orchestra.run.smithi204.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T11:07:45.715 INFO:teuthology.orchestra.run.smithi204.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-14T11:07:45.734 INFO:teuthology.orchestra.run.smithi028.stdout:(89/286): guava-30.1-6.el9.noarch.rpm 712 kB/s | 2.3 MB 00:03 2024-09-14T11:07:45.773 INFO:teuthology.orchestra.run.smithi204.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 8.1 MB/s | 3.5 MB 00:00 2024-09-14T11:07:45.780 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:07:45.780 INFO:teuthology.orchestra.run.smithi204.stdout:Total 16 MB/s | 327 MB 00:20 2024-09-14T11:07:46.151 INFO:teuthology.orchestra.run.smithi028.stdout:(90/286): gtk3-3.24.31-5.el9.x86_64.rpm 1.0 MB/s | 4.9 MB 00:04 2024-09-14T11:07:46.176 INFO:teuthology.orchestra.run.smithi028.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 495 kB/s | 219 kB 00:00 2024-09-14T11:07:47.143 INFO:teuthology.orchestra.run.smithi028.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 662 kB/s | 657 kB 00:00 2024-09-14T11:07:47.177 INFO:teuthology.orchestra.run.smithi028.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 631 kB/s | 632 kB 00:01 2024-09-14T11:07:47.285 INFO:teuthology.orchestra.run.smithi028.stdout:(94/286): jakarta-annotations-1.3.5-13.el9.noar 416 kB/s | 45 kB 00:00 2024-09-14T11:07:47.486 INFO:teuthology.orchestra.run.smithi028.stdout:(95/286): jansi-2.3.3-6.el9.x86_64.rpm 548 kB/s | 110 kB 00:00 2024-09-14T11:07:48.127 INFO:teuthology.orchestra.run.smithi028.stdout:(96/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 643 kB/s | 413 kB 00:00 2024-09-14T11:07:48.821 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-09-14T11:07:49.005 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-09-14T11:07:49.005 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-09-14T11:07:50.094 INFO:teuthology.orchestra.run.smithi028.stdout:(97/286): adwaita-icon-theme-40.1.1-3.el9.noarc 844 kB/s | 12 MB 00:14 2024-09-14T11:07:52.279 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-09-14T11:07:52.280 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-09-14T11:07:52.469 INFO:teuthology.orchestra.run.smithi028.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 678 kB/s | 3.5 MB 00:05 2024-09-14T11:07:52.570 INFO:teuthology.orchestra.run.smithi028.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 130 kB/s | 13 kB 00:00 2024-09-14T11:07:52.670 INFO:teuthology.orchestra.run.smithi028.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 531 kB/s | 53 kB 00:00 2024-09-14T11:07:52.770 INFO:teuthology.orchestra.run.smithi028.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 240 kB/s | 24 kB 00:00 2024-09-14T11:07:52.895 INFO:teuthology.orchestra.run.smithi028.stdout:(102/286): jsoup-1.13.1-10.el9.noarch.rpm 2.9 MB/s | 377 kB 00:00 2024-09-14T11:07:53.037 INFO:teuthology.orchestra.run.smithi028.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 251 kB/s | 35 kB 00:00 2024-09-14T11:07:53.096 INFO:teuthology.orchestra.run.smithi028.stdout:(104/286): java-11-openjdk-devel-11.0.20.1.1-2. 684 kB/s | 3.3 MB 00:04 2024-09-14T11:07:53.146 INFO:teuthology.orchestra.run.smithi028.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 1.5 MB/s | 168 kB 00:00 2024-09-14T11:07:53.205 INFO:teuthology.orchestra.run.smithi028.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 102 kB/s | 11 kB 00:00 2024-09-14T11:07:53.255 INFO:teuthology.orchestra.run.smithi028.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 223 kB/s | 24 kB 00:00 2024-09-14T11:07:53.313 INFO:teuthology.orchestra.run.smithi028.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 284 kB/s | 31 kB 00:00 2024-09-14T11:07:53.364 INFO:teuthology.orchestra.run.smithi028.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 210 kB/s | 23 kB 00:00 2024-09-14T11:07:53.431 INFO:teuthology.orchestra.run.smithi028.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 169 kB/s | 20 kB 00:00 2024-09-14T11:07:53.473 INFO:teuthology.orchestra.run.smithi028.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 365 kB/s | 40 kB 00:00 2024-09-14T11:07:53.539 INFO:teuthology.orchestra.run.smithi028.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 139 kB/s | 15 kB 00:00 2024-09-14T11:07:53.590 INFO:teuthology.orchestra.run.smithi028.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 243 kB/s | 28 kB 00:00 2024-09-14T11:07:53.932 INFO:teuthology.orchestra.run.smithi028.stdout:(114/286): java-11-openjdk-headless-11.0.20.1.1 10 MB/s | 39 MB 00:03 2024-09-14T11:07:53.957 INFO:teuthology.orchestra.run.smithi028.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 51 kB/s | 21 kB 00:00 2024-09-14T11:07:53.982 INFO:teuthology.orchestra.run.smithi028.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 49 kB/s | 19 kB 00:00 2024-09-14T11:07:54.041 INFO:teuthology.orchestra.run.smithi028.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 173 kB/s | 19 kB 00:00 2024-09-14T11:07:54.091 INFO:teuthology.orchestra.run.smithi028.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 281 kB/s | 30 kB 00:00 2024-09-14T11:07:54.149 INFO:teuthology.orchestra.run.smithi028.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 293 kB/s | 32 kB 00:00 2024-09-14T11:07:54.183 INFO:teuthology.orchestra.run.smithi028.stdout:(120/286): libcanberra-0.30-27.el9.x86_64.rpm 430 kB/s | 86 kB 00:00 2024-09-14T11:07:54.208 INFO:teuthology.orchestra.run.smithi028.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.3 MB/s | 161 kB 00:00 2024-09-14T11:07:54.283 INFO:teuthology.orchestra.run.smithi028.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 1.8 MB/s | 241 kB 00:00 2024-09-14T11:07:54.309 INFO:teuthology.orchestra.run.smithi028.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 3.4 MB/s | 435 kB 00:00 2024-09-14T11:07:54.334 INFO:teuthology.orchestra.run.smithi028.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 247 kB/s | 31 kB 00:00 2024-09-14T11:07:54.393 INFO:teuthology.orchestra.run.smithi028.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 760 kB/s | 83 kB 00:00 2024-09-14T11:07:54.418 INFO:teuthology.orchestra.run.smithi028.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 135 kB 00:00 2024-09-14T11:07:54.443 INFO:teuthology.orchestra.run.smithi028.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 337 kB/s | 37 kB 00:00 2024-09-14T11:07:54.502 INFO:teuthology.orchestra.run.smithi028.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.3 MB/s | 142 kB 00:00 2024-09-14T11:07:54.535 INFO:teuthology.orchestra.run.smithi028.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-09-14T11:07:54.561 INFO:teuthology.orchestra.run.smithi028.stdout:(130/286): libgxps-0.3.2-3.el9.x86_64.rpm 671 kB/s | 79 kB 00:00 2024-09-14T11:07:54.603 INFO:teuthology.orchestra.run.smithi028.stdout:(131/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 608 kB/s | 61 kB 00:00 2024-09-14T11:07:54.636 INFO:teuthology.orchestra.run.smithi028.stdout:(132/286): libldac-2.0.2.3-10.el9.x86_64.rpm 410 kB/s | 41 kB 00:00 2024-09-14T11:07:54.670 INFO:teuthology.orchestra.run.smithi028.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-14T11:07:54.703 INFO:teuthology.orchestra.run.smithi028.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 434 kB/s | 44 kB 00:00 2024-09-14T11:07:54.737 INFO:teuthology.orchestra.run.smithi028.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 334 kB/s | 34 kB 00:00 2024-09-14T11:07:54.787 INFO:teuthology.orchestra.run.smithi028.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 2.7 MB/s | 319 kB 00:00 2024-09-14T11:07:54.812 INFO:teuthology.orchestra.run.smithi028.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-14T11:07:54.844 INFO:teuthology.orchestra.run.smithi028.stdout:(138/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 423 kB/s | 45 kB 00:00 2024-09-14T11:07:54.904 INFO:teuthology.orchestra.run.smithi028.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 662 kB 00:00 2024-09-14T11:07:54.928 INFO:teuthology.orchestra.run.smithi028.stdout:(140/286): libsbc-1.4-9.el9.x86_64.rpm 389 kB/s | 45 kB 00:00 2024-09-14T11:07:54.962 INFO:teuthology.orchestra.run.smithi028.stdout:(141/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.7 MB/s | 206 kB 00:00 2024-09-14T11:07:55.012 INFO:teuthology.orchestra.run.smithi028.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2024-09-14T11:07:55.046 INFO:teuthology.orchestra.run.smithi028.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2024-09-14T11:07:55.071 INFO:teuthology.orchestra.run.smithi028.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 326 kB/s | 36 kB 00:00 2024-09-14T11:07:55.138 INFO:teuthology.orchestra.run.smithi028.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 2.5 MB/s | 324 kB 00:00 2024-09-14T11:07:55.163 INFO:teuthology.orchestra.run.smithi028.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.2 MB/s | 144 kB 00:00 2024-09-14T11:07:55.197 INFO:teuthology.orchestra.run.smithi028.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.5 MB/s | 193 kB 00:00 2024-09-14T11:07:55.247 INFO:teuthology.orchestra.run.smithi028.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 306 kB/s | 33 kB 00:00 2024-09-14T11:07:55.272 INFO:teuthology.orchestra.run.smithi028.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 178 kB/s | 19 kB 00:00 2024-09-14T11:07:55.306 INFO:teuthology.orchestra.run.smithi028.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 118 kB/s | 13 kB 00:00 2024-09-14T11:07:55.356 INFO:teuthology.orchestra.run.smithi028.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 384 kB/s | 42 kB 00:00 2024-09-14T11:07:55.389 INFO:teuthology.orchestra.run.smithi028.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-14T11:07:55.423 INFO:teuthology.orchestra.run.smithi028.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.1 MB/s | 133 kB 00:00 2024-09-14T11:07:55.465 INFO:teuthology.orchestra.run.smithi028.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 116 kB/s | 13 kB 00:00 2024-09-14T11:07:55.507 INFO:teuthology.orchestra.run.smithi028.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 306 kB/s | 36 kB 00:00 2024-09-14T11:07:55.541 INFO:teuthology.orchestra.run.smithi028.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-14T11:07:55.582 INFO:teuthology.orchestra.run.smithi028.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-14T11:07:55.616 INFO:teuthology.orchestra.run.smithi028.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-09-14T11:07:55.650 INFO:teuthology.orchestra.run.smithi028.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 162 kB/s | 18 kB 00:00 2024-09-14T11:07:55.733 INFO:teuthology.orchestra.run.smithi028.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 77 kB/s | 9.0 kB 00:00 2024-09-14T11:07:55.767 INFO:teuthology.orchestra.run.smithi028.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-14T11:07:55.842 INFO:teuthology.orchestra.run.smithi028.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 1.4 MB/s | 151 kB 00:00 2024-09-14T11:07:55.893 INFO:teuthology.orchestra.run.smithi028.stdout:(163/286): maven-lib-3.6.3-15.el9.noarch.rpm 4.8 MB/s | 1.5 MB 00:00 2024-09-14T11:07:55.926 INFO:teuthology.orchestra.run.smithi028.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 707 kB/s | 112 kB 00:00 2024-09-14T11:07:55.993 INFO:teuthology.orchestra.run.smithi028.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 112 kB/s | 11 kB 00:00 2024-09-14T11:07:56.035 INFO:teuthology.orchestra.run.smithi028.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 139 kB 00:00 2024-09-14T11:07:56.110 INFO:teuthology.orchestra.run.smithi028.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-14T11:07:56.144 INFO:teuthology.orchestra.run.smithi028.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 334 kB/s | 36 kB 00:00 2024-09-14T11:07:56.219 INFO:teuthology.orchestra.run.smithi028.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 423 kB/s | 46 kB 00:00 2024-09-14T11:07:56.253 INFO:teuthology.orchestra.run.smithi028.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 297 kB/s | 32 kB 00:00 2024-09-14T11:07:56.337 INFO:teuthology.orchestra.run.smithi028.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-14T11:07:56.445 INFO:teuthology.orchestra.run.smithi028.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.5 MB/s | 163 kB 00:00 2024-09-14T11:07:56.570 INFO:teuthology.orchestra.run.smithi028.stdout:(173/286): opus-1.3.1-10.el9.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-09-14T11:07:56.687 INFO:teuthology.orchestra.run.smithi028.stdout:(174/286): orc-0.4.31-8.el9.x86_64.rpm 1.5 MB/s | 183 kB 00:00 2024-09-14T11:07:56.896 INFO:teuthology.orchestra.run.smithi028.stdout:(175/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 8.3 MB/s | 8.8 MB 00:01 2024-09-14T11:07:56.921 INFO:teuthology.orchestra.run.smithi028.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 2.2 MB/s | 531 kB 00:00 2024-09-14T11:07:57.005 INFO:teuthology.orchestra.run.smithi028.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 681 kB/s | 74 kB 00:00 2024-09-14T11:07:57.038 INFO:teuthology.orchestra.run.smithi028.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 3.9 MB/s | 468 kB 00:00 2024-09-14T11:07:57.122 INFO:teuthology.orchestra.run.smithi028.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 2.1 MB/s | 246 kB 00:00 2024-09-14T11:07:57.147 INFO:teuthology.orchestra.run.smithi028.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 981 kB/s | 107 kB 00:00 2024-09-14T11:07:57.222 INFO:teuthology.orchestra.run.smithi028.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 572 kB/s | 57 kB 00:00 2024-09-14T11:07:57.247 INFO:teuthology.orchestra.run.smithi028.stdout:(182/286): pipewire-jack-audio-connection-kit-1 91 kB/s | 9.1 kB 00:00 2024-09-14T11:07:57.331 INFO:teuthology.orchestra.run.smithi028.stdout:(183/286): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-09-14T11:07:57.390 INFO:teuthology.orchestra.run.smithi028.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2024-09-14T11:07:57.449 INFO:teuthology.orchestra.run.smithi028.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.6 MB/s | 192 kB 00:00 2024-09-14T11:07:57.499 INFO:teuthology.orchestra.run.smithi028.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 238 kB/s | 26 kB 00:00 2024-09-14T11:07:57.565 INFO:teuthology.orchestra.run.smithi028.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 514 kB/s | 60 kB 00:00 2024-09-14T11:07:57.608 INFO:teuthology.orchestra.run.smithi028.stdout:(188/286): plexus-containers-component-annotati 169 kB/s | 18 kB 00:00 2024-09-14T11:07:57.674 INFO:teuthology.orchestra.run.smithi028.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 733 kB/s | 80 kB 00:00 2024-09-14T11:07:57.716 INFO:teuthology.orchestra.run.smithi028.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 310 kB/s | 34 kB 00:00 2024-09-14T11:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 2.0 MB/s | 254 kB 00:00 2024-09-14T11:07:58.034 INFO:teuthology.orchestra.run.smithi028.stdout:(192/286): poppler-data-0.4.9-9.el9.noarch.rpm 8.0 MB/s | 1.9 MB 00:00 2024-09-14T11:07:58.159 INFO:teuthology.orchestra.run.smithi028.stdout:(193/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.2 MB/s | 152 kB 00:00 2024-09-14T11:07:58.284 INFO:teuthology.orchestra.run.smithi028.stdout:(194/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-14T11:07:58.393 INFO:teuthology.orchestra.run.smithi028.stdout:(195/286): publicsuffix-list-20210518-3.el9.noa 763 kB/s | 83 kB 00:00 2024-09-14T11:07:58.518 INFO:teuthology.orchestra.run.smithi028.stdout:(196/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.3 MB/s | 679 kB 00:00 2024-09-14T11:07:59.135 INFO:teuthology.orchestra.run.smithi028.stdout:(197/286): python3-babel-2.9.1-2.el9.noarch.rpm 9.7 MB/s | 6.0 MB 00:00 2024-09-14T11:07:59.252 INFO:teuthology.orchestra.run.smithi028.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 2.1 MB/s | 245 kB 00:00 2024-09-14T11:07:59.369 INFO:teuthology.orchestra.run.smithi028.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 2.1 MB/s | 248 kB 00:00 2024-09-14T11:07:59.427 INFO:teuthology.orchestra.run.smithi028.stdout:(200/286): poppler-21.01.0-21.el9.x86_64.rpm 636 kB/s | 1.1 MB 00:01 2024-09-14T11:07:59.477 INFO:teuthology.orchestra.run.smithi028.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 236 kB/s | 26 kB 00:00 2024-09-14T11:07:59.536 INFO:teuthology.orchestra.run.smithi028.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 176 kB/s | 19 kB 00:00 2024-09-14T11:07:59.586 INFO:teuthology.orchestra.run.smithi028.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-14T11:07:59.645 INFO:teuthology.orchestra.run.smithi028.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 320 kB/s | 35 kB 00:00 2024-09-14T11:08:00.021 INFO:teuthology.orchestra.run.smithi028.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 668 kB/s | 250 kB 00:00 2024-09-14T11:08:00.104 INFO:teuthology.orchestra.run.smithi028.stdout:(206/286): python3-numpy-1.20.1-5.el9.x86_64.rp 9.9 MB/s | 5.1 MB 00:00 2024-09-14T11:08:00.221 INFO:teuthology.orchestra.run.smithi028.stdout:(207/286): python3-packaging-20.9-5.el9.noarch. 662 kB/s | 77 kB 00:00 2024-09-14T11:08:00.338 INFO:teuthology.orchestra.run.smithi028.stdout:(208/286): python3-prettytable-0.7.2-27.el9.noa 362 kB/s | 42 kB 00:00 2024-09-14T11:08:00.430 INFO:teuthology.orchestra.run.smithi028.stdout:(209/286): python3-oauthlib-3.1.1-5.el9.noarch. 543 kB/s | 222 kB 00:00 2024-09-14T11:08:00.455 INFO:teuthology.orchestra.run.smithi028.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 2.2 MB/s | 269 kB 00:00 2024-09-14T11:08:00.572 INFO:teuthology.orchestra.run.smithi028.stdout:(211/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-14T11:08:00.689 INFO:teuthology.orchestra.run.smithi028.stdout:(212/286): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-09-14T11:08:00.714 INFO:teuthology.orchestra.run.smithi028.stdout:(213/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 558 kB/s | 159 kB 00:00 2024-09-14T11:08:00.798 INFO:teuthology.orchestra.run.smithi028.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 494 kB/s | 54 kB 00:00 2024-09-14T11:08:00.906 INFO:teuthology.orchestra.run.smithi028.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-14T11:08:01.023 INFO:teuthology.orchestra.run.smithi028.stdout:(216/286): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-14T11:08:01.157 INFO:teuthology.orchestra.run.smithi028.stdout:(217/286): openblas-openmp-0.3.26-2.el9.x86_64. 1.0 MB/s | 4.9 MB 00:04 2024-09-14T11:08:01.174 INFO:teuthology.orchestra.run.smithi028.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 239 kB/s | 36 kB 00:00 2024-09-14T11:08:01.266 INFO:teuthology.orchestra.run.smithi028.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-14T11:08:01.291 INFO:teuthology.orchestra.run.smithi028.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 479 kB/s | 56 kB 00:00 2024-09-14T11:08:01.400 INFO:teuthology.orchestra.run.smithi028.stdout:(221/286): slf4j-1.7.30-13.el9.noarch.rpm 636 kB/s | 69 kB 00:00 2024-09-14T11:08:01.550 INFO:teuthology.orchestra.run.smithi028.stdout:(222/286): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-14T11:08:01.667 INFO:teuthology.orchestra.run.smithi028.stdout:(223/286): sound-theme-freedesktop-0.8-17.el9.n 3.2 MB/s | 383 kB 00:00 2024-09-14T11:08:01.800 INFO:teuthology.orchestra.run.smithi028.stdout:(224/286): totem-pl-parser-3.26.6-2.el9.x86_64. 1.1 MB/s | 152 kB 00:00 2024-09-14T11:08:01.934 INFO:teuthology.orchestra.run.smithi028.stdout:(225/286): tracker-3.1.2-3.el9.x86_64.rpm 4.1 MB/s | 555 kB 00:00 2024-09-14T11:08:02.226 INFO:teuthology.orchestra.run.smithi028.stdout:(226/286): sisu-0.3.4-10.el9.noarch.rpm 531 kB/s | 510 kB 00:00 2024-09-14T11:08:02.281 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:08:02.335 INFO:teuthology.orchestra.run.smithi028.stdout:(227/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 490 kB/s | 53 kB 00:00 2024-09-14T11:08:02.452 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:08:02.605 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-09-14T11:08:02.679 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:08:02.718 INFO:teuthology.orchestra.run.smithi028.stdout:(228/286): tzdata-java-2024a-2.el9.noarch.rpm 599 kB/s | 230 kB 00:00 2024-09-14T11:08:02.728 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:08:02.807 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:08:02.861 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:08:02.914 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:08:02.955 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:08:02.980 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:08:03.010 INFO:teuthology.orchestra.run.smithi028.stdout:(229/286): upower-0.99.11-11.el9.x86_64.rpm 592 kB/s | 173 kB 00:00 2024-09-14T11:08:03.039 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:08:03.382 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:08:03.469 INFO:teuthology.orchestra.run.smithi028.stdout:(230/286): webrtc-audio-processing-0.3.1-8.el9. 667 kB/s | 306 kB 00:00 2024-09-14T11:08:03.498 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:03.605 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:03.641 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:03.669 INFO:teuthology.orchestra.run.smithi028.stdout:(231/286): wireplumber-0.4.14-1.el9.x86_64.rpm 482 kB/s | 96 kB 00:00 2024-09-14T11:08:03.733 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:03.762 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:08:03.818 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:08:03.846 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:08:03.880 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:08:03.915 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:08:03.947 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:08:03.980 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:08:04.007 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:08:04.034 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:08:04.196 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:08:04.211 INFO:teuthology.orchestra.run.smithi028.stdout:(232/286): wireplumber-libs-0.4.14-1.el9.x86_64 660 kB/s | 358 kB 00:00 2024-09-14T11:08:04.319 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:08:04.327 INFO:teuthology.orchestra.run.smithi028.stdout:(233/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 364 kB/s | 42 kB 00:00 2024-09-14T11:08:04.377 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:08:04.429 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:08:04.456 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:04.563 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:04.594 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:04.657 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:04.682 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:08:04.704 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:04.731 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:04.882 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:04.912 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:04.987 INFO:teuthology.orchestra.run.smithi028.stdout:(234/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 585 kB/s | 385 kB 00:00 2024-09-14T11:08:05.030 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:08:05.060 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:08:05.096 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:08:05.171 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:08:05.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:08:05.262 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:08:05.306 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:08:05.312 INFO:teuthology.orchestra.run.smithi028.stdout:(235/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 414 kB/s | 134 kB 00:00 2024-09-14T11:08:05.330 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:08:05.357 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:08:05.382 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:08:05.407 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:08:05.446 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:08:05.477 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:08:05.501 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:08:05.549 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:08:05.575 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:05.658 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:05.718 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:08:05.748 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:08:05.797 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:08:05.847 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:08:05.885 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:08:05.963 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:08:05.995 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:08:06.039 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:08:06.083 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:08:06.159 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:08:06.297 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:08:06.346 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:08:06.646 INFO:teuthology.orchestra.run.smithi028.stdout:(236/286): xkeyboard-config-2.33-2.el9.noarch.r 644 kB/s | 859 kB 00:01 2024-09-14T11:08:06.871 INFO:teuthology.orchestra.run.smithi028.stdout:(237/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 283 kB/s | 64 kB 00:00 2024-09-14T11:08:06.909 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:08:06.993 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:08:07.036 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:08:07.115 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:08:07.152 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:08:07.188 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:08:07.226 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:08:07.306 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:08:07.360 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:08:07.395 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:08:07.430 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:08:07.485 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:08:07.517 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:08:07.550 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:08:07.595 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:08:07.651 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:08:07.685 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:08:07.687 INFO:teuthology.orchestra.run.smithi028.stdout:(238/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 618 kB/s | 505 kB 00:00 2024-09-14T11:08:07.730 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:08:07.771 INFO:teuthology.orchestra.run.smithi028.stdout:(239/286): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-09-14T11:08:07.833 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:08:07.913 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:08:07.986 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:08:08.032 INFO:teuthology.orchestra.run.smithi028.stdout:(240/286): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-09-14T11:08:08.088 INFO:teuthology.orchestra.run.smithi028.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-14T11:08:08.122 INFO:teuthology.orchestra.run.smithi028.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-14T11:08:08.147 INFO:teuthology.orchestra.run.smithi028.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-14T11:08:08.254 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:08:08.306 INFO:teuthology.orchestra.run.smithi028.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-14T11:08:08.331 INFO:teuthology.orchestra.run.smithi028.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T11:08:08.356 INFO:teuthology.orchestra.run.smithi028.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:08:08.369 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:08:08.382 INFO:teuthology.orchestra.run.smithi028.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T11:08:08.415 INFO:teuthology.orchestra.run.smithi028.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-14T11:08:08.417 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:08:08.462 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:08:08.465 INFO:teuthology.orchestra.run.smithi028.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-14T11:08:08.504 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:08:08.507 INFO:teuthology.orchestra.run.smithi028.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-14T11:08:08.533 INFO:teuthology.orchestra.run.smithi028.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T11:08:08.558 INFO:teuthology.orchestra.run.smithi028.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T11:08:08.592 INFO:teuthology.orchestra.run.smithi028.stdout:(253/286): tracker-miners-3.1.2-4.el9.x86_64.rp 142 kB/s | 944 kB 00:06 2024-09-14T11:08:08.625 INFO:teuthology.orchestra.run.smithi028.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 210 kB/s | 14 kB 00:00 2024-09-14T11:08:08.652 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:08:08.667 INFO:teuthology.orchestra.run.smithi028.stdout:(255/286): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-14T11:08:08.696 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:08:08.701 INFO:teuthology.orchestra.run.smithi028.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 6.9 MB/s | 220 kB 00:00 2024-09-14T11:08:08.726 INFO:teuthology.orchestra.run.smithi028.stdout:(257/286): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-14T11:08:08.738 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:08:08.768 INFO:teuthology.orchestra.run.smithi028.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-14T11:08:08.785 INFO:teuthology.orchestra.run.smithi028.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-14T11:08:08.810 INFO:teuthology.orchestra.run.smithi028.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-14T11:08:08.844 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:08:08.852 INFO:teuthology.orchestra.run.smithi028.stdout:(261/286): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-09-14T11:08:08.877 INFO:teuthology.orchestra.run.smithi028.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-09-14T11:08:08.879 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:08:08.902 INFO:teuthology.orchestra.run.smithi028.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-14T11:08:08.931 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:08:08.932 INFO:teuthology.orchestra.run.smithi028.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-14T11:08:08.953 INFO:teuthology.orchestra.run.smithi028.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:08:08.953 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:08:08.978 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:08:08.978 INFO:teuthology.orchestra.run.smithi028.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:08:09.004 INFO:teuthology.orchestra.run.smithi028.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T11:08:09.046 INFO:teuthology.orchestra.run.smithi028.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-14T11:08:09.059 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:08:09.079 INFO:teuthology.orchestra.run.smithi028.stdout:(269/286): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-14T11:08:09.105 INFO:teuthology.orchestra.run.smithi028.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-14T11:08:09.130 INFO:teuthology.orchestra.run.smithi028.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-14T11:08:09.155 INFO:teuthology.orchestra.run.smithi028.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-14T11:08:09.180 INFO:teuthology.orchestra.run.smithi028.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T11:08:09.184 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:08:09.206 INFO:teuthology.orchestra.run.smithi028.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T11:08:09.222 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:08:09.231 INFO:teuthology.orchestra.run.smithi028.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-14T11:08:09.256 INFO:teuthology.orchestra.run.smithi028.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-14T11:08:09.282 INFO:teuthology.orchestra.run.smithi028.stdout:(277/286): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-14T11:08:09.315 INFO:teuthology.orchestra.run.smithi028.stdout:(278/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-14T11:08:09.340 INFO:teuthology.orchestra.run.smithi028.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-14T11:08:09.365 INFO:teuthology.orchestra.run.smithi028.stdout:(280/286): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-14T11:08:09.399 INFO:teuthology.orchestra.run.smithi028.stdout:(281/286): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-14T11:08:09.424 INFO:teuthology.orchestra.run.smithi028.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 3.4 MB/s | 206 kB 00:00 2024-09-14T11:08:09.437 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:08:09.474 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:08:09.483 INFO:teuthology.orchestra.run.smithi028.stdout:(283/286): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-14T11:08:09.522 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:08:09.551 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:08:09.593 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:08:09.630 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:09.643 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:09.643 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:08:09.643 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:09.783 INFO:teuthology.orchestra.run.smithi028.stdout:(284/286): librbd1-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-14T11:08:09.834 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:08:09.909 INFO:teuthology.orchestra.run.smithi028.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 7.2 MB/s | 3.5 MB 00:00 2024-09-14T11:08:09.911 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:08:09.971 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:08:09.995 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:10.020 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:10.046 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:08:10.447 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:10.484 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:10.497 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:10.497 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:08:10.498 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:10.540 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:08:10.575 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:08:10.608 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:08:10.650 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:08:10.684 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:08:10.773 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:08:10.815 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:08:10.855 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:08:10.876 INFO:teuthology.orchestra.run.smithi028.stdout:(286/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.6 MB/s | 16 MB 00:10 2024-09-14T11:08:10.882 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:08:10.882 INFO:teuthology.orchestra.run.smithi028.stdout:Total 7.1 MB/s | 327 MB 00:46 2024-09-14T11:08:10.960 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:08:11.023 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:08:11.769 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:08:11.820 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:08:11.853 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:08:11.957 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:08:12.011 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:08:12.207 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:08:12.251 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:08:12.294 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:08:12.810 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:08:12.869 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:08:12.914 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:08:12.948 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:08:12.981 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:08:13.167 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:08:13.204 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:08:13.289 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:08:13.994 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:08:14.060 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-09-14T11:08:14.114 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:08:14.266 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-09-14T11:08:14.266 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-09-14T11:08:15.440 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:08:15.541 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:08:15.601 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:08:15.643 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:08:15.670 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:08:15.700 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:15.711 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:15.711 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:08:15.712 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:15.762 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:08:15.796 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:08:15.824 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:08:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:08:16.187 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:16.261 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:16.294 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:08:16.326 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:08:16.356 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:08:16.419 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:08:16.463 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:08:16.497 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:08:16.539 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:08:16.562 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:16.896 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:16.939 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:08:16.976 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:08:17.001 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:08:17.026 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:08:17.077 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:08:17.105 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:08:17.142 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:08:17.186 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:08:17.217 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:08:17.266 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:08:17.300 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:08:17.664 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-09-14T11:08:17.664 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-09-14T11:08:17.770 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:08:17.907 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:08:17.975 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:08:18.008 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:08:18.037 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:08:18.105 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:08:18.156 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:08:18.185 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:18.204 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:18.231 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:08:18.257 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:08:18.298 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:08:18.320 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:08:28.097 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:08:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-09-14T11:08:28.318 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:08:28.354 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:08:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:08:28.470 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:08:28.524 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:08:28.565 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:08:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:08:28.637 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:08:28.998 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:08:29.116 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:29.241 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:29.275 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:29.368 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:29.396 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:08:29.443 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:08:29.472 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:08:29.497 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:08:29.524 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:08:29.564 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:08:29.570 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:29.605 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:08:29.631 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:08:29.631 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:08:29.659 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:08:29.660 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:08:29.709 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:08:29.742 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:08:29.778 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:08:29.804 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:08:29.951 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:08:29.985 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:08:30.022 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:08:30.058 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:30.207 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:30.251 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:30.296 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:08:30.314 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:30.325 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:30.338 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:08:30.369 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:30.388 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:30.393 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:30.418 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:08:30.564 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:30.594 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:30.726 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:08:30.758 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:08:30.794 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:08:30.870 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:08:30.929 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:08:30.977 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:08:31.020 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:08:31.044 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:08:31.071 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:08:31.096 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:08:31.122 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:08:31.157 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:08:31.197 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:08:31.230 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:08:31.271 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:08:31.303 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:31.373 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:31.431 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:08:31.471 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:08:31.512 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:08:31.547 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:08:31.596 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:08:31.676 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:08:31.715 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:08:31.759 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:08:31.800 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:08:31.880 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:08:32.024 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:08:32.088 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:08:32.661 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:08:32.752 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:08:32.781 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:32.794 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:08:32.818 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:32.874 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:08:32.924 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:08:32.960 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:08:32.989 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:08:33.065 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:08:33.100 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:08:33.133 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:08:33.169 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:08:33.208 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:08:33.238 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:08:33.279 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:08:33.330 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:08:33.376 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:33.389 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:08:33.422 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:08:33.430 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:08:33.459 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:08:33.505 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:08:33.506 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:08:33.506 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:08:33.506 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:33.539 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:08:33.556 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:08:33.617 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:08:33.699 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:08:33.745 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:08:33.781 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:08:33.838 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:08:33.882 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:08:33.924 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:08:34.069 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:08:34.116 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:08:34.166 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:08:34.274 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:08:34.308 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:08:34.349 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:08:34.381 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:08:34.406 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:08:34.492 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:08:34.624 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:08:34.666 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:08:34.891 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:08:34.942 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:08:34.974 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:08:35.004 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:08:35.045 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:08:35.073 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:35.087 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:35.087 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:08:35.087 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:08:35.277 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:08:35.355 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:08:35.422 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:08:35.446 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:35.470 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:35.497 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:08:35.906 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:35.943 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:35.957 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:35.957 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:08:35.957 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:08:36.000 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:08:36.035 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:08:36.068 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:08:36.112 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:08:36.146 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:08:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:08:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:08:36.316 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:08:36.424 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:08:36.484 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:08:37.258 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:08:37.330 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:08:37.363 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:08:37.468 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:08:37.520 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:08:37.722 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:08:37.762 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:08:37.815 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:08:38.349 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:08:38.411 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:08:38.448 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:08:38.482 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:08:38.515 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:08:38.706 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:08:38.737 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:08:38.822 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:08:39.536 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:08:39.665 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:08:41.011 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:08:41.089 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:08:41.141 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:08:41.182 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:08:41.211 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:08:41.239 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:41.252 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:41.252 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:08:41.253 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:08:41.299 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:08:41.327 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:08:41.355 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:08:41.693 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:08:41.734 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:41.837 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:42.075 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:08:42.217 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:08:42.262 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:08:42.333 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:08:42.386 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:08:42.411 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:08:42.457 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:08:42.483 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:42.740 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:42.786 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:08:42.813 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:08:42.839 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:08:42.864 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:08:42.890 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:08:42.915 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:08:42.943 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-09-14T11:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-09-14T11:08:42.958 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-09-14T11:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-09-14T11:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-09-14T11:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /root 2024-09-14T11:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-09-14T11:08:42.959 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:42.979 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:08:43.028 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:08:43.071 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:08:43.120 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:08:43.130 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:08:43.146 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:08:43.146 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:08:43.146 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:08:43.146 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:43.154 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:08:43.648 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:08:43.797 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:08:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:08:43.884 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:08:43.921 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:08:43.992 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:08:44.036 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:08:44.060 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:44.080 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:44.106 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:08:44.133 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:08:44.174 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:08:44.204 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:44.606 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:08:44.633 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:08:44.633 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:08:44.633 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:08:44.633 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:08:44.633 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:08:44.634 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:44.857 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:08:44.880 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:08:44.880 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:08:44.880 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:08:44.880 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:08:44.880 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:08:44.880 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:45.324 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:08:45.347 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:08:45.347 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:08:45.347 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:08:45.347 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:08:45.348 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:08:45.348 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:45.451 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:08:48.353 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:08:48.476 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:08:48.532 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:08:48.598 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:08:48.785 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:08:48.829 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:08:48.908 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:08:49.006 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:08:49.146 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:08:49.201 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:08:49.239 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:08:50.111 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:08:50.169 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:08:50.532 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:08:50.567 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:08:50.599 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:08:50.626 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:08:50.661 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:08:50.698 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:08:50.725 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:08:50.751 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:08:50.779 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:08:50.804 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:08:50.830 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:08:50.856 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:08:50.883 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:08:50.913 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:08:50.941 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:08:50.976 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:08:51.012 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:08:51.043 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:08:51.069 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:08:51.103 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:08:51.140 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:08:51.178 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:08:51.220 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:08:51.264 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:08:51.306 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:08:51.337 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:08:51.390 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:08:51.422 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:08:51.452 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:08:51.490 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:08:51.515 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:08:51.686 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:08:51.716 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:08:51.743 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:08:51.778 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:08:51.811 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:08:51.942 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:08:52.002 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:08:52.071 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:08:52.116 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:08:52.228 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:08:52.263 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:08:52.278 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:08:52.308 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:08:52.331 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:08:52.786 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:08:52.810 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:08:52.826 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:08:52.826 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:08:52.826 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:08:53.045 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:08:53.115 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:08:53.153 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:08:53.189 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:08:53.214 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:08:53.621 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:08:53.652 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:08:53.668 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:08:54.202 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:08:54.290 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:08:54.335 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:08:54.363 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:08:54.560 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:08:54.617 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:08:54.644 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:08:54.665 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:08:54.695 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:08:54.762 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:08:54.789 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:08:54.800 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:08:54.831 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:08:54.850 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:08:54.874 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:08:55.220 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:08:55.246 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:08:55.280 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:08:55.348 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:08:55.371 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:08:56.162 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:56.203 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:08:56.230 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:08:56.273 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:08:56.305 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:08:56.341 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:08:56.877 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:08:56.903 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:56.983 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:57.013 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:08:58.593 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:08:58.677 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:08:59.473 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:59.511 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:59.648 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:08:59.677 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:08:59.796 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:08:59.957 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:08:59.988 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:00.012 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:00.012 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:00.012 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:09:00.012 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:00.012 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:00.012 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:00.064 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:00.075 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:00.107 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:09:00.156 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:09:00.165 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:09:00.194 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:09:00.243 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:09:00.245 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:09:00.245 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:09:00.245 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:09:00.246 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:00.266 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:00.276 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:09:00.282 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:00.282 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:09:00.282 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:01.233 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:01.257 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:01.257 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:01.257 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:09:01.257 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:01.257 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:01.257 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:01.301 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:01.323 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:01.324 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:01.324 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:09:01.324 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:01.644 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:01.667 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:01.667 INFO:teuthology.orchestra.run.smithi204.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:01.667 INFO:teuthology.orchestra.run.smithi204.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:09:01.667 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:01.667 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:01.667 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:06.397 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:09:06.439 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:09:06.470 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:09:06.574 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:09:06.630 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:06.661 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:09:06.661 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:06.828 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:06.843 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:09:06.850 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:09:06.858 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:09:06.868 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:09:06.868 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:06.869 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:06.869 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:06.922 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:06.990 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /sys 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /proc 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /mnt 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /var/tmp 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /home 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /root 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /tmp 2024-09-14T11:09:10.117 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:10.296 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:09:10.312 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:09:10.313 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:10.313 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:09:10.313 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:11.871 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:09:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:09:11.900 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:11.900 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:09:11.900 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:09:11.900 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:09:11.900 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:12.139 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:09:12.163 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:09:12.164 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:12.164 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:09:12.164 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:09:12.164 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:09:12.164 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:12.639 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:09:12.664 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:09:12.665 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:12.665 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:09:12.665 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:09:12.665 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:09:12.665 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:12.778 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:09:15.805 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:09:15.907 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:09:15.964 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:09:16.038 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:09:16.242 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:09:16.285 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:09:16.365 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:09:16.454 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:09:16.597 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:09:16.649 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:09:16.685 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:09:17.168 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:17.168 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:09:17.169 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:09:17.170 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:09:17.171 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:09:17.171 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:09:17.171 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:09:17.171 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:09:17.171 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:09:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:09:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:09:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:09:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:09:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:09:17.194 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:09:17.195 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:09:17.196 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:09:17.197 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:09:17.198 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:09:17.199 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:09:17.200 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:09:17.201 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:09:17.202 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:09:17.203 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:09:17.204 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:09:17.205 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:09:17.206 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:09:17.207 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:09:17.208 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:09:17.209 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:09:17.210 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:09:17.211 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:09:17.212 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:09:17.213 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:09:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:09:17.214 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:09:17.597 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:09:17.724 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:09:18.083 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:09:18.130 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:09:18.161 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:09:18.189 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:09:18.224 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:09:18.261 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:09:18.288 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:09:18.314 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:09:18.348 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:09:18.381 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:09:18.407 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:09:18.432 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:09:18.460 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:09:18.490 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:09:18.517 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:09:18.553 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:09:18.588 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:09:18.619 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:09:18.654 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:09:18.688 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:09:18.724 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:09:18.763 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:09:18.814 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:09:18.858 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:09:18.889 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:09:18.921 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:09:18.975 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:09:19.006 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:09:19.037 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:09:19.066 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:09:19.091 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:09:19.271 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:09:19.308 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:09:19.344 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:09:19.371 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:09:19.403 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:09:19.529 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:09:19.586 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:09:19.656 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:09:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:09:19.814 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:09:19.853 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:09:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:09:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:09:19.938 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:09:20.371 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:20.409 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:20.426 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:20.426 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:09:20.426 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:20.662 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:09:20.731 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:09:20.767 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:09:20.780 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:09:20.781 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.782 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.783 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:09:20.784 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:09:20.785 INFO:teuthology.orchestra.run.smithi204.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:09:20.786 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:09:20.787 INFO:teuthology.orchestra.run.smithi204.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:09:20.788 INFO:teuthology.orchestra.run.smithi204.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:20.789 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:09:20.790 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:09:20.791 INFO:teuthology.orchestra.run.smithi204.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:09:20.792 INFO:teuthology.orchestra.run.smithi204.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:20.793 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:09:20.794 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:09:20.795 INFO:teuthology.orchestra.run.smithi204.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:09:20.796 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:09:20.797 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:09:20.798 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:09:20.799 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:09:20.800 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:09:20.801 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:09:20.802 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:09:20.803 INFO:teuthology.orchestra.run.smithi204.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:09:20.803 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:20.803 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-09-14T11:09:20.832 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:09:20.970 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:09:21.258 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:21.371 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:21.398 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:21.416 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:21.956 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:09:22.048 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:09:22.081 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:09:22.110 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:09:22.317 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:09:22.383 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:09:22.408 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:09:22.430 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:09:22.458 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:09:22.529 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:09:22.561 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:09:22.572 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:09:22.603 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:09:22.630 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:09:22.654 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:09:23.117 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:09:23.143 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:09:23.177 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:09:23.245 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:09:23.275 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:09:26.663 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:09:26.731 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:09:27.744 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:09:27.773 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:09:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:09:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:09:28.100 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:28.126 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:28.126 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:28.126 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:09:28.126 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:28.126 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:28.126 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:28.176 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:28.188 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:28.219 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:09:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:09:28.297 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:09:28.328 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:28.345 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:28.345 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:09:28.345 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:29.362 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:29.387 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:29.387 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:29.388 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:09:29.388 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:29.388 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:29.388 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:29.438 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:29.462 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:29.462 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:29.462 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:09:29.463 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:29.788 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:29.813 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:29.813 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:29.813 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:09:29.813 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:29.813 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:29.813 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:34.775 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:09:34.817 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:09:34.848 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:09:34.957 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:09:35.018 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:35.056 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:09:35.056 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:35.165 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:35.165 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:35.264 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:35.284 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:09:35.291 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:09:35.300 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:09:35.312 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:09:35.312 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:35.312 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:35.312 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:35.378 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:35.451 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:45.230 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:09:45.231 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:09:45.232 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:09:45.233 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:09:45.233 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:09:45.233 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:09:45.270 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:09:45.271 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:09:45.272 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:09:45.273 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:09:45.274 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:09:45.275 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:09:45.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:09:45.277 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:09:45.277 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:45.277 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:09:45.277 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:09:48.857 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:48.857 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:48.857 INFO:teuthology.orchestra.run.smithi028.stdout:Upgraded: 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:09:48.858 INFO:teuthology.orchestra.run.smithi028.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.859 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.860 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:09:48.861 INFO:teuthology.orchestra.run.smithi028.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:09:48.862 INFO:teuthology.orchestra.run.smithi028.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:48.863 INFO:teuthology.orchestra.run.smithi028.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:09:48.864 INFO:teuthology.orchestra.run.smithi028.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:09:48.865 INFO:teuthology.orchestra.run.smithi028.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:09:48.866 INFO:teuthology.orchestra.run.smithi028.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:09:48.867 INFO:teuthology.orchestra.run.smithi028.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:09:48.868 INFO:teuthology.orchestra.run.smithi028.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:09:48.869 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:09:48.870 INFO:teuthology.orchestra.run.smithi028.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:09:48.871 INFO:teuthology.orchestra.run.smithi028.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.872 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:09:48.873 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:09:48.874 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:09:48.875 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:09:48.876 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:09:48.877 INFO:teuthology.orchestra.run.smithi028.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:09:48.878 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:09:48.879 INFO:teuthology.orchestra.run.smithi028.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:09:48.879 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:48.879 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-09-14T11:09:49.283 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:49.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:09:49.428 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:09:49.490 INFO:teuthology.orchestra.run.smithi028.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:09:49.491 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:09:49.491 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:09:49.493 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:09:49.645 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:09:49.726 INFO:teuthology.orchestra.run.smithi204.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:09:49.726 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:09:49.726 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:09:49.728 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:09:49.728 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:49.728 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:09:49.773 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:49.773 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:09:49.821 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:09:49.821 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:49.821 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:09:49.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:09:49.944 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:49.944 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:09:49.987 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:09:50.069 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:09:50.069 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:50.069 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:09:50.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:09:50.193 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:50.193 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:09:50.234 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:09:50.313 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:09:50.314 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:50.314 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:09:50.355 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:09:50.435 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:50.435 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:09:50.474 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:09:50.552 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:09:50.652 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:09:50.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2024-09-14T11:09:50.655 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-09-14T11:09:50.694 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:09:50.695 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:09:50.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:09:50.776 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:09:50.776 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:09:50.818 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:09:50.867 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:09:50.867 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:09:50.867 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904169', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOowGXUeoaCD7YeS4bsJr/tllPEwKPEI8DBxlCHcGUf6lc1lq97g8/pzorKuv4r5DveYX2qsaAt9Z6Sw8zWyfNs=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG2gcATkmHB2RV4a9l0cL2WTmT5cxfT3w++E5QMhVHDMVdHCxcMjrl7sNBT1RFt4VkuulVW09b0RcVF+dfkQPfw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:09:50.867 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:09:50.900 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:09:50.928 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:09:50.970 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:09:51.008 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:51.008 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:09:51.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:09:51.078 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-09-14T11:09:51.146 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:09:51.146 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:51.146 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T11:09:51.147 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:51.147 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:51.147 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-14 11:09:36.423447534 +0000 2024-09-14T11:09:51.147 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-14 11:06:44.133557580 +0000 2024-09-14T11:09:51.147 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-14 11:06:44.133557580 +0000 2024-09-14T11:09:51.147 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-14 11:06:44.133557580 +0000 2024-09-14T11:09:51.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:09:51.225 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-14T11:09:51.225 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-14T11:09:51.225 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 8.7583e-05 s, 5.8 MB/s 2024-09-14T11:09:51.226 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:09:51.297 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-09-14T11:09:51.367 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-14 11:09:36.424447505 +0000 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-14 11:06:44.462547879 +0000 2024-09-14T11:09:51.368 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-14 11:06:44.462547879 +0000 2024-09-14T11:09:51.369 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-14 11:06:44.462547879 +0000 2024-09-14T11:09:51.369 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:09:51.446 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-14T11:09:51.447 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-14T11:09:51.447 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.7825e-05 s, 5.2 MB/s 2024-09-14T11:09:51.448 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:09:51.519 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-14 11:09:36.424447505 +0000 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-14 11:06:44.784538384 +0000 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-14 11:06:44.784538384 +0000 2024-09-14T11:09:51.589 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-14 11:06:44.784538384 +0000 2024-09-14T11:09:51.590 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:09:51.667 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-14T11:09:51.667 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-14T11:09:51.667 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 8.6457e-05 s, 5.9 MB/s 2024-09-14T11:09:51.669 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:09:51.739 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-09-14 11:09:36.425447475 +0000 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-09-14 11:06:45.108528830 +0000 2024-09-14T11:09:51.810 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-09-14 11:06:45.108528830 +0000 2024-09-14T11:09:51.811 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-09-14 11:06:45.108528830 +0000 2024-09-14T11:09:51.811 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:09:51.888 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-09-14T11:09:51.888 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-09-14T11:09:51.888 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000102008 s, 5.0 MB/s 2024-09-14T11:09:51.889 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:09:51.959 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:51.960 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:51.960 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:09:51.993 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:09:51.993 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-14 11:09:08.064720298 +0000 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-14 11:06:44.131091807 +0000 2024-09-14T11:09:52.065 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-14 11:06:44.131091807 +0000 2024-09-14T11:09:52.066 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-14 11:06:44.131091807 +0000 2024-09-14T11:09:52.066 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:09:52.144 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-14T11:09:52.144 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-14T11:09:52.145 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000243069 s, 2.1 MB/s 2024-09-14T11:09:52.145 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:09:52.216 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-14 11:09:08.064720298 +0000 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-14 11:06:44.457087172 +0000 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-14 11:06:44.457087172 +0000 2024-09-14T11:09:52.286 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-14 11:06:44.457087172 +0000 2024-09-14T11:09:52.287 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:09:52.363 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-14T11:09:52.363 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-14T11:09:52.363 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000207069 s, 2.5 MB/s 2024-09-14T11:09:52.364 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:09:52.434 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-09-14T11:09:52.505 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:09:52.505 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-14 11:09:08.065720284 +0000 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-14 11:06:44.799082310 +0000 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-14 11:06:44.799082310 +0000 2024-09-14T11:09:52.506 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-14 11:06:44.799082310 +0000 2024-09-14T11:09:52.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:09:52.583 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-14T11:09:52.583 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-14T11:09:52.583 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.00021353 s, 2.4 MB/s 2024-09-14T11:09:52.584 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:09:52.654 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-14 11:09:08.065720284 +0000 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-14 11:06:45.121077732 +0000 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-14 11:06:45.121077732 +0000 2024-09-14T11:09:52.723 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-09-14 11:06:45.121077732 +0000 2024-09-14T11:09:52.724 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:09:52.799 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-14T11:09:52.800 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-14T11:09:52.800 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000220259 s, 2.3 MB/s 2024-09-14T11:09:52.801 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:09:52.870 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:52.871 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:09:52.871 INFO:tasks.ceph:Generating config... 2024-09-14T11:09:52.872 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:09:52.872 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:09:52.872 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:09:52.872 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:09:52.872 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:09:52.873 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:09:52.873 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:09:52.873 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:09:52.873 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T11:09:52.874 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:09:52.874 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:09:52.874 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-14T11:09:52.874 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:09:52.874 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:09:52.874 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:09:52.874 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:09:52.874 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:09:52.874 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T11:09:52.874 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:09:52.874 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:09:52.874 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:09:52.874 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T11:09:52.875 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:09:52.876 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:09:52.876 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:09:52.876 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:09:52.949 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:09:52.953 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:09:53.014 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:09:53.054 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.c', '[v2:172.21.15.28:3301,v1:172.21.15.28:6790]'), ('mon.b', '172.21.15.204')] 2024-09-14T11:09:53.055 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,[v2:172.21.15.28:3301,v1:172.21.15.28:6790],172.21.15.204', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:09:53.055 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:53.056 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:09:53.124 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --addv c '[v2:172.21.15.28:3301,v1:172.21.15.28:6790]' --add b 172.21.15.204 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:53.226 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:53.226 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:53.226 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = quincy 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 17 (quincy) 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:09:53.227 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:09:53.228 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:09:53.229 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:09:53.258 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7fcb1d8c-c737-420b-b643-4fde3e2bec1a... 2024-09-14T11:09:53.260 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:09:53.301 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:09:53.358 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-09-14T11:09:53.358 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2024-09-14T11:09:53.358 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:09:53.358 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2024-09-14T11:09:53.358 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.358 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.359 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:09:53.360 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2024-09-14T11:09:53.361 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,[v2:172.21.15.28:3301,v1:172.21.15.28:6790],172.21.15.204" 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: mon client directed command retry = 5 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject socket failures = 5000 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd heartbeat grace = 40 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: rgw override bucket index max shards = 1 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:09:53.362 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug trim objects = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2024-09-14T11:09:53.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: bdev async discard = True 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: bdev enable discard = True 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = bitmap 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2024-09-14T11:09:53.364 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 1/20 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 1/20 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: debug objclass = 20 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 4/10 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: osd fast shutdown = False 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: osd shutdown pgref assert = True 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.365 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2024-09-14T11:09:53.366 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:09:53.367 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:09:53.368 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd crush smoke test = False 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: debug rgw = 20 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: debug rgw notification = 20 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: rgw bucket counters cache = True 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: rgw crypt require ssl = False 2024-09-14T11:09:53.369 INFO:teuthology.orchestra.run.smithi028.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw max chunk size = 4194304 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw obj stripe size = 6291456 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw s3 auth use sts = True 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw torrent flag = True 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: rgw user counters cache = True 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: setgroup = ceph 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout: setuser = ceph 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2024-09-14T11:09:53.370 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2024-09-14T11:09:53.372 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-09-14T11:09:53.372 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-09-14T11:09:53.372 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:09:53.372 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-09-14T11:09:53.372 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.372 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-09-14T11:09:53.374 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.28,[v2:172.21.15.28:3301,v1:172.21.15.28:6790],172.21.15.204" 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: mon client directed command retry = 5 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: ms inject socket failures = 5000 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: osd heartbeat grace = 40 2024-09-14T11:09:53.375 INFO:teuthology.orchestra.run.smithi204.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: rgw override bucket index max shards = 1 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-09-14T11:09:53.376 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-09-14T11:09:53.377 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2024-09-14T11:09:53.378 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: debug objclass = 20 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: osd fast shutdown = False 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: osd shutdown pgref assert = True 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-14T11:09:53.379 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-09-14T11:09:53.380 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.381 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd crush smoke test = False 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: debug rgw = 20 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: debug rgw notification = 20 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: rgw bucket counters cache = True 2024-09-14T11:09:53.382 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt require ssl = False 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw max chunk size = 4194304 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw obj stripe size = 6291456 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw s3 auth use sts = True 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw torrent flag = True 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: rgw user counters cache = True 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: setgroup = ceph 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout: setuser = ceph 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-09-14T11:09:53.383 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-09-14T11:09:53.384 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:09:53.384 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:09:53.482 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:09:53.483 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:53.483 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:09:53.512 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:53.512 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:09:53.581 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:09:53.581 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:53.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:09:53.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:09:53.671 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:09:53.672 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:53.742 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:09:53.742 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:53.742 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:09:53.742 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:09:53.792 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:09:53.793 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:53.861 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:09:53.861 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:09:53.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:09:53.928 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:09:53.931 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:09:54.029 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:09:54.031 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:09:54.031 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:09:54.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:09:54.088 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:09:54.102 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:09:54.157 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:09:54.170 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:09:54.170 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:09:54.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:54.210 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:54.210 INFO:tasks.ceph:role: osd.0 2024-09-14T11:09:54.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:09:54.210 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:09:54.289 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:54.289 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:54.289 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:54.289 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:54.289 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:54.289 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:54.290 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:54.290 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:54.290 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:54.290 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:54.321 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-14T11:09:54.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-14T11:09:54.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:54.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:54.495 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:54.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:54.535 INFO:tasks.ceph:role: osd.1 2024-09-14T11:09:54.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:09:54.535 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:54.615 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:54.647 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-14T11:09:54.648 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-14T11:09:54.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:54.733 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:54.819 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:09:54.900 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:54.900 INFO:tasks.ceph:role: osd.2 2024-09-14T11:09:54.900 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:09:54.900 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:54.979 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:55.011 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-14T11:09:55.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-14T11:09:55.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:09:55.097 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:09:55.181 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:09:55.263 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:55.263 INFO:tasks.ceph:role: osd.3 2024-09-14T11:09:55.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:09:55.263 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:09:55.343 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:55.343 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:55.343 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:55.343 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:55.343 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:55.343 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:55.344 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:55.344 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:55.344 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:55.344 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:55.375 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-09-14T11:09:55.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-09-14T11:09:55.377 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:09:55.465 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:09:55.509 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:55.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:55.620+0000 7f21c7426640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:09:55.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:55.620+0000 7f21c7426640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:09:55.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:55.620+0000 7f21c7426640 -1 bdev(0x560ae06b7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:55.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:55.620+0000 7f21c7426640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:09:58.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:58.822 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:58.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:58.887+0000 7fc99c222640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:09:58.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:58.887+0000 7fc99c222640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:09:58.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:58.887+0000 7fc99c222640 -1 bdev(0x560420075800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:58.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:09:58.887+0000 7fc99c222640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:10:01.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:10:01.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:01.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:01.927+0000 7f7925f23640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:10:01.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:01.928+0000 7f7925f23640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:10:01.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:01.928+0000 7f7925f23640 -1 bdev(0x5622d568b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:01.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:01.928+0000 7f7925f23640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:10:04.846 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:10:04.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:04.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:04.995+0000 7f338be18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:10:04.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:04.995+0000 7f338be18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:10:04.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:04.995+0000 7f338be18640 -1 bdev(0x561e0f293800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:04.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:10:04.996+0000 7f338be18640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:10:08.156 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:10:08.203 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:08.249 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:08.249 INFO:tasks.ceph:role: osd.4 2024-09-14T11:10:08.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:10:08.249 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:08.299 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:08.300 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:08.300 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:08.800 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-14T11:10:08.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-14T11:10:08.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:08.900 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:08.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:08.985 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:08.986 INFO:tasks.ceph:role: osd.5 2024-09-14T11:10:08.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:10:08.986 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:10:09.074 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:09.074 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:09.074 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:09.074 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:09.075 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:09.075 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:09.075 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:09.075 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:09.075 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:09.075 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:09.535 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-14T11:10:09.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-14T11:10:09.537 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:09.608 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:09.650 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:09.733 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:09.733 INFO:tasks.ceph:role: osd.6 2024-09-14T11:10:09.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:10:09.733 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:09.819 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:10.301 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-14T11:10:10.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-14T11:10:10.303 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:10.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:10.440 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:10.520 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:10.520 INFO:tasks.ceph:role: osd.7 2024-09-14T11:10:10.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:10:10.520 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:10:10.606 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:10.606 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:10.607 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:11.110 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-14T11:10:11.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-14T11:10:11.113 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:11.232 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:11.279 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:11.358 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:11.359+0000 7f588a60f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:10:11.358 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:11.359+0000 7f588a60f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:10:11.359 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:11.359+0000 7f588a60f640 -1 bdev(0x55e3c3c6b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:11.359 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:11.359+0000 7f588a60f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:10:15.008 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:15.052 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:15.116 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:15.116+0000 7f68a000d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:10:15.116 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:15.116+0000 7f68a000d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:10:15.116 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:15.116+0000 7f68a000d640 -1 bdev(0x55ecb6d09800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:15.116 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:15.116+0000 7f68a000d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:10:18.012 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:18.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:18.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:18.152+0000 7f5c3c20b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:10:18.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:18.152+0000 7f5c3c20b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:10:18.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:18.152+0000 7f5c3c20b640 -1 bdev(0x55637fe95800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:18.151 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:18.152+0000 7f5c3c20b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:10:21.058 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:21.097 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:21.197 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:21.199+0000 7ff986e85640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:10:21.197 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:21.199+0000 7ff986e85640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:10:21.198 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:21.199+0000 7ff986e85640 -1 bdev(0x563b112b1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:21.198 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:21.199+0000 7ff986e85640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:10:24.351 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:24.393 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:10:24.394 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:24.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:10:24.441 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:24.442 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:10:24.526 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:24.527 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:10:24.609 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:24.610 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:10:24.691 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:24.691 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:10:24.770 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:24.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:10:24.813 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:24.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:10:24.895 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:24.895 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:10:24.975 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:24.975 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:10:25.054 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:25.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:10:25.132 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:25.132 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:10:25.163 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:25.163 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:10:25.201 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:10:25.202 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:10:25.205 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:10:25.244 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.y] 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQABb+VmlPB7NxAAxcPgOX4xxnPeMgyS6lXTwg== 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQADb+Vm0JMQJRAARSIKfDHVFFHQuDldw6x8IQ== 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAGb+VmVegBNRAAlwfNAAP9wXviuER3yTudng== 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAJb+VmFb5pNxAAC98p8xuw2XXkU/mqUE3spg== 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAMb+Vm8MhiOxAAMyZJ1meEkxSJ7M6Ybf8gpQ== 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQACb+VmYCzdARAAkyctH4uvSx1gyDBODQLlOA== 2024-09-14T11:10:25.245 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQATb+VmQGmCFRAAVDq2leGdILVlCyBiCSqrHw== 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAXb+Vmo3oNBxAAPT811BQDogK/EtMyTDtT+A== 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.6] 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAab+VmFcseCRAAl5CvELDoUUWwV1c87uZpRw== 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.7] 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQAdb+Vmsc/qCxAAyW5bInPU2joxua2W5yzwVg== 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQACb+VmT0dxBRAAbT22oQFXrafvz8FYycVfpg== 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout:[client.1] 2024-09-14T11:10:25.246 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQACb+VmB2aCCRAAp8NU+ybZ8S2aLzKyXWlSSA== 2024-09-14T11:10:25.278 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-09-14T11:10:25.278 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQABb+VmlPB7NxAAxcPgOX4xxnPeMgyS6lXTwg== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQADb+Vm0JMQJRAARSIKfDHVFFHQuDldw6x8IQ== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAGb+VmVegBNRAAlwfNAAP9wXviuER3yTudng== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAJb+VmFb5pNxAAC98p8xuw2XXkU/mqUE3spg== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAMb+Vm8MhiOxAAMyZJ1meEkxSJ7M6Ybf8gpQ== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQACb+VmYCzdARAAkyctH4uvSx1gyDBODQLlOA== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQATb+VmQGmCFRAAVDq2leGdILVlCyBiCSqrHw== 2024-09-14T11:10:25.279 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAXb+Vmo3oNBxAAPT811BQDogK/EtMyTDtT+A== 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAab+VmFcseCRAAl5CvELDoUUWwV1c87uZpRw== 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQAdb+Vmsc/qCxAAyW5bInPU2joxua2W5yzwVg== 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQACb+VmT0dxBRAAbT22oQFXrafvz8FYycVfpg== 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2024-09-14T11:10:25.280 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQACb+VmB2aCCRAAp8NU+ybZ8S2aLzKyXWlSSA== 2024-09-14T11:10:25.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.290 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.386 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.389 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.454 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.456 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.521 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.523 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.587 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.590 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.656 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.721 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.723 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.788 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.791 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.856 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.858 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.925 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.992 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:25.994 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:26.062 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:26.064 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:26.132 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:10:26.132 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:10:26.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:10:26.284 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:10:26.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:10:26.403 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:10:26.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:10:26.553 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:10:26.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:10:26.702 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:10:26.741 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:26.744 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:26.810 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:10:26.811 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:10:26.811 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:10:26.815 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:10:26.815 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:10:26.815 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:10:26.817 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:10:26.817 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:10:26.817 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:10:26.852 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:10:26.853 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:10:26.853 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:10:26.853 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:10:26.856 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:10:26.856 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:10:26.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:10:26.859 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:10:26.859 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:10:26.860 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:10:26.860 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:10:27.217 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-09-14T11:10:27.229 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:10:27.229 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:10:27.229 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:27.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:10:27.269 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:27.269 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:10:27.349 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:27.350 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:10:27.430 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:10:27.430 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:10:27.510 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:27.510 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:10:27.549 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:27.549 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:10:27.628 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:27.629 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:10:27.708 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-14T11:10:27.708 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:10:27.788 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b8416495-1130-4d7b-aa59-50071b3432ef 0 2024-09-14T11:10:28.042 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-09-14T11:10:28.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4 1 2024-09-14T11:10:28.373 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-14T11:10:28.375+0000 7fc9fe7fc640 0 --2- 172.21.15.204:0/732990054 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fca000b4310 0x7fca0013db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:10:28.459 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-14T11:10:28.470 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 45921141-8cae-40d2-aa64-f56528d3172d 2 2024-09-14T11:10:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-09-14T11:10:28.689 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b641f1d9-0605-4c4b-a240-59434cb273fd 3 2024-09-14T11:10:28.887 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-09-14T11:10:28.898 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new f81bd758-4121-4351-aea4-5bad6cf7d6b9 4 2024-09-14T11:10:29.095 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-09-14T11:10:29.106 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 215f1f2d-0b18-4059-93f7-04e871599192 5 2024-09-14T11:10:29.304 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-09-14T11:10:29.315 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new a4cf560d-90ac-457e-b597-2497b8f0b72e 6 2024-09-14T11:10:29.530 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-09-14T11:10:29.542 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 78d4478d-f8b6-47cf-856e-aa3e4018d402 7 2024-09-14T11:10:29.742 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-09-14T11:10:29.753 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:10:29.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:10:29.756 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:10:29.756 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:10:29.756 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:10:29.758 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:10:29.758 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:10:29.758 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:10:29.760 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:10:29.761 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:10:29.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:10:29.763 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:10:29.763 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:10:29.763 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:10:29.765 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:10:29.765 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:10:29.765 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:10:29.767 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:10:29.767 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:10:29.767 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:10:29.769 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:10:29.769 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:10:29.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:10:29.772 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:10:29.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:29.986 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:29.987 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":10,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:10:29.737584+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:29.997 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:10:29.998 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:10:30.803 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:30.983 INFO:teuthology.misc.health.smithi028.stdout: 2024-09-14T11:10:30.983 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":10,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:10:29.737584+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:30.994 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:10:31.001 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-14T11:10:31.002+0000 7f7a69c0b640 -1 Falling back to public interface 2024-09-14T11:10:31.016 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-14T11:10:31.017+0000 7f1895a3e640 -1 Falling back to public interface 2024-09-14T11:10:31.026 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-14T11:10:31.027+0000 7f3837eda640 -1 Falling back to public interface 2024-09-14T11:10:31.229 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-14T11:10:31.230+0000 7f94bbc0b640 -1 Falling back to public interface 2024-09-14T11:10:31.260 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-14T11:10:31.260+0000 7ff728c39640 -1 Falling back to public interface 2024-09-14T11:10:31.263 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-14T11:10:31.264+0000 7f975e34b640 -1 Falling back to public interface 2024-09-14T11:10:31.327 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-14T11:10:31.328+0000 7f612c818640 -1 Falling back to public interface 2024-09-14T11:10:31.513 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-14T11:10:31.513+0000 7f1d3160f640 -1 Falling back to public interface 2024-09-14T11:10:32.456 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-14T11:10:32.458+0000 7fe7080e5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:10:32.456 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-14T11:10:32.458+0000 7fe7080e5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:10:34.750 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-14T11:10:34.751+0000 7f7a69c0b640 -1 osd.7 0 log_to_monitors true 2024-09-14T11:10:35.061 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-14T11:10:35.063+0000 7f3837eda640 -1 osd.4 0 log_to_monitors true 2024-09-14T11:10:35.069 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-14T11:10:35.069+0000 7f1d3160f640 -1 osd.3 0 log_to_monitors true 2024-09-14T11:10:35.122 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-14T11:10:35.123+0000 7f1895a3e640 -1 osd.2 0 log_to_monitors true 2024-09-14T11:10:35.199 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-14T11:10:35.200+0000 7f94bbc0b640 -1 osd.5 0 log_to_monitors true 2024-09-14T11:10:35.568 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-14T11:10:35.568+0000 7ff728c39640 -1 osd.1 0 log_to_monitors true 2024-09-14T11:10:35.604 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-14T11:10:35.605+0000 7f975e34b640 -1 osd.0 0 log_to_monitors true 2024-09-14T11:10:35.850 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-14T11:10:35.852+0000 7f612c818640 -1 osd.6 0 log_to_monitors true 2024-09-14T11:10:37.525 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-14T11:10:37.527+0000 7f18921e6640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:10:37.525 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-14T11:10:37.527+0000 7f1d2cef2640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:10:37.540 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-09-14T11:10:37.542+0000 7f18897f1640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:37.592 INFO:tasks.ceph.osd.3.smithi028.stderr:2024-09-14T11:10:37.594+0000 7f1d24d11640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:37.801 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:38.122 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-14T11:10:38.124+0000 7f3833e6e640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:10:38.136 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-14T11:10:38.138+0000 7f382bc8d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:38.297 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-14T11:10:38.299+0000 7f94b7dab640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:10:38.308 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-14T11:10:38.310+0000 7f94af3b6640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:38.337 INFO:teuthology.misc.health.smithi028.stdout: 2024-09-14T11:10:38.337 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":13,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:10:37.464597+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:38.351 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-14T11:10:38.352+0000 7f7a65dab640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:10:38.354 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:10:38.364 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-14T11:10:38.366+0000 7f7a5d3b6640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:38.508 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-14T11:10:38.510+0000 7f975a2df640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:10:38.519 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-14T11:10:38.521+0000 7ff724bcd640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:10:38.525 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-09-14T11:10:38.527+0000 7f97520fe640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:38.531 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-09-14T11:10:38.533+0000 7ff71c9ec640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:38.572 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-14T11:10:38.573+0000 7f6128181640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:10:38.586 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-14T11:10:38.588+0000 7f611ffa0640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:45.162 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:45.480 INFO:teuthology.misc.health.smithi028.stdout: 2024-09-14T11:10:45.481 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":17,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:10:41.531160+0000","last_up_change":"2024-09-14T11:10:39.523268+0000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:39.465616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6817","nonce":3465733102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6819","nonce":3465733102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6823","nonce":3465733102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6821","nonce":3465733102}]},"public_addr":"172.21.15.28:6817/3465733102","cluster_addr":"172.21.15.28:6819/3465733102","heartbeat_back_addr":"172.21.15.28:6823/3465733102","heartbeat_front_addr":"172.21.15.28:6821/3465733102","state":["exists","up"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6809","nonce":2721762421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6811","nonce":2721762421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6815","nonce":2721762421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6813","nonce":2721762421}]},"public_addr":"172.21.15.28:6809/2721762421","cluster_addr":"172.21.15.28:6811/2721762421","heartbeat_back_addr":"172.21.15.28:6815/2721762421","heartbeat_front_addr":"172.21.15.28:6813/2721762421","state":["exists","up"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6801","nonce":1746144465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6803","nonce":1746144465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6807","nonce":1746144465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6805","nonce":1746144465}]},"public_addr":"172.21.15.28:6801/1746144465","cluster_addr":"172.21.15.28:6803/1746144465","heartbeat_back_addr":"172.21.15.28:6807/1746144465","heartbeat_front_addr":"172.21.15.28:6805/1746144465","state":["exists","up"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6825","nonce":1073830879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6827","nonce":1073830879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6831","nonce":1073830879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6829","nonce":1073830879}]},"public_addr":"172.21.15.28:6825/1073830879","cluster_addr":"172.21.15.28:6827/1073830879","heartbeat_back_addr":"172.21.15.28:6831/1073830879","heartbeat_front_addr":"172.21.15.28:6829/1073830879","state":["exists","up"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6809","nonce":1365453965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6811","nonce":1365453965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6815","nonce":1365453965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6813","nonce":1365453965}]},"public_addr":"172.21.15.204:6809/1365453965","cluster_addr":"172.21.15.204:6811/1365453965","heartbeat_back_addr":"172.21.15.204:6815/1365453965","heartbeat_front_addr":"172.21.15.204:6813/1365453965","state":["exists","up"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6817","nonce":3569450741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6819","nonce":3569450741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6823","nonce":3569450741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6821","nonce":3569450741}]},"public_addr":"172.21.15.204:6817/3569450741","cluster_addr":"172.21.15.204:6819/3569450741","heartbeat_back_addr":"172.21.15.204:6823/3569450741","heartbeat_front_addr":"172.21.15.204:6821/3569450741","state":["exists","up"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6825","nonce":2343506808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6827","nonce":2343506808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6831","nonce":2343506808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6829","nonce":2343506808}]},"public_addr":"172.21.15.204:6825/2343506808","cluster_addr":"172.21.15.204:6827/2343506808","heartbeat_back_addr":"172.21.15.204:6831/2343506808","heartbeat_front_addr":"172.21.15.204:6829/2343506808","state":["exists","up"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6801","nonce":410575023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6803","nonce":410575023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6807","nonce":410575023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6805","nonce":410575023}]},"public_addr":"172.21.15.204:6801/410575023","cluster_addr":"172.21.15.204:6803/410575023","heartbeat_back_addr":"172.21.15.204:6807/410575023","heartbeat_front_addr":"172.21.15.204:6805/410575023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.613894+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.527572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.173448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.053011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.066609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.178584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.847197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:35.785567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:45.492 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:10:45.492 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:10:45.492 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:10:46.549 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'rbd' created 2024-09-14T11:10:46.566 DEBUG:teuthology.orchestra.run.smithi028:> rbd --cluster ceph pool init rbd 2024-09-14T11:10:46.630 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:46.630 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:49.572 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:10:49.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:10:49.573 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:10:49.897 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:49.909 INFO:teuthology.orchestra.run.smithi028.stdout:[{"version":9,"timestamp":"2024-09-14T11:10:38.575177+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6378.159929"}]}] 2024-09-14T11:10:49.910 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:10:49.910 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:10:49.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:10:49.910 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:10:50.279 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:50.290 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3733252066},{"type":"v1","addr":"172.21.15.204:6833","nonce":3733252066}]},"active_addr":"172.21.15.204:6833/3733252066","active_change":"2024-09-14T11:10:31.445729+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2447110674}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2365479041}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":1941152573}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":3188670984}]}]} 2024-09-14T11:10:50.295 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:10:50.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:10:50.295 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:50.608 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:50.608 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:10:49.559011+0000","last_up_change":"2024-09-14T11:10:39.523268+0000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:39.465616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:10:45.809466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6817","nonce":3465733102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6819","nonce":3465733102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6823","nonce":3465733102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6821","nonce":3465733102}]},"public_addr":"172.21.15.28:6817/3465733102","cluster_addr":"172.21.15.28:6819/3465733102","heartbeat_back_addr":"172.21.15.28:6823/3465733102","heartbeat_front_addr":"172.21.15.28:6821/3465733102","state":["exists","up"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6809","nonce":2721762421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6811","nonce":2721762421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6815","nonce":2721762421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6813","nonce":2721762421}]},"public_addr":"172.21.15.28:6809/2721762421","cluster_addr":"172.21.15.28:6811/2721762421","heartbeat_back_addr":"172.21.15.28:6815/2721762421","heartbeat_front_addr":"172.21.15.28:6813/2721762421","state":["exists","up"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6801","nonce":1746144465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6803","nonce":1746144465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6807","nonce":1746144465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6805","nonce":1746144465}]},"public_addr":"172.21.15.28:6801/1746144465","cluster_addr":"172.21.15.28:6803/1746144465","heartbeat_back_addr":"172.21.15.28:6807/1746144465","heartbeat_front_addr":"172.21.15.28:6805/1746144465","state":["exists","up"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6825","nonce":1073830879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6827","nonce":1073830879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6831","nonce":1073830879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6829","nonce":1073830879}]},"public_addr":"172.21.15.28:6825/1073830879","cluster_addr":"172.21.15.28:6827/1073830879","heartbeat_back_addr":"172.21.15.28:6831/1073830879","heartbeat_front_addr":"172.21.15.28:6829/1073830879","state":["exists","up"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6809","nonce":1365453965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6811","nonce":1365453965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6815","nonce":1365453965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6813","nonce":1365453965}]},"public_addr":"172.21.15.204:6809/1365453965","cluster_addr":"172.21.15.204:6811/1365453965","heartbeat_back_addr":"172.21.15.204:6815/1365453965","heartbeat_front_addr":"172.21.15.204:6813/1365453965","state":["exists","up"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6817","nonce":3569450741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6819","nonce":3569450741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6823","nonce":3569450741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6821","nonce":3569450741}]},"public_addr":"172.21.15.204:6817/3569450741","cluster_addr":"172.21.15.204:6819/3569450741","heartbeat_back_addr":"172.21.15.204:6823/3569450741","heartbeat_front_addr":"172.21.15.204:6821/3569450741","state":["exists","up"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6825","nonce":2343506808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6827","nonce":2343506808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6831","nonce":2343506808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6829","nonce":2343506808}]},"public_addr":"172.21.15.204:6825/2343506808","cluster_addr":"172.21.15.204:6827/2343506808","heartbeat_back_addr":"172.21.15.204:6831/2343506808","heartbeat_front_addr":"172.21.15.204:6829/2343506808","state":["exists","up"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6801","nonce":410575023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6803","nonce":410575023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6807","nonce":410575023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6805","nonce":410575023}]},"public_addr":"172.21.15.204:6801/410575023","cluster_addr":"172.21.15.204:6803/410575023","heartbeat_back_addr":"172.21.15.204:6807/410575023","heartbeat_front_addr":"172.21.15.204:6805/410575023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.613894+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.527572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.173448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.053011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.066609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.178584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.847197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:35.785567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:50.621 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:10:50.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:50.934 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:50.934 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:10:49.559011+0000","last_up_change":"2024-09-14T11:10:39.523268+0000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:39.465616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:10:45.809466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6817","nonce":3465733102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6819","nonce":3465733102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6823","nonce":3465733102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6821","nonce":3465733102}]},"public_addr":"172.21.15.28:6817/3465733102","cluster_addr":"172.21.15.28:6819/3465733102","heartbeat_back_addr":"172.21.15.28:6823/3465733102","heartbeat_front_addr":"172.21.15.28:6821/3465733102","state":["exists","up"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6809","nonce":2721762421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6811","nonce":2721762421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6815","nonce":2721762421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6813","nonce":2721762421}]},"public_addr":"172.21.15.28:6809/2721762421","cluster_addr":"172.21.15.28:6811/2721762421","heartbeat_back_addr":"172.21.15.28:6815/2721762421","heartbeat_front_addr":"172.21.15.28:6813/2721762421","state":["exists","up"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6801","nonce":1746144465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6803","nonce":1746144465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6807","nonce":1746144465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6805","nonce":1746144465}]},"public_addr":"172.21.15.28:6801/1746144465","cluster_addr":"172.21.15.28:6803/1746144465","heartbeat_back_addr":"172.21.15.28:6807/1746144465","heartbeat_front_addr":"172.21.15.28:6805/1746144465","state":["exists","up"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6825","nonce":1073830879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6827","nonce":1073830879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6831","nonce":1073830879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6829","nonce":1073830879}]},"public_addr":"172.21.15.28:6825/1073830879","cluster_addr":"172.21.15.28:6827/1073830879","heartbeat_back_addr":"172.21.15.28:6831/1073830879","heartbeat_front_addr":"172.21.15.28:6829/1073830879","state":["exists","up"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6809","nonce":1365453965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6811","nonce":1365453965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6815","nonce":1365453965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6813","nonce":1365453965}]},"public_addr":"172.21.15.204:6809/1365453965","cluster_addr":"172.21.15.204:6811/1365453965","heartbeat_back_addr":"172.21.15.204:6815/1365453965","heartbeat_front_addr":"172.21.15.204:6813/1365453965","state":["exists","up"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6817","nonce":3569450741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6819","nonce":3569450741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6823","nonce":3569450741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6821","nonce":3569450741}]},"public_addr":"172.21.15.204:6817/3569450741","cluster_addr":"172.21.15.204:6819/3569450741","heartbeat_back_addr":"172.21.15.204:6823/3569450741","heartbeat_front_addr":"172.21.15.204:6821/3569450741","state":["exists","up"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6825","nonce":2343506808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6827","nonce":2343506808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6831","nonce":2343506808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6829","nonce":2343506808}]},"public_addr":"172.21.15.204:6825/2343506808","cluster_addr":"172.21.15.204:6827/2343506808","heartbeat_back_addr":"172.21.15.204:6831/2343506808","heartbeat_front_addr":"172.21.15.204:6829/2343506808","state":["exists","up"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6801","nonce":410575023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6803","nonce":410575023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6807","nonce":410575023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6805","nonce":410575023}]},"public_addr":"172.21.15.204:6801/410575023","cluster_addr":"172.21.15.204:6803/410575023","heartbeat_back_addr":"172.21.15.204:6807/410575023","heartbeat_front_addr":"172.21.15.204:6805/410575023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.613894+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.527572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.173448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.053011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.066609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.178584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.847197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:35.785567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:50.947 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:10:50.947 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:10:50.947 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:10:50.948 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:10:50.948 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:10:50.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:10:50.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:10:50.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:10:51.222 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2024-09-14T11:10:51.222 INFO:teuthology.orchestra.run.smithi028.stdout:60129542149 2024-09-14T11:10:51.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:10:51.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:10:51.224 INFO:teuthology.orchestra.run.smithi028.stdout:60129542148 2024-09-14T11:10:51.225 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:10:51.226 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2024-09-14T11:10:51.226 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:10:51.227 INFO:teuthology.orchestra.run.smithi028.stdout:60129542149 2024-09-14T11:10:51.227 INFO:teuthology.orchestra.run.smithi028.stdout:60129542150 2024-09-14T11:10:51.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:10:51.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:10:51.229 INFO:teuthology.orchestra.run.smithi028.stdout:60129542149 2024-09-14T11:10:51.230 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:10:51.231 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2024-09-14T11:10:51.231 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:10:51.842 INFO:teuthology.orchestra.run.smithi028.stdout:60129542149 2024-09-14T11:10:51.853 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2024-09-14T11:10:51.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-14T11:10:51.863 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-14T11:10:51.876 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.881 INFO:teuthology.orchestra.run.smithi028.stdout:60129542148 2024-09-14T11:10:51.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-09-14T11:10:51.895 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.896 INFO:teuthology.orchestra.run.smithi028.stdout:60129542149 2024-09-14T11:10:51.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-14T11:10:51.910 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.914 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2024-09-14T11:10:51.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-14T11:10:51.931 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.932 INFO:teuthology.orchestra.run.smithi028.stdout:60129542149 2024-09-14T11:10:51.932 INFO:teuthology.orchestra.run.smithi028.stdout:60129542150 2024-09-14T11:10:51.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-14T11:10:51.946 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2024-09-14T11:10:51.947 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-14T11:10:51.949 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-14T11:10:51.960 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:51.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:10:51.960 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:10:52.311 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:52.311 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T11:10:52.323 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T11:10:51.922204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252324,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722396,"statfs":{"total":773094113280,"available":772835733504,"internally_reserved":0,"allocated":2867200,"data_stored":1750462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.468564"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.566365+0000","last_change":"2024-09-14T11:10:49.566365+0000","last_active":"2024-09-14T11:10:49.566365+0000","last_peered":"2024-09-14T11:10:49.566365+0000","last_clean":"2024-09-14T11:10:49.566365+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T11:10:49.566365+0000","last_undegraded":"2024-09-14T11:10:49.566365+0000","last_fullsized":"2024-09-14T11:10:49.566365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:17.078627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.565917+0000","last_change":"2024-09-14T11:10:49.565917+0000","last_active":"2024-09-14T11:10:49.565917+0000","last_peered":"2024-09-14T11:10:49.565917+0000","last_clean":"2024-09-14T11:10:49.565917+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T11:10:49.565917+0000","last_undegraded":"2024-09-14T11:10:49.565917+0000","last_fullsized":"2024-09-14T11:10:49.565917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.682606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.784688+0000","last_change":"2024-09-14T11:10:49.784939+0000","last_active":"2024-09-14T11:10:49.784688+0000","last_peered":"2024-09-14T11:10:49.784688+0000","last_clean":"2024-09-14T11:10:49.784688+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T11:10:49.784688+0000","last_undegraded":"2024-09-14T11:10:49.784688+0000","last_fullsized":"2024-09-14T11:10:49.784688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:20.447651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.565862+0000","last_change":"2024-09-14T11:10:49.565862+0000","last_active":"2024-09-14T11:10:49.565862+0000","last_peered":"2024-09-14T11:10:49.565862+0000","last_clean":"2024-09-14T11:10:49.565862+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T11:10:49.565862+0000","last_undegraded":"2024-09-14T11:10:49.565862+0000","last_fullsized":"2024-09-14T11:10:49.565862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:23.143257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.566261+0000","last_change":"2024-09-14T11:10:49.566261+0000","last_active":"2024-09-14T11:10:49.566261+0000","last_peered":"2024-09-14T11:10:49.566261+0000","last_clean":"2024-09-14T11:10:49.566261+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T11:10:49.566261+0000","last_undegraded":"2024-09-14T11:10:49.566261+0000","last_fullsized":"2024-09-14T11:10:49.566261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:49.383472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:50.167814+0000","last_change":"2024-09-14T11:10:50.167984+0000","last_active":"2024-09-14T11:10:50.167814+0000","last_peered":"2024-09-14T11:10:50.167814+0000","last_clean":"2024-09-14T11:10:50.167814+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T11:10:50.167814+0000","last_undegraded":"2024-09-14T11:10:50.167814+0000","last_fullsized":"2024-09-14T11:10:50.167814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:56.618404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.784736+0000","last_change":"2024-09-14T11:10:49.784961+0000","last_active":"2024-09-14T11:10:49.784736+0000","last_peered":"2024-09-14T11:10:49.784736+0000","last_clean":"2024-09-14T11:10:49.784736+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T11:10:49.784736+0000","last_undegraded":"2024-09-14T11:10:49.784736+0000","last_fullsized":"2024-09-14T11:10:49.784736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:46.921965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.566009+0000","last_change":"2024-09-14T11:10:49.566289+0000","last_active":"2024-09-14T11:10:49.566009+0000","last_peered":"2024-09-14T11:10:49.566009+0000","last_clean":"2024-09-14T11:10:49.566009+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T11:10:49.566009+0000","last_undegraded":"2024-09-14T11:10:49.566009+0000","last_fullsized":"2024-09-14T11:10:49.566009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:43.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.784399+0000","last_change":"2024-09-14T11:10:40.558361+0000","last_active":"2024-09-14T11:10:49.784399+0000","last_peered":"2024-09-14T11:10:49.784399+0000","last_clean":"2024-09-14T11:10:49.784399+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T11:10:49.784399+0000","last_undegraded":"2024-09-14T11:10:49.784399+0000","last_fullsized":"2024-09-14T11:10:49.784399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_clean_scrub_stamp":"2024-09-14T11:10:39.523268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:36.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:10:52.324 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:10:52.633 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:52.633 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T11:10:52.644 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T11:10:51.922204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252324,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722396,"statfs":{"total":773094113280,"available":772835733504,"internally_reserved":0,"allocated":2867200,"data_stored":1750462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.468564"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.566365+0000","last_change":"2024-09-14T11:10:49.566365+0000","last_active":"2024-09-14T11:10:49.566365+0000","last_peered":"2024-09-14T11:10:49.566365+0000","last_clean":"2024-09-14T11:10:49.566365+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T11:10:49.566365+0000","last_undegraded":"2024-09-14T11:10:49.566365+0000","last_fullsized":"2024-09-14T11:10:49.566365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:17.078627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.565917+0000","last_change":"2024-09-14T11:10:49.565917+0000","last_active":"2024-09-14T11:10:49.565917+0000","last_peered":"2024-09-14T11:10:49.565917+0000","last_clean":"2024-09-14T11:10:49.565917+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T11:10:49.565917+0000","last_undegraded":"2024-09-14T11:10:49.565917+0000","last_fullsized":"2024-09-14T11:10:49.565917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.682606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.784688+0000","last_change":"2024-09-14T11:10:49.784939+0000","last_active":"2024-09-14T11:10:49.784688+0000","last_peered":"2024-09-14T11:10:49.784688+0000","last_clean":"2024-09-14T11:10:49.784688+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T11:10:49.784688+0000","last_undegraded":"2024-09-14T11:10:49.784688+0000","last_fullsized":"2024-09-14T11:10:49.784688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:20.447651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.565862+0000","last_change":"2024-09-14T11:10:49.565862+0000","last_active":"2024-09-14T11:10:49.565862+0000","last_peered":"2024-09-14T11:10:49.565862+0000","last_clean":"2024-09-14T11:10:49.565862+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T11:10:49.565862+0000","last_undegraded":"2024-09-14T11:10:49.565862+0000","last_fullsized":"2024-09-14T11:10:49.565862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:23.143257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.566261+0000","last_change":"2024-09-14T11:10:49.566261+0000","last_active":"2024-09-14T11:10:49.566261+0000","last_peered":"2024-09-14T11:10:49.566261+0000","last_clean":"2024-09-14T11:10:49.566261+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T11:10:49.566261+0000","last_undegraded":"2024-09-14T11:10:49.566261+0000","last_fullsized":"2024-09-14T11:10:49.566261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:49.383472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:50.167814+0000","last_change":"2024-09-14T11:10:50.167984+0000","last_active":"2024-09-14T11:10:50.167814+0000","last_peered":"2024-09-14T11:10:50.167814+0000","last_clean":"2024-09-14T11:10:50.167814+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T11:10:50.167814+0000","last_undegraded":"2024-09-14T11:10:50.167814+0000","last_fullsized":"2024-09-14T11:10:50.167814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:56.618404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.784736+0000","last_change":"2024-09-14T11:10:49.784961+0000","last_active":"2024-09-14T11:10:49.784736+0000","last_peered":"2024-09-14T11:10:49.784736+0000","last_clean":"2024-09-14T11:10:49.784736+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T11:10:49.784736+0000","last_undegraded":"2024-09-14T11:10:49.784736+0000","last_fullsized":"2024-09-14T11:10:49.784736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:46.921965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.566009+0000","last_change":"2024-09-14T11:10:49.566289+0000","last_active":"2024-09-14T11:10:49.566009+0000","last_peered":"2024-09-14T11:10:49.566009+0000","last_clean":"2024-09-14T11:10:49.566009+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T11:10:49.566009+0000","last_undegraded":"2024-09-14T11:10:49.566009+0000","last_fullsized":"2024-09-14T11:10:49.566009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:43.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:49.784399+0000","last_change":"2024-09-14T11:10:40.558361+0000","last_active":"2024-09-14T11:10:49.784399+0000","last_peered":"2024-09-14T11:10:49.784399+0000","last_clean":"2024-09-14T11:10:49.784399+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T11:10:49.784399+0000","last_undegraded":"2024-09-14T11:10:49.784399+0000","last_fullsized":"2024-09-14T11:10:49.784399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_clean_scrub_stamp":"2024-09-14T11:10:39.523268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:36.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:10:52.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:10:52.645 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:10:52.645 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:10:52.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:10:52.994 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:10:52.994 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:10:53.007 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:10:53.007 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:10:53.019 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:10:53.055 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T11:10:53.055 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:10:53.056 INFO:tasks.rgw:Creating data pools 2024-09-14T11:10:53.056 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:10:53.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-14T11:10:53.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T11:10:55.581 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:10:55.607 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:10:56.583 INFO:teuthology.orchestra.run.smithi028.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:10:56.625 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:10:57.584 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:10:57.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:10:58.586 INFO:teuthology.orchestra.run.smithi028.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:10:58.626 DEBUG:tasks.rgw:Pools created 2024-09-14T11:10:58.626 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:10:58.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:10:58.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:10:58.627 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:10:58.735 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:58.736 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:00.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.642+0000 7f306f64f640 0 -- 172.21.15.28:0/600730348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556bdebe1de0 msgr2=0x556bdebe2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:00.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.648+0000 7f306fe50640 0 -- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556bdebec100 msgr2=0x556bdebf2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:00.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.651+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:00.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 realm 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.653+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.654+0000 7f307392a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:00.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.654+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.655+0000 7f307392a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:11:00.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.655+0000 7f307392a800 20 searching for the correct realm 2024-09-14T11:11:00.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:00.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.667+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:00.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:11:00.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 zone default found 2024-09-14T11:11:00.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 4 Realm: () 2024-09-14T11:11:00.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:11:00.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:11:00.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:00.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 zonegroup default 2024-09-14T11:11:00.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:00.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:00.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:00.668+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:02.617+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:02.617+0000 7f307392a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:02.620+0000 7f307392a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:02.620+0000 7f307392a800 20 started sync module instance, tier type = 2024-09-14T11:11:02.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:02.620+0000 7f307392a800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=0 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=1 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=2 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=3 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=4 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=5 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.652+0000 7f307392a800 20 add_watcher() i=6 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.653+0000 7f307392a800 20 add_watcher() i=7 2024-09-14T11:11:04.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.653+0000 7f307392a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:04.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:11:04.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:11:04.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.654+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:11:04.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:11:04.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:11:04.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:11:04.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.655+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:11:04.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:11:04.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:11:04.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.656+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.657+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:11:04.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:11:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:11:04.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.658+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.659+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:11:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:11:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.660+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:11:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:11:04.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:11:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:11:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.661+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.662+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.663+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:11:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:11:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:11:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:11:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.664+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.665+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:11:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.666+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:11:04.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.667+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:11:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:11:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.668+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.669+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:11:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.670+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:11:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.671+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.672+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:11:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.673+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:11:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:11:04.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:11:04.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:11:04.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.674+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:11:04.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.675+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.676+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:11:04.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.677+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:11:04.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.678+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.679+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:11:04.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.680+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:11:04.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.681+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:11:04.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:11:04.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:11:04.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.682+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:11:04.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.683+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.684+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.685+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:11:04.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.686+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.687+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:11:04.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.688+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.689+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:11:04.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.691+0000 7f307392a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:04.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.695+0000 7f2f1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:04.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.695+0000 7f307392a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:04.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:04.695+0000 7f307392a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.637+0000 7f307392a800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:11:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.637+0000 7f307392a800 5 note: GC not initialized 2024-09-14T11:11:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.638+0000 7f2f1cfe1640 20 reqs_thread_entry: start 2024-09-14T11:11:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.638+0000 7f307392a800 20 init_complete bucket index max shards: 1 2024-09-14T11:11:07.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.638+0000 7f307392a800 20 Filter name: none 2024-09-14T11:11:07.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.638+0000 7f2e867fc640 20 reqs_thread_entry: start 2024-09-14T11:11:07.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.665+0000 7f2f1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:07.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.668+0000 7f307392a800 20 remove_watcher() i=0 2024-09-14T11:11:07.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.668+0000 7f307392a800 2 removed watcher, disabling cache 2024-09-14T11:11:07.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.669+0000 7f307392a800 20 remove_watcher() i=1 2024-09-14T11:11:07.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.671+0000 7f307392a800 20 remove_watcher() i=2 2024-09-14T11:11:07.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.675+0000 7f307392a800 20 remove_watcher() i=3 2024-09-14T11:11:07.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.676+0000 7f307392a800 20 remove_watcher() i=4 2024-09-14T11:11:07.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.678+0000 7f307392a800 20 remove_watcher() i=5 2024-09-14T11:11:07.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.679+0000 7f307392a800 20 remove_watcher() i=6 2024-09-14T11:11:07.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.680+0000 7f307392a800 20 remove_watcher() i=7 2024-09-14T11:11:07.707 INFO:teuthology.orchestra.run.smithi028.stdout:[] 2024-09-14T11:11:07.707 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:11:07.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:11:07.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:11:07.708 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:11:07.775 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:07.776 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:07.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.804+0000 7efdcc02f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:07.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.804+0000 7efdcc02f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:07.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.809+0000 7efc867fc640 20 reqs_thread_entry: start 2024-09-14T11:11:07.825 INFO:teuthology.orchestra.run.smithi028.stdout:{"id":"ee44e0ea-0921-4c74-bba9-e7ba41eeb320","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:11:07.825 DEBUG:tasks.util.rgw: json result: {'id': 'ee44e0ea-0921-4c74-bba9-e7ba41eeb320', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:11:07.825 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:11:07.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:11:07.825 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:11:07.882 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:07.883 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:07.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.918+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:07.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:07.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 realm 2024-09-14T11:11:07.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:07.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:07.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.920+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.921+0000 7f39c5e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.921+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.921+0000 7f39c5e2f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:11:07.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.921+0000 7f39c5e2f800 20 searching for the correct realm 2024-09-14T11:11:07.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:07.926+0000 7f39c4121640 0 -- 172.21.15.28:0/2944754058 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f39b809b3f0 msgr2=0x7f39b809b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:08.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.132+0000 7f39c3920640 0 -- 172.21.15.28:0/2944754058 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x55e65f2f1cf0 msgr2=0x55e65f2f41b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:08.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:11:08.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:08.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:08.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:11:08.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.135+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 zone default found 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 4 Realm: () 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:08.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 zonegroup default 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.136+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.137+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.137+0000 7f39c5e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.137+0000 7f39c5e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.137+0000 7f39c5e2f800 20 started sync module instance, tier type = 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.137+0000 7f39c5e2f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.152+0000 7f39c5e2f800 20 add_watcher() i=0 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.152+0000 7f39c5e2f800 20 add_watcher() i=1 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.152+0000 7f39c5e2f800 20 add_watcher() i=2 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.152+0000 7f39c5e2f800 20 add_watcher() i=3 2024-09-14T11:11:08.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.154+0000 7f39c5e2f800 20 add_watcher() i=4 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.154+0000 7f39c5e2f800 20 add_watcher() i=5 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.154+0000 7f39c5e2f800 20 add_watcher() i=6 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.154+0000 7f39c5e2f800 20 add_watcher() i=7 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.154+0000 7f39c5e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.155+0000 7f3879fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f39c5e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f39c5e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f39c5e2f800 5 note: GC not initialized 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f3878fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:08.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f39c5e2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f39c5e2f800 20 Filter name: none 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.156+0000 7f37f27fc640 20 reqs_thread_entry: start 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.166+0000 7f3879fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.169+0000 7f39c5e2f800 20 remove_watcher() i=0 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.169+0000 7f39c5e2f800 2 removed watcher, disabling cache 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.170+0000 7f39c5e2f800 20 remove_watcher() i=1 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.172+0000 7f39c5e2f800 20 remove_watcher() i=2 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.173+0000 7f39c5e2f800 20 remove_watcher() i=3 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.174+0000 7f39c5e2f800 20 remove_watcher() i=4 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.175+0000 7f39c5e2f800 20 remove_watcher() i=5 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.176+0000 7f39c5e2f800 20 remove_watcher() i=6 2024-09-14T11:11:08.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.177+0000 7f39c5e2f800 20 remove_watcher() i=7 2024-09-14T11:11:08.294 INFO:teuthology.orchestra.run.smithi028.stdout:[] 2024-09-14T11:11:08.295 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:11:08.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T11:11:08.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T11:11:08.295 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T11:11:08.363 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:08.364 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:08.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.391+0000 7f4e93535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:08.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.391+0000 7f4e93535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:08.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.395+0000 7f4d0dffb640 20 reqs_thread_entry: start 2024-09-14T11:11:08.411 INFO:teuthology.orchestra.run.smithi028.stdout:{"id":"ee44e0ea-0921-4c74-bba9-e7ba41eeb320","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:11:08.411 DEBUG:tasks.util.rgw: json result: {'id': 'ee44e0ea-0921-4c74-bba9-e7ba41eeb320', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:11:08.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:11:08.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:11:08.412 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:11:08.470 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:08.470 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:08.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.504+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.506+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.506+0000 7f2c4bb23800 20 realm 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.506+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.506+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.506+0000 7f2c4bb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.506+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.507+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.507+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.507+0000 7f2c4bb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:08.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.507+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.508+0000 7f2c4bb23800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:11:08.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.508+0000 7f2c4bb23800 20 searching for the correct realm 2024-09-14T11:11:08.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.511+0000 7f2c3f00b640 0 -- 172.21.15.28:0/2268032574 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f2c38091310 msgr2=0x7f2c3803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:08.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.515+0000 7f2c4780c640 0 -- 172.21.15.28:0/2268032574 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f2c30067f30 msgr2=0x7f2c3006e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.721+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:08.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 zone default found 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 4 Realm: () 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 zonegroup default 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.722+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 rados->read ofs=0 len=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:08.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 started sync module instance, tier type = 2024-09-14T11:11:08.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.723+0000 7f2c4bb23800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=0 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=1 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=2 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=3 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=4 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=5 2024-09-14T11:11:08.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.735+0000 7f2c4bb23800 20 add_watcher() i=6 2024-09-14T11:11:08.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.736+0000 7f2c4bb23800 20 add_watcher() i=7 2024-09-14T11:11:08.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.736+0000 7f2c4bb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.738+0000 7f2afdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.738+0000 7f2c4bb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.738+0000 7f2c4bb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.738+0000 7f2c4bb23800 5 note: GC not initialized 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.739+0000 7f2afcfe1640 20 reqs_thread_entry: start 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.739+0000 7f2c4bb23800 20 init_complete bucket index max shards: 1 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.739+0000 7f2c4bb23800 20 Filter name: none 2024-09-14T11:11:08.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.739+0000 7f2a767fc640 20 reqs_thread_entry: start 2024-09-14T11:11:08.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.748+0000 7f2afdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:08.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.751+0000 7f2c4bb23800 20 remove_watcher() i=0 2024-09-14T11:11:08.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.751+0000 7f2c4bb23800 2 removed watcher, disabling cache 2024-09-14T11:11:08.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.752+0000 7f2c4bb23800 20 remove_watcher() i=1 2024-09-14T11:11:08.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.753+0000 7f2c4bb23800 20 remove_watcher() i=2 2024-09-14T11:11:08.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.754+0000 7f2c4bb23800 20 remove_watcher() i=3 2024-09-14T11:11:08.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.755+0000 7f2c4bb23800 20 remove_watcher() i=4 2024-09-14T11:11:08.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.756+0000 7f2c4bb23800 20 remove_watcher() i=5 2024-09-14T11:11:08.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.757+0000 7f2c4bb23800 20 remove_watcher() i=6 2024-09-14T11:11:08.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.758+0000 7f2c4bb23800 20 remove_watcher() i=7 2024-09-14T11:11:08.768 INFO:teuthology.orchestra.run.smithi028.stdout:[] 2024-09-14T11:11:08.768 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:11:08.769 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:11:08.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:11:08.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:11:08.769 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:11:08.833 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:08.834 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:08.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.861+0000 7f8fca746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:08.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.861+0000 7f8fca746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.865+0000 7f8e867fc640 20 reqs_thread_entry: start 2024-09-14T11:11:08.880 INFO:teuthology.orchestra.run.smithi028.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:11:08.880 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:11:08.880 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:11:08.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:11:08.880 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:11:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:08.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.973+0000 7fae4a340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:08.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.973+0000 7fae4a340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:08.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:08.977+0000 7fad08fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:08.993 INFO:teuthology.orchestra.run.smithi028.stdout:{"id":"ee44e0ea-0921-4c74-bba9-e7ba41eeb320","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:11:08.993 DEBUG:tasks.util.rgw: json result: {'id': 'ee44e0ea-0921-4c74-bba9-e7ba41eeb320', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:11:08.993 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:11:08.993 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:11:08.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:11:08.994 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:11:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:09.057 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:09.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:09.085+0000 7f9e34725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:09.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:09.085+0000 7f9e34725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:09.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:09.089+0000 7f9c8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:09.103 INFO:teuthology.orchestra.run.smithi028.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:11:09.103 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:11:09.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:11:09.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:11:09.103 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:11:09.169 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:09.169 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:09.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:09.197+0000 7fa143f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:09.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:09.197+0000 7fa143f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:09.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:11:09.201+0000 7f9f9dffb640 20 reqs_thread_entry: start 2024-09-14T11:11:09.216 INFO:teuthology.orchestra.run.smithi028.stdout:{"id":"ee44e0ea-0921-4c74-bba9-e7ba41eeb320","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T11:11:09.217 DEBUG:tasks.util.rgw: json result: {'id': 'ee44e0ea-0921-4c74-bba9-e7ba41eeb320', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T11:11:09.217 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:11:09.217 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T11:11:09.217 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:11:09.217 DEBUG:teuthology.orchestra.run.smithi028:> sudo echo -n http://smithi028.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:11:09.257 INFO:teuthology.orchestra.run.smithi028.stdout:http://smithi028.front.sepia.ceph.com:80 2024-09-14T11:11:09.258 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:11:09.337 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T11:11:09.337 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:11:09.338 DEBUG:teuthology.orchestra.run.smithi028:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:11:09.380 INFO:tasks.rgw.client.0:Started 2024-09-14T11:11:09.380 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:09.380 DEBUG:teuthology.orchestra.run.smithi028:> curl http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:09.426 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:11:09.427 INFO:teuthology.orchestra.run.smithi028.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:09.427 INFO:teuthology.orchestra.run.smithi028.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:09.427 INFO:teuthology.orchestra.run.smithi028.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:11:09.427 INFO:teuthology.orchestra.run.smithi028.stderr:curl: (7) Failed to connect to smithi028.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:11:10.428 DEBUG:teuthology.orchestra.run.smithi028:> curl http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:10.462 INFO:teuthology.orchestra.run.smithi028.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:10.462 INFO:teuthology.orchestra.run.smithi028.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:10.464 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:11:10.464 INFO:teuthology.orchestra.run.smithi028.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:11:10.465 INFO:teuthology.orchestra.run.smithi028.stderr:curl: (7) Failed to connect to smithi028.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:11:12.466 DEBUG:teuthology.orchestra.run.smithi028:> curl http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:12.500 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:11:12.501 INFO:teuthology.orchestra.run.smithi028.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:12.501 INFO:teuthology.orchestra.run.smithi028.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:12.501 INFO:teuthology.orchestra.run.smithi028.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:11:12.501 INFO:teuthology.orchestra.run.smithi028.stderr:curl: (7) Failed to connect to smithi028.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:11:16.502 DEBUG:teuthology.orchestra.run.smithi028:> curl http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:16.537 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:11:16.538 INFO:teuthology.orchestra.run.smithi028.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:16.538 INFO:teuthology.orchestra.run.smithi028.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:16.538 INFO:teuthology.orchestra.run.smithi028.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:11:16.538 INFO:teuthology.orchestra.run.smithi028.stderr:curl: (7) Failed to connect to smithi028.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:11:24.539 DEBUG:teuthology.orchestra.run.smithi028:> curl http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:24.573 INFO:teuthology.orchestra.run.smithi028.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:24.573 INFO:teuthology.orchestra.run.smithi028.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:24.575 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:11:24.575 INFO:teuthology.orchestra.run.smithi028.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:11:24.575 INFO:teuthology.orchestra.run.smithi028.stderr:curl: (7) Failed to connect to smithi028.front.sepia.ceph.com port 80: Connection refused 2024-09-14T11:11:40.576 DEBUG:teuthology.orchestra.run.smithi028:> curl http://smithi028.front.sepia.ceph.com:80/ 2024-09-14T11:11:40.616 INFO:teuthology.orchestra.run.smithi028.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:40.616 INFO:teuthology.orchestra.run.smithi028.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:40.939 INFO:teuthology.orchestra.run.smithi028.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 578 0 --:--:-- --:--:-- --:--:-- 578 2024-09-14T11:11:40.939 INFO:teuthology.orchestra.run.smithi028.stdout:anonymous 2024-09-14T11:11:40.940 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:11:40.952 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:11:40.953 DEBUG:teuthology.orchestra.run.smithi028:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:11:43.348 DEBUG:teuthology.orchestra.run.smithi028:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:11:43.882 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting tox==3.15.0 2024-09-14T11:11:43.930 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:11:44.256 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:11:44.270 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:11:44.513 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting toml>=0.9.4 2024-09-14T11:11:44.527 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:11:44.645 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:11:44.658 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:11:44.751 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:11:44.765 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:11:44.867 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting packaging>=14 2024-09-14T11:11:44.880 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:11:44.976 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:11:44.990 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:11:45.073 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:11:45.087 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:11:45.234 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:11:45.249 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:11:45.338 INFO:teuthology.orchestra.run.smithi028.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:11:45.353 INFO:teuthology.orchestra.run.smithi028.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:11:45.481 INFO:teuthology.orchestra.run.smithi028.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T11:11:46.319 INFO:teuthology.orchestra.run.smithi028.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:11:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T11:11:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T11:11:46.587 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:11:46.602 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:11:46.602 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:11:46.602 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:46.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:46.633 INFO:teuthology.orchestra.run.smithi028.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:11:46.633 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:46.704 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:46.704 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:11:46.773 INFO:tasks.workunit:timeout=3h 2024-09-14T11:11:46.773 INFO:tasks.workunit:cleanup=True 2024-09-14T11:11:46.774 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:11:46.844 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:12:43.814 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 95% (12261/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:12:44.429 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-09-14T11:12:44.430 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.431 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-09-14T11:12:44.431 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.431 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:12:44.431 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:44.431 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:12:44.432 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:12:44.514 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:12:44.517 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:12:44.517 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:12:45.141 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:12:45.213 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:12:45.254 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:12:45.256 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:12:45.256 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:12:45.296 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:12:45.300 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:12:45.300 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:12:45.370 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:12:45.371 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:12:45.372 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:12:45.444 INFO:tasks.workunit.client.0.smithi028.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:12:45.445 INFO:tasks.workunit.client.0.smithi028.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:45.445 INFO:tasks.workunit.client.0.smithi028.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ deactivate nondestructive 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ hash -r 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:12:47.836 INFO:tasks.workunit.client.0.smithi028.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ export VIRTUAL_ENV 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ export PATH 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -z '' ']' 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ PS1='(rgw) ' 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ export PS1 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:++ hash -r 2024-09-14T11:12:47.837 INFO:tasks.workunit.client.0.smithi028.stderr:+ pip install pip --upgrade 2024-09-14T11:12:48.075 INFO:tasks.workunit.client.0.smithi028.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:12:48.256 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting pip 2024-09-14T11:12:48.306 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:12:48.467 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: pip 2024-09-14T11:12:48.467 INFO:tasks.workunit.client.0.smithi028.stdout: Attempting uninstall: pip 2024-09-14T11:12:48.468 INFO:tasks.workunit.client.0.smithi028.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:12:48.649 INFO:tasks.workunit.client.0.smithi028.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:12:48.654 INFO:tasks.workunit.client.0.smithi028.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:12:49.435 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed pip-24.2 2024-09-14T11:12:49.694 INFO:tasks.workunit.client.0.smithi028.stderr:+ pip install boto3 2024-09-14T11:12:50.597 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting boto3 2024-09-14T11:12:50.638 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:12:51.323 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:12:51.337 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:12:51.464 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:12:51.478 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:12:51.604 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:12:51.619 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:12:51.747 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:12:51.760 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:12:51.910 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:12:51.924 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:12:52.211 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:12:52.225 INFO:tasks.workunit.client.0.smithi028.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:12:52.281 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:12:52.346 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:12:52.559 INFO:tasks.workunit.client.0.smithi028.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 61.2 MB/s eta 0:00:00 2024-09-14T11:12:52.574 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:12:52.637 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:12:52.705 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:12:52.772 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:12:52.839 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:12:52.970 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:12:54.031 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:12:54.149 INFO:tasks.workunit.client.0.smithi028.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:12:54.284 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:12:54.322 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:54.322 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:54.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.363+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 realm 2024-09-14T11:12:54.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:54.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.365+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.366+0000 7f61c2d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:54.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.366+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.366+0000 7f61c2d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:54.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.366+0000 7f61c2d2c800 20 searching for the correct realm 2024-09-14T11:12:54.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.370+0000 7f61be2d9640 0 -- 172.21.15.28:0/1340967829 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x56501a0ce6e0 msgr2=0x56501a0d0ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:54.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.374+0000 7f61beada640 0 -- 172.21.15.28:0/1340967829 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f61b4087880 msgr2=0x7f61b405f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:54.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:12:54.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:54.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:54.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:12:54.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:54.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:54.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.379+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 zone default found 2024-09-14T11:12:54.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 4 Realm: () 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 zonegroup default 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.380+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.381+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.381+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.381+0000 7f61c2d2c800 20 started sync module instance, tier type = 2024-09-14T11:12:54.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.381+0000 7f61c2d2c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=0 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=1 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=2 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=3 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=4 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=5 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.391+0000 7f61c2d2c800 20 add_watcher() i=6 2024-09-14T11:12:54.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.392+0000 7f61c2d2c800 20 add_watcher() i=7 2024-09-14T11:12:54.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.392+0000 7f61c2d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:54.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.394+0000 7f60757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.394+0000 7f61c2d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.394+0000 7f61c2d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.394+0000 7f61c2d2c800 5 note: GC not initialized 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f5feffff640 20 reqs_thread_entry: start 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 20 Filter name: none 2024-09-14T11:12:54.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f5fedffb640 20 reqs_thread_entry: start 2024-09-14T11:12:54.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:12:54.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:12:54.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.395+0000 7f61c2d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.396+0000 7f61c2d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.396+0000 7f61c2d2c800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.396+0000 7f61c2d2c800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.396+0000 7f61c2d2c800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.396+0000 7f61c2d2c800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.397+0000 7f61c2d2c800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:12:54.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.397+0000 7f61c2d2c800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:12:54.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.397+0000 7f61c2d2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:12:54.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.398+0000 7f60a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659136 cookie 94902034440576 notifier 4614 bl.length()=593 2024-09-14T11:12:54.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.398+0000 7f60a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:12:54.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.398+0000 7f60a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:12:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.424+0000 7f61c2d2c800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:12:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.424+0000 7f61c2d2c800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:12:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.424+0000 7f61c2d2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:12:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.425+0000 7f60a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659136 cookie 94902034433888 notifier 4614 bl.length()=186 2024-09-14T11:12:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.425+0000 7f60a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:12:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.425+0000 7f60a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:12:54.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.427+0000 7f60757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:54.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.429+0000 7f61c2d2c800 20 remove_watcher() i=0 2024-09-14T11:12:54.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.429+0000 7f61c2d2c800 2 removed watcher, disabling cache 2024-09-14T11:12:54.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.430+0000 7f61c2d2c800 20 remove_watcher() i=1 2024-09-14T11:12:54.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.432+0000 7f61c2d2c800 20 remove_watcher() i=2 2024-09-14T11:12:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.433+0000 7f61c2d2c800 20 remove_watcher() i=3 2024-09-14T11:12:54.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.434+0000 7f61c2d2c800 20 remove_watcher() i=4 2024-09-14T11:12:54.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.435+0000 7f61c2d2c800 20 remove_watcher() i=5 2024-09-14T11:12:54.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.436+0000 7f61c2d2c800 20 remove_watcher() i=6 2024-09-14T11:12:54.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:54.437+0000 7f61c2d2c800 20 remove_watcher() i=7 2024-09-14T11:12:56.302 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:12:56.302 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:56.304 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:12:56.334 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:56.334 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:56.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.375+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 realm 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.377+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.378+0000 7fcbf9c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:56.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.378+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.378+0000 7fcbf9c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:56.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.378+0000 7fcbf9c13800 20 searching for the correct realm 2024-09-14T11:12:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.381+0000 7fcbf5b49640 0 -- 172.21.15.28:0/206907293 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fcbec08d060 msgr2=0x7fcbec06da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:56.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.385+0000 7fcbf5348640 0 -- 172.21.15.28:0/206907293 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fcbec0b6a30 msgr2=0x7fcbec0adce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:56.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.794+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 zone default found 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 4 Realm: () 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:12:56.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.795+0000 7fcbf9c13800 20 zonegroup default 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 started sync module instance, tier type = 2024-09-14T11:12:56.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.796+0000 7fcbf9c13800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=0 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=1 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=2 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=3 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=4 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=5 2024-09-14T11:12:56.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.808+0000 7fcbf9c13800 20 add_watcher() i=6 2024-09-14T11:12:56.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.809+0000 7fcbf9c13800 20 add_watcher() i=7 2024-09-14T11:12:56.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.809+0000 7fcbf9c13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:56.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.811+0000 7fcaab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:56.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.811+0000 7fcbf9c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.811+0000 7fcbf9c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.811+0000 7fcbf9c13800 5 note: GC not initialized 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.811+0000 7fcaaa7e4640 20 reqs_thread_entry: start 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.811+0000 7fcbf9c13800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 20 Filter name: none 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fca1bfff640 20 reqs_thread_entry: start 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:56.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:56.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:56.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:12:56.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.812+0000 7fcbf9c13800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:56.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:12:56.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:12:56.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:56.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:56.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:12:56.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.813+0000 7fcbf9c13800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:12:56.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.818+0000 7fcaab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:56.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.820+0000 7fcbf9c13800 20 remove_watcher() i=0 2024-09-14T11:12:56.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.820+0000 7fcbf9c13800 2 removed watcher, disabling cache 2024-09-14T11:12:56.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.821+0000 7fcbf9c13800 20 remove_watcher() i=1 2024-09-14T11:12:56.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.823+0000 7fcbf9c13800 20 remove_watcher() i=2 2024-09-14T11:12:56.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.824+0000 7fcbf9c13800 20 remove_watcher() i=3 2024-09-14T11:12:56.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.825+0000 7fcbf9c13800 20 remove_watcher() i=4 2024-09-14T11:12:56.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.826+0000 7fcbf9c13800 20 remove_watcher() i=5 2024-09-14T11:12:56.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.827+0000 7fcbf9c13800 20 remove_watcher() i=6 2024-09-14T11:12:56.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.828+0000 7fcbf9c13800 20 remove_watcher() i=7 2024-09-14T11:12:56.839 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:12:56.870 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:56.870 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:56.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.912+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 realm 2024-09-14T11:12:56.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:56.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.914+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.915+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:56.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.915+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.915+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:56.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.915+0000 7f8c8bd32800 20 searching for the correct realm 2024-09-14T11:12:56.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.917+0000 7f8c879bc640 0 -- 172.21.15.28:0/4098163166 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x55893ac6fb30 msgr2=0x7f8c78056550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:56.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.922+0000 7f8c881bd640 0 -- 172.21.15.28:0/4098163166 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f8c70027040 msgr2=0x7f8c70077600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:56.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.927+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:56.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:56.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 zone default found 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 4 Realm: () 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 zonegroup default 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.928+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.929+0000 7f8c8bd32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.929+0000 7f8c8bd32800 20 started sync module instance, tier type = 2024-09-14T11:12:56.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.929+0000 7f8c8bd32800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:12:56.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=0 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=1 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=2 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=3 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=4 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=5 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.944+0000 7f8c8bd32800 20 add_watcher() i=6 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.945+0000 7f8c8bd32800 20 add_watcher() i=7 2024-09-14T11:12:56.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.945+0000 7f8c8bd32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:56.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.947+0000 7f8b3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.947+0000 7f8c8bd32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.947+0000 7f8c8bd32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.947+0000 7f8c8bd32800 5 note: GC not initialized 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.947+0000 7f8b3cfe1640 20 reqs_thread_entry: start 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.948+0000 7f8c8bd32800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.948+0000 7f8c8bd32800 20 Filter name: none 2024-09-14T11:12:56.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.948+0000 7f8ab67fc640 20 reqs_thread_entry: start 2024-09-14T11:12:56.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.948+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.948+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:56.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.948+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.949+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:56.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.949+0000 7f8c8bd32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:56.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.949+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.949+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:56.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.949+0000 7f8c8bd32800 20 rados->read ofs=0 len=0 2024-09-14T11:12:56.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.950+0000 7f8c8bd32800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:56.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.950+0000 7f8c8bd32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:56.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.951+0000 7f8b3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:56.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.956+0000 7f8c8bd32800 20 remove_watcher() i=0 2024-09-14T11:12:56.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.956+0000 7f8c8bd32800 2 removed watcher, disabling cache 2024-09-14T11:12:56.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.957+0000 7f8c8bd32800 20 remove_watcher() i=1 2024-09-14T11:12:56.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.958+0000 7f8c8bd32800 20 remove_watcher() i=2 2024-09-14T11:12:56.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.959+0000 7f8c8bd32800 20 remove_watcher() i=3 2024-09-14T11:12:56.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.960+0000 7f8c8bd32800 20 remove_watcher() i=4 2024-09-14T11:12:56.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.961+0000 7f8c8bd32800 20 remove_watcher() i=5 2024-09-14T11:12:56.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.962+0000 7f8c8bd32800 20 remove_watcher() i=6 2024-09-14T11:12:56.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:56.963+0000 7f8c8bd32800 20 remove_watcher() i=7 2024-09-14T11:12:56.972 INFO:tasks.workunit.client.0.smithi028.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 59, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:12:56.973 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:12:56.973 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:12:56.974 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:12:57.008 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:57.009 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:57.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.050+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 realm 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.051+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.052+0000 7fe44022f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:57.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.052+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.052+0000 7fe44022f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:57.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.053+0000 7fe44022f800 20 searching for the correct realm 2024-09-14T11:12:57.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.055+0000 7fe43adcb640 0 -- 172.21.15.28:0/211518266 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fe42c06b020 msgr2=0x7fe42c0c0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:57.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.262+0000 7fe43b5cc640 0 -- 172.21.15.28:0/211518266 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fe430053920 msgr2=0x7fe430040410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:57.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:57.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.470+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:57.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 20 zone default found 2024-09-14T11:12:57.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 4 Realm: () 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 20 zonegroup default 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.471+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.472+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.472+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.472+0000 7fe44022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.472+0000 7fe44022f800 20 started sync module instance, tier type = 2024-09-14T11:12:57.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.472+0000 7fe44022f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=0 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=1 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=2 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=3 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=4 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=5 2024-09-14T11:12:57.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.482+0000 7fe44022f800 20 add_watcher() i=6 2024-09-14T11:12:57.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.483+0000 7fe44022f800 20 add_watcher() i=7 2024-09-14T11:12:57.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.483+0000 7fe44022f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe2f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe44022f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe44022f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe44022f800 5 note: GC not initialized 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe2f0fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe44022f800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe44022f800 20 Filter name: none 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.486+0000 7fe26a7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:12:57.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:57.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.487+0000 7fe44022f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.488+0000 7fe44022f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.488+0000 7fe44022f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.488+0000 7fe44022f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.488+0000 7fe44022f800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:12:57.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.489+0000 7fe2f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:57.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.492+0000 7fe44022f800 20 remove_watcher() i=0 2024-09-14T11:12:57.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.492+0000 7fe44022f800 2 removed watcher, disabling cache 2024-09-14T11:12:57.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.493+0000 7fe44022f800 20 remove_watcher() i=1 2024-09-14T11:12:57.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.494+0000 7fe44022f800 20 remove_watcher() i=2 2024-09-14T11:12:57.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.495+0000 7fe44022f800 20 remove_watcher() i=3 2024-09-14T11:12:57.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.496+0000 7fe44022f800 20 remove_watcher() i=4 2024-09-14T11:12:57.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.498+0000 7fe44022f800 20 remove_watcher() i=5 2024-09-14T11:12:57.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.499+0000 7fe44022f800 20 remove_watcher() i=6 2024-09-14T11:12:57.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:57.500+0000 7fe44022f800 20 remove_watcher() i=7 2024-09-14T11:12:57.512 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:12:57.921 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:12:59.445 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:59.446 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:12:59.480 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:59.480 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:59.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.524+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.525+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.525+0000 7f544772c800 20 realm 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.525+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.526+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.526+0000 7f544772c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.526+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.526+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.526+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.527+0000 7f544772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:59.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.527+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.527+0000 7f544772c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:59.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.527+0000 7f544772c800 20 searching for the correct realm 2024-09-14T11:12:59.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.530+0000 7f5442c4e640 0 -- 172.21.15.28:0/2669500575 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5434079c60 msgr2=0x7f543406b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:59.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.534+0000 7f544344f640 0 -- 172.21.15.28:0/2669500575 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f543809a410 msgr2=0x7f543809a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:59.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.740+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.741+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.741+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.741+0000 7f544772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.741+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 zone default found 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 4 Realm: () 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 zonegroup default 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.742+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.743+0000 7f544772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.743+0000 7f544772c800 20 started sync module instance, tier type = 2024-09-14T11:12:59.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.743+0000 7f544772c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=0 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=1 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=2 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=3 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=4 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=5 2024-09-14T11:12:59.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.754+0000 7f544772c800 20 add_watcher() i=6 2024-09-14T11:12:59.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.755+0000 7f544772c800 20 add_watcher() i=7 2024-09-14T11:12:59.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.755+0000 7f544772c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:59.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f52f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:59.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f544772c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:59.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f544772c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:59.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f544772c800 5 note: GC not initialized 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f52f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f544772c800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.757+0000 7f544772c800 20 Filter name: none 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.758+0000 7f52727fc640 20 reqs_thread_entry: start 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.758+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.758+0000 7f544772c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.758+0000 7f544772c800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 INFO: main: starting shard=0 2024-09-14T11:12:59.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:12:59.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:12:59.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.759+0000 7f544772c800 20 INFO: main: done 2024-09-14T11:12:59.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.760+0000 7f52f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:59.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.763+0000 7f544772c800 20 remove_watcher() i=0 2024-09-14T11:12:59.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.763+0000 7f544772c800 2 removed watcher, disabling cache 2024-09-14T11:12:59.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.764+0000 7f544772c800 20 remove_watcher() i=1 2024-09-14T11:12:59.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.765+0000 7f544772c800 20 remove_watcher() i=2 2024-09-14T11:12:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.766+0000 7f544772c800 20 remove_watcher() i=3 2024-09-14T11:12:59.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.767+0000 7f544772c800 20 remove_watcher() i=4 2024-09-14T11:12:59.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.768+0000 7f544772c800 20 remove_watcher() i=5 2024-09-14T11:12:59.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.769+0000 7f544772c800 20 remove_watcher() i=6 2024-09-14T11:12:59.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.770+0000 7f544772c800 20 remove_watcher() i=7 2024-09-14T11:12:59.898 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:12:59.900 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:12:59.931 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:59.931 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:59.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.972+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.973+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.973+0000 7f2e18d39800 20 realm 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.973+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.973+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.973+0000 7f2e18d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.974+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.974+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.974+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.975+0000 7f2e18d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:59.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.975+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.975+0000 7f2e18d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:59.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.975+0000 7f2e18d39800 20 searching for the correct realm 2024-09-14T11:12:59.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.979+0000 7f2e151c8640 0 -- 172.21.15.28:0/1014079830 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55c51b2a4540 msgr2=0x55c51b2a6990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:12:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.983+0000 7f2e149c7640 0 -- 172.21.15.28:0/1014079830 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f2e0001d3e0 msgr2=0x7f2e0001d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:59.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:12:59.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.987+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 zone default found 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 4 Realm: () 2024-09-14T11:12:59.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:12:59.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:12:59.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:59.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 zonegroup default 2024-09-14T11:12:59.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.988+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.989+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.989+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:12:59.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.989+0000 7f2e18d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:59.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.989+0000 7f2e18d39800 20 started sync module instance, tier type = 2024-09-14T11:12:59.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.989+0000 7f2e18d39800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:12:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=0 2024-09-14T11:12:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=1 2024-09-14T11:12:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=2 2024-09-14T11:12:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=3 2024-09-14T11:12:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=4 2024-09-14T11:12:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=5 2024-09-14T11:12:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:12:59.999+0000 7f2e18d39800 20 add_watcher() i=6 2024-09-14T11:12:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.000+0000 7f2e18d39800 20 add_watcher() i=7 2024-09-14T11:12:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.000+0000 7f2e18d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.001+0000 7f2ccafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:00.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2e18d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2e18d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2e18d39800 5 note: GC not initialized 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2cc9fe3640 20 reqs_thread_entry: start 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2e18d39800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2e18d39800 20 Filter name: none 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2c3b7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:00.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.002+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 INFO: main: starting shard=0 2024-09-14T11:13:00.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.003+0000 7f2e18d39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:00.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.004+0000 7f2e18d39800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:00.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.004+0000 7f2e18d39800 20 INFO: main: done 2024-09-14T11:13:00.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.005+0000 7f2ccafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.007+0000 7f2e18d39800 20 remove_watcher() i=0 2024-09-14T11:13:00.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.007+0000 7f2e18d39800 2 removed watcher, disabling cache 2024-09-14T11:13:00.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.008+0000 7f2e18d39800 20 remove_watcher() i=1 2024-09-14T11:13:00.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.010+0000 7f2e18d39800 20 remove_watcher() i=2 2024-09-14T11:13:00.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.011+0000 7f2e18d39800 20 remove_watcher() i=3 2024-09-14T11:13:00.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.012+0000 7f2e18d39800 20 remove_watcher() i=4 2024-09-14T11:13:00.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.013+0000 7f2e18d39800 20 remove_watcher() i=5 2024-09-14T11:13:00.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.014+0000 7f2e18d39800 20 remove_watcher() i=6 2024-09-14T11:13:00.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.015+0000 7f2e18d39800 20 remove_watcher() i=7 2024-09-14T11:13:00.176 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:00.178 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:13:00.210 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:00.210 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:00.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.251+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.253+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.253+0000 7f9728d19800 20 realm 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.253+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.253+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.253+0000 7f9728d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.253+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.254+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.254+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.254+0000 7f9728d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:00.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.254+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.255+0000 7f9728d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:00.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.255+0000 7f9728d19800 20 searching for the correct realm 2024-09-14T11:13:00.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.459+0000 7f9726009640 0 -- 172.21.15.28:0/2088986441 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9718072040 msgr2=0x7f97180aba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:00.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.665+0000 7f972680a640 0 -- 172.21.15.28:0/2088986441 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f971c06b980 msgr2=0x7f971c049790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.872+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 zone default found 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 4 Realm: () 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 zonegroup default 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.873+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.874+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.874+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.874+0000 7f9728d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:00.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.874+0000 7f9728d19800 20 started sync module instance, tier type = 2024-09-14T11:13:00.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.874+0000 7f9728d19800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:00.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=0 2024-09-14T11:13:00.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=1 2024-09-14T11:13:00.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=2 2024-09-14T11:13:00.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=3 2024-09-14T11:13:00.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=4 2024-09-14T11:13:00.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=5 2024-09-14T11:13:00.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.885+0000 7f9728d19800 20 add_watcher() i=6 2024-09-14T11:13:00.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.886+0000 7f9728d19800 20 add_watcher() i=7 2024-09-14T11:13:00.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.886+0000 7f9728d19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:00.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.888+0000 7f95dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.888+0000 7f9728d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.888+0000 7f9728d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.888+0000 7f9728d19800 5 note: GC not initialized 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.888+0000 7f9557fff640 20 reqs_thread_entry: start 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.889+0000 7f9728d19800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.889+0000 7f9728d19800 20 Filter name: none 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.889+0000 7f9555ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:00.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.889+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.889+0000 7f9728d19800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:00.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.889+0000 7f9728d19800 20 rados->read ofs=0 len=0 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 INFO: main: starting shard=0 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:00.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.890+0000 7f9728d19800 20 INFO: main: done 2024-09-14T11:13:00.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.891+0000 7f95dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:00.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.894+0000 7f9728d19800 20 remove_watcher() i=0 2024-09-14T11:13:00.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.894+0000 7f9728d19800 2 removed watcher, disabling cache 2024-09-14T11:13:00.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.895+0000 7f9728d19800 20 remove_watcher() i=1 2024-09-14T11:13:00.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.896+0000 7f9728d19800 20 remove_watcher() i=2 2024-09-14T11:13:00.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.897+0000 7f9728d19800 20 remove_watcher() i=3 2024-09-14T11:13:00.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.899+0000 7f9728d19800 20 remove_watcher() i=4 2024-09-14T11:13:00.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.900+0000 7f9728d19800 20 remove_watcher() i=5 2024-09-14T11:13:00.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.901+0000 7f9728d19800 20 remove_watcher() i=6 2024-09-14T11:13:00.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:00.902+0000 7f9728d19800 20 remove_watcher() i=7 2024-09-14T11:13:01.026 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:01.028 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:13:01.059 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:01.059 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:01.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.100+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 realm 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.102+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.103+0000 7f3317b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:01.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.103+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.104+0000 7f3317b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:01.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.104+0000 7f3317b35800 20 searching for the correct realm 2024-09-14T11:13:01.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.107+0000 7f3314022640 0 -- 172.21.15.28:0/2567290622 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x558a8ecd2820 msgr2=0x558a8ecd4c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:01.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.111+0000 7f3313020640 0 -- 172.21.15.28:0/2567290622 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f330400b040 msgr2=0x7f3304078a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 zone default found 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 4 Realm: () 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 zonegroup default 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.115+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:01.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 started sync module instance, tier type = 2024-09-14T11:13:01.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.116+0000 7f3317b35800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:01.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=0 2024-09-14T11:13:01.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=1 2024-09-14T11:13:01.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=2 2024-09-14T11:13:01.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=3 2024-09-14T11:13:01.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=4 2024-09-14T11:13:01.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=5 2024-09-14T11:13:01.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.127+0000 7f3317b35800 20 add_watcher() i=6 2024-09-14T11:13:01.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.128+0000 7f3317b35800 20 add_watcher() i=7 2024-09-14T11:13:01.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.128+0000 7f3317b35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:01.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.130+0000 7f31c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:01.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f3317b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:01.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f3317b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:01.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f3317b35800 5 note: GC not initialized 2024-09-14T11:13:01.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f31c8fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:01.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f3317b35800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:01.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f3317b35800 20 Filter name: none 2024-09-14T11:13:01.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f31427fc640 20 reqs_thread_entry: start 2024-09-14T11:13:01.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.131+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.132+0000 7f3317b35800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.132+0000 7f3317b35800 20 rados->read ofs=0 len=0 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.132+0000 7f3317b35800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.133+0000 7f3317b35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.133+0000 7f3317b35800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.133+0000 7f3317b35800 20 INFO: main: starting shard=0 2024-09-14T11:13:01.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.133+0000 7f3317b35800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:01.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.133+0000 7f3317b35800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:01.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.133+0000 7f3317b35800 20 INFO: main: done 2024-09-14T11:13:01.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.134+0000 7f31c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:01.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.138+0000 7f3317b35800 20 remove_watcher() i=0 2024-09-14T11:13:01.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.138+0000 7f3317b35800 2 removed watcher, disabling cache 2024-09-14T11:13:01.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.139+0000 7f3317b35800 20 remove_watcher() i=1 2024-09-14T11:13:01.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.140+0000 7f3317b35800 20 remove_watcher() i=2 2024-09-14T11:13:01.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.142+0000 7f3317b35800 20 remove_watcher() i=3 2024-09-14T11:13:01.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.143+0000 7f3317b35800 20 remove_watcher() i=4 2024-09-14T11:13:01.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.143+0000 7f3317b35800 20 remove_watcher() i=5 2024-09-14T11:13:01.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.144+0000 7f3317b35800 20 remove_watcher() i=6 2024-09-14T11:13:01.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:01.145+0000 7f3317b35800 20 remove_watcher() i=7 2024-09-14T11:13:01.182 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:13:01.588 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:13:01.995 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:13:01.995 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:01.996 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:13:02.030 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:02.030 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:02.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.071+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 realm 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.073+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.074+0000 7f867bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.074+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.075+0000 7f867bf3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.075+0000 7f867bf3e800 20 searching for the correct realm 2024-09-14T11:13:02.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.079+0000 7f8678487640 0 -- 172.21.15.28:0/3188682559 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f8660083500 msgr2=0x7f86600839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:02.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.286+0000 7f8677c86640 0 -- 172.21.15.28:0/3188682559 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x55f8c0a0de90 msgr2=0x55f8c0a10280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:02.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:02.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:02.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.289+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 zone default found 2024-09-14T11:13:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 4 Realm: () 2024-09-14T11:13:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 zonegroup default 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 started sync module instance, tier type = 2024-09-14T11:13:02.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.290+0000 7f867bf3e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:02.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=0 2024-09-14T11:13:02.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=1 2024-09-14T11:13:02.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=2 2024-09-14T11:13:02.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=3 2024-09-14T11:13:02.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=4 2024-09-14T11:13:02.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=5 2024-09-14T11:13:02.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.301+0000 7f867bf3e800 20 add_watcher() i=6 2024-09-14T11:13:02.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.302+0000 7f867bf3e800 20 add_watcher() i=7 2024-09-14T11:13:02.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.302+0000 7f867bf3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:02.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.304+0000 7f852dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.304+0000 7f867bf3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.304+0000 7f867bf3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.304+0000 7f867bf3e800 5 note: GC not initialized 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.304+0000 7f852cfe1640 20 reqs_thread_entry: start 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.304+0000 7f867bf3e800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 20 Filter name: none 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f84a67fc640 20 reqs_thread_entry: start 2024-09-14T11:13:02.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:02.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.305+0000 7f867bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:02.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.306+0000 7f867bf3e800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:02.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.309+0000 7f867bf3e800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-14T11:13:02.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.309+0000 7f867bf3e800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:13:02.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.310+0000 7f852dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:02.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.312+0000 7f867bf3e800 20 remove_watcher() i=0 2024-09-14T11:13:02.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.312+0000 7f867bf3e800 2 removed watcher, disabling cache 2024-09-14T11:13:02.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.314+0000 7f867bf3e800 20 remove_watcher() i=1 2024-09-14T11:13:02.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.315+0000 7f867bf3e800 20 remove_watcher() i=2 2024-09-14T11:13:02.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.316+0000 7f867bf3e800 20 remove_watcher() i=3 2024-09-14T11:13:02.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.317+0000 7f867bf3e800 20 remove_watcher() i=4 2024-09-14T11:13:02.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.318+0000 7f867bf3e800 20 remove_watcher() i=5 2024-09-14T11:13:02.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.319+0000 7f867bf3e800 20 remove_watcher() i=6 2024-09-14T11:13:02.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.320+0000 7f867bf3e800 20 remove_watcher() i=7 2024-09-14T11:13:02.329 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: unlinked entries are not listable 2024-09-14T11:13:02.329 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:02.445 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:13:02.446 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:02.582 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:13:02.583 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:02.584 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:13:02.619 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:02.619 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:02.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.661+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.662+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.662+0000 7f0ee6a63800 20 realm 2024-09-14T11:13:02.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.662+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.663+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.663+0000 7f0ee6a63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:02.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.663+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.663+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:02.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.663+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.664+0000 7f0ee6a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:02.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.664+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:02.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.664+0000 7f0ee6a63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:02.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.664+0000 7f0ee6a63800 20 searching for the correct realm 2024-09-14T11:13:02.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.667+0000 7f0edbfff640 0 -- 172.21.15.28:0/1264764776 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f0dac084f20 msgr2=0x7f0dac087350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:02.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:02.874+0000 7f0ee4554640 0 -- 172.21.15.28:0/1264764776 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f0ecc0b3160 msgr2=0x7f0ecc0e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.081+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 zone default found 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 4 Realm: () 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 zonegroup default 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.082+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.083+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.083+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.083+0000 7f0ee6a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.083+0000 7f0ee6a63800 20 started sync module instance, tier type = 2024-09-14T11:13:03.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.083+0000 7f0ee6a63800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=0 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=1 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=2 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=3 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=4 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=5 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.094+0000 7f0ee6a63800 20 add_watcher() i=6 2024-09-14T11:13:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.095+0000 7f0ee6a63800 20 add_watcher() i=7 2024-09-14T11:13:03.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.095+0000 7f0ee6a63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:03.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.097+0000 7f0d9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.097+0000 7f0ee6a63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:03.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.097+0000 7f0ee6a63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:03.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.097+0000 7f0ee6a63800 5 note: GC not initialized 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0d99fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 20 Filter name: none 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0d0b7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.098+0000 7f0ee6a63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:03.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:03.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:03.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:03.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:03.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:03.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:03.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.099+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.101+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.101+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:c state=0x55b8afcb0a18 s->prefetch_data=0 2024-09-14T11:13:03.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.102+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to g80ajt00g6vlmhzui9zr41rn76b05lpd 2024-09-14T11:13:03.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.102+0000 7f0ee6a63800 20 get_obj_state_impl: setting s->olh_tag to tdrionwevp1sj2822rsfaf7ilbcs9w3d 2024-09-14T11:13:03.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.102+0000 7f0ee6a63800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tdrionwevp1sj2822rsfaf7ilbcs9w3d 2024-09-14T11:13:03.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.103+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.104+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 20 olh_log_entry: epoch=3 op=3 key=c[1ZYv-P40pePOUI0p5aQdCp6Vq5dnlun] 2024-09-14T11:13:03.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:1ZYv-P40pePOUI0p5aQdCp6Vq5dnlun_c state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 10 manifest: total_size = 12 2024-09-14T11:13:03.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6460493221270969821 2024-09-14T11:13:03.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:1ZYv-P40pePOUI0p5aQdCp6Vq5dnlun_c state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 20 prepare_atomic_modification: state is not atomic. state=0x55b8afce7258 2024-09-14T11:13:03.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.105+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.110+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:03.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.110+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:13:03.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.110+0000 7f0ee6a63800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:03.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.110+0000 7f0ee6a63800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:1ZYv-P40pePOUI0p5aQdCp6Vq5dnlun_.NIuf_kZQtAV0v7gzgunkrXCJSjbqcl9_0 2024-09-14T11:13:03.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.111+0000 7f0dbb7fe640 20 handle_completion(): completion ok for obj=c[1ZYv-P40pePOUI0p5aQdCp6Vq5dnlun] 2024-09-14T11:13:03.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.112+0000 7f0ee6a63800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:03.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.113+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.113+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.114+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.115+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.115+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:d state=0x55b8afcab798 s->prefetch_data=0 2024-09-14T11:13:03.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.115+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to c1omamdt41agi006rvagg0sp9m5ag4c8 2024-09-14T11:13:03.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.115+0000 7f0ee6a63800 20 get_obj_state_impl: setting s->olh_tag to 41ycib71269yo2tp36ker1va7xkez1u1 2024-09-14T11:13:03.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.115+0000 7f0ee6a63800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=41ycib71269yo2tp36ker1va7xkez1u1 2024-09-14T11:13:03.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.117+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 olh_log_entry: epoch=3 op=3 key=d[6TcqmxzIWiuszKeb99LqXtK1N5jqoe-] 2024-09-14T11:13:03.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:6TcqmxzIWiuszKeb99LqXtK1N5jqoe-_d state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 10 manifest: total_size = 11 2024-09-14T11:13:03.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.455889078709501574 2024-09-14T11:13:03.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:6TcqmxzIWiuszKeb99LqXtK1N5jqoe-_d state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 prepare_atomic_modification: state is not atomic. state=0x55b8afce7258 2024-09-14T11:13:03.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.119+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.122+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:03.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.122+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:13:03.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.122+0000 7f0ee6a63800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:03.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.122+0000 7f0ee6a63800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:6TcqmxzIWiuszKeb99LqXtK1N5jqoe-_.l3d4h-pO_7tLCxpsUfvjI8K04UtaMx9_0 2024-09-14T11:13:03.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.124+0000 7f0dbaffd640 20 handle_completion(): completion ok for obj=d[6TcqmxzIWiuszKeb99LqXtK1N5jqoe-] 2024-09-14T11:13:03.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.124+0000 7f0ee6a63800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:03.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.125+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.125+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.127+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.127+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.128+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:e state=0x55b8afcab798 s->prefetch_data=0 2024-09-14T11:13:03.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.128+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to gazxfxnn3pznvzy951rn1vv8qgz2k14k 2024-09-14T11:13:03.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.128+0000 7f0ee6a63800 20 get_obj_state_impl: setting s->olh_tag to fhe87xajlv30vj6m68j9ldkop5hl2b6b 2024-09-14T11:13:03.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.128+0000 7f0ee6a63800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fhe87xajlv30vj6m68j9ldkop5hl2b6b 2024-09-14T11:13:03.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.130+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:13:03.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 olh_log_entry: epoch=2 op=3 key=e[6Uvsqs-rzxl75p9h-9ygN6KPeati193] 2024-09-14T11:13:03.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:6Uvsqs-rzxl75p9h-9ygN6KPeati193_e state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 10 manifest: total_size = 11 2024-09-14T11:13:03.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17111338988146287704 2024-09-14T11:13:03.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:6Uvsqs-rzxl75p9h-9ygN6KPeati193_e state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 prepare_atomic_modification: state is not atomic. state=0x55b8afce7258 2024-09-14T11:13:03.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.132+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.136+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:03.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.136+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:13:03.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.136+0000 7f0ee6a63800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:03.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.136+0000 7f0ee6a63800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:6Uvsqs-rzxl75p9h-9ygN6KPeati193_.jgTedrPG34Bm0887IqKiffW4CvDeSoD_0 2024-09-14T11:13:03.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.138+0000 7f0dbaffd640 20 handle_completion(): completion ok for obj=e[6Uvsqs-rzxl75p9h-9ygN6KPeati193] 2024-09-14T11:13:03.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.138+0000 7f0ee6a63800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:03.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.139+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:e state=0x55b8afcab798 s->prefetch_data=0 2024-09-14T11:13:03.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.139+0000 7f0ee6a63800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fhe87xajlv30vj6m68j9ldkop5hl2b6b 2024-09-14T11:13:03.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.143+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.144+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.145+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.145+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:f state=0x55b8afcab798 s->prefetch_data=0 2024-09-14T11:13:03.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.146+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to 47k8z73oj2p0quvhxuehxu966u7kl4m5 2024-09-14T11:13:03.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.146+0000 7f0ee6a63800 20 get_obj_state_impl: setting s->olh_tag to 4b1ej33pfdpwegsd9f629ce3b2tk3qi9 2024-09-14T11:13:03.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.146+0000 7f0ee6a63800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4b1ej33pfdpwegsd9f629ce3b2tk3qi9 2024-09-14T11:13:03.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.147+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:13:03.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 olh_log_entry: epoch=2 op=3 key=f[b7TWeJOPIDis1rFNTHuH4U8OGzatLd-] 2024-09-14T11:13:03.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:b7TWeJOPIDis1rFNTHuH4U8OGzatLd-_f state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 10 manifest: total_size = 11 2024-09-14T11:13:03.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9649746938791790376 2024-09-14T11:13:03.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:_:b7TWeJOPIDis1rFNTHuH4U8OGzatLd-_f state=0x55b8afce7258 s->prefetch_data=0 2024-09-14T11:13:03.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 prepare_atomic_modification: state is not atomic. state=0x55b8afce7258 2024-09-14T11:13:03.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.149+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.152+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:03.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.152+0000 7f0ee6a63800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:13:03.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.152+0000 7f0ee6a63800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:03.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.152+0000 7f0ee6a63800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:b7TWeJOPIDis1rFNTHuH4U8OGzatLd-_.4nfp3dbVMdXSkzeCMupp_Dxul8ishfx_0 2024-09-14T11:13:03.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.153+0000 7f0ee6a63800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:03.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.153+0000 7f0dbb7fe640 20 handle_completion(): completion ok for obj=f[b7TWeJOPIDis1rFNTHuH4U8OGzatLd-] 2024-09-14T11:13:03.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.155+0000 7f0ee6a63800 20 get_obj_state: octx=0x55b8af9fcba0 obj=check-bucket:f state=0x55b8afcab798 s->prefetch_data=0 2024-09-14T11:13:03.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.155+0000 7f0ee6a63800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4b1ej33pfdpwegsd9f629ce3b2tk3qi9 2024-09-14T11:13:03.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.158+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.162+0000 7f0ee6a63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.162+0000 7f0ee6a63800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-14T11:13:03.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.162+0000 7f0ee6a63800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:13:03.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.162+0000 7f0d9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.165+0000 7f0ee6a63800 20 remove_watcher() i=0 2024-09-14T11:13:03.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.165+0000 7f0ee6a63800 2 removed watcher, disabling cache 2024-09-14T11:13:03.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.166+0000 7f0ee6a63800 20 remove_watcher() i=1 2024-09-14T11:13:03.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.167+0000 7f0ee6a63800 20 remove_watcher() i=2 2024-09-14T11:13:03.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.169+0000 7f0ee6a63800 20 remove_watcher() i=3 2024-09-14T11:13:03.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.170+0000 7f0ee6a63800 20 remove_watcher() i=4 2024-09-14T11:13:03.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.171+0000 7f0ee6a63800 20 remove_watcher() i=5 2024-09-14T11:13:03.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.172+0000 7f0ee6a63800 20 remove_watcher() i=6 2024-09-14T11:13:03.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.173+0000 7f0ee6a63800 20 remove_watcher() i=7 2024-09-14T11:13:03.271 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:13:03.271 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:03.437 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:13:03.437 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:03.438 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:13:03.472 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:03.472 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:03.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.512+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 realm 2024-09-14T11:13:03.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:03.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.514+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.515+0000 7f42a3525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.515+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.515+0000 7f42a3525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:03.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.515+0000 7f42a3525800 20 searching for the correct realm 2024-09-14T11:13:03.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.519+0000 7f429e9ad640 0 -- 172.21.15.28:0/1267416721 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55a271e99640 msgr2=0x55a271e9bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.522+0000 7f429f1ae640 0 -- 172.21.15.28:0/1267416721 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f42940698d0 msgr2=0x7f4294084120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:03.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.527+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 zone default found 2024-09-14T11:13:03.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 4 Realm: () 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 zonegroup default 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.528+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.529+0000 7f42a3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.529+0000 7f42a3525800 20 started sync module instance, tier type = 2024-09-14T11:13:03.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.529+0000 7f42a3525800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=0 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=1 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=2 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=3 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=4 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=5 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.539+0000 7f42a3525800 20 add_watcher() i=6 2024-09-14T11:13:03.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.540+0000 7f42a3525800 20 add_watcher() i=7 2024-09-14T11:13:03.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.540+0000 7f42a3525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:03.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.542+0000 7f4155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.542+0000 7f42a3525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:03.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.542+0000 7f42a3525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:03.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.542+0000 7f42a3525800 5 note: GC not initialized 2024-09-14T11:13:03.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.542+0000 7f4154fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 20 Filter name: none 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f40ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:03.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.543+0000 7f42a3525800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:03.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:03.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.544+0000 7f42a3525800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:13:03.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.545+0000 7f4155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.547+0000 7f42a3525800 20 remove_watcher() i=0 2024-09-14T11:13:03.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.547+0000 7f42a3525800 2 removed watcher, disabling cache 2024-09-14T11:13:03.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.548+0000 7f42a3525800 20 remove_watcher() i=1 2024-09-14T11:13:03.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.549+0000 7f42a3525800 20 remove_watcher() i=2 2024-09-14T11:13:03.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.551+0000 7f42a3525800 20 remove_watcher() i=3 2024-09-14T11:13:03.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.552+0000 7f42a3525800 20 remove_watcher() i=4 2024-09-14T11:13:03.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.552+0000 7f42a3525800 20 remove_watcher() i=5 2024-09-14T11:13:03.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.553+0000 7f42a3525800 20 remove_watcher() i=6 2024-09-14T11:13:03.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.554+0000 7f42a3525800 20 remove_watcher() i=7 2024-09-14T11:13:03.769 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:03.800 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:03.800 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:03.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.842+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.844+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.844+0000 7f99d16bb800 20 realm 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.844+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.844+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.844+0000 7f99d16bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.845+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.845+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.845+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.845+0000 7f99d16bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.845+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.846+0000 7f99d16bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:03.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.846+0000 7f99d16bb800 20 searching for the correct realm 2024-09-14T11:13:03.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.849+0000 7f99cf9a6640 0 -- 172.21.15.28:0/3259644091 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x5562cefa3b00 msgr2=0x5562cefa5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.852+0000 7f99ce9a4640 0 -- 172.21.15.28:0/3259644091 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f99c0027040 msgr2=0x7f99c0076db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:03.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:03.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:03.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:03.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:03.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:03.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.856+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:03.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 zone default found 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 4 Realm: () 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 zonegroup default 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.857+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.858+0000 7f99d16bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.858+0000 7f99d16bb800 20 started sync module instance, tier type = 2024-09-14T11:13:03.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.858+0000 7f99d16bb800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:03.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=0 2024-09-14T11:13:03.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=1 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=2 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=3 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=4 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=5 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.867+0000 7f99d16bb800 20 add_watcher() i=6 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.868+0000 7f99d16bb800 20 add_watcher() i=7 2024-09-14T11:13:03.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.868+0000 7f99d16bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:03.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.870+0000 7f9885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.870+0000 7f99d16bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:03.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.870+0000 7f99d16bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:03.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.870+0000 7f99d16bb800 5 note: GC not initialized 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f9884fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f99d16bb800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f99d16bb800 20 Filter name: none 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f97fe7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f99d16bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:03.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.871+0000 7f99d16bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 INFO: main: starting shard=0 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:13:03.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.872+0000 7f99d16bb800 20 INFO: main: done 2024-09-14T11:13:03.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.873+0000 7f9885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.875+0000 7f99d16bb800 20 remove_watcher() i=0 2024-09-14T11:13:03.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.875+0000 7f99d16bb800 2 removed watcher, disabling cache 2024-09-14T11:13:03.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.876+0000 7f99d16bb800 20 remove_watcher() i=1 2024-09-14T11:13:03.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.877+0000 7f99d16bb800 20 remove_watcher() i=2 2024-09-14T11:13:03.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.879+0000 7f99d16bb800 20 remove_watcher() i=3 2024-09-14T11:13:03.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.880+0000 7f99d16bb800 20 remove_watcher() i=4 2024-09-14T11:13:03.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.881+0000 7f99d16bb800 20 remove_watcher() i=5 2024-09-14T11:13:03.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.882+0000 7f99d16bb800 20 remove_watcher() i=6 2024-09-14T11:13:03.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.883+0000 7f99d16bb800 20 remove_watcher() i=7 2024-09-14T11:13:03.894 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:03.926 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:03.926 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:03.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.966+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 realm 2024-09-14T11:13:03.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:03.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.968+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.969+0000 7fcf25b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.969+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.969+0000 7fcf25b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:03.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.969+0000 7fcf25b26800 20 searching for the correct realm 2024-09-14T11:13:03.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.972+0000 7fcf20fd8640 0 -- 172.21.15.28:0/442269622 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x562010658560 msgr2=0x56201065a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.976+0000 7fcf217d9640 0 -- 172.21.15.28:0/442269622 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fcf18079b80 msgr2=0x7fcf1804a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:03.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:03.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:03.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.980+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:03.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 20 zone default found 2024-09-14T11:13:03.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 4 Realm: () 2024-09-14T11:13:03.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 20 zonegroup default 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.981+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.982+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.982+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.982+0000 7fcf25b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.982+0000 7fcf25b26800 20 started sync module instance, tier type = 2024-09-14T11:13:03.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.982+0000 7fcf25b26800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=0 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=1 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=2 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=3 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=4 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=5 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.991+0000 7fcf25b26800 20 add_watcher() i=6 2024-09-14T11:13:03.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.992+0000 7fcf25b26800 20 add_watcher() i=7 2024-09-14T11:13:03.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.992+0000 7fcf25b26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:03.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.994+0000 7fcdd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.994+0000 7fcf25b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:03.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.994+0000 7fcf25b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:03.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.994+0000 7fcf25b26800 5 note: GC not initialized 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcdd67e4640 20 reqs_thread_entry: start 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcf25b26800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcf25b26800 20 Filter name: none 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcd47fff640 20 reqs_thread_entry: start 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcf25b26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:03.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.995+0000 7fcf25b26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 INFO: main: starting shard=0 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.996+0000 7fcf25b26800 20 INFO: main: done 2024-09-14T11:13:03.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:03.997+0000 7fcdd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:03.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.000+0000 7fcf25b26800 20 remove_watcher() i=0 2024-09-14T11:13:03.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.000+0000 7fcf25b26800 2 removed watcher, disabling cache 2024-09-14T11:13:03.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.001+0000 7fcf25b26800 20 remove_watcher() i=1 2024-09-14T11:13:04.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.002+0000 7fcf25b26800 20 remove_watcher() i=2 2024-09-14T11:13:04.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.003+0000 7fcf25b26800 20 remove_watcher() i=3 2024-09-14T11:13:04.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.004+0000 7fcf25b26800 20 remove_watcher() i=4 2024-09-14T11:13:04.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.005+0000 7fcf25b26800 20 remove_watcher() i=5 2024-09-14T11:13:04.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.006+0000 7fcf25b26800 20 remove_watcher() i=6 2024-09-14T11:13:04.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.007+0000 7fcf25b26800 20 remove_watcher() i=7 2024-09-14T11:13:04.016 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:13:04.016 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:04.017 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:13:04.049 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:04.049 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:04.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.090+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 realm 2024-09-14T11:13:04.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.092+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.093+0000 7f605610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.093+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.093+0000 7f605610c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:04.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.093+0000 7f605610c800 20 searching for the correct realm 2024-09-14T11:13:04.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.097+0000 7f60533fc640 0 -- 172.21.15.28:0/1247500328 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55af1fbc0c60 msgr2=0x55af1fbc3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.100+0000 7f6053bfd640 0 -- 172.21.15.28:0/1247500328 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f603c066040 msgr2=0x7f603c0aa410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:04.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.105+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 zone default found 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 4 Realm: () 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 zonegroup default 2024-09-14T11:13:04.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 started sync module instance, tier type = 2024-09-14T11:13:04.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.106+0000 7f605610c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=0 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=1 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=2 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=3 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=4 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=5 2024-09-14T11:13:04.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.115+0000 7f605610c800 20 add_watcher() i=6 2024-09-14T11:13:04.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.117+0000 7f605610c800 20 add_watcher() i=7 2024-09-14T11:13:04.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.117+0000 7f605610c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:04.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.118+0000 7f5f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:04.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:04.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 5 note: GC not initialized 2024-09-14T11:13:04.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f5f08fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:04.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:04.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 Filter name: none 2024-09-14T11:13:04.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f5e827fc640 20 reqs_thread_entry: start 2024-09-14T11:13:04.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:04.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.119+0000 7f605610c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:04.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.120+0000 7f605610c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.121+0000 7f605610c800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.121+0000 7f605610c800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:13:04.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.122+0000 7f5f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.124+0000 7f605610c800 20 remove_watcher() i=0 2024-09-14T11:13:04.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.124+0000 7f605610c800 2 removed watcher, disabling cache 2024-09-14T11:13:04.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.125+0000 7f605610c800 20 remove_watcher() i=1 2024-09-14T11:13:04.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.126+0000 7f605610c800 20 remove_watcher() i=2 2024-09-14T11:13:04.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.127+0000 7f605610c800 20 remove_watcher() i=3 2024-09-14T11:13:04.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.128+0000 7f605610c800 20 remove_watcher() i=4 2024-09-14T11:13:04.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.129+0000 7f605610c800 20 remove_watcher() i=5 2024-09-14T11:13:04.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.130+0000 7f605610c800 20 remove_watcher() i=6 2024-09-14T11:13:04.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.131+0000 7f605610c800 20 remove_watcher() i=7 2024-09-14T11:13:04.140 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:13:04.140 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:04.142 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:13:04.177 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:04.177 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:04.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.217+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 realm 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.219+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.220+0000 7fc2efd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.220+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.220+0000 7fc2efd25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:04.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.220+0000 7fc2efd25800 20 searching for the correct realm 2024-09-14T11:13:04.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.224+0000 7fc2ec1af640 0 -- 172.21.15.28:0/860954384 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x5577d9bc06e0 msgr2=0x5577d9bc2ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.227+0000 7fc2eb1ad640 0 -- 172.21.15.28:0/860954384 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fc2dc027070 msgr2=0x7fc2dc062540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.231+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 zone default found 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 4 Realm: () 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 zonegroup default 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.232+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.233+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.233+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.233+0000 7fc2efd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.233+0000 7fc2efd25800 20 started sync module instance, tier type = 2024-09-14T11:13:04.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.233+0000 7fc2efd25800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:04.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=0 2024-09-14T11:13:04.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=1 2024-09-14T11:13:04.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=2 2024-09-14T11:13:04.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=3 2024-09-14T11:13:04.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=4 2024-09-14T11:13:04.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=5 2024-09-14T11:13:04.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.242+0000 7fc2efd25800 20 add_watcher() i=6 2024-09-14T11:13:04.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.243+0000 7fc2efd25800 20 add_watcher() i=7 2024-09-14T11:13:04.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.243+0000 7fc2efd25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:04.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc1a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc2efd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:04.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc2efd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:04.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc2efd25800 5 note: GC not initialized 2024-09-14T11:13:04.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc1a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc2efd25800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc2efd25800 20 Filter name: none 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.245+0000 7fc11a7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:04.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:04.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:04.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:04.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:04.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.246+0000 7fc2efd25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.247+0000 7fc2efd25800 20 get_obj_state: octx=0x5577d9950b80 obj=check-bucket:c state=0x5577d9bfb968 s->prefetch_data=0 2024-09-14T11:13:04.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.248+0000 7fc2efd25800 20 get_obj_state: setting s->obj_tag to g80ajt00g6vlmhzui9zr41rn76b05lpd 2024-09-14T11:13:04.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.248+0000 7fc2efd25800 20 get_obj_state_impl: setting s->olh_tag to tdrionwevp1sj2822rsfaf7ilbcs9w3d 2024-09-14T11:13:04.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.248+0000 7fc2efd25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.248+0000 7fc2efd25800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:13:04.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.248+0000 7fc2efd25800 20 olh_log_entry: epoch=4 op=3 key=c[WLuwqAw1snMAUsfUPRYb880-kz3my3x] 2024-09-14T11:13:04.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.248+0000 7fc2efd25800 20 get_obj_state: octx=0x5577d9c359b0 obj=check-bucket:_:WLuwqAw1snMAUsfUPRYb880-kz3my3x_c state=0x5577d9bfac98 s->prefetch_data=0 2024-09-14T11:13:04.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.250+0000 7fc2efd25800 20 get_obj_state: octx=0x5577d9c359b0 obj=check-bucket:c state=0x5577d9bf6c58 s->prefetch_data=0 2024-09-14T11:13:04.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.250+0000 7fc2efd25800 20 get_obj_state: setting s->obj_tag to g80ajt00g6vlmhzui9zr41rn76b05lpd 2024-09-14T11:13:04.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.250+0000 7fc2efd25800 20 get_obj_state_impl: setting s->olh_tag to tdrionwevp1sj2822rsfaf7ilbcs9w3d 2024-09-14T11:13:04.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.250+0000 7fc2efd25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tdrionwevp1sj2822rsfaf7ilbcs9w3d 2024-09-14T11:13:04.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.253+0000 7fc2efd25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.254+0000 7fc2efd25800 20 get_obj_state: octx=0x5577d9950b80 obj=check-bucket:d state=0x5577d9bfb968 s->prefetch_data=0 2024-09-14T11:13:04.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.255+0000 7fc2efd25800 20 get_obj_state: setting s->obj_tag to c1omamdt41agi006rvagg0sp9m5ag4c8 2024-09-14T11:13:04.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.255+0000 7fc2efd25800 20 get_obj_state_impl: setting s->olh_tag to 41ycib71269yo2tp36ker1va7xkez1u1 2024-09-14T11:13:04.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.255+0000 7fc2efd25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.255+0000 7fc2efd25800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:13:04.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.255+0000 7fc2efd25800 20 olh_log_entry: epoch=4 op=3 key=d[0GzMuyV3OCvlzX.n9q1Ga31BxbWbaHG] 2024-09-14T11:13:04.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.255+0000 7fc2efd25800 20 get_obj_state: octx=0x5577d9c359b0 obj=check-bucket:_:0GzMuyV3OCvlzX.n9q1Ga31BxbWbaHG_d state=0x5577d9bfac98 s->prefetch_data=0 2024-09-14T11:13:04.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.257+0000 7fc2efd25800 20 get_obj_state: octx=0x5577d9c359b0 obj=check-bucket:d state=0x5577d9bf7c68 s->prefetch_data=0 2024-09-14T11:13:04.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.257+0000 7fc2efd25800 20 get_obj_state: setting s->obj_tag to c1omamdt41agi006rvagg0sp9m5ag4c8 2024-09-14T11:13:04.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.257+0000 7fc2efd25800 20 get_obj_state_impl: setting s->olh_tag to 41ycib71269yo2tp36ker1va7xkez1u1 2024-09-14T11:13:04.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.257+0000 7fc2efd25800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=41ycib71269yo2tp36ker1va7xkez1u1 2024-09-14T11:13:04.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.260+0000 7fc2efd25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.261+0000 7fc2efd25800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-14T11:13:04.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.261+0000 7fc2efd25800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:13:04.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.262+0000 7fc1a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.265+0000 7fc2efd25800 20 remove_watcher() i=0 2024-09-14T11:13:04.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.265+0000 7fc2efd25800 2 removed watcher, disabling cache 2024-09-14T11:13:04.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.266+0000 7fc2efd25800 20 remove_watcher() i=1 2024-09-14T11:13:04.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.267+0000 7fc2efd25800 20 remove_watcher() i=2 2024-09-14T11:13:04.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.268+0000 7fc2efd25800 20 remove_watcher() i=3 2024-09-14T11:13:04.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.269+0000 7fc2efd25800 20 remove_watcher() i=4 2024-09-14T11:13:04.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.270+0000 7fc2efd25800 20 remove_watcher() i=5 2024-09-14T11:13:04.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.271+0000 7fc2efd25800 20 remove_watcher() i=6 2024-09-14T11:13:04.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.272+0000 7fc2efd25800 20 remove_watcher() i=7 2024-09-14T11:13:04.282 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:04.314 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:04.314 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:04.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.354+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 realm 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.558+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.559+0000 7f983e326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.559+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.559+0000 7f983e326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.559+0000 7f983e326800 20 searching for the correct realm 2024-09-14T11:13:04.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.562+0000 7f983a75e640 0 -- 172.21.15.28:0/2685189914 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f9830028040 msgr2=0x7f983006dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.566+0000 7f9839f5d640 0 -- 172.21.15.28:0/2685189914 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f983006f1a0 msgr2=0x7f983006d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.772+0000 7f983e326800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:04.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.772+0000 7f983e326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.772+0000 7f983e326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.772+0000 7f983e326800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.772+0000 7f983e326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.772+0000 7f983e326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:04.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 zone default found 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 4 Realm: () 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 zonegroup default 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.773+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.774+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.774+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.774+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.774+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.775+0000 7f983e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.775+0000 7f983e326800 20 started sync module instance, tier type = 2024-09-14T11:13:04.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.775+0000 7f983e326800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:04.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=0 2024-09-14T11:13:04.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=1 2024-09-14T11:13:04.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=2 2024-09-14T11:13:04.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=3 2024-09-14T11:13:04.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=4 2024-09-14T11:13:04.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=5 2024-09-14T11:13:04.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.786+0000 7f983e326800 20 add_watcher() i=6 2024-09-14T11:13:04.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.787+0000 7f983e326800 20 add_watcher() i=7 2024-09-14T11:13:04.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.787+0000 7f983e326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:04.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f96eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f983e326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f983e326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f983e326800 5 note: GC not initialized 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f96ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f983e326800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.789+0000 7f983e326800 20 Filter name: none 2024-09-14T11:13:04.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.790+0000 7f965bfff640 20 reqs_thread_entry: start 2024-09-14T11:13:04.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.790+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.790+0000 7f983e326800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.790+0000 7f983e326800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 INFO: main: starting shard=0 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:04.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.791+0000 7f983e326800 20 INFO: main: done 2024-09-14T11:13:04.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.792+0000 7f96eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.794+0000 7f983e326800 20 remove_watcher() i=0 2024-09-14T11:13:04.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.794+0000 7f983e326800 2 removed watcher, disabling cache 2024-09-14T11:13:04.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.795+0000 7f983e326800 20 remove_watcher() i=1 2024-09-14T11:13:04.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.797+0000 7f983e326800 20 remove_watcher() i=2 2024-09-14T11:13:04.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.798+0000 7f983e326800 20 remove_watcher() i=3 2024-09-14T11:13:04.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.799+0000 7f983e326800 20 remove_watcher() i=4 2024-09-14T11:13:04.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.801+0000 7f983e326800 20 remove_watcher() i=5 2024-09-14T11:13:04.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.802+0000 7f983e326800 20 remove_watcher() i=6 2024-09-14T11:13:04.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.803+0000 7f983e326800 20 remove_watcher() i=7 2024-09-14T11:13:04.816 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:04.848 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:04.848 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:04.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.889+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 realm 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.891+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.892+0000 7f8e9b40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.892+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.893+0000 7f8e9b40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:04.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.893+0000 7f8e9b40e800 20 searching for the correct realm 2024-09-14T11:13:04.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.896+0000 7f8e9725a640 0 -- 172.21.15.28:0/3750439108 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55e1e36ce4e0 msgr2=0x55e1e36d0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.900+0000 7f8e96258640 0 -- 172.21.15.28:0/3750439108 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f8e88029070 msgr2=0x7f8e8804f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.903+0000 7f8e9b40e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.903+0000 7f8e9b40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.903+0000 7f8e9b40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.903+0000 7f8e9b40e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.903+0000 7f8e9b40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.903+0000 7f8e9b40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:04.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.904+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.904+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.904+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.904+0000 7f8e9b40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.904+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 zone default found 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 4 Realm: () 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 zonegroup default 2024-09-14T11:13:04.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.905+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.906+0000 7f8e9b40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.906+0000 7f8e9b40e800 20 started sync module instance, tier type = 2024-09-14T11:13:04.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.906+0000 7f8e9b40e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=0 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=1 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=2 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=3 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=4 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=5 2024-09-14T11:13:04.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.916+0000 7f8e9b40e800 20 add_watcher() i=6 2024-09-14T11:13:04.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.917+0000 7f8e9b40e800 20 add_watcher() i=7 2024-09-14T11:13:04.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.917+0000 7f8e9b40e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:04.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.918+0000 7f8d4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8e9b40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8e9b40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8e9b40e800 5 note: GC not initialized 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8cc7fff640 20 reqs_thread_entry: start 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8e9b40e800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8e9b40e800 20 Filter name: none 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8cc5ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.919+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.920+0000 7f8e9b40e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:04.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.920+0000 7f8e9b40e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:04.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.920+0000 7f8e9b40e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:04.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.920+0000 7f8e9b40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:04.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.921+0000 7f8e9b40e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:04.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.921+0000 7f8e9b40e800 20 INFO: main: starting shard=0 2024-09-14T11:13:04.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.921+0000 7f8e9b40e800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:04.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.921+0000 7f8e9b40e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:04.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.921+0000 7f8e9b40e800 20 INFO: main: done 2024-09-14T11:13:04.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.922+0000 7f8d4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:04.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.924+0000 7f8e9b40e800 20 remove_watcher() i=0 2024-09-14T11:13:04.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.924+0000 7f8e9b40e800 2 removed watcher, disabling cache 2024-09-14T11:13:04.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.925+0000 7f8e9b40e800 20 remove_watcher() i=1 2024-09-14T11:13:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.926+0000 7f8e9b40e800 20 remove_watcher() i=2 2024-09-14T11:13:04.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.928+0000 7f8e9b40e800 20 remove_watcher() i=3 2024-09-14T11:13:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.929+0000 7f8e9b40e800 20 remove_watcher() i=4 2024-09-14T11:13:04.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.930+0000 7f8e9b40e800 20 remove_watcher() i=5 2024-09-14T11:13:04.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.931+0000 7f8e9b40e800 20 remove_watcher() i=6 2024-09-14T11:13:04.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:04.932+0000 7f8e9b40e800 20 remove_watcher() i=7 2024-09-14T11:13:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:13:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:13:04.974 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:04.974 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:05.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.015+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 realm 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.017+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.018+0000 7f3ccd887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:05.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.018+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.018+0000 7f3ccd887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:05.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.018+0000 7f3ccd887800 20 searching for the correct realm 2024-09-14T11:13:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.021+0000 7f3ccab70640 0 -- 172.21.15.28:0/51804776 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f3cbc074c00 msgr2=0x7f3cbc007cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:05.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.024+0000 7f3ccb371640 0 -- 172.21.15.28:0/51804776 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f3cc0061670 msgr2=0x7f3cc00896c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:05.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:05.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:05.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:05.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:05.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:05.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:05.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.231+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:05.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 zone default found 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 4 Realm: () 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:05.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 zonegroup default 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.232+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.233+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.233+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.233+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.233+0000 7f3ccd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.233+0000 7f3ccd887800 20 started sync module instance, tier type = 2024-09-14T11:13:05.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.233+0000 7f3ccd887800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=0 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=1 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=2 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=3 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=4 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=5 2024-09-14T11:13:05.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.248+0000 7f3ccd887800 20 add_watcher() i=6 2024-09-14T11:13:05.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.249+0000 7f3ccd887800 20 add_watcher() i=7 2024-09-14T11:13:05.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.249+0000 7f3ccd887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:05.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.250+0000 7f3b81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 5 note: GC not initialized 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3b80fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 20 Filter name: none 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3afa7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:05.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.251+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:05.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.252+0000 7f3ccd887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.253+0000 7f3ccd887800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.253+0000 7f3ccd887800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.253+0000 7f3ccd887800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:13:05.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.254+0000 7f3b81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.256+0000 7f3ccd887800 20 remove_watcher() i=0 2024-09-14T11:13:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.256+0000 7f3ccd887800 2 removed watcher, disabling cache 2024-09-14T11:13:05.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.257+0000 7f3ccd887800 20 remove_watcher() i=1 2024-09-14T11:13:05.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.258+0000 7f3ccd887800 20 remove_watcher() i=2 2024-09-14T11:13:05.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.260+0000 7f3ccd887800 20 remove_watcher() i=3 2024-09-14T11:13:05.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.261+0000 7f3ccd887800 20 remove_watcher() i=4 2024-09-14T11:13:05.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.262+0000 7f3ccd887800 20 remove_watcher() i=5 2024-09-14T11:13:05.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.262+0000 7f3ccd887800 20 remove_watcher() i=6 2024-09-14T11:13:05.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:05.264+0000 7f3ccd887800 20 remove_watcher() i=7 2024-09-14T11:13:05.273 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:13:05.273 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:05.391 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:13:05.391 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:13:06.197 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:13:06.619 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:13:08.125 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:08.126 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:08.161 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:08.162 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:08.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.204+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 realm 2024-09-14T11:13:08.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.206+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.207+0000 7f29a4e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.207+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.207+0000 7f29a4e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.207+0000 7f29a4e87800 20 searching for the correct realm 2024-09-14T11:13:08.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.212+0000 7f29a3172640 0 -- 172.21.15.28:0/2812494247 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55eb114cb190 msgr2=0x55eb114cd5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.215+0000 7f29a2170640 0 -- 172.21.15.28:0/2812494247 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f2994017050 msgr2=0x7f29940619d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.220+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 zone default found 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 4 Realm: () 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 zonegroup default 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.221+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.222+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.222+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.222+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.222+0000 7f29a4e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.222+0000 7f29a4e87800 20 started sync module instance, tier type = 2024-09-14T11:13:08.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.222+0000 7f29a4e87800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:08.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=0 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=1 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=2 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=3 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=4 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=5 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.233+0000 7f29a4e87800 20 add_watcher() i=6 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.234+0000 7f29a4e87800 20 add_watcher() i=7 2024-09-14T11:13:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.234+0000 7f29a4e87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.236+0000 7f28597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 5 note: GC not initialized 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f27d3fff640 20 reqs_thread_entry: start 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 Filter name: none 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f27d1ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.237+0000 7f29a4e87800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.238+0000 7f29a4e87800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.238+0000 7f29a4e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.238+0000 7f29a4e87800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.238+0000 7f29a4e87800 20 INFO: main: starting shard=0 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.238+0000 7f29a4e87800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.239+0000 7f29a4e87800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:08.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.239+0000 7f29a4e87800 20 INFO: main: done 2024-09-14T11:13:08.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.240+0000 7f28597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.242+0000 7f29a4e87800 20 remove_watcher() i=0 2024-09-14T11:13:08.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.242+0000 7f29a4e87800 2 removed watcher, disabling cache 2024-09-14T11:13:08.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.243+0000 7f29a4e87800 20 remove_watcher() i=1 2024-09-14T11:13:08.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.244+0000 7f29a4e87800 20 remove_watcher() i=2 2024-09-14T11:13:08.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.246+0000 7f29a4e87800 20 remove_watcher() i=3 2024-09-14T11:13:08.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.247+0000 7f29a4e87800 20 remove_watcher() i=4 2024-09-14T11:13:08.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.248+0000 7f29a4e87800 20 remove_watcher() i=5 2024-09-14T11:13:08.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.249+0000 7f29a4e87800 20 remove_watcher() i=6 2024-09-14T11:13:08.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.250+0000 7f29a4e87800 20 remove_watcher() i=7 2024-09-14T11:13:08.376 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:08.378 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:08.409 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:08.409 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:08.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.450+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 realm 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.452+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.453+0000 7f8fe6e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.453+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.453+0000 7f8fe6e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.453+0000 7f8fe6e20800 20 searching for the correct realm 2024-09-14T11:13:08.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.457+0000 7f8fe510b640 0 -- 172.21.15.28:0/3724167358 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f8fd007cbb0 msgr2=0x7f8fd006e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.460+0000 7f8fe490a640 0 -- 172.21.15.28:0/3724167358 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f8fd007a440 msgr2=0x7f8fd007a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.668+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 zone default found 2024-09-14T11:13:08.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 4 Realm: () 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 zonegroup default 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.669+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.670+0000 7f8fe6e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.670+0000 7f8fe6e20800 20 started sync module instance, tier type = 2024-09-14T11:13:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.670+0000 7f8fe6e20800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=0 2024-09-14T11:13:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=1 2024-09-14T11:13:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=2 2024-09-14T11:13:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=3 2024-09-14T11:13:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=4 2024-09-14T11:13:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=5 2024-09-14T11:13:08.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.682+0000 7f8fe6e20800 20 add_watcher() i=6 2024-09-14T11:13:08.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.683+0000 7f8fe6e20800 20 add_watcher() i=7 2024-09-14T11:13:08.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.683+0000 7f8fe6e20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.684+0000 7f8e9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8fe6e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8fe6e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8fe6e20800 5 note: GC not initialized 2024-09-14T11:13:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8e99fe3640 20 reqs_thread_entry: start 2024-09-14T11:13:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8fe6e20800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8fe6e20800 20 Filter name: none 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8e0b7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.685+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:08.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 INFO: main: starting shard=0 2024-09-14T11:13:08.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.686+0000 7f8fe6e20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:08.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.687+0000 7f8fe6e20800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:08.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.687+0000 7f8fe6e20800 20 INFO: main: done 2024-09-14T11:13:08.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.688+0000 7f8e9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.691+0000 7f8fe6e20800 20 remove_watcher() i=0 2024-09-14T11:13:08.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.691+0000 7f8fe6e20800 2 removed watcher, disabling cache 2024-09-14T11:13:08.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.692+0000 7f8fe6e20800 20 remove_watcher() i=1 2024-09-14T11:13:08.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.693+0000 7f8fe6e20800 20 remove_watcher() i=2 2024-09-14T11:13:08.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.694+0000 7f8fe6e20800 20 remove_watcher() i=3 2024-09-14T11:13:08.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.695+0000 7f8fe6e20800 20 remove_watcher() i=4 2024-09-14T11:13:08.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.696+0000 7f8fe6e20800 20 remove_watcher() i=5 2024-09-14T11:13:08.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.697+0000 7f8fe6e20800 20 remove_watcher() i=6 2024-09-14T11:13:08.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.699+0000 7f8fe6e20800 20 remove_watcher() i=7 2024-09-14T11:13:08.849 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:08.850 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:08.881 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:08.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.922+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 realm 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.924+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.925+0000 7f98c5e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.925+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.926+0000 7f98c5e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:08.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.926+0000 7f98c5e40800 20 searching for the correct realm 2024-09-14T11:13:08.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.929+0000 7f98c3129640 0 -- 172.21.15.28:0/284459413 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55c81a1977e0 msgr2=0x55c81a199bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.933+0000 7f98c392a640 0 -- 172.21.15.28:0/284459413 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f98b80cf310 msgr2=0x7f98b8007390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.937+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.938+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.938+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.938+0000 7f98c5e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.938+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:08.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 zone default found 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 4 Realm: () 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 zonegroup default 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:08.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 started sync module instance, tier type = 2024-09-14T11:13:08.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.939+0000 7f98c5e40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:08.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=0 2024-09-14T11:13:08.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=1 2024-09-14T11:13:08.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=2 2024-09-14T11:13:08.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=3 2024-09-14T11:13:08.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=4 2024-09-14T11:13:08.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=5 2024-09-14T11:13:08.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.949+0000 7f98c5e40800 20 add_watcher() i=6 2024-09-14T11:13:08.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.950+0000 7f98c5e40800 20 add_watcher() i=7 2024-09-14T11:13:08.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.950+0000 7f98c5e40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:08.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.952+0000 7f9779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.952+0000 7f98c5e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:08.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.952+0000 7f98c5e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:08.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.952+0000 7f98c5e40800 5 note: GC not initialized 2024-09-14T11:13:08.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f9778fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:08.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f98c5e40800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:08.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f98c5e40800 20 Filter name: none 2024-09-14T11:13:08.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f96f27fc640 20 reqs_thread_entry: start 2024-09-14T11:13:08.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f98c5e40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:08.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.953+0000 7f98c5e40800 20 rados->read ofs=0 len=0 2024-09-14T11:13:08.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.954+0000 7f98c5e40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:08.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.954+0000 7f98c5e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:08.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.954+0000 7f98c5e40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:08.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.954+0000 7f98c5e40800 20 INFO: main: starting shard=0 2024-09-14T11:13:08.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.954+0000 7f98c5e40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:08.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.955+0000 7f98c5e40800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:08.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.955+0000 7f98c5e40800 20 INFO: main: done 2024-09-14T11:13:08.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.956+0000 7f9779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:08.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.958+0000 7f98c5e40800 20 remove_watcher() i=0 2024-09-14T11:13:08.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.958+0000 7f98c5e40800 2 removed watcher, disabling cache 2024-09-14T11:13:08.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.959+0000 7f98c5e40800 20 remove_watcher() i=1 2024-09-14T11:13:08.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.960+0000 7f98c5e40800 20 remove_watcher() i=2 2024-09-14T11:13:08.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.962+0000 7f98c5e40800 20 remove_watcher() i=3 2024-09-14T11:13:08.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.963+0000 7f98c5e40800 20 remove_watcher() i=4 2024-09-14T11:13:08.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.964+0000 7f98c5e40800 20 remove_watcher() i=5 2024-09-14T11:13:08.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.965+0000 7f98c5e40800 20 remove_watcher() i=6 2024-09-14T11:13:08.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:08.966+0000 7f98c5e40800 20 remove_watcher() i=7 2024-09-14T11:13:09.090 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:09.092 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:13:09.123 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:09.124 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:09.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.165+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 realm 2024-09-14T11:13:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.167+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.168+0000 7ffb8bf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:09.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.168+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.168+0000 7ffb8bf2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:09.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.168+0000 7ffb8bf2a800 20 searching for the correct realm 2024-09-14T11:13:09.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.172+0000 7ffb87416640 0 -- 172.21.15.28:0/2530792451 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x557ce7e27210 msgr2=0x557ce7e29600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:09.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.175+0000 7ffb87c17640 0 -- 172.21.15.28:0/2530792451 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ffb7c0750b0 msgr2=0x7ffb7c0812e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.179+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:09.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 zone default found 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 4 Realm: () 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 zonegroup default 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.180+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.181+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.181+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.181+0000 7ffb8bf2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.181+0000 7ffb8bf2a800 20 started sync module instance, tier type = 2024-09-14T11:13:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.181+0000 7ffb8bf2a800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:09.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=0 2024-09-14T11:13:09.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=1 2024-09-14T11:13:09.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=2 2024-09-14T11:13:09.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=3 2024-09-14T11:13:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=4 2024-09-14T11:13:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=5 2024-09-14T11:13:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.192+0000 7ffb8bf2a800 20 add_watcher() i=6 2024-09-14T11:13:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.193+0000 7ffb8bf2a800 20 add_watcher() i=7 2024-09-14T11:13:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.193+0000 7ffb8bf2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:09.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.195+0000 7ffa3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:09.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.195+0000 7ffb8bf2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:09.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.195+0000 7ffb8bf2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:09.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.195+0000 7ffb8bf2a800 5 note: GC not initialized 2024-09-14T11:13:09.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.195+0000 7ffa3cfe1640 20 reqs_thread_entry: start 2024-09-14T11:13:09.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.195+0000 7ffb8bf2a800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:09.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.196+0000 7ffb8bf2a800 20 Filter name: none 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.196+0000 7ff9b67fc640 20 reqs_thread_entry: start 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.196+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.196+0000 7ffb8bf2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.196+0000 7ffb8bf2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:09.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:13:09.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 INFO: main: starting shard=0 2024-09-14T11:13:09.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:09.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:09.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.197+0000 7ffb8bf2a800 20 INFO: main: done 2024-09-14T11:13:09.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.198+0000 7ffa3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:09.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.200+0000 7ffb8bf2a800 20 remove_watcher() i=0 2024-09-14T11:13:09.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.200+0000 7ffb8bf2a800 2 removed watcher, disabling cache 2024-09-14T11:13:09.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.201+0000 7ffb8bf2a800 20 remove_watcher() i=1 2024-09-14T11:13:09.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.202+0000 7ffb8bf2a800 20 remove_watcher() i=2 2024-09-14T11:13:09.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.204+0000 7ffb8bf2a800 20 remove_watcher() i=3 2024-09-14T11:13:09.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.205+0000 7ffb8bf2a800 20 remove_watcher() i=4 2024-09-14T11:13:09.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.206+0000 7ffb8bf2a800 20 remove_watcher() i=5 2024-09-14T11:13:09.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.207+0000 7ffb8bf2a800 20 remove_watcher() i=6 2024-09-14T11:13:09.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:09.208+0000 7ffb8bf2a800 20 remove_watcher() i=7 2024-09-14T11:13:09.244 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:13:09.650 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:13:10.060 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:13:10.090 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:10.090 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:10.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.131+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 realm 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.132+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.133+0000 7f6bc9d36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:10.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.133+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.133+0000 7f6bc9d36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:10.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.133+0000 7f6bc9d36800 20 searching for the correct realm 2024-09-14T11:13:10.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.137+0000 7f6bc52b6640 0 -- 172.21.15.28:0/3557119676 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55b6db0a7800 msgr2=0x55b6db0a9ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:10.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.141+0000 7f6bc5ab7640 0 -- 172.21.15.28:0/3557119676 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f6bbc061910 msgr2=0x7f6bbc0783d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.145+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 zone default found 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 4 Realm: () 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 zonegroup default 2024-09-14T11:13:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.146+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.147+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.147+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.147+0000 7f6bc9d36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.147+0000 7f6bc9d36800 20 started sync module instance, tier type = 2024-09-14T11:13:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.147+0000 7f6bc9d36800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:10.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=0 2024-09-14T11:13:10.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=1 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=2 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=3 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=4 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=5 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.157+0000 7f6bc9d36800 20 add_watcher() i=6 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.158+0000 7f6bc9d36800 20 add_watcher() i=7 2024-09-14T11:13:10.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.158+0000 7f6bc9d36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:10.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6a777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6bc9d36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6bc9d36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6bc9d36800 5 note: GC not initialized 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6a767fc640 20 reqs_thread_entry: start 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6bc9d36800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.160+0000 7f6bc9d36800 20 Filter name: none 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f69e7fff640 20 reqs_thread_entry: start 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.161+0000 7f6bc9d36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.162+0000 7f6bc9d36800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.167+0000 7f6a777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:10.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.169+0000 7f6bc9d36800 20 remove_watcher() i=0 2024-09-14T11:13:10.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.169+0000 7f6bc9d36800 2 removed watcher, disabling cache 2024-09-14T11:13:10.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.170+0000 7f6bc9d36800 20 remove_watcher() i=1 2024-09-14T11:13:10.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.172+0000 7f6bc9d36800 20 remove_watcher() i=2 2024-09-14T11:13:10.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.173+0000 7f6bc9d36800 20 remove_watcher() i=3 2024-09-14T11:13:10.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.174+0000 7f6bc9d36800 20 remove_watcher() i=4 2024-09-14T11:13:10.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.175+0000 7f6bc9d36800 20 remove_watcher() i=5 2024-09-14T11:13:10.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.176+0000 7f6bc9d36800 20 remove_watcher() i=6 2024-09-14T11:13:10.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.177+0000 7f6bc9d36800 20 remove_watcher() i=7 2024-09-14T11:13:10.188 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:13:10.223 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:10.223 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:10.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.264+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 realm 2024-09-14T11:13:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.265+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.266+0000 7f88da520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:10.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.266+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.266+0000 7f88da520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:10.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.266+0000 7f88da520800 20 searching for the correct realm 2024-09-14T11:13:10.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.270+0000 7f88d5a67640 0 -- 172.21.15.28:0/2542056610 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5612d3c48290 msgr2=0x5612d3c4a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:10.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.274+0000 7f88d6268640 0 -- 172.21.15.28:0/2542056610 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f88c002d420 msgr2=0x7f88c002d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.278+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 zone default found 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 4 Realm: () 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 zonegroup default 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 started sync module instance, tier type = 2024-09-14T11:13:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.279+0000 7f88da520800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:10.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=0 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=1 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=2 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=3 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=4 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=5 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.293+0000 7f88da520800 20 add_watcher() i=6 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.294+0000 7f88da520800 20 add_watcher() i=7 2024-09-14T11:13:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.294+0000 7f88da520800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:10.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.296+0000 7f878cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.296+0000 7f88da520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.296+0000 7f88da520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.296+0000 7f88da520800 5 note: GC not initialized 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.296+0000 7f87077fe640 20 reqs_thread_entry: start 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.296+0000 7f88da520800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 20 Filter name: none 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f87057fa640 20 reqs_thread_entry: start 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:10.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:10.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:10.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 : miss 2024-09-14T11:13:10.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.297+0000 7f88da520800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 info.flags=0x17 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 to cache LRU end 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.298+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.299+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.299+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:c state=0x5612d3c798f8 s->prefetch_data=0 2024-09-14T11:13:10.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.300+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to 7b6dkx4nqlu68mprxzmltkjivncn9rw2 2024-09-14T11:13:10.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.300+0000 7f88da520800 20 get_obj_state_impl: setting s->olh_tag to 8s4mj03ij2nqh2no6q7plcu9jp8gxf5q 2024-09-14T11:13:10.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.300+0000 7f88da520800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8s4mj03ij2nqh2no6q7plcu9jp8gxf5q 2024-09-14T11:13:10.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.301+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.302+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 20 olh_log_entry: epoch=3 op=3 key=c[25rFev2ky7YVT8ABP1zM0YK2X263vru] 2024-09-14T11:13:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:25rFev2ky7YVT8ABP1zM0YK2X263vru_c state=0x5612d3c789a8 s->prefetch_data=0 2024-09-14T11:13:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 10 manifest: total_size = 22 2024-09-14T11:13:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7549049144895812887 2024-09-14T11:13:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:25rFev2ky7YVT8ABP1zM0YK2X263vru_c state=0x5612d3c789a8 s->prefetch_data=0 2024-09-14T11:13:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 20 prepare_atomic_modification: state is not atomic. state=0x5612d3c789a8 2024-09-14T11:13:10.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.303+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.309+0000 7f88da520800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:10.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.309+0000 7f88da520800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:13:10.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.309+0000 7f88da520800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:10.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.309+0000 7f88da520800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:25rFev2ky7YVT8ABP1zM0YK2X263vru_.VSp1p4KQC8dah_XOgKo9ZRBXgG2e5aD_0 2024-09-14T11:13:10.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.312+0000 7f87b9ffb640 20 handle_completion(): completion ok for obj=c[25rFev2ky7YVT8ABP1zM0YK2X263vru] 2024-09-14T11:13:10.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.312+0000 7f88da520800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:10.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.313+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.313+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.315+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.316+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.316+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:d state=0x5612d3c798f8 s->prefetch_data=0 2024-09-14T11:13:10.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.316+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to piosh68btfj9irkfybx5x5dpbisxmqil 2024-09-14T11:13:10.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.316+0000 7f88da520800 20 get_obj_state_impl: setting s->olh_tag to 44x214415z49xpsgq4g874emo88104r1 2024-09-14T11:13:10.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.316+0000 7f88da520800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=44x214415z49xpsgq4g874emo88104r1 2024-09-14T11:13:10.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.318+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.319+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.319+0000 7f88da520800 20 olh_log_entry: epoch=3 op=3 key=d[bRLqZgJ-YRBlJ1mW683ZGZODOI0UV6C] 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.319+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:bRLqZgJ-YRBlJ1mW683ZGZODOI0UV6C_d state=0x5612d3cbadd8 s->prefetch_data=0 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.320+0000 7f88da520800 10 manifest: total_size = 22 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.320+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5944576486187895878 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.320+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:bRLqZgJ-YRBlJ1mW683ZGZODOI0UV6C_d state=0x5612d3cbadd8 s->prefetch_data=0 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.320+0000 7f88da520800 20 prepare_atomic_modification: state is not atomic. state=0x5612d3cbadd8 2024-09-14T11:13:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.320+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.322+0000 7f88da520800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:10.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.322+0000 7f88da520800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:13:10.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.322+0000 7f88da520800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:10.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.322+0000 7f88da520800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:bRLqZgJ-YRBlJ1mW683ZGZODOI0UV6C_.9rwz-O-o1-QcVxj3PCyJdYeeAKgV_Qg_0 2024-09-14T11:13:10.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.324+0000 7f87b97fa640 20 handle_completion(): completion ok for obj=d[bRLqZgJ-YRBlJ1mW683ZGZODOI0UV6C] 2024-09-14T11:13:10.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.324+0000 7f88da520800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:10.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.325+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.325+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.326+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.327+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.327+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:e state=0x5612d3cbd178 s->prefetch_data=0 2024-09-14T11:13:10.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.327+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to kda7y5dy076fgxk3jstua8ht2uiejx6l 2024-09-14T11:13:10.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.327+0000 7f88da520800 20 get_obj_state_impl: setting s->olh_tag to rikujzywcu3h0eyhyc982mw0yz3bdd69 2024-09-14T11:13:10.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.327+0000 7f88da520800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rikujzywcu3h0eyhyc982mw0yz3bdd69 2024-09-14T11:13:10.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.329+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.330+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:13:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 olh_log_entry: epoch=2 op=3 key=e[T09rpixR3k3EuoK8.5REtZIEQzZO2MN] 2024-09-14T11:13:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:T09rpixR3k3EuoK8.5REtZIEQzZO2MN_e state=0x5612d3cbadd8 s->prefetch_data=0 2024-09-14T11:13:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 10 manifest: total_size = 22 2024-09-14T11:13:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17923076391011251730 2024-09-14T11:13:10.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:T09rpixR3k3EuoK8.5REtZIEQzZO2MN_e state=0x5612d3cbadd8 s->prefetch_data=0 2024-09-14T11:13:10.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 prepare_atomic_modification: state is not atomic. state=0x5612d3cbadd8 2024-09-14T11:13:10.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.331+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.334+0000 7f88da520800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:10.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.334+0000 7f88da520800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:13:10.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.334+0000 7f88da520800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:10.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.334+0000 7f88da520800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:T09rpixR3k3EuoK8.5REtZIEQzZO2MN_.tpcFioY3WnsHbbbPSzHMXYEfDGH89AM_0 2024-09-14T11:13:10.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.335+0000 7f88da520800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:10.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.335+0000 7f87b97fa640 20 handle_completion(): completion ok for obj=e[T09rpixR3k3EuoK8.5REtZIEQzZO2MN] 2024-09-14T11:13:10.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.336+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:e state=0x5612d3cbd178 s->prefetch_data=0 2024-09-14T11:13:10.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.336+0000 7f88da520800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rikujzywcu3h0eyhyc982mw0yz3bdd69 2024-09-14T11:13:10.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.339+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.340+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.341+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.341+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:f state=0x5612d3cbd178 s->prefetch_data=0 2024-09-14T11:13:10.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.341+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to p6bvh5fqpqderhgdlx9ko5tgjxc3b5lp 2024-09-14T11:13:10.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.341+0000 7f88da520800 20 get_obj_state_impl: setting s->olh_tag to lyicft3ucnhx1p2bs30wlke6bu3qq062 2024-09-14T11:13:10.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.341+0000 7f88da520800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lyicft3ucnhx1p2bs30wlke6bu3qq062 2024-09-14T11:13:10.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.342+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.344+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.344+0000 7f88da520800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:13:10.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.344+0000 7f88da520800 20 olh_log_entry: epoch=2 op=3 key=f[arHaiHGw6Ci-fq7l.qTRBJIhsv0oY1Y] 2024-09-14T11:13:10.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.344+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:arHaiHGw6Ci-fq7l.qTRBJIhsv0oY1Y_f state=0x5612d3cbadd8 s->prefetch_data=0 2024-09-14T11:13:10.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.345+0000 7f88da520800 10 manifest: total_size = 22 2024-09-14T11:13:10.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.345+0000 7f88da520800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3335262468751772569 2024-09-14T11:13:10.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.345+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:_:arHaiHGw6Ci-fq7l.qTRBJIhsv0oY1Y_f state=0x5612d3cbadd8 s->prefetch_data=0 2024-09-14T11:13:10.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.345+0000 7f88da520800 20 prepare_atomic_modification: state is not atomic. state=0x5612d3cbadd8 2024-09-14T11:13:10.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.345+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.347+0000 7f88da520800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:13:10.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.347+0000 7f88da520800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:13:10.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.347+0000 7f88da520800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:13:10.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.347+0000 7f88da520800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1__shadow:arHaiHGw6Ci-fq7l.qTRBJIhsv0oY1Y_.z8xtAbAH38t6rEPD8Gn0rRcST9Uy18d_0 2024-09-14T11:13:10.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.349+0000 7f88da520800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:13:10.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.349+0000 7f87b97fa640 20 handle_completion(): completion ok for obj=f[arHaiHGw6Ci-fq7l.qTRBJIhsv0oY1Y] 2024-09-14T11:13:10.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.350+0000 7f88da520800 20 get_obj_state: octx=0x5612d39ccba0 obj=check-bucket:f state=0x5612d3cbd178 s->prefetch_data=0 2024-09-14T11:13:10.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.350+0000 7f88da520800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lyicft3ucnhx1p2bs30wlke6bu3qq062 2024-09-14T11:13:10.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.353+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.354+0000 7f88da520800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1.0 2024-09-14T11:13:10.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.354+0000 7f88da520800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-14T11:13:10.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.354+0000 7f88da520800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:13:10.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.355+0000 7f878cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:10.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.357+0000 7f88da520800 20 remove_watcher() i=0 2024-09-14T11:13:10.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.357+0000 7f88da520800 2 removed watcher, disabling cache 2024-09-14T11:13:10.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.358+0000 7f88da520800 20 remove_watcher() i=1 2024-09-14T11:13:10.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.360+0000 7f88da520800 20 remove_watcher() i=2 2024-09-14T11:13:10.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.361+0000 7f88da520800 20 remove_watcher() i=3 2024-09-14T11:13:10.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.362+0000 7f88da520800 20 remove_watcher() i=4 2024-09-14T11:13:10.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.363+0000 7f88da520800 20 remove_watcher() i=5 2024-09-14T11:13:10.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.364+0000 7f88da520800 20 remove_watcher() i=6 2024-09-14T11:13:10.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.365+0000 7f88da520800 20 remove_watcher() i=7 2024-09-14T11:13:10.595 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:13:10.624 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:10.624 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:10.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.867+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 realm 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:10.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.869+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.870+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:10.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.870+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:10.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.871+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:10.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.871+0000 7f5a168bb800 20 searching for the correct realm 2024-09-14T11:13:10.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:10.874+0000 7f5a13ba4640 0 -- 172.21.15.28:0/404706339 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55a309609260 msgr2=0x55a30960b690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:11.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.079+0000 7f5a143a5640 0 -- 172.21.15.28:0/404706339 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5a080a9450 msgr2=0x7f5a080a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:11.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.286+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 20 zone default found 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 4 Realm: () 2024-09-14T11:13:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 20 zonegroup default 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.287+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.288+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:11.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.288+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.288+0000 7f5a168bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:11.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.288+0000 7f5a168bb800 20 started sync module instance, tier type = 2024-09-14T11:13:11.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.288+0000 7f5a168bb800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:13:11.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=0 2024-09-14T11:13:11.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=1 2024-09-14T11:13:11.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=2 2024-09-14T11:13:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=3 2024-09-14T11:13:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=4 2024-09-14T11:13:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=5 2024-09-14T11:13:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.298+0000 7f5a168bb800 20 add_watcher() i=6 2024-09-14T11:13:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.299+0000 7f5a168bb800 20 add_watcher() i=7 2024-09-14T11:13:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.299+0000 7f5a168bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.301+0000 7f58cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.301+0000 7f5a168bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.301+0000 7f5a168bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.301+0000 7f5a168bb800 5 note: GC not initialized 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.301+0000 7f58c9fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.302+0000 7f5a168bb800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:11.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.302+0000 7f5a168bb800 20 Filter name: none 2024-09-14T11:13:11.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.302+0000 7f583b7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:11.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.302+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.302+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.302+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.303+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.303+0000 7f5a168bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.303+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.303+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.303+0000 7f5a168bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.304+0000 7f5a168bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.304+0000 7f5a168bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:11.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.305+0000 7f58cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:11.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.307+0000 7f5a168bb800 20 remove_watcher() i=0 2024-09-14T11:13:11.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.307+0000 7f5a168bb800 2 removed watcher, disabling cache 2024-09-14T11:13:11.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.309+0000 7f5a168bb800 20 remove_watcher() i=1 2024-09-14T11:13:11.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.310+0000 7f5a168bb800 20 remove_watcher() i=2 2024-09-14T11:13:11.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.311+0000 7f5a168bb800 20 remove_watcher() i=3 2024-09-14T11:13:11.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.312+0000 7f5a168bb800 20 remove_watcher() i=4 2024-09-14T11:13:11.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.313+0000 7f5a168bb800 20 remove_watcher() i=5 2024-09-14T11:13:11.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.315+0000 7f5a168bb800 20 remove_watcher() i=6 2024-09-14T11:13:11.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:13:11.316+0000 7f5a168bb800 20 remove_watcher() i=7 2024-09-14T11:13:11.326 INFO:tasks.workunit.client.0.smithi028.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:13:11.326 INFO:tasks.workunit.client.0.smithi028.stderr:Deleting bucket check-bucket 2024-09-14T11:13:11.496 INFO:tasks.workunit.client.0.smithi028.stderr:Completed bucket check tests 2024-09-14T11:13:11.496 INFO:tasks.workunit.client.0.smithi028.stdout:connected to http://localhost:80 2024-09-14T11:13:11.556 INFO:tasks.workunit.client.0.smithi028.stderr:+ deactivate 2024-09-14T11:13:11.556 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:13:11.556 INFO:tasks.workunit.client.0.smithi028.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ export PATH 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n '' ']' 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ hash -r 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n '' ']' 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset -f deactivate 2024-09-14T11:13:11.557 INFO:tasks.workunit.client.0.smithi028.stderr:+ echo OK. 2024-09-14T11:13:11.558 INFO:tasks.workunit.client.0.smithi028.stdout:OK. 2024-09-14T11:13:11.558 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:13:11.559 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:13:11.598 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:13:11.598 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:13:11.987 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:11.988 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:12.027 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:12.027 DEBUG:teuthology.orchestra.run.smithi028:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:12.105 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:12.105 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:13:12.116 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:12.117 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:13:12.117 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:12.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:13:12.175 INFO:teuthology.orchestra.run.smithi028.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:13:12.175 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:12.245 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:12.245 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:13:12.314 INFO:tasks.workunit:timeout=3h 2024-09-14T11:13:12.315 INFO:tasks.workunit:cleanup=True 2024-09-14T11:13:12.315 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:12.386 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:14:09.732 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 94% (12206/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:14:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:14:10.310 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:14:10.311 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:14:10.381 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:14:10.383 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:10.383 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:14:10.433 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:14:10.483 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:14:10.523 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:10.525 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:10.525 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:14:10.564 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:10.567 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:14:10.567 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:14:10.638 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:14:10.639 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:14:10.639 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:14:10.724 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:14:10.724 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:14:10.724 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:14:10.724 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:14:10.724 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:14:12.099 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:12.099 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: exclusive 2024-09-14T11:14:12.099 INFO:tasks.workunit.client.0.smithi028.stdout: tag: 2024-09-14T11:14:12.100 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:12.100 INFO:tasks.workunit.client.0.smithi028.stdout: client.4949 expiration=2024-09-14T11:16:12.097581+0000 addr=v1:172.21.15.28:0/3380631365 cookie= 2024-09-14T11:14:12.104 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:12.104 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: shared 2024-09-14T11:14:12.104 INFO:tasks.workunit.client.0.smithi028.stdout: tag: 2024-09-14T11:14:12.104 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:12.104 INFO:tasks.workunit.client.0.smithi028.stdout: client.4949 expiration=2024-09-14T11:16:12.105170+0000 addr=v1:172.21.15.28:0/3380631365 cookie= 2024-09-14T11:14:12.104 INFO:tasks.workunit.client.0.smithi028.stdout: client.5127 expiration=0.000000 addr=v1:172.21.15.28:0/2789031190 cookie= 2024-09-14T11:14:12.105 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:12.105 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: shared 2024-09-14T11:14:12.105 INFO:tasks.workunit.client.0.smithi028.stdout: tag: 2024-09-14T11:14:12.105 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:12.105 INFO:tasks.workunit.client.0.smithi028.stdout: client.5127 expiration=0.000000 addr=v1:172.21.15.28:0/2789031190 cookie= 2024-09-14T11:14:13.014 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestMultiLocking (2291 ms) 2024-09-14T11:14:13.015 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: shared 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi028.stdout: tag: 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi028.stdout: client.5139 expiration=0.000000 addr=v1:172.21.15.28:0/991065846 cookie= 2024-09-14T11:14:15.274 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:15.274 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: exclusive 2024-09-14T11:14:15.274 INFO:tasks.workunit.client.0.smithi028.stdout: tag: new_tag 2024-09-14T11:14:15.274 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:15.274 INFO:tasks.workunit.client.0.smithi028.stdout: client.4958 expiration=0.000000 addr=v1:172.21.15.28:0/749875516 cookie= 2024-09-14T11:14:16.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestMeta (3016 ms) 2024-09-14T11:14:16.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:14:18.060 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:18.061 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: exclusive 2024-09-14T11:14:18.061 INFO:tasks.workunit.client.0.smithi028.stdout: tag: 2024-09-14T11:14:18.061 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:18.063 INFO:tasks.workunit.client.0.smithi028.stdout:lock: mylock 2024-09-14T11:14:18.063 INFO:tasks.workunit.client.0.smithi028.stdout: lock_type: shared 2024-09-14T11:14:18.063 INFO:tasks.workunit.client.0.smithi028.stdout: tag: 2024-09-14T11:14:18.063 INFO:tasks.workunit.client.0.smithi028.stdout: lockers: 2024-09-14T11:14:18.063 INFO:tasks.workunit.client.0.smithi028.stdout: client.5145 expiration=0.000000 addr=v1:172.21.15.28:0/2250839103 cookie= 2024-09-14T11:14:18.063 INFO:tasks.workunit.client.0.smithi028.stdout: client.5145 expiration=0.000000 addr=v1:172.21.15.28:0/2250839103 cookie=new cookie 2024-09-14T11:14:19.048 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestCookie (3017 ms) 2024-09-14T11:14:19.048 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:14:22.066 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestMultipleLocks (3018 ms) 2024-09-14T11:14:22.066 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:14:29.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestLockDuration (7076 ms) 2024-09-14T11:14:29.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:14:32.166 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestAssertLocked (3023 ms) 2024-09-14T11:14:32.167 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:14:35.181 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestSetCookie (3017 ms) 2024-09-14T11:14:35.182 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:14:55.611 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestRenew (20429 ms) 2024-09-14T11:14:55.611 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:15:01.688 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6077 ms) 2024-09-14T11:15:01.688 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:15:08.772 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7084 ms) 2024-09-14T11:15:08.773 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8033 ms) 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 11 tests from ClsLock (66081 ms total) 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 11 tests from 1 test suite ran. (66081 ms total) 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 11 tests. 2024-09-14T11:15:16.810 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:16.810 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:16.855 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:15:16.856 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:15:16.857 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:15:16.945 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:16.945 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:15:16.945 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:16.945 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 4 tests from cls_log 2024-09-14T11:15:16.945 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:15:19.826 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_log.test_log_add_same_time (2878 ms) 2024-09-14T11:15:19.827 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:15:22.840 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_log.test_log_add_different_time (3017 ms) 2024-09-14T11:15:22.841 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:15:25.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_log.trim_by_time (3026 ms) 2024-09-14T11:15:25.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:15:28.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_log.trim_by_marker (3010 ms) 2024-09-14T11:15:28.876 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 4 tests from cls_log (11931 ms total) 2024-09-14T11:15:28.876 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:15:28.876 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:28.876 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 4 tests from 1 test suite ran. (11931 ms total) 2024-09-14T11:15:28.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 4 tests. 2024-09-14T11:15:28.879 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:28.879 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:28.925 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:15:28.926 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:15:28.926 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:15:29.012 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:29.012 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:15:29.012 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:29.012 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:15:29.013 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:15:31.902 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_implicit (2889 ms) 2024-09-14T11:15:31.902 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:15:34.925 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3020 ms) 2024-09-14T11:15:34.928 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:15:43.968 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_put_snap (9046 ms) 2024-09-14T11:15:43.968 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:15:46.990 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_explicit (3019 ms) 2024-09-14T11:15:46.990 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:15:50.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.set (3021 ms) 2024-09-14T11:15:50.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:15:57.040 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_implicit_ec (7032 ms) 2024-09-14T11:15:57.040 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:16:04.063 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7024 ms) 2024-09-14T11:16:04.064 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:16:16.177 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_put_snap_ec (12112 ms) 2024-09-14T11:16:16.177 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:16:23.207 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.test_explicit_ec (7031 ms) 2024-09-14T11:16:23.207 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:16:30.237 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_refcount.set_ec (7030 ms) 2024-09-14T11:16:30.237 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 10 tests from cls_refcount (61224 ms total) 2024-09-14T11:16:30.237 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:16:30.237 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:16:30.237 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 10 tests from 1 test suite ran. (61224 ms total) 2024-09-14T11:16:30.237 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 10 tests. 2024-09-14T11:16:30.240 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:30.240 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:30.283 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:16:30.284 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:16:30.285 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:16:30.370 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:16:30.370 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:16:30.370 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:16:30.371 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:16:32.240 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:16:32.285 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_basic (46 ms) 2024-09-14T11:16:32.286 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:16:32.319 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (34 ms) 2024-09-14T11:16:32.319 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:16:32.366 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_remove_object (46 ms) 2024-09-14T11:16:32.366 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:16:33.849 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_suggest (1483 ms) 2024-09-14T11:16:33.849 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:16:33.855 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-14T11:16:33.855 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:16:33.877 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_list (21 ms) 2024-09-14T11:16:33.877 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:16:53.516 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_list_delimited (19639 ms) 2024-09-14T11:16:53.516 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:16:53.589 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.bi_list (74 ms) 2024-09-14T11:16:53.589 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:16:53.599 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-14T11:16:53.599 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:16:53.609 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2024-09-14T11:16:53.609 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:17:00.710 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.gc_defer (7102 ms) 2024-09-14T11:17:00.711 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:17:00.788 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.usage_basic (78 ms) 2024-09-14T11:17:00.788 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:17:00.789 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-14T11:17:00.789 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:17:00.883 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.usage_clear (94 ms) 2024-09-14T11:17:00.883 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:17:00.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.bi_log_trim (51 ms) 2024-09-14T11:17:00.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:17:00.950 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.index_racing_removes (15 ms) 2024-09-14T11:17:00.950 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:17:00.963 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.reshardlog_list (14 ms) 2024-09-14T11:17:00.963 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:17:00.973 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw.reshardlog_num (9 ms) 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 18 tests from cls_rgw (28733 ms total) 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 18 tests from 1 test suite ran. (31349 ms total) 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 18 tests. 2024-09-14T11:17:01.723 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:01.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:01.767 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:17:01.768 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:17:01.768 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:17:01.855 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:01.855 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:17:01.856 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:01.856 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:17:01.856 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:17:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.init (1885 ms) 2024-09-14T11:17:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:17:03.758 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (17 ms) 2024-09-14T11:17:03.758 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:17:03.758 INFO:tasks.workunit.client.0.smithi028.stderr:[ ] list info tag = chain-0 2024-09-14T11:17:03.765 INFO:tasks.workunit.client.0.smithi028.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:17:03.765 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-14T11:17:03.765 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:17:03.773 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-14T11:17:03.773 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:17:03.781 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-14T11:17:03.781 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:17:03.920 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (140 ms) 2024-09-14T11:17:03.921 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:17:03.929 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-14T11:17:03.929 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:17:03.936 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-14T11:17:03.937 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:17:04.745 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_gc.finalize (808 ms) 2024-09-14T11:17:04.745 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 9 tests from cls_rgw_gc (2889 ms total) 2024-09-14T11:17:04.745 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:17:04.745 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:04.745 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 9 tests from 1 test suite ran. (2889 ms total) 2024-09-14T11:17:04.746 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 9 tests. 2024-09-14T11:17:04.749 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:04.749 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:04.793 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:17:04.794 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:17:04.794 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:17:04.891 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:04.891 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:04.892 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:17:04.892 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:06.760 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:17:06.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:17:06.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.780+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~BZU8W4JDIB36.0 size=1048576 2024-09-14T11:17:06.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.781+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~BZU8W4JDIB36.1 size=733662 2024-09-14T11:17:06.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.781+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=BZU8W4JDIB36 tag=476TYIZA1G72 type=write size=2830814 2024-09-14T11:17:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.784+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~2J23LLWNBZ6N.0 size=1048576 2024-09-14T11:17:06.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.785+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~2J23LLWNBZ6N.1 size=1048576 2024-09-14T11:17:06.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.786+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~2J23LLWNBZ6N.2 size=363056 2024-09-14T11:17:06.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.786+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=2J23LLWNBZ6N tag=8RNX299DQTS3 type=write size=3508784 2024-09-14T11:17:06.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.788+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=MI6N1EZVF5JR type=del size=2285782 2024-09-14T11:17:06.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.789+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=K037JLLEM48F type=del size=2567781 2024-09-14T11:17:06.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.792+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~7EAM7C7CTV08.0 size=1048576 2024-09-14T11:17:06.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.793+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~7EAM7C7CTV08.1 size=677770 2024-09-14T11:17:06.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.793+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=7EAM7C7CTV08 tag=O4S4P2GQHZ1H type=write size=2774922 2024-09-14T11:17:06.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.794+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=C75Y0R80QSAO type=del size=711936 2024-09-14T11:17:06.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.795+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=FEX1XS90SWIK type=write size=35029 2024-09-14T11:17:06.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.797+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=R0VYIRNPSZNP type=del size=360188 2024-09-14T11:17:06.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.798+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=0T7KQY7S0CGQ type=del size=3864708 2024-09-14T11:17:06.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.801+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~6S5K7UZA8AFB.0 size=600722 2024-09-14T11:17:06.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.801+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=6S5K7UZA8AFB tag=PLESIGSHOQ7K type=write size=1649298 2024-09-14T11:17:06.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.803+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=CB6AYS8IWY9T type=del size=1703084 2024-09-14T11:17:06.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.804+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=4HMZLK2MXUSS type=del size=1289591 2024-09-14T11:17:06.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.806+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=IB8E2PTXBASQ type=del size=2130792 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.808+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~CPS2UNNM52RT.0 size=1048576 2024-09-14T11:17:06.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.809+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~CPS2UNNM52RT.1 size=414396 2024-09-14T11:17:06.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.809+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=CPS2UNNM52RT tag=EBF391VVEA11 type=write size=2511548 2024-09-14T11:17:06.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.811+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=F28VL4KFVMJ1 type=del size=2678435 2024-09-14T11:17:06.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.812+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=1GGVW77ZIE2Q type=del size=1878197 2024-09-14T11:17:06.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.814+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~BZU8W4JDIB36.0 size=1048576 2024-09-14T11:17:06.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.815+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~BZU8W4JDIB36.1 size=733662 2024-09-14T11:17:06.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.818+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=BZU8W4JDIB36 tag=476TYIZA1G72 type=write size=2830814 2024-09-14T11:17:06.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.819+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=1ZWECIM45NT2 type=del size=1180045 2024-09-14T11:17:06.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.821+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~2J23LLWNBZ6N.0 size=1048576 2024-09-14T11:17:06.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.822+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~2J23LLWNBZ6N.1 size=1048576 2024-09-14T11:17:06.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.823+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~2J23LLWNBZ6N.2 size=363056 2024-09-14T11:17:06.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.826+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=2J23LLWNBZ6N tag=8RNX299DQTS3 type=write size=3508784 2024-09-14T11:17:06.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.827+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=NZ0FSFZ1RI7D type=write size=402796 2024-09-14T11:17:06.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.829+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=MI6N1EZVF5JR type=del 2024-09-14T11:17:06.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.830+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=USIHI9QVZAPK type=del size=1048246 2024-09-14T11:17:06.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.833+0000 7f185d9f8780 1 < suggested remove operation key=7XGG5LBGRI4H tag=K037JLLEM48F type=del 2024-09-14T11:17:06.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.834+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=89PP2JQM2TBW type=del size=1218999 2024-09-14T11:17:06.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.836+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~7EAM7C7CTV08.0 size=1048576 2024-09-14T11:17:06.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.837+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~7EAM7C7CTV08.1 size=677770 2024-09-14T11:17:06.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.839+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=7EAM7C7CTV08 tag=O4S4P2GQHZ1H type=write size=2774922 2024-09-14T11:17:06.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.841+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=DYP3VZ576LM2 type=del size=2719929 2024-09-14T11:17:06.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.842+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=C75Y0R80QSAO type=del 2024-09-14T11:17:06.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.844+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=92779ZAP6D8T type=del size=983380 2024-09-14T11:17:06.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.845+0000 7f185d9f8780 1 < completed write operation key=DAKWA1OCVTBG tag=FEX1XS90SWIK type=write size=35029 2024-09-14T11:17:06.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.848+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~F9H2X78LG0B4.0 size=1048576 2024-09-14T11:17:06.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.849+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~F9H2X78LG0B4.1 size=19179 2024-09-14T11:17:06.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.849+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=F9H2X78LG0B4 tag=DYKTPGM3IR4E type=write size=2116331 2024-09-14T11:17:06.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.850+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=R0VYIRNPSZNP type=del 2024-09-14T11:17:06.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.852+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=S3T1OR8GIBDY type=del size=540047 2024-09-14T11:17:06.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.853+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=0T7KQY7S0CGQ type=del 2024-09-14T11:17:06.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.855+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~8OI7GZ70LLNB.0 size=992636 2024-09-14T11:17:06.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.855+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=8OI7GZ70LLNB tag=ND3IRSI8OC2W type=write size=2041212 2024-09-14T11:17:06.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.857+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~6S5K7UZA8AFB.0 size=600722 2024-09-14T11:17:06.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.859+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=6S5K7UZA8AFB tag=PLESIGSHOQ7K type=write size=1649298 2024-09-14T11:17:06.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.860+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=UKAUXKA642T3 type=del size=533483 2024-09-14T11:17:06.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.862+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=CB6AYS8IWY9T type=del 2024-09-14T11:17:06.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.864+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~170RP22A21HW.0 size=166985 2024-09-14T11:17:06.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.864+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=170RP22A21HW tag=SDCK07M3B4H6 type=write size=1215561 2024-09-14T11:17:06.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.865+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=4HMZLK2MXUSS type=del 2024-09-14T11:17:06.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.866+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=N69X1BAR2EPR type=write size=88909 2024-09-14T11:17:06.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.868+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=IB8E2PTXBASQ type=del 2024-09-14T11:17:06.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.869+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=F1Y2ESEGBZWR type=del size=2328130 2024-09-14T11:17:06.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.870+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~CPS2UNNM52RT.0 size=1048576 2024-09-14T11:17:06.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.871+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~CPS2UNNM52RT.1 size=414396 2024-09-14T11:17:06.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.873+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=CPS2UNNM52RT tag=EBF391VVEA11 type=write size=2511548 2024-09-14T11:17:06.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.875+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=26THM3YNHIW9 type=del size=1604121 2024-09-14T11:17:06.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.876+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=F28VL4KFVMJ1 type=del 2024-09-14T11:17:06.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.878+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~TTRY80ZBTT5R.0 size=1048576 2024-09-14T11:17:06.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.879+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~TTRY80ZBTT5R.1 size=299623 2024-09-14T11:17:06.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.879+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=TTRY80ZBTT5R tag=0J5MPZBXSSSL type=write size=2396775 2024-09-14T11:17:06.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.881+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=1GGVW77ZIE2Q type=del 2024-09-14T11:17:06.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.882+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=QIEAZH75J3V5 type=del size=2007183 2024-09-14T11:17:06.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.884+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=1ZWECIM45NT2 type=del 2024-09-14T11:17:06.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.886+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~MPD2O2GRX30L.0 size=495493 2024-09-14T11:17:06.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.886+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=MPD2O2GRX30L tag=IX342AKNHP4K type=write size=1544069 2024-09-14T11:17:06.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.889+0000 7f185d9f8780 1 < suggested update operation key=SEI774TP8YMJ tag=NZ0FSFZ1RI7D type=write size=402796 2024-09-14T11:17:06.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.891+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~4L8O3XXU1GRL.0 size=1048576 2024-09-14T11:17:06.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.892+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~4L8O3XXU1GRL.1 size=571381 2024-09-14T11:17:06.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.892+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=4L8O3XXU1GRL tag=31RFARE0K2ZH type=write size=2668533 2024-09-14T11:17:06.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.895+0000 7f185d9f8780 1 < suggested update operation key=P30WF4R3UFPX tag=USIHI9QVZAPK type=del size=1048246 2024-09-14T11:17:06.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.896+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=U8K8XM45QB6J type=del size=3850609 2024-09-14T11:17:06.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.897+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=89PP2JQM2TBW type=del 2024-09-14T11:17:06.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.898+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=GTQJ9BCCV436 type=del size=396031 2024-09-14T11:17:06.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.900+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=DYP3VZ576LM2 type=del 2024-09-14T11:17:06.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.901+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=UW8NS1LSB08E type=del size=2846290 2024-09-14T11:17:06.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.902+0000 7f185d9f8780 1 < canceled operation key=H29SXBS4N9JK tag=92779ZAP6D8T type=del size=983380 2024-09-14T11:17:06.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.903+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=6J1JGAXXMQVC type=del size=3253200 2024-09-14T11:17:06.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.905+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~F9H2X78LG0B4.0 size=1048576 2024-09-14T11:17:06.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.906+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~F9H2X78LG0B4.1 size=19179 2024-09-14T11:17:06.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.908+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=F9H2X78LG0B4 tag=DYKTPGM3IR4E type=write size=2116331 2024-09-14T11:17:06.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.910+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=2TON41TNQKWY type=del size=2307788 2024-09-14T11:17:06.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.911+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=S3T1OR8GIBDY type=del 2024-09-14T11:17:06.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.913+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=9I5BM8Z35KAW type=del size=669530 2024-09-14T11:17:06.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.914+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~8OI7GZ70LLNB.0 size=992636 2024-09-14T11:17:06.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.916+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=8OI7GZ70LLNB tag=ND3IRSI8OC2W type=write size=2041212 2024-09-14T11:17:06.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.920+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~Z0DS82W00NJI.0 size=1048576 2024-09-14T11:17:06.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.921+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~Z0DS82W00NJI.1 size=1048576 2024-09-14T11:17:06.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.922+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~Z0DS82W00NJI.2 size=809210 2024-09-14T11:17:06.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.922+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=Z0DS82W00NJI tag=B6UK0IDZF1NA type=write size=3954938 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.923+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=UKAUXKA642T3 type=del 2024-09-14T11:17:06.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.925+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=F7589AM6S1WJ type=del size=491489 2024-09-14T11:17:06.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.926+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~170RP22A21HW.0 size=166985 2024-09-14T11:17:06.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.929+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=170RP22A21HW tag=SDCK07M3B4H6 type=write size=1215561 2024-09-14T11:17:06.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.931+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~XWUEVSMUU41K.0 size=1022379 2024-09-14T11:17:06.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.931+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=XWUEVSMUU41K tag=4MFZBMHWQYC7 type=write size=2070955 2024-09-14T11:17:06.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.932+0000 7f185d9f8780 1 < completed write operation key=HLUMY48G90KB tag=N69X1BAR2EPR type=write size=88909 2024-09-14T11:17:06.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.934+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~IQZ1WBF0X860.0 size=1048576 2024-09-14T11:17:06.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.935+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~IQZ1WBF0X860.1 size=1048576 2024-09-14T11:17:06.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.936+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~IQZ1WBF0X860.2 size=927519 2024-09-14T11:17:06.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.936+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=IQZ1WBF0X860 tag=RIW2S5P2KWIL type=write size=4073247 2024-09-14T11:17:06.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.937+0000 7f185d9f8780 1 < canceled operation key=L4L83NVMXHXZ tag=F1Y2ESEGBZWR type=del size=2328130 2024-09-14T11:17:06.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.939+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=6JUC43AK1FY5 type=del size=3424106 2024-09-14T11:17:06.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.940+0000 7f185d9f8780 -1 < failed to complete operation key=LGLAG80GX8GF tag=26THM3YNHIW9 type=del size=1604121: (22) Invalid argument 2024-09-14T11:17:06.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.942+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~4L96FP0VK2T6.0 size=1048576 2024-09-14T11:17:06.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.943+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~4L96FP0VK2T6.1 size=63339 2024-09-14T11:17:06.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.943+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=4L96FP0VK2T6 tag=4FG3VPUGNX3W type=write size=2160491 2024-09-14T11:17:06.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.944+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~TTRY80ZBTT5R.0 size=1048576 2024-09-14T11:17:06.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.945+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~TTRY80ZBTT5R.1 size=299623 2024-09-14T11:17:06.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.947+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=TTRY80ZBTT5R tag=0J5MPZBXSSSL type=write size=2396775 2024-09-14T11:17:06.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.949+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~0DTK1AWPN3RP.0 size=497192 2024-09-14T11:17:06.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.949+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=0DTK1AWPN3RP tag=Y7GTXL5GNX38 type=write size=1545768 2024-09-14T11:17:06.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.950+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=QIEAZH75J3V5 type=del 2024-09-14T11:17:06.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.951+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=SX5SIFVFBX50 type=del size=424834 2024-09-14T11:17:06.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.952+0000 7f185d9f8780 1 < canceled part key=_multipart_ZR3IEW48CSCF.2~MPD2O2GRX30L.0 size=495493 2024-09-14T11:17:06.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.953+0000 7f185d9f8780 1 < canceled multipart upload key=ZR3IEW48CSCF upload=MPD2O2GRX30L tag=IX342AKNHP4K type=write size=1544069 2024-09-14T11:17:06.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.955+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=OYDOR6QA8D34 type=del size=237702 2024-09-14T11:17:06.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.956+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~4L8O3XXU1GRL.0 size=1048576 2024-09-14T11:17:06.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.957+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~4L8O3XXU1GRL.1 size=571381 2024-09-14T11:17:06.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.959+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=4L8O3XXU1GRL tag=31RFARE0K2ZH type=write size=2668533 2024-09-14T11:17:06.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.961+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=U2NWPE226XGT type=del size=427240 2024-09-14T11:17:06.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.962+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=U8K8XM45QB6J type=del 2024-09-14T11:17:06.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.964+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~K5A364RMKRPE.0 size=1048576 2024-09-14T11:17:06.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.965+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~K5A364RMKRPE.1 size=632229 2024-09-14T11:17:06.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.965+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=K5A364RMKRPE tag=TGUPN23I9DQ6 type=write size=2729381 2024-09-14T11:17:06.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.966+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=GTQJ9BCCV436 type=del 2024-09-14T11:17:06.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.968+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=3293EL5DDC1Z type=write size=553166 2024-09-14T11:17:06.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.970+0000 7f185d9f8780 1 < suggested remove operation key=HLUMY48G90KB tag=UW8NS1LSB08E type=del 2024-09-14T11:17:06.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.971+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=94T3BLNW98OO type=write size=126148 2024-09-14T11:17:06.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.973+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=6J1JGAXXMQVC type=del 2024-09-14T11:17:06.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.974+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=QBUKB83VCOJ1 type=del size=4004322 2024-09-14T11:17:06.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.975+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=2TON41TNQKWY type=del 2024-09-14T11:17:06.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.977+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=Q7BTA40QLSPJ type=del size=885799 2024-09-14T11:17:06.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.978+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=9I5BM8Z35KAW type=del 2024-09-14T11:17:06.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.979+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=7GRJRJ66136C type=del size=3864045 2024-09-14T11:17:06.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.981+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~Z0DS82W00NJI.0 size=1048576 2024-09-14T11:17:06.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.982+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~Z0DS82W00NJI.1 size=1048576 2024-09-14T11:17:06.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.983+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~Z0DS82W00NJI.2 size=809210 2024-09-14T11:17:06.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.985+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=Z0DS82W00NJI tag=B6UK0IDZF1NA type=write size=3954938 2024-09-14T11:17:06.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.987+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=RNNEQ0PMY7CS type=del size=32196 2024-09-14T11:17:06.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.988+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=F7589AM6S1WJ type=del 2024-09-14T11:17:06.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.989+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=B5THIHE7QHQC type=del size=3570829 2024-09-14T11:17:06.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.991+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~XWUEVSMUU41K.0 size=1022379 2024-09-14T11:17:06.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.993+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=XWUEVSMUU41K tag=4MFZBMHWQYC7 type=write size=2070955 2024-09-14T11:17:06.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.994+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=T168VXSUU3AU type=write size=907243 2024-09-14T11:17:06.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.995+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~IQZ1WBF0X860.0 size=1048576 2024-09-14T11:17:06.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.997+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~IQZ1WBF0X860.1 size=1048576 2024-09-14T11:17:06.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:06.998+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~IQZ1WBF0X860.2 size=927519 2024-09-14T11:17:06.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.000+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=IQZ1WBF0X860 tag=RIW2S5P2KWIL type=write size=4073247 2024-09-14T11:17:06.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.001+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=3XT0M5N6J2NM type=del size=1188844 2024-09-14T11:17:07.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.002+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=6JUC43AK1FY5 type=del 2024-09-14T11:17:07.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.004+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~BW51OEV821PU.0 size=1048576 2024-09-14T11:17:07.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.005+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~BW51OEV821PU.1 size=639355 2024-09-14T11:17:07.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.005+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=BW51OEV821PU tag=PRD6W7VFHJ2B type=write size=2736507 2024-09-14T11:17:07.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.005+0000 7f185d9f8780 1 < canceled part key=_multipart_N040R6OERAJP.2~4L96FP0VK2T6.0 size=1048576 2024-09-14T11:17:07.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.006+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~4L96FP0VK2T6.1 size=63339 2024-09-14T11:17:07.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.008+0000 7f185d9f8780 1 < canceled multipart upload key=N040R6OERAJP upload=4L96FP0VK2T6 tag=4FG3VPUGNX3W type=write size=2160491 2024-09-14T11:17:07.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.009+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=DQPFLZHKSH12 type=del size=962530 2024-09-14T11:17:07.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.010+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~0DTK1AWPN3RP.0 size=497192 2024-09-14T11:17:07.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.012+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=0DTK1AWPN3RP tag=Y7GTXL5GNX38 type=write size=1545768 2024-09-14T11:17:07.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.015+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~P1ZZ3IXVRPNC.0 size=1048576 2024-09-14T11:17:07.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.015+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~P1ZZ3IXVRPNC.1 size=133904 2024-09-14T11:17:07.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.015+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=P1ZZ3IXVRPNC tag=LCOGRCUWBV3Y type=write size=2231056 2024-09-14T11:17:07.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.017+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=SX5SIFVFBX50 type=del 2024-09-14T11:17:07.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.018+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=JHPI9KYKTV2C type=del size=3720728 2024-09-14T11:17:07.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.020+0000 7f185d9f8780 1 < suggested remove operation key=CRZOT1D0U2F3 tag=OYDOR6QA8D34 type=del 2024-09-14T11:17:07.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.021+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=35EF1OZZSTS4 type=del size=1292424 2024-09-14T11:17:07.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.022+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=U2NWPE226XGT type=del 2024-09-14T11:17:07.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.023+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=W91PZKKICFWL type=write size=522770 2024-09-14T11:17:07.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.024+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~K5A364RMKRPE.0 size=1048576 2024-09-14T11:17:07.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.025+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~K5A364RMKRPE.1 size=632229 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.027+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=K5A364RMKRPE tag=TGUPN23I9DQ6 type=write size=2729381 2024-09-14T11:17:07.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.029+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=6XWIHTN7UD5C type=del size=1265658 2024-09-14T11:17:07.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.030+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=3293EL5DDC1Z type=write size=553166 2024-09-14T11:17:07.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.031+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=PE9OEGVR2ISR type=del size=1193015 2024-09-14T11:17:07.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.033+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=94T3BLNW98OO type=write size=126148 2024-09-14T11:17:07.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.036+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=JHIN47PEYWTG type=del size=2628709 2024-09-14T11:17:07.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.037+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=QBUKB83VCOJ1 type=del 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.039+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~WYLT5FBFZ3S5.0 size=1048576 2024-09-14T11:17:07.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.040+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~WYLT5FBFZ3S5.1 size=1048576 2024-09-14T11:17:07.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.041+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~WYLT5FBFZ3S5.2 size=272536 2024-09-14T11:17:07.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.041+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=WYLT5FBFZ3S5 tag=1FN0ITS9JIFH type=write size=3418264 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.042+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=Q7BTA40QLSPJ type=del 2024-09-14T11:17:07.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.043+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=PF0Y5C0BWOST type=write size=715362 2024-09-14T11:17:07.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.044+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=7GRJRJ66136C type=del 2024-09-14T11:17:07.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.047+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~5OMQNI9WQFNN.0 size=221056 2024-09-14T11:17:07.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.047+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=5OMQNI9WQFNN tag=WWFQM3A3QGAE type=write size=1269632 2024-09-14T11:17:07.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.048+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=RNNEQ0PMY7CS type=del 2024-09-14T11:17:07.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.050+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~K11C5HBZ0KJQ.0 size=1048576 2024-09-14T11:17:07.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.051+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~K11C5HBZ0KJQ.1 size=1048576 2024-09-14T11:17:07.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.052+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~K11C5HBZ0KJQ.2 size=552844 2024-09-14T11:17:07.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.052+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=K11C5HBZ0KJQ tag=5KR4LVLNUSED type=write size=3698572 2024-09-14T11:17:07.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.053+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=B5THIHE7QHQC type=del 2024-09-14T11:17:07.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.055+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~9FXUSY5G2GPP.0 size=172167 2024-09-14T11:17:07.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.055+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=9FXUSY5G2GPP tag=R26NAA6AWO3P type=write size=1220743 2024-09-14T11:17:07.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.056+0000 7f185d9f8780 -1 < failed to complete operation key=CRZOT1D0U2F3 tag=T168VXSUU3AU type=write size=907243: (22) Invalid argument 2024-09-14T11:17:07.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.057+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=06ZHEBRUIIYR type=del size=3813733 2024-09-14T11:17:07.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.060+0000 7f185d9f8780 1 < suggested update operation key=CVVKY636WXG9 tag=3XT0M5N6J2NM type=del size=1188844 2024-09-14T11:17:07.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.061+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=RC67P7EZ6VCI type=del size=1340879 2024-09-14T11:17:07.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.062+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~BW51OEV821PU.0 size=1048576 2024-09-14T11:17:07.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.063+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~BW51OEV821PU.1 size=639355 2024-09-14T11:17:07.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.065+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=BW51OEV821PU tag=PRD6W7VFHJ2B type=write size=2736507 2024-09-14T11:17:07.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.067+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~4JRXDOUA405B.0 size=457954 2024-09-14T11:17:07.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.067+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=4JRXDOUA405B tag=09GK3DTJZGI4 type=write size=1506530 2024-09-14T11:17:07.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.069+0000 7f185d9f8780 1 < canceled operation key=SEI774TP8YMJ tag=DQPFLZHKSH12 type=del size=962530 2024-09-14T11:17:07.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.070+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=6E9OSJQCK0IO type=del size=374620 2024-09-14T11:17:07.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.071+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~P1ZZ3IXVRPNC.0 size=1048576 2024-09-14T11:17:07.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.072+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~P1ZZ3IXVRPNC.1 size=133904 2024-09-14T11:17:07.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.074+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=P1ZZ3IXVRPNC tag=LCOGRCUWBV3Y type=write size=2231056 2024-09-14T11:17:07.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.076+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~59FIMNF3MZ86.0 size=560943 2024-09-14T11:17:07.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.076+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=59FIMNF3MZ86 tag=2LDEO1LZ9YX8 type=write size=1609519 2024-09-14T11:17:07.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.077+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=JHPI9KYKTV2C type=del 2024-09-14T11:17:07.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.079+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~QH7IMD5JUQ8M.0 size=1048576 2024-09-14T11:17:07.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.080+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~QH7IMD5JUQ8M.1 size=1021160 2024-09-14T11:17:07.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.080+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=QH7IMD5JUQ8M tag=87779D39TF4K type=write size=3118312 2024-09-14T11:17:07.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.082+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=35EF1OZZSTS4 type=del 2024-09-14T11:17:07.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.083+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=5QXVCA51XPVR type=del size=1396515 2024-09-14T11:17:07.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.084+0000 7f185d9f8780 1 < canceled operation key=PSL63WUBLB75 tag=W91PZKKICFWL type=write size=522770 2024-09-14T11:17:07.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.085+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=QUD6UZIXKCBZ type=del size=2070210 2024-09-14T11:17:07.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.086+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=6XWIHTN7UD5C type=del 2024-09-14T11:17:07.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.088+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=H52M8KUQYZJX type=del size=411198 2024-09-14T11:17:07.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.089+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=PE9OEGVR2ISR type=del 2024-09-14T11:17:07.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.091+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~LPZCCTY7012J.0 size=1048576 2024-09-14T11:17:07.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.092+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~LPZCCTY7012J.1 size=1048576 2024-09-14T11:17:07.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.093+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~LPZCCTY7012J.2 size=789438 2024-09-14T11:17:07.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.093+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=LPZCCTY7012J tag=ML13LT20NIF6 type=write size=3935166 2024-09-14T11:17:07.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.094+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=JHIN47PEYWTG type=del 2024-09-14T11:17:07.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.097+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~L04U670SX5OF.0 size=1048576 2024-09-14T11:17:07.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.098+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~L04U670SX5OF.1 size=1048576 2024-09-14T11:17:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.099+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~L04U670SX5OF.2 size=289909 2024-09-14T11:17:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.099+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=L04U670SX5OF tag=Q168XY3FDT2H type=write size=3435637 2024-09-14T11:17:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.099+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~WYLT5FBFZ3S5.0 size=1048576 2024-09-14T11:17:07.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.100+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~WYLT5FBFZ3S5.1 size=1048576 2024-09-14T11:17:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.101+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~WYLT5FBFZ3S5.2 size=272536 2024-09-14T11:17:07.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.103+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=WYLT5FBFZ3S5 tag=1FN0ITS9JIFH type=write size=3418264 2024-09-14T11:17:07.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.105+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~OX5ZSTCJWTE8.0 size=1048576 2024-09-14T11:17:07.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.106+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~OX5ZSTCJWTE8.1 size=1048576 2024-09-14T11:17:07.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.107+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~OX5ZSTCJWTE8.2 size=557585 2024-09-14T11:17:07.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.107+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=OX5ZSTCJWTE8 tag=B5WRV0D6VEXL type=write size=3703313 2024-09-14T11:17:07.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.108+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=PF0Y5C0BWOST type=write size=715362 2024-09-14T11:17:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.110+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=0ORYJWZQT5NG type=del size=1053728 2024-09-14T11:17:07.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.111+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~5OMQNI9WQFNN.0 size=221056 2024-09-14T11:17:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.113+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=5OMQNI9WQFNN tag=WWFQM3A3QGAE type=write size=1269632 2024-09-14T11:17:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.114+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=VVIE2B1IOBQ2 type=del size=2347591 2024-09-14T11:17:07.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.115+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~K11C5HBZ0KJQ.0 size=1048576 2024-09-14T11:17:07.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.116+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~K11C5HBZ0KJQ.1 size=1048576 2024-09-14T11:17:07.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.117+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~K11C5HBZ0KJQ.2 size=552844 2024-09-14T11:17:07.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.119+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=K11C5HBZ0KJQ tag=5KR4LVLNUSED type=write size=3698572 2024-09-14T11:17:07.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.122+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~CVHIUYQE1M18.0 size=1048576 2024-09-14T11:17:07.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.123+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~CVHIUYQE1M18.1 size=262786 2024-09-14T11:17:07.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.123+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=CVHIUYQE1M18 tag=0IHR5ALI15ZM type=write size=2359938 2024-09-14T11:17:07.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.123+0000 7f185d9f8780 1 < canceled part key=_multipart_PSL63WUBLB75.2~9FXUSY5G2GPP.0 size=172167 2024-09-14T11:17:07.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.125+0000 7f185d9f8780 1 < canceled multipart upload key=PSL63WUBLB75 upload=9FXUSY5G2GPP tag=R26NAA6AWO3P type=write size=1220743 2024-09-14T11:17:07.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.127+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~ZTIWKS9OU8QX.0 size=105045 2024-09-14T11:17:07.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.127+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=ZTIWKS9OU8QX tag=Z13P05TKBTQH type=write size=1153621 2024-09-14T11:17:07.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.128+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=06ZHEBRUIIYR type=del 2024-09-14T11:17:07.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.131+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~EA5QEZ5TFMQD.0 size=670522 2024-09-14T11:17:07.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.131+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=EA5QEZ5TFMQD tag=IY562M9U8OVS type=write size=1719098 2024-09-14T11:17:07.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.133+0000 7f185d9f8780 1 < suggested update operation key=JL2IH8NEX1YF tag=RC67P7EZ6VCI type=del size=1340879 2024-09-14T11:17:07.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.134+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=SPE9V0QXHG2S type=del size=3029175 2024-09-14T11:17:07.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.136+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~4JRXDOUA405B.0 size=457954 2024-09-14T11:17:07.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.138+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=4JRXDOUA405B tag=09GK3DTJZGI4 type=write size=1506530 2024-09-14T11:17:07.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.139+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=GGKQQYNA6CVX type=del size=3666906 2024-09-14T11:17:07.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.140+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=6E9OSJQCK0IO type=del 2024-09-14T11:17:07.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.142+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~0EXDDQG2X3AX.0 size=1048576 2024-09-14T11:17:07.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.143+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~0EXDDQG2X3AX.1 size=877548 2024-09-14T11:17:07.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.143+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=0EXDDQG2X3AX tag=JGOBPU29AN3V type=write size=2974700 2024-09-14T11:17:07.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.144+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~59FIMNF3MZ86.0 size=560943 2024-09-14T11:17:07.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.147+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=59FIMNF3MZ86 tag=2LDEO1LZ9YX8 type=write size=1609519 2024-09-14T11:17:07.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.149+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~X9AGRFBKLLKL.0 size=1048576 2024-09-14T11:17:07.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.150+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~X9AGRFBKLLKL.1 size=1048576 2024-09-14T11:17:07.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.151+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~X9AGRFBKLLKL.2 size=237831 2024-09-14T11:17:07.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.151+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=X9AGRFBKLLKL tag=ZRBAVN3Y0762 type=write size=3383559 2024-09-14T11:17:07.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.153+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~QH7IMD5JUQ8M.0 size=1048576 2024-09-14T11:17:07.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.154+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~QH7IMD5JUQ8M.1 size=1021160 2024-09-14T11:17:07.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.156+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=QH7IMD5JUQ8M tag=87779D39TF4K type=write size=3118312 2024-09-14T11:17:07.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.157+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=90B48TWVL31X type=write size=473652 2024-09-14T11:17:07.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.159+0000 7f185d9f8780 1 < suggested remove operation key=ESN8NVVJB3B0 tag=5QXVCA51XPVR type=del 2024-09-14T11:17:07.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.160+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=DP140FQPZMOY type=del size=1006307 2024-09-14T11:17:07.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.162+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=QUD6UZIXKCBZ type=del 2024-09-14T11:17:07.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.164+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~I0K3U5P6O9UF.0 size=581618 2024-09-14T11:17:07.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.164+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=I0K3U5P6O9UF tag=L6ZYZ1104IPT type=write size=1630194 2024-09-14T11:17:07.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.165+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=H52M8KUQYZJX type=del 2024-09-14T11:17:07.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.167+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~C7EOGFN4NH0O.0 size=1048576 2024-09-14T11:17:07.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.168+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~C7EOGFN4NH0O.1 size=89423 2024-09-14T11:17:07.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.168+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=C7EOGFN4NH0O tag=M070PK4GVETM type=write size=2186575 2024-09-14T11:17:07.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.169+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~LPZCCTY7012J.0 size=1048576 2024-09-14T11:17:07.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.170+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~LPZCCTY7012J.1 size=1048576 2024-09-14T11:17:07.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.170+0000 7f185d9f8780 1 < canceled part key=_multipart_WPBYTFP7HRVE.2~LPZCCTY7012J.2 size=789438 2024-09-14T11:17:07.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.172+0000 7f185d9f8780 1 < canceled multipart upload key=WPBYTFP7HRVE upload=LPZCCTY7012J tag=ML13LT20NIF6 type=write size=3935166 2024-09-14T11:17:07.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.174+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=DK321LHAV1B0 type=write size=19258 2024-09-14T11:17:07.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.174+0000 7f185d9f8780 1 < canceled part key=_multipart_M4FJDW1QHGBM.2~L04U670SX5OF.0 size=1048576 2024-09-14T11:17:07.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.175+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~L04U670SX5OF.1 size=1048576 2024-09-14T11:17:07.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.176+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~L04U670SX5OF.2 size=289909 2024-09-14T11:17:07.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.178+0000 7f185d9f8780 1 < canceled multipart upload key=M4FJDW1QHGBM upload=L04U670SX5OF tag=Q168XY3FDT2H type=write size=3435637 2024-09-14T11:17:07.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.179+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=X891TOVTRVW6 type=write size=925757 2024-09-14T11:17:07.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.181+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~OX5ZSTCJWTE8.0 size=1048576 2024-09-14T11:17:07.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.182+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~OX5ZSTCJWTE8.1 size=1048576 2024-09-14T11:17:07.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.182+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~OX5ZSTCJWTE8.2 size=557585 2024-09-14T11:17:07.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.183+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=OX5ZSTCJWTE8 tag=B5WRV0D6VEXL type=write size=3703313 2024-09-14T11:17:07.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.185+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=7QI1QN15HFRP type=del size=136382 2024-09-14T11:17:07.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.186+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=0ORYJWZQT5NG type=del 2024-09-14T11:17:07.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.188+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~G9QM93L7WIIT.0 size=1048576 2024-09-14T11:17:07.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.189+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~G9QM93L7WIIT.1 size=772100 2024-09-14T11:17:07.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.189+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=G9QM93L7WIIT tag=EFAI9V3YVRXA type=write size=2869252 2024-09-14T11:17:07.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.190+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=VVIE2B1IOBQ2 type=del 2024-09-14T11:17:07.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.191+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=RVHSDMRF5QKW type=write size=563611 2024-09-14T11:17:07.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.192+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~CVHIUYQE1M18.0 size=1048576 2024-09-14T11:17:07.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.193+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~CVHIUYQE1M18.1 size=262786 2024-09-14T11:17:07.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.194+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=CVHIUYQE1M18 tag=0IHR5ALI15ZM type=write size=2359938 2024-09-14T11:17:07.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.196+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=VN63LW3I1M63 type=del size=3150848 2024-09-14T11:17:07.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.197+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~ZTIWKS9OU8QX.0 size=105045 2024-09-14T11:17:07.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.199+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=ZTIWKS9OU8QX tag=Z13P05TKBTQH type=write size=1153621 2024-09-14T11:17:07.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.201+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~FO9LXPSJ00UO.0 size=1048576 2024-09-14T11:17:07.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.202+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~FO9LXPSJ00UO.1 size=958013 2024-09-14T11:17:07.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.202+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=FO9LXPSJ00UO tag=H0HHGKSAE63D type=write size=3055165 2024-09-14T11:17:07.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.203+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~EA5QEZ5TFMQD.0 size=670522 2024-09-14T11:17:07.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.205+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=EA5QEZ5TFMQD tag=IY562M9U8OVS type=write size=1719098 2024-09-14T11:17:07.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.207+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~LS1PK8MRY2UJ.0 size=7723 2024-09-14T11:17:07.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.207+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=LS1PK8MRY2UJ tag=I00QGWGX9CPY type=write size=1056299 2024-09-14T11:17:07.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.208+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=SPE9V0QXHG2S type=del 2024-09-14T11:17:07.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.211+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~NDO59UKP91XW.0 size=1048576 2024-09-14T11:17:07.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.212+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~NDO59UKP91XW.1 size=1048576 2024-09-14T11:17:07.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.212+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~NDO59UKP91XW.2 size=406654 2024-09-14T11:17:07.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.212+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=NDO59UKP91XW tag=GXT701AGREQS type=write size=3552382 2024-09-14T11:17:07.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.214+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=GGKQQYNA6CVX type=del 2024-09-14T11:17:07.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.215+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=6RG5REDCAVER type=del size=681673 2024-09-14T11:17:07.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.216+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~0EXDDQG2X3AX.0 size=1048576 2024-09-14T11:17:07.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.217+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~0EXDDQG2X3AX.1 size=877548 2024-09-14T11:17:07.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.219+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=0EXDDQG2X3AX tag=JGOBPU29AN3V type=write size=2974700 2024-09-14T11:17:07.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.221+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=5TFOTE57HTH3 type=del size=2088703 2024-09-14T11:17:07.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.222+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~X9AGRFBKLLKL.0 size=1048576 2024-09-14T11:17:07.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.223+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~X9AGRFBKLLKL.1 size=1048576 2024-09-14T11:17:07.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.224+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~X9AGRFBKLLKL.2 size=237831 2024-09-14T11:17:07.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.226+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=X9AGRFBKLLKL tag=ZRBAVN3Y0762 type=write size=3383559 2024-09-14T11:17:07.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.228+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~AZUP21MNG1VJ.0 size=1048576 2024-09-14T11:17:07.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.229+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~AZUP21MNG1VJ.1 size=1000106 2024-09-14T11:17:07.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.229+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=AZUP21MNG1VJ tag=CW64XLUOCQ7J type=write size=3097258 2024-09-14T11:17:07.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.231+0000 7f185d9f8780 1 < completed write operation key=P30WF4R3UFPX tag=90B48TWVL31X type=write size=473652 2024-09-14T11:17:07.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.232+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=J7HXE25DZMU8 type=del size=3134586 2024-09-14T11:17:07.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.233+0000 7f185d9f8780 1 < canceled operation key=CRZOT1D0U2F3 tag=DP140FQPZMOY type=del size=1006307 2024-09-14T11:17:07.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.235+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~ZVKWREIXYZZH.0 size=291649 2024-09-14T11:17:07.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.235+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=ZVKWREIXYZZH tag=X1IGV0FRI2S8 type=write size=1340225 2024-09-14T11:17:07.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.236+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~I0K3U5P6O9UF.0 size=581618 2024-09-14T11:17:07.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.238+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=I0K3U5P6O9UF tag=L6ZYZ1104IPT type=write size=1630194 2024-09-14T11:17:07.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.239+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=IFJGT2FLA35K type=del size=2592842 2024-09-14T11:17:07.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.241+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~C7EOGFN4NH0O.0 size=1048576 2024-09-14T11:17:07.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.242+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~C7EOGFN4NH0O.1 size=89423 2024-09-14T11:17:07.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.244+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=C7EOGFN4NH0O tag=M070PK4GVETM type=write size=2186575 2024-09-14T11:17:07.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.246+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0R0LBK0R6ZHN.0 size=761007 2024-09-14T11:17:07.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.246+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=0R0LBK0R6ZHN tag=0RS9DNY4B9RX type=write size=1809583 2024-09-14T11:17:07.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.247+0000 7f185d9f8780 1 < canceled operation key=MPZOX5RU0580 tag=DK321LHAV1B0 type=write size=19258 2024-09-14T11:17:07.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.248+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=JBYO4AFJ6RIB type=del size=1896652 2024-09-14T11:17:07.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.251+0000 7f185d9f8780 1 < suggested remove operation key=N040R6OERAJP tag=X891TOVTRVW6 type=write 2024-09-14T11:17:07.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.253+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~SSNBVVF4PQ33.0 size=793447 2024-09-14T11:17:07.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.253+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=SSNBVVF4PQ33 tag=AO9VQ39I9K04 type=write size=1842023 2024-09-14T11:17:07.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.254+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=7QI1QN15HFRP type=del 2024-09-14T11:17:07.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.255+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=U9Q5I3X2RMEX type=del size=2356875 2024-09-14T11:17:07.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.256+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~G9QM93L7WIIT.0 size=1048576 2024-09-14T11:17:07.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.258+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~G9QM93L7WIIT.1 size=772100 2024-09-14T11:17:07.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.260+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=G9QM93L7WIIT tag=EFAI9V3YVRXA type=write size=2869252 2024-09-14T11:17:07.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.262+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~C344WXC392ZP.0 size=1048576 2024-09-14T11:17:07.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.263+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~C344WXC392ZP.1 size=37622 2024-09-14T11:17:07.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.263+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=C344WXC392ZP tag=QR6P88DQSLR3 type=write size=2134774 2024-09-14T11:17:07.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.264+0000 7f185d9f8780 1 < completed write operation key=6MZGLP5KPPB3 tag=RVHSDMRF5QKW type=write size=563611 2024-09-14T11:17:07.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.266+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~760X49RFGYL2.0 size=512435 2024-09-14T11:17:07.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.266+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=760X49RFGYL2 tag=9ZQ8BX3OAOFK type=write size=1561011 2024-09-14T11:17:07.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.268+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=VN63LW3I1M63 type=del 2024-09-14T11:17:07.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.269+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=6A4PY7FIAITQ type=del size=295638 2024-09-14T11:17:07.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.270+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~FO9LXPSJ00UO.0 size=1048576 2024-09-14T11:17:07.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.271+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~FO9LXPSJ00UO.1 size=958013 2024-09-14T11:17:07.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.273+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=FO9LXPSJ00UO tag=H0HHGKSAE63D type=write size=3055165 2024-09-14T11:17:07.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.275+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~N88GU1BPDZRA.0 size=313839 2024-09-14T11:17:07.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.275+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=N88GU1BPDZRA tag=KW86BIYHARTK type=write size=1362415 2024-09-14T11:17:07.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.276+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~LS1PK8MRY2UJ.0 size=7723 2024-09-14T11:17:07.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.278+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=LS1PK8MRY2UJ tag=I00QGWGX9CPY type=write size=1056299 2024-09-14T11:17:07.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.280+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=Z0PNA68TK4CN type=del size=79608 2024-09-14T11:17:07.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.281+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~NDO59UKP91XW.0 size=1048576 2024-09-14T11:17:07.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.282+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~NDO59UKP91XW.1 size=1048576 2024-09-14T11:17:07.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.282+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~NDO59UKP91XW.2 size=406654 2024-09-14T11:17:07.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.284+0000 7f185d9f8780 1 < canceled multipart upload key=SEI774TP8YMJ upload=NDO59UKP91XW tag=GXT701AGREQS type=write size=3552382 2024-09-14T11:17:07.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.285+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=2PBYYO04219X type=del size=1598880 2024-09-14T11:17:07.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.286+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=6RG5REDCAVER type=del 2024-09-14T11:17:07.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.288+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~V05ZC9J339ES.0 size=714756 2024-09-14T11:17:07.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.288+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=V05ZC9J339ES tag=RN1REFYIOYDZ type=write size=1763332 2024-09-14T11:17:07.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.290+0000 7f185d9f8780 1 < canceled operation key=P30WF4R3UFPX tag=5TFOTE57HTH3 type=del size=2088703 2024-09-14T11:17:07.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.291+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=Z7KBF3DF5VNW type=del size=3475780 2024-09-14T11:17:07.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.292+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~AZUP21MNG1VJ.0 size=1048576 2024-09-14T11:17:07.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.292+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~AZUP21MNG1VJ.1 size=1000106 2024-09-14T11:17:07.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.294+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=AZUP21MNG1VJ tag=CW64XLUOCQ7J type=write size=3097258 2024-09-14T11:17:07.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.295+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=LKD3CXWXNOKC type=del size=1049709 2024-09-14T11:17:07.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.296+0000 7f185d9f8780 1 < canceled operation key=WPBYTFP7HRVE tag=J7HXE25DZMU8 type=del size=3134586 2024-09-14T11:17:07.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.297+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=QBRRC5E71XIN type=del size=2242674 2024-09-14T11:17:07.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.298+0000 7f185d9f8780 1 < canceled part key=_multipart_CRZOT1D0U2F3.2~ZVKWREIXYZZH.0 size=291649 2024-09-14T11:17:07.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.300+0000 7f185d9f8780 1 < canceled multipart upload key=CRZOT1D0U2F3 upload=ZVKWREIXYZZH tag=X1IGV0FRI2S8 type=write size=1340225 2024-09-14T11:17:07.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.302+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~CGVQXLQ12H3Y.0 size=1048576 2024-09-14T11:17:07.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.303+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~CGVQXLQ12H3Y.1 size=91958 2024-09-14T11:17:07.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.303+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=CGVQXLQ12H3Y tag=UCAZ0W6CLQUM type=write size=2189110 2024-09-14T11:17:07.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.305+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=IFJGT2FLA35K type=del 2024-09-14T11:17:07.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.307+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~1FRIX5CLIL3I.0 size=1048576 2024-09-14T11:17:07.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.308+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~1FRIX5CLIL3I.1 size=88154 2024-09-14T11:17:07.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.308+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=1FRIX5CLIL3I tag=W5EO78U4I8A5 type=write size=2185306 2024-09-14T11:17:07.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.309+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~0R0LBK0R6ZHN.0 size=761007 2024-09-14T11:17:07.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.311+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=0R0LBK0R6ZHN tag=0RS9DNY4B9RX type=write size=1809583 2024-09-14T11:17:07.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.313+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=2P6GAWF3LENB type=del size=40117 2024-09-14T11:17:07.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.314+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=JBYO4AFJ6RIB type=del 2024-09-14T11:17:07.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.315+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=J20EMSZAT36X type=del size=649468 2024-09-14T11:17:07.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.317+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~SSNBVVF4PQ33.0 size=793447 2024-09-14T11:17:07.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.318+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=SSNBVVF4PQ33 tag=AO9VQ39I9K04 type=write size=1842023 2024-09-14T11:17:07.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.321+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~H921ENTN7LKF.0 size=1048576 2024-09-14T11:17:07.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.322+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~H921ENTN7LKF.1 size=20483 2024-09-14T11:17:07.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.322+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=H921ENTN7LKF tag=P9CZ2XTRI5A9 type=write size=2117635 2024-09-14T11:17:07.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.323+0000 7f185d9f8780 1 < canceled operation key=OYZIXCSGXTHR tag=U9Q5I3X2RMEX type=del size=2356875 2024-09-14T11:17:07.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.325+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=VFGC1GVD90GQ type=del size=2168755 2024-09-14T11:17:07.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.326+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~C344WXC392ZP.0 size=1048576 2024-09-14T11:17:07.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.327+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~C344WXC392ZP.1 size=37622 2024-09-14T11:17:07.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.329+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=C344WXC392ZP tag=QR6P88DQSLR3 type=write size=2134774 2024-09-14T11:17:07.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.330+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=98XBPQ1147GV type=del size=1728962 2024-09-14T11:17:07.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.332+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~760X49RFGYL2.0 size=512435 2024-09-14T11:17:07.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.333+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=760X49RFGYL2 tag=9ZQ8BX3OAOFK type=write size=1561011 2024-09-14T11:17:07.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.335+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=6RQLM98A8YZ2 type=del size=3458409 2024-09-14T11:17:07.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.337+0000 7f185d9f8780 1 < suggested update operation key=XPMGVU0U52GS tag=6A4PY7FIAITQ type=del size=295638 2024-09-14T11:17:07.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.339+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~60TRTZ8ERQRO.0 size=1048576 2024-09-14T11:17:07.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.340+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~60TRTZ8ERQRO.1 size=900056 2024-09-14T11:17:07.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.340+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=60TRTZ8ERQRO tag=RV2LAKDOM3Y2 type=write size=2997208 2024-09-14T11:17:07.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.342+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~N88GU1BPDZRA.0 size=313839 2024-09-14T11:17:07.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.343+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=N88GU1BPDZRA tag=KW86BIYHARTK type=write size=1362415 2024-09-14T11:17:07.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.345+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=97ZBBR1ZG6JX type=del size=2486337 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.346+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=Z0PNA68TK4CN type=del 2024-09-14T11:17:07.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.347+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=RIJO3JMUASA4 type=del size=2190351 2024-09-14T11:17:07.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.348+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=2PBYYO04219X type=del 2024-09-14T11:17:07.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.349+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=S8WECCP9543Y type=del size=3400457 2024-09-14T11:17:07.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.351+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~V05ZC9J339ES.0 size=714756 2024-09-14T11:17:07.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.353+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=V05ZC9J339ES tag=RN1REFYIOYDZ type=write size=1763332 2024-09-14T11:17:07.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.355+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~SLTRB7K4YPRW.0 size=1048576 2024-09-14T11:17:07.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.356+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~SLTRB7K4YPRW.1 size=1048576 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.357+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~SLTRB7K4YPRW.2 size=50580 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.357+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=SLTRB7K4YPRW tag=0HWMMIZNQTJP type=write size=3196308 2024-09-14T11:17:07.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.358+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=Z7KBF3DF5VNW type=del 2024-09-14T11:17:07.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.359+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=SMNYR78QM3C2 type=del size=2074275 2024-09-14T11:17:07.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.360+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=LKD3CXWXNOKC type=del 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.362+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~Y1RXT34BTBOP.0 size=1048576 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.363+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~Y1RXT34BTBOP.1 size=27157 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.363+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=Y1RXT34BTBOP tag=EHIY21UDS6P9 type=write size=2124309 2024-09-14T11:17:07.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.364+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=QBRRC5E71XIN type=del 2024-09-14T11:17:07.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.365+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=IOUL1D4TH3AX type=write size=729577 2024-09-14T11:17:07.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.367+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~CGVQXLQ12H3Y.0 size=1048576 2024-09-14T11:17:07.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.368+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~CGVQXLQ12H3Y.1 size=91958 2024-09-14T11:17:07.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.370+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=CGVQXLQ12H3Y tag=UCAZ0W6CLQUM type=write size=2189110 2024-09-14T11:17:07.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.371+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=HIPEWL9MJ8U0 type=del size=1898175 2024-09-14T11:17:07.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.373+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~1FRIX5CLIL3I.0 size=1048576 2024-09-14T11:17:07.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.374+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~1FRIX5CLIL3I.1 size=88154 2024-09-14T11:17:07.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.375+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=1FRIX5CLIL3I tag=W5EO78U4I8A5 type=write size=2185306 2024-09-14T11:17:07.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.377+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=KD53DZOYT42O type=del size=194559 2024-09-14T11:17:07.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.378+0000 7f185d9f8780 1 < canceled operation key=55K4D3SEM068 tag=2P6GAWF3LENB type=del size=40117 2024-09-14T11:17:07.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.380+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~RPG0SF8J8OD3.0 size=978323 2024-09-14T11:17:07.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.380+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=RPG0SF8J8OD3 tag=MPPCUS86LV1R type=write size=2026899 2024-09-14T11:17:07.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.382+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=J20EMSZAT36X type=del size=649468 2024-09-14T11:17:07.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.383+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=IESOLFB9AOO0 type=del size=3105068 2024-09-14T11:17:07.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.383+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~H921ENTN7LKF.0 size=1048576 2024-09-14T11:17:07.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.384+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~H921ENTN7LKF.1 size=20483 2024-09-14T11:17:07.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.386+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=H921ENTN7LKF tag=P9CZ2XTRI5A9 type=write size=2117635 2024-09-14T11:17:07.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.387+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=GT23543173FD type=write size=784420 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.389+0000 7f185d9f8780 1 < suggested update operation key=DAKWA1OCVTBG tag=VFGC1GVD90GQ type=del size=2168755 2024-09-14T11:17:07.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.391+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~H85D6SQ6QUNB.0 size=1048576 2024-09-14T11:17:07.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.392+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~H85D6SQ6QUNB.1 size=505674 2024-09-14T11:17:07.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.392+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=H85D6SQ6QUNB tag=BCRMZEK4BXEB type=write size=2602826 2024-09-14T11:17:07.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.393+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=98XBPQ1147GV type=del 2024-09-14T11:17:07.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.395+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~RWHKSG567SXC.0 size=1048576 2024-09-14T11:17:07.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.396+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~RWHKSG567SXC.1 size=890210 2024-09-14T11:17:07.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.396+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=RWHKSG567SXC tag=JXTHO1NQ5E8O type=write size=2987362 2024-09-14T11:17:07.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.398+0000 7f185d9f8780 1 < suggested remove operation key=HLUMY48G90KB tag=6RQLM98A8YZ2 type=del 2024-09-14T11:17:07.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.400+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=9S09FOVRWNFG type=del size=1361916 2024-09-14T11:17:07.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.401+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~60TRTZ8ERQRO.0 size=1048576 2024-09-14T11:17:07.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.402+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~60TRTZ8ERQRO.1 size=900056 2024-09-14T11:17:07.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.404+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=60TRTZ8ERQRO tag=RV2LAKDOM3Y2 type=write size=2997208 2024-09-14T11:17:07.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.405+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=VG8NAF8ILUIL type=write size=593748 2024-09-14T11:17:07.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.406+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=97ZBBR1ZG6JX type=del 2024-09-14T11:17:07.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.408+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~2UW716S574DT.0 size=1048576 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.409+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~2UW716S574DT.1 size=865364 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.409+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=2UW716S574DT tag=R6H616RWKEQI type=write size=2962516 2024-09-14T11:17:07.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.410+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=RIJO3JMUASA4 type=del 2024-09-14T11:17:07.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.411+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=HPEW1EXA15VV type=del size=917373 2024-09-14T11:17:07.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.412+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=S8WECCP9543Y type=del 2024-09-14T11:17:07.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.413+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=M4EOMOXWFWDZ type=write size=441684 2024-09-14T11:17:07.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.415+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~SLTRB7K4YPRW.0 size=1048576 2024-09-14T11:17:07.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.415+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~SLTRB7K4YPRW.1 size=1048576 2024-09-14T11:17:07.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.416+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~SLTRB7K4YPRW.2 size=50580 2024-09-14T11:17:07.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.418+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=SLTRB7K4YPRW tag=0HWMMIZNQTJP type=write size=3196308 2024-09-14T11:17:07.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.420+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~X4FU5ER1ZJOJ.0 size=968312 2024-09-14T11:17:07.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.420+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=X4FU5ER1ZJOJ tag=SLP765RDGHFV type=write size=2016888 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.422+0000 7f185d9f8780 1 < canceled operation key=M4FJDW1QHGBM tag=SMNYR78QM3C2 type=del size=2074275 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.423+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=E0TWO7XH5P1N type=del size=3744856 2024-09-14T11:17:07.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.424+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~Y1RXT34BTBOP.0 size=1048576 2024-09-14T11:17:07.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.424+0000 7f185d9f8780 1 < canceled part key=_multipart_1BOZ331NA7JA.2~Y1RXT34BTBOP.1 size=27157 2024-09-14T11:17:07.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.426+0000 7f185d9f8780 1 < canceled multipart upload key=1BOZ331NA7JA upload=Y1RXT34BTBOP tag=EHIY21UDS6P9 type=write size=2124309 2024-09-14T11:17:07.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.427+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=D6DUSDB0JD9Z type=del size=735285 2024-09-14T11:17:07.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.429+0000 7f185d9f8780 1 < completed write operation key=087PN6V1BP65 tag=IOUL1D4TH3AX type=write size=729577 2024-09-14T11:17:07.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.430+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=1WHB45Q61M2T type=del size=701426 2024-09-14T11:17:07.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.432+0000 7f185d9f8780 1 < suggested update operation key=U5S6L8GPSMU5 tag=HIPEWL9MJ8U0 type=del size=1898175 2024-09-14T11:17:07.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.433+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=I58TD91T2WUI type=del size=688088 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.435+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=KD53DZOYT42O type=del 2024-09-14T11:17:07.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.437+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~0HCJS07T7283.0 size=1048576 2024-09-14T11:17:07.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.437+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~0HCJS07T7283.1 size=497388 2024-09-14T11:17:07.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.437+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=0HCJS07T7283 tag=U6CTDTOI06ZT type=write size=2594540 2024-09-14T11:17:07.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.439+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~RPG0SF8J8OD3.0 size=978323 2024-09-14T11:17:07.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.441+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=RPG0SF8J8OD3 tag=MPPCUS86LV1R type=write size=2026899 2024-09-14T11:17:07.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.442+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=RJXLQ7MVH9ZO type=del size=1506209 2024-09-14T11:17:07.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.443+0000 7f185d9f8780 -1 < failed to complete operation key=DAKWA1OCVTBG tag=IESOLFB9AOO0 type=del size=3105068: (22) Invalid argument 2024-09-14T11:17:07.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.445+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~2WTOH1WKX43P.0 size=1048576 2024-09-14T11:17:07.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.446+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~2WTOH1WKX43P.1 size=624583 2024-09-14T11:17:07.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.446+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=2WTOH1WKX43P tag=8V8BV6OX3ND6 type=write size=2721735 2024-09-14T11:17:07.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.447+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=GT23543173FD type=write size=784420 2024-09-14T11:17:07.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.448+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=OUV4K2VCZDU2 type=write size=875488 2024-09-14T11:17:07.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.450+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~H85D6SQ6QUNB.0 size=1048576 2024-09-14T11:17:07.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.450+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~H85D6SQ6QUNB.1 size=505674 2024-09-14T11:17:07.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.451+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=H85D6SQ6QUNB tag=BCRMZEK4BXEB type=write size=2602826 2024-09-14T11:17:07.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.453+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=MRHR60DYU0II type=del size=1972378 2024-09-14T11:17:07.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.453+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~RWHKSG567SXC.0 size=1048576 2024-09-14T11:17:07.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.454+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~RWHKSG567SXC.1 size=890210 2024-09-14T11:17:07.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.456+0000 7f185d9f8780 1 < canceled multipart upload key=SEI774TP8YMJ upload=RWHKSG567SXC tag=JXTHO1NQ5E8O type=write size=2987362 2024-09-14T11:17:07.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.458+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~2VJBZ1DF6AF2.0 size=1048576 2024-09-14T11:17:07.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.459+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~2VJBZ1DF6AF2.1 size=1048576 2024-09-14T11:17:07.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.459+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~2VJBZ1DF6AF2.2 size=456189 2024-09-14T11:17:07.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.459+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=2VJBZ1DF6AF2 tag=RSVY4SGDJVRR type=write size=3601917 2024-09-14T11:17:07.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.461+0000 7f185d9f8780 1 < canceled operation key=P30WF4R3UFPX tag=9S09FOVRWNFG type=del size=1361916 2024-09-14T11:17:07.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.462+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=Q0UZUXM6Y8CC type=del size=2055843 2024-09-14T11:17:07.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.463+0000 7f185d9f8780 1 < completed write operation key=IXWIKD7J74RJ tag=VG8NAF8ILUIL type=write size=593748 2024-09-14T11:17:07.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.465+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~0PPFFFUZLFH4.0 size=103375 2024-09-14T11:17:07.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.465+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=0PPFFFUZLFH4 tag=Q2WUNMY9OGQF type=write size=1151951 2024-09-14T11:17:07.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.466+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~2UW716S574DT.0 size=1048576 2024-09-14T11:17:07.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.467+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~2UW716S574DT.1 size=865364 2024-09-14T11:17:07.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.469+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=2UW716S574DT tag=R6H616RWKEQI type=write size=2962516 2024-09-14T11:17:07.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.471+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~AQV30JRYMGA2.0 size=1048576 2024-09-14T11:17:07.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.472+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~AQV30JRYMGA2.1 size=885168 2024-09-14T11:17:07.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.472+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=AQV30JRYMGA2 tag=5RRARRF56ULL type=write size=2982320 2024-09-14T11:17:07.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.475+0000 7f185d9f8780 1 < suggested update operation key=DAKWA1OCVTBG tag=HPEW1EXA15VV type=del size=917373 2024-09-14T11:17:07.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.476+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=K82AGUW3Q1M8 type=del size=4125162 2024-09-14T11:17:07.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.478+0000 7f185d9f8780 1 < completed write operation key=IXWIKD7J74RJ tag=M4EOMOXWFWDZ type=write size=441684 2024-09-14T11:17:07.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.481+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~0ZJV6DEUSZ3V.0 size=1048576 2024-09-14T11:17:07.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.481+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~0ZJV6DEUSZ3V.1 size=204393 2024-09-14T11:17:07.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.481+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=0ZJV6DEUSZ3V tag=QSP3AVRGI8M9 type=write size=2301545 2024-09-14T11:17:07.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.483+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~X4FU5ER1ZJOJ.0 size=968312 2024-09-14T11:17:07.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.485+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=X4FU5ER1ZJOJ tag=SLP765RDGHFV type=write size=2016888 2024-09-14T11:17:07.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.487+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~MKOZNDXX8O91.0 size=1048576 2024-09-14T11:17:07.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.488+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~MKOZNDXX8O91.1 size=543012 2024-09-14T11:17:07.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.488+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=MKOZNDXX8O91 tag=VCWAI2SMIHC7 type=write size=2640164 2024-09-14T11:17:07.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.489+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=E0TWO7XH5P1N type=del 2024-09-14T11:17:07.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.490+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=THQYNZ0UHYHH type=del size=1047929 2024-09-14T11:17:07.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.491+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=D6DUSDB0JD9Z type=del 2024-09-14T11:17:07.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.493+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=TPK09L0QIYM4 type=del size=559594 2024-09-14T11:17:07.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.494+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=1WHB45Q61M2T type=del 2024-09-14T11:17:07.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.495+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=BET6VEDIEM21 type=del size=2270967 2024-09-14T11:17:07.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.497+0000 7f185d9f8780 1 < suggested remove operation key=OYZIXCSGXTHR tag=I58TD91T2WUI type=del 2024-09-14T11:17:07.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.499+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~SBITL6Z8G2N8.0 size=1048576 2024-09-14T11:17:07.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.500+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~SBITL6Z8G2N8.1 size=1048576 2024-09-14T11:17:07.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.501+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~SBITL6Z8G2N8.2 size=932634 2024-09-14T11:17:07.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.501+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=SBITL6Z8G2N8 tag=I78DPSG73G1G type=write size=4078362 2024-09-14T11:17:07.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.503+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~0HCJS07T7283.0 size=1048576 2024-09-14T11:17:07.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.504+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~0HCJS07T7283.1 size=497388 2024-09-14T11:17:07.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.506+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=0HCJS07T7283 tag=U6CTDTOI06ZT type=write size=2594540 2024-09-14T11:17:07.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.507+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=6SIPW82A7RO3 type=del size=390972 2024-09-14T11:17:07.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.508+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=RJXLQ7MVH9ZO type=del 2024-09-14T11:17:07.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.510+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~QXXC1TS6G4BB.0 size=1048576 2024-09-14T11:17:07.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.511+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~QXXC1TS6G4BB.1 size=758162 2024-09-14T11:17:07.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.511+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=QXXC1TS6G4BB tag=41D5BTPFLS6A type=write size=2855314 2024-09-14T11:17:07.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.513+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~2WTOH1WKX43P.0 size=1048576 2024-09-14T11:17:07.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.514+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~2WTOH1WKX43P.1 size=624583 2024-09-14T11:17:07.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.516+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=2WTOH1WKX43P tag=8V8BV6OX3ND6 type=write size=2721735 2024-09-14T11:17:07.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.517+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=UPP7PD07ICX1 type=del size=2657295 2024-09-14T11:17:07.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.519+0000 7f185d9f8780 1 < suggested remove operation key=XPMGVU0U52GS tag=OUV4K2VCZDU2 type=write 2024-09-14T11:17:07.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.520+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=Y8N412YSAK7J type=del size=1451901 2024-09-14T11:17:07.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.522+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=MRHR60DYU0II type=del 2024-09-14T11:17:07.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.524+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~XIODKQT2ROEC.0 size=190408 2024-09-14T11:17:07.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.524+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=XIODKQT2ROEC tag=B09UTX2JHABD type=write size=1238984 2024-09-14T11:17:07.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.524+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~2VJBZ1DF6AF2.0 size=1048576 2024-09-14T11:17:07.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.525+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~2VJBZ1DF6AF2.1 size=1048576 2024-09-14T11:17:07.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.526+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~2VJBZ1DF6AF2.2 size=456189 2024-09-14T11:17:07.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.528+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=2VJBZ1DF6AF2 tag=RSVY4SGDJVRR type=write size=3601917 2024-09-14T11:17:07.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.529+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=L844CIQMSKP8 type=write size=634754 2024-09-14T11:17:07.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.530+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=Q0UZUXM6Y8CC type=del 2024-09-14T11:17:07.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.532+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~9R5A2ZB0AGWQ.0 size=1048576 2024-09-14T11:17:07.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.533+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~9R5A2ZB0AGWQ.1 size=1048576 2024-09-14T11:17:07.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.534+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~9R5A2ZB0AGWQ.2 size=542902 2024-09-14T11:17:07.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.534+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=9R5A2ZB0AGWQ tag=XVSHXOPIQPOL type=write size=3688630 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.535+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~0PPFFFUZLFH4.0 size=103375 2024-09-14T11:17:07.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.537+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=0PPFFFUZLFH4 tag=Q2WUNMY9OGQF type=write size=1151951 2024-09-14T11:17:07.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.538+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=ALXMLMOQ7X43 type=del size=1997792 2024-09-14T11:17:07.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.539+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~AQV30JRYMGA2.0 size=1048576 2024-09-14T11:17:07.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.539+0000 7f185d9f8780 1 < canceled part key=_multipart_H29SXBS4N9JK.2~AQV30JRYMGA2.1 size=885168 2024-09-14T11:17:07.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.541+0000 7f185d9f8780 1 < canceled multipart upload key=H29SXBS4N9JK upload=AQV30JRYMGA2 tag=5RRARRF56ULL type=write size=2982320 2024-09-14T11:17:07.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.543+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~1QPIB2IF30NG.0 size=285753 2024-09-14T11:17:07.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.543+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=1QPIB2IF30NG tag=9RI8QYOVM4TF type=write size=1334329 2024-09-14T11:17:07.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.545+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=K82AGUW3Q1M8 type=del 2024-09-14T11:17:07.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.546+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=AP0PSLLB6BLA type=write size=607281 2024-09-14T11:17:07.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.547+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~0ZJV6DEUSZ3V.0 size=1048576 2024-09-14T11:17:07.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.548+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~0ZJV6DEUSZ3V.1 size=204393 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.550+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=0ZJV6DEUSZ3V tag=QSP3AVRGI8M9 type=write size=2301545 2024-09-14T11:17:07.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.552+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~EQHMI77JSDMF.0 size=1048576 2024-09-14T11:17:07.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.553+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~EQHMI77JSDMF.1 size=865010 2024-09-14T11:17:07.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.553+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=EQHMI77JSDMF tag=1B9N94E98PQ8 type=write size=2962162 2024-09-14T11:17:07.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.554+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~MKOZNDXX8O91.0 size=1048576 2024-09-14T11:17:07.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.555+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~MKOZNDXX8O91.1 size=543012 2024-09-14T11:17:07.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.557+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=MKOZNDXX8O91 tag=VCWAI2SMIHC7 type=write size=2640164 2024-09-14T11:17:07.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.559+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~XKFQMF8J6B0H.0 size=506506 2024-09-14T11:17:07.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.559+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=XKFQMF8J6B0H tag=OK08PF0T4Z08 type=write size=1555082 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.561+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=THQYNZ0UHYHH type=del size=1047929 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.563+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=A5ULX0RQ1K1J type=del size=403402 2024-09-14T11:17:07.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.564+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=TPK09L0QIYM4 type=del 2024-09-14T11:17:07.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.565+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=L6MDLD7QNSG5 type=del size=4142307 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.567+0000 7f185d9f8780 1 < suggested remove operation key=WPBYTFP7HRVE tag=BET6VEDIEM21 type=del 2024-09-14T11:17:07.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.568+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=O94KVLIKMK5O type=del size=2180432 2024-09-14T11:17:07.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.569+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~SBITL6Z8G2N8.0 size=1048576 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.570+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~SBITL6Z8G2N8.1 size=1048576 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.571+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~SBITL6Z8G2N8.2 size=932634 2024-09-14T11:17:07.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.573+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=SBITL6Z8G2N8 tag=I78DPSG73G1G type=write size=4078362 2024-09-14T11:17:07.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.575+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=F8IS09Z9XRAO type=del size=2843747 2024-09-14T11:17:07.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.576+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=6SIPW82A7RO3 type=del 2024-09-14T11:17:07.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.579+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~Q1WNYVKT9FQ7.0 size=1048576 2024-09-14T11:17:07.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.580+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~Q1WNYVKT9FQ7.1 size=1048576 2024-09-14T11:17:07.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.581+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~Q1WNYVKT9FQ7.2 size=746938 2024-09-14T11:17:07.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.581+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=Q1WNYVKT9FQ7 tag=YUQG4NF6U0L8 type=write size=3892666 2024-09-14T11:17:07.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.582+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~QXXC1TS6G4BB.0 size=1048576 2024-09-14T11:17:07.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.584+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~QXXC1TS6G4BB.1 size=758162 2024-09-14T11:17:07.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.586+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=QXXC1TS6G4BB tag=41D5BTPFLS6A type=write size=2855314 2024-09-14T11:17:07.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.589+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~YM05OPURKYSR.0 size=1048576 2024-09-14T11:17:07.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.590+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~YM05OPURKYSR.1 size=1048576 2024-09-14T11:17:07.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.591+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~YM05OPURKYSR.2 size=344434 2024-09-14T11:17:07.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.591+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=YM05OPURKYSR tag=2EOQNA6W36BL type=write size=3490162 2024-09-14T11:17:07.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.592+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=WPBYTFP7HRVE tag=UPP7PD07ICX1 type=del size=2657295: (2) No such file or directory 2024-09-14T11:17:07.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.593+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=W3R4L4U012XW type=write size=575200 2024-09-14T11:17:07.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.594+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=Y8N412YSAK7J type=del 2024-09-14T11:17:07.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.595+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=DK2FIM0KU7ZW type=del size=2218407 2024-09-14T11:17:07.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.596+0000 7f185d9f8780 1 < canceled part key=_multipart_087PN6V1BP65.2~XIODKQT2ROEC.0 size=190408 2024-09-14T11:17:07.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.598+0000 7f185d9f8780 1 < canceled multipart upload key=087PN6V1BP65 upload=XIODKQT2ROEC tag=B09UTX2JHABD type=write size=1238984 2024-09-14T11:17:07.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.599+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=UJ1F38C6T03V type=del size=2169503 2024-09-14T11:17:07.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.600+0000 7f185d9f8780 1 < completed write operation key=XPMGVU0U52GS tag=L844CIQMSKP8 type=write size=634754 2024-09-14T11:17:07.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.601+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=FFO7JH8KNTE3 type=del size=4194042 2024-09-14T11:17:07.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.603+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~9R5A2ZB0AGWQ.0 size=1048576 2024-09-14T11:17:07.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.604+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~9R5A2ZB0AGWQ.1 size=1048576 2024-09-14T11:17:07.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.605+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~9R5A2ZB0AGWQ.2 size=542902 2024-09-14T11:17:07.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.606+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=9R5A2ZB0AGWQ tag=XVSHXOPIQPOL type=write size=3688630 2024-09-14T11:17:07.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.608+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~UFIAV5UXVFKG.0 size=1048576 2024-09-14T11:17:07.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.609+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~UFIAV5UXVFKG.1 size=423924 2024-09-14T11:17:07.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.609+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=UFIAV5UXVFKG tag=X8ZU2JFEDS4B type=write size=2521076 2024-09-14T11:17:07.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.610+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=ALXMLMOQ7X43 type=del 2024-09-14T11:17:07.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.612+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=BFRSDL6770YH type=del size=2812767 2024-09-14T11:17:07.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.612+0000 7f185d9f8780 1 < canceled part key=_multipart_6MZGLP5KPPB3.2~1QPIB2IF30NG.0 size=285753 2024-09-14T11:17:07.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.614+0000 7f185d9f8780 1 < canceled multipart upload key=6MZGLP5KPPB3 upload=1QPIB2IF30NG tag=9RI8QYOVM4TF type=write size=1334329 2024-09-14T11:17:07.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.616+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~MEG5XHTTU1FW.0 size=1048576 2024-09-14T11:17:07.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.617+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~MEG5XHTTU1FW.1 size=797228 2024-09-14T11:17:07.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.617+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=MEG5XHTTU1FW tag=LKDBBL9KPXTT type=write size=2894380 2024-09-14T11:17:07.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.618+0000 7f185d9f8780 1 < completed write operation key=M4FJDW1QHGBM tag=AP0PSLLB6BLA type=write size=607281 2024-09-14T11:17:07.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.620+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~GQZL24UTS0CY.0 size=701272 2024-09-14T11:17:07.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.620+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=GQZL24UTS0CY tag=JEI38NV4QLVE type=write size=1749848 2024-09-14T11:17:07.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.622+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~EQHMI77JSDMF.0 size=1048576 2024-09-14T11:17:07.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.622+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~EQHMI77JSDMF.1 size=865010 2024-09-14T11:17:07.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.624+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=EQHMI77JSDMF tag=1B9N94E98PQ8 type=write size=2962162 2024-09-14T11:17:07.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.626+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=N92HBMJA5U38 type=del size=3275218 2024-09-14T11:17:07.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.627+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~XKFQMF8J6B0H.0 size=506506 2024-09-14T11:17:07.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.629+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=XKFQMF8J6B0H tag=OK08PF0T4Z08 type=write size=1555082 2024-09-14T11:17:07.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.630+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=Z04JVR3VFLOU type=del size=648388 2024-09-14T11:17:07.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.631+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=A5ULX0RQ1K1J type=del size=403402 2024-09-14T11:17:07.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.632+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=WV1BROPIB5UP type=del size=444909 2024-09-14T11:17:07.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.634+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=L6MDLD7QNSG5 type=del 2024-09-14T11:17:07.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.635+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=EH4I10098E4Q type=del size=145979 2024-09-14T11:17:07.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.636+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=O94KVLIKMK5O type=del 2024-09-14T11:17:07.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.637+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=Z6RVVSW3DYDH type=del size=2768576 2024-09-14T11:17:07.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.639+0000 7f185d9f8780 1 < suggested remove operation key=CRZOT1D0U2F3 tag=F8IS09Z9XRAO type=del 2024-09-14T11:17:07.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.642+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~5OJOKJILC6ZK.0 size=1048576 2024-09-14T11:17:07.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.642+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~5OJOKJILC6ZK.1 size=1048576 2024-09-14T11:17:07.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.643+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~5OJOKJILC6ZK.2 size=638903 2024-09-14T11:17:07.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.643+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=5OJOKJILC6ZK tag=0TPNH9VR31MT type=write size=3784631 2024-09-14T11:17:07.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.645+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~Q1WNYVKT9FQ7.0 size=1048576 2024-09-14T11:17:07.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.645+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~Q1WNYVKT9FQ7.1 size=1048576 2024-09-14T11:17:07.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.646+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~Q1WNYVKT9FQ7.2 size=746938 2024-09-14T11:17:07.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.648+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=Q1WNYVKT9FQ7 tag=YUQG4NF6U0L8 type=write size=3892666 2024-09-14T11:17:07.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.649+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=PRH0LLV5761X type=del size=1909123 2024-09-14T11:17:07.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.651+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~YM05OPURKYSR.0 size=1048576 2024-09-14T11:17:07.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.652+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~YM05OPURKYSR.1 size=1048576 2024-09-14T11:17:07.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.652+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~YM05OPURKYSR.2 size=344434 2024-09-14T11:17:07.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.654+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=YM05OPURKYSR tag=2EOQNA6W36BL type=write size=3490162 2024-09-14T11:17:07.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.656+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~7E3B9PXGRJFR.0 size=25598 2024-09-14T11:17:07.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.656+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=7E3B9PXGRJFR tag=QV6IP3P1D3NK type=write size=1074174 2024-09-14T11:17:07.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.657+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=W3R4L4U012XW type=write size=575200 2024-09-14T11:17:07.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.658+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=B3ZDMI73IUKI type=del size=2313277 2024-09-14T11:17:07.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.659+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=DK2FIM0KU7ZW type=del 2024-09-14T11:17:07.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.660+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=PN9L2B42R0K1 type=del size=1126093 2024-09-14T11:17:07.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.661+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=UJ1F38C6T03V type=del 2024-09-14T11:17:07.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.663+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=8VBX3XPLNNLS type=del size=137737 2024-09-14T11:17:07.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.664+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=FFO7JH8KNTE3 type=del 2024-09-14T11:17:07.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.666+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~JEEB1N0D4NBL.0 size=387055 2024-09-14T11:17:07.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.666+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=JEEB1N0D4NBL tag=C8LJXWXUBQZT type=write size=1435631 2024-09-14T11:17:07.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.667+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~UFIAV5UXVFKG.0 size=1048576 2024-09-14T11:17:07.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.668+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~UFIAV5UXVFKG.1 size=423924 2024-09-14T11:17:07.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.670+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=UFIAV5UXVFKG tag=X8ZU2JFEDS4B type=write size=2521076 2024-09-14T11:17:07.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.671+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=U58GGUJG7E9T type=write size=737922 2024-09-14T11:17:07.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.673+0000 7f185d9f8780 1 < suggested update operation key=087PN6V1BP65 tag=BFRSDL6770YH type=del size=2812767 2024-09-14T11:17:07.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.674+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=SAWT5VFM7057 type=write size=671490 2024-09-14T11:17:07.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.675+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~MEG5XHTTU1FW.0 size=1048576 2024-09-14T11:17:07.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.676+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~MEG5XHTTU1FW.1 size=797228 2024-09-14T11:17:07.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.678+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=MEG5XHTTU1FW tag=LKDBBL9KPXTT type=write size=2894380 2024-09-14T11:17:07.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.679+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=FOKJUZI4Z2BN type=del size=112165 2024-09-14T11:17:07.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.680+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~GQZL24UTS0CY.0 size=701272 2024-09-14T11:17:07.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.682+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=GQZL24UTS0CY tag=JEI38NV4QLVE type=write size=1749848 2024-09-14T11:17:07.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.683+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=VJIL4N7ZI8C3 type=del size=2394172 2024-09-14T11:17:07.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.685+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=N92HBMJA5U38 type=del 2024-09-14T11:17:07.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.686+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=ST8EMAW88LR9 type=del size=844355 2024-09-14T11:17:07.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.687+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=Z04JVR3VFLOU type=del 2024-09-14T11:17:07.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.688+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=K43ZLUW6AHUZ type=del size=877630 2024-09-14T11:17:07.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.689+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=WV1BROPIB5UP type=del 2024-09-14T11:17:07.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.692+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~S9DW0LZ3ZXR0.0 size=1048576 2024-09-14T11:17:07.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.693+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~S9DW0LZ3ZXR0.1 size=1048576 2024-09-14T11:17:07.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.694+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~S9DW0LZ3ZXR0.2 size=285046 2024-09-14T11:17:07.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.694+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=S9DW0LZ3ZXR0 tag=7N1563XS96LL type=write size=3430774 2024-09-14T11:17:07.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.695+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=EH4I10098E4Q type=del 2024-09-14T11:17:07.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.697+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=0LYHAQ4FNKIE type=del size=1624869 2024-09-14T11:17:07.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.700+0000 7f185d9f8780 1 < suggested remove operation key=DAKWA1OCVTBG tag=Z6RVVSW3DYDH type=del 2024-09-14T11:17:07.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.701+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=C7OGE6DZXZPX type=del size=3914661 2024-09-14T11:17:07.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.702+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~5OJOKJILC6ZK.0 size=1048576 2024-09-14T11:17:07.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.703+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~5OJOKJILC6ZK.1 size=1048576 2024-09-14T11:17:07.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.704+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~5OJOKJILC6ZK.2 size=638903 2024-09-14T11:17:07.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.706+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=5OJOKJILC6ZK tag=0TPNH9VR31MT type=write size=3784631 2024-09-14T11:17:07.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.707+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=5GIJ9Q851HHB type=del size=387126 2024-09-14T11:17:07.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.710+0000 7f185d9f8780 1 < suggested remove operation key=WPBYTFP7HRVE tag=PRH0LLV5761X type=del 2024-09-14T11:17:07.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.712+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~LMZL1BZCJZO3.0 size=355894 2024-09-14T11:17:07.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.712+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=LMZL1BZCJZO3 tag=JFF1NVGU814M type=write size=1404470 2024-09-14T11:17:07.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.713+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~7E3B9PXGRJFR.0 size=25598 2024-09-14T11:17:07.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.715+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=7E3B9PXGRJFR tag=QV6IP3P1D3NK type=write size=1074174 2024-09-14T11:17:07.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.716+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=TK7C8ZY1BG5X type=del size=980288 2024-09-14T11:17:07.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.717+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=B3ZDMI73IUKI type=del 2024-09-14T11:17:07.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.719+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~6UH7LON7J8ZV.0 size=697131 2024-09-14T11:17:07.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.719+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=6UH7LON7J8ZV tag=UBUGHYJESVAN type=write size=1745707 2024-09-14T11:17:07.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.720+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=PN9L2B42R0K1 type=del 2024-09-14T11:17:07.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.721+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=7OAR0DOUBD3H type=del size=2911849 2024-09-14T11:17:07.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.724+0000 7f185d9f8780 1 < suggested remove operation key=830X857XIX9O tag=8VBX3XPLNNLS type=del 2024-09-14T11:17:07.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.726+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~3K8Q5VOAUW03.0 size=1048576 2024-09-14T11:17:07.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.727+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~3K8Q5VOAUW03.1 size=1048576 2024-09-14T11:17:07.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.728+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~3K8Q5VOAUW03.2 size=328066 2024-09-14T11:17:07.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.728+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=3K8Q5VOAUW03 tag=VAEMO1C9QFRJ type=write size=3473794 2024-09-14T11:17:07.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.729+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~JEEB1N0D4NBL.0 size=387055 2024-09-14T11:17:07.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.731+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=JEEB1N0D4NBL tag=C8LJXWXUBQZT type=write size=1435631 2024-09-14T11:17:07.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.732+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=IXIWQIBZV22Z type=del size=3681280 2024-09-14T11:17:07.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.733+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=U58GGUJG7E9T type=write size=737922 2024-09-14T11:17:07.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.735+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=61J31K61SDKN type=del size=2316986 2024-09-14T11:17:07.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.735+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=830X857XIX9O tag=SAWT5VFM7057 type=write size=671490: (2) No such file or directory 2024-09-14T11:17:07.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.738+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~70JRIMR88S1F.0 size=644779 2024-09-14T11:17:07.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.738+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=70JRIMR88S1F tag=1U5K1YB8I9IZ type=write size=1693355 2024-09-14T11:17:07.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.740+0000 7f185d9f8780 1 < suggested update operation key=O2Y34FSQHS1S tag=FOKJUZI4Z2BN type=del size=112165 2024-09-14T11:17:07.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.741+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=OY8C1MQ350MA type=del size=3298000 2024-09-14T11:17:07.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.743+0000 7f185d9f8780 -1 < failed to complete operation key=O2Y34FSQHS1S tag=VJIL4N7ZI8C3 type=del size=2394172: (22) Invalid argument 2024-09-14T11:17:07.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.745+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~4KPFB0HB6LMD.0 size=737677 2024-09-14T11:17:07.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.745+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=4KPFB0HB6LMD tag=HWQNTO0LR13X type=write size=1786253 2024-09-14T11:17:07.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.746+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=ST8EMAW88LR9 type=del 2024-09-14T11:17:07.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.748+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~M1H5V8H17KNR.0 size=473736 2024-09-14T11:17:07.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.748+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=M1H5V8H17KNR tag=C8EFHZUEQMXG type=write size=1522312 2024-09-14T11:17:07.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.750+0000 7f185d9f8780 1 < suggested update operation key=HLUMY48G90KB tag=K43ZLUW6AHUZ type=del size=877630 2024-09-14T11:17:07.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.751+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=CJ5XA55GWXQJ type=del size=1660135 2024-09-14T11:17:07.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.753+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~S9DW0LZ3ZXR0.0 size=1048576 2024-09-14T11:17:07.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.753+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~S9DW0LZ3ZXR0.1 size=1048576 2024-09-14T11:17:07.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.753+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~S9DW0LZ3ZXR0.2 size=285046 2024-09-14T11:17:07.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.755+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=S9DW0LZ3ZXR0 tag=7N1563XS96LL type=write size=3430774 2024-09-14T11:17:07.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.757+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~0MTDVFFRQID1.0 size=495166 2024-09-14T11:17:07.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.757+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=0MTDVFFRQID1 tag=DAN0A2WRMCUP type=write size=1543742 2024-09-14T11:17:07.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.758+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=0LYHAQ4FNKIE type=del 2024-09-14T11:17:07.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.759+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=66E21VRR131V type=del size=2635451 2024-09-14T11:17:07.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.760+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=C7OGE6DZXZPX type=del 2024-09-14T11:17:07.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.762+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=MIWMYHN9FTIO type=del size=2975132 2024-09-14T11:17:07.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.763+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=5GIJ9Q851HHB type=del 2024-09-14T11:17:07.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.765+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~YH6NIDN1E6S4.0 size=794914 2024-09-14T11:17:07.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.765+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=YH6NIDN1E6S4 tag=3SNFCSVWKM6G type=write size=1843490 2024-09-14T11:17:07.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.766+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~LMZL1BZCJZO3.0 size=355894 2024-09-14T11:17:07.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.769+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=LMZL1BZCJZO3 tag=JFF1NVGU814M type=write size=1404470 2024-09-14T11:17:07.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.778+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~8CBEW49SXMV7.0 size=437894 2024-09-14T11:17:07.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.778+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=8CBEW49SXMV7 tag=OPFXY9DVD6L1 type=write size=1486470 2024-09-14T11:17:07.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.779+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=TK7C8ZY1BG5X type=del 2024-09-14T11:17:07.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.782+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~60Y6YVJZ8PVN.0 size=1048576 2024-09-14T11:17:07.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.783+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~60Y6YVJZ8PVN.1 size=1048576 2024-09-14T11:17:07.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.783+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~60Y6YVJZ8PVN.2 size=494663 2024-09-14T11:17:07.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.783+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=60Y6YVJZ8PVN tag=PPI2CQ3TUB8N type=write size=3640391 2024-09-14T11:17:07.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.785+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~6UH7LON7J8ZV.0 size=697131 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.787+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=6UH7LON7J8ZV tag=UBUGHYJESVAN type=write size=1745707 2024-09-14T11:17:07.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.789+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~7GFVZ1I734KA.0 size=1048576 2024-09-14T11:17:07.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.790+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~7GFVZ1I734KA.1 size=1048576 2024-09-14T11:17:07.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.791+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~7GFVZ1I734KA.2 size=653650 2024-09-14T11:17:07.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.791+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=7GFVZ1I734KA tag=49XIPLLWT3VM type=write size=3799378 2024-09-14T11:17:07.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.792+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=7OAR0DOUBD3H type=del 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.793+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=8IY40PV1X8WQ type=del size=3755882 2024-09-14T11:17:07.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.794+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~3K8Q5VOAUW03.0 size=1048576 2024-09-14T11:17:07.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.795+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~3K8Q5VOAUW03.1 size=1048576 2024-09-14T11:17:07.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.795+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~3K8Q5VOAUW03.2 size=328066 2024-09-14T11:17:07.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.797+0000 7f185d9f8780 1 < canceled multipart upload key=SEI774TP8YMJ upload=3K8Q5VOAUW03 tag=VAEMO1C9QFRJ type=write size=3473794 2024-09-14T11:17:07.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.798+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=OUY4FFQCBHW1 type=del size=2851268 2024-09-14T11:17:07.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.800+0000 7f185d9f8780 1 < canceled operation key=CJ6C03RXS0IW tag=IXIWQIBZV22Z type=del size=3681280 2024-09-14T11:17:07.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.802+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~9YXVZOP3NZTS.0 size=1048576 2024-09-14T11:17:07.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.803+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~9YXVZOP3NZTS.1 size=1048576 2024-09-14T11:17:07.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.804+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~9YXVZOP3NZTS.2 size=20741 2024-09-14T11:17:07.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.804+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=9YXVZOP3NZTS tag=FHHA866NHZ95 type=write size=3166469 2024-09-14T11:17:07.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.805+0000 7f185d9f8780 -1 < failed to complete operation key=HLUMY48G90KB tag=61J31K61SDKN type=del size=2316986: (22) Invalid argument 2024-09-14T11:17:07.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.806+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=MMYU322EQM4Y type=del size=747646 2024-09-14T11:17:07.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.806+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~70JRIMR88S1F.0 size=644779 2024-09-14T11:17:07.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.808+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=70JRIMR88S1F tag=1U5K1YB8I9IZ type=write size=1693355 2024-09-14T11:17:07.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.809+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=FF5CL0EZL5QO type=del size=2728142 2024-09-14T11:17:07.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.810+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=OY8C1MQ350MA type=del 2024-09-14T11:17:07.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.812+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=N69GV5HKHF81 type=del size=925810 2024-09-14T11:17:07.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.813+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~4KPFB0HB6LMD.0 size=737677 2024-09-14T11:17:07.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.815+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=4KPFB0HB6LMD tag=HWQNTO0LR13X type=write size=1786253 2024-09-14T11:17:07.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.817+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~FNXT1AMAEM5M.0 size=933397 2024-09-14T11:17:07.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.817+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=FNXT1AMAEM5M tag=3LDB1R0ZYPES type=write size=1981973 2024-09-14T11:17:07.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.819+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~M1H5V8H17KNR.0 size=473736 2024-09-14T11:17:07.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.821+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=M1H5V8H17KNR tag=C8EFHZUEQMXG type=write size=1522312 2024-09-14T11:17:07.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.822+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=9FC1R7Y1PHP0 type=del size=2107820 2024-09-14T11:17:07.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.823+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=CJ5XA55GWXQJ type=del 2024-09-14T11:17:07.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.826+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~T1BDTWZK0LDU.0 size=1048576 2024-09-14T11:17:07.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.827+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~T1BDTWZK0LDU.1 size=419286 2024-09-14T11:17:07.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.827+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=T1BDTWZK0LDU tag=X5FCS8BI08GS type=write size=2516438 2024-09-14T11:17:07.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.828+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~0MTDVFFRQID1.0 size=495166 2024-09-14T11:17:07.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.830+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=0MTDVFFRQID1 tag=DAN0A2WRMCUP type=write size=1543742 2024-09-14T11:17:07.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.831+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=QLKZ6RLIN57A type=del size=94617 2024-09-14T11:17:07.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.832+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=66E21VRR131V type=del 2024-09-14T11:17:07.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.834+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~79QK0660HWGG.0 size=1048576 2024-09-14T11:17:07.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.835+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~79QK0660HWGG.1 size=1048576 2024-09-14T11:17:07.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.836+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~79QK0660HWGG.2 size=566337 2024-09-14T11:17:07.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.836+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=79QK0660HWGG tag=HU8PMT20AT6Z type=write size=3712065 2024-09-14T11:17:07.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.838+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=MIWMYHN9FTIO type=del 2024-09-14T11:17:07.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.839+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=EZVZIEMGM0TH type=del size=2602584 2024-09-14T11:17:07.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.840+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~YH6NIDN1E6S4.0 size=794914 2024-09-14T11:17:07.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.842+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=YH6NIDN1E6S4 tag=3SNFCSVWKM6G type=write size=1843490 2024-09-14T11:17:07.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.843+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=XYGTARORHHBI type=del size=2358507 2024-09-14T11:17:07.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.844+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~8CBEW49SXMV7.0 size=437894 2024-09-14T11:17:07.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.846+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=8CBEW49SXMV7 tag=OPFXY9DVD6L1 type=write size=1486470 2024-09-14T11:17:07.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.848+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=0QWCJ8VGZH7G type=del size=1512087 2024-09-14T11:17:07.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.849+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~60Y6YVJZ8PVN.0 size=1048576 2024-09-14T11:17:07.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.850+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~60Y6YVJZ8PVN.1 size=1048576 2024-09-14T11:17:07.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.851+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~60Y6YVJZ8PVN.2 size=494663 2024-09-14T11:17:07.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.853+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=60Y6YVJZ8PVN tag=PPI2CQ3TUB8N type=write size=3640391 2024-09-14T11:17:07.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.854+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=RWSOR813G2VO type=del size=338515 2024-09-14T11:17:07.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.855+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~7GFVZ1I734KA.0 size=1048576 2024-09-14T11:17:07.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.856+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~7GFVZ1I734KA.1 size=1048576 2024-09-14T11:17:07.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.857+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~7GFVZ1I734KA.2 size=653650 2024-09-14T11:17:07.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.859+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=7GFVZ1I734KA tag=49XIPLLWT3VM type=write size=3799378 2024-09-14T11:17:07.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.861+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~X0VFGTCKKNR5.0 size=1048576 2024-09-14T11:17:07.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.862+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~X0VFGTCKKNR5.1 size=818857 2024-09-14T11:17:07.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.862+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=X0VFGTCKKNR5 tag=ATM504Z73FER type=write size=2916009 2024-09-14T11:17:07.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.863+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=8IY40PV1X8WQ type=del 2024-09-14T11:17:07.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.864+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=A2YE0OCMS9O0 type=del size=1166238 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.867+0000 7f185d9f8780 1 < suggested update operation key=U5S6L8GPSMU5 tag=OUY4FFQCBHW1 type=del size=2851268 2024-09-14T11:17:07.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.869+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~SN4IYLQ8SCPA.0 size=1048576 2024-09-14T11:17:07.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.870+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~SN4IYLQ8SCPA.1 size=1048576 2024-09-14T11:17:07.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.870+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~SN4IYLQ8SCPA.2 size=132641 2024-09-14T11:17:07.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.870+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=SN4IYLQ8SCPA tag=1EQ5OBJE2DQO type=write size=3278369 2024-09-14T11:17:07.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.871+0000 7f185d9f8780 1 < canceled part key=_multipart_CJ6C03RXS0IW.2~9YXVZOP3NZTS.0 size=1048576 2024-09-14T11:17:07.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.872+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~9YXVZOP3NZTS.1 size=1048576 2024-09-14T11:17:07.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.873+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~9YXVZOP3NZTS.2 size=20741 2024-09-14T11:17:07.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.874+0000 7f185d9f8780 1 < canceled multipart upload key=CJ6C03RXS0IW upload=9YXVZOP3NZTS tag=FHHA866NHZ95 type=write size=3166469 2024-09-14T11:17:07.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.876+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=XP19NLIS58WG type=del size=3549154 2024-09-14T11:17:07.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.877+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=MMYU322EQM4Y type=del size=747646 2024-09-14T11:17:07.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.878+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=WJ8A2DNDRMDR type=del size=763573 2024-09-14T11:17:07.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.879+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=FF5CL0EZL5QO type=del 2024-09-14T11:17:07.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.880+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=84AMQSDJW3PE type=del size=2861080 2024-09-14T11:17:07.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.883+0000 7f185d9f8780 1 < suggested remove operation key=O2Y34FSQHS1S tag=N69GV5HKHF81 type=del 2024-09-14T11:17:07.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.884+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=QQ1B88T2JZ3R type=del size=3995645 2024-09-14T11:17:07.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.885+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~FNXT1AMAEM5M.0 size=933397 2024-09-14T11:17:07.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.887+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=FNXT1AMAEM5M tag=3LDB1R0ZYPES type=write size=1981973 2024-09-14T11:17:07.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.888+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=I3721SN3GB5P type=del size=2811007 2024-09-14T11:17:07.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.889+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=9FC1R7Y1PHP0 type=del 2024-09-14T11:17:07.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.891+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=OFW0EFM6IQXE type=del size=1933809 2024-09-14T11:17:07.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.892+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~T1BDTWZK0LDU.0 size=1048576 2024-09-14T11:17:07.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.893+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~T1BDTWZK0LDU.1 size=419286 2024-09-14T11:17:07.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.894+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=T1BDTWZK0LDU tag=X5FCS8BI08GS type=write size=2516438 2024-09-14T11:17:07.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.897+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~WHWVWOE72LIK.0 size=1048576 2024-09-14T11:17:07.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.897+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~WHWVWOE72LIK.1 size=1048576 2024-09-14T11:17:07.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.898+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~WHWVWOE72LIK.2 size=755790 2024-09-14T11:17:07.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.898+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=WHWVWOE72LIK tag=PFRNIMRO1LST type=write size=3901518 2024-09-14T11:17:07.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.901+0000 7f185d9f8780 1 < suggested remove operation key=XPMGVU0U52GS tag=QLKZ6RLIN57A type=del 2024-09-14T11:17:07.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.902+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=NXQ0SJ0P2WGK type=del size=2041753 2024-09-14T11:17:07.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.903+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~79QK0660HWGG.0 size=1048576 2024-09-14T11:17:07.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.904+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~79QK0660HWGG.1 size=1048576 2024-09-14T11:17:07.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.904+0000 7f185d9f8780 1 < canceled part key=_multipart_DAKWA1OCVTBG.2~79QK0660HWGG.2 size=566337 2024-09-14T11:17:07.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.906+0000 7f185d9f8780 1 < canceled multipart upload key=DAKWA1OCVTBG upload=79QK0660HWGG tag=HU8PMT20AT6Z type=write size=3712065 2024-09-14T11:17:07.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.908+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~DIN6W3YAWSET.0 size=838729 2024-09-14T11:17:07.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.908+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=DIN6W3YAWSET tag=1QCINI0BWWAP type=write size=1887305 2024-09-14T11:17:07.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.909+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=EZVZIEMGM0TH type=del 2024-09-14T11:17:07.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.911+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=ELRQK9P7UO5Q type=del size=3096031 2024-09-14T11:17:07.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.912+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=XYGTARORHHBI type=del 2024-09-14T11:17:07.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.913+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=RHYM31DB3BUW type=del size=3349855 2024-09-14T11:17:07.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.914+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=0QWCJ8VGZH7G type=del 2024-09-14T11:17:07.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.915+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=PK09GUAMWGR0 type=del size=3651356 2024-09-14T11:17:07.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.917+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=RWSOR813G2VO type=del 2024-09-14T11:17:07.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.919+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~GRYST8AK6YUB.0 size=1048576 2024-09-14T11:17:07.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.920+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~GRYST8AK6YUB.1 size=242080 2024-09-14T11:17:07.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.920+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=GRYST8AK6YUB tag=HYVHDZ7WVC03 type=write size=2339232 2024-09-14T11:17:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.921+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~X0VFGTCKKNR5.0 size=1048576 2024-09-14T11:17:07.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.922+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~X0VFGTCKKNR5.1 size=818857 2024-09-14T11:17:07.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.924+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=X0VFGTCKKNR5 tag=ATM504Z73FER type=write size=2916009 2024-09-14T11:17:07.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.925+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=AQFY4ZTDXJ31 type=write size=370983 2024-09-14T11:17:07.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.927+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=A2YE0OCMS9O0 type=del 2024-09-14T11:17:07.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.930+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~2FXPXJ84W2II.0 size=1048576 2024-09-14T11:17:07.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.931+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~2FXPXJ84W2II.1 size=419770 2024-09-14T11:17:07.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.931+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=2FXPXJ84W2II tag=B61Q29ILYVRB type=write size=2516922 2024-09-14T11:17:07.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.932+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~SN4IYLQ8SCPA.0 size=1048576 2024-09-14T11:17:07.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.933+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~SN4IYLQ8SCPA.1 size=1048576 2024-09-14T11:17:07.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.934+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~SN4IYLQ8SCPA.2 size=132641 2024-09-14T11:17:07.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.936+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=SN4IYLQ8SCPA tag=1EQ5OBJE2DQO type=write size=3278369 2024-09-14T11:17:07.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.937+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=TVLG4KP5KFZG type=del size=1851625 2024-09-14T11:17:07.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.939+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=XP19NLIS58WG type=del size=3549154 2024-09-14T11:17:07.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.941+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~7Q9HV3O3VJK1.0 size=1023254 2024-09-14T11:17:07.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.941+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=7Q9HV3O3VJK1 tag=JNT0R0EOOO3S type=write size=2071830 2024-09-14T11:17:07.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.943+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=WJ8A2DNDRMDR type=del 2024-09-14T11:17:07.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.944+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=IGL7TW15DWJZ type=del size=2212165 2024-09-14T11:17:07.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.945+0000 7f185d9f8780 1 < canceled operation key=MPZOX5RU0580 tag=84AMQSDJW3PE type=del size=2861080 2024-09-14T11:17:07.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.946+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=USM3AF09BEPC type=del size=676461 2024-09-14T11:17:07.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.948+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=QQ1B88T2JZ3R type=del 2024-09-14T11:17:07.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.950+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~6XQDMA6NHN1V.0 size=1048576 2024-09-14T11:17:07.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.951+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~6XQDMA6NHN1V.1 size=498284 2024-09-14T11:17:07.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.951+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=6XQDMA6NHN1V tag=L463EKKKTOKO type=write size=2595436 2024-09-14T11:17:07.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.952+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=I3721SN3GB5P type=del 2024-09-14T11:17:07.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.954+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~W0AEUDSW4711.0 size=1048576 2024-09-14T11:17:07.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.955+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~W0AEUDSW4711.1 size=928942 2024-09-14T11:17:07.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.955+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=W0AEUDSW4711 tag=WSPFFBRLYGR1 type=write size=3026094 2024-09-14T11:17:07.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.958+0000 7f185d9f8780 1 < suggested update operation key=M4FJDW1QHGBM tag=OFW0EFM6IQXE type=del size=1933809 2024-09-14T11:17:07.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.959+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=J4S9ODNI6LEJ type=del size=3249032 2024-09-14T11:17:07.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.960+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~WHWVWOE72LIK.0 size=1048576 2024-09-14T11:17:07.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.960+0000 7f185d9f8780 1 < canceled part key=_multipart_7XGG5LBGRI4H.2~WHWVWOE72LIK.1 size=1048576 2024-09-14T11:17:07.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.962+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~WHWVWOE72LIK.2 size=755790 2024-09-14T11:17:07.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.964+0000 7f185d9f8780 1 < canceled multipart upload key=7XGG5LBGRI4H upload=WHWVWOE72LIK tag=PFRNIMRO1LST type=write size=3901518 2024-09-14T11:17:07.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.967+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~30OLJLMID1MW.0 size=1048576 2024-09-14T11:17:07.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.967+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~30OLJLMID1MW.1 size=85931 2024-09-14T11:17:07.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.967+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=30OLJLMID1MW tag=V7QLVP4MQ2C6 type=write size=2183083 2024-09-14T11:17:07.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.969+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=NXQ0SJ0P2WGK type=del 2024-09-14T11:17:07.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.970+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=KI7S3C8Y070H type=del size=1144794 2024-09-14T11:17:07.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.971+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~DIN6W3YAWSET.0 size=838729 2024-09-14T11:17:07.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.973+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=DIN6W3YAWSET tag=1QCINI0BWWAP type=write size=1887305 2024-09-14T11:17:07.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.975+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~125H3TB0MJDO.0 size=7911 2024-09-14T11:17:07.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.975+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=125H3TB0MJDO tag=RXY63ICPBQSX type=write size=1056487 2024-09-14T11:17:07.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.978+0000 7f185d9f8780 1 < suggested update operation key=1BOZ331NA7JA tag=ELRQK9P7UO5Q type=del size=3096031 2024-09-14T11:17:07.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.979+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=HF1W5K0FOQ4Z type=del size=1469492 2024-09-14T11:17:07.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.980+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=RHYM31DB3BUW type=del 2024-09-14T11:17:07.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.982+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=FQI1Y76IG17T type=del size=4106153 2024-09-14T11:17:07.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.983+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=PK09GUAMWGR0 type=del 2024-09-14T11:17:07.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.984+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=RAQ9L9USWG9H type=del size=1399256 2024-09-14T11:17:07.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.984+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~GRYST8AK6YUB.0 size=1048576 2024-09-14T11:17:07.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.985+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~GRYST8AK6YUB.1 size=242080 2024-09-14T11:17:07.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.987+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=GRYST8AK6YUB tag=HYVHDZ7WVC03 type=write size=2339232 2024-09-14T11:17:07.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.989+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=VMU0D8YFXUTW type=del size=3262684 2024-09-14T11:17:07.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.990+0000 7f185d9f8780 1 < completed write operation key=6B0SURI3Q8R6 tag=AQFY4ZTDXJ31 type=write size=370983 2024-09-14T11:17:07.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.991+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=09JE4MCAZU2Q type=del size=3411114 2024-09-14T11:17:07.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.993+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~2FXPXJ84W2II.0 size=1048576 2024-09-14T11:17:07.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.994+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~2FXPXJ84W2II.1 size=419770 2024-09-14T11:17:07.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.996+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=2FXPXJ84W2II tag=B61Q29ILYVRB type=write size=2516922 2024-09-14T11:17:07.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.997+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=MNJXRTNM9FEQ type=del size=1060859 2024-09-14T11:17:07.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:07.998+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=TVLG4KP5KFZG type=del 2024-09-14T11:17:07.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.001+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~KA1GOMSQBEQV.0 size=90296 2024-09-14T11:17:07.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.001+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=KA1GOMSQBEQV tag=0GSEILP2O18L type=write size=1138872 2024-09-14T11:17:08.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.002+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~7Q9HV3O3VJK1.0 size=1023254 2024-09-14T11:17:08.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.004+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=7Q9HV3O3VJK1 tag=JNT0R0EOOO3S type=write size=2071830 2024-09-14T11:17:08.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.006+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=2BOXQ3HYSTII type=del size=3274561 2024-09-14T11:17:08.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.007+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=IGL7TW15DWJZ type=del 2024-09-14T11:17:08.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.008+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=WKCUUGOBCPKR type=del size=584704 2024-09-14T11:17:08.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.010+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=USM3AF09BEPC type=del 2024-09-14T11:17:08.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.011+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=H43BE5VL8O58 type=del size=2718463 2024-09-14T11:17:08.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.012+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~6XQDMA6NHN1V.0 size=1048576 2024-09-14T11:17:08.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.013+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~6XQDMA6NHN1V.1 size=498284 2024-09-14T11:17:08.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.015+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=6XQDMA6NHN1V tag=L463EKKKTOKO type=write size=2595436 2024-09-14T11:17:08.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.016+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=OIWXP8KMBW56 type=del size=2300644 2024-09-14T11:17:08.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.017+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~W0AEUDSW4711.0 size=1048576 2024-09-14T11:17:08.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.018+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~W0AEUDSW4711.1 size=928942 2024-09-14T11:17:08.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.020+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=W0AEUDSW4711 tag=WSPFFBRLYGR1 type=write size=3026094 2024-09-14T11:17:08.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.021+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=EP1ZMH4ZNIZS type=del size=1696047 2024-09-14T11:17:08.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.022+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=J4S9ODNI6LEJ type=del 2024-09-14T11:17:08.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.024+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=32BT39BY1MMQ type=del size=4030197 2024-09-14T11:17:08.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.025+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~30OLJLMID1MW.0 size=1048576 2024-09-14T11:17:08.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.026+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~30OLJLMID1MW.1 size=85931 2024-09-14T11:17:08.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.028+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=30OLJLMID1MW tag=V7QLVP4MQ2C6 type=write size=2183083 2024-09-14T11:17:08.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.030+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~NPCR8TVT2Y6C.0 size=1048576 2024-09-14T11:17:08.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.031+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~NPCR8TVT2Y6C.1 size=534310 2024-09-14T11:17:08.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.031+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=NPCR8TVT2Y6C tag=FCCTF56CTD6S type=write size=2631462 2024-09-14T11:17:08.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.032+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=KI7S3C8Y070H type=del 2024-09-14T11:17:08.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.033+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=N1CZVHUHVMZE type=del size=661383 2024-09-14T11:17:08.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.034+0000 7f185d9f8780 1 < canceled part key=_multipart_M4FJDW1QHGBM.2~125H3TB0MJDO.0 size=7911 2024-09-14T11:17:08.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.036+0000 7f185d9f8780 1 < canceled multipart upload key=M4FJDW1QHGBM upload=125H3TB0MJDO tag=RXY63ICPBQSX type=write size=1056487 2024-09-14T11:17:08.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.037+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=J0IMGHO91O11 type=del size=3848443 2024-09-14T11:17:08.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.038+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=HF1W5K0FOQ4Z type=del 2024-09-14T11:17:08.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.040+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~Q7UYO5KHMMD4.0 size=1048576 2024-09-14T11:17:08.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.041+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~Q7UYO5KHMMD4.1 size=277266 2024-09-14T11:17:08.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.041+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=Q7UYO5KHMMD4 tag=B2H2WOKL4KPG type=write size=2374418 2024-09-14T11:17:08.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.043+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=FQI1Y76IG17T type=del 2024-09-14T11:17:08.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.045+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=8O897XYKOJRK type=del size=2468022 2024-09-14T11:17:08.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.048+0000 7f185d9f8780 1 < suggested remove operation key=O2Y34FSQHS1S tag=RAQ9L9USWG9H type=del 2024-09-14T11:17:08.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.049+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=R165051KKVST type=write size=82773 2024-09-14T11:17:08.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.050+0000 7f185d9f8780 1 < canceled operation key=1BOZ331NA7JA tag=VMU0D8YFXUTW type=del size=3262684 2024-09-14T11:17:08.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.052+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~OECS9KIIR12W.0 size=1048576 2024-09-14T11:17:08.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.053+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~OECS9KIIR12W.1 size=1048576 2024-09-14T11:17:08.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.054+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~OECS9KIIR12W.2 size=448495 2024-09-14T11:17:08.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.054+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=OECS9KIIR12W tag=IKX3KBAK0NY7 type=write size=3594223 2024-09-14T11:17:08.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.057+0000 7f185d9f8780 1 < suggested remove operation key=HLUMY48G90KB tag=09JE4MCAZU2Q type=del 2024-09-14T11:17:08.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.059+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~PWD438EN7XRZ.0 size=1048576 2024-09-14T11:17:08.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.060+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~PWD438EN7XRZ.1 size=1048576 2024-09-14T11:17:08.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.061+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~PWD438EN7XRZ.2 size=964041 2024-09-14T11:17:08.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.061+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=PWD438EN7XRZ tag=1II6WHHUWLG4 type=write size=4109769 2024-09-14T11:17:08.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.063+0000 7f185d9f8780 -1 < failed to complete operation key=O2Y34FSQHS1S tag=MNJXRTNM9FEQ type=del size=1060859: (22) Invalid argument 2024-09-14T11:17:08.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.065+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~ESOMAYY1753P.0 size=1048576 2024-09-14T11:17:08.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.066+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~ESOMAYY1753P.1 size=1048576 2024-09-14T11:17:08.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.067+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~ESOMAYY1753P.2 size=110720 2024-09-14T11:17:08.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.067+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=ESOMAYY1753P tag=Z1CUZF3ZS9ZA type=write size=3256448 2024-09-14T11:17:08.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.068+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~KA1GOMSQBEQV.0 size=90296 2024-09-14T11:17:08.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.070+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=KA1GOMSQBEQV tag=0GSEILP2O18L type=write size=1138872 2024-09-14T11:17:08.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.072+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=P822RKDJPUNG type=del size=3197617 2024-09-14T11:17:08.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.074+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=2BOXQ3HYSTII type=del size=3274561 2024-09-14T11:17:08.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.075+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=RWDHBI5OS64R type=del size=3810116 2024-09-14T11:17:08.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.077+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=WKCUUGOBCPKR type=del 2024-09-14T11:17:08.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.079+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~8ZUF320NXU3X.0 size=1048576 2024-09-14T11:17:08.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.080+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~8ZUF320NXU3X.1 size=1048576 2024-09-14T11:17:08.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.081+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~8ZUF320NXU3X.2 size=398907 2024-09-14T11:17:08.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.081+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=8ZUF320NXU3X tag=V1F8XIXRYVPO type=write size=3544635 2024-09-14T11:17:08.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.082+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=H43BE5VL8O58 type=del 2024-09-14T11:17:08.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.084+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=C81DWU1PBT9B type=del size=1440099 2024-09-14T11:17:08.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.085+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=OIWXP8KMBW56 type=del 2024-09-14T11:17:08.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.087+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=6IY3LDF6FVMH type=write size=139226 2024-09-14T11:17:08.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.088+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=EP1ZMH4ZNIZS type=del 2024-09-14T11:17:08.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.090+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~SMJ2EK1U2BAB.0 size=886065 2024-09-14T11:17:08.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.090+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=SMJ2EK1U2BAB tag=HPZQ13G0KJC0 type=write size=1934641 2024-09-14T11:17:08.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.093+0000 7f185d9f8780 1 < suggested update operation key=ZR3IEW48CSCF tag=32BT39BY1MMQ type=del size=4030197 2024-09-14T11:17:08.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.094+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=BQ63MB13C6UI type=del size=1089567 2024-09-14T11:17:08.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.095+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~NPCR8TVT2Y6C.0 size=1048576 2024-09-14T11:17:08.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.097+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~NPCR8TVT2Y6C.1 size=534310 2024-09-14T11:17:08.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.099+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=NPCR8TVT2Y6C tag=FCCTF56CTD6S type=write size=2631462 2024-09-14T11:17:08.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.100+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=0FWB9MZUGI1H type=del size=1420038 2024-09-14T11:17:08.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.102+0000 7f185d9f8780 1 < suggested update operation key=M4FJDW1QHGBM tag=N1CZVHUHVMZE type=del size=661383 2024-09-14T11:17:08.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.103+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=7B570IVSEJW4 type=write size=810444 2024-09-14T11:17:08.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.106+0000 7f185d9f8780 1 < suggested update operation key=830X857XIX9O tag=J0IMGHO91O11 type=del size=3848443 2024-09-14T11:17:08.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.108+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~IIN23WY6X8AC.0 size=1048576 2024-09-14T11:17:08.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.109+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~IIN23WY6X8AC.1 size=739158 2024-09-14T11:17:08.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.109+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=IIN23WY6X8AC tag=SAPU1YXD5TLR type=write size=2836310 2024-09-14T11:17:08.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.110+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~Q7UYO5KHMMD4.0 size=1048576 2024-09-14T11:17:08.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.111+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~Q7UYO5KHMMD4.1 size=277266 2024-09-14T11:17:08.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.113+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=Q7UYO5KHMMD4 tag=B2H2WOKL4KPG type=write size=2374418 2024-09-14T11:17:08.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.114+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=297HG3HO91YP type=del size=3930002 2024-09-14T11:17:08.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.116+0000 7f185d9f8780 1 < suggested update operation key=L4L83NVMXHXZ tag=8O897XYKOJRK type=del size=2468022 2024-09-14T11:17:08.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.119+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~YU5JPS0PZVEM.0 size=1048576 2024-09-14T11:17:08.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.119+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~YU5JPS0PZVEM.1 size=114228 2024-09-14T11:17:08.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.119+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=YU5JPS0PZVEM tag=HDQGRJ3EN0OD type=write size=2211380 2024-09-14T11:17:08.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.121+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=R165051KKVST type=write size=82773 2024-09-14T11:17:08.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.123+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~XNQIBE1HELKK.0 size=273280 2024-09-14T11:17:08.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.123+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=XNQIBE1HELKK tag=0VKI4YWS1J6W type=write size=1321856 2024-09-14T11:17:08.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.124+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~OECS9KIIR12W.0 size=1048576 2024-09-14T11:17:08.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.125+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~OECS9KIIR12W.1 size=1048576 2024-09-14T11:17:08.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.126+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~OECS9KIIR12W.2 size=448495 2024-09-14T11:17:08.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.128+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=OECS9KIIR12W tag=IKX3KBAK0NY7 type=write size=3594223 2024-09-14T11:17:08.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.129+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=ENI8UPN2VQ00 type=del size=1982684 2024-09-14T11:17:08.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.131+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~PWD438EN7XRZ.0 size=1048576 2024-09-14T11:17:08.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.131+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~PWD438EN7XRZ.1 size=1048576 2024-09-14T11:17:08.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.132+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~PWD438EN7XRZ.2 size=964041 2024-09-14T11:17:08.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.134+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=PWD438EN7XRZ tag=1II6WHHUWLG4 type=write size=4109769 2024-09-14T11:17:08.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.135+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=73NVWOZU30G6 type=del size=1481607 2024-09-14T11:17:08.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.136+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~ESOMAYY1753P.0 size=1048576 2024-09-14T11:17:08.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.137+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~ESOMAYY1753P.1 size=1048576 2024-09-14T11:17:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.138+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~ESOMAYY1753P.2 size=110720 2024-09-14T11:17:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.140+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=ESOMAYY1753P tag=Z1CUZF3ZS9ZA type=write size=3256448 2024-09-14T11:17:08.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.141+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=XUB25123JMKS type=del size=735436 2024-09-14T11:17:08.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.144+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=P822RKDJPUNG type=del 2024-09-14T11:17:08.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.145+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=Q0TGTVAOOWB6 type=del size=3009534 2024-09-14T11:17:08.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.146+0000 7f185d9f8780 -1 < failed to complete operation key=830X857XIX9O tag=RWDHBI5OS64R type=del size=3810116: (22) Invalid argument 2024-09-14T11:17:08.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.147+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=MMXSI4E1ZL4E type=del size=2508097 2024-09-14T11:17:08.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.149+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~8ZUF320NXU3X.0 size=1048576 2024-09-14T11:17:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.150+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~8ZUF320NXU3X.1 size=1048576 2024-09-14T11:17:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.150+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~8ZUF320NXU3X.2 size=398907 2024-09-14T11:17:08.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.152+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=8ZUF320NXU3X tag=V1F8XIXRYVPO type=write size=3544635 2024-09-14T11:17:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.154+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~HCPK4WQD3P70.0 size=1048576 2024-09-14T11:17:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.155+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~HCPK4WQD3P70.1 size=1048576 2024-09-14T11:17:08.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.156+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~HCPK4WQD3P70.2 size=548607 2024-09-14T11:17:08.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.156+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=HCPK4WQD3P70 tag=6F037KA2OU6F type=write size=3694335 2024-09-14T11:17:08.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.157+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=C81DWU1PBT9B type=del 2024-09-14T11:17:08.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.160+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~E2N2BOXE010Q.0 size=791577 2024-09-14T11:17:08.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.160+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=E2N2BOXE010Q tag=3YFGRO2Z5JHG type=write size=1840153 2024-09-14T11:17:08.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.162+0000 7f185d9f8780 1 < suggested remove operation key=MPZOX5RU0580 tag=6IY3LDF6FVMH type=write 2024-09-14T11:17:08.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.163+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=Z7SPKG2B2SET type=del size=3970832 2024-09-14T11:17:08.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.165+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~SMJ2EK1U2BAB.0 size=886065 2024-09-14T11:17:08.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.167+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=SMJ2EK1U2BAB tag=HPZQ13G0KJC0 type=write size=1934641 2024-09-14T11:17:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.169+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~IQ4C5S1IUGUA.0 size=1048576 2024-09-14T11:17:08.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.170+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~IQ4C5S1IUGUA.1 size=902279 2024-09-14T11:17:08.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.170+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=IQ4C5S1IUGUA tag=BRN8KMM1CFLB type=write size=2999431 2024-09-14T11:17:08.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.171+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=BQ63MB13C6UI type=del 2024-09-14T11:17:08.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.172+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=YNDLTC6RUR5P type=del size=3243273 2024-09-14T11:17:08.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.173+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=0FWB9MZUGI1H type=del 2024-09-14T11:17:08.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.174+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=DPAR7CQL6CK2 type=write size=961114 2024-09-14T11:17:08.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.176+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=7B570IVSEJW4 type=write size=810444 2024-09-14T11:17:08.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.178+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~DDCSQ5ZZDVLE.0 size=920003 2024-09-14T11:17:08.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.178+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=DDCSQ5ZZDVLE tag=MWK1HL0SL0CQ type=write size=1968579 2024-09-14T11:17:08.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.179+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~IIN23WY6X8AC.0 size=1048576 2024-09-14T11:17:08.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.180+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~IIN23WY6X8AC.1 size=739158 2024-09-14T11:17:08.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.182+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=IIN23WY6X8AC tag=SAPU1YXD5TLR type=write size=2836310 2024-09-14T11:17:08.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.183+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=IV88KWL15LU3 type=del size=3850348 2024-09-14T11:17:08.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.184+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=297HG3HO91YP type=del 2024-09-14T11:17:08.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.186+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~JR2DM7I9D8MW.0 size=1048576 2024-09-14T11:17:08.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.187+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~JR2DM7I9D8MW.1 size=1048576 2024-09-14T11:17:08.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.188+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~JR2DM7I9D8MW.2 size=432766 2024-09-14T11:17:08.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.188+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=JR2DM7I9D8MW tag=H6HPD8RKIR6E type=write size=3578494 2024-09-14T11:17:08.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.189+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~YU5JPS0PZVEM.0 size=1048576 2024-09-14T11:17:08.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.190+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~YU5JPS0PZVEM.1 size=114228 2024-09-14T11:17:08.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.192+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=YU5JPS0PZVEM tag=HDQGRJ3EN0OD type=write size=2211380 2024-09-14T11:17:08.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.195+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~ND59JTQ2DXRW.0 size=387553 2024-09-14T11:17:08.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.195+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=ND59JTQ2DXRW tag=IW705ZO66WRU type=write size=1436129 2024-09-14T11:17:08.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.196+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~XNQIBE1HELKK.0 size=273280 2024-09-14T11:17:08.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.198+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=XNQIBE1HELKK tag=0VKI4YWS1J6W type=write size=1321856 2024-09-14T11:17:08.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.199+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=MVSXB3L73QTI type=del size=2998257 2024-09-14T11:17:08.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.200+0000 7f185d9f8780 -1 < failed to complete operation key=MPZOX5RU0580 tag=ENI8UPN2VQ00 type=del size=1982684: (22) Invalid argument 2024-09-14T11:17:08.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.202+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=CPR9P1M8T2Y1 type=del size=288051 2024-09-14T11:17:08.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.203+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=73NVWOZU30G6 type=del 2024-09-14T11:17:08.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.204+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=4RVB9S8WZBHV type=del size=1828820 2024-09-14T11:17:08.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.205+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=XUB25123JMKS type=del 2024-09-14T11:17:08.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.207+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=BUD5J3UO266I type=write size=854949 2024-09-14T11:17:08.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.209+0000 7f185d9f8780 1 < suggested update operation key=XPMGVU0U52GS tag=Q0TGTVAOOWB6 type=del size=3009534 2024-09-14T11:17:08.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.210+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=I46BE40BYHWF type=del size=1792900 2024-09-14T11:17:08.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.212+0000 7f185d9f8780 1 < suggested remove operation key=IXWIKD7J74RJ tag=MMXSI4E1ZL4E type=del 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.214+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=8PEB9UIUQ72O type=del size=3643791 2024-09-14T11:17:08.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.215+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~HCPK4WQD3P70.0 size=1048576 2024-09-14T11:17:08.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.216+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~HCPK4WQD3P70.1 size=1048576 2024-09-14T11:17:08.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.216+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~HCPK4WQD3P70.2 size=548607 2024-09-14T11:17:08.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.218+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=HCPK4WQD3P70 tag=6F037KA2OU6F type=write size=3694335 2024-09-14T11:17:08.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.219+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=2MMIEHG3QR1O type=del size=2756704 2024-09-14T11:17:08.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.220+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~E2N2BOXE010Q.0 size=791577 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.222+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=E2N2BOXE010Q tag=3YFGRO2Z5JHG type=write size=1840153 2024-09-14T11:17:08.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.224+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~PNOKSZHJHVYF.0 size=886046 2024-09-14T11:17:08.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.224+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=PNOKSZHJHVYF tag=3WV0EV04BIUL type=write size=1934622 2024-09-14T11:17:08.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.226+0000 7f185d9f8780 1 < canceled operation key=SEI774TP8YMJ tag=Z7SPKG2B2SET type=del size=3970832 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.227+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=MWX8VP2N216K type=del size=2112651 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.227+0000 7f185d9f8780 1 < canceled part key=_multipart_PSL63WUBLB75.2~IQ4C5S1IUGUA.0 size=1048576 2024-09-14T11:17:08.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.228+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~IQ4C5S1IUGUA.1 size=902279 2024-09-14T11:17:08.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.230+0000 7f185d9f8780 1 < canceled multipart upload key=PSL63WUBLB75 upload=IQ4C5S1IUGUA tag=BRN8KMM1CFLB type=write size=2999431 2024-09-14T11:17:08.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.232+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~MM1PONVEIW0B.0 size=1022971 2024-09-14T11:17:08.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.232+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=MM1PONVEIW0B tag=1WOB2R1D601V type=write size=2071547 2024-09-14T11:17:08.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.233+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=YNDLTC6RUR5P type=del 2024-09-14T11:17:08.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.234+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=79OB4H6ROOJA type=del size=421937 2024-09-14T11:17:08.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.235+0000 7f185d9f8780 1 < completed write operation key=JL2IH8NEX1YF tag=DPAR7CQL6CK2 type=write size=961114 2024-09-14T11:17:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.237+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~E6NT8BVVDZ5Z.0 size=477973 2024-09-14T11:17:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.237+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=E6NT8BVVDZ5Z tag=TN710LJXHN4W type=write size=1526549 2024-09-14T11:17:08.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.238+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~DDCSQ5ZZDVLE.0 size=920003 2024-09-14T11:17:08.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.240+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=DDCSQ5ZZDVLE tag=MWK1HL0SL0CQ type=write size=1968579 2024-09-14T11:17:08.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.242+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~FJYO5QGTCE2L.0 size=1048576 2024-09-14T11:17:08.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.243+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~FJYO5QGTCE2L.1 size=1048576 2024-09-14T11:17:08.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.244+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~FJYO5QGTCE2L.2 size=855295 2024-09-14T11:17:08.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.244+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=FJYO5QGTCE2L tag=00GX67YC8RP7 type=write size=4001023 2024-09-14T11:17:08.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.246+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=IV88KWL15LU3 type=del size=3850348 2024-09-14T11:17:08.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.248+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~FMK4J5Q6IPFE.0 size=1048576 2024-09-14T11:17:08.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.249+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~FMK4J5Q6IPFE.1 size=1048576 2024-09-14T11:17:08.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.250+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~FMK4J5Q6IPFE.2 size=736935 2024-09-14T11:17:08.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.250+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=FMK4J5Q6IPFE tag=JEB5CXA2YN67 type=write size=3882663 2024-09-14T11:17:08.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.251+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~JR2DM7I9D8MW.0 size=1048576 2024-09-14T11:17:08.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.252+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~JR2DM7I9D8MW.1 size=1048576 2024-09-14T11:17:08.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.253+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~JR2DM7I9D8MW.2 size=432766 2024-09-14T11:17:08.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.255+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=JR2DM7I9D8MW tag=H6HPD8RKIR6E type=write size=3578494 2024-09-14T11:17:08.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.257+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~A8Z1XFH5NME5.0 size=1048576 2024-09-14T11:17:08.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.258+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~A8Z1XFH5NME5.1 size=1048576 2024-09-14T11:17:08.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.259+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~A8Z1XFH5NME5.2 size=810202 2024-09-14T11:17:08.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.259+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=A8Z1XFH5NME5 tag=1FCE307IZOMR type=write size=3955930 2024-09-14T11:17:08.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.260+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~ND59JTQ2DXRW.0 size=387553 2024-09-14T11:17:08.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.262+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=ND59JTQ2DXRW tag=IW705ZO66WRU type=write size=1436129 2024-09-14T11:17:08.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.264+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=0GAG0AUOGPCF type=del size=3209802 2024-09-14T11:17:08.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.265+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=MVSXB3L73QTI type=del 2024-09-14T11:17:08.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.266+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=Y65DC8I4NA90 type=del size=3304214 2024-09-14T11:17:08.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.267+0000 7f185d9f8780 -1 < failed to complete operation key=IXWIKD7J74RJ tag=CPR9P1M8T2Y1 type=del size=288051: (22) Invalid argument 2024-09-14T11:17:08.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.268+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=JNW37UMSH9TI type=del size=3578328 2024-09-14T11:17:08.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.270+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=4RVB9S8WZBHV type=del 2024-09-14T11:17:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.271+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=23AS3TM1H6ZA type=write size=898875 2024-09-14T11:17:08.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.273+0000 7f185d9f8780 1 < completed write operation key=JL2IH8NEX1YF tag=BUD5J3UO266I type=write size=854949 2024-09-14T11:17:08.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.274+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=P7GGKQWCEO0X type=del size=232627 2024-09-14T11:17:08.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.275+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=I46BE40BYHWF type=del 2024-09-14T11:17:08.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.277+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~65BHS5M1UYCY.0 size=283 2024-09-14T11:17:08.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.277+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=65BHS5M1UYCY tag=I2BBVR398IBM type=write size=1048859 2024-09-14T11:17:08.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.279+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=8PEB9UIUQ72O type=del 2024-09-14T11:17:08.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.281+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~X464QLIJQTCG.0 size=1048576 2024-09-14T11:17:08.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.282+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~X464QLIJQTCG.1 size=303630 2024-09-14T11:17:08.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.282+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=X464QLIJQTCG tag=9N6RYYWQDHZR type=write size=2400782 2024-09-14T11:17:08.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.283+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=2MMIEHG3QR1O type=del 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.284+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=81C4JW55657W type=del size=467839 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.284+0000 7f185d9f8780 1 < canceled part key=_multipart_OYZIXCSGXTHR.2~PNOKSZHJHVYF.0 size=886046 2024-09-14T11:17:08.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.286+0000 7f185d9f8780 1 < canceled multipart upload key=OYZIXCSGXTHR upload=PNOKSZHJHVYF tag=3WV0EV04BIUL type=write size=1934622 2024-09-14T11:17:08.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.289+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~LP7TNF2QT25M.0 size=784029 2024-09-14T11:17:08.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.289+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=LP7TNF2QT25M tag=P8CCL3V3R4G9 type=write size=1832605 2024-09-14T11:17:08.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.290+0000 7f185d9f8780 1 < canceled operation key=PSL63WUBLB75 tag=MWX8VP2N216K type=del size=2112651 2024-09-14T11:17:08.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.291+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=J5HD4QLIYQH6 type=del size=4025187 2024-09-14T11:17:08.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.292+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~MM1PONVEIW0B.0 size=1022971 2024-09-14T11:17:08.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.294+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=MM1PONVEIW0B tag=1WOB2R1D601V type=write size=2071547 2024-09-14T11:17:08.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.295+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=YGFG5DWLNOM1 type=del size=4172718 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.297+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=79OB4H6ROOJA type=del 2024-09-14T11:17:08.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.298+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=UV2MT8O98RC9 type=del size=711214 2024-09-14T11:17:08.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.299+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~E6NT8BVVDZ5Z.0 size=477973 2024-09-14T11:17:08.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.301+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=E6NT8BVVDZ5Z tag=TN710LJXHN4W type=write size=1526549 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.302+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=WUEZ493V7P43 type=del size=3801275 2024-09-14T11:17:08.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.303+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~FJYO5QGTCE2L.0 size=1048576 2024-09-14T11:17:08.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.304+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~FJYO5QGTCE2L.1 size=1048576 2024-09-14T11:17:08.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.305+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~FJYO5QGTCE2L.2 size=855295 2024-09-14T11:17:08.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.308+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=FJYO5QGTCE2L tag=00GX67YC8RP7 type=write size=4001023 2024-09-14T11:17:08.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.310+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~KVMWKPU8EANP.0 size=1048576 2024-09-14T11:17:08.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.311+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~KVMWKPU8EANP.1 size=990763 2024-09-14T11:17:08.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.311+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=KVMWKPU8EANP tag=CHMOKCQN6Q54 type=write size=3087915 2024-09-14T11:17:08.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.312+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~FMK4J5Q6IPFE.0 size=1048576 2024-09-14T11:17:08.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.313+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~FMK4J5Q6IPFE.1 size=1048576 2024-09-14T11:17:08.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.314+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~FMK4J5Q6IPFE.2 size=736935 2024-09-14T11:17:08.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.316+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=FMK4J5Q6IPFE tag=JEB5CXA2YN67 type=write size=3882663 2024-09-14T11:17:08.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.319+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~WZLLCWAG8M6C.0 size=1048576 2024-09-14T11:17:08.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.319+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~WZLLCWAG8M6C.1 size=818340 2024-09-14T11:17:08.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.319+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=WZLLCWAG8M6C tag=GCU9IJ3I5VB5 type=write size=2915492 2024-09-14T11:17:08.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.321+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~A8Z1XFH5NME5.0 size=1048576 2024-09-14T11:17:08.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.322+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~A8Z1XFH5NME5.1 size=1048576 2024-09-14T11:17:08.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.323+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~A8Z1XFH5NME5.2 size=810202 2024-09-14T11:17:08.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.325+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=A8Z1XFH5NME5 tag=1FCE307IZOMR type=write size=3955930 2024-09-14T11:17:08.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.326+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=B55ISGCBWZ44 type=write size=930812 2024-09-14T11:17:08.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.327+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=0GAG0AUOGPCF type=del 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.328+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=NV5MYG7ZKYR2 type=del size=1378951 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.330+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=Y65DC8I4NA90 type=del 2024-09-14T11:17:08.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.332+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~M8712JTLEH6F.0 size=1048576 2024-09-14T11:17:08.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.333+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~M8712JTLEH6F.1 size=1048576 2024-09-14T11:17:08.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.334+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~M8712JTLEH6F.2 size=875622 2024-09-14T11:17:08.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.334+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=M8712JTLEH6F tag=S2VTCFVMK9V9 type=write size=4021350 2024-09-14T11:17:08.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.335+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=JNW37UMSH9TI type=del 2024-09-14T11:17:08.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.336+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=4RCBWXXT5SUU type=del size=3739391 2024-09-14T11:17:08.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.337+0000 7f185d9f8780 1 < completed write operation key=OYZIXCSGXTHR tag=23AS3TM1H6ZA type=write size=898875 2024-09-14T11:17:08.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.338+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=F1B804HQ4FK3 type=del size=3660072 2024-09-14T11:17:08.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.339+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=P7GGKQWCEO0X type=del 2024-09-14T11:17:08.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.341+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~3Q8S0J1ST4Q9.0 size=1048576 2024-09-14T11:17:08.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.342+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~3Q8S0J1ST4Q9.1 size=1048576 2024-09-14T11:17:08.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.343+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~3Q8S0J1ST4Q9.2 size=467279 2024-09-14T11:17:08.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.343+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=3Q8S0J1ST4Q9 tag=NB8W351Q4CK3 type=write size=3613007 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.345+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~65BHS5M1UYCY.0 size=283 2024-09-14T11:17:08.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.346+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=65BHS5M1UYCY tag=I2BBVR398IBM type=write size=1048859 2024-09-14T11:17:08.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.348+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=UM5JRWXXWENP type=del size=3560208 2024-09-14T11:17:08.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.349+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~X464QLIJQTCG.0 size=1048576 2024-09-14T11:17:08.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.350+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~X464QLIJQTCG.1 size=303630 2024-09-14T11:17:08.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.352+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=X464QLIJQTCG tag=9N6RYYWQDHZR type=write size=2400782 2024-09-14T11:17:08.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.353+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=1Q2IN3QA6Q7T type=del size=3268071 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.354+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=81C4JW55657W type=del 2024-09-14T11:17:08.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.356+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~3EP9I2N5C161.0 size=435020 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.356+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=3EP9I2N5C161 tag=8SNAR1ZIICG2 type=write size=1483596 2024-09-14T11:17:08.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.358+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~LP7TNF2QT25M.0 size=784029 2024-09-14T11:17:08.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.360+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=LP7TNF2QT25M tag=P8CCL3V3R4G9 type=write size=1832605 2024-09-14T11:17:08.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.361+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=9GXTR67JV3SI type=del size=584039 2024-09-14T11:17:08.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.362+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=J5HD4QLIYQH6 type=del 2024-09-14T11:17:08.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.364+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=MEF0QY0LIZ4B type=write size=826147 2024-09-14T11:17:08.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.365+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=YGFG5DWLNOM1 type=del 2024-09-14T11:17:08.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.366+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=AZL2ZIFEY4KH type=del size=1347298 2024-09-14T11:17:08.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.368+0000 7f185d9f8780 1 < suggested remove operation key=1BOZ331NA7JA tag=UV2MT8O98RC9 type=del 2024-09-14T11:17:08.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.370+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=EJ3CW9BQIXIY type=write size=624469 2024-09-14T11:17:08.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.371+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=WUEZ493V7P43 type=del 2024-09-14T11:17:08.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.372+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=U52MJL062473 type=del size=3080351 2024-09-14T11:17:08.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.373+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~KVMWKPU8EANP.0 size=1048576 2024-09-14T11:17:08.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.374+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~KVMWKPU8EANP.1 size=990763 2024-09-14T11:17:08.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.376+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=KVMWKPU8EANP tag=CHMOKCQN6Q54 type=write size=3087915 2024-09-14T11:17:08.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.377+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=HY9MGZLMHAN9 type=del size=300670 2024-09-14T11:17:08.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.378+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~WZLLCWAG8M6C.0 size=1048576 2024-09-14T11:17:08.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.379+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~WZLLCWAG8M6C.1 size=818340 2024-09-14T11:17:08.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.382+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=WZLLCWAG8M6C tag=GCU9IJ3I5VB5 type=write size=2915492 2024-09-14T11:17:08.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.384+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=818ODD94KUBV type=del size=3849312 2024-09-14T11:17:08.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.385+0000 7f185d9f8780 1 < completed write operation key=DAKWA1OCVTBG tag=B55ISGCBWZ44 type=write size=930812 2024-09-14T11:17:08.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.387+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~A67ULV0ZVCR5.0 size=1048576 2024-09-14T11:17:08.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.388+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~A67ULV0ZVCR5.1 size=1048576 2024-09-14T11:17:08.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.389+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~A67ULV0ZVCR5.2 size=288609 2024-09-14T11:17:08.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.389+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=A67ULV0ZVCR5 tag=X1RTB7XX8TZA type=write size=3434337 2024-09-14T11:17:08.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.390+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=NV5MYG7ZKYR2 type=del 2024-09-14T11:17:08.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.391+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=2JOO4NRAI4U0 type=del size=1319402 2024-09-14T11:17:08.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.392+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~M8712JTLEH6F.0 size=1048576 2024-09-14T11:17:08.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.393+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~M8712JTLEH6F.1 size=1048576 2024-09-14T11:17:08.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.394+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~M8712JTLEH6F.2 size=875622 2024-09-14T11:17:08.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.396+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=M8712JTLEH6F tag=S2VTCFVMK9V9 type=write size=4021350 2024-09-14T11:17:08.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.397+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=LB1KVWW0L7J0 type=write size=670634 2024-09-14T11:17:08.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.399+0000 7f185d9f8780 1 < canceled operation key=PSL63WUBLB75 tag=4RCBWXXT5SUU type=del size=3739391 2024-09-14T11:17:08.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.401+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~IJNAPD1MYF8J.0 size=1048576 2024-09-14T11:17:08.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.402+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~IJNAPD1MYF8J.1 size=1048576 2024-09-14T11:17:08.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.402+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~IJNAPD1MYF8J.2 size=459440 2024-09-14T11:17:08.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.402+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=IJNAPD1MYF8J tag=0FBTWZHKN5F2 type=write size=3605168 2024-09-14T11:17:08.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.404+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=F1B804HQ4FK3 type=del size=3660072 2024-09-14T11:17:08.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.405+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=8R6HQMXAK6PU type=del size=2552408 2024-09-14T11:17:08.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.406+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~3Q8S0J1ST4Q9.0 size=1048576 2024-09-14T11:17:08.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.407+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~3Q8S0J1ST4Q9.1 size=1048576 2024-09-14T11:17:08.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.408+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~3Q8S0J1ST4Q9.2 size=467279 2024-09-14T11:17:08.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.410+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=3Q8S0J1ST4Q9 tag=NB8W351Q4CK3 type=write size=3613007 2024-09-14T11:17:08.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.411+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=0W1HW94MV747 type=del size=177202 2024-09-14T11:17:08.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.413+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=UM5JRWXXWENP type=del 2024-09-14T11:17:08.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.415+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~Q7V76ND3RC0F.0 size=542674 2024-09-14T11:17:08.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.415+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=Q7V76ND3RC0F tag=WHAVVDU1QCRP type=write size=1591250 2024-09-14T11:17:08.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.416+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=1Q2IN3QA6Q7T type=del 2024-09-14T11:17:08.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.417+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=MR4MGSH4F7XK type=del size=1448478 2024-09-14T11:17:08.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.418+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~3EP9I2N5C161.0 size=435020 2024-09-14T11:17:08.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.421+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=3EP9I2N5C161 tag=8SNAR1ZIICG2 type=write size=1483596 2024-09-14T11:17:08.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.423+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~H6YTRR0GY2OJ.0 size=1048576 2024-09-14T11:17:08.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.424+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~H6YTRR0GY2OJ.1 size=188802 2024-09-14T11:17:08.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.424+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=H6YTRR0GY2OJ tag=XF98JWJ3PF2T type=write size=2285954 2024-09-14T11:17:08.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.427+0000 7f185d9f8780 1 < suggested update operation key=087PN6V1BP65 tag=9GXTR67JV3SI type=del size=584039 2024-09-14T11:17:08.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.429+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=P250V5OMRCIN type=del size=1855974 2024-09-14T11:17:08.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.430+0000 7f185d9f8780 1 < completed write operation key=MPZOX5RU0580 tag=MEF0QY0LIZ4B type=write size=826147 2024-09-14T11:17:08.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.432+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~PPGR5TY5GFQ8.0 size=1048576 2024-09-14T11:17:08.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.433+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~PPGR5TY5GFQ8.1 size=1048576 2024-09-14T11:17:08.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.434+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~PPGR5TY5GFQ8.2 size=382009 2024-09-14T11:17:08.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.434+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=PPGR5TY5GFQ8 tag=M4CA5KHU599Y type=write size=3527737 2024-09-14T11:17:08.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.435+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=AZL2ZIFEY4KH type=del 2024-09-14T11:17:08.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.436+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=V1CT9RFD7MAK type=del size=3645608 2024-09-14T11:17:08.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.437+0000 7f185d9f8780 -1 < failed to complete operation key=087PN6V1BP65 tag=EJ3CW9BQIXIY type=write size=624469: (22) Invalid argument 2024-09-14T11:17:08.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.439+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=FNEU0HN2PAMA type=del size=2955759 2024-09-14T11:17:08.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.440+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=U52MJL062473 type=del 2024-09-14T11:17:08.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.441+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=4K48W81SE6LI type=del size=4100645 2024-09-14T11:17:08.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.442+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=HY9MGZLMHAN9 type=del 2024-09-14T11:17:08.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.444+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=WUH3XAHK24FW type=write size=1020959 2024-09-14T11:17:08.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.445+0000 7f185d9f8780 1 < canceled operation key=LGLAG80GX8GF tag=818ODD94KUBV type=del size=3849312 2024-09-14T11:17:08.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.446+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=5XCNGA32Q9Q6 type=del size=2064200 2024-09-14T11:17:08.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.447+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~A67ULV0ZVCR5.0 size=1048576 2024-09-14T11:17:08.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.448+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~A67ULV0ZVCR5.1 size=1048576 2024-09-14T11:17:08.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.449+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~A67ULV0ZVCR5.2 size=288609 2024-09-14T11:17:08.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.452+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=A67ULV0ZVCR5 tag=X1RTB7XX8TZA type=write size=3434337 2024-09-14T11:17:08.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.453+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=6VC3R0XG0A7O type=write size=10581 2024-09-14T11:17:08.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.454+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=2JOO4NRAI4U0 type=del 2024-09-14T11:17:08.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.456+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~SJ3HPZM4RAFW.0 size=1048576 2024-09-14T11:17:08.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.457+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~SJ3HPZM4RAFW.1 size=613441 2024-09-14T11:17:08.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.457+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=SJ3HPZM4RAFW tag=0JCG6SOC1672 type=write size=2710593 2024-09-14T11:17:08.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.459+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=LB1KVWW0L7J0 type=write size=670634 2024-09-14T11:17:08.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.461+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~GSJBXQGZB088.0 size=1048576 2024-09-14T11:17:08.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.462+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~GSJBXQGZB088.1 size=833785 2024-09-14T11:17:08.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.462+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=GSJBXQGZB088 tag=K03ZXT73MIJT type=write size=2930937 2024-09-14T11:17:08.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.463+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~IJNAPD1MYF8J.0 size=1048576 2024-09-14T11:17:08.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.464+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~IJNAPD1MYF8J.1 size=1048576 2024-09-14T11:17:08.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.464+0000 7f185d9f8780 1 < canceled part key=_multipart_J6RN3WULDLQE.2~IJNAPD1MYF8J.2 size=459440 2024-09-14T11:17:08.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.466+0000 7f185d9f8780 1 < canceled multipart upload key=J6RN3WULDLQE upload=IJNAPD1MYF8J tag=0FBTWZHKN5F2 type=write size=3605168 2024-09-14T11:17:08.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.467+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=UR8ZIJX025NQ type=del size=3961735 2024-09-14T11:17:08.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.469+0000 7f185d9f8780 1 < canceled operation key=ZR3IEW48CSCF tag=8R6HQMXAK6PU type=del size=2552408 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.470+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=F6OZZ5UHKGU0 type=del size=862607 2024-09-14T11:17:08.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.471+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=0W1HW94MV747 type=del 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.473+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=GK1A7S7FZ86N type=del size=989749 2024-09-14T11:17:08.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.474+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~Q7V76ND3RC0F.0 size=542674 2024-09-14T11:17:08.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.476+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=Q7V76ND3RC0F tag=WHAVVDU1QCRP type=write size=1591250 2024-09-14T11:17:08.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.478+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~V448OOM5Q795.0 size=1048576 2024-09-14T11:17:08.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.479+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~V448OOM5Q795.1 size=1048576 2024-09-14T11:17:08.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.480+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~V448OOM5Q795.2 size=222064 2024-09-14T11:17:08.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.480+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=V448OOM5Q795 tag=RGIM1Z6AG206 type=write size=3367792 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.481+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=MR4MGSH4F7XK type=del 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.484+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~I3UEOGQ0V3E2.0 size=812767 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.484+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=I3UEOGQ0V3E2 tag=NOV1FUJ5Y5F6 type=write size=1861343 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.484+0000 7f185d9f8780 1 < canceled part key=_multipart_N040R6OERAJP.2~H6YTRR0GY2OJ.0 size=1048576 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.485+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~H6YTRR0GY2OJ.1 size=188802 2024-09-14T11:17:08.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.487+0000 7f185d9f8780 1 < canceled multipart upload key=N040R6OERAJP upload=H6YTRR0GY2OJ tag=XF98JWJ3PF2T type=write size=2285954 2024-09-14T11:17:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.488+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=XNZR7T0NUZFB type=del size=120198 2024-09-14T11:17:08.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.490+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=P250V5OMRCIN type=del 2024-09-14T11:17:08.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.491+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=TQUMRPI5JTXG type=del size=2814435 2024-09-14T11:17:08.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.492+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~PPGR5TY5GFQ8.0 size=1048576 2024-09-14T11:17:08.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.493+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~PPGR5TY5GFQ8.1 size=1048576 2024-09-14T11:17:08.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.494+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~PPGR5TY5GFQ8.2 size=382009 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.497+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=PPGR5TY5GFQ8 tag=M4CA5KHU599Y type=write size=3527737 2024-09-14T11:17:08.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.498+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=N3GI6TRO15FK type=del size=3852915 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.499+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=V1CT9RFD7MAK type=del 2024-09-14T11:17:08.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.500+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=914QHJPHD7MA type=del size=301576 2024-09-14T11:17:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.502+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=FNEU0HN2PAMA type=del size=2955759 2024-09-14T11:17:08.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.504+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~ASDMCVKG7OJH.0 size=156757 2024-09-14T11:17:08.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.504+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=ASDMCVKG7OJH tag=5Y6LHVVYC034 type=write size=1205333 2024-09-14T11:17:08.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.505+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=4K48W81SE6LI type=del 2024-09-14T11:17:08.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.507+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~R7N5H9BE58Y3.0 size=1048576 2024-09-14T11:17:08.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.508+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~R7N5H9BE58Y3.1 size=1048576 2024-09-14T11:17:08.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.509+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~R7N5H9BE58Y3.2 size=210687 2024-09-14T11:17:08.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.509+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=R7N5H9BE58Y3 tag=ZTAF5ENAFDB9 type=write size=3356415 2024-09-14T11:17:08.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.511+0000 7f185d9f8780 1 < suggested remove operation key=WPBYTFP7HRVE tag=WUH3XAHK24FW type=write 2024-09-14T11:17:08.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.512+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=QUPIU3E4FUYO type=del size=1766948 2024-09-14T11:17:08.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.514+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=5XCNGA32Q9Q6 type=del 2024-09-14T11:17:08.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.516+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~2V8IUJL812OB.0 size=1048576 2024-09-14T11:17:08.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.517+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~2V8IUJL812OB.1 size=615210 2024-09-14T11:17:08.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.517+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=2V8IUJL812OB tag=2KIX0YZL77JP type=write size=2712362 2024-09-14T11:17:08.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.518+0000 7f185d9f8780 1 < completed write operation key=L4L83NVMXHXZ tag=6VC3R0XG0A7O type=write size=10581 2024-09-14T11:17:08.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.520+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=HJ7Q8YO6JS35 type=del size=2851769 2024-09-14T11:17:08.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.520+0000 7f185d9f8780 1 < canceled part key=_multipart_WPBYTFP7HRVE.2~SJ3HPZM4RAFW.0 size=1048576 2024-09-14T11:17:08.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.521+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~SJ3HPZM4RAFW.1 size=613441 2024-09-14T11:17:08.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.523+0000 7f185d9f8780 1 < canceled multipart upload key=WPBYTFP7HRVE upload=SJ3HPZM4RAFW tag=0JCG6SOC1672 type=write size=2710593 2024-09-14T11:17:08.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.525+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~YO1BF2AGXHBG.0 size=762662 2024-09-14T11:17:08.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.525+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=YO1BF2AGXHBG tag=IWYQ3K6R9G14 type=write size=1811238 2024-09-14T11:17:08.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.526+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~GSJBXQGZB088.0 size=1048576 2024-09-14T11:17:08.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.526+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~GSJBXQGZB088.1 size=833785 2024-09-14T11:17:08.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.528+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=GSJBXQGZB088 tag=K03ZXT73MIJT type=write size=2930937 2024-09-14T11:17:08.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.530+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=4EMVG39X5ZQ8 type=del size=214047 2024-09-14T11:17:08.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.531+0000 7f185d9f8780 1 < canceled operation key=H29SXBS4N9JK tag=UR8ZIJX025NQ type=del size=3961735 2024-09-14T11:17:08.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.533+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~48EYCYZAHIYZ.0 size=1048576 2024-09-14T11:17:08.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.534+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~48EYCYZAHIYZ.1 size=624378 2024-09-14T11:17:08.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.534+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=48EYCYZAHIYZ tag=Q1LS0O0H7JGC type=write size=2721530 2024-09-14T11:17:08.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.536+0000 7f185d9f8780 1 < suggested update operation key=7XGG5LBGRI4H tag=F6OZZ5UHKGU0 type=del size=862607 2024-09-14T11:17:08.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.538+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=N1WYFBAECCA8 type=write size=653455 2024-09-14T11:17:08.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.539+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=GK1A7S7FZ86N type=del 2024-09-14T11:17:08.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.541+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~1YV112HX6J48.0 size=1048576 2024-09-14T11:17:08.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.542+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~1YV112HX6J48.1 size=1048576 2024-09-14T11:17:08.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.543+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~1YV112HX6J48.2 size=822604 2024-09-14T11:17:08.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.543+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=1YV112HX6J48 tag=B3CVMLTJ7VHP type=write size=3968332 2024-09-14T11:17:08.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.544+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~V448OOM5Q795.0 size=1048576 2024-09-14T11:17:08.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.545+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~V448OOM5Q795.1 size=1048576 2024-09-14T11:17:08.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.546+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~V448OOM5Q795.2 size=222064 2024-09-14T11:17:08.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.548+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=V448OOM5Q795 tag=RGIM1Z6AG206 type=write size=3367792 2024-09-14T11:17:08.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.550+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~0OPOACG37F03.0 size=1048576 2024-09-14T11:17:08.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.551+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~0OPOACG37F03.1 size=531841 2024-09-14T11:17:08.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.551+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=0OPOACG37F03 tag=VUZ23FIYHT3S type=write size=2628993 2024-09-14T11:17:08.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.551+0000 7f185d9f8780 1 < canceled part key=_multipart_IXWIKD7J74RJ.2~I3UEOGQ0V3E2.0 size=812767 2024-09-14T11:17:08.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.553+0000 7f185d9f8780 1 < canceled multipart upload key=IXWIKD7J74RJ upload=I3UEOGQ0V3E2 tag=NOV1FUJ5Y5F6 type=write size=1861343 2024-09-14T11:17:08.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.554+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=CZ0M7RZ1JF9A type=del size=1081675 2024-09-14T11:17:08.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.556+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=XNZR7T0NUZFB type=del 2024-09-14T11:17:08.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.557+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=VFW03535RO7X type=del size=1208189 2024-09-14T11:17:08.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.558+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=TQUMRPI5JTXG type=del 2024-09-14T11:17:08.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.559+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=RDGJ6TCKHTTC type=del size=1655368 2024-09-14T11:17:08.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.561+0000 7f185d9f8780 1 < suggested remove operation key=XPMGVU0U52GS tag=N3GI6TRO15FK type=del 2024-09-14T11:17:08.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.564+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~JU2XDX7XAZIM.0 size=1048576 2024-09-14T11:17:08.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.565+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~JU2XDX7XAZIM.1 size=1048576 2024-09-14T11:17:08.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.566+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~JU2XDX7XAZIM.2 size=227319 2024-09-14T11:17:08.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.566+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=JU2XDX7XAZIM tag=GPTQP4P35YUD type=write size=3373047 2024-09-14T11:17:08.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.567+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=914QHJPHD7MA type=del 2024-09-14T11:17:08.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.568+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=UU3LQYJE2DA5 type=del size=1310488 2024-09-14T11:17:08.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.568+0000 7f185d9f8780 1 < canceled part key=_multipart_1BOZ331NA7JA.2~ASDMCVKG7OJH.0 size=156757 2024-09-14T11:17:08.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.570+0000 7f185d9f8780 1 < canceled multipart upload key=1BOZ331NA7JA upload=ASDMCVKG7OJH tag=5Y6LHVVYC034 type=write size=1205333 2024-09-14T11:17:08.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.573+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~5DKAPCC0JAIE.0 size=1048576 2024-09-14T11:17:08.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.574+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~5DKAPCC0JAIE.1 size=1048576 2024-09-14T11:17:08.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.575+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~5DKAPCC0JAIE.2 size=216994 2024-09-14T11:17:08.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.575+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=5DKAPCC0JAIE tag=O9L9HZ1GXR1W type=write size=3362722 2024-09-14T11:17:08.574 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.576+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~R7N5H9BE58Y3.0 size=1048576 2024-09-14T11:17:08.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.577+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~R7N5H9BE58Y3.1 size=1048576 2024-09-14T11:17:08.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.578+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~R7N5H9BE58Y3.2 size=210687 2024-09-14T11:17:08.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.580+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=R7N5H9BE58Y3 tag=ZTAF5ENAFDB9 type=write size=3356415 2024-09-14T11:17:08.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.581+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=SS1IT2K42N7K type=write size=250688 2024-09-14T11:17:08.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.583+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=QUPIU3E4FUYO type=del 2024-09-14T11:17:08.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.584+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=YMK8VXS5NCKH type=del size=2437199 2024-09-14T11:17:08.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.584+0000 7f185d9f8780 1 < canceled part key=_multipart_LGLAG80GX8GF.2~2V8IUJL812OB.0 size=1048576 2024-09-14T11:17:08.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.585+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~2V8IUJL812OB.1 size=615210 2024-09-14T11:17:08.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.587+0000 7f185d9f8780 1 < canceled multipart upload key=LGLAG80GX8GF upload=2V8IUJL812OB tag=2KIX0YZL77JP type=write size=2712362 2024-09-14T11:17:08.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.589+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=U3F2KI8VN0VC type=write size=405672 2024-09-14T11:17:08.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.590+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=HJ7Q8YO6JS35 type=del 2024-09-14T11:17:08.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.591+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=823SSF32E6DE type=del size=2416501 2024-09-14T11:17:08.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.592+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~YO1BF2AGXHBG.0 size=762662 2024-09-14T11:17:08.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.594+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=YO1BF2AGXHBG tag=IWYQ3K6R9G14 type=write size=1811238 2024-09-14T11:17:08.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.597+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~69QIEGQBX64D.0 size=1048576 2024-09-14T11:17:08.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.598+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~69QIEGQBX64D.1 size=760639 2024-09-14T11:17:08.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.598+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=69QIEGQBX64D tag=R4RPKCPPG0D4 type=write size=2857791 2024-09-14T11:17:08.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.599+0000 7f185d9f8780 1 < canceled operation key=087PN6V1BP65 tag=4EMVG39X5ZQ8 type=del size=214047 2024-09-14T11:17:08.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.600+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=6BHH1856LUGT type=del size=3751470 2024-09-14T11:17:08.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.601+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~48EYCYZAHIYZ.0 size=1048576 2024-09-14T11:17:08.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.602+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~48EYCYZAHIYZ.1 size=624378 2024-09-14T11:17:08.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.604+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=48EYCYZAHIYZ tag=Q1LS0O0H7JGC type=write size=2721530 2024-09-14T11:17:08.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.607+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~ZC68WVD4N5VX.0 size=1048576 2024-09-14T11:17:08.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.608+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~ZC68WVD4N5VX.1 size=1048576 2024-09-14T11:17:08.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.609+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~ZC68WVD4N5VX.2 size=732051 2024-09-14T11:17:08.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.609+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=ZC68WVD4N5VX tag=9Z4OMHDAK1HD type=write size=3877779 2024-09-14T11:17:08.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.612+0000 7f185d9f8780 1 < suggested remove operation key=N040R6OERAJP tag=N1WYFBAECCA8 type=write 2024-09-14T11:17:08.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.614+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=5C3WNFSTNKFF type=del size=2745273 2024-09-14T11:17:08.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.614+0000 7f185d9f8780 1 < canceled part key=_multipart_H29SXBS4N9JK.2~1YV112HX6J48.0 size=1048576 2024-09-14T11:17:08.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.615+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~1YV112HX6J48.1 size=1048576 2024-09-14T11:17:08.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.616+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~1YV112HX6J48.2 size=822604 2024-09-14T11:17:08.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.618+0000 7f185d9f8780 1 < canceled multipart upload key=H29SXBS4N9JK upload=1YV112HX6J48 tag=B3CVMLTJ7VHP type=write size=3968332 2024-09-14T11:17:08.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.619+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=VWIMT2QBI2VA type=write size=470565 2024-09-14T11:17:08.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.620+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~0OPOACG37F03.0 size=1048576 2024-09-14T11:17:08.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.621+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~0OPOACG37F03.1 size=531841 2024-09-14T11:17:08.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.623+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=0OPOACG37F03 tag=VUZ23FIYHT3S type=write size=2628993 2024-09-14T11:17:08.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.625+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=JOQ0IX58V447 type=write size=135 2024-09-14T11:17:08.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.626+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=CZ0M7RZ1JF9A type=del 2024-09-14T11:17:08.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.628+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~989PTGK2U1VP.0 size=1011865 2024-09-14T11:17:08.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.628+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=989PTGK2U1VP tag=HTPWFJ0R204E type=write size=2060441 2024-09-14T11:17:08.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.630+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=VFW03535RO7X type=del 2024-09-14T11:17:08.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.632+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=27OH74LF0M9K type=del size=2658575 2024-09-14T11:17:08.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.633+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=RDGJ6TCKHTTC type=del 2024-09-14T11:17:08.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.634+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=ZTIHF7BIW1VE type=del size=2332559 2024-09-14T11:17:08.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.635+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~JU2XDX7XAZIM.0 size=1048576 2024-09-14T11:17:08.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.636+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~JU2XDX7XAZIM.1 size=1048576 2024-09-14T11:17:08.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.637+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~JU2XDX7XAZIM.2 size=227319 2024-09-14T11:17:08.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.639+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=JU2XDX7XAZIM tag=GPTQP4P35YUD type=write size=3373047 2024-09-14T11:17:08.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.641+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~WCSIL1PQY0JV.0 size=265347 2024-09-14T11:17:08.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.641+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=WCSIL1PQY0JV tag=PF0D50Q6GW90 type=write size=1313923 2024-09-14T11:17:08.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.642+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=UU3LQYJE2DA5 type=del 2024-09-14T11:17:08.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.643+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=HV8YR862Z7K8 type=del size=1675160 2024-09-14T11:17:08.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.645+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~5DKAPCC0JAIE.0 size=1048576 2024-09-14T11:17:08.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.645+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~5DKAPCC0JAIE.1 size=1048576 2024-09-14T11:17:08.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.646+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~5DKAPCC0JAIE.2 size=216994 2024-09-14T11:17:08.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.648+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=5DKAPCC0JAIE tag=O9L9HZ1GXR1W type=write size=3362722 2024-09-14T11:17:08.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.650+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=X47DNN9AICQU type=write size=712221 2024-09-14T11:17:08.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.651+0000 7f185d9f8780 1 < completed write operation key=55K4D3SEM068 tag=SS1IT2K42N7K type=write size=250688 2024-09-14T11:17:08.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.653+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~6H97I9VQ6YQB.0 size=206117 2024-09-14T11:17:08.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.653+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=6H97I9VQ6YQB tag=YON92UDVXVC0 type=write size=1254693 2024-09-14T11:17:08.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.654+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=YMK8VXS5NCKH type=del 2024-09-14T11:17:08.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.657+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~FDHRF180U8LC.0 size=629780 2024-09-14T11:17:08.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.657+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=FDHRF180U8LC tag=BHWKQMHNXNIF type=write size=1678356 2024-09-14T11:17:08.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.659+0000 7f185d9f8780 1 < suggested remove operation key=MPZOX5RU0580 tag=U3F2KI8VN0VC type=write 2024-09-14T11:17:08.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.660+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=RZXHYJYR01YG type=del size=1892597 2024-09-14T11:17:08.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.662+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=823SSF32E6DE type=del size=2416501 2024-09-14T11:17:08.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.663+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=DMNI4TD6SK47 type=del size=742838 2024-09-14T11:17:08.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.664+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~69QIEGQBX64D.0 size=1048576 2024-09-14T11:17:08.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.665+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~69QIEGQBX64D.1 size=760639 2024-09-14T11:17:08.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.667+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=69QIEGQBX64D tag=R4RPKCPPG0D4 type=write size=2857791 2024-09-14T11:17:08.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.669+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=SJO8K1RFHEEM type=del size=1866716 2024-09-14T11:17:08.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.670+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=6BHH1856LUGT type=del 2024-09-14T11:17:08.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.671+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=X77UJVVXLYPG type=del size=3383810 2024-09-14T11:17:08.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.673+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~ZC68WVD4N5VX.0 size=1048576 2024-09-14T11:17:08.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.673+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~ZC68WVD4N5VX.1 size=1048576 2024-09-14T11:17:08.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.673+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~ZC68WVD4N5VX.2 size=732051 2024-09-14T11:17:08.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.676+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=ZC68WVD4N5VX tag=9Z4OMHDAK1HD type=write size=3877779 2024-09-14T11:17:08.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.677+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=J4SU3FEWR4E7 type=del size=2217691 2024-09-14T11:17:08.678 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.680+0000 7f185d9f8780 1 < suggested update operation key=N040R6OERAJP tag=5C3WNFSTNKFF type=del size=2745273 2024-09-14T11:17:08.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.681+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=BRU25Q10F5FM type=del size=1348130 2024-09-14T11:17:08.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.682+0000 7f185d9f8780 1 < completed write operation key=DAKWA1OCVTBG tag=VWIMT2QBI2VA type=write size=470565 2024-09-14T11:17:08.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.684+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=5KITY68X6BCK type=write size=684226 2024-09-14T11:17:08.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.685+0000 7f185d9f8780 -1 < failed to complete operation key=6MZGLP5KPPB3 tag=JOQ0IX58V447 type=write size=135: (22) Invalid argument 2024-09-14T11:17:08.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.687+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~8ZNQ0V5OGIAX.0 size=1048576 2024-09-14T11:17:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.688+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~8ZNQ0V5OGIAX.1 size=888086 2024-09-14T11:17:08.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.688+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=8ZNQ0V5OGIAX tag=AWF5SJDNJ36V type=write size=2985238 2024-09-14T11:17:08.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.689+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~989PTGK2U1VP.0 size=1011865 2024-09-14T11:17:08.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.691+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=989PTGK2U1VP tag=HTPWFJ0R204E type=write size=2060441 2024-09-14T11:17:08.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.692+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=HEEO63O4T1B1 type=write size=1002118 2024-09-14T11:17:08.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.694+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=27OH74LF0M9K type=del 2024-09-14T11:17:08.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.695+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=E4IRAP06YGZU type=write size=817361 2024-09-14T11:17:08.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.696+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=ZTIHF7BIW1VE type=del 2024-09-14T11:17:08.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.698+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=GJWUTBZPZF47 type=write size=395899 2024-09-14T11:17:08.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.699+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~WCSIL1PQY0JV.0 size=265347 2024-09-14T11:17:08.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.701+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=WCSIL1PQY0JV tag=PF0D50Q6GW90 type=write size=1313923 2024-09-14T11:17:08.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.702+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=VB3UMG53AB8K type=del size=144322 2024-09-14T11:17:08.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.705+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=HV8YR862Z7K8 type=del size=1675160 2024-09-14T11:17:08.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.706+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=8CKY0H8QKG7B type=del size=1381726 2024-09-14T11:17:08.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.707+0000 7f185d9f8780 1 < completed write operation key=PSL63WUBLB75 tag=X47DNN9AICQU type=write size=712221 2024-09-14T11:17:08.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.709+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~TOZ04FOFQW2N.0 size=1048576 2024-09-14T11:17:08.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.711+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~TOZ04FOFQW2N.1 size=560825 2024-09-14T11:17:08.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.711+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=TOZ04FOFQW2N tag=FHDXFH4E4RTA type=write size=2657977 2024-09-14T11:17:08.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.712+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~6H97I9VQ6YQB.0 size=206117 2024-09-14T11:17:08.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.714+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=6H97I9VQ6YQB tag=YON92UDVXVC0 type=write size=1254693 2024-09-14T11:17:08.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.715+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=NXZF4AL3ABRI type=del size=3060482 2024-09-14T11:17:08.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.717+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~FDHRF180U8LC.0 size=629780 2024-09-14T11:17:08.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.719+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=FDHRF180U8LC tag=BHWKQMHNXNIF type=write size=1678356 2024-09-14T11:17:08.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.720+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=86F6EELPGO25 type=del size=2041780 2024-09-14T11:17:08.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.722+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=RZXHYJYR01YG type=del 2024-09-14T11:17:08.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.723+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=OZ30VBUH2OVA type=write size=528348 2024-09-14T11:17:08.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.725+0000 7f185d9f8780 1 < canceled operation key=LGLAG80GX8GF tag=DMNI4TD6SK47 type=del size=742838 2024-09-14T11:17:08.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.728+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~67ZKOYC0WACR.0 size=1048576 2024-09-14T11:17:08.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.729+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~67ZKOYC0WACR.1 size=1048576 2024-09-14T11:17:08.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.730+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~67ZKOYC0WACR.2 size=603048 2024-09-14T11:17:08.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.730+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=67ZKOYC0WACR tag=GIEQNPU5TZ9R type=write size=3748776 2024-09-14T11:17:08.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.731+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=SJO8K1RFHEEM type=del 2024-09-14T11:17:08.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.734+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~74KG4L2CJSN5.0 size=1048576 2024-09-14T11:17:08.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.735+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~74KG4L2CJSN5.1 size=499926 2024-09-14T11:17:08.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.735+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=74KG4L2CJSN5 tag=4YP0K34T84K0 type=write size=2597078 2024-09-14T11:17:08.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.736+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=X77UJVVXLYPG type=del 2024-09-14T11:17:08.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.738+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~0A6N9FMN6US6.0 size=1048576 2024-09-14T11:17:08.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.739+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~0A6N9FMN6US6.1 size=1048576 2024-09-14T11:17:08.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.740+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~0A6N9FMN6US6.2 size=805707 2024-09-14T11:17:08.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.740+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=0A6N9FMN6US6 tag=8UI7AY78AVU8 type=write size=3951435 2024-09-14T11:17:08.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.741+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=J4SU3FEWR4E7 type=del 2024-09-14T11:17:08.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.742+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=IHYJNC1D10KK type=del size=2674944 2024-09-14T11:17:08.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.744+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=BRU25Q10F5FM type=del 2024-09-14T11:17:08.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.746+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~U7AXAQVUMA5I.0 size=1048576 2024-09-14T11:17:08.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.747+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~U7AXAQVUMA5I.1 size=1048576 2024-09-14T11:17:08.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.748+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~U7AXAQVUMA5I.2 size=506929 2024-09-14T11:17:08.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.748+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=U7AXAQVUMA5I tag=1F08YWAJMLZY type=write size=3652657 2024-09-14T11:17:08.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.750+0000 7f185d9f8780 1 < completed write operation key=JL2IH8NEX1YF tag=5KITY68X6BCK type=write size=684226 2024-09-14T11:17:08.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.751+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=GEVJDTZ704I9 type=del size=53515 2024-09-14T11:17:08.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.751+0000 7f185d9f8780 1 < canceled part key=_multipart_830X857XIX9O.2~8ZNQ0V5OGIAX.0 size=1048576 2024-09-14T11:17:08.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.752+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~8ZNQ0V5OGIAX.1 size=888086 2024-09-14T11:17:08.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.754+0000 7f185d9f8780 1 < canceled multipart upload key=830X857XIX9O upload=8ZNQ0V5OGIAX tag=AWF5SJDNJ36V type=write size=2985238 2024-09-14T11:17:08.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.757+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~VPKHGD6NI3HT.0 size=1048576 2024-09-14T11:17:08.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.758+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~VPKHGD6NI3HT.1 size=521113 2024-09-14T11:17:08.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.758+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=VPKHGD6NI3HT tag=00LL41XZNLOM type=write size=2618265 2024-09-14T11:17:08.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.760+0000 7f185d9f8780 1 < suggested update operation key=IXWIKD7J74RJ tag=HEEO63O4T1B1 type=write size=1002118 2024-09-14T11:17:08.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.762+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=9AGITKCDUJ0K type=write size=67363 2024-09-14T11:17:08.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.763+0000 7f185d9f8780 1 < completed write operation key=DAKWA1OCVTBG tag=E4IRAP06YGZU type=write size=817361 2024-09-14T11:17:08.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.764+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=97YX0KERCBOW type=del size=3634390 2024-09-14T11:17:08.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.766+0000 7f185d9f8780 1 < completed write operation key=O2Y34FSQHS1S tag=GJWUTBZPZF47 type=write size=395899 2024-09-14T11:17:08.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.767+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=6EOY7UE3YA7O type=del size=3111186 2024-09-14T11:17:08.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.768+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=VB3UMG53AB8K type=del 2024-09-14T11:17:08.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.771+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~0GH3HGNM3JWF.0 size=1048576 2024-09-14T11:17:08.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.772+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~0GH3HGNM3JWF.1 size=1048576 2024-09-14T11:17:08.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.773+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~0GH3HGNM3JWF.2 size=729228 2024-09-14T11:17:08.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.773+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=0GH3HGNM3JWF tag=1LO3FT91HKOA type=write size=3874956 2024-09-14T11:17:08.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.774+0000 7f185d9f8780 1 < canceled operation key=6B0SURI3Q8R6 tag=8CKY0H8QKG7B type=del size=1381726 2024-09-14T11:17:08.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.776+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=4D6VRWK0A990 type=write size=393559 2024-09-14T11:17:08.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.777+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~TOZ04FOFQW2N.0 size=1048576 2024-09-14T11:17:08.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.778+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~TOZ04FOFQW2N.1 size=560825 2024-09-14T11:17:08.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.780+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=TOZ04FOFQW2N tag=FHDXFH4E4RTA type=write size=2657977 2024-09-14T11:17:08.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.782+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~QK2T805HM3R8.0 size=309029 2024-09-14T11:17:08.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.782+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=QK2T805HM3R8 tag=ITI4YIJQ939E type=write size=1357605 2024-09-14T11:17:08.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.783+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=NXZF4AL3ABRI type=del 2024-09-14T11:17:08.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.784+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=HEG7K7OYYE3N type=del size=2981662 2024-09-14T11:17:08.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.786+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=86F6EELPGO25 type=del 2024-09-14T11:17:08.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.787+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=T696RD4A13JO type=del size=1972269 2024-09-14T11:17:08.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.788+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=OZ30VBUH2OVA type=write size=528348 2024-09-14T11:17:08.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.789+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=YSTKVR89W4RW type=del size=2761135 2024-09-14T11:17:08.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.791+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~67ZKOYC0WACR.0 size=1048576 2024-09-14T11:17:08.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.792+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~67ZKOYC0WACR.1 size=1048576 2024-09-14T11:17:08.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.793+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~67ZKOYC0WACR.2 size=603048 2024-09-14T11:17:08.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.795+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=67ZKOYC0WACR tag=GIEQNPU5TZ9R type=write size=3748776 2024-09-14T11:17:08.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.797+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~KFTAZNCNY0W6.0 size=1048576 2024-09-14T11:17:08.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.798+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~KFTAZNCNY0W6.1 size=1048576 2024-09-14T11:17:08.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.799+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~KFTAZNCNY0W6.2 size=449476 2024-09-14T11:17:08.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.799+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=KFTAZNCNY0W6 tag=D2REJEW5MEKN type=write size=3595204 2024-09-14T11:17:08.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.800+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~74KG4L2CJSN5.0 size=1048576 2024-09-14T11:17:08.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.800+0000 7f185d9f8780 1 < canceled part key=_multipart_1BOZ331NA7JA.2~74KG4L2CJSN5.1 size=499926 2024-09-14T11:17:08.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.802+0000 7f185d9f8780 1 < canceled multipart upload key=1BOZ331NA7JA upload=74KG4L2CJSN5 tag=4YP0K34T84K0 type=write size=2597078 2024-09-14T11:17:08.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.803+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=T8M7SMMQ5HBQ type=del size=782041 2024-09-14T11:17:08.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.804+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~0A6N9FMN6US6.0 size=1048576 2024-09-14T11:17:08.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.804+0000 7f185d9f8780 1 < canceled part key=_multipart_PSL63WUBLB75.2~0A6N9FMN6US6.1 size=1048576 2024-09-14T11:17:08.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.806+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~0A6N9FMN6US6.2 size=805707 2024-09-14T11:17:08.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.807+0000 7f185d9f8780 1 < canceled multipart upload key=PSL63WUBLB75 upload=0A6N9FMN6US6 tag=8UI7AY78AVU8 type=write size=3951435 2024-09-14T11:17:08.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.809+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=4T1BEIR7076P type=del size=3834276 2024-09-14T11:17:08.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.810+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=IHYJNC1D10KK type=del 2024-09-14T11:17:08.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.811+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=I09B89GGJX7H type=del size=737271 2024-09-14T11:17:08.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.813+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~U7AXAQVUMA5I.0 size=1048576 2024-09-14T11:17:08.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.814+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~U7AXAQVUMA5I.1 size=1048576 2024-09-14T11:17:08.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.814+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~U7AXAQVUMA5I.2 size=506929 2024-09-14T11:17:08.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.817+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=U7AXAQVUMA5I tag=1F08YWAJMLZY type=write size=3652657 2024-09-14T11:17:08.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.818+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=RH9V6OPWWMAH type=del size=3166954 2024-09-14T11:17:08.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.819+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=GEVJDTZ704I9 type=del 2024-09-14T11:17:08.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.821+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~F5PYO08EUADH.0 size=1048576 2024-09-14T11:17:08.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.822+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~F5PYO08EUADH.1 size=986724 2024-09-14T11:17:08.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.822+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=F5PYO08EUADH tag=M997QRUJKLLQ type=write size=3083876 2024-09-14T11:17:08.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.823+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~VPKHGD6NI3HT.0 size=1048576 2024-09-14T11:17:08.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.824+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~VPKHGD6NI3HT.1 size=521113 2024-09-14T11:17:08.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.826+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=VPKHGD6NI3HT tag=00LL41XZNLOM type=write size=2618265 2024-09-14T11:17:08.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.828+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~Z3PV9SS6V6YK.0 size=449345 2024-09-14T11:17:08.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.828+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=Z3PV9SS6V6YK tag=1QYJ002COAFP type=write size=1497921 2024-09-14T11:17:08.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.829+0000 7f185d9f8780 1 < completed write operation key=6MZGLP5KPPB3 tag=9AGITKCDUJ0K type=write size=67363 2024-09-14T11:17:08.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.831+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=KII7479HRX8F type=del size=1610257 2024-09-14T11:17:08.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.832+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=97YX0KERCBOW type=del 2024-09-14T11:17:08.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.833+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=DBJ6AIK5QADP type=write size=91971 2024-09-14T11:17:08.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.834+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=6EOY7UE3YA7O type=del 2024-09-14T11:17:08.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.836+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~KXAQ69W67KFM.0 size=1048576 2024-09-14T11:17:08.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.837+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~KXAQ69W67KFM.1 size=1048576 2024-09-14T11:17:08.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.838+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~KXAQ69W67KFM.2 size=685300 2024-09-14T11:17:08.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.838+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=KXAQ69W67KFM tag=X1MJ1JW7R5KY type=write size=3831028 2024-09-14T11:17:08.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.839+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~0GH3HGNM3JWF.0 size=1048576 2024-09-14T11:17:08.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.840+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~0GH3HGNM3JWF.1 size=1048576 2024-09-14T11:17:08.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.840+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~0GH3HGNM3JWF.2 size=729228 2024-09-14T11:17:08.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.843+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=0GH3HGNM3JWF tag=1LO3FT91HKOA type=write size=3874956 2024-09-14T11:17:08.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.844+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=8PMF72QJ0VUH type=write size=317058 2024-09-14T11:17:08.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.845+0000 7f185d9f8780 1 < completed write operation key=CVVKY636WXG9 tag=4D6VRWK0A990 type=write size=393559 2024-09-14T11:17:08.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.847+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~46XL3B84VKL9.0 size=1048576 2024-09-14T11:17:08.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.848+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~46XL3B84VKL9.1 size=1048576 2024-09-14T11:17:08.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.849+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~46XL3B84VKL9.2 size=742879 2024-09-14T11:17:08.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.849+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=46XL3B84VKL9 tag=9OK5RRDIO3NZ type=write size=3888607 2024-09-14T11:17:08.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.850+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~QK2T805HM3R8.0 size=309029 2024-09-14T11:17:08.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.852+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=QK2T805HM3R8 tag=ITI4YIJQ939E type=write size=1357605 2024-09-14T11:17:08.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.853+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=GB6UIHK1KG7M type=del size=2244959 2024-09-14T11:17:08.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.855+0000 7f185d9f8780 1 < suggested remove operation key=PSL63WUBLB75 tag=HEG7K7OYYE3N type=del 2024-09-14T11:17:08.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.856+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=YDQ26E5XO4WS type=del size=733099 2024-09-14T11:17:08.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.858+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=T696RD4A13JO type=del 2024-09-14T11:17:08.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.859+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=Y82HJC0DYYER type=del size=1384126 2024-09-14T11:17:08.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.860+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=YSTKVR89W4RW type=del 2024-09-14T11:17:08.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.861+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=0ZYCM9YB9DKD type=write size=622240 2024-09-14T11:17:08.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.862+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~KFTAZNCNY0W6.0 size=1048576 2024-09-14T11:17:08.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.862+0000 7f185d9f8780 1 < canceled part key=_multipart_IXWIKD7J74RJ.2~KFTAZNCNY0W6.1 size=1048576 2024-09-14T11:17:08.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.863+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~KFTAZNCNY0W6.2 size=449476 2024-09-14T11:17:08.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.865+0000 7f185d9f8780 1 < canceled multipart upload key=IXWIKD7J74RJ upload=KFTAZNCNY0W6 tag=D2REJEW5MEKN type=write size=3595204 2024-09-14T11:17:08.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.866+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=R2SF83F5Z1US type=del size=2831177 2024-09-14T11:17:08.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.867+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=T8M7SMMQ5HBQ type=del 2024-09-14T11:17:08.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.869+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~4ZMFEQ2QUS1L.0 size=1048576 2024-09-14T11:17:08.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.870+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~4ZMFEQ2QUS1L.1 size=687742 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.870+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=4ZMFEQ2QUS1L tag=NQGSZ6NXUFMD type=write size=2784894 2024-09-14T11:17:08.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.872+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=4T1BEIR7076P type=del 2024-09-14T11:17:08.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.873+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=1AWCGUS19QJR type=write size=517103 2024-09-14T11:17:08.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.874+0000 7f185d9f8780 1 < canceled operation key=J6RN3WULDLQE tag=I09B89GGJX7H type=del size=737271 2024-09-14T11:17:08.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.875+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=WJMG1YJRTDR5 type=del size=3220571 2024-09-14T11:17:08.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.876+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=RH9V6OPWWMAH type=del 2024-09-14T11:17:08.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.877+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=894OV40FZ5NY type=del size=488403 2024-09-14T11:17:08.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.878+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~F5PYO08EUADH.0 size=1048576 2024-09-14T11:17:08.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.879+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~F5PYO08EUADH.1 size=986724 2024-09-14T11:17:08.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.881+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=F5PYO08EUADH tag=M997QRUJKLLQ type=write size=3083876 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.884+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~DTD6MFH4AIFD.0 size=1048576 2024-09-14T11:17:08.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.884+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~DTD6MFH4AIFD.1 size=698140 2024-09-14T11:17:08.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.884+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=DTD6MFH4AIFD tag=8RH9WL6VPXI2 type=write size=2795292 2024-09-14T11:17:08.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.886+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~Z3PV9SS6V6YK.0 size=449345 2024-09-14T11:17:08.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.888+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=Z3PV9SS6V6YK tag=1QYJ002COAFP type=write size=1497921 2024-09-14T11:17:08.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.889+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=WDE2I3J09IKX type=del size=3807794 2024-09-14T11:17:08.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.890+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=KII7479HRX8F type=del 2024-09-14T11:17:08.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.892+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~OLI0Q3302U5S.0 size=1048576 2024-09-14T11:17:08.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.893+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~OLI0Q3302U5S.1 size=223609 2024-09-14T11:17:08.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.893+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=OLI0Q3302U5S tag=MKJ9QFL0KFTH type=write size=2320761 2024-09-14T11:17:08.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.895+0000 7f185d9f8780 1 < completed write operation key=XPMGVU0U52GS tag=DBJ6AIK5QADP type=write size=91971 2024-09-14T11:17:08.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.897+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~0LUG21DW97LB.0 size=174923 2024-09-14T11:17:08.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.897+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=0LUG21DW97LB tag=FB9AZHVO0LX1 type=write size=1223499 2024-09-14T11:17:08.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.898+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~KXAQ69W67KFM.0 size=1048576 2024-09-14T11:17:08.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.899+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~KXAQ69W67KFM.1 size=1048576 2024-09-14T11:17:08.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.900+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~KXAQ69W67KFM.2 size=685300 2024-09-14T11:17:08.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.902+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=KXAQ69W67KFM tag=X1MJ1JW7R5KY type=write size=3831028 2024-09-14T11:17:08.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.903+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=7EGV55VROQ2X type=del size=3301100 2024-09-14T11:17:08.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.904+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=8PMF72QJ0VUH type=write size=317058 2024-09-14T11:17:08.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.906+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~G1UNUOWYAMDU.0 size=1048576 2024-09-14T11:17:08.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.907+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~G1UNUOWYAMDU.1 size=406243 2024-09-14T11:17:08.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.907+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=G1UNUOWYAMDU tag=RWRSXT53NLW9 type=write size=2503395 2024-09-14T11:17:08.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.909+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~46XL3B84VKL9.0 size=1048576 2024-09-14T11:17:08.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.910+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~46XL3B84VKL9.1 size=1048576 2024-09-14T11:17:08.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.911+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~46XL3B84VKL9.2 size=742879 2024-09-14T11:17:08.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.912+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=46XL3B84VKL9 tag=9OK5RRDIO3NZ type=write size=3888607 2024-09-14T11:17:08.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.914+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=SQWBQ1IU1FN2 type=del size=2349911 2024-09-14T11:17:08.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.915+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=GB6UIHK1KG7M type=del 2024-09-14T11:17:08.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.917+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~AFC5UQL49PVO.0 size=1048576 2024-09-14T11:17:08.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.918+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~AFC5UQL49PVO.1 size=1048576 2024-09-14T11:17:08.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.919+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~AFC5UQL49PVO.2 size=836772 2024-09-14T11:17:08.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.919+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=AFC5UQL49PVO tag=TMLVGHEBJOXU type=write size=3982500 2024-09-14T11:17:08.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.921+0000 7f185d9f8780 1 < suggested update operation key=830X857XIX9O tag=YDQ26E5XO4WS type=del size=733099 2024-09-14T11:17:08.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.923+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~MHBG80710E24.0 size=1048576 2024-09-14T11:17:08.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.924+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~MHBG80710E24.1 size=1048576 2024-09-14T11:17:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.925+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~MHBG80710E24.2 size=1038274 2024-09-14T11:17:08.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.925+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=MHBG80710E24 tag=2CYTSEJK0LPC type=write size=4184002 2024-09-14T11:17:08.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.926+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=Y82HJC0DYYER type=del 2024-09-14T11:17:08.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.928+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=OYEUOR6NH2D3 type=del size=1598055 2024-09-14T11:17:08.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.929+0000 7f185d9f8780 1 < canceled operation key=H29SXBS4N9JK tag=0ZYCM9YB9DKD type=write size=622240 2024-09-14T11:17:08.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.931+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~D7LWRA9XP38W.0 size=392456 2024-09-14T11:17:08.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.931+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=D7LWRA9XP38W tag=YX30BPRR4K3T type=write size=1441032 2024-09-14T11:17:08.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.932+0000 7f185d9f8780 1 < canceled operation key=SEI774TP8YMJ tag=R2SF83F5Z1US type=del size=2831177 2024-09-14T11:17:08.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.935+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~7UOH7YP244UF.0 size=226405 2024-09-14T11:17:08.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.935+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=7UOH7YP244UF tag=907KOZW03NTF type=write size=1274981 2024-09-14T11:17:08.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.936+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~4ZMFEQ2QUS1L.0 size=1048576 2024-09-14T11:17:08.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.937+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~4ZMFEQ2QUS1L.1 size=687742 2024-09-14T11:17:08.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.940+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=4ZMFEQ2QUS1L tag=NQGSZ6NXUFMD type=write size=2784894 2024-09-14T11:17:08.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.941+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=0F0Y203658ST type=del size=752224 2024-09-14T11:17:08.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.942+0000 7f185d9f8780 1 < completed write operation key=PSL63WUBLB75 tag=1AWCGUS19QJR type=write size=517103 2024-09-14T11:17:08.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.943+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=9ML5XZUL4KM2 type=write size=671909 2024-09-14T11:17:08.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.946+0000 7f185d9f8780 1 < suggested update operation key=6MZGLP5KPPB3 tag=WJMG1YJRTDR5 type=del size=3220571 2024-09-14T11:17:08.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.947+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=Z5W8LTZI36XC type=del size=2265391 2024-09-14T11:17:08.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.948+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=894OV40FZ5NY type=del 2024-09-14T11:17:08.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.950+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~9BZG8SM97J0X.0 size=1048576 2024-09-14T11:17:08.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.952+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~9BZG8SM97J0X.1 size=1048576 2024-09-14T11:17:08.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.953+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~9BZG8SM97J0X.2 size=163422 2024-09-14T11:17:08.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.953+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=9BZG8SM97J0X tag=QCCUIYGB7ENL type=write size=3309150 2024-09-14T11:17:08.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.954+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~DTD6MFH4AIFD.0 size=1048576 2024-09-14T11:17:08.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.955+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~DTD6MFH4AIFD.1 size=698140 2024-09-14T11:17:08.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.957+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=DTD6MFH4AIFD tag=8RH9WL6VPXI2 type=write size=2795292 2024-09-14T11:17:08.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.959+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~E46C0N9T88OQ.0 size=518772 2024-09-14T11:17:08.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.959+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=E46C0N9T88OQ tag=6LSZ9IHDXZLV type=write size=1567348 2024-09-14T11:17:08.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.962+0000 7f185d9f8780 1 < suggested remove operation key=IXWIKD7J74RJ tag=WDE2I3J09IKX type=del 2024-09-14T11:17:08.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.963+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=ZMKIXTI0EAJI type=del size=4021888 2024-09-14T11:17:08.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.964+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~OLI0Q3302U5S.0 size=1048576 2024-09-14T11:17:08.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.965+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~OLI0Q3302U5S.1 size=223609 2024-09-14T11:17:08.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.967+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=OLI0Q3302U5S tag=MKJ9QFL0KFTH type=write size=2320761 2024-09-14T11:17:08.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.969+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~4Q53C9AZWKG8.0 size=906356 2024-09-14T11:17:08.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.969+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=4Q53C9AZWKG8 tag=879F3LA2H80Q type=write size=1954932 2024-09-14T11:17:08.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.971+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~0LUG21DW97LB.0 size=174923 2024-09-14T11:17:08.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.973+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=0LUG21DW97LB tag=FB9AZHVO0LX1 type=write size=1223499 2024-09-14T11:17:08.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.975+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~YK0F25WWSUWR.0 size=1048576 2024-09-14T11:17:08.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.976+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~YK0F25WWSUWR.1 size=1006887 2024-09-14T11:17:08.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.976+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=YK0F25WWSUWR tag=FBKI6TXTCH6Y type=write size=3104039 2024-09-14T11:17:08.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.977+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=7EGV55VROQ2X type=del 2024-09-14T11:17:08.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.979+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~W42RD3QQ7E30.0 size=1048576 2024-09-14T11:17:08.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.980+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~W42RD3QQ7E30.1 size=407781 2024-09-14T11:17:08.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.980+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=W42RD3QQ7E30 tag=3M4P505MGI3N type=write size=2504933 2024-09-14T11:17:08.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.982+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~G1UNUOWYAMDU.0 size=1048576 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.982+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~G1UNUOWYAMDU.1 size=406243 2024-09-14T11:17:08.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.984+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=G1UNUOWYAMDU tag=RWRSXT53NLW9 type=write size=2503395 2024-09-14T11:17:08.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.987+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~RM5KIKTKHH29.0 size=1048576 2024-09-14T11:17:08.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.988+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~RM5KIKTKHH29.1 size=817992 2024-09-14T11:17:08.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.988+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=RM5KIKTKHH29 tag=4ATUTV7YCJ2Z type=write size=2915144 2024-09-14T11:17:08.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.989+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=SQWBQ1IU1FN2 type=del 2024-09-14T11:17:08.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.990+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=PEP6U37ZJHDF type=del size=3257817 2024-09-14T11:17:08.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.991+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~AFC5UQL49PVO.0 size=1048576 2024-09-14T11:17:08.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.992+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~AFC5UQL49PVO.1 size=1048576 2024-09-14T11:17:08.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.993+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~AFC5UQL49PVO.2 size=836772 2024-09-14T11:17:08.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.996+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=AFC5UQL49PVO tag=TMLVGHEBJOXU type=write size=3982500 2024-09-14T11:17:08.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.997+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=Z2NS3KVX0LP8 type=del size=1547466 2024-09-14T11:17:08.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.998+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~MHBG80710E24.0 size=1048576 2024-09-14T11:17:08.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:08.999+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~MHBG80710E24.1 size=1048576 2024-09-14T11:17:08.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.000+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~MHBG80710E24.2 size=1038274 2024-09-14T11:17:09.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.002+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=MHBG80710E24 tag=2CYTSEJK0LPC type=write size=4184002 2024-09-14T11:17:09.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.003+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=M69ECE8X3M76 type=del size=3973222 2024-09-14T11:17:09.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.004+0000 7f185d9f8780 1 < canceled operation key=830X857XIX9O tag=OYEUOR6NH2D3 type=del size=1598055 2024-09-14T11:17:09.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.006+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=4O2LVRM2QIWD type=write size=186076 2024-09-14T11:17:09.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.007+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~D7LWRA9XP38W.0 size=392456 2024-09-14T11:17:09.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.009+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=D7LWRA9XP38W tag=YX30BPRR4K3T type=write size=1441032 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.011+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~6YW55BGMNWL1.0 size=1048576 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.012+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~6YW55BGMNWL1.1 size=474503 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.012+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=6YW55BGMNWL1 tag=WTS8ZIG9J9UJ type=write size=2571655 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.013+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~7UOH7YP244UF.0 size=226405 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.015+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=7UOH7YP244UF tag=907KOZW03NTF type=write size=1274981 2024-09-14T11:17:09.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.018+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~JM77ZHZWCXH6.0 size=1048576 2024-09-14T11:17:09.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.018+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~JM77ZHZWCXH6.1 size=1048576 2024-09-14T11:17:09.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.019+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~JM77ZHZWCXH6.2 size=495138 2024-09-14T11:17:09.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.019+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=JM77ZHZWCXH6 tag=Y94X1VBCQMDW type=write size=3640866 2024-09-14T11:17:09.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.021+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=0F0Y203658ST type=del 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.023+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~O8DN1OW48HSY.0 size=1048576 2024-09-14T11:17:09.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.024+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~O8DN1OW48HSY.1 size=578288 2024-09-14T11:17:09.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.024+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=O8DN1OW48HSY tag=V33NFMHP5QQA type=write size=2675440 2024-09-14T11:17:09.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.025+0000 7f185d9f8780 1 < completed write operation key=L4L83NVMXHXZ tag=9ML5XZUL4KM2 type=write size=671909 2024-09-14T11:17:09.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.026+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=7HC0Y443FDP0 type=del size=950139 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.028+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=Z5W8LTZI36XC type=del 2024-09-14T11:17:09.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.030+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~H93HYQSCIK6B.0 size=1048576 2024-09-14T11:17:09.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.031+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~H93HYQSCIK6B.1 size=186246 2024-09-14T11:17:09.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.031+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=H93HYQSCIK6B tag=P34R27Z0XYT8 type=write size=2283398 2024-09-14T11:17:09.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.032+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~9BZG8SM97J0X.0 size=1048576 2024-09-14T11:17:09.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.033+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~9BZG8SM97J0X.1 size=1048576 2024-09-14T11:17:09.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.034+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~9BZG8SM97J0X.2 size=163422 2024-09-14T11:17:09.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.036+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=9BZG8SM97J0X tag=QCCUIYGB7ENL type=write size=3309150 2024-09-14T11:17:09.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.037+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=TU6ZE5J59JHN type=del size=1627770 2024-09-14T11:17:09.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.039+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~E46C0N9T88OQ.0 size=518772 2024-09-14T11:17:09.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.041+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=E46C0N9T88OQ tag=6LSZ9IHDXZLV type=write size=1567348 2024-09-14T11:17:09.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.042+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=YYQJMTAEP3HT type=del size=190509 2024-09-14T11:17:09.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.043+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=ZMKIXTI0EAJI type=del 2024-09-14T11:17:09.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.045+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=ROBWIYF8ATXC type=del size=1088926 2024-09-14T11:17:09.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.046+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~4Q53C9AZWKG8.0 size=906356 2024-09-14T11:17:09.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.048+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=4Q53C9AZWKG8 tag=879F3LA2H80Q type=write size=1954932 2024-09-14T11:17:09.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.049+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=CDCZTCBHGHWW type=del size=4063181 2024-09-14T11:17:09.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.051+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~YK0F25WWSUWR.0 size=1048576 2024-09-14T11:17:09.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.052+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~YK0F25WWSUWR.1 size=1006887 2024-09-14T11:17:09.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.054+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=YK0F25WWSUWR tag=FBKI6TXTCH6Y type=write size=3104039 2024-09-14T11:17:09.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.055+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=A3E685D1QOMC type=del size=290761 2024-09-14T11:17:09.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.056+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~W42RD3QQ7E30.0 size=1048576 2024-09-14T11:17:09.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.056+0000 7f185d9f8780 1 < canceled part key=_multipart_ZR3IEW48CSCF.2~W42RD3QQ7E30.1 size=407781 2024-09-14T11:17:09.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.058+0000 7f185d9f8780 1 < canceled multipart upload key=ZR3IEW48CSCF upload=W42RD3QQ7E30 tag=3M4P505MGI3N type=write size=2504933 2024-09-14T11:17:09.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.061+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~2C0K9MAN661L.0 size=612821 2024-09-14T11:17:09.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.061+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=2C0K9MAN661L tag=CR9ZOB3YBRXW type=write size=1661397 2024-09-14T11:17:09.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.062+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~RM5KIKTKHH29.0 size=1048576 2024-09-14T11:17:09.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.064+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~RM5KIKTKHH29.1 size=817992 2024-09-14T11:17:09.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.066+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=RM5KIKTKHH29 tag=4ATUTV7YCJ2Z type=write size=2915144 2024-09-14T11:17:09.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.068+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~V793YBE3BAB1.0 size=1048576 2024-09-14T11:17:09.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.069+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~V793YBE3BAB1.1 size=812158 2024-09-14T11:17:09.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.069+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=V793YBE3BAB1 tag=2ELY5AZNOCV5 type=write size=2909310 2024-09-14T11:17:09.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.072+0000 7f185d9f8780 1 < suggested update operation key=ZR3IEW48CSCF tag=PEP6U37ZJHDF type=del size=3257817 2024-09-14T11:17:09.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.074+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~BRO0ITKVV8CS.0 size=1048576 2024-09-14T11:17:09.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.075+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~BRO0ITKVV8CS.1 size=1048576 2024-09-14T11:17:09.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.076+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~BRO0ITKVV8CS.2 size=369746 2024-09-14T11:17:09.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.076+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=BRO0ITKVV8CS tag=0SVNDYBQ2HZN type=write size=3515474 2024-09-14T11:17:09.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.077+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=Z2NS3KVX0LP8 type=del 2024-09-14T11:17:09.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.079+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~UT5DWA9KVG43.0 size=1048576 2024-09-14T11:17:09.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.080+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~UT5DWA9KVG43.1 size=102733 2024-09-14T11:17:09.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.080+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=UT5DWA9KVG43 tag=LGK6Z6I8Q4D4 type=write size=2199885 2024-09-14T11:17:09.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.082+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=M69ECE8X3M76 type=del 2024-09-14T11:17:09.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.083+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=922RQOL2XSFD type=del size=583171 2024-09-14T11:17:09.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.085+0000 7f185d9f8780 1 < suggested remove operation key=W24KN3J819EB tag=4O2LVRM2QIWD type=write 2024-09-14T11:17:09.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.088+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~CSJD6PFQX09C.0 size=1048576 2024-09-14T11:17:09.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.089+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~CSJD6PFQX09C.1 size=1048576 2024-09-14T11:17:09.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.089+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~CSJD6PFQX09C.2 size=417455 2024-09-14T11:17:09.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.089+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=CSJD6PFQX09C tag=B0WUM7EEN2O0 type=write size=3563183 2024-09-14T11:17:09.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.091+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~6YW55BGMNWL1.0 size=1048576 2024-09-14T11:17:09.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.092+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~6YW55BGMNWL1.1 size=474503 2024-09-14T11:17:09.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.094+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=6YW55BGMNWL1 tag=WTS8ZIG9J9UJ type=write size=2571655 2024-09-14T11:17:09.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.096+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~9P3FIRHY0JDY.0 size=1048576 2024-09-14T11:17:09.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.097+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~9P3FIRHY0JDY.1 size=633406 2024-09-14T11:17:09.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.097+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=9P3FIRHY0JDY tag=UZG8UL7TUGNR type=write size=2730558 2024-09-14T11:17:09.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.098+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~JM77ZHZWCXH6.0 size=1048576 2024-09-14T11:17:09.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.099+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~JM77ZHZWCXH6.1 size=1048576 2024-09-14T11:17:09.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.099+0000 7f185d9f8780 1 < canceled part key=_multipart_DAKWA1OCVTBG.2~JM77ZHZWCXH6.2 size=495138 2024-09-14T11:17:09.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.101+0000 7f185d9f8780 1 < canceled multipart upload key=DAKWA1OCVTBG upload=JM77ZHZWCXH6 tag=Y94X1VBCQMDW type=write size=3640866 2024-09-14T11:17:09.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.102+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=YC88XIWW3PAU type=write size=535916 2024-09-14T11:17:09.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.104+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~O8DN1OW48HSY.0 size=1048576 2024-09-14T11:17:09.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.105+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~O8DN1OW48HSY.1 size=578288 2024-09-14T11:17:09.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.107+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=O8DN1OW48HSY tag=V33NFMHP5QQA type=write size=2675440 2024-09-14T11:17:09.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.109+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~HGS0ZRSAZCDD.0 size=1048576 2024-09-14T11:17:09.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.110+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~HGS0ZRSAZCDD.1 size=1048576 2024-09-14T11:17:09.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.111+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~HGS0ZRSAZCDD.2 size=592451 2024-09-14T11:17:09.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.111+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=HGS0ZRSAZCDD tag=WN0BSZXM6DTA type=write size=3738179 2024-09-14T11:17:09.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.112+0000 7f185d9f8780 1 < canceled operation key=XPMGVU0U52GS tag=7HC0Y443FDP0 type=del size=950139 2024-09-14T11:17:09.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.114+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=F2S1TBMC29O6 type=del size=2790831 2024-09-14T11:17:09.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.115+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~H93HYQSCIK6B.0 size=1048576 2024-09-14T11:17:09.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.116+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~H93HYQSCIK6B.1 size=186246 2024-09-14T11:17:09.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.118+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=H93HYQSCIK6B tag=P34R27Z0XYT8 type=write size=2283398 2024-09-14T11:17:09.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.120+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~MXBA8QJHH169.0 size=1048576 2024-09-14T11:17:09.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.121+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~MXBA8QJHH169.1 size=413587 2024-09-14T11:17:09.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.121+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=MXBA8QJHH169 tag=SP35CHKJZ574 type=write size=2510739 2024-09-14T11:17:09.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.123+0000 7f185d9f8780 1 < suggested update operation key=LGLAG80GX8GF tag=TU6ZE5J59JHN type=del size=1627770 2024-09-14T11:17:09.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.124+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=SB3J1YBC8NDE type=del size=1525908 2024-09-14T11:17:09.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.125+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=YYQJMTAEP3HT type=del 2024-09-14T11:17:09.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.127+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~8VRSX46WLK1D.0 size=1048576 2024-09-14T11:17:09.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.128+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~8VRSX46WLK1D.1 size=829406 2024-09-14T11:17:09.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.128+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=8VRSX46WLK1D tag=C67E8Y5HTTK9 type=write size=2926558 2024-09-14T11:17:09.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.131+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=ROBWIYF8ATXC type=del size=1088926 2024-09-14T11:17:09.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.132+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=OP356AIMS0VU type=del size=1871361 2024-09-14T11:17:09.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.133+0000 7f185d9f8780 1 < canceled operation key=SEI774TP8YMJ tag=CDCZTCBHGHWW type=del size=4063181 2024-09-14T11:17:09.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.135+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~WOJP0RHES9U1.0 size=180806 2024-09-14T11:17:09.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.135+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=WOJP0RHES9U1 tag=XHM7QKNQ1011 type=write size=1229382 2024-09-14T11:17:09.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.137+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=A3E685D1QOMC type=del 2024-09-14T11:17:09.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.138+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=LZOZ0VQZEVUV type=del size=3441139 2024-09-14T11:17:09.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.139+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~2C0K9MAN661L.0 size=612821 2024-09-14T11:17:09.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.141+0000 7f185d9f8780 1 < canceled multipart upload key=SEI774TP8YMJ upload=2C0K9MAN661L tag=CR9ZOB3YBRXW type=write size=1661397 2024-09-14T11:17:09.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.143+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~H850W2ONQ42N.0 size=1048576 2024-09-14T11:17:09.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.144+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~H850W2ONQ42N.1 size=171926 2024-09-14T11:17:09.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.144+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=H850W2ONQ42N tag=W43CA3EEFJVO type=write size=2269078 2024-09-14T11:17:09.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.146+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~V793YBE3BAB1.0 size=1048576 2024-09-14T11:17:09.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.147+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~V793YBE3BAB1.1 size=812158 2024-09-14T11:17:09.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.149+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=V793YBE3BAB1 tag=2ELY5AZNOCV5 type=write size=2909310 2024-09-14T11:17:09.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.152+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~RJS1CYCZABIE.0 size=1048576 2024-09-14T11:17:09.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.153+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~RJS1CYCZABIE.1 size=962506 2024-09-14T11:17:09.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.153+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=RJS1CYCZABIE tag=A2S81Z44OM90 type=write size=3059658 2024-09-14T11:17:09.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.154+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~BRO0ITKVV8CS.0 size=1048576 2024-09-14T11:17:09.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.155+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~BRO0ITKVV8CS.1 size=1048576 2024-09-14T11:17:09.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.156+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~BRO0ITKVV8CS.2 size=369746 2024-09-14T11:17:09.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.158+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=BRO0ITKVV8CS tag=0SVNDYBQ2HZN type=write size=3515474 2024-09-14T11:17:09.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.159+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=SOBF2S4LPYRN type=del size=1484560 2024-09-14T11:17:09.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.160+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~UT5DWA9KVG43.0 size=1048576 2024-09-14T11:17:09.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.161+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~UT5DWA9KVG43.1 size=102733 2024-09-14T11:17:09.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.163+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=UT5DWA9KVG43 tag=LGK6Z6I8Q4D4 type=write size=2199885 2024-09-14T11:17:09.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.165+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=Z2F8J84JWBFO type=del size=3778982 2024-09-14T11:17:09.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.167+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=922RQOL2XSFD type=del size=583171 2024-09-14T11:17:09.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.168+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=9GY9501COK0C type=del size=1103436 2024-09-14T11:17:09.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.169+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~CSJD6PFQX09C.0 size=1048576 2024-09-14T11:17:09.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.170+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~CSJD6PFQX09C.1 size=1048576 2024-09-14T11:17:09.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.171+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~CSJD6PFQX09C.2 size=417455 2024-09-14T11:17:09.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.173+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=CSJD6PFQX09C tag=B0WUM7EEN2O0 type=write size=3563183 2024-09-14T11:17:09.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.176+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~62SZVGJ915BM.0 size=1048576 2024-09-14T11:17:09.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.177+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~62SZVGJ915BM.1 size=660237 2024-09-14T11:17:09.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.177+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=62SZVGJ915BM tag=HFP55P3HWUJ0 type=write size=2757389 2024-09-14T11:17:09.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.178+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~9P3FIRHY0JDY.0 size=1048576 2024-09-14T11:17:09.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.179+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~9P3FIRHY0JDY.1 size=633406 2024-09-14T11:17:09.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.181+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=9P3FIRHY0JDY tag=UZG8UL7TUGNR type=write size=2730558 2024-09-14T11:17:09.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.182+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=UK8L1RA0IX4A type=del size=2827891 2024-09-14T11:17:09.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.183+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=YC88XIWW3PAU type=write size=535916 2024-09-14T11:17:09.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.184+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=LWYRMAS9UYLW type=del size=1517728 2024-09-14T11:17:09.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.185+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~HGS0ZRSAZCDD.0 size=1048576 2024-09-14T11:17:09.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.186+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~HGS0ZRSAZCDD.1 size=1048576 2024-09-14T11:17:09.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.187+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~HGS0ZRSAZCDD.2 size=592451 2024-09-14T11:17:09.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.189+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=HGS0ZRSAZCDD tag=WN0BSZXM6DTA type=write size=3738179 2024-09-14T11:17:09.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.190+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=8EV00ZUTNRXR type=del size=4064250 2024-09-14T11:17:09.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.191+0000 7f185d9f8780 1 < canceled operation key=JL2IH8NEX1YF tag=F2S1TBMC29O6 type=del size=2790831 2024-09-14T11:17:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.192+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=S5OG5J4WX1AZ type=del size=1516284 2024-09-14T11:17:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.193+0000 7f185d9f8780 1 < canceled part key=_multipart_IXWIKD7J74RJ.2~MXBA8QJHH169.0 size=1048576 2024-09-14T11:17:09.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.193+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~MXBA8QJHH169.1 size=413587 2024-09-14T11:17:09.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.195+0000 7f185d9f8780 1 < canceled multipart upload key=IXWIKD7J74RJ upload=MXBA8QJHH169 tag=SP35CHKJZ574 type=write size=2510739 2024-09-14T11:17:09.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.196+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=HNMX82PRL19Z type=del size=3880891 2024-09-14T11:17:09.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.197+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=SB3J1YBC8NDE type=del 2024-09-14T11:17:09.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.199+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=91E7CJWHJ8NS type=write size=113214 2024-09-14T11:17:09.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.200+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~8VRSX46WLK1D.0 size=1048576 2024-09-14T11:17:09.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.201+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~8VRSX46WLK1D.1 size=829406 2024-09-14T11:17:09.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.203+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=8VRSX46WLK1D tag=C67E8Y5HTTK9 type=write size=2926558 2024-09-14T11:17:09.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.204+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=LWPJREARSFM4 type=del size=1301845 2024-09-14T11:17:09.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.205+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=OP356AIMS0VU type=del 2024-09-14T11:17:09.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.207+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~ZQ6NSPXJFIRF.0 size=887582 2024-09-14T11:17:09.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.207+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=ZQ6NSPXJFIRF tag=LMU9YYQZOHNJ type=write size=1936158 2024-09-14T11:17:09.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.209+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~WOJP0RHES9U1.0 size=180806 2024-09-14T11:17:09.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.211+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=WOJP0RHES9U1 tag=XHM7QKNQ1011 type=write size=1229382 2024-09-14T11:17:09.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.212+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=OGSUATGHNCG6 type=del size=1982673 2024-09-14T11:17:09.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.214+0000 7f185d9f8780 1 < suggested remove operation key=ESN8NVVJB3B0 tag=LZOZ0VQZEVUV type=del 2024-09-14T11:17:09.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.215+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=IWHMVCSBW0BL type=del size=1295270 2024-09-14T11:17:09.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.217+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~H850W2ONQ42N.0 size=1048576 2024-09-14T11:17:09.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.217+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~H850W2ONQ42N.1 size=171926 2024-09-14T11:17:09.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.219+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=H850W2ONQ42N tag=W43CA3EEFJVO type=write size=2269078 2024-09-14T11:17:09.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.220+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=FKFC2W42G9AG type=del size=1782928 2024-09-14T11:17:09.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.222+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~RJS1CYCZABIE.0 size=1048576 2024-09-14T11:17:09.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.222+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~RJS1CYCZABIE.1 size=962506 2024-09-14T11:17:09.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.224+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=RJS1CYCZABIE tag=A2S81Z44OM90 type=write size=3059658 2024-09-14T11:17:09.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.225+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=UDOYUETZILAD type=del size=3805863 2024-09-14T11:17:09.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.226+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=SOBF2S4LPYRN type=del 2024-09-14T11:17:09.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.228+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~9Q3QB5L300UK.0 size=1048576 2024-09-14T11:17:09.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.229+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~9Q3QB5L300UK.1 size=179316 2024-09-14T11:17:09.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.229+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=9Q3QB5L300UK tag=2W1RD6EZVVPL type=write size=2276468 2024-09-14T11:17:09.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.232+0000 7f185d9f8780 1 < suggested remove operation key=J6RN3WULDLQE tag=Z2F8J84JWBFO type=del 2024-09-14T11:17:09.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.234+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~DZZFY0G3TZO2.0 size=1048576 2024-09-14T11:17:09.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.235+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~DZZFY0G3TZO2.1 size=153341 2024-09-14T11:17:09.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.235+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=DZZFY0G3TZO2 tag=L5IX1P9XFQR7 type=write size=2250493 2024-09-14T11:17:09.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.236+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=9GY9501COK0C type=del 2024-09-14T11:17:09.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.238+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=D82MQDFCXQQW type=del size=896430 2024-09-14T11:17:09.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.238+0000 7f185d9f8780 1 < canceled part key=_multipart_H29SXBS4N9JK.2~62SZVGJ915BM.0 size=1048576 2024-09-14T11:17:09.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.239+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~62SZVGJ915BM.1 size=660237 2024-09-14T11:17:09.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.241+0000 7f185d9f8780 1 < canceled multipart upload key=H29SXBS4N9JK upload=62SZVGJ915BM tag=HFP55P3HWUJ0 type=write size=2757389 2024-09-14T11:17:09.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.243+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~5TA8S9L1BS9W.0 size=511350 2024-09-14T11:17:09.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.243+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=5TA8S9L1BS9W tag=AOKZZ7OSERUD type=write size=1559926 2024-09-14T11:17:09.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.244+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=UK8L1RA0IX4A type=del 2024-09-14T11:17:09.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.246+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=0Q2XF402RMX1 type=del size=3193647 2024-09-14T11:17:09.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.248+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=LWYRMAS9UYLW type=del 2024-09-14T11:17:09.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.249+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=3IYF7J4FODER type=del size=2212980 2024-09-14T11:17:09.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.250+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=8EV00ZUTNRXR type=del 2024-09-14T11:17:09.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.253+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~L00ERS802R7O.0 size=626659 2024-09-14T11:17:09.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.253+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=L00ERS802R7O tag=CX2NRRVB92XY type=write size=1675235 2024-09-14T11:17:09.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.254+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=S5OG5J4WX1AZ type=del 2024-09-14T11:17:09.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.256+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~4K1MBNSWZSB8.0 size=1048576 2024-09-14T11:17:09.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.257+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~4K1MBNSWZSB8.1 size=1048576 2024-09-14T11:17:09.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.258+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~4K1MBNSWZSB8.2 size=523137 2024-09-14T11:17:09.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.258+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=4K1MBNSWZSB8 tag=3QIT3UTMRPMT type=write size=3668865 2024-09-14T11:17:09.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.259+0000 7f185d9f8780 -1 < failed to complete operation key=ESN8NVVJB3B0 tag=HNMX82PRL19Z type=del size=3880891: (22) Invalid argument 2024-09-14T11:17:09.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.262+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~BMHXCCO16UBY.0 size=1048576 2024-09-14T11:17:09.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.262+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~BMHXCCO16UBY.1 size=1048576 2024-09-14T11:17:09.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.263+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~BMHXCCO16UBY.2 size=1030289 2024-09-14T11:17:09.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.263+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=BMHXCCO16UBY tag=9BPYO6KIW8EO type=write size=4176017 2024-09-14T11:17:09.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.265+0000 7f185d9f8780 -1 < failed to complete operation key=ESN8NVVJB3B0 tag=91E7CJWHJ8NS type=write size=113214: (22) Invalid argument 2024-09-14T11:17:09.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.266+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=XMIF37YDQE5N type=del size=2240315 2024-09-14T11:17:09.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.267+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=LWPJREARSFM4 type=del 2024-09-14T11:17:09.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.268+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=Q6URCZT8BDQR type=write size=122872 2024-09-14T11:17:09.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.269+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~ZQ6NSPXJFIRF.0 size=887582 2024-09-14T11:17:09.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.271+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=ZQ6NSPXJFIRF tag=LMU9YYQZOHNJ type=write size=1936158 2024-09-14T11:17:09.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.273+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~6WTMG9OZQ5FT.0 size=1048576 2024-09-14T11:17:09.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.274+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~6WTMG9OZQ5FT.1 size=1048576 2024-09-14T11:17:09.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.275+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~6WTMG9OZQ5FT.2 size=610910 2024-09-14T11:17:09.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.275+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=6WTMG9OZQ5FT tag=R21E9KGPQ2L7 type=write size=3756638 2024-09-14T11:17:09.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.277+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=OGSUATGHNCG6 type=del 2024-09-14T11:17:09.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.279+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~4FXIB7VPWZE9.0 size=296383 2024-09-14T11:17:09.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.279+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=4FXIB7VPWZE9 tag=E4RIP9U9BHEE type=write size=1344959 2024-09-14T11:17:09.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.280+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=IWHMVCSBW0BL type=del 2024-09-14T11:17:09.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.281+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=M30HVK19SHJE type=del size=2021300 2024-09-14T11:17:09.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.283+0000 7f185d9f8780 -1 < failed to complete operation key=6MZGLP5KPPB3 tag=FKFC2W42G9AG type=del size=1782928: (22) Invalid argument 2024-09-14T11:17:09.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.284+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=OR1VM2EKU957 type=del size=3115625 2024-09-14T11:17:09.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.287+0000 7f185d9f8780 1 < suggested remove operation key=830X857XIX9O tag=UDOYUETZILAD type=del 2024-09-14T11:17:09.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.289+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~4QC87F0MA586.0 size=635739 2024-09-14T11:17:09.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.289+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=4QC87F0MA586 tag=X7IY1XZUA1C1 type=write size=1684315 2024-09-14T11:17:09.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.290+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~9Q3QB5L300UK.0 size=1048576 2024-09-14T11:17:09.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.291+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~9Q3QB5L300UK.1 size=179316 2024-09-14T11:17:09.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.293+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=9Q3QB5L300UK tag=2W1RD6EZVVPL type=write size=2276468 2024-09-14T11:17:09.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.294+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=7GAPFD0BPDX7 type=del size=77347 2024-09-14T11:17:09.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.295+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~DZZFY0G3TZO2.0 size=1048576 2024-09-14T11:17:09.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.296+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~DZZFY0G3TZO2.1 size=153341 2024-09-14T11:17:09.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.298+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=DZZFY0G3TZO2 tag=L5IX1P9XFQR7 type=write size=2250493 2024-09-14T11:17:09.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.301+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~GG7EGPGWWZJZ.0 size=976983 2024-09-14T11:17:09.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.301+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=GG7EGPGWWZJZ tag=WHSFOQ2TFMHM type=write size=2025559 2024-09-14T11:17:09.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.302+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=D82MQDFCXQQW type=del 2024-09-14T11:17:09.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.303+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=4IS5SL09FJBB type=del size=2249812 2024-09-14T11:17:09.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.305+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~5TA8S9L1BS9W.0 size=511350 2024-09-14T11:17:09.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.307+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=5TA8S9L1BS9W tag=AOKZZ7OSERUD type=write size=1559926 2024-09-14T11:17:09.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.309+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~XI6DU3O1W9MC.0 size=683890 2024-09-14T11:17:09.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.309+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=XI6DU3O1W9MC tag=IKY72AXUPKPG type=write size=1732466 2024-09-14T11:17:09.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.310+0000 7f185d9f8780 -1 < failed to complete operation key=830X857XIX9O tag=0Q2XF402RMX1 type=del size=3193647: (22) Invalid argument 2024-09-14T11:17:09.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.311+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=PLKLIL87JKTE type=del size=1975942 2024-09-14T11:17:09.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.312+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=3IYF7J4FODER type=del 2024-09-14T11:17:09.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.314+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=TBJ1N4YO5G3X type=del size=2052452 2024-09-14T11:17:09.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.315+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~L00ERS802R7O.0 size=626659 2024-09-14T11:17:09.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.317+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=L00ERS802R7O tag=CX2NRRVB92XY type=write size=1675235 2024-09-14T11:17:09.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.319+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~O4RL43F3UJ8T.0 size=1048576 2024-09-14T11:17:09.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.320+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~O4RL43F3UJ8T.1 size=918592 2024-09-14T11:17:09.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.320+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=O4RL43F3UJ8T tag=0INV1I4U0F80 type=write size=3015744 2024-09-14T11:17:09.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.321+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~4K1MBNSWZSB8.0 size=1048576 2024-09-14T11:17:09.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.321+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~4K1MBNSWZSB8.1 size=1048576 2024-09-14T11:17:09.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.321+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~4K1MBNSWZSB8.2 size=523137 2024-09-14T11:17:09.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.323+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=4K1MBNSWZSB8 tag=3QIT3UTMRPMT type=write size=3668865 2024-09-14T11:17:09.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.325+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~G5MLZ6FP4XYT.0 size=1048576 2024-09-14T11:17:09.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.326+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~G5MLZ6FP4XYT.1 size=264111 2024-09-14T11:17:09.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.326+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=G5MLZ6FP4XYT tag=PKR97HC9XJF0 type=write size=2361263 2024-09-14T11:17:09.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.327+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~BMHXCCO16UBY.0 size=1048576 2024-09-14T11:17:09.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.329+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~BMHXCCO16UBY.1 size=1048576 2024-09-14T11:17:09.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.330+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~BMHXCCO16UBY.2 size=1030289 2024-09-14T11:17:09.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.331+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=BMHXCCO16UBY tag=9BPYO6KIW8EO type=write size=4176017 2024-09-14T11:17:09.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.334+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~5A055TEVQLLS.0 size=1048576 2024-09-14T11:17:09.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.334+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~5A055TEVQLLS.1 size=1048576 2024-09-14T11:17:09.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.335+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~5A055TEVQLLS.2 size=471341 2024-09-14T11:17:09.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.335+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=5A055TEVQLLS tag=7GAE9BXZZW3A type=write size=3617069 2024-09-14T11:17:09.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.337+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=XMIF37YDQE5N type=del 2024-09-14T11:17:09.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.338+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=YGTZJBC1E7H5 type=del size=4049303 2024-09-14T11:17:09.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.340+0000 7f185d9f8780 1 < suggested remove operation key=ZR3IEW48CSCF tag=Q6URCZT8BDQR type=write 2024-09-14T11:17:09.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.341+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=HYQQI4I0MZFP type=del size=1450638 2024-09-14T11:17:09.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.343+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~6WTMG9OZQ5FT.0 size=1048576 2024-09-14T11:17:09.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.343+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~6WTMG9OZQ5FT.1 size=1048576 2024-09-14T11:17:09.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.344+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~6WTMG9OZQ5FT.2 size=610910 2024-09-14T11:17:09.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.346+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=6WTMG9OZQ5FT tag=R21E9KGPQ2L7 type=write size=3756638 2024-09-14T11:17:09.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.348+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=70I8PF5M4IEC type=write size=776649 2024-09-14T11:17:09.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.348+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~4FXIB7VPWZE9.0 size=296383 2024-09-14T11:17:09.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.350+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=4FXIB7VPWZE9 tag=E4RIP9U9BHEE type=write size=1344959 2024-09-14T11:17:09.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.352+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~70OD7C2WXPU8.0 size=1048576 2024-09-14T11:17:09.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.353+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~70OD7C2WXPU8.1 size=1048576 2024-09-14T11:17:09.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.354+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~70OD7C2WXPU8.2 size=32792 2024-09-14T11:17:09.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.354+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=70OD7C2WXPU8 tag=T2X7LJQAP1AV type=write size=3178520 2024-09-14T11:17:09.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.355+0000 7f185d9f8780 -1 < failed to complete operation key=ZR3IEW48CSCF tag=M30HVK19SHJE type=del size=2021300: (22) Invalid argument 2024-09-14T11:17:09.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.356+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=CDB0E5VKT4B2 type=write size=753728 2024-09-14T11:17:09.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.357+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=OR1VM2EKU957 type=del 2024-09-14T11:17:09.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.358+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=UFSMXWTHJF4Q type=del size=1788261 2024-09-14T11:17:09.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.360+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~4QC87F0MA586.0 size=635739 2024-09-14T11:17:09.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.362+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=4QC87F0MA586 tag=X7IY1XZUA1C1 type=write size=1684315 2024-09-14T11:17:09.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.363+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=FCOO0M6VPY84 type=del size=2617668 2024-09-14T11:17:09.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.364+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=7GAPFD0BPDX7 type=del 2024-09-14T11:17:09.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.366+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~GZ1FVA28LYKT.0 size=1048576 2024-09-14T11:17:09.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.367+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~GZ1FVA28LYKT.1 size=605454 2024-09-14T11:17:09.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.367+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=GZ1FVA28LYKT tag=4DDXRE9PBE7C type=write size=2702606 2024-09-14T11:17:09.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.368+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~GG7EGPGWWZJZ.0 size=976983 2024-09-14T11:17:09.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.371+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=GG7EGPGWWZJZ tag=WHSFOQ2TFMHM type=write size=2025559 2024-09-14T11:17:09.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.373+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~P9IETX573QW6.0 size=985012 2024-09-14T11:17:09.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.373+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=P9IETX573QW6 tag=Z7C947L5FJ0P type=write size=2033588 2024-09-14T11:17:09.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.374+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=4IS5SL09FJBB type=del 2024-09-14T11:17:09.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.376+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~CMAOX6UZSTFH.0 size=1048576 2024-09-14T11:17:09.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.377+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~CMAOX6UZSTFH.1 size=1048576 2024-09-14T11:17:09.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.378+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~CMAOX6UZSTFH.2 size=156050 2024-09-14T11:17:09.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.378+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=CMAOX6UZSTFH tag=7V8JRUB2H8PO type=write size=3301778 2024-09-14T11:17:09.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.379+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~XI6DU3O1W9MC.0 size=683890 2024-09-14T11:17:09.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.381+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=XI6DU3O1W9MC tag=IKY72AXUPKPG type=write size=1732466 2024-09-14T11:17:09.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.383+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~VLZ9JDVUBE8I.0 size=726944 2024-09-14T11:17:09.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.383+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=VLZ9JDVUBE8I tag=IETROE3J0Q3N type=write size=1775520 2024-09-14T11:17:09.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.384+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=PLKLIL87JKTE type=del 2024-09-14T11:17:09.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.387+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E2GP28T21GCE.0 size=400827 2024-09-14T11:17:09.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.387+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=E2GP28T21GCE tag=44M04K4W49EL type=write size=1449403 2024-09-14T11:17:09.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.388+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=TBJ1N4YO5G3X type=del 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.390+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~TWBT8HE4OER2.0 size=1048576 2024-09-14T11:17:09.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.391+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~TWBT8HE4OER2.1 size=1048576 2024-09-14T11:17:09.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.392+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~TWBT8HE4OER2.2 size=310928 2024-09-14T11:17:09.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.392+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=TWBT8HE4OER2 tag=781UIYELVAWF type=write size=3456656 2024-09-14T11:17:09.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.393+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~O4RL43F3UJ8T.0 size=1048576 2024-09-14T11:17:09.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.394+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~O4RL43F3UJ8T.1 size=918592 2024-09-14T11:17:09.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.397+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=O4RL43F3UJ8T tag=0INV1I4U0F80 type=write size=3015744 2024-09-14T11:17:09.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.398+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=2J420OYZYDNH type=del size=3100001 2024-09-14T11:17:09.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.399+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~G5MLZ6FP4XYT.0 size=1048576 2024-09-14T11:17:09.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.400+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~G5MLZ6FP4XYT.1 size=264111 2024-09-14T11:17:09.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.402+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=G5MLZ6FP4XYT tag=PKR97HC9XJF0 type=write size=2361263 2024-09-14T11:17:09.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.404+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=HQSJWCNAGV3Y type=del size=263251 2024-09-14T11:17:09.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.405+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~5A055TEVQLLS.0 size=1048576 2024-09-14T11:17:09.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.406+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~5A055TEVQLLS.1 size=1048576 2024-09-14T11:17:09.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.407+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~5A055TEVQLLS.2 size=471341 2024-09-14T11:17:09.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.409+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=5A055TEVQLLS tag=7GAE9BXZZW3A type=write size=3617069 2024-09-14T11:17:09.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.411+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~QY05VQW1H6HH.0 size=1048576 2024-09-14T11:17:09.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.412+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~QY05VQW1H6HH.1 size=1048576 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.412+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~QY05VQW1H6HH.2 size=683279 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.412+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=QY05VQW1H6HH tag=NOM4LI23KT4E type=write size=3829007 2024-09-14T11:17:09.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.415+0000 7f185d9f8780 1 < suggested remove operation key=OYZIXCSGXTHR tag=YGTZJBC1E7H5 type=del 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.416+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=LP7NH6C9H5R8 type=del size=778431 2024-09-14T11:17:09.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.418+0000 7f185d9f8780 1 < suggested update operation key=CRZOT1D0U2F3 tag=HYQQI4I0MZFP type=del size=1450638 2024-09-14T11:17:09.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.420+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~5OE1NMGUEZIO.0 size=133539 2024-09-14T11:17:09.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.420+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=5OE1NMGUEZIO tag=W3U4WS3VA4RZ type=write size=1182115 2024-09-14T11:17:09.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.422+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=70I8PF5M4IEC type=write size=776649 2024-09-14T11:17:09.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.424+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~JBP253ZKQS52.0 size=1048576 2024-09-14T11:17:09.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.425+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~JBP253ZKQS52.1 size=331770 2024-09-14T11:17:09.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.425+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=JBP253ZKQS52 tag=BEO3YLWCC04V type=write size=2428922 2024-09-14T11:17:09.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.426+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~70OD7C2WXPU8.0 size=1048576 2024-09-14T11:17:09.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.427+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~70OD7C2WXPU8.1 size=1048576 2024-09-14T11:17:09.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.428+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~70OD7C2WXPU8.2 size=32792 2024-09-14T11:17:09.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.430+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=70OD7C2WXPU8 tag=T2X7LJQAP1AV type=write size=3178520 2024-09-14T11:17:09.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.432+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~QEPI8A6TBIO3.0 size=1048576 2024-09-14T11:17:09.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.433+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~QEPI8A6TBIO3.1 size=1048576 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.434+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~QEPI8A6TBIO3.2 size=230359 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.434+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=QEPI8A6TBIO3 tag=YHS9LJ99RMKS type=write size=3376087 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.435+0000 7f185d9f8780 1 < completed write operation key=LGLAG80GX8GF tag=CDB0E5VKT4B2 type=write size=753728 2024-09-14T11:17:09.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.437+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~23PBPO7GZLTP.0 size=1048576 2024-09-14T11:17:09.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.438+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~23PBPO7GZLTP.1 size=549221 2024-09-14T11:17:09.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.438+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=23PBPO7GZLTP tag=EZ148UXT91RP type=write size=2646373 2024-09-14T11:17:09.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.439+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=UFSMXWTHJF4Q type=del 2024-09-14T11:17:09.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.440+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=XV0P72N5A983 type=del size=2986526 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.441+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=FCOO0M6VPY84 type=del 2024-09-14T11:17:09.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.443+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=8G1TE0HMB1UJ type=write size=395703 2024-09-14T11:17:09.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.444+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~GZ1FVA28LYKT.0 size=1048576 2024-09-14T11:17:09.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.445+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~GZ1FVA28LYKT.1 size=605454 2024-09-14T11:17:09.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.447+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=GZ1FVA28LYKT tag=4DDXRE9PBE7C type=write size=2702606 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.449+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~6IM7D9ZQ8N1X.0 size=1048576 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.450+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~6IM7D9ZQ8N1X.1 size=1048576 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.451+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~6IM7D9ZQ8N1X.2 size=889957 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.451+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=6IM7D9ZQ8N1X tag=OVV730VC59YO type=write size=4035685 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.452+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~P9IETX573QW6.0 size=985012 2024-09-14T11:17:09.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.455+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=P9IETX573QW6 tag=Z7C947L5FJ0P type=write size=2033588 2024-09-14T11:17:09.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.457+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~XG3DRNZA5AFG.0 size=1048576 2024-09-14T11:17:09.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.457+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~XG3DRNZA5AFG.1 size=60570 2024-09-14T11:17:09.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.457+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=XG3DRNZA5AFG tag=B2VR71D5H8L5 type=write size=2157722 2024-09-14T11:17:09.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.459+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~CMAOX6UZSTFH.0 size=1048576 2024-09-14T11:17:09.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.460+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~CMAOX6UZSTFH.1 size=1048576 2024-09-14T11:17:09.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.460+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~CMAOX6UZSTFH.2 size=156050 2024-09-14T11:17:09.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.462+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=CMAOX6UZSTFH tag=7V8JRUB2H8PO type=write size=3301778 2024-09-14T11:17:09.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.463+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=HT1G19PP6EWV type=del size=1146921 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.465+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~VLZ9JDVUBE8I.0 size=726944 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.466+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=VLZ9JDVUBE8I tag=IETROE3J0Q3N type=write size=1775520 2024-09-14T11:17:09.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.468+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=W4PW6188YU19 type=del size=2448587 2024-09-14T11:17:09.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.469+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~E2GP28T21GCE.0 size=400827 2024-09-14T11:17:09.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.471+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=E2GP28T21GCE tag=44M04K4W49EL type=write size=1449403 2024-09-14T11:17:09.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.473+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~9KK3BXPPSWM8.0 size=1048576 2024-09-14T11:17:09.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.474+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~9KK3BXPPSWM8.1 size=1048576 2024-09-14T11:17:09.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.475+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~9KK3BXPPSWM8.2 size=967674 2024-09-14T11:17:09.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.475+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=9KK3BXPPSWM8 tag=4BI4ISSK1ICY type=write size=4113402 2024-09-14T11:17:09.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.476+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~TWBT8HE4OER2.0 size=1048576 2024-09-14T11:17:09.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.477+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~TWBT8HE4OER2.1 size=1048576 2024-09-14T11:17:09.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.478+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~TWBT8HE4OER2.2 size=310928 2024-09-14T11:17:09.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.480+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=TWBT8HE4OER2 tag=781UIYELVAWF type=write size=3456656 2024-09-14T11:17:09.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.481+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=39W9KWMCDK4W type=del size=1280902 2024-09-14T11:17:09.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.482+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=2J420OYZYDNH type=del 2024-09-14T11:17:09.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.483+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=C5WEC6GBNL1B type=del size=4099811 2024-09-14T11:17:09.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.486+0000 7f185d9f8780 1 < suggested remove operation key=O2Y34FSQHS1S tag=HQSJWCNAGV3Y type=del 2024-09-14T11:17:09.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.487+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=7O0OI8AQUOEU type=write size=787686 2024-09-14T11:17:09.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.489+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~QY05VQW1H6HH.0 size=1048576 2024-09-14T11:17:09.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.489+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~QY05VQW1H6HH.1 size=1048576 2024-09-14T11:17:09.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.490+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~QY05VQW1H6HH.2 size=683279 2024-09-14T11:17:09.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.492+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=QY05VQW1H6HH tag=NOM4LI23KT4E type=write size=3829007 2024-09-14T11:17:09.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.494+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=6U9UEJX5EZCL type=del size=468084 2024-09-14T11:17:09.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.495+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=LP7NH6C9H5R8 type=del 2024-09-14T11:17:09.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.497+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~TLQVJ9SHPD04.0 size=1048576 2024-09-14T11:17:09.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.498+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~TLQVJ9SHPD04.1 size=1048576 2024-09-14T11:17:09.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.499+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~TLQVJ9SHPD04.2 size=631674 2024-09-14T11:17:09.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.499+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=TLQVJ9SHPD04 tag=0MQCICND8HJD type=write size=3777402 2024-09-14T11:17:09.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.500+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~5OE1NMGUEZIO.0 size=133539 2024-09-14T11:17:09.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.502+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=5OE1NMGUEZIO tag=W3U4WS3VA4RZ type=write size=1182115 2024-09-14T11:17:09.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.506+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~QBDA3JDZEZVK.0 size=1048576 2024-09-14T11:17:09.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.507+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~QBDA3JDZEZVK.1 size=1048576 2024-09-14T11:17:09.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.508+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~QBDA3JDZEZVK.2 size=182556 2024-09-14T11:17:09.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.508+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=QBDA3JDZEZVK tag=9UX29YWNKX8A type=write size=3328284 2024-09-14T11:17:09.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.509+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~JBP253ZKQS52.0 size=1048576 2024-09-14T11:17:09.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.510+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~JBP253ZKQS52.1 size=331770 2024-09-14T11:17:09.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.512+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=JBP253ZKQS52 tag=BEO3YLWCC04V type=write size=2428922 2024-09-14T11:17:09.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.513+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=PFSFMCHLNYJ5 type=del size=2005484 2024-09-14T11:17:09.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.514+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~QEPI8A6TBIO3.0 size=1048576 2024-09-14T11:17:09.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.515+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~QEPI8A6TBIO3.1 size=1048576 2024-09-14T11:17:09.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.516+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~QEPI8A6TBIO3.2 size=230359 2024-09-14T11:17:09.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.518+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=QEPI8A6TBIO3 tag=YHS9LJ99RMKS type=write size=3376087 2024-09-14T11:17:09.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.519+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=OTQUH08RXJQE type=write size=911222 2024-09-14T11:17:09.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.520+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~23PBPO7GZLTP.0 size=1048576 2024-09-14T11:17:09.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.520+0000 7f185d9f8780 1 < canceled part key=_multipart_P30WF4R3UFPX.2~23PBPO7GZLTP.1 size=549221 2024-09-14T11:17:09.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.522+0000 7f185d9f8780 1 < canceled multipart upload key=P30WF4R3UFPX upload=23PBPO7GZLTP tag=EZ148UXT91RP type=write size=2646373 2024-09-14T11:17:09.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.524+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=IF1Q1GZVRIUV type=write size=917765 2024-09-14T11:17:09.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.525+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=XV0P72N5A983 type=del 2024-09-14T11:17:09.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.526+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=MKCXMBX9UVDI type=del size=3306881 2024-09-14T11:17:09.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.528+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=8G1TE0HMB1UJ type=write size=395703 2024-09-14T11:17:09.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.530+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~AVZQFFQCGVZ7.0 size=1048576 2024-09-14T11:17:09.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.531+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~AVZQFFQCGVZ7.1 size=1048576 2024-09-14T11:17:09.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.532+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~AVZQFFQCGVZ7.2 size=818373 2024-09-14T11:17:09.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.532+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=AVZQFFQCGVZ7 tag=ZIVJ2GXQV4A0 type=write size=3964101 2024-09-14T11:17:09.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.533+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~6IM7D9ZQ8N1X.0 size=1048576 2024-09-14T11:17:09.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.534+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~6IM7D9ZQ8N1X.1 size=1048576 2024-09-14T11:17:09.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.535+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~6IM7D9ZQ8N1X.2 size=889957 2024-09-14T11:17:09.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.537+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=6IM7D9ZQ8N1X tag=OVV730VC59YO type=write size=4035685 2024-09-14T11:17:09.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.539+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~1V2HGXMHZ25U.0 size=1048576 2024-09-14T11:17:09.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.540+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~1V2HGXMHZ25U.1 size=947957 2024-09-14T11:17:09.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.540+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=1V2HGXMHZ25U tag=5G3S31QPOHH4 type=write size=3045109 2024-09-14T11:17:09.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.541+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~XG3DRNZA5AFG.0 size=1048576 2024-09-14T11:17:09.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.542+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~XG3DRNZA5AFG.1 size=60570 2024-09-14T11:17:09.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.544+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=XG3DRNZA5AFG tag=B2VR71D5H8L5 type=write size=2157722 2024-09-14T11:17:09.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.547+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~HHK9Q6UDOAPW.0 size=1048576 2024-09-14T11:17:09.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.547+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~HHK9Q6UDOAPW.1 size=1048576 2024-09-14T11:17:09.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.548+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~HHK9Q6UDOAPW.2 size=852260 2024-09-14T11:17:09.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.548+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=HHK9Q6UDOAPW tag=5R1C13WY2ECB type=write size=3997988 2024-09-14T11:17:09.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.549+0000 7f185d9f8780 1 < canceled operation key=CRZOT1D0U2F3 tag=HT1G19PP6EWV type=del size=1146921 2024-09-14T11:17:09.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.551+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~F1Z00ZH8DQ4W.0 size=1048576 2024-09-14T11:17:09.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.552+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~F1Z00ZH8DQ4W.1 size=1048576 2024-09-14T11:17:09.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.553+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~F1Z00ZH8DQ4W.2 size=796617 2024-09-14T11:17:09.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.553+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=F1Z00ZH8DQ4W tag=RSTU9OZNOCQE type=write size=3942345 2024-09-14T11:17:09.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.555+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=W4PW6188YU19 type=del 2024-09-14T11:17:09.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.556+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=IWJYCAKUZSJR type=del size=660971 2024-09-14T11:17:09.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.557+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~9KK3BXPPSWM8.0 size=1048576 2024-09-14T11:17:09.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.558+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~9KK3BXPPSWM8.1 size=1048576 2024-09-14T11:17:09.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.558+0000 7f185d9f8780 1 < canceled part key=_multipart_W24KN3J819EB.2~9KK3BXPPSWM8.2 size=967674 2024-09-14T11:17:09.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.560+0000 7f185d9f8780 1 < canceled multipart upload key=W24KN3J819EB upload=9KK3BXPPSWM8 tag=4BI4ISSK1ICY type=write size=4113402 2024-09-14T11:17:09.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.561+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=9TT6LF8K6VE7 type=del size=1228940 2024-09-14T11:17:09.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.562+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=39W9KWMCDK4W type=del 2024-09-14T11:17:09.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.564+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~H03N1E2HS606.0 size=1048576 2024-09-14T11:17:09.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.565+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~H03N1E2HS606.1 size=1048576 2024-09-14T11:17:09.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.567+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~H03N1E2HS606.2 size=55035 2024-09-14T11:17:09.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.567+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=H03N1E2HS606 tag=UB1CIXI4TTES type=write size=3200763 2024-09-14T11:17:09.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.568+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=C5WEC6GBNL1B type=del 2024-09-14T11:17:09.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.569+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=LK9OSJ1PN7LK type=del size=1231951 2024-09-14T11:17:09.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.570+0000 7f185d9f8780 1 < completed write operation key=N040R6OERAJP tag=7O0OI8AQUOEU type=write size=787686 2024-09-14T11:17:09.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.571+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=63GJCF2EBOZD type=del size=2924431 2024-09-14T11:17:09.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.573+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=6U9UEJX5EZCL type=del 2024-09-14T11:17:09.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.574+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=P0AD26JRRP1T type=del size=4104666 2024-09-14T11:17:09.574 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.576+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~TLQVJ9SHPD04.0 size=1048576 2024-09-14T11:17:09.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.577+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~TLQVJ9SHPD04.1 size=1048576 2024-09-14T11:17:09.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.579+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~TLQVJ9SHPD04.2 size=631674 2024-09-14T11:17:09.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.581+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=TLQVJ9SHPD04 tag=0MQCICND8HJD type=write size=3777402 2024-09-14T11:17:09.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.583+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~VX0L1Q6Q0BAD.0 size=1048576 2024-09-14T11:17:09.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.584+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~VX0L1Q6Q0BAD.1 size=1048576 2024-09-14T11:17:09.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.585+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~VX0L1Q6Q0BAD.2 size=300611 2024-09-14T11:17:09.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.585+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=VX0L1Q6Q0BAD tag=WKQ8NQINW91C type=write size=3446339 2024-09-14T11:17:09.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.587+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~QBDA3JDZEZVK.0 size=1048576 2024-09-14T11:17:09.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.588+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~QBDA3JDZEZVK.1 size=1048576 2024-09-14T11:17:09.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.589+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~QBDA3JDZEZVK.2 size=182556 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.591+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=QBDA3JDZEZVK tag=9UX29YWNKX8A type=write size=3328284 2024-09-14T11:17:09.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.593+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~2O5FKGP9BECU.0 size=1048576 2024-09-14T11:17:09.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.594+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~2O5FKGP9BECU.1 size=689271 2024-09-14T11:17:09.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.594+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=2O5FKGP9BECU tag=4X36EQN5RHZH type=write size=2786423 2024-09-14T11:17:09.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.595+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=PFSFMCHLNYJ5 type=del 2024-09-14T11:17:09.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.597+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CU2J36SC03UN.0 size=1048576 2024-09-14T11:17:09.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.598+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CU2J36SC03UN.1 size=1048576 2024-09-14T11:17:09.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.599+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CU2J36SC03UN.2 size=100457 2024-09-14T11:17:09.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.599+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=CU2J36SC03UN tag=JRNYTL1WYZOL type=write size=3246185 2024-09-14T11:17:09.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.601+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=OTQUH08RXJQE type=write size=911222 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.603+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~BPWSUZJ1N2UB.0 size=1048576 2024-09-14T11:17:09.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.604+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~BPWSUZJ1N2UB.1 size=1036735 2024-09-14T11:17:09.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.604+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=BPWSUZJ1N2UB tag=XA8LPSWKZX9K type=write size=3133887 2024-09-14T11:17:09.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.606+0000 7f185d9f8780 1 < suggested remove operation key=O2Y34FSQHS1S tag=IF1Q1GZVRIUV type=write 2024-09-14T11:17:09.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.609+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~G70QGW0PGTI6.0 size=99407 2024-09-14T11:17:09.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.609+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=G70QGW0PGTI6 tag=19T8OFWTPFCE type=write size=1147983 2024-09-14T11:17:09.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.610+0000 7f185d9f8780 -1 < failed to complete operation key=WPBYTFP7HRVE tag=MKCXMBX9UVDI type=del size=3306881: (22) Invalid argument 2024-09-14T11:17:09.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.611+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=333AYDSA0K5C type=del size=3388466 2024-09-14T11:17:09.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.612+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~AVZQFFQCGVZ7.0 size=1048576 2024-09-14T11:17:09.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.614+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~AVZQFFQCGVZ7.1 size=1048576 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.616+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~AVZQFFQCGVZ7.2 size=818373 2024-09-14T11:17:09.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.618+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=AVZQFFQCGVZ7 tag=ZIVJ2GXQV4A0 type=write size=3964101 2024-09-14T11:17:09.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.619+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=HBDMK1YF7H8X type=write size=795400 2024-09-14T11:17:09.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.619+0000 7f185d9f8780 1 < canceled part key=_multipart_M4FJDW1QHGBM.2~1V2HGXMHZ25U.0 size=1048576 2024-09-14T11:17:09.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.620+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~1V2HGXMHZ25U.1 size=947957 2024-09-14T11:17:09.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.622+0000 7f185d9f8780 1 < canceled multipart upload key=M4FJDW1QHGBM upload=1V2HGXMHZ25U tag=5G3S31QPOHH4 type=write size=3045109 2024-09-14T11:17:09.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.623+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=G59BU0PBRFYG type=write size=903972 2024-09-14T11:17:09.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.624+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~HHK9Q6UDOAPW.0 size=1048576 2024-09-14T11:17:09.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.625+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~HHK9Q6UDOAPW.1 size=1048576 2024-09-14T11:17:09.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.626+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~HHK9Q6UDOAPW.2 size=852260 2024-09-14T11:17:09.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.628+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=HHK9Q6UDOAPW tag=5R1C13WY2ECB type=write size=3997988 2024-09-14T11:17:09.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.630+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~YD5I10D5J9OU.0 size=1048576 2024-09-14T11:17:09.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.631+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~YD5I10D5J9OU.1 size=1048576 2024-09-14T11:17:09.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.632+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~YD5I10D5J9OU.2 size=956620 2024-09-14T11:17:09.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.632+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=YD5I10D5J9OU tag=85PTBTXIK3ZJ type=write size=4102348 2024-09-14T11:17:09.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.633+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~F1Z00ZH8DQ4W.0 size=1048576 2024-09-14T11:17:09.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.634+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~F1Z00ZH8DQ4W.1 size=1048576 2024-09-14T11:17:09.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.635+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~F1Z00ZH8DQ4W.2 size=796617 2024-09-14T11:17:09.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.637+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=F1Z00ZH8DQ4W tag=RSTU9OZNOCQE type=write size=3942345 2024-09-14T11:17:09.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.639+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~6V13UNHMJ8HP.0 size=1048576 2024-09-14T11:17:09.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.640+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~6V13UNHMJ8HP.1 size=647358 2024-09-14T11:17:09.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.640+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=6V13UNHMJ8HP tag=6GEF1I950OVS type=write size=2744510 2024-09-14T11:17:09.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.641+0000 7f185d9f8780 -1 < failed to complete operation key=O2Y34FSQHS1S tag=IWJYCAKUZSJR type=del size=660971: (22) Invalid argument 2024-09-14T11:17:09.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.643+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~0JC9LE71KY6S.0 size=1048576 2024-09-14T11:17:09.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.644+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~0JC9LE71KY6S.1 size=1033599 2024-09-14T11:17:09.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.644+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=0JC9LE71KY6S tag=FO3QQ46U0T3T type=write size=3130751 2024-09-14T11:17:09.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.646+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=9TT6LF8K6VE7 type=del 2024-09-14T11:17:09.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.647+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=EBFF6O3Q0VLQ type=write size=1048462 2024-09-14T11:17:09.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.647+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~H03N1E2HS606.0 size=1048576 2024-09-14T11:17:09.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.648+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~H03N1E2HS606.1 size=1048576 2024-09-14T11:17:09.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.648+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~H03N1E2HS606.2 size=55035 2024-09-14T11:17:09.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.650+0000 7f185d9f8780 1 < canceled multipart upload key=SEI774TP8YMJ upload=H03N1E2HS606 tag=UB1CIXI4TTES type=write size=3200763 2024-09-14T11:17:09.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.652+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~2B2MKEE63M3X.0 size=1048576 2024-09-14T11:17:09.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.653+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~2B2MKEE63M3X.1 size=760922 2024-09-14T11:17:09.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.653+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=2B2MKEE63M3X tag=JYHEUB9RO8N2 type=write size=2858074 2024-09-14T11:17:09.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.656+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=LK9OSJ1PN7LK type=del 2024-09-14T11:17:09.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.657+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=UE7JQVZRRQ09 type=del size=955758 2024-09-14T11:17:09.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.658+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=63GJCF2EBOZD type=del 2024-09-14T11:17:09.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.659+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=5QOM9HL45L22 type=del size=1503411 2024-09-14T11:17:09.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.661+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=P0AD26JRRP1T type=del 2024-09-14T11:17:09.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.663+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~Z0M7B0BRML6X.0 size=1048576 2024-09-14T11:17:09.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.664+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~Z0M7B0BRML6X.1 size=514824 2024-09-14T11:17:09.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.664+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=Z0M7B0BRML6X tag=ACKMYT1RRPUV type=write size=2611976 2024-09-14T11:17:09.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.664+0000 7f185d9f8780 1 < canceled part key=_multipart_W24KN3J819EB.2~VX0L1Q6Q0BAD.0 size=1048576 2024-09-14T11:17:09.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.665+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~VX0L1Q6Q0BAD.1 size=1048576 2024-09-14T11:17:09.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.665+0000 7f185d9f8780 1 < canceled part key=_multipart_W24KN3J819EB.2~VX0L1Q6Q0BAD.2 size=300611 2024-09-14T11:17:09.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.667+0000 7f185d9f8780 1 < canceled multipart upload key=W24KN3J819EB upload=VX0L1Q6Q0BAD tag=WKQ8NQINW91C type=write size=3446339 2024-09-14T11:17:09.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.670+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~IE938XMDAXMT.0 size=1048576 2024-09-14T11:17:09.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.671+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~IE938XMDAXMT.1 size=1048576 2024-09-14T11:17:09.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.671+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~IE938XMDAXMT.2 size=711280 2024-09-14T11:17:09.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.671+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=IE938XMDAXMT tag=024807O3OSX3 type=write size=3857008 2024-09-14T11:17:09.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.673+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~2O5FKGP9BECU.0 size=1048576 2024-09-14T11:17:09.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.674+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~2O5FKGP9BECU.1 size=689271 2024-09-14T11:17:09.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.675+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=2O5FKGP9BECU tag=4X36EQN5RHZH type=write size=2786423 2024-09-14T11:17:09.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.677+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=5MO5HKSYAHZG type=del size=4034176 2024-09-14T11:17:09.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.678+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~CU2J36SC03UN.0 size=1048576 2024-09-14T11:17:09.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.679+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~CU2J36SC03UN.1 size=1048576 2024-09-14T11:17:09.678 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.680+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~CU2J36SC03UN.2 size=100457 2024-09-14T11:17:09.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.682+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=CU2J36SC03UN tag=JRNYTL1WYZOL type=write size=3246185 2024-09-14T11:17:09.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.683+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=A4XTS5OBAEG3 type=write size=271351 2024-09-14T11:17:09.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.684+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~BPWSUZJ1N2UB.0 size=1048576 2024-09-14T11:17:09.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.685+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~BPWSUZJ1N2UB.1 size=1036735 2024-09-14T11:17:09.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.687+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=BPWSUZJ1N2UB tag=XA8LPSWKZX9K type=write size=3133887 2024-09-14T11:17:09.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.689+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~4SUWLFRRKU18.0 size=1048576 2024-09-14T11:17:09.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.690+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~4SUWLFRRKU18.1 size=1048576 2024-09-14T11:17:09.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.691+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~4SUWLFRRKU18.2 size=444715 2024-09-14T11:17:09.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.691+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=4SUWLFRRKU18 tag=CJ7KQOM63NQ2 type=write size=3590443 2024-09-14T11:17:09.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.692+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~G70QGW0PGTI6.0 size=99407 2024-09-14T11:17:09.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.694+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=G70QGW0PGTI6 tag=19T8OFWTPFCE type=write size=1147983 2024-09-14T11:17:09.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.695+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=V5WMRUT1K87Y type=del size=3753307 2024-09-14T11:17:09.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.696+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=333AYDSA0K5C type=del 2024-09-14T11:17:09.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.699+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~ZFY7BR48T85N.0 size=43599 2024-09-14T11:17:09.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.699+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=ZFY7BR48T85N tag=IZ5IXU38AUK9 type=write size=1092175 2024-09-14T11:17:09.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.700+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=HBDMK1YF7H8X type=write size=795400 2024-09-14T11:17:09.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.701+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=ZQWEQBQ0FCKJ type=del size=2304880 2024-09-14T11:17:09.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.702+0000 7f185d9f8780 1 < completed write operation key=XPMGVU0U52GS tag=G59BU0PBRFYG type=write size=903972 2024-09-14T11:17:09.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.704+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=NX2CKJRUDE3G type=del size=3076288 2024-09-14T11:17:09.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.705+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~YD5I10D5J9OU.0 size=1048576 2024-09-14T11:17:09.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.706+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~YD5I10D5J9OU.1 size=1048576 2024-09-14T11:17:09.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.707+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~YD5I10D5J9OU.2 size=956620 2024-09-14T11:17:09.707 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.709+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=YD5I10D5J9OU tag=85PTBTXIK3ZJ type=write size=4102348 2024-09-14T11:17:09.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.710+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=2D3JWSGXUH1J type=del size=3931146 2024-09-14T11:17:09.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.711+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~6V13UNHMJ8HP.0 size=1048576 2024-09-14T11:17:09.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.712+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~6V13UNHMJ8HP.1 size=647358 2024-09-14T11:17:09.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.714+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=6V13UNHMJ8HP tag=6GEF1I950OVS type=write size=2744510 2024-09-14T11:17:09.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.715+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=B11L4RKSZEJE type=del size=1664000 2024-09-14T11:17:09.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.716+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~0JC9LE71KY6S.0 size=1048576 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.717+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~0JC9LE71KY6S.1 size=1033599 2024-09-14T11:17:09.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.719+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=0JC9LE71KY6S tag=FO3QQ46U0T3T type=write size=3130751 2024-09-14T11:17:09.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.721+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=D3IFBD8CI4TH type=del size=205960 2024-09-14T11:17:09.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.722+0000 7f185d9f8780 1 < completed write operation key=830X857XIX9O tag=EBFF6O3Q0VLQ type=write size=1048462 2024-09-14T11:17:09.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.725+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~17XUS3WKA33Y.0 size=1048576 2024-09-14T11:17:09.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.726+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~17XUS3WKA33Y.1 size=1048576 2024-09-14T11:17:09.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.727+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~17XUS3WKA33Y.2 size=548485 2024-09-14T11:17:09.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.727+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=17XUS3WKA33Y tag=BZ09IGMD53YL type=write size=3694213 2024-09-14T11:17:09.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.728+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~2B2MKEE63M3X.0 size=1048576 2024-09-14T11:17:09.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.729+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~2B2MKEE63M3X.1 size=760922 2024-09-14T11:17:09.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.731+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=2B2MKEE63M3X tag=JYHEUB9RO8N2 type=write size=2858074 2024-09-14T11:17:09.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.733+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~ZQP3LN3QEAJU.0 size=428023 2024-09-14T11:17:09.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.733+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=ZQP3LN3QEAJU tag=1QG3L9GDHLPS type=write size=1476599 2024-09-14T11:17:09.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.735+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=UE7JQVZRRQ09 type=del 2024-09-14T11:17:09.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.736+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=OTYS7IB9IKPQ type=del size=1734002 2024-09-14T11:17:09.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.737+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=5QOM9HL45L22 type=del 2024-09-14T11:17:09.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.738+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=RN0O0OI2Y78R type=del size=459707 2024-09-14T11:17:09.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.739+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~Z0M7B0BRML6X.0 size=1048576 2024-09-14T11:17:09.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.740+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~Z0M7B0BRML6X.1 size=514824 2024-09-14T11:17:09.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.742+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=Z0M7B0BRML6X tag=ACKMYT1RRPUV type=write size=2611976 2024-09-14T11:17:09.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.744+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=I1C6A4WQ3NIL type=write size=383447 2024-09-14T11:17:09.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.745+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~IE938XMDAXMT.0 size=1048576 2024-09-14T11:17:09.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.746+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~IE938XMDAXMT.1 size=1048576 2024-09-14T11:17:09.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.747+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~IE938XMDAXMT.2 size=711280 2024-09-14T11:17:09.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.749+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=IE938XMDAXMT tag=024807O3OSX3 type=write size=3857008 2024-09-14T11:17:09.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.750+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=WW7B1MS11JM0 type=del size=1629834 2024-09-14T11:17:09.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.752+0000 7f185d9f8780 1 < suggested update operation key=N040R6OERAJP tag=5MO5HKSYAHZG type=del size=4034176 2024-09-14T11:17:09.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.755+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~KDKWNDJ3SNIE.0 size=378058 2024-09-14T11:17:09.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.755+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=KDKWNDJ3SNIE tag=6GWIU3GC3OU2 type=write size=1426634 2024-09-14T11:17:09.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.756+0000 7f185d9f8780 1 < completed write operation key=OYZIXCSGXTHR tag=A4XTS5OBAEG3 type=write size=271351 2024-09-14T11:17:09.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.757+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=SXTA81BDV7LB type=del size=3681376 2024-09-14T11:17:09.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.758+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~4SUWLFRRKU18.0 size=1048576 2024-09-14T11:17:09.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.759+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~4SUWLFRRKU18.1 size=1048576 2024-09-14T11:17:09.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.760+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~4SUWLFRRKU18.2 size=444715 2024-09-14T11:17:09.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.762+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=4SUWLFRRKU18 tag=CJ7KQOM63NQ2 type=write size=3590443 2024-09-14T11:17:09.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.763+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=AQWRS8DHV2IK type=del size=3638907 2024-09-14T11:17:09.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.764+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=V5WMRUT1K87Y type=del 2024-09-14T11:17:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.766+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=B9DQA9CSBY5K type=write size=461470 2024-09-14T11:17:09.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.767+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~ZFY7BR48T85N.0 size=43599 2024-09-14T11:17:09.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.769+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=ZFY7BR48T85N tag=IZ5IXU38AUK9 type=write size=1092175 2024-09-14T11:17:09.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.770+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=OMIL66VONZ0T type=del size=2416700 2024-09-14T11:17:09.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.771+0000 7f185d9f8780 -1 < failed to complete operation key=N040R6OERAJP tag=ZQWEQBQ0FCKJ type=del size=2304880: (22) Invalid argument 2024-09-14T11:17:09.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.773+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=GI5X9SHSO1P7 type=del size=92533 2024-09-14T11:17:09.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.774+0000 7f185d9f8780 1 < canceled operation key=55K4D3SEM068 tag=NX2CKJRUDE3G type=del size=3076288 2024-09-14T11:17:09.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.776+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=6YGV2P9KBFRN type=del size=457137 2024-09-14T11:17:09.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.778+0000 7f185d9f8780 1 < suggested remove operation key=W24KN3J819EB tag=2D3JWSGXUH1J type=del 2024-09-14T11:17:09.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.779+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=U47YIAGKBZ5L type=del size=325581 2024-09-14T11:17:09.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.780+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=B11L4RKSZEJE type=del size=1664000 2024-09-14T11:17:09.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.781+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=GJ1PJE8R8U04 type=del size=77082 2024-09-14T11:17:09.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.784+0000 7f185d9f8780 1 < suggested remove operation key=55K4D3SEM068 tag=D3IFBD8CI4TH type=del 2024-09-14T11:17:09.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.786+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~CA43Q6E2DQO5.0 size=1048576 2024-09-14T11:17:09.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.787+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~CA43Q6E2DQO5.1 size=1048576 2024-09-14T11:17:09.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.788+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~CA43Q6E2DQO5.2 size=644403 2024-09-14T11:17:09.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.788+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=CA43Q6E2DQO5 tag=8ZYG8XK6BB4M type=write size=3790131 2024-09-14T11:17:09.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.789+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~17XUS3WKA33Y.0 size=1048576 2024-09-14T11:17:09.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.790+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~17XUS3WKA33Y.1 size=1048576 2024-09-14T11:17:09.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.791+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~17XUS3WKA33Y.2 size=548485 2024-09-14T11:17:09.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.792+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=17XUS3WKA33Y tag=BZ09IGMD53YL type=write size=3694213 2024-09-14T11:17:09.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.795+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~75QG6EPJD9E7.0 size=36735 2024-09-14T11:17:09.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.795+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=75QG6EPJD9E7 tag=MVA223GTGO4Z type=write size=1085311 2024-09-14T11:17:09.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.796+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~ZQP3LN3QEAJU.0 size=428023 2024-09-14T11:17:09.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.798+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=ZQP3LN3QEAJU tag=1QG3L9GDHLPS type=write size=1476599 2024-09-14T11:17:09.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.799+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=XOIAW91HT503 type=write size=406315 2024-09-14T11:17:09.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.800+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=OTYS7IB9IKPQ type=del 2024-09-14T11:17:09.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.802+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~OO18PPQ7XG5X.0 size=406746 2024-09-14T11:17:09.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.802+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=OO18PPQ7XG5X tag=SXO348EWD7PA type=write size=1455322 2024-09-14T11:17:09.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.804+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=RN0O0OI2Y78R type=del 2024-09-14T11:17:09.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.806+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=6BG7WSXA1V2C type=del size=835505 2024-09-14T11:17:09.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.807+0000 7f185d9f8780 1 < completed write operation key=SEI774TP8YMJ tag=I1C6A4WQ3NIL type=write size=383447 2024-09-14T11:17:09.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.808+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=1ED6OWR2HD45 type=del size=1432297 2024-09-14T11:17:09.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.811+0000 7f185d9f8780 1 < suggested update operation key=JL2IH8NEX1YF tag=WW7B1MS11JM0 type=del size=1629834 2024-09-14T11:17:09.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.812+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=799A60ARGO8F type=del size=2444465 2024-09-14T11:17:09.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.812+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~KDKWNDJ3SNIE.0 size=378058 2024-09-14T11:17:09.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.814+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=KDKWNDJ3SNIE tag=6GWIU3GC3OU2 type=write size=1426634 2024-09-14T11:17:09.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.815+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=MCFVAQEE6AW1 type=write size=363991 2024-09-14T11:17:09.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.817+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=SXTA81BDV7LB type=del 2024-09-14T11:17:09.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.819+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~4B6A43DR9TBU.0 size=1048576 2024-09-14T11:17:09.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.820+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~4B6A43DR9TBU.1 size=878054 2024-09-14T11:17:09.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.820+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=4B6A43DR9TBU tag=KRL74SU5H4Q3 type=write size=2975206 2024-09-14T11:17:09.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.821+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=AQWRS8DHV2IK type=del 2024-09-14T11:17:09.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.822+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=H145DEXKIUK2 type=write size=759636 2024-09-14T11:17:09.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.824+0000 7f185d9f8780 1 < completed write operation key=U5S6L8GPSMU5 tag=B9DQA9CSBY5K type=write size=461470 2024-09-14T11:17:09.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.825+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=0HBZTBQ2HP76 type=write size=414797 2024-09-14T11:17:09.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.826+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=OMIL66VONZ0T type=del 2024-09-14T11:17:09.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.828+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=GN38XLU9434Z type=del size=3587222 2024-09-14T11:17:09.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.828+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=55K4D3SEM068 tag=GI5X9SHSO1P7 type=del size=92533: (2) No such file or directory 2024-09-14T11:17:09.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.829+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=SHCCD1V3AQRT type=del size=736245 2024-09-14T11:17:09.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.830+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=6YGV2P9KBFRN type=del 2024-09-14T11:17:09.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.832+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=YSGUUI9BV4C6 type=write size=587436 2024-09-14T11:17:09.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.833+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=U47YIAGKBZ5L type=del 2024-09-14T11:17:09.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.834+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=J6RYIXZWOTMM type=write size=1002864 2024-09-14T11:17:09.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.835+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=GJ1PJE8R8U04 type=del 2024-09-14T11:17:09.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.838+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~NEPHX8F5TDFX.0 size=596381 2024-09-14T11:17:09.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.838+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=NEPHX8F5TDFX tag=SAGQV8VODG2R type=write size=1644957 2024-09-14T11:17:09.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.839+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~CA43Q6E2DQO5.0 size=1048576 2024-09-14T11:17:09.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.840+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~CA43Q6E2DQO5.1 size=1048576 2024-09-14T11:17:09.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.841+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~CA43Q6E2DQO5.2 size=644403 2024-09-14T11:17:09.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.843+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=CA43Q6E2DQO5 tag=8ZYG8XK6BB4M type=write size=3790131 2024-09-14T11:17:09.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.845+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~KQKDUXS28GQX.0 size=1048576 2024-09-14T11:17:09.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.846+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~KQKDUXS28GQX.1 size=1048576 2024-09-14T11:17:09.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.847+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~KQKDUXS28GQX.2 size=634879 2024-09-14T11:17:09.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.847+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=KQKDUXS28GQX tag=PHZPEW8XHAND type=write size=3780607 2024-09-14T11:17:09.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.848+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~75QG6EPJD9E7.0 size=36735 2024-09-14T11:17:09.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.851+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=75QG6EPJD9E7 tag=MVA223GTGO4Z type=write size=1085311 2024-09-14T11:17:09.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.852+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=057Z70NZOX84 type=del size=3411198 2024-09-14T11:17:09.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.853+0000 7f185d9f8780 1 < completed write operation key=6B0SURI3Q8R6 tag=XOIAW91HT503 type=write size=406315 2024-09-14T11:17:09.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.855+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~IL0WILV08I9I.0 size=1048576 2024-09-14T11:17:09.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.856+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~IL0WILV08I9I.1 size=755655 2024-09-14T11:17:09.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.856+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=IL0WILV08I9I tag=T49D0KRI2T1O type=write size=2852807 2024-09-14T11:17:09.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.858+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~OO18PPQ7XG5X.0 size=406746 2024-09-14T11:17:09.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.860+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=OO18PPQ7XG5X tag=SXO348EWD7PA type=write size=1455322 2024-09-14T11:17:09.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.861+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=84HODDUDXQL0 type=del size=3879042 2024-09-14T11:17:09.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.862+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=6BG7WSXA1V2C type=del 2024-09-14T11:17:09.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.863+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=D21XYMB4461M type=del size=1760480 2024-09-14T11:17:09.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.864+0000 7f185d9f8780 -1 < failed to complete operation key=JL2IH8NEX1YF tag=1ED6OWR2HD45 type=del size=1432297: (22) Invalid argument 2024-09-14T11:17:09.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.866+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=7N3UNU5M2XWR type=del size=3876089 2024-09-14T11:17:09.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.867+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=799A60ARGO8F type=del 2024-09-14T11:17:09.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.869+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~FSAEHVMATQJF.0 size=1048576 2024-09-14T11:17:09.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.870+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~FSAEHVMATQJF.1 size=1048576 2024-09-14T11:17:09.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.871+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~FSAEHVMATQJF.2 size=651602 2024-09-14T11:17:09.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.871+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=FSAEHVMATQJF tag=XPR98KKA5728 type=write size=3797330 2024-09-14T11:17:09.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.872+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=MCFVAQEE6AW1 type=write size=363991 2024-09-14T11:17:09.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.874+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=GT17OC8D7R1Y type=write size=390642 2024-09-14T11:17:09.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.875+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~4B6A43DR9TBU.0 size=1048576 2024-09-14T11:17:09.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.876+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~4B6A43DR9TBU.1 size=878054 2024-09-14T11:17:09.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.878+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=4B6A43DR9TBU tag=KRL74SU5H4Q3 type=write size=2975206 2024-09-14T11:17:09.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.879+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=78GSA9WPCORE type=del size=340230 2024-09-14T11:17:09.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.880+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=H145DEXKIUK2 type=write size=759636 2024-09-14T11:17:09.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.881+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=GL97M2INC4TA type=write size=351840 2024-09-14T11:17:09.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.883+0000 7f185d9f8780 1 < suggested update operation key=7XGG5LBGRI4H tag=0HBZTBQ2HP76 type=write size=414797 2024-09-14T11:17:09.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.885+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~0BK4073PDPI1.0 size=247279 2024-09-14T11:17:09.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.885+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=0BK4073PDPI1 tag=IHOUAFBQK1QF type=write size=1295855 2024-09-14T11:17:09.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.886+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=GN38XLU9434Z type=del 2024-09-14T11:17:09.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.888+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=C2E6P6BZEGEG type=write size=385671 2024-09-14T11:17:09.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.889+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=SHCCD1V3AQRT type=del 2024-09-14T11:17:09.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.890+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=U1TUHL7VZSDB type=del size=3693505 2024-09-14T11:17:09.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.891+0000 7f185d9f8780 1 < completed write operation key=ESN8NVVJB3B0 tag=YSGUUI9BV4C6 type=write size=587436 2024-09-14T11:17:09.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.894+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~EOM9LXJWVLQG.0 size=1048576 2024-09-14T11:17:09.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.895+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~EOM9LXJWVLQG.1 size=1048576 2024-09-14T11:17:09.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.896+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~EOM9LXJWVLQG.2 size=901323 2024-09-14T11:17:09.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.896+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=EOM9LXJWVLQG tag=HLDRZV7MBMRW type=write size=4047051 2024-09-14T11:17:09.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.898+0000 7f185d9f8780 1 < suggested remove operation key=O2Y34FSQHS1S tag=J6RYIXZWOTMM type=write 2024-09-14T11:17:09.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.900+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~LITXBYWLYNL3.0 size=901280 2024-09-14T11:17:09.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.900+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=LITXBYWLYNL3 tag=3RTSGP62V2CE type=write size=1949856 2024-09-14T11:17:09.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.900+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~NEPHX8F5TDFX.0 size=596381 2024-09-14T11:17:09.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.902+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=NEPHX8F5TDFX tag=SAGQV8VODG2R type=write size=1644957 2024-09-14T11:17:09.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.904+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=NXDUEJ7OJO7I type=write size=456663 2024-09-14T11:17:09.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.905+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~KQKDUXS28GQX.0 size=1048576 2024-09-14T11:17:09.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.906+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~KQKDUXS28GQX.1 size=1048576 2024-09-14T11:17:09.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.907+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~KQKDUXS28GQX.2 size=634879 2024-09-14T11:17:09.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.909+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=KQKDUXS28GQX tag=PHZPEW8XHAND type=write size=3780607 2024-09-14T11:17:09.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.910+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=HAD9UKYCMMND type=write size=601127 2024-09-14T11:17:09.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.912+0000 7f185d9f8780 1 < canceled operation key=OYZIXCSGXTHR tag=057Z70NZOX84 type=del size=3411198 2024-09-14T11:17:09.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.913+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=IDAB08SB794W type=del size=2735578 2024-09-14T11:17:09.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.914+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~IL0WILV08I9I.0 size=1048576 2024-09-14T11:17:09.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.914+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~IL0WILV08I9I.1 size=755655 2024-09-14T11:17:09.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.916+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=IL0WILV08I9I tag=T49D0KRI2T1O type=write size=2852807 2024-09-14T11:17:09.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.918+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~SD9WXTEKFLC8.0 size=1048576 2024-09-14T11:17:09.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.919+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~SD9WXTEKFLC8.1 size=172274 2024-09-14T11:17:09.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.919+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=SD9WXTEKFLC8 tag=37G1PUKQ3QLE type=write size=2269426 2024-09-14T11:17:09.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.920+0000 7f185d9f8780 1 < canceled operation key=IXWIKD7J74RJ tag=84HODDUDXQL0 type=del size=3879042 2024-09-14T11:17:09.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.921+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=DA9D7X2QWEY7 type=del size=1009171 2024-09-14T11:17:09.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.922+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=D21XYMB4461M type=del 2024-09-14T11:17:09.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.924+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=ZFYXFD1CEXGH type=del size=3597264 2024-09-14T11:17:09.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.925+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=7N3UNU5M2XWR type=del 2024-09-14T11:17:09.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.926+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=WRVX1513OK5X type=write size=140526 2024-09-14T11:17:09.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.927+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~FSAEHVMATQJF.0 size=1048576 2024-09-14T11:17:09.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.927+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~FSAEHVMATQJF.1 size=1048576 2024-09-14T11:17:09.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.927+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~FSAEHVMATQJF.2 size=651602 2024-09-14T11:17:09.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.929+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=FSAEHVMATQJF tag=XPR98KKA5728 type=write size=3797330 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.931+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~9SAP6CXJTD72.0 size=163174 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.931+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=9SAP6CXJTD72 tag=T0Y1UNJ2CPSX type=write size=1211750 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.934+0000 7f185d9f8780 1 < suggested update operation key=CVVKY636WXG9 tag=GT17OC8D7R1Y type=write size=390642 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.935+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=LC8IT2PGC58U type=del size=229603 2024-09-14T11:17:09.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.937+0000 7f185d9f8780 1 < suggested remove operation key=P30WF4R3UFPX tag=78GSA9WPCORE type=del 2024-09-14T11:17:09.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.939+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~V7LGG1ROEZEQ.0 size=1048576 2024-09-14T11:17:09.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.940+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~V7LGG1ROEZEQ.1 size=1048576 2024-09-14T11:17:09.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.941+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~V7LGG1ROEZEQ.2 size=226474 2024-09-14T11:17:09.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.941+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=V7LGG1ROEZEQ tag=AQ624B47WOIH type=write size=3372202 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.942+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=GL97M2INC4TA type=write size=351840 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.945+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~6JBE0HYX25H8.0 size=205663 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.945+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=6JBE0HYX25H8 tag=3JKTCL8RJGIG type=write size=1254239 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.945+0000 7f185d9f8780 1 < canceled part key=_multipart_ZR3IEW48CSCF.2~0BK4073PDPI1.0 size=247279 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.947+0000 7f185d9f8780 1 < canceled multipart upload key=ZR3IEW48CSCF upload=0BK4073PDPI1 tag=IHOUAFBQK1QF type=write size=1295855 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.948+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=GN75VGK7YR4U type=write size=494705 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.950+0000 7f185d9f8780 1 < completed write operation key=JL2IH8NEX1YF tag=C2E6P6BZEGEG type=write size=385671 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.952+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~RK60KRFC52AQ.0 size=842235 2024-09-14T11:17:09.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.952+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=RK60KRFC52AQ tag=IV5J36M0XHIK type=write size=1890811 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.954+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=U1TUHL7VZSDB type=del 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.955+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=H9AARFU18YWI type=del size=2206391 2024-09-14T11:17:09.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.956+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~EOM9LXJWVLQG.0 size=1048576 2024-09-14T11:17:09.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.957+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~EOM9LXJWVLQG.1 size=1048576 2024-09-14T11:17:09.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.958+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~EOM9LXJWVLQG.2 size=901323 2024-09-14T11:17:09.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.960+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=EOM9LXJWVLQG tag=HLDRZV7MBMRW type=write size=4047051 2024-09-14T11:17:09.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.962+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~JMWWOEYKSFSD.0 size=1048576 2024-09-14T11:17:09.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.963+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~JMWWOEYKSFSD.1 size=873057 2024-09-14T11:17:09.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.963+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=JMWWOEYKSFSD tag=VKLEJUL08E75 type=write size=2970209 2024-09-14T11:17:09.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.964+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~LITXBYWLYNL3.0 size=901280 2024-09-14T11:17:09.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.966+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=LITXBYWLYNL3 tag=3RTSGP62V2CE type=write size=1949856 2024-09-14T11:17:09.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.967+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=1RBOA1HTUAWT type=del size=1298239 2024-09-14T11:17:09.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.968+0000 7f185d9f8780 1 < canceled operation key=L4L83NVMXHXZ tag=NXDUEJ7OJO7I type=write size=456663 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.970+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=ZJ7K2Q8E6LUM type=del size=1635744 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.971+0000 7f185d9f8780 1 < completed write operation key=6B0SURI3Q8R6 tag=HAD9UKYCMMND type=write size=601127 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.973+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~06GPFSG8ZNMV.0 size=979749 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.973+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=06GPFSG8ZNMV tag=UDBBRGTE34UK type=write size=2028325 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.974+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=IDAB08SB794W type=del 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.975+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=1DAREXMDKVF3 type=del size=1640572 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.976+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~SD9WXTEKFLC8.0 size=1048576 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.977+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~SD9WXTEKFLC8.1 size=172274 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.979+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=SD9WXTEKFLC8 tag=37G1PUKQ3QLE type=write size=2269426 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.980+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=LPQH41XO0Z3Q type=del size=3491287 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.982+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=DA9D7X2QWEY7 type=del 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.983+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=BHFS80YHXZDO type=del size=2717623 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.984+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=ZFYXFD1CEXGH type=del 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.986+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=1AFA8UENEZC7 type=del size=1964643 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.988+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=WRVX1513OK5X type=write size=140526 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.989+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=8W13UIP1B1WE type=del size=3929845 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.990+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~9SAP6CXJTD72.0 size=163174 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.992+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=9SAP6CXJTD72 tag=T0Y1UNJ2CPSX type=write size=1211750 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.993+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=B94S6HJHJK13 type=del size=3455462 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.995+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=LC8IT2PGC58U type=del 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.997+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~RN36ZI3LOPIC.0 size=1048576 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.998+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~RN36ZI3LOPIC.1 size=1048576 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.999+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~RN36ZI3LOPIC.2 size=892847 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:09.999+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=RN36ZI3LOPIC tag=VHOE63F706VK type=write size=4038575 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.000+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~V7LGG1ROEZEQ.0 size=1048576 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.000+0000 7f185d9f8780 1 < canceled part key=_multipart_XPMGVU0U52GS.2~V7LGG1ROEZEQ.1 size=1048576 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.001+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~V7LGG1ROEZEQ.2 size=226474 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.003+0000 7f185d9f8780 1 < canceled multipart upload key=XPMGVU0U52GS upload=V7LGG1ROEZEQ tag=AQ624B47WOIH type=write size=3372202 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.004+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=345DG2J1M3EC type=del size=600548 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.005+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~6JBE0HYX25H8.0 size=205663 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.007+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=6JBE0HYX25H8 tag=3JKTCL8RJGIG type=write size=1254239 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.008+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=2X2JCUXNB2ID type=del size=1213921 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.009+0000 7f185d9f8780 1 < completed write operation key=SEI774TP8YMJ tag=GN75VGK7YR4U type=write size=494705 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.011+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~G3WVZWU8AAYK.0 size=1048576 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.012+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~G3WVZWU8AAYK.1 size=1048576 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.013+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~G3WVZWU8AAYK.2 size=455808 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.013+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=G3WVZWU8AAYK tag=XMAXLVNPHS4Z type=write size=3601536 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.014+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~RK60KRFC52AQ.0 size=842235 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.016+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=RK60KRFC52AQ tag=IV5J36M0XHIK type=write size=1890811 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.018+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~7P8AH1JQ9TWD.0 size=943027 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.018+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=7P8AH1JQ9TWD tag=A3TQ7GBA34AV type=write size=1991603 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.020+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=H9AARFU18YWI type=del 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.021+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=WTG8KPPIN3JW type=del size=2514266 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.022+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~JMWWOEYKSFSD.0 size=1048576 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.023+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~JMWWOEYKSFSD.1 size=873057 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.025+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=JMWWOEYKSFSD tag=VKLEJUL08E75 type=write size=2970209 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.026+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=AXDIZZ3XBR0J type=del size=1819277 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.027+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=1RBOA1HTUAWT type=del 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.028+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=5L0N3F0ALBX3 type=del size=2151338 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.029+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=ZJ7K2Q8E6LUM type=del 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.031+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=RDLM3EZ3UXX2 type=del size=1506552 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.032+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~06GPFSG8ZNMV.0 size=979749 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.034+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=06GPFSG8ZNMV tag=UDBBRGTE34UK type=write size=2028325 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.036+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~YZXVSNAVTGGT.0 size=1048576 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.037+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~YZXVSNAVTGGT.1 size=214168 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.037+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=YZXVSNAVTGGT tag=RZBUFBYAA9AM type=write size=2311320 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.038+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=1DAREXMDKVF3 type=del 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.040+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~ZON6HA0I6PVG.0 size=1048576 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.041+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~ZON6HA0I6PVG.1 size=48572 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.041+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=ZON6HA0I6PVG tag=EDS3JF3CLU1J type=write size=2145724 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.042+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=LPQH41XO0Z3Q type=del 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.043+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=JZY17ZE8QT0K type=del size=2040230 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.044+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=BHFS80YHXZDO type=del 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.047+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~41F3N7DHF4ZN.0 size=130906 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.047+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=41F3N7DHF4ZN tag=SORWU9EFXXP7 type=write size=1179482 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.048+0000 7f185d9f8780 1 < canceled operation key=MPZOX5RU0580 tag=1AFA8UENEZC7 type=del size=1964643 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.050+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~CR2HLIVQU7YV.0 size=1048576 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.051+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~CR2HLIVQU7YV.1 size=51492 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.051+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=CR2HLIVQU7YV tag=PGMHFM2VE18U type=write size=2148644 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.052+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=8W13UIP1B1WE type=del size=3929845 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.054+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~H3G8830NBJCB.0 size=347143 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.054+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=H3G8830NBJCB tag=QMPEZNUXQYER type=write size=1395719 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.055+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=B94S6HJHJK13 type=del 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.057+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~4QLHR6XKZP2Y.0 size=1048576 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.058+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~4QLHR6XKZP2Y.1 size=1009320 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.058+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=4QLHR6XKZP2Y tag=1BYF4XAM9WM6 type=write size=3106472 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.061+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~RN36ZI3LOPIC.0 size=1048576 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.062+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~RN36ZI3LOPIC.1 size=1048576 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.063+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~RN36ZI3LOPIC.2 size=892847 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.065+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=RN36ZI3LOPIC tag=VHOE63F706VK type=write size=4038575 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.066+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=44KMA3R57VRC type=del size=1276640 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.067+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=345DG2J1M3EC type=del 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.068+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=XYC5XILB6XRC type=del size=3745538 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.069+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=2X2JCUXNB2ID type=del 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.070+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=TPB5SELGKB32 type=write size=774652 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.071+0000 7f185d9f8780 1 < canceled part key=_multipart_CJ6C03RXS0IW.2~G3WVZWU8AAYK.0 size=1048576 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.072+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~G3WVZWU8AAYK.1 size=1048576 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.073+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~G3WVZWU8AAYK.2 size=455808 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.075+0000 7f185d9f8780 1 < canceled multipart upload key=CJ6C03RXS0IW upload=G3WVZWU8AAYK tag=XMAXLVNPHS4Z type=write size=3601536 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.077+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~QS5B328EOLE6.0 size=1048576 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.078+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~QS5B328EOLE6.1 size=678680 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.078+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=QS5B328EOLE6 tag=0JZ5V62AOU6N type=write size=2775832 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.079+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~7P8AH1JQ9TWD.0 size=943027 2024-09-14T11:17:10.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.081+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=7P8AH1JQ9TWD tag=A3TQ7GBA34AV type=write size=1991603 2024-09-14T11:17:10.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.083+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~NCVMJ1ZDBV21.0 size=1048576 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.084+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~NCVMJ1ZDBV21.1 size=1048576 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.085+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~NCVMJ1ZDBV21.2 size=816724 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.085+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=NCVMJ1ZDBV21 tag=Q4V3AL5FRF7Q type=write size=3962452 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.086+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=WTG8KPPIN3JW type=del 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.088+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2ZOGIN36PNAV.0 size=1048576 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.089+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2ZOGIN36PNAV.1 size=1048576 2024-09-14T11:17:10.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.090+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2ZOGIN36PNAV.2 size=697261 2024-09-14T11:17:10.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.090+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=2ZOGIN36PNAV tag=01LPJYDZ94V7 type=write size=3842989 2024-09-14T11:17:10.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.092+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=AXDIZZ3XBR0J type=del size=1819277 2024-09-14T11:17:10.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.094+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DZXMNVINJ3B9.0 size=1048576 2024-09-14T11:17:10.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.095+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DZXMNVINJ3B9.1 size=1048576 2024-09-14T11:17:10.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.096+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DZXMNVINJ3B9.2 size=867044 2024-09-14T11:17:10.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.096+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=DZXMNVINJ3B9 tag=9UXVYT041H6N type=write size=4012772 2024-09-14T11:17:10.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.098+0000 7f185d9f8780 1 < suggested update operation key=SEI774TP8YMJ tag=5L0N3F0ALBX3 type=del size=2151338 2024-09-14T11:17:10.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.100+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=M7XXXBV9A2DB type=write size=97399 2024-09-14T11:17:10.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.101+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=RDLM3EZ3UXX2 type=del 2024-09-14T11:17:10.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.103+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~WGAP3EUGD5AX.0 size=1048576 2024-09-14T11:17:10.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.104+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~WGAP3EUGD5AX.1 size=1048576 2024-09-14T11:17:10.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.105+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~WGAP3EUGD5AX.2 size=867904 2024-09-14T11:17:10.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.105+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=WGAP3EUGD5AX tag=LKGBNQMDT0G6 type=write size=4013632 2024-09-14T11:17:10.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.106+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~YZXVSNAVTGGT.0 size=1048576 2024-09-14T11:17:10.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.107+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~YZXVSNAVTGGT.1 size=214168 2024-09-14T11:17:10.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.109+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=YZXVSNAVTGGT tag=RZBUFBYAA9AM type=write size=2311320 2024-09-14T11:17:10.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.110+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=M42V1C5VHQ5V type=del size=4188795 2024-09-14T11:17:10.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.111+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~ZON6HA0I6PVG.0 size=1048576 2024-09-14T11:17:10.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.112+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~ZON6HA0I6PVG.1 size=48572 2024-09-14T11:17:10.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.114+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=ZON6HA0I6PVG tag=EDS3JF3CLU1J type=write size=2145724 2024-09-14T11:17:10.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.115+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=YHISVEFQGD0D type=del size=2864546 2024-09-14T11:17:10.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.118+0000 7f185d9f8780 1 < suggested update operation key=CRZOT1D0U2F3 tag=JZY17ZE8QT0K type=del size=2040230 2024-09-14T11:17:10.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.119+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=BD0XM1WKIM6J type=write size=518562 2024-09-14T11:17:10.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.120+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~41F3N7DHF4ZN.0 size=130906 2024-09-14T11:17:10.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.122+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=41F3N7DHF4ZN tag=SORWU9EFXXP7 type=write size=1179482 2024-09-14T11:17:10.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.124+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=D8U1I7TY5Q31 type=write size=173987 2024-09-14T11:17:10.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.125+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~CR2HLIVQU7YV.0 size=1048576 2024-09-14T11:17:10.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.126+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~CR2HLIVQU7YV.1 size=51492 2024-09-14T11:17:10.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.128+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=CR2HLIVQU7YV tag=PGMHFM2VE18U type=write size=2148644 2024-09-14T11:17:10.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.129+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=YAKROA0YGBYB type=write size=525131 2024-09-14T11:17:10.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.131+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~H3G8830NBJCB.0 size=347143 2024-09-14T11:17:10.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.133+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=H3G8830NBJCB tag=QMPEZNUXQYER type=write size=1395719 2024-09-14T11:17:10.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.135+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~O9WW4PA3GS75.0 size=1048576 2024-09-14T11:17:10.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.136+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~O9WW4PA3GS75.1 size=116162 2024-09-14T11:17:10.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.136+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=O9WW4PA3GS75 tag=PVOHRSOBJ1G7 type=write size=2213314 2024-09-14T11:17:10.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.137+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~4QLHR6XKZP2Y.0 size=1048576 2024-09-14T11:17:10.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.138+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~4QLHR6XKZP2Y.1 size=1009320 2024-09-14T11:17:10.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.140+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=4QLHR6XKZP2Y tag=1BYF4XAM9WM6 type=write size=3106472 2024-09-14T11:17:10.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.141+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=Q49QJ7031T5V type=del size=3598343 2024-09-14T11:17:10.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.143+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=44KMA3R57VRC type=del 2024-09-14T11:17:10.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.144+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=9300TEVQN6LZ type=del size=1052290 2024-09-14T11:17:10.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.145+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=XYC5XILB6XRC type=del 2024-09-14T11:17:10.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.146+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=0XEWLZ90XSUL type=del size=308177 2024-09-14T11:17:10.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.148+0000 7f185d9f8780 1 < completed write operation key=XPMGVU0U52GS tag=TPB5SELGKB32 type=write size=774652 2024-09-14T11:17:10.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.149+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=MGJX52HETG2V type=del size=4021671 2024-09-14T11:17:10.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.150+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~QS5B328EOLE6.0 size=1048576 2024-09-14T11:17:10.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.152+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~QS5B328EOLE6.1 size=678680 2024-09-14T11:17:10.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.154+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=QS5B328EOLE6 tag=0JZ5V62AOU6N type=write size=2775832 2024-09-14T11:17:10.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.155+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=CNAW6G8HFA0W type=del size=1401108 2024-09-14T11:17:10.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.156+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~NCVMJ1ZDBV21.0 size=1048576 2024-09-14T11:17:10.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.157+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~NCVMJ1ZDBV21.1 size=1048576 2024-09-14T11:17:10.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.158+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~NCVMJ1ZDBV21.2 size=816724 2024-09-14T11:17:10.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.161+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=NCVMJ1ZDBV21 tag=Q4V3AL5FRF7Q type=write size=3962452 2024-09-14T11:17:10.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.162+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=DA9VEHBAP4TT type=del size=1582829 2024-09-14T11:17:10.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.163+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2ZOGIN36PNAV.0 size=1048576 2024-09-14T11:17:10.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.164+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2ZOGIN36PNAV.1 size=1048576 2024-09-14T11:17:10.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.165+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2ZOGIN36PNAV.2 size=697261 2024-09-14T11:17:10.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.167+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=2ZOGIN36PNAV tag=01LPJYDZ94V7 type=write size=3842989 2024-09-14T11:17:10.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.168+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=264SR4S69GJR type=del size=1209388 2024-09-14T11:17:10.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.170+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DZXMNVINJ3B9.0 size=1048576 2024-09-14T11:17:10.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.170+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~DZXMNVINJ3B9.1 size=1048576 2024-09-14T11:17:10.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.172+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DZXMNVINJ3B9.2 size=867044 2024-09-14T11:17:10.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.174+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=DZXMNVINJ3B9 tag=9UXVYT041H6N type=write size=4012772 2024-09-14T11:17:10.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.175+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=7D4KKYYQLJMC type=del size=48272 2024-09-14T11:17:10.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.176+0000 7f185d9f8780 1 < canceled operation key=XPMGVU0U52GS tag=M7XXXBV9A2DB type=write size=97399 2024-09-14T11:17:10.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.177+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=FILQ6TQNFISG type=del size=1134433 2024-09-14T11:17:10.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.178+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~WGAP3EUGD5AX.0 size=1048576 2024-09-14T11:17:10.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.179+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~WGAP3EUGD5AX.1 size=1048576 2024-09-14T11:17:10.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.180+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~WGAP3EUGD5AX.2 size=867904 2024-09-14T11:17:10.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.182+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=WGAP3EUGD5AX tag=LKGBNQMDT0G6 type=write size=4013632 2024-09-14T11:17:10.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.184+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~RBMAQ361W36W.0 size=1048576 2024-09-14T11:17:10.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.185+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~RBMAQ361W36W.1 size=917477 2024-09-14T11:17:10.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.185+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=RBMAQ361W36W tag=H4UJOICCHGXG type=write size=3014629 2024-09-14T11:17:10.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.187+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=M42V1C5VHQ5V type=del 2024-09-14T11:17:10.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.189+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~2MCQ2TUTS84L.0 size=1048576 2024-09-14T11:17:10.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.190+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~2MCQ2TUTS84L.1 size=73837 2024-09-14T11:17:10.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.190+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=2MCQ2TUTS84L tag=Q5KEXZ2WF5XM type=write size=2170989 2024-09-14T11:17:10.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.191+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=YHISVEFQGD0D type=del 2024-09-14T11:17:10.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.193+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~II0MVD28H649.0 size=329286 2024-09-14T11:17:10.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.193+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=II0MVD28H649 tag=301AKJH9Q2IP type=write size=1377862 2024-09-14T11:17:10.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.194+0000 7f185d9f8780 1 < completed write operation key=PSL63WUBLB75 tag=BD0XM1WKIM6J type=write size=518562 2024-09-14T11:17:10.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.197+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~1O06K8YTICVW.0 size=314482 2024-09-14T11:17:10.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.197+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=1O06K8YTICVW tag=CI7RL4J6MCJL type=write size=1363058 2024-09-14T11:17:10.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.199+0000 7f185d9f8780 1 < suggested remove operation key=ZR3IEW48CSCF tag=D8U1I7TY5Q31 type=write 2024-09-14T11:17:10.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.201+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=GODH5JH4T7A9 type=write size=1043947 2024-09-14T11:17:10.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.202+0000 7f185d9f8780 1 < canceled operation key=J6RN3WULDLQE tag=YAKROA0YGBYB type=write size=525131 2024-09-14T11:17:10.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.204+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~4FKYLPKPOO9P.0 size=1048576 2024-09-14T11:17:10.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.205+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~4FKYLPKPOO9P.1 size=695758 2024-09-14T11:17:10.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.205+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=4FKYLPKPOO9P tag=JRXF618S3RHB type=write size=2792910 2024-09-14T11:17:10.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.206+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~O9WW4PA3GS75.0 size=1048576 2024-09-14T11:17:10.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.208+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~O9WW4PA3GS75.1 size=116162 2024-09-14T11:17:10.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.210+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=O9WW4PA3GS75 tag=PVOHRSOBJ1G7 type=write size=2213314 2024-09-14T11:17:10.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.212+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~5LVZHOMEPWTW.0 size=423243 2024-09-14T11:17:10.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.212+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=5LVZHOMEPWTW tag=67EY8T0POFN2 type=write size=1471819 2024-09-14T11:17:10.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.215+0000 7f185d9f8780 1 < suggested remove operation key=CJ6C03RXS0IW tag=Q49QJ7031T5V type=del 2024-09-14T11:17:10.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.216+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=WI1OP6WJ4BBY type=del size=659504 2024-09-14T11:17:10.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.217+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=9300TEVQN6LZ type=del 2024-09-14T11:17:10.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.219+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=C0VS9VWZODC3 type=del size=246300 2024-09-14T11:17:10.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.220+0000 7f185d9f8780 1 < canceled operation key=N040R6OERAJP tag=0XEWLZ90XSUL type=del size=308177 2024-09-14T11:17:10.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.221+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=HWOJPE6E0PH8 type=del size=1575334 2024-09-14T11:17:10.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.224+0000 7f185d9f8780 1 < suggested update operation key=MPZOX5RU0580 tag=MGJX52HETG2V type=del size=4021671 2024-09-14T11:17:10.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.226+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~U5A6PLFDSVZY.0 size=1048576 2024-09-14T11:17:10.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.228+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~U5A6PLFDSVZY.1 size=1048576 2024-09-14T11:17:10.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.229+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~U5A6PLFDSVZY.2 size=655175 2024-09-14T11:17:10.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.229+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=U5A6PLFDSVZY tag=BLTIKX02UZ21 type=write size=3800903 2024-09-14T11:17:10.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.230+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=CNAW6G8HFA0W type=del 2024-09-14T11:17:10.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.232+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~6W0K5U3YJOEX.0 size=817045 2024-09-14T11:17:10.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.232+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=6W0K5U3YJOEX tag=L2JLI18YY8RH type=write size=1865621 2024-09-14T11:17:10.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.233+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=CJ6C03RXS0IW tag=DA9VEHBAP4TT type=del size=1582829: (2) No such file or directory 2024-09-14T11:17:10.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.234+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=8RASZ46Y0VLJ type=del size=204969 2024-09-14T11:17:10.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.235+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=264SR4S69GJR type=del 2024-09-14T11:17:10.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.236+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=BXXRH6TYDJDM type=del size=452359 2024-09-14T11:17:10.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.239+0000 7f185d9f8780 1 < suggested update operation key=MPZOX5RU0580 tag=7D4KKYYQLJMC type=del size=48272 2024-09-14T11:17:10.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.240+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=XQI8ZBJY8IOP type=del size=3429502 2024-09-14T11:17:10.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.241+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=FILQ6TQNFISG type=del 2024-09-14T11:17:10.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.243+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~0DV0MILZUGX9.0 size=1048576 2024-09-14T11:17:10.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.244+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~0DV0MILZUGX9.1 size=1048576 2024-09-14T11:17:10.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.245+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~0DV0MILZUGX9.2 size=345875 2024-09-14T11:17:10.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.245+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=0DV0MILZUGX9 tag=WQFW0GFQT9HR type=write size=3491603 2024-09-14T11:17:10.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.247+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~RBMAQ361W36W.0 size=1048576 2024-09-14T11:17:10.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.248+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~RBMAQ361W36W.1 size=917477 2024-09-14T11:17:10.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.250+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=RBMAQ361W36W tag=H4UJOICCHGXG type=write size=3014629 2024-09-14T11:17:10.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.251+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=QI3FB4RR3F3W type=del size=16477 2024-09-14T11:17:10.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.252+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~2MCQ2TUTS84L.0 size=1048576 2024-09-14T11:17:10.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.253+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~2MCQ2TUTS84L.1 size=73837 2024-09-14T11:17:10.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.255+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=2MCQ2TUTS84L tag=Q5KEXZ2WF5XM type=write size=2170989 2024-09-14T11:17:10.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.257+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~1G5PMG8GV2AS.0 size=1048576 2024-09-14T11:17:10.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.258+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~1G5PMG8GV2AS.1 size=1048576 2024-09-14T11:17:10.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.259+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~1G5PMG8GV2AS.2 size=809285 2024-09-14T11:17:10.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.259+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=1G5PMG8GV2AS tag=3832G2TQ5Z9O type=write size=3955013 2024-09-14T11:17:10.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.260+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~II0MVD28H649.0 size=329286 2024-09-14T11:17:10.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.262+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=II0MVD28H649 tag=301AKJH9Q2IP type=write size=1377862 2024-09-14T11:17:10.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.263+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=BU7VXTQ4YV7I type=del size=959549 2024-09-14T11:17:10.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.264+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~1O06K8YTICVW.0 size=314482 2024-09-14T11:17:10.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.266+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=1O06K8YTICVW tag=CI7RL4J6MCJL type=write size=1363058 2024-09-14T11:17:10.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.268+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~NQSFY8ZOSE63.0 size=1048576 2024-09-14T11:17:10.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.269+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~NQSFY8ZOSE63.1 size=254732 2024-09-14T11:17:10.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.269+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=NQSFY8ZOSE63 tag=ZWN7471F2G2V type=write size=2351884 2024-09-14T11:17:10.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.271+0000 7f185d9f8780 1 < completed write operation key=OYZIXCSGXTHR tag=GODH5JH4T7A9 type=write size=1043947 2024-09-14T11:17:10.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.272+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=WNJLB51KETL4 type=del size=897658 2024-09-14T11:17:10.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.273+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~4FKYLPKPOO9P.0 size=1048576 2024-09-14T11:17:10.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.274+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~4FKYLPKPOO9P.1 size=695758 2024-09-14T11:17:10.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.276+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=4FKYLPKPOO9P tag=JRXF618S3RHB type=write size=2792910 2024-09-14T11:17:10.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.277+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=9TRU0J4SJK4N type=del size=253063 2024-09-14T11:17:10.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.278+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~5LVZHOMEPWTW.0 size=423243 2024-09-14T11:17:10.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.280+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=5LVZHOMEPWTW tag=67EY8T0POFN2 type=write size=1471819 2024-09-14T11:17:10.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.281+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=0T06ZKAL34YO type=write size=814035 2024-09-14T11:17:10.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.283+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=WI1OP6WJ4BBY type=del 2024-09-14T11:17:10.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.285+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~YHLDAG55GM9J.0 size=969392 2024-09-14T11:17:10.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.285+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=YHLDAG55GM9J tag=KX3XHSK7D7I2 type=write size=2017968 2024-09-14T11:17:10.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.288+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=C0VS9VWZODC3 type=del 2024-09-14T11:17:10.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.289+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=73MPSRSAKE0Y type=del size=1095121 2024-09-14T11:17:10.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.291+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=HWOJPE6E0PH8 type=del 2024-09-14T11:17:10.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.292+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=98L7VW66F08G type=del size=1063940 2024-09-14T11:17:10.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.293+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~U5A6PLFDSVZY.0 size=1048576 2024-09-14T11:17:10.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.294+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~U5A6PLFDSVZY.1 size=1048576 2024-09-14T11:17:10.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.295+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~U5A6PLFDSVZY.2 size=655175 2024-09-14T11:17:10.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.297+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=U5A6PLFDSVZY tag=BLTIKX02UZ21 type=write size=3800903 2024-09-14T11:17:10.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.298+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=JSWQ1X25NYY3 type=del size=767091 2024-09-14T11:17:10.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.300+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~6W0K5U3YJOEX.0 size=817045 2024-09-14T11:17:10.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.302+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=6W0K5U3YJOEX tag=L2JLI18YY8RH type=write size=1865621 2024-09-14T11:17:10.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.303+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=82R2CRX2BTEF type=del size=765530 2024-09-14T11:17:10.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.304+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=8RASZ46Y0VLJ type=del 2024-09-14T11:17:10.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.306+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~C44LFZNJZ1IC.0 size=1048576 2024-09-14T11:17:10.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.307+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~C44LFZNJZ1IC.1 size=1048576 2024-09-14T11:17:10.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.308+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~C44LFZNJZ1IC.2 size=683178 2024-09-14T11:17:10.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.308+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=C44LFZNJZ1IC tag=3C91K6C1ODD6 type=write size=3828906 2024-09-14T11:17:10.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.309+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=BXXRH6TYDJDM type=del 2024-09-14T11:17:10.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.310+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=1LSYMK24YGMY type=del size=775061 2024-09-14T11:17:10.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.311+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=XQI8ZBJY8IOP type=del 2024-09-14T11:17:10.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.313+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=2AHBPCERTQR5 type=del size=69282 2024-09-14T11:17:10.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.313+0000 7f185d9f8780 1 < canceled part key=_multipart_WPBYTFP7HRVE.2~0DV0MILZUGX9.0 size=1048576 2024-09-14T11:17:10.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.314+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~0DV0MILZUGX9.1 size=1048576 2024-09-14T11:17:10.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.314+0000 7f185d9f8780 1 < canceled part key=_multipart_WPBYTFP7HRVE.2~0DV0MILZUGX9.2 size=345875 2024-09-14T11:17:10.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.316+0000 7f185d9f8780 1 < canceled multipart upload key=WPBYTFP7HRVE upload=0DV0MILZUGX9 tag=WQFW0GFQT9HR type=write size=3491603 2024-09-14T11:17:10.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.318+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~J53TD3M60DY7.0 size=371366 2024-09-14T11:17:10.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.318+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=J53TD3M60DY7 tag=LD8MF3L7EPW8 type=write size=1419942 2024-09-14T11:17:10.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.319+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=QI3FB4RR3F3W type=del 2024-09-14T11:17:10.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.320+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=TBU1H6QSU90H type=del size=3718671 2024-09-14T11:17:10.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.321+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~1G5PMG8GV2AS.0 size=1048576 2024-09-14T11:17:10.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.322+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~1G5PMG8GV2AS.1 size=1048576 2024-09-14T11:17:10.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.323+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~1G5PMG8GV2AS.2 size=809285 2024-09-14T11:17:10.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.325+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=1G5PMG8GV2AS tag=3832G2TQ5Z9O type=write size=3955013 2024-09-14T11:17:10.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.326+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=G7NYHJYBPVKC type=del size=163601 2024-09-14T11:17:10.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.329+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=BU7VXTQ4YV7I type=del 2024-09-14T11:17:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.331+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~TNTTAKLG9TM2.0 size=298953 2024-09-14T11:17:10.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.331+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=TNTTAKLG9TM2 tag=M9QEY5NLBLIL type=write size=1347529 2024-09-14T11:17:10.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.332+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~NQSFY8ZOSE63.0 size=1048576 2024-09-14T11:17:10.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.333+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~NQSFY8ZOSE63.1 size=254732 2024-09-14T11:17:10.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.335+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=NQSFY8ZOSE63 tag=ZWN7471F2G2V type=write size=2351884 2024-09-14T11:17:10.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.336+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=V0N987MXJ7UZ type=del size=3719883 2024-09-14T11:17:10.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.337+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=WNJLB51KETL4 type=del 2024-09-14T11:17:10.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.340+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~V8D6PF9UUZ34.0 size=1048576 2024-09-14T11:17:10.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.340+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~V8D6PF9UUZ34.1 size=149711 2024-09-14T11:17:10.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.340+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=V8D6PF9UUZ34 tag=18RF1I7LG1JR type=write size=2246863 2024-09-14T11:17:10.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.342+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=9TRU0J4SJK4N type=del 2024-09-14T11:17:10.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.343+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=83XBCPKDDQ0D type=write size=319392 2024-09-14T11:17:10.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.344+0000 7f185d9f8780 1 < completed write operation key=W24KN3J819EB tag=0T06ZKAL34YO type=write size=814035 2024-09-14T11:17:10.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.345+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=PQ3U9NGCJ925 type=del size=4098285 2024-09-14T11:17:10.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.346+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~YHLDAG55GM9J.0 size=969392 2024-09-14T11:17:10.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.348+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=YHLDAG55GM9J tag=KX3XHSK7D7I2 type=write size=2017968 2024-09-14T11:17:10.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.350+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~M8IL6QJJYALT.0 size=1048576 2024-09-14T11:17:10.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.351+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~M8IL6QJJYALT.1 size=662898 2024-09-14T11:17:10.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.351+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=M8IL6QJJYALT tag=T0JLBONPAEOW type=write size=2760050 2024-09-14T11:17:10.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.354+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=73MPSRSAKE0Y type=del size=1095121 2024-09-14T11:17:10.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.355+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=0ZB8BJO98DQW type=del size=1382608 2024-09-14T11:17:10.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.356+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=98L7VW66F08G type=del 2024-09-14T11:17:10.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.357+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=O5NSVCP2ME82 type=del size=3630320 2024-09-14T11:17:10.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.358+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=JSWQ1X25NYY3 type=del 2024-09-14T11:17:10.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.359+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=PBD7VR1I9QOT type=del size=66412 2024-09-14T11:17:10.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.360+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=82R2CRX2BTEF type=del 2024-09-14T11:17:10.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.362+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=O0DOAD3315IE type=del size=2113334 2024-09-14T11:17:10.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.363+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~C44LFZNJZ1IC.0 size=1048576 2024-09-14T11:17:10.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.364+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~C44LFZNJZ1IC.1 size=1048576 2024-09-14T11:17:10.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.365+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~C44LFZNJZ1IC.2 size=683178 2024-09-14T11:17:10.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.366+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=C44LFZNJZ1IC tag=3C91K6C1ODD6 type=write size=3828906 2024-09-14T11:17:10.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.369+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~6HRXLBINZKE6.0 size=1048576 2024-09-14T11:17:10.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.369+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~6HRXLBINZKE6.1 size=294876 2024-09-14T11:17:10.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.369+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=6HRXLBINZKE6 tag=MI00KCSUIRN0 type=write size=2392028 2024-09-14T11:17:10.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.371+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=1LSYMK24YGMY type=del 2024-09-14T11:17:10.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.372+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=1RLSLGHAYYJB type=del size=1813411 2024-09-14T11:17:10.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.373+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=2AHBPCERTQR5 type=del 2024-09-14T11:17:10.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.374+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=OHASCDGJ5C5P type=del size=3024137 2024-09-14T11:17:10.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.375+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~J53TD3M60DY7.0 size=371366 2024-09-14T11:17:10.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.377+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=J53TD3M60DY7 tag=LD8MF3L7EPW8 type=write size=1419942 2024-09-14T11:17:10.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.378+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=CWWBL91YMTT4 type=del size=291784 2024-09-14T11:17:10.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.379+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=TBU1H6QSU90H type=del 2024-09-14T11:17:10.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.381+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~76XKT8SLN4SD.0 size=1048576 2024-09-14T11:17:10.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.382+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~76XKT8SLN4SD.1 size=1018959 2024-09-14T11:17:10.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.382+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=76XKT8SLN4SD tag=BXA7SFE75FBF type=write size=3116111 2024-09-14T11:17:10.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.384+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=G7NYHJYBPVKC type=del size=163601 2024-09-14T11:17:10.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.386+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~CU9FX2R7ZWCK.0 size=1048576 2024-09-14T11:17:10.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.387+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~CU9FX2R7ZWCK.1 size=1048576 2024-09-14T11:17:10.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.388+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~CU9FX2R7ZWCK.2 size=816807 2024-09-14T11:17:10.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.388+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=CU9FX2R7ZWCK tag=F3KGN7R0UM90 type=write size=3962535 2024-09-14T11:17:10.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.389+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~TNTTAKLG9TM2.0 size=298953 2024-09-14T11:17:10.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.391+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=TNTTAKLG9TM2 tag=M9QEY5NLBLIL type=write size=1347529 2024-09-14T11:17:10.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.393+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=6V998V7QYUH5 type=del size=3554951 2024-09-14T11:17:10.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.395+0000 7f185d9f8780 1 < suggested remove operation key=WPBYTFP7HRVE tag=V0N987MXJ7UZ type=del 2024-09-14T11:17:10.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.399+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~DSNLRZAIFSYC.0 size=600467 2024-09-14T11:17:10.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.399+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=DSNLRZAIFSYC tag=YP0QO4U9INXC type=write size=1649043 2024-09-14T11:17:10.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.400+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~V8D6PF9UUZ34.0 size=1048576 2024-09-14T11:17:10.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.401+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~V8D6PF9UUZ34.1 size=149711 2024-09-14T11:17:10.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.403+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=V8D6PF9UUZ34 tag=18RF1I7LG1JR type=write size=2246863 2024-09-14T11:17:10.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.405+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~ZA653MKB2EIA.0 size=1048576 2024-09-14T11:17:10.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.406+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~ZA653MKB2EIA.1 size=626378 2024-09-14T11:17:10.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.406+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=ZA653MKB2EIA tag=ALG648Q4N8ND type=write size=2723530 2024-09-14T11:17:10.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.409+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=83XBCPKDDQ0D type=write size=319392 2024-09-14T11:17:10.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.411+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=IG0CFTRDY0FB type=del size=3900989 2024-09-14T11:17:10.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.413+0000 7f185d9f8780 1 < suggested update operation key=ZR3IEW48CSCF tag=PQ3U9NGCJ925 type=del size=4098285 2024-09-14T11:17:10.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.416+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~A4ZVY0R1QOQT.0 size=34595 2024-09-14T11:17:10.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.416+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=A4ZVY0R1QOQT tag=1IVWPYQTR8H2 type=write size=1083171 2024-09-14T11:17:10.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.417+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~M8IL6QJJYALT.0 size=1048576 2024-09-14T11:17:10.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.418+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~M8IL6QJJYALT.1 size=662898 2024-09-14T11:17:10.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.420+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=M8IL6QJJYALT tag=T0JLBONPAEOW type=write size=2760050 2024-09-14T11:17:10.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.423+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~H0UTF5EMDPXH.0 size=782076 2024-09-14T11:17:10.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.423+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=H0UTF5EMDPXH tag=1ZSR511KNUM5 type=write size=1830652 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.425+0000 7f185d9f8780 1 < suggested remove operation key=6B0SURI3Q8R6 tag=0ZB8BJO98DQW type=del 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.426+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=E178GAR483OP type=write size=244521 2024-09-14T11:17:10.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.427+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=O5NSVCP2ME82 type=del 2024-09-14T11:17:10.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.429+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~COL7H57INWQK.0 size=1048576 2024-09-14T11:17:10.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.430+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~COL7H57INWQK.1 size=675263 2024-09-14T11:17:10.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.430+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=COL7H57INWQK tag=QXKFJN03SNE0 type=write size=2772415 2024-09-14T11:17:10.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.431+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=PBD7VR1I9QOT type=del 2024-09-14T11:17:10.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.433+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=5ZW1Q17C4K5C type=del size=2178384 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.434+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=O0DOAD3315IE type=del 2024-09-14T11:17:10.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.435+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=T04XR4TS5KA1 type=del size=615500 2024-09-14T11:17:10.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.436+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~6HRXLBINZKE6.0 size=1048576 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.437+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~6HRXLBINZKE6.1 size=294876 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.439+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=6HRXLBINZKE6 tag=MI00KCSUIRN0 type=write size=2392028 2024-09-14T11:17:10.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.441+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~CTVBJVNZWUM5.0 size=1016940 2024-09-14T11:17:10.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.441+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=CTVBJVNZWUM5 tag=3WEXGG5GF9OE type=write size=2065516 2024-09-14T11:17:10.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.442+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=1RLSLGHAYYJB type=del 2024-09-14T11:17:10.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.443+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=3T55U7HPNT6J type=del size=3432549 2024-09-14T11:17:10.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.445+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=OHASCDGJ5C5P type=del 2024-09-14T11:17:10.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.447+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~IAOPRRJNLAJC.0 size=1048576 2024-09-14T11:17:10.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.448+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~IAOPRRJNLAJC.1 size=1048576 2024-09-14T11:17:10.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.449+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~IAOPRRJNLAJC.2 size=913873 2024-09-14T11:17:10.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.449+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=IAOPRRJNLAJC tag=KK3FHHJJ3MS7 type=write size=4059601 2024-09-14T11:17:10.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.450+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=CWWBL91YMTT4 type=del 2024-09-14T11:17:10.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.452+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~QRR03JGA7F3A.0 size=189823 2024-09-14T11:17:10.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.452+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=QRR03JGA7F3A tag=VKVQ8Z3JQ14J type=write size=1238399 2024-09-14T11:17:10.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.453+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~76XKT8SLN4SD.0 size=1048576 2024-09-14T11:17:10.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.454+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~76XKT8SLN4SD.1 size=1018959 2024-09-14T11:17:10.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.456+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=76XKT8SLN4SD tag=BXA7SFE75FBF type=write size=3116111 2024-09-14T11:17:10.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.458+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~I2F828LYR7T9.0 size=1048576 2024-09-14T11:17:10.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.458+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~I2F828LYR7T9.1 size=1048576 2024-09-14T11:17:10.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.459+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~I2F828LYR7T9.2 size=557003 2024-09-14T11:17:10.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.459+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=I2F828LYR7T9 tag=607Y4N08WN81 type=write size=3702731 2024-09-14T11:17:10.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.461+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~CU9FX2R7ZWCK.0 size=1048576 2024-09-14T11:17:10.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.461+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~CU9FX2R7ZWCK.1 size=1048576 2024-09-14T11:17:10.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.461+0000 7f185d9f8780 1 < canceled part key=_multipart_XPMGVU0U52GS.2~CU9FX2R7ZWCK.2 size=816807 2024-09-14T11:17:10.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.463+0000 7f185d9f8780 1 < canceled multipart upload key=XPMGVU0U52GS upload=CU9FX2R7ZWCK tag=F3KGN7R0UM90 type=write size=3962535 2024-09-14T11:17:10.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.465+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~6IL262M7Q69D.0 size=707730 2024-09-14T11:17:10.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.465+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=6IL262M7Q69D tag=A1XQI9XGMXMR type=write size=1756306 2024-09-14T11:17:10.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.467+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=6V998V7QYUH5 type=del 2024-09-14T11:17:10.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.468+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=JJM8LLDK17M9 type=del size=1243841 2024-09-14T11:17:10.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.469+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~DSNLRZAIFSYC.0 size=600467 2024-09-14T11:17:10.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.471+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=DSNLRZAIFSYC tag=YP0QO4U9INXC type=write size=1649043 2024-09-14T11:17:10.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.473+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~VSKL8BU6KWZY.0 size=1048576 2024-09-14T11:17:10.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.474+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~VSKL8BU6KWZY.1 size=819511 2024-09-14T11:17:10.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.474+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=VSKL8BU6KWZY tag=QMQHRR4CI6BZ type=write size=2916663 2024-09-14T11:17:10.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.476+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~ZA653MKB2EIA.0 size=1048576 2024-09-14T11:17:10.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.476+0000 7f185d9f8780 1 < canceled part key=_multipart_J6RN3WULDLQE.2~ZA653MKB2EIA.1 size=626378 2024-09-14T11:17:10.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.478+0000 7f185d9f8780 1 < canceled multipart upload key=J6RN3WULDLQE upload=ZA653MKB2EIA tag=ALG648Q4N8ND type=write size=2723530 2024-09-14T11:17:10.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.480+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~QOM2OD486J5C.0 size=1048576 2024-09-14T11:17:10.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.481+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~QOM2OD486J5C.1 size=1048576 2024-09-14T11:17:10.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.482+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~QOM2OD486J5C.2 size=422011 2024-09-14T11:17:10.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.482+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=QOM2OD486J5C tag=VTIMNA9SYFNS type=write size=3567739 2024-09-14T11:17:10.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.483+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=IG0CFTRDY0FB type=del 2024-09-14T11:17:10.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.484+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=5RN4DNRVVCFM type=del size=682113 2024-09-14T11:17:10.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.485+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~A4ZVY0R1QOQT.0 size=34595 2024-09-14T11:17:10.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.487+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=A4ZVY0R1QOQT tag=1IVWPYQTR8H2 type=write size=1083171 2024-09-14T11:17:10.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.488+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=5754M6DZ85G0 type=del size=834562 2024-09-14T11:17:10.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.490+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~H0UTF5EMDPXH.0 size=782076 2024-09-14T11:17:10.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.492+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=H0UTF5EMDPXH tag=1ZSR511KNUM5 type=write size=1830652 2024-09-14T11:17:10.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.493+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=E3WKFRYUAOR3 type=write size=94067 2024-09-14T11:17:10.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.495+0000 7f185d9f8780 1 < suggested update operation key=IXWIKD7J74RJ tag=E178GAR483OP type=write size=244521 2024-09-14T11:17:10.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.497+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=F9X1G2IMFSV4 type=del size=1074368 2024-09-14T11:17:10.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.498+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~COL7H57INWQK.0 size=1048576 2024-09-14T11:17:10.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.499+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~COL7H57INWQK.1 size=675263 2024-09-14T11:17:10.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.502+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=COL7H57INWQK tag=QXKFJN03SNE0 type=write size=2772415 2024-09-14T11:17:10.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.504+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~6RF754EVZZJC.0 size=1048576 2024-09-14T11:17:10.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.505+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~6RF754EVZZJC.1 size=182232 2024-09-14T11:17:10.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.505+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=6RF754EVZZJC tag=ED3PJYVHSOW0 type=write size=2279384 2024-09-14T11:17:10.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.506+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=5ZW1Q17C4K5C type=del 2024-09-14T11:17:10.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.507+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=3ME7J7ORIZHR type=write size=190251 2024-09-14T11:17:10.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.509+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=T04XR4TS5KA1 type=del 2024-09-14T11:17:10.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.510+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=OONRDDIL53JU type=del size=1452654 2024-09-14T11:17:10.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.512+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~CTVBJVNZWUM5.0 size=1016940 2024-09-14T11:17:10.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.514+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=CTVBJVNZWUM5 tag=3WEXGG5GF9OE type=write size=2065516 2024-09-14T11:17:10.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.515+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=NY5JI7FHA38R type=del size=3162271 2024-09-14T11:17:10.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.516+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=3T55U7HPNT6J type=del 2024-09-14T11:17:10.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.517+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=UK0H9K7XGIP2 type=write size=715003 2024-09-14T11:17:10.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.518+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~IAOPRRJNLAJC.0 size=1048576 2024-09-14T11:17:10.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.519+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~IAOPRRJNLAJC.1 size=1048576 2024-09-14T11:17:10.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.520+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~IAOPRRJNLAJC.2 size=913873 2024-09-14T11:17:10.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.522+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=IAOPRRJNLAJC tag=KK3FHHJJ3MS7 type=write size=4059601 2024-09-14T11:17:10.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.524+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=DPRJ8EAIHYSD type=del size=4101958 2024-09-14T11:17:10.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.525+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~QRR03JGA7F3A.0 size=189823 2024-09-14T11:17:10.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.527+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=QRR03JGA7F3A tag=VKVQ8Z3JQ14J type=write size=1238399 2024-09-14T11:17:10.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.528+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=THL1IEK85RV2 type=write size=58016 2024-09-14T11:17:10.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.529+0000 7f185d9f8780 1 < canceled part key=_multipart_CRZOT1D0U2F3.2~I2F828LYR7T9.0 size=1048576 2024-09-14T11:17:10.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.530+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~I2F828LYR7T9.1 size=1048576 2024-09-14T11:17:10.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.530+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~I2F828LYR7T9.2 size=557003 2024-09-14T11:17:10.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.532+0000 7f185d9f8780 1 < canceled multipart upload key=CRZOT1D0U2F3 upload=I2F828LYR7T9 tag=607Y4N08WN81 type=write size=3702731 2024-09-14T11:17:10.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.534+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~N1S01HWAKPNW.0 size=1048576 2024-09-14T11:17:10.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.535+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~N1S01HWAKPNW.1 size=1048576 2024-09-14T11:17:10.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.536+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~N1S01HWAKPNW.2 size=412874 2024-09-14T11:17:10.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.536+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=N1S01HWAKPNW tag=NTDZDGCHRJSO type=write size=3558602 2024-09-14T11:17:10.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.538+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~6IL262M7Q69D.0 size=707730 2024-09-14T11:17:10.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.540+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=6IL262M7Q69D tag=A1XQI9XGMXMR type=write size=1756306 2024-09-14T11:17:10.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.541+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=HBH52RDSEP18 type=del size=967026 2024-09-14T11:17:10.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.542+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=JJM8LLDK17M9 type=del 2024-09-14T11:17:10.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.544+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~8808U51D8KZT.0 size=1048576 2024-09-14T11:17:10.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.545+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~8808U51D8KZT.1 size=1048576 2024-09-14T11:17:10.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.546+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~8808U51D8KZT.2 size=484865 2024-09-14T11:17:10.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.546+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=8808U51D8KZT tag=EUO7Z186UW1M type=write size=3630593 2024-09-14T11:17:10.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.548+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~VSKL8BU6KWZY.0 size=1048576 2024-09-14T11:17:10.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.549+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~VSKL8BU6KWZY.1 size=819511 2024-09-14T11:17:10.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.551+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=VSKL8BU6KWZY tag=QMQHRR4CI6BZ type=write size=2916663 2024-09-14T11:17:10.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.552+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=N40FRVZ19AA7 type=del size=936883 2024-09-14T11:17:10.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.553+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~QOM2OD486J5C.0 size=1048576 2024-09-14T11:17:10.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.554+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~QOM2OD486J5C.1 size=1048576 2024-09-14T11:17:10.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.555+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~QOM2OD486J5C.2 size=422011 2024-09-14T11:17:10.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.557+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=QOM2OD486J5C tag=VTIMNA9SYFNS type=write size=3567739 2024-09-14T11:17:10.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.559+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=XTXX5N117SON type=write size=1039197 2024-09-14T11:17:10.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.560+0000 7f185d9f8780 1 < canceled operation key=W24KN3J819EB tag=5RN4DNRVVCFM type=del size=682113 2024-09-14T11:17:10.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.561+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=KPLUT11TNVCI type=del size=2006311 2024-09-14T11:17:10.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.563+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=5754M6DZ85G0 type=del 2024-09-14T11:17:10.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.565+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~FAED2IMZM3Q0.0 size=1048576 2024-09-14T11:17:10.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.566+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~FAED2IMZM3Q0.1 size=67235 2024-09-14T11:17:10.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.566+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=FAED2IMZM3Q0 tag=2HF9U1SNPMJS type=write size=2164387 2024-09-14T11:17:10.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.567+0000 7f185d9f8780 1 < completed write operation key=HLUMY48G90KB tag=E3WKFRYUAOR3 type=write size=94067 2024-09-14T11:17:10.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.568+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=6HBVD3QUFCBK type=write size=293364 2024-09-14T11:17:10.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.571+0000 7f185d9f8780 1 < suggested remove operation key=MPZOX5RU0580 tag=F9X1G2IMFSV4 type=del 2024-09-14T11:17:10.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.572+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=LLAJJY77QE3P type=del size=3102388 2024-09-14T11:17:10.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.574+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~6RF754EVZZJC.0 size=1048576 2024-09-14T11:17:10.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.575+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~6RF754EVZZJC.1 size=182232 2024-09-14T11:17:10.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.577+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=6RF754EVZZJC tag=ED3PJYVHSOW0 type=write size=2279384 2024-09-14T11:17:10.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.578+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=OP0ZWVMBQEGH type=del size=3013861 2024-09-14T11:17:10.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.581+0000 7f185d9f8780 1 < suggested remove operation key=P30WF4R3UFPX tag=3ME7J7ORIZHR type=write 2024-09-14T11:17:10.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.583+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~ASW32PXWQHF5.0 size=1048576 2024-09-14T11:17:10.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.584+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~ASW32PXWQHF5.1 size=533319 2024-09-14T11:17:10.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.584+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=ASW32PXWQHF5 tag=JEZUF000ASI5 type=write size=2630471 2024-09-14T11:17:10.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.585+0000 7f185d9f8780 -1 < failed to complete operation key=MPZOX5RU0580 tag=OONRDDIL53JU type=del size=1452654: (22) Invalid argument 2024-09-14T11:17:10.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.586+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=GLNKAL6EIV4L type=del size=1332504 2024-09-14T11:17:10.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.587+0000 7f185d9f8780 1 < canceled operation key=JL2IH8NEX1YF tag=NY5JI7FHA38R type=del size=3162271 2024-09-14T11:17:10.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.589+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=8BKZ4GDX1KRI type=del size=2570985 2024-09-14T11:17:10.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.590+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=UK0H9K7XGIP2 type=write size=715003 2024-09-14T11:17:10.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.591+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=R4U2ME11TJEJ type=del size=1295837 2024-09-14T11:17:10.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.592+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=DPRJ8EAIHYSD type=del 2024-09-14T11:17:10.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.595+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~LVQZ2IXBODG2.0 size=1048576 2024-09-14T11:17:10.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.596+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~LVQZ2IXBODG2.1 size=871377 2024-09-14T11:17:10.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.596+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=LVQZ2IXBODG2 tag=ZEXH5ZG4L229 type=write size=2968529 2024-09-14T11:17:10.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.597+0000 7f185d9f8780 1 < completed write operation key=U5S6L8GPSMU5 tag=THL1IEK85RV2 type=write size=58016 2024-09-14T11:17:10.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.599+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~1JYNTSHNPSIF.0 size=1048576 2024-09-14T11:17:10.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.600+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~1JYNTSHNPSIF.1 size=1048576 2024-09-14T11:17:10.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.601+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~1JYNTSHNPSIF.2 size=128193 2024-09-14T11:17:10.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.601+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=1JYNTSHNPSIF tag=9YOY539U7HVO type=write size=3273921 2024-09-14T11:17:10.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.602+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~N1S01HWAKPNW.0 size=1048576 2024-09-14T11:17:10.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.603+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~N1S01HWAKPNW.1 size=1048576 2024-09-14T11:17:10.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.604+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~N1S01HWAKPNW.2 size=412874 2024-09-14T11:17:10.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.606+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=N1S01HWAKPNW tag=NTDZDGCHRJSO type=write size=3558602 2024-09-14T11:17:10.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.607+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=OKWYKXQB72I0 type=del size=679214 2024-09-14T11:17:10.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.608+0000 7f185d9f8780 -1 < failed to complete operation key=MPZOX5RU0580 tag=HBH52RDSEP18 type=del size=967026: (22) Invalid argument 2024-09-14T11:17:10.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.610+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~V7N20BYBM9Q8.0 size=1048576 2024-09-14T11:17:10.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.611+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~V7N20BYBM9Q8.1 size=459835 2024-09-14T11:17:10.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.611+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=V7N20BYBM9Q8 tag=6QX2ZPJA0ONF type=write size=2556987 2024-09-14T11:17:10.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.612+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~8808U51D8KZT.0 size=1048576 2024-09-14T11:17:10.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.613+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~8808U51D8KZT.1 size=1048576 2024-09-14T11:17:10.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.614+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~8808U51D8KZT.2 size=484865 2024-09-14T11:17:10.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.616+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=8808U51D8KZT tag=EUO7Z186UW1M type=write size=3630593 2024-09-14T11:17:10.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.617+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=L7SEHE95NADO type=write size=971253 2024-09-14T11:17:10.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.618+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=N40FRVZ19AA7 type=del 2024-09-14T11:17:10.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.620+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=2JD9IW30D7E7 type=write size=240213 2024-09-14T11:17:10.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.621+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=XTXX5N117SON type=write size=1039197 2024-09-14T11:17:10.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.625+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DPEJTRTSJ4A5.0 size=1048576 2024-09-14T11:17:10.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.626+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DPEJTRTSJ4A5.1 size=1048576 2024-09-14T11:17:10.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.627+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DPEJTRTSJ4A5.2 size=981890 2024-09-14T11:17:10.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.627+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=DPEJTRTSJ4A5 tag=B230PNRWZFW4 type=write size=4127618 2024-09-14T11:17:10.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.628+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=KPLUT11TNVCI type=del 2024-09-14T11:17:10.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.630+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~OXK4H82EL1FY.0 size=1048576 2024-09-14T11:17:10.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.631+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~OXK4H82EL1FY.1 size=3417 2024-09-14T11:17:10.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.631+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=OXK4H82EL1FY tag=3LQBF4F10HAU type=write size=2100569 2024-09-14T11:17:10.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.632+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~FAED2IMZM3Q0.0 size=1048576 2024-09-14T11:17:10.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.633+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~FAED2IMZM3Q0.1 size=67235 2024-09-14T11:17:10.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.635+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=FAED2IMZM3Q0 tag=2HF9U1SNPMJS type=write size=2164387 2024-09-14T11:17:10.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.636+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=GAT8P3XDDSTE type=write size=866597 2024-09-14T11:17:10.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.637+0000 7f185d9f8780 1 < completed write operation key=CJ6C03RXS0IW tag=6HBVD3QUFCBK type=write size=293364 2024-09-14T11:17:10.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.638+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=MCEUK5BTCVKG type=del size=2616264 2024-09-14T11:17:10.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.640+0000 7f185d9f8780 1 < suggested update operation key=1BOZ331NA7JA tag=LLAJJY77QE3P type=del size=3102388 2024-09-14T11:17:10.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.641+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=IV40FXXM1720 type=write size=822767 2024-09-14T11:17:10.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.643+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=OP0ZWVMBQEGH type=del 2024-09-14T11:17:10.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.644+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=9K0H4SA0ERN8 type=del size=2684554 2024-09-14T11:17:10.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.645+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~ASW32PXWQHF5.0 size=1048576 2024-09-14T11:17:10.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.646+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~ASW32PXWQHF5.1 size=533319 2024-09-14T11:17:10.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.648+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=ASW32PXWQHF5 tag=JEZUF000ASI5 type=write size=2630471 2024-09-14T11:17:10.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.649+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=CIZGO8I00AUD type=del size=1641240 2024-09-14T11:17:10.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.650+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=GLNKAL6EIV4L type=del 2024-09-14T11:17:10.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.651+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=HVT9EY4PQCEX type=write size=702384 2024-09-14T11:17:10.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.652+0000 7f185d9f8780 1 < canceled operation key=CVVKY636WXG9 tag=8BKZ4GDX1KRI type=del size=2570985 2024-09-14T11:17:10.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.653+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=TUGP8I40ZKGZ type=del size=3810179 2024-09-14T11:17:10.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.654+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=R4U2ME11TJEJ type=del 2024-09-14T11:17:10.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.655+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=7ABND07APXV3 type=del size=3167242 2024-09-14T11:17:10.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.657+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~LVQZ2IXBODG2.0 size=1048576 2024-09-14T11:17:10.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.657+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~LVQZ2IXBODG2.1 size=871377 2024-09-14T11:17:10.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.659+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=LVQZ2IXBODG2 tag=ZEXH5ZG4L229 type=write size=2968529 2024-09-14T11:17:10.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.660+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=HEUI1Y3AGNY7 type=del size=3071756 2024-09-14T11:17:10.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.661+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~1JYNTSHNPSIF.0 size=1048576 2024-09-14T11:17:10.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.661+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~1JYNTSHNPSIF.1 size=1048576 2024-09-14T11:17:10.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.662+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~1JYNTSHNPSIF.2 size=128193 2024-09-14T11:17:10.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.664+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=1JYNTSHNPSIF tag=9YOY539U7HVO type=write size=3273921 2024-09-14T11:17:10.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.666+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~WZTWFKCSBRFC.0 size=1048576 2024-09-14T11:17:10.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.667+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~WZTWFKCSBRFC.1 size=772968 2024-09-14T11:17:10.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.667+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=WZTWFKCSBRFC tag=D14ZIH66FZWS type=write size=2870120 2024-09-14T11:17:10.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.669+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=OKWYKXQB72I0 type=del 2024-09-14T11:17:10.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.670+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=XJIYV5O124R4 type=write size=543044 2024-09-14T11:17:10.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.671+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~V7N20BYBM9Q8.0 size=1048576 2024-09-14T11:17:10.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.672+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~V7N20BYBM9Q8.1 size=459835 2024-09-14T11:17:10.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.674+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=V7N20BYBM9Q8 tag=6QX2ZPJA0ONF type=write size=2556987 2024-09-14T11:17:10.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.676+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~A4Y4KR3EUAY8.0 size=1048576 2024-09-14T11:17:10.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.677+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~A4Y4KR3EUAY8.1 size=1048576 2024-09-14T11:17:10.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.678+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~A4Y4KR3EUAY8.2 size=371773 2024-09-14T11:17:10.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.678+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=A4Y4KR3EUAY8 tag=S0EG3BMG1GAE type=write size=3517501 2024-09-14T11:17:10.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.679+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=L7SEHE95NADO type=write size=971253 2024-09-14T11:17:10.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.681+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=GSMZYDBXGZEL type=del size=2364084 2024-09-14T11:17:10.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.682+0000 7f185d9f8780 1 < completed write operation key=MPZOX5RU0580 tag=2JD9IW30D7E7 type=write size=240213 2024-09-14T11:17:10.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.683+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=QYQNGSOIYT3K type=del size=1112814 2024-09-14T11:17:10.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.684+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DPEJTRTSJ4A5.0 size=1048576 2024-09-14T11:17:10.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.685+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DPEJTRTSJ4A5.1 size=1048576 2024-09-14T11:17:10.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.686+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DPEJTRTSJ4A5.2 size=981890 2024-09-14T11:17:10.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.688+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=DPEJTRTSJ4A5 tag=B230PNRWZFW4 type=write size=4127618 2024-09-14T11:17:10.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.689+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=V8Z2A55YR6I2 type=del size=2614108 2024-09-14T11:17:10.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.691+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~OXK4H82EL1FY.0 size=1048576 2024-09-14T11:17:10.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.692+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~OXK4H82EL1FY.1 size=3417 2024-09-14T11:17:10.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.693+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=OXK4H82EL1FY tag=3LQBF4F10HAU type=write size=2100569 2024-09-14T11:17:10.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.695+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=47EEX8BEE7YZ type=del size=3144757 2024-09-14T11:17:10.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.696+0000 7f185d9f8780 1 < completed write operation key=CVVKY636WXG9 tag=GAT8P3XDDSTE type=write size=866597 2024-09-14T11:17:10.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.698+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~AERGCLHRVS7K.0 size=1048576 2024-09-14T11:17:10.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.699+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~AERGCLHRVS7K.1 size=1048576 2024-09-14T11:17:10.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.700+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~AERGCLHRVS7K.2 size=1038131 2024-09-14T11:17:10.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.700+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=AERGCLHRVS7K tag=3C70BWLOEXOI type=write size=4183859 2024-09-14T11:17:10.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.701+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=MCEUK5BTCVKG type=del 2024-09-14T11:17:10.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.702+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=RUZRZSMEGX09 type=del size=1531995 2024-09-14T11:17:10.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.703+0000 7f185d9f8780 1 < completed write operation key=W24KN3J819EB tag=IV40FXXM1720 type=write size=822767 2024-09-14T11:17:10.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.704+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=U4EEVCKW66PH type=del size=2525424 2024-09-14T11:17:10.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.706+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=9K0H4SA0ERN8 type=del 2024-09-14T11:17:10.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.707+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=CHABBYL1L4K2 type=del size=2429189 2024-09-14T11:17:10.706 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.708+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=CIZGO8I00AUD type=del 2024-09-14T11:17:10.707 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.709+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=4EIZ89IIE55N type=del size=307554 2024-09-14T11:17:10.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.711+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=HVT9EY4PQCEX type=write size=702384 2024-09-14T11:17:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.713+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~KOHWG40B07F6.0 size=1048576 2024-09-14T11:17:10.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.714+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~KOHWG40B07F6.1 size=36882 2024-09-14T11:17:10.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.714+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=KOHWG40B07F6 tag=35JXDZFZ5PJC type=write size=2134034 2024-09-14T11:17:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.715+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=TUGP8I40ZKGZ type=del 2024-09-14T11:17:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.716+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=J1LN3LGISUDP type=del size=3590933 2024-09-14T11:17:10.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.718+0000 7f185d9f8780 1 < suggested update operation key=N040R6OERAJP tag=7ABND07APXV3 type=del size=3167242 2024-09-14T11:17:10.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.720+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~H6TKWZLTAWB7.0 size=1048576 2024-09-14T11:17:10.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.721+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~H6TKWZLTAWB7.1 size=208669 2024-09-14T11:17:10.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.721+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=H6TKWZLTAWB7 tag=Q6K8C49GRZGC type=write size=2305821 2024-09-14T11:17:10.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.722+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=HEUI1Y3AGNY7 type=del 2024-09-14T11:17:10.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.724+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=EMBG0Y6H2P7V type=del size=2946673 2024-09-14T11:17:10.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.725+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~WZTWFKCSBRFC.0 size=1048576 2024-09-14T11:17:10.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.726+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~WZTWFKCSBRFC.1 size=772968 2024-09-14T11:17:10.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.727+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=WZTWFKCSBRFC tag=D14ZIH66FZWS type=write size=2870120 2024-09-14T11:17:10.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.730+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~1LKE0B16ZYQX.0 size=252921 2024-09-14T11:17:10.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.730+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=1LKE0B16ZYQX tag=RHF3ZDP7T0J5 type=write size=1301497 2024-09-14T11:17:10.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.732+0000 7f185d9f8780 1 < canceled operation key=1BOZ331NA7JA tag=XJIYV5O124R4 type=write size=543044 2024-09-14T11:17:10.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.734+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~PR0PNXL6QS69.0 size=1048576 2024-09-14T11:17:10.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.735+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~PR0PNXL6QS69.1 size=60186 2024-09-14T11:17:10.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.735+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=PR0PNXL6QS69 tag=C5XX51FL27DP type=write size=2157338 2024-09-14T11:17:10.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.736+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~A4Y4KR3EUAY8.0 size=1048576 2024-09-14T11:17:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.737+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~A4Y4KR3EUAY8.1 size=1048576 2024-09-14T11:17:10.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.738+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~A4Y4KR3EUAY8.2 size=371773 2024-09-14T11:17:10.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.740+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=A4Y4KR3EUAY8 tag=S0EG3BMG1GAE type=write size=3517501 2024-09-14T11:17:10.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.741+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=UO4XTKNBW2BN type=del size=3045895 2024-09-14T11:17:10.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.742+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=GSMZYDBXGZEL type=del 2024-09-14T11:17:10.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.743+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=QT17J80IPGFM type=del size=1663447 2024-09-14T11:17:10.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.745+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=QYQNGSOIYT3K type=del 2024-09-14T11:17:10.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.746+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=XV2WYMVJTP6U type=del size=3410116 2024-09-14T11:17:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.747+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=V8Z2A55YR6I2 type=del 2024-09-14T11:17:10.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.748+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=AQUYE21FGDJN type=del size=4006674 2024-09-14T11:17:10.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.749+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=47EEX8BEE7YZ type=del 2024-09-14T11:17:10.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.752+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~ZTUD8U2C0DWE.0 size=1048576 2024-09-14T11:17:10.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.753+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~ZTUD8U2C0DWE.1 size=274362 2024-09-14T11:17:10.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.753+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=ZTUD8U2C0DWE tag=ATN0D63VZVMI type=write size=2371514 2024-09-14T11:17:10.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.754+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~AERGCLHRVS7K.0 size=1048576 2024-09-14T11:17:10.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.755+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~AERGCLHRVS7K.1 size=1048576 2024-09-14T11:17:10.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.756+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~AERGCLHRVS7K.2 size=1038131 2024-09-14T11:17:10.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.758+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=AERGCLHRVS7K tag=3C70BWLOEXOI type=write size=4183859 2024-09-14T11:17:10.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.760+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~O6ZLUVUVMF05.0 size=1048576 2024-09-14T11:17:10.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.761+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~O6ZLUVUVMF05.1 size=186379 2024-09-14T11:17:10.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.761+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=O6ZLUVUVMF05 tag=MNWRKHHPHWM8 type=write size=2283531 2024-09-14T11:17:10.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.763+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=RUZRZSMEGX09 type=del 2024-09-14T11:17:10.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.764+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=Q7TAECRIGBBN type=del size=3624911 2024-09-14T11:17:10.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.765+0000 7f185d9f8780 1 < canceled operation key=M4FJDW1QHGBM tag=U4EEVCKW66PH type=del size=2525424 2024-09-14T11:17:10.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.767+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~TK0WO5A4O95P.0 size=1048576 2024-09-14T11:17:10.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.768+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~TK0WO5A4O95P.1 size=233144 2024-09-14T11:17:10.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.768+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=TK0WO5A4O95P tag=671NWCMML1TF type=write size=2330296 2024-09-14T11:17:10.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.769+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=CHABBYL1L4K2 type=del 2024-09-14T11:17:10.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.771+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=C5C8HUV4NIW0 type=del size=1188552 2024-09-14T11:17:10.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.772+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=4EIZ89IIE55N type=del 2024-09-14T11:17:10.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.773+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=LLULH55ME8M9 type=del size=1888196 2024-09-14T11:17:10.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.775+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~KOHWG40B07F6.0 size=1048576 2024-09-14T11:17:10.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.775+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~KOHWG40B07F6.1 size=36882 2024-09-14T11:17:10.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.777+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=KOHWG40B07F6 tag=35JXDZFZ5PJC type=write size=2134034 2024-09-14T11:17:10.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.779+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E5B4KX4GTNYY.0 size=883203 2024-09-14T11:17:10.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.779+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=E5B4KX4GTNYY tag=8MNEFH9PJ0K3 type=write size=1931779 2024-09-14T11:17:10.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.780+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=J1LN3LGISUDP type=del 2024-09-14T11:17:10.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.781+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=LKC2GKF8U4PG type=del size=3306811 2024-09-14T11:17:10.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.782+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~H6TKWZLTAWB7.0 size=1048576 2024-09-14T11:17:10.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.783+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~H6TKWZLTAWB7.1 size=208669 2024-09-14T11:17:10.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.785+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=H6TKWZLTAWB7 tag=Q6K8C49GRZGC type=write size=2305821 2024-09-14T11:17:10.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.786+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=G2SN6UK39PUA type=write size=713589 2024-09-14T11:17:10.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.788+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=EMBG0Y6H2P7V type=del 2024-09-14T11:17:10.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.789+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=05V7M16PKXJ8 type=del size=396637 2024-09-14T11:17:10.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.790+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~1LKE0B16ZYQX.0 size=252921 2024-09-14T11:17:10.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.792+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=1LKE0B16ZYQX tag=RHF3ZDP7T0J5 type=write size=1301497 2024-09-14T11:17:10.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.795+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~VKFEHQ2JQEEG.0 size=144108 2024-09-14T11:17:10.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.795+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=VKFEHQ2JQEEG tag=W68P02DODGT3 type=write size=1192684 2024-09-14T11:17:10.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.796+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~PR0PNXL6QS69.0 size=1048576 2024-09-14T11:17:10.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.797+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~PR0PNXL6QS69.1 size=60186 2024-09-14T11:17:10.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.800+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=PR0PNXL6QS69 tag=C5XX51FL27DP type=write size=2157338 2024-09-14T11:17:10.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.801+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=CCSEQZ74VWXX type=del size=4091003 2024-09-14T11:17:10.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.802+0000 7f185d9f8780 1 < canceled operation key=M4FJDW1QHGBM tag=UO4XTKNBW2BN type=del size=3045895 2024-09-14T11:17:10.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.804+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=BNC4D39ARQ5K type=del size=775819 2024-09-14T11:17:10.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.805+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=QT17J80IPGFM type=del 2024-09-14T11:17:10.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.806+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=4Q3FIYE5T057 type=del size=3611802 2024-09-14T11:17:10.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.807+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=XV2WYMVJTP6U type=del 2024-09-14T11:17:10.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.808+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=30U0V8X95CGR type=del size=2590151 2024-09-14T11:17:10.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.810+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=AQUYE21FGDJN type=del 2024-09-14T11:17:10.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.811+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=X4DBMH166B9X type=del size=1613255 2024-09-14T11:17:10.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.812+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~ZTUD8U2C0DWE.0 size=1048576 2024-09-14T11:17:10.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.812+0000 7f185d9f8780 1 < canceled part key=_multipart_H29SXBS4N9JK.2~ZTUD8U2C0DWE.1 size=274362 2024-09-14T11:17:10.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.814+0000 7f185d9f8780 1 < canceled multipart upload key=H29SXBS4N9JK upload=ZTUD8U2C0DWE tag=ATN0D63VZVMI type=write size=2371514 2024-09-14T11:17:10.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.816+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~SYNDM2DTVV3W.0 size=237325 2024-09-14T11:17:10.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.816+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=SYNDM2DTVV3W tag=AP8FLXX2IJZQ type=write size=1285901 2024-09-14T11:17:10.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.818+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~O6ZLUVUVMF05.0 size=1048576 2024-09-14T11:17:10.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.818+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~O6ZLUVUVMF05.1 size=186379 2024-09-14T11:17:10.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.820+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=O6ZLUVUVMF05 tag=MNWRKHHPHWM8 type=write size=2283531 2024-09-14T11:17:10.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.823+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~M0GKZOT30S5X.0 size=1048576 2024-09-14T11:17:10.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.824+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~M0GKZOT30S5X.1 size=935778 2024-09-14T11:17:10.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.824+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=M0GKZOT30S5X tag=QMW7F13L4QWV type=write size=3032930 2024-09-14T11:17:10.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.825+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=Q7TAECRIGBBN type=del 2024-09-14T11:17:10.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.826+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=NB4KCNIH9W0I type=del size=2440625 2024-09-14T11:17:10.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.827+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~TK0WO5A4O95P.0 size=1048576 2024-09-14T11:17:10.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.828+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~TK0WO5A4O95P.1 size=233144 2024-09-14T11:17:10.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.830+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=TK0WO5A4O95P tag=671NWCMML1TF type=write size=2330296 2024-09-14T11:17:10.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.832+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~FSIR220AAXHX.0 size=1048576 2024-09-14T11:17:10.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.833+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~FSIR220AAXHX.1 size=626579 2024-09-14T11:17:10.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.833+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=FSIR220AAXHX tag=TFO5GKXYJ5KJ type=write size=2723731 2024-09-14T11:17:10.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.834+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=C5C8HUV4NIW0 type=del 2024-09-14T11:17:10.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.836+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~M8K0KR8PELAQ.0 size=1048576 2024-09-14T11:17:10.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.837+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~M8K0KR8PELAQ.1 size=1048576 2024-09-14T11:17:10.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.838+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~M8K0KR8PELAQ.2 size=760037 2024-09-14T11:17:10.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.838+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=M8K0KR8PELAQ tag=JHC7OJBNGV0Y type=write size=3905765 2024-09-14T11:17:10.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.840+0000 7f185d9f8780 1 < suggested remove operation key=OYZIXCSGXTHR tag=LLULH55ME8M9 type=del 2024-09-14T11:17:10.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.842+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~E0S00YDOHXEH.0 size=1045703 2024-09-14T11:17:10.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.842+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=E0S00YDOHXEH tag=PUKZNPV0IQ20 type=write size=2094279 2024-09-14T11:17:10.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.845+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~E5B4KX4GTNYY.0 size=883203 2024-09-14T11:17:10.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.847+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=E5B4KX4GTNYY tag=8MNEFH9PJ0K3 type=write size=1931779 2024-09-14T11:17:10.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.848+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=1DEO6UD67ZVS type=del size=2197165 2024-09-14T11:17:10.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.849+0000 7f185d9f8780 1 < canceled operation key=PSL63WUBLB75 tag=LKC2GKF8U4PG type=del size=3306811 2024-09-14T11:17:10.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.851+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~E1PK55K5RCX2.0 size=389865 2024-09-14T11:17:10.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.851+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=E1PK55K5RCX2 tag=K5O8OVYQT8UL type=write size=1438441 2024-09-14T11:17:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.853+0000 7f185d9f8780 1 < completed write operation key=U5S6L8GPSMU5 tag=G2SN6UK39PUA type=write size=713589 2024-09-14T11:17:10.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.854+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=YDS0H7FQGX5F type=del size=328382 2024-09-14T11:17:10.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.856+0000 7f185d9f8780 1 < suggested remove operation key=CJ6C03RXS0IW tag=05V7M16PKXJ8 type=del 2024-09-14T11:17:10.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.859+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~POI88RQDL6TF.0 size=1048576 2024-09-14T11:17:10.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.859+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~POI88RQDL6TF.1 size=638021 2024-09-14T11:17:10.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.859+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=POI88RQDL6TF tag=RYBEF7OXDVZ4 type=write size=2735173 2024-09-14T11:17:10.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.861+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~VKFEHQ2JQEEG.0 size=144108 2024-09-14T11:17:10.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.863+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=VKFEHQ2JQEEG tag=W68P02DODGT3 type=write size=1192684 2024-09-14T11:17:10.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.864+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=9KWAEZJ2QNDV type=del size=4181677 2024-09-14T11:17:10.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.865+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=CCSEQZ74VWXX type=del 2024-09-14T11:17:10.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.867+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~O49JLGPUMS5S.0 size=121000 2024-09-14T11:17:10.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.867+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=O49JLGPUMS5S tag=SE13U890EAMV type=write size=1169576 2024-09-14T11:17:10.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.869+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=BNC4D39ARQ5K type=del 2024-09-14T11:17:10.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.871+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~2FX7U0I524WJ.0 size=1048576 2024-09-14T11:17:10.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.872+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~2FX7U0I524WJ.1 size=848004 2024-09-14T11:17:10.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.872+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=2FX7U0I524WJ tag=6RTZ081BNLW1 type=write size=2945156 2024-09-14T11:17:10.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.873+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=4Q3FIYE5T057 type=del 2024-09-14T11:17:10.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.874+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=F4FER2MCRAF8 type=del size=3522161 2024-09-14T11:17:10.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.875+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=30U0V8X95CGR type=del size=2590151 2024-09-14T11:17:10.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.877+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~0TJ612UO19FK.0 size=791074 2024-09-14T11:17:10.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.878+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=0TJ612UO19FK tag=T7XBM719HRDZ type=write size=1839650 2024-09-14T11:17:10.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.880+0000 7f185d9f8780 1 < suggested remove operation key=WPBYTFP7HRVE tag=X4DBMH166B9X type=del 2024-09-14T11:17:10.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.881+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=5CV0IVHFE0TE type=del size=368389 2024-09-14T11:17:10.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.882+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~SYNDM2DTVV3W.0 size=237325 2024-09-14T11:17:10.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.884+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=SYNDM2DTVV3W tag=AP8FLXX2IJZQ type=write size=1285901 2024-09-14T11:17:10.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.885+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=1B0LS7ZYENRW type=del size=1668659 2024-09-14T11:17:10.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.887+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~M0GKZOT30S5X.0 size=1048576 2024-09-14T11:17:10.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.888+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~M0GKZOT30S5X.1 size=935778 2024-09-14T11:17:10.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.890+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=M0GKZOT30S5X tag=QMW7F13L4QWV type=write size=3032930 2024-09-14T11:17:10.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.892+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~HKEOQJWXMD8I.0 size=563686 2024-09-14T11:17:10.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.892+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=HKEOQJWXMD8I tag=S77RKY25YPTC type=write size=1612262 2024-09-14T11:17:10.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.893+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=NB4KCNIH9W0I type=del 2024-09-14T11:17:10.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.895+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E4S2TDPONS9O.0 size=1048576 2024-09-14T11:17:10.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.896+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E4S2TDPONS9O.1 size=1048576 2024-09-14T11:17:10.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.897+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E4S2TDPONS9O.2 size=233075 2024-09-14T11:17:10.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.897+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=E4S2TDPONS9O tag=SCXDWCQLQ9A5 type=write size=3378803 2024-09-14T11:17:10.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.898+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~FSIR220AAXHX.0 size=1048576 2024-09-14T11:17:10.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.899+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~FSIR220AAXHX.1 size=626579 2024-09-14T11:17:10.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.900+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=FSIR220AAXHX tag=TFO5GKXYJ5KJ type=write size=2723731 2024-09-14T11:17:10.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.903+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~1L2PNGRUFBQN.0 size=1048576 2024-09-14T11:17:10.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.903+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~1L2PNGRUFBQN.1 size=886250 2024-09-14T11:17:10.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.903+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=1L2PNGRUFBQN tag=PUY4643O2PII type=write size=2983402 2024-09-14T11:17:10.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.904+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~M8K0KR8PELAQ.0 size=1048576 2024-09-14T11:17:10.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.905+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~M8K0KR8PELAQ.1 size=1048576 2024-09-14T11:17:10.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.906+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~M8K0KR8PELAQ.2 size=760037 2024-09-14T11:17:10.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.908+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=M8K0KR8PELAQ tag=JHC7OJBNGV0Y type=write size=3905765 2024-09-14T11:17:10.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.909+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=E5LIO170LK25 type=del size=3125455 2024-09-14T11:17:10.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.911+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~E0S00YDOHXEH.0 size=1045703 2024-09-14T11:17:10.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.913+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=E0S00YDOHXEH tag=PUKZNPV0IQ20 type=write size=2094279 2024-09-14T11:17:10.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.915+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~JOWUNFTYY0NR.0 size=749565 2024-09-14T11:17:10.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.915+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=JOWUNFTYY0NR tag=AKYAIRCVRELZ type=write size=1798141 2024-09-14T11:17:10.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.917+0000 7f185d9f8780 1 < suggested remove operation key=1BOZ331NA7JA tag=1DEO6UD67ZVS type=del 2024-09-14T11:17:10.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.918+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=60JOSDJ1JER4 type=del size=422268 2024-09-14T11:17:10.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.919+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~E1PK55K5RCX2.0 size=389865 2024-09-14T11:17:10.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.921+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=E1PK55K5RCX2 tag=K5O8OVYQT8UL type=write size=1438441 2024-09-14T11:17:10.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.923+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~Y0KTZ4QA567C.0 size=1048576 2024-09-14T11:17:10.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.924+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~Y0KTZ4QA567C.1 size=1048576 2024-09-14T11:17:10.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.925+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~Y0KTZ4QA567C.2 size=408705 2024-09-14T11:17:10.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.925+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=Y0KTZ4QA567C tag=6A8X29T9ES23 type=write size=3554433 2024-09-14T11:17:10.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.928+0000 7f185d9f8780 1 < suggested update operation key=CRZOT1D0U2F3 tag=YDS0H7FQGX5F type=del size=328382 2024-09-14T11:17:10.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.930+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~K70F0NIXXG03.0 size=355598 2024-09-14T11:17:10.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.930+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=K70F0NIXXG03 tag=MIIA345FQ4WQ type=write size=1404174 2024-09-14T11:17:10.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.931+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~POI88RQDL6TF.0 size=1048576 2024-09-14T11:17:10.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.932+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~POI88RQDL6TF.1 size=638021 2024-09-14T11:17:10.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.934+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=POI88RQDL6TF tag=RYBEF7OXDVZ4 type=write size=2735173 2024-09-14T11:17:10.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.935+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=0RJ6JP6DP0HW type=write size=650008 2024-09-14T11:17:10.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.936+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=9KWAEZJ2QNDV type=del 2024-09-14T11:17:10.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.937+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=EWBG796KMQJ9 type=del size=3578053 2024-09-14T11:17:10.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.939+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~O49JLGPUMS5S.0 size=121000 2024-09-14T11:17:10.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.941+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=O49JLGPUMS5S tag=SE13U890EAMV type=write size=1169576 2024-09-14T11:17:10.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.942+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=QXQDHE50NN4G type=del size=461922 2024-09-14T11:17:10.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.943+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~2FX7U0I524WJ.0 size=1048576 2024-09-14T11:17:10.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.944+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~2FX7U0I524WJ.1 size=848004 2024-09-14T11:17:10.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.946+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=2FX7U0I524WJ tag=6RTZ081BNLW1 type=write size=2945156 2024-09-14T11:17:10.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.948+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=0KRSVY9GO427 type=del size=507975 2024-09-14T11:17:10.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.949+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=F4FER2MCRAF8 type=del 2024-09-14T11:17:10.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.950+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=9ZS82M8R3AM4 type=del size=320491 2024-09-14T11:17:10.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.951+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~0TJ612UO19FK.0 size=791074 2024-09-14T11:17:10.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.955+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=0TJ612UO19FK tag=T7XBM719HRDZ type=write size=1839650 2024-09-14T11:17:10.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.956+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=6X2UAUDLEEGS type=del size=984889 2024-09-14T11:17:10.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.957+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=5CV0IVHFE0TE type=del 2024-09-14T11:17:10.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.958+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=OHK0PMRAEFZQ type=del size=2766636 2024-09-14T11:17:10.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.960+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=1B0LS7ZYENRW type=del 2024-09-14T11:17:10.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.961+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=MUZADFURL26V type=del size=737326 2024-09-14T11:17:10.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.962+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~HKEOQJWXMD8I.0 size=563686 2024-09-14T11:17:10.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.964+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=HKEOQJWXMD8I tag=S77RKY25YPTC type=write size=1612262 2024-09-14T11:17:10.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.965+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=F2ARJ8M3PFXT type=del size=3278710 2024-09-14T11:17:10.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.966+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~E4S2TDPONS9O.0 size=1048576 2024-09-14T11:17:10.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.966+0000 7f185d9f8780 1 < canceled part key=_multipart_CJ6C03RXS0IW.2~E4S2TDPONS9O.1 size=1048576 2024-09-14T11:17:10.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.967+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~E4S2TDPONS9O.2 size=233075 2024-09-14T11:17:10.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.969+0000 7f185d9f8780 1 < canceled multipart upload key=CJ6C03RXS0IW upload=E4S2TDPONS9O tag=SCXDWCQLQ9A5 type=write size=3378803 2024-09-14T11:17:10.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.972+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~XOLFD7Q3FJ9Z.0 size=239684 2024-09-14T11:17:10.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.972+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=XOLFD7Q3FJ9Z tag=IRLHKXT2Q7CV type=write size=1288260 2024-09-14T11:17:10.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.973+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~1L2PNGRUFBQN.0 size=1048576 2024-09-14T11:17:10.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.974+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~1L2PNGRUFBQN.1 size=886250 2024-09-14T11:17:10.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.977+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=1L2PNGRUFBQN tag=PUY4643O2PII type=write size=2983402 2024-09-14T11:17:10.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.978+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=KGG96R03J1H2 type=del size=2862083 2024-09-14T11:17:10.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.980+0000 7f185d9f8780 1 < suggested remove operation key=HLUMY48G90KB tag=E5LIO170LK25 type=del 2024-09-14T11:17:10.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.982+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=EDIBEXC33837 type=del size=3446860 2024-09-14T11:17:10.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.983+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~JOWUNFTYY0NR.0 size=749565 2024-09-14T11:17:10.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.985+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=JOWUNFTYY0NR tag=AKYAIRCVRELZ type=write size=1798141 2024-09-14T11:17:10.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.986+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=JW9SOTGWWZAK type=del size=2353210 2024-09-14T11:17:10.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.989+0000 7f185d9f8780 1 < suggested update operation key=ESN8NVVJB3B0 tag=60JOSDJ1JER4 type=del size=422268 2024-09-14T11:17:10.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.990+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=MLJIMBHT6D9S type=del size=4085532 2024-09-14T11:17:10.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.992+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~Y0KTZ4QA567C.0 size=1048576 2024-09-14T11:17:10.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.992+0000 7f185d9f8780 1 < canceled part key=_multipart_H29SXBS4N9JK.2~Y0KTZ4QA567C.1 size=1048576 2024-09-14T11:17:10.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.993+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~Y0KTZ4QA567C.2 size=408705 2024-09-14T11:17:10.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.995+0000 7f185d9f8780 1 < canceled multipart upload key=H29SXBS4N9JK upload=Y0KTZ4QA567C tag=6A8X29T9ES23 type=write size=3554433 2024-09-14T11:17:10.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.998+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~LEG3AAZBO2HI.0 size=1048576 2024-09-14T11:17:10.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:10.999+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~LEG3AAZBO2HI.1 size=1048576 2024-09-14T11:17:10.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.000+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~LEG3AAZBO2HI.2 size=245564 2024-09-14T11:17:10.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.000+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=LEG3AAZBO2HI tag=J6616TLWAR2B type=write size=3391292 2024-09-14T11:17:10.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.001+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~K70F0NIXXG03.0 size=355598 2024-09-14T11:17:11.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.003+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=K70F0NIXXG03 tag=MIIA345FQ4WQ type=write size=1404174 2024-09-14T11:17:11.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.006+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~C2CMCRJUJDEO.0 size=1048576 2024-09-14T11:17:11.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.007+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~C2CMCRJUJDEO.1 size=99237 2024-09-14T11:17:11.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.007+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=C2CMCRJUJDEO tag=KSKWPA3F1266 type=write size=2196389 2024-09-14T11:17:11.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.008+0000 7f185d9f8780 1 < completed write operation key=830X857XIX9O tag=0RJ6JP6DP0HW type=write size=650008 2024-09-14T11:17:11.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.009+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=P02WN364VSD4 type=write size=65362 2024-09-14T11:17:11.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.010+0000 7f185d9f8780 -1 < failed to complete operation key=HLUMY48G90KB tag=EWBG796KMQJ9 type=del size=3578053: (22) Invalid argument 2024-09-14T11:17:11.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.012+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~7ZKF9LVY63GM.0 size=275238 2024-09-14T11:17:11.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.012+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=7ZKF9LVY63GM tag=361F15R3VJUL type=write size=1323814 2024-09-14T11:17:11.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.014+0000 7f185d9f8780 1 < suggested remove operation key=OYZIXCSGXTHR tag=QXQDHE50NN4G type=del 2024-09-14T11:17:11.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.016+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=9985290783UQ type=del size=127603 2024-09-14T11:17:11.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.017+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=0KRSVY9GO427 type=del 2024-09-14T11:17:11.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.018+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=9AN460ZN727W type=del size=988240 2024-09-14T11:17:11.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.021+0000 7f185d9f8780 1 < suggested remove operation key=IXWIKD7J74RJ tag=9ZS82M8R3AM4 type=del 2024-09-14T11:17:11.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.023+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~FALE71I0DOZ0.0 size=1048576 2024-09-14T11:17:11.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.024+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~FALE71I0DOZ0.1 size=1048576 2024-09-14T11:17:11.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.025+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~FALE71I0DOZ0.2 size=652245 2024-09-14T11:17:11.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.025+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=FALE71I0DOZ0 tag=CS6EH48LF77F type=write size=3797973 2024-09-14T11:17:11.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.027+0000 7f185d9f8780 1 < suggested update operation key=DAKWA1OCVTBG tag=6X2UAUDLEEGS type=del size=984889 2024-09-14T11:17:11.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.030+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~LUTPIOFAP9NT.0 size=979370 2024-09-14T11:17:11.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.030+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=LUTPIOFAP9NT tag=E7APC0B8SGJL type=write size=2027946 2024-09-14T11:17:11.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.031+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=OHK0PMRAEFZQ type=del 2024-09-14T11:17:11.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.033+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~9RJ1W3DH5WJZ.0 size=1048576 2024-09-14T11:17:11.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.034+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~9RJ1W3DH5WJZ.1 size=1048576 2024-09-14T11:17:11.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.035+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~9RJ1W3DH5WJZ.2 size=881114 2024-09-14T11:17:11.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.035+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=9RJ1W3DH5WJZ tag=3QFW27J4EGJW type=write size=4026842 2024-09-14T11:17:11.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.036+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=MUZADFURL26V type=del 2024-09-14T11:17:11.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.037+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=1NFZR2P69MKR type=del size=50937 2024-09-14T11:17:11.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.038+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=F2ARJ8M3PFXT type=del 2024-09-14T11:17:11.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.040+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=0TC0ODRMP4O4 type=del size=52360 2024-09-14T11:17:11.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.041+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~XOLFD7Q3FJ9Z.0 size=239684 2024-09-14T11:17:11.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.043+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=XOLFD7Q3FJ9Z tag=IRLHKXT2Q7CV type=write size=1288260 2024-09-14T11:17:11.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.044+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=ZLXEB1HIJ1R7 type=del size=2610966 2024-09-14T11:17:11.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.045+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=KGG96R03J1H2 type=del 2024-09-14T11:17:11.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.047+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~X2XHWYVUVFEW.0 size=568126 2024-09-14T11:17:11.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.047+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=X2XHWYVUVFEW tag=FDATXW43S1F7 type=write size=1616702 2024-09-14T11:17:11.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.048+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=EDIBEXC33837 type=del 2024-09-14T11:17:11.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.051+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~F2VH43SMRC8Q.0 size=1048576 2024-09-14T11:17:11.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.051+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~F2VH43SMRC8Q.1 size=1048576 2024-09-14T11:17:11.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.052+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~F2VH43SMRC8Q.2 size=728915 2024-09-14T11:17:11.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.052+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=F2VH43SMRC8Q tag=62K6LUALNG48 type=write size=3874643 2024-09-14T11:17:11.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.054+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=JW9SOTGWWZAK type=del 2024-09-14T11:17:11.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.055+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=R607UCFT50II type=del size=1255566 2024-09-14T11:17:11.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.056+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=MLJIMBHT6D9S type=del 2024-09-14T11:17:11.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.057+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=VU0C2QZEOL1R type=del size=1531430 2024-09-14T11:17:11.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.058+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~LEG3AAZBO2HI.0 size=1048576 2024-09-14T11:17:11.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.059+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~LEG3AAZBO2HI.1 size=1048576 2024-09-14T11:17:11.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.060+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~LEG3AAZBO2HI.2 size=245564 2024-09-14T11:17:11.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.063+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=LEG3AAZBO2HI tag=J6616TLWAR2B type=write size=3391292 2024-09-14T11:17:11.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.065+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~OOI01AV9E8JG.0 size=825200 2024-09-14T11:17:11.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.065+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=OOI01AV9E8JG tag=QC6W0BLO25UM type=write size=1873776 2024-09-14T11:17:11.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.066+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~C2CMCRJUJDEO.0 size=1048576 2024-09-14T11:17:11.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.066+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~C2CMCRJUJDEO.1 size=99237 2024-09-14T11:17:11.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.068+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=C2CMCRJUJDEO tag=KSKWPA3F1266 type=write size=2196389 2024-09-14T11:17:11.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.071+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~LDWIKOEJLXMO.0 size=1048576 2024-09-14T11:17:11.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.072+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~LDWIKOEJLXMO.1 size=1048576 2024-09-14T11:17:11.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.073+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~LDWIKOEJLXMO.2 size=609542 2024-09-14T11:17:11.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.073+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=LDWIKOEJLXMO tag=BZ3UC5MEVSMA type=write size=3755270 2024-09-14T11:17:11.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.074+0000 7f185d9f8780 -1 < failed to complete operation key=OYZIXCSGXTHR tag=P02WN364VSD4 type=write size=65362: (22) Invalid argument 2024-09-14T11:17:11.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.076+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~L9GAOYLXJ1XO.0 size=1048576 2024-09-14T11:17:11.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.077+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~L9GAOYLXJ1XO.1 size=1048576 2024-09-14T11:17:11.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.078+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~L9GAOYLXJ1XO.2 size=601341 2024-09-14T11:17:11.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.078+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=L9GAOYLXJ1XO tag=XKV3JQJ4CLWA type=write size=3747069 2024-09-14T11:17:11.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.079+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~7ZKF9LVY63GM.0 size=275238 2024-09-14T11:17:11.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.081+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=7ZKF9LVY63GM tag=361F15R3VJUL type=write size=1323814 2024-09-14T11:17:11.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.082+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=TJEF4CAELLM0 type=del size=3203859 2024-09-14T11:17:11.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.085+0000 7f185d9f8780 1 < suggested update operation key=N040R6OERAJP tag=9985290783UQ type=del size=127603 2024-09-14T11:17:11.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.087+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~AKAUY75XRTLV.0 size=557414 2024-09-14T11:17:11.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.087+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=AKAUY75XRTLV tag=VNHY6XWZN2MX type=write size=1605990 2024-09-14T11:17:11.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.088+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=9AN460ZN727W type=del 2024-09-14T11:17:11.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.089+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=ZKJCOPPKTA9D type=del size=171792 2024-09-14T11:17:11.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.090+0000 7f185d9f8780 1 < canceled part key=_multipart_55K4D3SEM068.2~FALE71I0DOZ0.0 size=1048576 2024-09-14T11:17:11.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.091+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~FALE71I0DOZ0.1 size=1048576 2024-09-14T11:17:11.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.092+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~FALE71I0DOZ0.2 size=652245 2024-09-14T11:17:11.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.094+0000 7f185d9f8780 1 < canceled multipart upload key=55K4D3SEM068 upload=FALE71I0DOZ0 tag=CS6EH48LF77F type=write size=3797973 2024-09-14T11:17:11.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.095+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=SWN8SY766306 type=del size=611324 2024-09-14T11:17:11.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.096+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~LUTPIOFAP9NT.0 size=979370 2024-09-14T11:17:11.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.098+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=LUTPIOFAP9NT tag=E7APC0B8SGJL type=write size=2027946 2024-09-14T11:17:11.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.099+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=QNV5FVRW90HU type=del size=1321497 2024-09-14T11:17:11.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.099+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~9RJ1W3DH5WJZ.0 size=1048576 2024-09-14T11:17:11.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.100+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~9RJ1W3DH5WJZ.1 size=1048576 2024-09-14T11:17:11.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.101+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~9RJ1W3DH5WJZ.2 size=881114 2024-09-14T11:17:11.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.103+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=9RJ1W3DH5WJZ tag=3QFW27J4EGJW type=write size=4026842 2024-09-14T11:17:11.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.104+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=4STMRG2SP57W type=del size=1747184 2024-09-14T11:17:11.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.106+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=1NFZR2P69MKR type=del 2024-09-14T11:17:11.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.108+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~A6SIL913ZOHH.0 size=336557 2024-09-14T11:17:11.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.108+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=A6SIL913ZOHH tag=LTHTX4YHYMVT type=write size=1385133 2024-09-14T11:17:11.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.109+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=0TC0ODRMP4O4 type=del 2024-09-14T11:17:11.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.111+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~XZIAJUYJRFMT.0 size=1013787 2024-09-14T11:17:11.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.111+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=XZIAJUYJRFMT tag=ELB9ATNX03NW type=write size=2062363 2024-09-14T11:17:11.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.112+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=ZLXEB1HIJ1R7 type=del 2024-09-14T11:17:11.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.113+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=OS0701EB9LS7 type=write size=794614 2024-09-14T11:17:11.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.114+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~X2XHWYVUVFEW.0 size=568126 2024-09-14T11:17:11.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.116+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=X2XHWYVUVFEW tag=FDATXW43S1F7 type=write size=1616702 2024-09-14T11:17:11.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.118+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=UJXAHFW2LD1S type=write size=1003440 2024-09-14T11:17:11.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.118+0000 7f185d9f8780 1 < canceled part key=_multipart_830X857XIX9O.2~F2VH43SMRC8Q.0 size=1048576 2024-09-14T11:17:11.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.119+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~F2VH43SMRC8Q.1 size=1048576 2024-09-14T11:17:11.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.120+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~F2VH43SMRC8Q.2 size=728915 2024-09-14T11:17:11.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.122+0000 7f185d9f8780 1 < canceled multipart upload key=830X857XIX9O upload=F2VH43SMRC8Q tag=62K6LUALNG48 type=write size=3874643 2024-09-14T11:17:11.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.123+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=49DEHSQ9GGKB type=del size=1009264 2024-09-14T11:17:11.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.124+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=R607UCFT50II type=del 2024-09-14T11:17:11.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.125+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=DCEIE6A6MX25 type=del size=164044 2024-09-14T11:17:11.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.127+0000 7f185d9f8780 1 < canceled operation key=6MZGLP5KPPB3 tag=VU0C2QZEOL1R type=del size=1531430 2024-09-14T11:17:11.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.128+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=03Y3UTIGZ77L type=del size=1565778 2024-09-14T11:17:11.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.129+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~OOI01AV9E8JG.0 size=825200 2024-09-14T11:17:11.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.131+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=OOI01AV9E8JG tag=QC6W0BLO25UM type=write size=1873776 2024-09-14T11:17:11.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.132+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=PKCAPK0AV8X8 type=del size=1078213 2024-09-14T11:17:11.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.132+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~LDWIKOEJLXMO.0 size=1048576 2024-09-14T11:17:11.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.133+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~LDWIKOEJLXMO.1 size=1048576 2024-09-14T11:17:11.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.134+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~LDWIKOEJLXMO.2 size=609542 2024-09-14T11:17:11.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.137+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=LDWIKOEJLXMO tag=BZ3UC5MEVSMA type=write size=3755270 2024-09-14T11:17:11.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.139+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~OXN6Z7M8R241.0 size=1048576 2024-09-14T11:17:11.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.140+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~OXN6Z7M8R241.1 size=1048576 2024-09-14T11:17:11.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.141+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~OXN6Z7M8R241.2 size=1012425 2024-09-14T11:17:11.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.141+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=OXN6Z7M8R241 tag=YME4CE3PIHNT type=write size=4158153 2024-09-14T11:17:11.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.142+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~L9GAOYLXJ1XO.0 size=1048576 2024-09-14T11:17:11.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.143+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~L9GAOYLXJ1XO.1 size=1048576 2024-09-14T11:17:11.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.144+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~L9GAOYLXJ1XO.2 size=601341 2024-09-14T11:17:11.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.146+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=L9GAOYLXJ1XO tag=XKV3JQJ4CLWA type=write size=3747069 2024-09-14T11:17:11.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.148+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=4VYCQRVCUDF8 type=del size=2621637 2024-09-14T11:17:11.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.149+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=TJEF4CAELLM0 type=del 2024-09-14T11:17:11.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.150+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=3DCXYN52NDU5 type=del size=213250 2024-09-14T11:17:11.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.152+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~AKAUY75XRTLV.0 size=557414 2024-09-14T11:17:11.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.154+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=AKAUY75XRTLV tag=VNHY6XWZN2MX type=write size=1605990 2024-09-14T11:17:11.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.156+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~8JDLB80RL1HH.0 size=488267 2024-09-14T11:17:11.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.156+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=8JDLB80RL1HH tag=OBZJJB51H2DP type=write size=1536843 2024-09-14T11:17:11.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.158+0000 7f185d9f8780 1 < suggested remove operation key=7XGG5LBGRI4H tag=ZKJCOPPKTA9D type=del 2024-09-14T11:17:11.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.159+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=LFAYV13TGP4I type=del size=2626709 2024-09-14T11:17:11.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.161+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=SWN8SY766306 type=del 2024-09-14T11:17:11.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.162+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=YZFKH5S9NR3A type=del size=2573569 2024-09-14T11:17:11.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.163+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=QNV5FVRW90HU type=del 2024-09-14T11:17:11.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.164+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=89CSYP7AD466 type=del size=1466269 2024-09-14T11:17:11.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.165+0000 7f185d9f8780 1 < canceled operation key=ESN8NVVJB3B0 tag=4STMRG2SP57W type=del size=1747184 2024-09-14T11:17:11.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.167+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=VNSWS48IBV5K type=del size=3723972 2024-09-14T11:17:11.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.168+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~A6SIL913ZOHH.0 size=336557 2024-09-14T11:17:11.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.170+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=A6SIL913ZOHH tag=LTHTX4YHYMVT type=write size=1385133 2024-09-14T11:17:11.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.171+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=0VHJJSS5Z63R type=del size=2432996 2024-09-14T11:17:11.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.173+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~XZIAJUYJRFMT.0 size=1013787 2024-09-14T11:17:11.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.175+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=XZIAJUYJRFMT tag=ELB9ATNX03NW type=write size=2062363 2024-09-14T11:17:11.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.176+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=GM16EA8EZ2IE type=del size=2917761 2024-09-14T11:17:11.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.177+0000 7f185d9f8780 1 < completed write operation key=CJ6C03RXS0IW tag=OS0701EB9LS7 type=write size=794614 2024-09-14T11:17:11.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.179+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=S5GKFBD57Y9R type=write size=262296 2024-09-14T11:17:11.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.180+0000 7f185d9f8780 1 < completed write operation key=N040R6OERAJP tag=UJXAHFW2LD1S type=write size=1003440 2024-09-14T11:17:11.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.184+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~KQ8331SICYRD.0 size=1048576 2024-09-14T11:17:11.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.185+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~KQ8331SICYRD.1 size=1048576 2024-09-14T11:17:11.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.186+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~KQ8331SICYRD.2 size=91957 2024-09-14T11:17:11.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.186+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=KQ8331SICYRD tag=PZLIUTST91G6 type=write size=3237685 2024-09-14T11:17:11.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.187+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=49DEHSQ9GGKB type=del 2024-09-14T11:17:11.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.188+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=UGWIB3FOQ1Y8 type=del size=2382442 2024-09-14T11:17:11.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.189+0000 7f185d9f8780 1 < canceled operation key=PSL63WUBLB75 tag=DCEIE6A6MX25 type=del size=164044 2024-09-14T11:17:11.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.191+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~0B871476IPT3.0 size=1048576 2024-09-14T11:17:11.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.192+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~0B871476IPT3.1 size=1048576 2024-09-14T11:17:11.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.193+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~0B871476IPT3.2 size=243035 2024-09-14T11:17:11.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.193+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=0B871476IPT3 tag=P1OFPJV0JA0P type=write size=3388763 2024-09-14T11:17:11.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.194+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=03Y3UTIGZ77L type=del 2024-09-14T11:17:11.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.195+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=X4T8A025JRCV type=del size=3990492 2024-09-14T11:17:11.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.197+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=PKCAPK0AV8X8 type=del size=1078213 2024-09-14T11:17:11.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.199+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~A41PF2GF2YWG.0 size=1048576 2024-09-14T11:17:11.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.200+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~A41PF2GF2YWG.1 size=1048576 2024-09-14T11:17:11.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.201+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~A41PF2GF2YWG.2 size=423007 2024-09-14T11:17:11.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.201+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=A41PF2GF2YWG tag=2NFMQMHLKGTL type=write size=3568735 2024-09-14T11:17:11.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.202+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~OXN6Z7M8R241.0 size=1048576 2024-09-14T11:17:11.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.203+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~OXN6Z7M8R241.1 size=1048576 2024-09-14T11:17:11.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.204+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~OXN6Z7M8R241.2 size=1012425 2024-09-14T11:17:11.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.206+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=OXN6Z7M8R241 tag=YME4CE3PIHNT type=write size=4158153 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.207+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=IM12CKHJIP2S type=del size=1659771 2024-09-14T11:17:11.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.208+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=4VYCQRVCUDF8 type=del 2024-09-14T11:17:11.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.209+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=XIF4B8EV71NY type=del size=4127172 2024-09-14T11:17:11.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.210+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=3DCXYN52NDU5 type=del 2024-09-14T11:17:11.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.213+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~0KJBLC6P9S5W.0 size=1048576 2024-09-14T11:17:11.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.213+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~0KJBLC6P9S5W.1 size=744254 2024-09-14T11:17:11.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.213+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=0KJBLC6P9S5W tag=AQK1G3ENXGJO type=write size=2841406 2024-09-14T11:17:11.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.215+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~8JDLB80RL1HH.0 size=488267 2024-09-14T11:17:11.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.217+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=8JDLB80RL1HH tag=OBZJJB51H2DP type=write size=1536843 2024-09-14T11:17:11.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.219+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~TNR1FGWUUFHW.0 size=1039272 2024-09-14T11:17:11.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.219+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=TNR1FGWUUFHW tag=0FUB50NX3H1G type=write size=2087848 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.220+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=LFAYV13TGP4I type=del 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.222+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~8XLG8M9M3VR9.0 size=500153 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.222+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=8XLG8M9M3VR9 tag=82LNGVD670PR type=write size=1548729 2024-09-14T11:17:11.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.223+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=YZFKH5S9NR3A type=del 2024-09-14T11:17:11.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.225+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~019QWBR2T6B7.0 size=1048576 2024-09-14T11:17:11.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.226+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~019QWBR2T6B7.1 size=1048576 2024-09-14T11:17:11.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.227+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~019QWBR2T6B7.2 size=576342 2024-09-14T11:17:11.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.227+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=019QWBR2T6B7 tag=M22YW7DFFOPQ type=write size=3722070 2024-09-14T11:17:11.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.228+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=89CSYP7AD466 type=del 2024-09-14T11:17:11.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.229+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=V53P3NIOGC4Z type=del size=2045413 2024-09-14T11:17:11.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.232+0000 7f185d9f8780 1 < suggested update operation key=P30WF4R3UFPX tag=VNSWS48IBV5K type=del size=3723972 2024-09-14T11:17:11.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.234+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~XKDED9L35MGY.0 size=1048576 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.235+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~XKDED9L35MGY.1 size=1048576 2024-09-14T11:17:11.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.235+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~XKDED9L35MGY.2 size=98504 2024-09-14T11:17:11.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.235+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=XKDED9L35MGY tag=Q0EUYKQM8WXT type=write size=3244232 2024-09-14T11:17:11.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.237+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=0VHJJSS5Z63R type=del 2024-09-14T11:17:11.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.238+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=Q3QUJJKB8Q2C type=del size=2830652 2024-09-14T11:17:11.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.239+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=GM16EA8EZ2IE type=del 2024-09-14T11:17:11.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.240+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=2CVCQ13NGE2L type=del size=2738663 2024-09-14T11:17:11.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.241+0000 7f185d9f8780 1 < completed write operation key=IXWIKD7J74RJ tag=S5GKFBD57Y9R type=write size=262296 2024-09-14T11:17:11.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.244+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~BMWESUTSC6VK.0 size=1048576 2024-09-14T11:17:11.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.245+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~BMWESUTSC6VK.1 size=1048576 2024-09-14T11:17:11.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.245+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~BMWESUTSC6VK.2 size=424149 2024-09-14T11:17:11.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.245+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=BMWESUTSC6VK tag=IKYJHB24WEB9 type=write size=3569877 2024-09-14T11:17:11.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.247+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~KQ8331SICYRD.0 size=1048576 2024-09-14T11:17:11.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.247+0000 7f185d9f8780 1 < canceled part key=_multipart_J6RN3WULDLQE.2~KQ8331SICYRD.1 size=1048576 2024-09-14T11:17:11.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.248+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~KQ8331SICYRD.2 size=91957 2024-09-14T11:17:11.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.250+0000 7f185d9f8780 1 < canceled multipart upload key=J6RN3WULDLQE upload=KQ8331SICYRD tag=PZLIUTST91G6 type=write size=3237685 2024-09-14T11:17:11.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.252+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~IKQCIUJ5Z8C5.0 size=1048576 2024-09-14T11:17:11.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.253+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~IKQCIUJ5Z8C5.1 size=552005 2024-09-14T11:17:11.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.253+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=IKQCIUJ5Z8C5 tag=HQ6VSH2I5Q38 type=write size=2649157 2024-09-14T11:17:11.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.254+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=UGWIB3FOQ1Y8 type=del 2024-09-14T11:17:11.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.256+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~VE8ZPNK4NQAO.0 size=1048576 2024-09-14T11:17:11.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.257+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~VE8ZPNK4NQAO.1 size=479614 2024-09-14T11:17:11.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.257+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=VE8ZPNK4NQAO tag=2DCR4ESF4T1I type=write size=2576766 2024-09-14T11:17:11.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.258+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~0B871476IPT3.0 size=1048576 2024-09-14T11:17:11.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.259+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~0B871476IPT3.1 size=1048576 2024-09-14T11:17:11.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.260+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~0B871476IPT3.2 size=243035 2024-09-14T11:17:11.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.261+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=0B871476IPT3 tag=P1OFPJV0JA0P type=write size=3388763 2024-09-14T11:17:11.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.264+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~MJ2J2COCT5NG.0 size=1048576 2024-09-14T11:17:11.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.265+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~MJ2J2COCT5NG.1 size=768893 2024-09-14T11:17:11.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.265+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=MJ2J2COCT5NG tag=BT4GQNA8TA2Z type=write size=2866045 2024-09-14T11:17:11.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.266+0000 7f185d9f8780 1 < canceled operation key=HLUMY48G90KB tag=X4T8A025JRCV type=del size=3990492 2024-09-14T11:17:11.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.267+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=VM7WRVAPICUP type=del size=3367266 2024-09-14T11:17:11.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.268+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~A41PF2GF2YWG.0 size=1048576 2024-09-14T11:17:11.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.268+0000 7f185d9f8780 1 < canceled part key=_multipart_J6RN3WULDLQE.2~A41PF2GF2YWG.1 size=1048576 2024-09-14T11:17:11.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.268+0000 7f185d9f8780 1 < canceled part key=_multipart_J6RN3WULDLQE.2~A41PF2GF2YWG.2 size=423007 2024-09-14T11:17:11.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.270+0000 7f185d9f8780 1 < canceled multipart upload key=J6RN3WULDLQE upload=A41PF2GF2YWG tag=2NFMQMHLKGTL type=write size=3568735 2024-09-14T11:17:11.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.271+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=0M03L0NGCVCR type=del size=1220013 2024-09-14T11:17:11.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.274+0000 7f185d9f8780 1 < suggested update operation key=PSL63WUBLB75 tag=IM12CKHJIP2S type=del size=1659771 2024-09-14T11:17:11.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.276+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~JQ8RMG3TNBYA.0 size=986756 2024-09-14T11:17:11.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.276+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=JQ8RMG3TNBYA tag=08BKFUE677ZP type=write size=2035332 2024-09-14T11:17:11.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.277+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=XIF4B8EV71NY type=del 2024-09-14T11:17:11.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.279+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~4Z0S23ENCETX.0 size=1048576 2024-09-14T11:17:11.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.280+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~4Z0S23ENCETX.1 size=874891 2024-09-14T11:17:11.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.280+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=4Z0S23ENCETX tag=USWURVT8XZPV type=write size=2972043 2024-09-14T11:17:11.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.280+0000 7f185d9f8780 1 < canceled part key=_multipart_087PN6V1BP65.2~0KJBLC6P9S5W.0 size=1048576 2024-09-14T11:17:11.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.281+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~0KJBLC6P9S5W.1 size=744254 2024-09-14T11:17:11.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.283+0000 7f185d9f8780 1 < canceled multipart upload key=087PN6V1BP65 upload=0KJBLC6P9S5W tag=AQK1G3ENXGJO type=write size=2841406 2024-09-14T11:17:11.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.284+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=KO2XANSTLQ3M type=del size=3009277 2024-09-14T11:17:11.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.286+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~TNR1FGWUUFHW.0 size=1039272 2024-09-14T11:17:11.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.287+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=TNR1FGWUUFHW tag=0FUB50NX3H1G type=write size=2087848 2024-09-14T11:17:11.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.289+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=N04477YEV4IZ type=del size=1868997 2024-09-14T11:17:11.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.291+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~8XLG8M9M3VR9.0 size=500153 2024-09-14T11:17:11.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.293+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=8XLG8M9M3VR9 tag=82LNGVD670PR type=write size=1548729 2024-09-14T11:17:11.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.294+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=1OECQD9467NO type=del size=1550778 2024-09-14T11:17:11.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.295+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~019QWBR2T6B7.0 size=1048576 2024-09-14T11:17:11.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.296+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~019QWBR2T6B7.1 size=1048576 2024-09-14T11:17:11.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.297+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~019QWBR2T6B7.2 size=576342 2024-09-14T11:17:11.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.299+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=019QWBR2T6B7 tag=M22YW7DFFOPQ type=write size=3722070 2024-09-14T11:17:11.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.300+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=NCOQNQ7TXGPB type=del size=633957 2024-09-14T11:17:11.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.301+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=V53P3NIOGC4Z type=del 2024-09-14T11:17:11.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.302+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=RROEFOQ8F42T type=del size=3580500 2024-09-14T11:17:11.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.304+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~XKDED9L35MGY.0 size=1048576 2024-09-14T11:17:11.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.305+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~XKDED9L35MGY.1 size=1048576 2024-09-14T11:17:11.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.306+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~XKDED9L35MGY.2 size=98504 2024-09-14T11:17:11.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.307+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=XKDED9L35MGY tag=Q0EUYKQM8WXT type=write size=3244232 2024-09-14T11:17:11.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.309+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=0DDQEICLQ4EJ type=del size=1550163 2024-09-14T11:17:11.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.310+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=Q3QUJJKB8Q2C type=del 2024-09-14T11:17:11.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.311+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=047WIFALPOYB type=del size=3426995 2024-09-14T11:17:11.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.312+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=2CVCQ13NGE2L type=del 2024-09-14T11:17:11.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.315+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~97N8VHJUTI8Z.0 size=483309 2024-09-14T11:17:11.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.315+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=97N8VHJUTI8Z tag=SYLLT0Z5LY8L type=write size=1531885 2024-09-14T11:17:11.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.316+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~BMWESUTSC6VK.0 size=1048576 2024-09-14T11:17:11.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.317+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~BMWESUTSC6VK.1 size=1048576 2024-09-14T11:17:11.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.318+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~BMWESUTSC6VK.2 size=424149 2024-09-14T11:17:11.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.320+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=BMWESUTSC6VK tag=IKYJHB24WEB9 type=write size=3569877 2024-09-14T11:17:11.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.322+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~DMTLFT4DK1TP.0 size=1000443 2024-09-14T11:17:11.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.322+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=DMTLFT4DK1TP tag=1D6C3G3WFUXR type=write size=2049019 2024-09-14T11:17:11.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.323+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~IKQCIUJ5Z8C5.0 size=1048576 2024-09-14T11:17:11.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.324+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~IKQCIUJ5Z8C5.1 size=552005 2024-09-14T11:17:11.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.326+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=IKQCIUJ5Z8C5 tag=HQ6VSH2I5Q38 type=write size=2649157 2024-09-14T11:17:11.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.327+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=861GVS42V4X8 type=write size=112252 2024-09-14T11:17:11.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.329+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~VE8ZPNK4NQAO.0 size=1048576 2024-09-14T11:17:11.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.330+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~VE8ZPNK4NQAO.1 size=479614 2024-09-14T11:17:11.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.332+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=VE8ZPNK4NQAO tag=2DCR4ESF4T1I type=write size=2576766 2024-09-14T11:17:11.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.333+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=8MGRW59HLINI type=del size=730522 2024-09-14T11:17:11.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.334+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~MJ2J2COCT5NG.0 size=1048576 2024-09-14T11:17:11.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.335+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~MJ2J2COCT5NG.1 size=768893 2024-09-14T11:17:11.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.337+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=MJ2J2COCT5NG tag=BT4GQNA8TA2Z type=write size=2866045 2024-09-14T11:17:11.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.338+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=691TGZLUV4TE type=del size=3414372 2024-09-14T11:17:11.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.340+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=VM7WRVAPICUP type=del size=3367266 2024-09-14T11:17:11.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.341+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=224IRGWYIDTT type=del size=2392202 2024-09-14T11:17:11.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.342+0000 7f185d9f8780 1 < canceled operation key=P30WF4R3UFPX tag=0M03L0NGCVCR type=del size=1220013 2024-09-14T11:17:11.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.344+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~GXTGZ279LJ0X.0 size=1048576 2024-09-14T11:17:11.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.345+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~GXTGZ279LJ0X.1 size=1048576 2024-09-14T11:17:11.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.346+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~GXTGZ279LJ0X.2 size=297774 2024-09-14T11:17:11.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.346+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=GXTGZ279LJ0X tag=AE8POHNRKE7Z type=write size=3443502 2024-09-14T11:17:11.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.347+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~JQ8RMG3TNBYA.0 size=986756 2024-09-14T11:17:11.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.349+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=JQ8RMG3TNBYA tag=08BKFUE677ZP type=write size=2035332 2024-09-14T11:17:11.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.352+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~R9KAJ1VWF9NJ.0 size=695602 2024-09-14T11:17:11.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.352+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=R9KAJ1VWF9NJ tag=9EJXZHBGYGGY type=write size=1744178 2024-09-14T11:17:11.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.353+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~4Z0S23ENCETX.0 size=1048576 2024-09-14T11:17:11.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.354+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~4Z0S23ENCETX.1 size=874891 2024-09-14T11:17:11.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.356+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=4Z0S23ENCETX tag=USWURVT8XZPV type=write size=2972043 2024-09-14T11:17:11.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.357+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=ZFUC4H62KX0F type=del size=500669 2024-09-14T11:17:11.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.358+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=KO2XANSTLQ3M type=del 2024-09-14T11:17:11.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.360+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~S7ENVAZ9NUGA.0 size=1048576 2024-09-14T11:17:11.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.361+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~S7ENVAZ9NUGA.1 size=386696 2024-09-14T11:17:11.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.361+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=S7ENVAZ9NUGA tag=JM65ML9MYHOB type=write size=2483848 2024-09-14T11:17:11.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.363+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=N04477YEV4IZ type=del 2024-09-14T11:17:11.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.364+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=8A91E9NCYBCR type=del size=244294 2024-09-14T11:17:11.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.366+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=1OECQD9467NO type=del 2024-09-14T11:17:11.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.368+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~14540EIO8NUK.0 size=1048576 2024-09-14T11:17:11.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.369+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~14540EIO8NUK.1 size=481860 2024-09-14T11:17:11.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.369+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=14540EIO8NUK tag=8S6O50YAYLVB type=write size=2579012 2024-09-14T11:17:11.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.372+0000 7f185d9f8780 1 < suggested update operation key=HLUMY48G90KB tag=NCOQNQ7TXGPB type=del size=633957 2024-09-14T11:17:11.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.375+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~YFE5OGU9W0NI.0 size=1048576 2024-09-14T11:17:11.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.375+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~YFE5OGU9W0NI.1 size=143004 2024-09-14T11:17:11.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.375+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=YFE5OGU9W0NI tag=O119YBPLURLE type=write size=2240156 2024-09-14T11:17:11.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.377+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=RROEFOQ8F42T type=del 2024-09-14T11:17:11.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.378+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=WK54FSHAOBDX type=del size=438369 2024-09-14T11:17:11.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.381+0000 7f185d9f8780 1 < suggested update operation key=7XGG5LBGRI4H tag=0DDQEICLQ4EJ type=del size=1550163 2024-09-14T11:17:11.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.383+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~EOYC759DQKDJ.0 size=1048576 2024-09-14T11:17:11.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.384+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~EOYC759DQKDJ.1 size=1048576 2024-09-14T11:17:11.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.385+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~EOYC759DQKDJ.2 size=54501 2024-09-14T11:17:11.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.385+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=EOYC759DQKDJ tag=CYOB0K8SAFK4 type=write size=3200229 2024-09-14T11:17:11.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.386+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=047WIFALPOYB type=del 2024-09-14T11:17:11.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.388+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=8ZOTDL9R2E0E type=del size=2578900 2024-09-14T11:17:11.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.389+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~97N8VHJUTI8Z.0 size=483309 2024-09-14T11:17:11.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.391+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=97N8VHJUTI8Z tag=SYLLT0Z5LY8L type=write size=1531885 2024-09-14T11:17:11.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.392+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=OJZYFM8NDJHH type=del size=2595701 2024-09-14T11:17:11.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.394+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~DMTLFT4DK1TP.0 size=1000443 2024-09-14T11:17:11.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.396+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=DMTLFT4DK1TP tag=1D6C3G3WFUXR type=write size=2049019 2024-09-14T11:17:11.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.398+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~13W5XGONA65H.0 size=1048576 2024-09-14T11:17:11.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.399+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~13W5XGONA65H.1 size=1048576 2024-09-14T11:17:11.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.400+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~13W5XGONA65H.2 size=774056 2024-09-14T11:17:11.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.400+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=13W5XGONA65H tag=WGHMANRSY6HM type=write size=3919784 2024-09-14T11:17:11.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.402+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=861GVS42V4X8 type=write 2024-09-14T11:17:11.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.404+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=GM6SFJ0GWSZD type=del size=1976333 2024-09-14T11:17:11.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.405+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=8MGRW59HLINI type=del 2024-09-14T11:17:11.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.407+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~Z8M7XKLK4241.0 size=1048576 2024-09-14T11:17:11.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.408+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~Z8M7XKLK4241.1 size=1048576 2024-09-14T11:17:11.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.409+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~Z8M7XKLK4241.2 size=1037017 2024-09-14T11:17:11.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.409+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=Z8M7XKLK4241 tag=OD1RB82EITLS type=write size=4182745 2024-09-14T11:17:11.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.410+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=691TGZLUV4TE type=del 2024-09-14T11:17:11.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.411+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=UJ3L1V2KVWOW type=del size=2689979 2024-09-14T11:17:11.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.413+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=224IRGWYIDTT type=del 2024-09-14T11:17:11.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.415+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~09HG1GMNFAJT.0 size=1048576 2024-09-14T11:17:11.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.416+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~09HG1GMNFAJT.1 size=387781 2024-09-14T11:17:11.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.416+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=09HG1GMNFAJT tag=UVNMZFRRR0BW type=write size=2484933 2024-09-14T11:17:11.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.417+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~GXTGZ279LJ0X.0 size=1048576 2024-09-14T11:17:11.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.418+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~GXTGZ279LJ0X.1 size=1048576 2024-09-14T11:17:11.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.419+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~GXTGZ279LJ0X.2 size=297774 2024-09-14T11:17:11.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.421+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=GXTGZ279LJ0X tag=AE8POHNRKE7Z type=write size=3443502 2024-09-14T11:17:11.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.422+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=KKL93QJC40N2 type=del size=897546 2024-09-14T11:17:11.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.424+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~R9KAJ1VWF9NJ.0 size=695602 2024-09-14T11:17:11.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.426+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=R9KAJ1VWF9NJ tag=9EJXZHBGYGGY type=write size=1744178 2024-09-14T11:17:11.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.428+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~H1ZLXD7RJX73.0 size=1048576 2024-09-14T11:17:11.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.429+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~H1ZLXD7RJX73.1 size=115094 2024-09-14T11:17:11.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.429+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=H1ZLXD7RJX73 tag=I4B1RB8R52BR type=write size=2212246 2024-09-14T11:17:11.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.430+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=ZFUC4H62KX0F type=del 2024-09-14T11:17:11.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.433+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~ZSPXL4O4DD5F.0 size=1048576 2024-09-14T11:17:11.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.434+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~ZSPXL4O4DD5F.1 size=1048576 2024-09-14T11:17:11.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.435+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~ZSPXL4O4DD5F.2 size=5384 2024-09-14T11:17:11.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.435+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=ZSPXL4O4DD5F tag=9SMCCAQUP6BE type=write size=3151112 2024-09-14T11:17:11.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.436+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~S7ENVAZ9NUGA.0 size=1048576 2024-09-14T11:17:11.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.437+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~S7ENVAZ9NUGA.1 size=386696 2024-09-14T11:17:11.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.439+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=S7ENVAZ9NUGA tag=JM65ML9MYHOB type=write size=2483848 2024-09-14T11:17:11.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.440+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=J6DRMCLCF2MI type=del size=2809682 2024-09-14T11:17:11.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.441+0000 7f185d9f8780 -1 < failed to complete operation key=7XGG5LBGRI4H tag=8A91E9NCYBCR type=del size=244294: (22) Invalid argument 2024-09-14T11:17:11.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.443+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=EG9U4U0SBQNJ type=del size=1438311 2024-09-14T11:17:11.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.444+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~14540EIO8NUK.0 size=1048576 2024-09-14T11:17:11.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.445+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~14540EIO8NUK.1 size=481860 2024-09-14T11:17:11.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.447+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=14540EIO8NUK tag=8S6O50YAYLVB type=write size=2579012 2024-09-14T11:17:11.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.448+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=8TW4UWCHABTN type=del size=553477 2024-09-14T11:17:11.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.450+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~YFE5OGU9W0NI.0 size=1048576 2024-09-14T11:17:11.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.451+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~YFE5OGU9W0NI.1 size=143004 2024-09-14T11:17:11.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.453+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=YFE5OGU9W0NI tag=O119YBPLURLE type=write size=2240156 2024-09-14T11:17:11.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.455+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~05L9N2VPM740.0 size=1048576 2024-09-14T11:17:11.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.456+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~05L9N2VPM740.1 size=1048576 2024-09-14T11:17:11.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.457+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~05L9N2VPM740.2 size=665607 2024-09-14T11:17:11.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.457+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=05L9N2VPM740 tag=0ZEILL89RBAV type=write size=3811335 2024-09-14T11:17:11.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.458+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=WK54FSHAOBDX type=del 2024-09-14T11:17:11.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.459+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=NBYHTNHN193W type=del size=4059406 2024-09-14T11:17:11.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.460+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~EOYC759DQKDJ.0 size=1048576 2024-09-14T11:17:11.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.461+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~EOYC759DQKDJ.1 size=1048576 2024-09-14T11:17:11.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.462+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~EOYC759DQKDJ.2 size=54501 2024-09-14T11:17:11.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.464+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=EOYC759DQKDJ tag=CYOB0K8SAFK4 type=write size=3200229 2024-09-14T11:17:11.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.465+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=DGCR1MHR0PYA type=del size=494939 2024-09-14T11:17:11.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.467+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=8ZOTDL9R2E0E type=del 2024-09-14T11:17:11.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.468+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=QYIMF3687BIM type=write size=81974 2024-09-14T11:17:11.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.469+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=OJZYFM8NDJHH type=del 2024-09-14T11:17:11.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.470+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=GRDWXRDUQS8W type=del size=1948449 2024-09-14T11:17:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.471+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~13W5XGONA65H.0 size=1048576 2024-09-14T11:17:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.472+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~13W5XGONA65H.1 size=1048576 2024-09-14T11:17:11.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.473+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~13W5XGONA65H.2 size=774056 2024-09-14T11:17:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.475+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=13W5XGONA65H tag=WGHMANRSY6HM type=write size=3919784 2024-09-14T11:17:11.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.477+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~E42DCCCSEDP7.0 size=617208 2024-09-14T11:17:11.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.477+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=E42DCCCSEDP7 tag=G3XW7O7PQ4Z2 type=write size=1665784 2024-09-14T11:17:11.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.479+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=GM6SFJ0GWSZD type=del 2024-09-14T11:17:11.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.480+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=DHPSIU9UN035 type=del size=1302473 2024-09-14T11:17:11.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.481+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~Z8M7XKLK4241.0 size=1048576 2024-09-14T11:17:11.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.482+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~Z8M7XKLK4241.1 size=1048576 2024-09-14T11:17:11.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.483+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~Z8M7XKLK4241.2 size=1037017 2024-09-14T11:17:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.485+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=Z8M7XKLK4241 tag=OD1RB82EITLS type=write size=4182745 2024-09-14T11:17:11.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.486+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=PRA3B3807BJQ type=del size=2596475 2024-09-14T11:17:11.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.487+0000 7f185d9f8780 1 < canceled operation key=LGLAG80GX8GF tag=UJ3L1V2KVWOW type=del size=2689979 2024-09-14T11:17:11.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.488+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=GCZI3Q69H88E type=del size=1298299 2024-09-14T11:17:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.489+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~09HG1GMNFAJT.0 size=1048576 2024-09-14T11:17:11.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.490+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~09HG1GMNFAJT.1 size=387781 2024-09-14T11:17:11.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.492+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=09HG1GMNFAJT tag=UVNMZFRRR0BW type=write size=2484933 2024-09-14T11:17:11.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.493+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=Q0C7K2JBB770 type=del size=1023858 2024-09-14T11:17:11.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.495+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=KKL93QJC40N2 type=del 2024-09-14T11:17:11.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.497+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~WW4SRUOSP32E.0 size=1048576 2024-09-14T11:17:11.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.498+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~WW4SRUOSP32E.1 size=1048576 2024-09-14T11:17:11.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.498+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~WW4SRUOSP32E.2 size=166169 2024-09-14T11:17:11.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.498+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=WW4SRUOSP32E tag=KGLTLUVMBY3N type=write size=3311897 2024-09-14T11:17:11.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.500+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~H1ZLXD7RJX73.0 size=1048576 2024-09-14T11:17:11.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.501+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~H1ZLXD7RJX73.1 size=115094 2024-09-14T11:17:11.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.503+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=H1ZLXD7RJX73 tag=I4B1RB8R52BR type=write size=2212246 2024-09-14T11:17:11.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.505+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~IQUE1QEZGLSZ.0 size=1048576 2024-09-14T11:17:11.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.506+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~IQUE1QEZGLSZ.1 size=1048576 2024-09-14T11:17:11.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.507+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~IQUE1QEZGLSZ.2 size=516686 2024-09-14T11:17:11.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.507+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=IQUE1QEZGLSZ tag=L3OWE7W5NGR1 type=write size=3662414 2024-09-14T11:17:11.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.508+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~ZSPXL4O4DD5F.0 size=1048576 2024-09-14T11:17:11.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.508+0000 7f185d9f8780 1 < canceled part key=_multipart_CRZOT1D0U2F3.2~ZSPXL4O4DD5F.1 size=1048576 2024-09-14T11:17:11.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.509+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~ZSPXL4O4DD5F.2 size=5384 2024-09-14T11:17:11.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.511+0000 7f185d9f8780 1 < canceled multipart upload key=CRZOT1D0U2F3 upload=ZSPXL4O4DD5F tag=9SMCCAQUP6BE type=write size=3151112 2024-09-14T11:17:11.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.514+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=32BJG0T1OZC5 type=del size=4065988 2024-09-14T11:17:11.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.515+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=J6DRMCLCF2MI type=del 2024-09-14T11:17:11.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.516+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=X7SHJ7QQG2ZO type=del size=1580831 2024-09-14T11:17:11.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.518+0000 7f185d9f8780 1 < suggested update operation key=6MZGLP5KPPB3 tag=EG9U4U0SBQNJ type=del size=1438311 2024-09-14T11:17:11.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.520+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=LFQAAPSPBIIY type=del size=775076 2024-09-14T11:17:11.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.521+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=8TW4UWCHABTN type=del 2024-09-14T11:17:11.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.522+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=KV03TTYN9HNL type=del size=3818473 2024-09-14T11:17:11.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.523+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~05L9N2VPM740.0 size=1048576 2024-09-14T11:17:11.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.524+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~05L9N2VPM740.1 size=1048576 2024-09-14T11:17:11.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.525+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~05L9N2VPM740.2 size=665607 2024-09-14T11:17:11.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.527+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=05L9N2VPM740 tag=0ZEILL89RBAV type=write size=3811335 2024-09-14T11:17:11.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.529+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=308342V5JE97 type=write size=118378 2024-09-14T11:17:11.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.530+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=NBYHTNHN193W type=del 2024-09-14T11:17:11.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.531+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=NI6QGLDOUWL8 type=del size=131708 2024-09-14T11:17:11.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.532+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=DGCR1MHR0PYA type=del 2024-09-14T11:17:11.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.535+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~R1SSB3AV4O2C.0 size=1048576 2024-09-14T11:17:11.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.536+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~R1SSB3AV4O2C.1 size=1048576 2024-09-14T11:17:11.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.536+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~R1SSB3AV4O2C.2 size=141855 2024-09-14T11:17:11.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.536+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=R1SSB3AV4O2C tag=PMYFS4KGTM57 type=write size=3287583 2024-09-14T11:17:11.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.538+0000 7f185d9f8780 1 < completed write operation key=CVVKY636WXG9 tag=QYIMF3687BIM type=write size=81974 2024-09-14T11:17:11.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.539+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=QKOJN5FC32EC type=del size=2962160 2024-09-14T11:17:11.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.540+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=GRDWXRDUQS8W type=del 2024-09-14T11:17:11.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.541+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=NT7CDO8GQVU4 type=write size=540347 2024-09-14T11:17:11.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.542+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~E42DCCCSEDP7.0 size=617208 2024-09-14T11:17:11.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.544+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=E42DCCCSEDP7 tag=G3XW7O7PQ4Z2 type=write size=1665784 2024-09-14T11:17:11.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.545+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=J77W5HLNS3Z9 type=del size=3929169 2024-09-14T11:17:11.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.546+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=DHPSIU9UN035 type=del 2024-09-14T11:17:11.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.548+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~Z2QI61U45CZD.0 size=1048576 2024-09-14T11:17:11.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.549+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~Z2QI61U45CZD.1 size=871479 2024-09-14T11:17:11.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.549+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=Z2QI61U45CZD tag=SWP7LS5BOL3S type=write size=2968631 2024-09-14T11:17:11.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.551+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=PRA3B3807BJQ type=del 2024-09-14T11:17:11.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.552+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=FDU8M0Y79BYJ type=del size=3890282 2024-09-14T11:17:11.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.553+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=GCZI3Q69H88E type=del 2024-09-14T11:17:11.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.555+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~398J7ECD0Z9F.0 size=1048576 2024-09-14T11:17:11.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.556+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~398J7ECD0Z9F.1 size=1048576 2024-09-14T11:17:11.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.557+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~398J7ECD0Z9F.2 size=270180 2024-09-14T11:17:11.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.557+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=398J7ECD0Z9F tag=92K28Z35N1W1 type=write size=3415908 2024-09-14T11:17:11.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.560+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=Q0C7K2JBB770 type=del size=1023858 2024-09-14T11:17:11.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.561+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=N4H6CYACLK5R type=del size=688182 2024-09-14T11:17:11.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.562+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~WW4SRUOSP32E.0 size=1048576 2024-09-14T11:17:11.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.563+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~WW4SRUOSP32E.1 size=1048576 2024-09-14T11:17:11.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.564+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~WW4SRUOSP32E.2 size=166169 2024-09-14T11:17:11.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.566+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=WW4SRUOSP32E tag=KGLTLUVMBY3N type=write size=3311897 2024-09-14T11:17:11.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.568+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~5N4TS11F1IFS.0 size=1048576 2024-09-14T11:17:11.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.569+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~5N4TS11F1IFS.1 size=1048576 2024-09-14T11:17:11.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.570+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~5N4TS11F1IFS.2 size=248596 2024-09-14T11:17:11.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.570+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=5N4TS11F1IFS tag=BJ9BNVVV4KBZ type=write size=3394324 2024-09-14T11:17:11.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.571+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~IQUE1QEZGLSZ.0 size=1048576 2024-09-14T11:17:11.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.572+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~IQUE1QEZGLSZ.1 size=1048576 2024-09-14T11:17:11.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.573+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~IQUE1QEZGLSZ.2 size=516686 2024-09-14T11:17:11.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.575+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=IQUE1QEZGLSZ tag=L3OWE7W5NGR1 type=write size=3662414 2024-09-14T11:17:11.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.577+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=AKTJAKJ3LHU8 type=del size=3723554 2024-09-14T11:17:11.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.578+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=32BJG0T1OZC5 type=del 2024-09-14T11:17:11.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.579+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=4JWJDM2715UB type=write size=607631 2024-09-14T11:17:11.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.580+0000 7f185d9f8780 1 < canceled operation key=55K4D3SEM068 tag=X7SHJ7QQG2ZO type=del size=1580831 2024-09-14T11:17:11.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.581+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=NJIAP4TIGMWV type=del size=462640 2024-09-14T11:17:11.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.584+0000 7f185d9f8780 1 < suggested remove operation key=CRZOT1D0U2F3 tag=LFQAAPSPBIIY type=del 2024-09-14T11:17:11.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.585+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=L3FEIXGBBULH type=del size=3536881 2024-09-14T11:17:11.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.587+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=KV03TTYN9HNL type=del 2024-09-14T11:17:11.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.588+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=BR0NEY5B73HP type=write size=443622 2024-09-14T11:17:11.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.590+0000 7f185d9f8780 1 < suggested update operation key=W24KN3J819EB tag=308342V5JE97 type=write size=118378 2024-09-14T11:17:11.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.592+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=M8AXHTUS57PB type=write size=989815 2024-09-14T11:17:11.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.593+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=NI6QGLDOUWL8 type=del 2024-09-14T11:17:11.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.594+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=VLH61B5L6E12 type=del size=3461311 2024-09-14T11:17:11.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.595+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~R1SSB3AV4O2C.0 size=1048576 2024-09-14T11:17:11.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.597+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~R1SSB3AV4O2C.1 size=1048576 2024-09-14T11:17:11.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.598+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~R1SSB3AV4O2C.2 size=141855 2024-09-14T11:17:11.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.600+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=R1SSB3AV4O2C tag=PMYFS4KGTM57 type=write size=3287583 2024-09-14T11:17:11.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.601+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=PQM0YC6HAC5A type=del size=2658393 2024-09-14T11:17:11.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.602+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=QKOJN5FC32EC type=del 2024-09-14T11:17:11.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.605+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~VAZ222IKT9PJ.0 size=1048576 2024-09-14T11:17:11.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.605+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~VAZ222IKT9PJ.1 size=1048576 2024-09-14T11:17:11.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.606+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~VAZ222IKT9PJ.2 size=306190 2024-09-14T11:17:11.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.606+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=VAZ222IKT9PJ tag=8Q3VDQ0SV2E8 type=write size=3451918 2024-09-14T11:17:11.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.609+0000 7f185d9f8780 1 < suggested update operation key=N040R6OERAJP tag=NT7CDO8GQVU4 type=write size=540347 2024-09-14T11:17:11.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.611+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~D63ESCKWW3AR.0 size=944134 2024-09-14T11:17:11.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.611+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=D63ESCKWW3AR tag=YW0NCLUAMSQV type=write size=1992710 2024-09-14T11:17:11.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.612+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=J77W5HLNS3Z9 type=del 2024-09-14T11:17:11.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.613+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=7TT27KZD4N8Q type=del size=2276072 2024-09-14T11:17:11.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.614+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~Z2QI61U45CZD.0 size=1048576 2024-09-14T11:17:11.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.615+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~Z2QI61U45CZD.1 size=871479 2024-09-14T11:17:11.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.617+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=Z2QI61U45CZD tag=SWP7LS5BOL3S type=write size=2968631 2024-09-14T11:17:11.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.619+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~HTYA5OAIVSIJ.0 size=184050 2024-09-14T11:17:11.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.619+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=HTYA5OAIVSIJ tag=1DUQN1BJ6SX3 type=write size=1232626 2024-09-14T11:17:11.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.620+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=FDU8M0Y79BYJ type=del 2024-09-14T11:17:11.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.622+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=1UR1MZMMN8Q1 type=del size=371340 2024-09-14T11:17:11.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.622+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~398J7ECD0Z9F.0 size=1048576 2024-09-14T11:17:11.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.623+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~398J7ECD0Z9F.1 size=1048576 2024-09-14T11:17:11.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.624+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~398J7ECD0Z9F.2 size=270180 2024-09-14T11:17:11.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.626+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=398J7ECD0Z9F tag=92K28Z35N1W1 type=write size=3415908 2024-09-14T11:17:11.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.628+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=MMOWTAF05BOJ type=del size=727084 2024-09-14T11:17:11.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.629+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=N4H6CYACLK5R type=del 2024-09-14T11:17:11.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.631+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~DYO3F2QY7RAJ.0 size=1048576 2024-09-14T11:17:11.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.632+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~DYO3F2QY7RAJ.1 size=392139 2024-09-14T11:17:11.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.632+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=DYO3F2QY7RAJ tag=GEL8BL75NV99 type=write size=2489291 2024-09-14T11:17:11.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.633+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~5N4TS11F1IFS.0 size=1048576 2024-09-14T11:17:11.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.634+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~5N4TS11F1IFS.1 size=1048576 2024-09-14T11:17:11.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.635+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~5N4TS11F1IFS.2 size=248596 2024-09-14T11:17:11.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.637+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=5N4TS11F1IFS tag=BJ9BNVVV4KBZ type=write size=3394324 2024-09-14T11:17:11.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.639+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~MLCSPHDBNOYP.0 size=1048576 2024-09-14T11:17:11.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.640+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~MLCSPHDBNOYP.1 size=128873 2024-09-14T11:17:11.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.640+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=MLCSPHDBNOYP tag=435MBL3BFSJ2 type=write size=2226025 2024-09-14T11:17:11.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.641+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=AKTJAKJ3LHU8 type=del 2024-09-14T11:17:11.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.642+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=LQQMEHTVFG5I type=del size=2803460 2024-09-14T11:17:11.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.643+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=4JWJDM2715UB type=write size=607631 2024-09-14T11:17:11.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.645+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=2PJDU0FQS5GY type=del size=3889588 2024-09-14T11:17:11.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.646+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=NJIAP4TIGMWV type=del 2024-09-14T11:17:11.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.647+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=V3DEIVOI5T0B type=del size=3838106 2024-09-14T11:17:11.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.648+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=L3FEIXGBBULH type=del 2024-09-14T11:17:11.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.651+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~XWZIXL82MR3Q.0 size=644114 2024-09-14T11:17:11.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.651+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=XWZIXL82MR3Q tag=J5HXT3OPJV94 type=write size=1692690 2024-09-14T11:17:11.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.652+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=BR0NEY5B73HP type=write size=443622 2024-09-14T11:17:11.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.654+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~E2H9EEOMNQAD.0 size=1048576 2024-09-14T11:17:11.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.655+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~E2H9EEOMNQAD.1 size=1048576 2024-09-14T11:17:11.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.656+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~E2H9EEOMNQAD.2 size=503034 2024-09-14T11:17:11.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.656+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=E2H9EEOMNQAD tag=9GJKX2UUGD1U type=write size=3648762 2024-09-14T11:17:11.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.657+0000 7f185d9f8780 1 < completed write operation key=OYZIXCSGXTHR tag=M8AXHTUS57PB type=write size=989815 2024-09-14T11:17:11.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.659+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=773CCGHBGX9P type=del size=3446475 2024-09-14T11:17:11.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.660+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=VLH61B5L6E12 type=del 2024-09-14T11:17:11.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.662+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~NXRYDTWPTOJ4.0 size=1048576 2024-09-14T11:17:11.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.663+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~NXRYDTWPTOJ4.1 size=226251 2024-09-14T11:17:11.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.663+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=NXRYDTWPTOJ4 tag=HM21S5MY81OL type=write size=2323403 2024-09-14T11:17:11.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.664+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=PQM0YC6HAC5A type=del 2024-09-14T11:17:11.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.666+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=ZNFOXLX1TI97 type=del size=2297628 2024-09-14T11:17:11.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.667+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~VAZ222IKT9PJ.0 size=1048576 2024-09-14T11:17:11.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.668+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~VAZ222IKT9PJ.1 size=1048576 2024-09-14T11:17:11.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.669+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~VAZ222IKT9PJ.2 size=306190 2024-09-14T11:17:11.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.671+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=VAZ222IKT9PJ tag=8Q3VDQ0SV2E8 type=write size=3451918 2024-09-14T11:17:11.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.672+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=G0YSC0QYY0TZ type=write size=701233 2024-09-14T11:17:11.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.674+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~D63ESCKWW3AR.0 size=944134 2024-09-14T11:17:11.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.676+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=D63ESCKWW3AR tag=YW0NCLUAMSQV type=write size=1992710 2024-09-14T11:17:11.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.678+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~E1CC4189Q46S.0 size=1048576 2024-09-14T11:17:11.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.678+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~E1CC4189Q46S.1 size=704329 2024-09-14T11:17:11.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.678+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=E1CC4189Q46S tag=6ZVT8GJOO61M type=write size=2801481 2024-09-14T11:17:11.678 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.680+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=7TT27KZD4N8Q type=del 2024-09-14T11:17:11.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.682+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~0X56IALSVCY4.0 size=947175 2024-09-14T11:17:11.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.682+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=0X56IALSVCY4 tag=L6OFXPXZWJZA type=write size=1995751 2024-09-14T11:17:11.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.683+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~HTYA5OAIVSIJ.0 size=184050 2024-09-14T11:17:11.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.685+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=HTYA5OAIVSIJ tag=1DUQN1BJ6SX3 type=write size=1232626 2024-09-14T11:17:11.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.686+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=OT3LXZ3BQX16 type=del size=1025263 2024-09-14T11:17:11.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.687+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=1UR1MZMMN8Q1 type=del 2024-09-14T11:17:11.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.689+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=D2Y1PPJQ9WKP type=del size=835356 2024-09-14T11:17:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.690+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=MMOWTAF05BOJ type=del 2024-09-14T11:17:11.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.692+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~93LHBJKLMONN.0 size=174647 2024-09-14T11:17:11.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.692+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=93LHBJKLMONN tag=UVRE8P5S4GC1 type=write size=1223223 2024-09-14T11:17:11.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.692+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~DYO3F2QY7RAJ.0 size=1048576 2024-09-14T11:17:11.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.693+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~DYO3F2QY7RAJ.1 size=392139 2024-09-14T11:17:11.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.695+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=DYO3F2QY7RAJ tag=GEL8BL75NV99 type=write size=2489291 2024-09-14T11:17:11.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.697+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~S0UFGV9AYS2J.0 size=1048576 2024-09-14T11:17:11.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.698+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~S0UFGV9AYS2J.1 size=610336 2024-09-14T11:17:11.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.698+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=S0UFGV9AYS2J tag=2KYHDIHT7W2F type=write size=2707488 2024-09-14T11:17:11.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.700+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~MLCSPHDBNOYP.0 size=1048576 2024-09-14T11:17:11.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.700+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~MLCSPHDBNOYP.1 size=128873 2024-09-14T11:17:11.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.703+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=MLCSPHDBNOYP tag=435MBL3BFSJ2 type=write size=2226025 2024-09-14T11:17:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.705+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~FVJNLX11BNMX.0 size=1048576 2024-09-14T11:17:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.706+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~FVJNLX11BNMX.1 size=525191 2024-09-14T11:17:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.706+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=FVJNLX11BNMX tag=C0XK33SFZBG3 type=write size=2622343 2024-09-14T11:17:11.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.707+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=LQQMEHTVFG5I type=del 2024-09-14T11:17:11.706 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.708+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=JJ2WG9ECDIJ8 type=del size=3674461 2024-09-14T11:17:11.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.710+0000 7f185d9f8780 1 < suggested update operation key=PSL63WUBLB75 tag=2PJDU0FQS5GY type=del size=3889588 2024-09-14T11:17:11.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.712+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=YU3FGVURLL25 type=del size=2026614 2024-09-14T11:17:11.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.713+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=V3DEIVOI5T0B type=del 2024-09-14T11:17:11.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.714+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=VE4IL9HPNXBO type=del size=1179170 2024-09-14T11:17:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.715+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~XWZIXL82MR3Q.0 size=644114 2024-09-14T11:17:11.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.717+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=XWZIXL82MR3Q tag=J5HXT3OPJV94 type=write size=1692690 2024-09-14T11:17:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.719+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~47YHIXX1OBWW.0 size=418021 2024-09-14T11:17:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.719+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=47YHIXX1OBWW tag=D9R1E3W2ETJ6 type=write size=1466597 2024-09-14T11:17:11.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.721+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~E2H9EEOMNQAD.0 size=1048576 2024-09-14T11:17:11.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.722+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~E2H9EEOMNQAD.1 size=1048576 2024-09-14T11:17:11.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.723+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~E2H9EEOMNQAD.2 size=503034 2024-09-14T11:17:11.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.725+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=E2H9EEOMNQAD tag=9GJKX2UUGD1U type=write size=3648762 2024-09-14T11:17:11.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.727+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~95Y9E2O0RQ4R.0 size=1048576 2024-09-14T11:17:11.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.728+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~95Y9E2O0RQ4R.1 size=1048576 2024-09-14T11:17:11.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.729+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~95Y9E2O0RQ4R.2 size=690762 2024-09-14T11:17:11.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.729+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=95Y9E2O0RQ4R tag=085791NS1AH1 type=write size=3836490 2024-09-14T11:17:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.731+0000 7f185d9f8780 1 < suggested update operation key=MPZOX5RU0580 tag=773CCGHBGX9P type=del size=3446475 2024-09-14T11:17:11.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.733+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=9H4AT1CEPU6R type=del size=1972558 2024-09-14T11:17:11.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.734+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~NXRYDTWPTOJ4.0 size=1048576 2024-09-14T11:17:11.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.735+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~NXRYDTWPTOJ4.1 size=226251 2024-09-14T11:17:11.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.738+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=NXRYDTWPTOJ4 tag=HM21S5MY81OL type=write size=2323403 2024-09-14T11:17:11.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.740+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~YU0BNXRIMD4U.0 size=6755 2024-09-14T11:17:11.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.740+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=YU0BNXRIMD4U tag=3O2JQPH87UC0 type=write size=1055331 2024-09-14T11:17:11.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.741+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=ZNFOXLX1TI97 type=del 2024-09-14T11:17:11.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.744+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~H2KNG67LRU5I.0 size=1048576 2024-09-14T11:17:11.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.744+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~H2KNG67LRU5I.1 size=1048576 2024-09-14T11:17:11.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.745+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~H2KNG67LRU5I.2 size=781222 2024-09-14T11:17:11.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.745+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=H2KNG67LRU5I tag=LJAEN067PW2I type=write size=3926950 2024-09-14T11:17:11.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.747+0000 7f185d9f8780 1 < completed write operation key=LGLAG80GX8GF tag=G0YSC0QYY0TZ type=write size=701233 2024-09-14T11:17:11.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.748+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=2XUZ95KEV55S type=del size=1448253 2024-09-14T11:17:11.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.749+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~E1CC4189Q46S.0 size=1048576 2024-09-14T11:17:11.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.750+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~E1CC4189Q46S.1 size=704329 2024-09-14T11:17:11.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.752+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=E1CC4189Q46S tag=6ZVT8GJOO61M type=write size=2801481 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.753+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=EBHAQJ6AWSTS type=write size=76639 2024-09-14T11:17:11.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.754+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~0X56IALSVCY4.0 size=947175 2024-09-14T11:17:11.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.756+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=0X56IALSVCY4 tag=L6OFXPXZWJZA type=write size=1995751 2024-09-14T11:17:11.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.757+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=1H56GB0VY8JI type=del size=1588354 2024-09-14T11:17:11.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.760+0000 7f185d9f8780 1 < suggested remove operation key=SEI774TP8YMJ tag=OT3LXZ3BQX16 type=del 2024-09-14T11:17:11.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.762+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~ZSZ4EKLXB06G.0 size=56697 2024-09-14T11:17:11.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.762+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=ZSZ4EKLXB06G tag=LP7BIEU3N11Q type=write size=1105273 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.764+0000 7f185d9f8780 1 < suggested remove operation key=CJ6C03RXS0IW tag=D2Y1PPJQ9WKP type=del 2024-09-14T11:17:11.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.766+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=W71ODNPQJ3S0 type=del size=3636329 2024-09-14T11:17:11.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.767+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~93LHBJKLMONN.0 size=174647 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.769+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=93LHBJKLMONN tag=UVRE8P5S4GC1 type=write size=1223223 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.770+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=B7OM0AIJ9KMU type=del size=497957 2024-09-14T11:17:11.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.772+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~S0UFGV9AYS2J.0 size=1048576 2024-09-14T11:17:11.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.773+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~S0UFGV9AYS2J.1 size=610336 2024-09-14T11:17:11.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.775+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=S0UFGV9AYS2J tag=2KYHDIHT7W2F type=write size=2707488 2024-09-14T11:17:11.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.776+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=AXUHQIZHKKP4 type=del size=2729799 2024-09-14T11:17:11.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.777+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~FVJNLX11BNMX.0 size=1048576 2024-09-14T11:17:11.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.778+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~FVJNLX11BNMX.1 size=525191 2024-09-14T11:17:11.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.780+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=FVJNLX11BNMX tag=C0XK33SFZBG3 type=write size=2622343 2024-09-14T11:17:11.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.782+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~J41Z3J8ERHCI.0 size=1048576 2024-09-14T11:17:11.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.783+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~J41Z3J8ERHCI.1 size=94484 2024-09-14T11:17:11.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.783+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=J41Z3J8ERHCI tag=VBCV3SS7DGIJ type=write size=2191636 2024-09-14T11:17:11.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.785+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=JJ2WG9ECDIJ8 type=del 2024-09-14T11:17:11.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.786+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=QVE2PSJ0ECCK type=del size=2802415 2024-09-14T11:17:11.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.787+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=YU3FGVURLL25 type=del 2024-09-14T11:17:11.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.788+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=7ZA3QWSVDBBS type=del size=2070667 2024-09-14T11:17:11.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.791+0000 7f185d9f8780 1 < suggested update operation key=J6RN3WULDLQE tag=VE4IL9HPNXBO type=del size=1179170 2024-09-14T11:17:11.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.792+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=RWCBBIK20ZY3 type=write size=925299 2024-09-14T11:17:11.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.794+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~47YHIXX1OBWW.0 size=418021 2024-09-14T11:17:11.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.796+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=47YHIXX1OBWW tag=D9R1E3W2ETJ6 type=write size=1466597 2024-09-14T11:17:11.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.797+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=DLF2RJSQV4QC type=del size=1720355 2024-09-14T11:17:11.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.798+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~95Y9E2O0RQ4R.0 size=1048576 2024-09-14T11:17:11.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.799+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~95Y9E2O0RQ4R.1 size=1048576 2024-09-14T11:17:11.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.800+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~95Y9E2O0RQ4R.2 size=690762 2024-09-14T11:17:11.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.802+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=95Y9E2O0RQ4R tag=085791NS1AH1 type=write size=3836490 2024-09-14T11:17:11.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.803+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=384T7J3AUHGD type=del size=3235537 2024-09-14T11:17:11.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.804+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=9H4AT1CEPU6R type=del 2024-09-14T11:17:11.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.806+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=U0MZ1PKE8RJN type=write size=102178 2024-09-14T11:17:11.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.807+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~YU0BNXRIMD4U.0 size=6755 2024-09-14T11:17:11.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.809+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=YU0BNXRIMD4U tag=3O2JQPH87UC0 type=write size=1055331 2024-09-14T11:17:11.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.811+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~XYC61IPSW9G3.0 size=1048576 2024-09-14T11:17:11.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.812+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~XYC61IPSW9G3.1 size=1048576 2024-09-14T11:17:11.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.813+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~XYC61IPSW9G3.2 size=642179 2024-09-14T11:17:11.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.813+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=XYC61IPSW9G3 tag=1BODI9I45FO0 type=write size=3787907 2024-09-14T11:17:11.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.814+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~H2KNG67LRU5I.0 size=1048576 2024-09-14T11:17:11.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.815+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~H2KNG67LRU5I.1 size=1048576 2024-09-14T11:17:11.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.816+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~H2KNG67LRU5I.2 size=781222 2024-09-14T11:17:11.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.818+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=H2KNG67LRU5I tag=LJAEN067PW2I type=write size=3926950 2024-09-14T11:17:11.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.819+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=9LY116ZTOTLC type=del size=3826992 2024-09-14T11:17:11.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.822+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=2XUZ95KEV55S type=del size=1448253 2024-09-14T11:17:11.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.823+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=LZDDFCG0EJF7 type=del size=3636891 2024-09-14T11:17:11.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.824+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=EBHAQJ6AWSTS type=write size=76639 2024-09-14T11:17:11.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.826+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=JXP484V30RVM type=del size=3763335 2024-09-14T11:17:11.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.827+0000 7f185d9f8780 -1 < failed to complete operation key=CJ6C03RXS0IW tag=1H56GB0VY8JI type=del size=1588354: (22) Invalid argument 2024-09-14T11:17:11.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.828+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=ATLN7HMI2NMM type=del size=2982942 2024-09-14T11:17:11.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.829+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~ZSZ4EKLXB06G.0 size=56697 2024-09-14T11:17:11.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.831+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=ZSZ4EKLXB06G tag=LP7BIEU3N11Q type=write size=1105273 2024-09-14T11:17:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.832+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=ZIVBW5Q0YMXG type=del size=2155868 2024-09-14T11:17:11.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.834+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=W71ODNPQJ3S0 type=del 2024-09-14T11:17:11.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.836+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~JB8V8MI5BUN3.0 size=1048576 2024-09-14T11:17:11.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.837+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~JB8V8MI5BUN3.1 size=1048576 2024-09-14T11:17:11.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.838+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~JB8V8MI5BUN3.2 size=113616 2024-09-14T11:17:11.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.838+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=JB8V8MI5BUN3 tag=HTHZ9X0SANU5 type=write size=3259344 2024-09-14T11:17:11.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.839+0000 7f185d9f8780 1 < canceled operation key=IXWIKD7J74RJ tag=B7OM0AIJ9KMU type=del size=497957 2024-09-14T11:17:11.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.840+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=QP6SPB5XDTW0 type=del size=1675280 2024-09-14T11:17:11.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.841+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=AXUHQIZHKKP4 type=del 2024-09-14T11:17:11.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.843+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=MRPF3BFLD59W type=write size=852845 2024-09-14T11:17:11.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.844+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~J41Z3J8ERHCI.0 size=1048576 2024-09-14T11:17:11.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.845+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~J41Z3J8ERHCI.1 size=94484 2024-09-14T11:17:11.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.847+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=J41Z3J8ERHCI tag=VBCV3SS7DGIJ type=write size=2191636 2024-09-14T11:17:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.849+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~0PKX5BDO3J3P.0 size=1048576 2024-09-14T11:17:11.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.852+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~0PKX5BDO3J3P.1 size=369373 2024-09-14T11:17:11.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.852+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=0PKX5BDO3J3P tag=640OG5LTWQPD type=write size=2466525 2024-09-14T11:17:11.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.853+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=QVE2PSJ0ECCK type=del 2024-09-14T11:17:11.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.854+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=MOT893VR1VQU type=del size=1544227 2024-09-14T11:17:11.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.855+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=7ZA3QWSVDBBS type=del 2024-09-14T11:17:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.857+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=MMOR0XPX5E8N type=del size=1558155 2024-09-14T11:17:11.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.858+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=RWCBBIK20ZY3 type=write size=925299 2024-09-14T11:17:11.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.860+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~GK4XFL1NPXUB.0 size=245156 2024-09-14T11:17:11.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.860+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=GK4XFL1NPXUB tag=C1NY5IJ43O3D type=write size=1293732 2024-09-14T11:17:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.861+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=DLF2RJSQV4QC type=del 2024-09-14T11:17:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.862+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=41Q6CO99Q5QP type=del size=1326097 2024-09-14T11:17:11.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.864+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=384T7J3AUHGD type=del 2024-09-14T11:17:11.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.865+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=Y3TJRAFGZP5T type=del size=2608660 2024-09-14T11:17:11.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.866+0000 7f185d9f8780 1 < completed write operation key=HLUMY48G90KB tag=U0MZ1PKE8RJN type=write size=102178 2024-09-14T11:17:11.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.868+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~Z5P71DS0HLTB.0 size=33358 2024-09-14T11:17:11.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.868+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=Z5P71DS0HLTB tag=H6JX7FYYY77N type=write size=1081934 2024-09-14T11:17:11.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.869+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~XYC61IPSW9G3.0 size=1048576 2024-09-14T11:17:11.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.870+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~XYC61IPSW9G3.1 size=1048576 2024-09-14T11:17:11.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.870+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~XYC61IPSW9G3.2 size=642179 2024-09-14T11:17:11.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.872+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=XYC61IPSW9G3 tag=1BODI9I45FO0 type=write size=3787907 2024-09-14T11:17:11.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.874+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=CMZKA5GTHO0F type=write size=31482 2024-09-14T11:17:11.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.875+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=9LY116ZTOTLC type=del 2024-09-14T11:17:11.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.877+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~JBSJVJ8JL71G.0 size=1048576 2024-09-14T11:17:11.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.878+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~JBSJVJ8JL71G.1 size=1048576 2024-09-14T11:17:11.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.879+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~JBSJVJ8JL71G.2 size=376480 2024-09-14T11:17:11.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.879+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=JBSJVJ8JL71G tag=E3RPYIFZ4K7I type=write size=3522208 2024-09-14T11:17:11.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.881+0000 7f185d9f8780 1 < suggested remove operation key=L4L83NVMXHXZ tag=LZDDFCG0EJF7 type=del 2024-09-14T11:17:11.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.882+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=MDL08BFEL6E4 type=del size=1150687 2024-09-14T11:17:11.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.884+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=JXP484V30RVM type=del 2024-09-14T11:17:11.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.885+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=2XF854WBIJ2M type=write size=765569 2024-09-14T11:17:11.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.886+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=ATLN7HMI2NMM type=del 2024-09-14T11:17:11.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.888+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~VTVP8DSY3PU3.0 size=386615 2024-09-14T11:17:11.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.888+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=VTVP8DSY3PU3 tag=3K84OCEN6Y3K type=write size=1435191 2024-09-14T11:17:11.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.889+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=ZIVBW5Q0YMXG type=del 2024-09-14T11:17:11.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.892+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~FTCNSNS2EMFO.0 size=1048576 2024-09-14T11:17:11.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.893+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~FTCNSNS2EMFO.1 size=834562 2024-09-14T11:17:11.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.893+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=FTCNSNS2EMFO tag=VYUJBE3R9SVX type=write size=2931714 2024-09-14T11:17:11.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.894+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~JB8V8MI5BUN3.0 size=1048576 2024-09-14T11:17:11.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.895+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~JB8V8MI5BUN3.1 size=1048576 2024-09-14T11:17:11.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.896+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~JB8V8MI5BUN3.2 size=113616 2024-09-14T11:17:11.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.898+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=JB8V8MI5BUN3 tag=HTHZ9X0SANU5 type=write size=3259344 2024-09-14T11:17:11.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.899+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=8BNMJIWH9GLT type=del size=919683 2024-09-14T11:17:11.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.901+0000 7f185d9f8780 1 < canceled operation key=IXWIKD7J74RJ tag=QP6SPB5XDTW0 type=del size=1675280 2024-09-14T11:17:11.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.903+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~UX1JYHD0XZEO.0 size=1048576 2024-09-14T11:17:11.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.904+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~UX1JYHD0XZEO.1 size=199173 2024-09-14T11:17:11.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.904+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=UX1JYHD0XZEO tag=BAG1QY50TA4J type=write size=2296325 2024-09-14T11:17:11.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.906+0000 7f185d9f8780 1 < completed write operation key=6B0SURI3Q8R6 tag=MRPF3BFLD59W type=write size=852845 2024-09-14T11:17:11.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.908+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0L8C6NR28E47.0 size=1048576 2024-09-14T11:17:11.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.909+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0L8C6NR28E47.1 size=1048576 2024-09-14T11:17:11.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.910+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0L8C6NR28E47.2 size=26906 2024-09-14T11:17:11.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.910+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=0L8C6NR28E47 tag=R7AWW4LNC8MS type=write size=3172634 2024-09-14T11:17:11.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.911+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~0PKX5BDO3J3P.0 size=1048576 2024-09-14T11:17:11.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.913+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~0PKX5BDO3J3P.1 size=369373 2024-09-14T11:17:11.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.915+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=0PKX5BDO3J3P tag=640OG5LTWQPD type=write size=2466525 2024-09-14T11:17:11.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.917+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~33MCDWRM7HQ6.0 size=64708 2024-09-14T11:17:11.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.917+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=33MCDWRM7HQ6 tag=NPHIKSWIP4JH type=write size=1113284 2024-09-14T11:17:11.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.919+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=MOT893VR1VQU type=del 2024-09-14T11:17:11.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.920+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=AARAJ9F4B357 type=write size=380195 2024-09-14T11:17:11.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.921+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=MMOR0XPX5E8N type=del 2024-09-14T11:17:11.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.922+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=AC6CJ7KIDWMN type=write size=802572 2024-09-14T11:17:11.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.924+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~GK4XFL1NPXUB.0 size=245156 2024-09-14T11:17:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.926+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=GK4XFL1NPXUB tag=C1NY5IJ43O3D type=write size=1293732 2024-09-14T11:17:11.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.927+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=2KWFK7D4LGUZ type=del size=1552915 2024-09-14T11:17:11.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.928+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=41Q6CO99Q5QP type=del 2024-09-14T11:17:11.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.929+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=GNDGLT4EGDYH type=del size=282755 2024-09-14T11:17:11.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.930+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=Y3TJRAFGZP5T type=del 2024-09-14T11:17:11.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.932+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=08YSOHVUGT99 type=write size=79802 2024-09-14T11:17:11.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.933+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~Z5P71DS0HLTB.0 size=33358 2024-09-14T11:17:11.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.935+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=Z5P71DS0HLTB tag=H6JX7FYYY77N type=write size=1081934 2024-09-14T11:17:11.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.936+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=OL3U7Q2BDLWN type=del size=1768341 2024-09-14T11:17:11.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.937+0000 7f185d9f8780 1 < canceled operation key=MPZOX5RU0580 tag=CMZKA5GTHO0F type=write size=31482 2024-09-14T11:17:11.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.938+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=TICQ6X710A6P type=del size=85462 2024-09-14T11:17:11.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.940+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~JBSJVJ8JL71G.0 size=1048576 2024-09-14T11:17:11.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.941+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~JBSJVJ8JL71G.1 size=1048576 2024-09-14T11:17:11.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.942+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~JBSJVJ8JL71G.2 size=376480 2024-09-14T11:17:11.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.944+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=JBSJVJ8JL71G tag=E3RPYIFZ4K7I type=write size=3522208 2024-09-14T11:17:11.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.946+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~VXP9WH6YLXJQ.0 size=1048576 2024-09-14T11:17:11.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.947+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~VXP9WH6YLXJQ.1 size=696623 2024-09-14T11:17:11.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.947+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=VXP9WH6YLXJQ tag=VBSU49HBUX2X type=write size=2793775 2024-09-14T11:17:11.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.948+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=MDL08BFEL6E4 type=del size=1150687 2024-09-14T11:17:11.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.949+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=YEDN0FPB7T07 type=del size=3797566 2024-09-14T11:17:11.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.950+0000 7f185d9f8780 1 < completed write operation key=ESN8NVVJB3B0 tag=2XF854WBIJ2M type=write size=765569 2024-09-14T11:17:11.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.952+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=Q8U1U3IML4LP type=del size=2931774 2024-09-14T11:17:11.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.953+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~VTVP8DSY3PU3.0 size=386615 2024-09-14T11:17:11.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.955+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=VTVP8DSY3PU3 tag=3K84OCEN6Y3K type=write size=1435191 2024-09-14T11:17:11.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.957+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~0OJZ98S80DBT.0 size=1048576 2024-09-14T11:17:11.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.958+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~0OJZ98S80DBT.1 size=476609 2024-09-14T11:17:11.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.958+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=0OJZ98S80DBT tag=TZ68FLMICXF8 type=write size=2573761 2024-09-14T11:17:11.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.959+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~FTCNSNS2EMFO.0 size=1048576 2024-09-14T11:17:11.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.960+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~FTCNSNS2EMFO.1 size=834562 2024-09-14T11:17:11.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.962+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=FTCNSNS2EMFO tag=VYUJBE3R9SVX type=write size=2931714 2024-09-14T11:17:11.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.963+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=QBHWHI9S5SKC type=del size=3474903 2024-09-14T11:17:11.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.964+0000 7f185d9f8780 1 < canceled operation key=LGLAG80GX8GF tag=8BNMJIWH9GLT type=del size=919683 2024-09-14T11:17:11.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.967+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=VGNC100QKJ26 type=del size=1093813 2024-09-14T11:17:11.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.969+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~UX1JYHD0XZEO.0 size=1048576 2024-09-14T11:17:11.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.970+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~UX1JYHD0XZEO.1 size=199173 2024-09-14T11:17:11.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.972+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=UX1JYHD0XZEO tag=BAG1QY50TA4J type=write size=2296325 2024-09-14T11:17:11.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.974+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~2IS4K11ZDJ08.0 size=1048576 2024-09-14T11:17:11.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.975+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~2IS4K11ZDJ08.1 size=846824 2024-09-14T11:17:11.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.975+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=2IS4K11ZDJ08 tag=AAUHQA8R41RH type=write size=2943976 2024-09-14T11:17:11.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.977+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~0L8C6NR28E47.0 size=1048576 2024-09-14T11:17:11.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.977+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~0L8C6NR28E47.1 size=1048576 2024-09-14T11:17:11.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.977+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~0L8C6NR28E47.2 size=26906 2024-09-14T11:17:11.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.979+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=0L8C6NR28E47 tag=R7AWW4LNC8MS type=write size=3172634 2024-09-14T11:17:11.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.981+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=4T0XKR1FPC6E type=del size=425249 2024-09-14T11:17:11.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.982+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~33MCDWRM7HQ6.0 size=64708 2024-09-14T11:17:11.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.984+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=33MCDWRM7HQ6 tag=NPHIKSWIP4JH type=write size=1113284 2024-09-14T11:17:11.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.986+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~SY1Z4V8OOJ48.0 size=1048576 2024-09-14T11:17:11.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.987+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~SY1Z4V8OOJ48.1 size=166004 2024-09-14T11:17:11.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.987+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=SY1Z4V8OOJ48 tag=QLDT2SXT8N0L type=write size=2263156 2024-09-14T11:17:11.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.989+0000 7f185d9f8780 1 < completed write operation key=087PN6V1BP65 tag=AARAJ9F4B357 type=write size=380195 2024-09-14T11:17:11.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.991+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~FN1GBGY7KI1Z.0 size=1048576 2024-09-14T11:17:11.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.992+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~FN1GBGY7KI1Z.1 size=1048576 2024-09-14T11:17:11.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.993+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~FN1GBGY7KI1Z.2 size=670406 2024-09-14T11:17:11.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.993+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=FN1GBGY7KI1Z tag=62PM3P738NPM type=write size=3816134 2024-09-14T11:17:11.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.994+0000 7f185d9f8780 1 < completed write operation key=M4FJDW1QHGBM tag=AC6CJ7KIDWMN type=write size=802572 2024-09-14T11:17:11.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.995+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=PXN7X7VL1459 type=del size=3132084 2024-09-14T11:17:11.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.997+0000 7f185d9f8780 1 < canceled operation key=087PN6V1BP65 tag=2KWFK7D4LGUZ type=del size=1552915 2024-09-14T11:17:11.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.999+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~5O6HEXOG2SB1.0 size=142879 2024-09-14T11:17:11.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:11.999+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=5O6HEXOG2SB1 tag=BE0TE4EXC8L0 type=write size=1191455 2024-09-14T11:17:11.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.000+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=GNDGLT4EGDYH type=del 2024-09-14T11:17:12.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.002+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~ZMMKLSIJSOLZ.0 size=452786 2024-09-14T11:17:12.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.002+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=ZMMKLSIJSOLZ tag=SHZ39F3QSAJ9 type=write size=1501362 2024-09-14T11:17:12.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.003+0000 7f185d9f8780 1 < completed write operation key=MPZOX5RU0580 tag=08YSOHVUGT99 type=write size=79802 2024-09-14T11:17:12.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.005+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~ZC5GB2IHXMNO.0 size=1048576 2024-09-14T11:17:12.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.006+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~ZC5GB2IHXMNO.1 size=1048576 2024-09-14T11:17:12.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.007+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~ZC5GB2IHXMNO.2 size=303520 2024-09-14T11:17:12.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.007+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=ZC5GB2IHXMNO tag=09S9CI1QWEMX type=write size=3449248 2024-09-14T11:17:12.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.008+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=OL3U7Q2BDLWN type=del 2024-09-14T11:17:12.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.010+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~V9NLGENACAH1.0 size=1038161 2024-09-14T11:17:12.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.010+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=V9NLGENACAH1 tag=164FUADPENSM type=write size=2086737 2024-09-14T11:17:12.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.011+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=TICQ6X710A6P type=del 2024-09-14T11:17:12.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.012+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=NCYNOH30C0HF type=del size=1917212 2024-09-14T11:17:12.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.014+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~VXP9WH6YLXJQ.0 size=1048576 2024-09-14T11:17:12.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.015+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~VXP9WH6YLXJQ.1 size=696623 2024-09-14T11:17:12.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.017+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=VXP9WH6YLXJQ tag=VBSU49HBUX2X type=write size=2793775 2024-09-14T11:17:12.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.018+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=6N0Z2362LHTD type=write size=163199 2024-09-14T11:17:12.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.019+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=YEDN0FPB7T07 type=del 2024-09-14T11:17:12.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.020+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=MHFVZI5ND3AS type=del size=2232645 2024-09-14T11:17:12.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.021+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=Q8U1U3IML4LP type=del 2024-09-14T11:17:12.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.023+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~RORMN1MRF5NT.0 size=1048576 2024-09-14T11:17:12.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.024+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~RORMN1MRF5NT.1 size=312529 2024-09-14T11:17:12.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.024+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=RORMN1MRF5NT tag=L2QRLZVINK0Q type=write size=2409681 2024-09-14T11:17:12.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.026+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~0OJZ98S80DBT.0 size=1048576 2024-09-14T11:17:12.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.027+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~0OJZ98S80DBT.1 size=476609 2024-09-14T11:17:12.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.028+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=0OJZ98S80DBT tag=TZ68FLMICXF8 type=write size=2573761 2024-09-14T11:17:12.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.030+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=GR1UMGFPS2I9 type=del size=2887798 2024-09-14T11:17:12.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.031+0000 7f185d9f8780 1 < canceled operation key=WPBYTFP7HRVE tag=QBHWHI9S5SKC type=del size=3474903 2024-09-14T11:17:12.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.032+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=S11DNYV1AJFI type=del size=3215554 2024-09-14T11:17:12.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.033+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=VGNC100QKJ26 type=del 2024-09-14T11:17:12.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.034+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=J34III66LJ1Q type=del size=1133294 2024-09-14T11:17:12.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.036+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~2IS4K11ZDJ08.0 size=1048576 2024-09-14T11:17:12.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.037+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~2IS4K11ZDJ08.1 size=846824 2024-09-14T11:17:12.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.039+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=2IS4K11ZDJ08 tag=AAUHQA8R41RH type=write size=2943976 2024-09-14T11:17:12.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.040+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=EWEVHTHRRJYR type=del size=2792021 2024-09-14T11:17:12.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.041+0000 7f185d9f8780 1 < canceled operation key=U5S6L8GPSMU5 tag=4T0XKR1FPC6E type=del size=425249 2024-09-14T11:17:12.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.042+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=SB0U7LM7Z547 type=del size=2500723 2024-09-14T11:17:12.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.043+0000 7f185d9f8780 1 < canceled part key=_multipart_7XGG5LBGRI4H.2~SY1Z4V8OOJ48.0 size=1048576 2024-09-14T11:17:12.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.043+0000 7f185d9f8780 1 < canceled part key=_multipart_7XGG5LBGRI4H.2~SY1Z4V8OOJ48.1 size=166004 2024-09-14T11:17:12.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.044+0000 7f185d9f8780 1 < canceled multipart upload key=7XGG5LBGRI4H upload=SY1Z4V8OOJ48 tag=QLDT2SXT8N0L type=write size=2263156 2024-09-14T11:17:12.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.047+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~73Z9PG4RKV42.0 size=850978 2024-09-14T11:17:12.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.047+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=73Z9PG4RKV42 tag=07A4ZC9ZNJ13 type=write size=1899554 2024-09-14T11:17:12.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.048+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~FN1GBGY7KI1Z.0 size=1048576 2024-09-14T11:17:12.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.048+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~FN1GBGY7KI1Z.1 size=1048576 2024-09-14T11:17:12.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.048+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~FN1GBGY7KI1Z.2 size=670406 2024-09-14T11:17:12.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.050+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=FN1GBGY7KI1Z tag=62PM3P738NPM type=write size=3816134 2024-09-14T11:17:12.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.053+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~92U93A7NTJGK.0 size=1048576 2024-09-14T11:17:12.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.054+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~92U93A7NTJGK.1 size=1048576 2024-09-14T11:17:12.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.055+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~92U93A7NTJGK.2 size=744044 2024-09-14T11:17:12.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.055+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=92U93A7NTJGK tag=8YU66ZQ5XAVV type=write size=3889772 2024-09-14T11:17:12.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.057+0000 7f185d9f8780 1 < suggested remove operation key=P30WF4R3UFPX tag=PXN7X7VL1459 type=del 2024-09-14T11:17:12.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.059+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=A9XCP0W3NYZ5 type=del size=355720 2024-09-14T11:17:12.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.060+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~5O6HEXOG2SB1.0 size=142879 2024-09-14T11:17:12.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.062+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=5O6HEXOG2SB1 tag=BE0TE4EXC8L0 type=write size=1191455 2024-09-14T11:17:12.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.064+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~DG0PCS6HGCSJ.0 size=1048576 2024-09-14T11:17:12.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.065+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~DG0PCS6HGCSJ.1 size=1048576 2024-09-14T11:17:12.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.066+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~DG0PCS6HGCSJ.2 size=519545 2024-09-14T11:17:12.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.066+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=DG0PCS6HGCSJ tag=FTCTMQCWU6A9 type=write size=3665273 2024-09-14T11:17:12.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.067+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~ZMMKLSIJSOLZ.0 size=452786 2024-09-14T11:17:12.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.069+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=ZMMKLSIJSOLZ tag=SHZ39F3QSAJ9 type=write size=1501362 2024-09-14T11:17:12.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.071+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~0JE857WGSE4R.0 size=656137 2024-09-14T11:17:12.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.071+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=0JE857WGSE4R tag=61HKCOYAMFWI type=write size=1704713 2024-09-14T11:17:12.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.073+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~ZC5GB2IHXMNO.0 size=1048576 2024-09-14T11:17:12.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.073+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~ZC5GB2IHXMNO.1 size=1048576 2024-09-14T11:17:12.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.073+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~ZC5GB2IHXMNO.2 size=303520 2024-09-14T11:17:12.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.076+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=ZC5GB2IHXMNO tag=09S9CI1QWEMX type=write size=3449248 2024-09-14T11:17:12.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.079+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~1SOKUDD3VGDJ.0 size=1048576 2024-09-14T11:17:12.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.080+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~1SOKUDD3VGDJ.1 size=1048576 2024-09-14T11:17:12.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.081+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~1SOKUDD3VGDJ.2 size=332889 2024-09-14T11:17:12.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.081+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=1SOKUDD3VGDJ tag=HU9WD8IZ0SDA type=write size=3478617 2024-09-14T11:17:12.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.083+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~V9NLGENACAH1.0 size=1038161 2024-09-14T11:17:12.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.085+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=V9NLGENACAH1 tag=164FUADPENSM type=write size=2086737 2024-09-14T11:17:12.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.086+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=URG70AUAPTLV type=del size=4071259 2024-09-14T11:17:12.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.087+0000 7f185d9f8780 1 < canceled operation key=LGLAG80GX8GF tag=NCYNOH30C0HF type=del size=1917212 2024-09-14T11:17:12.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.088+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=B2SJTNL57G9Q type=del size=3964124 2024-09-14T11:17:12.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.089+0000 7f185d9f8780 1 < completed write operation key=CRZOT1D0U2F3 tag=6N0Z2362LHTD type=write size=163199 2024-09-14T11:17:12.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.091+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=D933VGDJC44F type=del size=2849035 2024-09-14T11:17:12.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.092+0000 7f185d9f8780 1 < canceled operation key=J6RN3WULDLQE tag=MHFVZI5ND3AS type=del size=2232645 2024-09-14T11:17:12.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.093+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=WBU68LA4ELLN type=del size=810977 2024-09-14T11:17:12.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.094+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~RORMN1MRF5NT.0 size=1048576 2024-09-14T11:17:12.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.095+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~RORMN1MRF5NT.1 size=312529 2024-09-14T11:17:12.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.097+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=RORMN1MRF5NT tag=L2QRLZVINK0Q type=write size=2409681 2024-09-14T11:17:12.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.098+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=ZQBX093YATRV type=del size=479986 2024-09-14T11:17:12.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.099+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=GR1UMGFPS2I9 type=del 2024-09-14T11:17:12.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.100+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=8GH1PPUKEWYM type=del size=2849330 2024-09-14T11:17:12.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.103+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=S11DNYV1AJFI type=del 2024-09-14T11:17:12.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.104+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=CCXQG5GYZA2T type=del size=3041101 2024-09-14T11:17:12.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.106+0000 7f185d9f8780 1 < suggested update operation key=ZR3IEW48CSCF tag=J34III66LJ1Q type=del size=1133294 2024-09-14T11:17:12.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.107+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=BHIHGPL9G7ZB type=del size=3800515 2024-09-14T11:17:12.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.109+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=EWEVHTHRRJYR type=del 2024-09-14T11:17:12.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.110+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=PXY3671TBQ9Q type=del size=1690320 2024-09-14T11:17:12.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.111+0000 7f185d9f8780 1 < canceled operation key=L4L83NVMXHXZ tag=SB0U7LM7Z547 type=del size=2500723 2024-09-14T11:17:12.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.113+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~MAQ1ND2OIPSG.0 size=1048576 2024-09-14T11:17:12.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.114+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~MAQ1ND2OIPSG.1 size=1048576 2024-09-14T11:17:12.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.115+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~MAQ1ND2OIPSG.2 size=431691 2024-09-14T11:17:12.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.115+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=MAQ1ND2OIPSG tag=O1CH550RSBRG type=write size=3577419 2024-09-14T11:17:12.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.115+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~73Z9PG4RKV42.0 size=850978 2024-09-14T11:17:12.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.117+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=73Z9PG4RKV42 tag=07A4ZC9ZNJ13 type=write size=1899554 2024-09-14T11:17:12.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.119+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=HRUN40E9212C type=del size=3165699 2024-09-14T11:17:12.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.120+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~92U93A7NTJGK.0 size=1048576 2024-09-14T11:17:12.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.120+0000 7f185d9f8780 1 < canceled part key=_multipart_H29SXBS4N9JK.2~92U93A7NTJGK.1 size=1048576 2024-09-14T11:17:12.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.121+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~92U93A7NTJGK.2 size=744044 2024-09-14T11:17:12.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.123+0000 7f185d9f8780 1 < canceled multipart upload key=H29SXBS4N9JK upload=92U93A7NTJGK tag=8YU66ZQ5XAVV type=write size=3889772 2024-09-14T11:17:12.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.124+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=7WA5MBUJ0KQ2 type=del size=2460358 2024-09-14T11:17:12.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.125+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=A9XCP0W3NYZ5 type=del 2024-09-14T11:17:12.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.128+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~O6LX5AD3ELYU.0 size=233596 2024-09-14T11:17:12.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.128+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=O6LX5AD3ELYU tag=3B7A370URQK1 type=write size=1282172 2024-09-14T11:17:12.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.129+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~DG0PCS6HGCSJ.0 size=1048576 2024-09-14T11:17:12.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.130+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~DG0PCS6HGCSJ.1 size=1048576 2024-09-14T11:17:12.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.131+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~DG0PCS6HGCSJ.2 size=519545 2024-09-14T11:17:12.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.133+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=DG0PCS6HGCSJ tag=FTCTMQCWU6A9 type=write size=3665273 2024-09-14T11:17:12.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.135+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~0NKGE2R51X3E.0 size=1048576 2024-09-14T11:17:12.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.136+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~0NKGE2R51X3E.1 size=956851 2024-09-14T11:17:12.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.136+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=0NKGE2R51X3E tag=VXN8PLZ3WSWW type=write size=3054003 2024-09-14T11:17:12.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.138+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~0JE857WGSE4R.0 size=656137 2024-09-14T11:17:12.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.139+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=0JE857WGSE4R tag=61HKCOYAMFWI type=write size=1704713 2024-09-14T11:17:12.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.141+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=CFW7Y0XOPF25 type=del size=1449155 2024-09-14T11:17:12.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.142+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~1SOKUDD3VGDJ.0 size=1048576 2024-09-14T11:17:12.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.143+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~1SOKUDD3VGDJ.1 size=1048576 2024-09-14T11:17:12.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.144+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~1SOKUDD3VGDJ.2 size=332889 2024-09-14T11:17:12.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.146+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=1SOKUDD3VGDJ tag=HU9WD8IZ0SDA type=write size=3478617 2024-09-14T11:17:12.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.148+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~FV30A60WA7PM.0 size=1048576 2024-09-14T11:17:12.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.149+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~FV30A60WA7PM.1 size=602569 2024-09-14T11:17:12.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.149+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=FV30A60WA7PM tag=XTCM80P76BGP type=write size=2699721 2024-09-14T11:17:12.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.150+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=URG70AUAPTLV type=del 2024-09-14T11:17:12.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.151+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=73UFCSCM206Z type=del size=1175636 2024-09-14T11:17:12.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.153+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=B2SJTNL57G9Q type=del 2024-09-14T11:17:12.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.154+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=CEC4DXN7FXZX type=del size=538037 2024-09-14T11:17:12.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.155+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=D933VGDJC44F type=del 2024-09-14T11:17:12.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.156+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=KBX2ZGXJ41SF type=del size=492628 2024-09-14T11:17:12.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.158+0000 7f185d9f8780 1 < suggested update operation key=MPZOX5RU0580 tag=WBU68LA4ELLN type=del size=810977 2024-09-14T11:17:12.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.161+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~E8N3VKKTF7LM.0 size=1048576 2024-09-14T11:17:12.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.161+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~E8N3VKKTF7LM.1 size=1048576 2024-09-14T11:17:12.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.162+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~E8N3VKKTF7LM.2 size=692502 2024-09-14T11:17:12.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.162+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=E8N3VKKTF7LM tag=4EWXLXI0TNSQ type=write size=3838230 2024-09-14T11:17:12.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.165+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=ZQBX093YATRV type=del size=479986 2024-09-14T11:17:12.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.167+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~FCE2CKTBUCM3.0 size=1048576 2024-09-14T11:17:12.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.168+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~FCE2CKTBUCM3.1 size=1048576 2024-09-14T11:17:12.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.169+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~FCE2CKTBUCM3.2 size=363152 2024-09-14T11:17:12.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.169+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=FCE2CKTBUCM3 tag=LXZWNJFJNL77 type=write size=3508880 2024-09-14T11:17:12.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.170+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=8GH1PPUKEWYM type=del 2024-09-14T11:17:12.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.172+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~2H99IQEDZX1X.0 size=1048576 2024-09-14T11:17:12.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.173+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~2H99IQEDZX1X.1 size=465402 2024-09-14T11:17:12.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.173+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=2H99IQEDZX1X tag=FNZMHJXYJGCI type=write size=2562554 2024-09-14T11:17:12.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.174+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=CCXQG5GYZA2T type=del 2024-09-14T11:17:12.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.176+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~EZWUP1G8HGRU.0 size=1048576 2024-09-14T11:17:12.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.177+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~EZWUP1G8HGRU.1 size=16465 2024-09-14T11:17:12.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.177+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=EZWUP1G8HGRU tag=48F5CRGTXFFT type=write size=2113617 2024-09-14T11:17:12.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.178+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=BHIHGPL9G7ZB type=del 2024-09-14T11:17:12.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.179+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=DR97LP1CY4WR type=del size=2607028 2024-09-14T11:17:12.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.182+0000 7f185d9f8780 1 < suggested remove operation key=1BOZ331NA7JA tag=PXY3671TBQ9Q type=del 2024-09-14T11:17:12.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.183+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=QTM7D9KBR3YO type=del size=3710653 2024-09-14T11:17:12.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.184+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~MAQ1ND2OIPSG.0 size=1048576 2024-09-14T11:17:12.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.185+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~MAQ1ND2OIPSG.1 size=1048576 2024-09-14T11:17:12.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.186+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~MAQ1ND2OIPSG.2 size=431691 2024-09-14T11:17:12.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.188+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=MAQ1ND2OIPSG tag=O1CH550RSBRG type=write size=3577419 2024-09-14T11:17:12.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.192+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~4BWLJ3QEKW0Q.0 size=1048576 2024-09-14T11:17:12.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.193+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~4BWLJ3QEKW0Q.1 size=1408 2024-09-14T11:17:12.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.193+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=4BWLJ3QEKW0Q tag=XDLWCFFT91K2 type=write size=2098560 2024-09-14T11:17:12.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.194+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=HRUN40E9212C type=del 2024-09-14T11:17:12.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.195+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=2NF1J38EXG7T type=del size=136202 2024-09-14T11:17:12.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.196+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=7WA5MBUJ0KQ2 type=del 2024-09-14T11:17:12.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.198+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=X4BJ0R8O3HHX type=write size=273245 2024-09-14T11:17:12.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.199+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~O6LX5AD3ELYU.0 size=233596 2024-09-14T11:17:12.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.201+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=O6LX5AD3ELYU tag=3B7A370URQK1 type=write size=1282172 2024-09-14T11:17:12.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.202+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=WCVEQUQK1ZK8 type=del size=708934 2024-09-14T11:17:12.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.204+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~0NKGE2R51X3E.0 size=1048576 2024-09-14T11:17:12.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.205+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~0NKGE2R51X3E.1 size=956851 2024-09-14T11:17:12.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.207+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=0NKGE2R51X3E tag=VXN8PLZ3WSWW type=write size=3054003 2024-09-14T11:17:12.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.209+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~YGVYTEJHWW5K.0 size=1048576 2024-09-14T11:17:12.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.210+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~YGVYTEJHWW5K.1 size=1048576 2024-09-14T11:17:12.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.210+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~YGVYTEJHWW5K.2 size=348871 2024-09-14T11:17:12.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.210+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=YGVYTEJHWW5K tag=K69CHHHBZ5UI type=write size=3494599 2024-09-14T11:17:12.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.212+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=CFW7Y0XOPF25 type=del 2024-09-14T11:17:12.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.214+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~6UHGS3MS7IQG.0 size=1048576 2024-09-14T11:17:12.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.215+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~6UHGS3MS7IQG.1 size=1048576 2024-09-14T11:17:12.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.216+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~6UHGS3MS7IQG.2 size=807951 2024-09-14T11:17:12.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.216+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=6UHGS3MS7IQG tag=50U1SIAW0V6X type=write size=3953679 2024-09-14T11:17:12.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.217+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~FV30A60WA7PM.0 size=1048576 2024-09-14T11:17:12.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.218+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~FV30A60WA7PM.1 size=602569 2024-09-14T11:17:12.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.220+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=FV30A60WA7PM tag=XTCM80P76BGP type=write size=2699721 2024-09-14T11:17:12.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.222+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~5W843LS4Q4E3.0 size=1042131 2024-09-14T11:17:12.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.222+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=5W843LS4Q4E3 tag=15OHQAMZWDCK type=write size=2090707 2024-09-14T11:17:12.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.223+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=73UFCSCM206Z type=del 2024-09-14T11:17:12.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.224+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=81N0Z5UGC2L3 type=del size=3095037 2024-09-14T11:17:12.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.226+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=CEC4DXN7FXZX type=del 2024-09-14T11:17:12.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.227+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=77XGXOKMSE0F type=del size=1658464 2024-09-14T11:17:12.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.228+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=KBX2ZGXJ41SF type=del 2024-09-14T11:17:12.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.229+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=AZ39QXV1VUV4 type=write size=799091 2024-09-14T11:17:12.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.230+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~E8N3VKKTF7LM.0 size=1048576 2024-09-14T11:17:12.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.230+0000 7f185d9f8780 1 < canceled part key=_multipart_087PN6V1BP65.2~E8N3VKKTF7LM.1 size=1048576 2024-09-14T11:17:12.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.231+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~E8N3VKKTF7LM.2 size=692502 2024-09-14T11:17:12.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.233+0000 7f185d9f8780 1 < canceled multipart upload key=087PN6V1BP65 upload=E8N3VKKTF7LM tag=4EWXLXI0TNSQ type=write size=3838230 2024-09-14T11:17:12.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.235+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~CZKNK74TQ91R.0 size=717836 2024-09-14T11:17:12.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.235+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=CZKNK74TQ91R tag=451I20O8W3SL type=write size=1766412 2024-09-14T11:17:12.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.237+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~FCE2CKTBUCM3.0 size=1048576 2024-09-14T11:17:12.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.238+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~FCE2CKTBUCM3.1 size=1048576 2024-09-14T11:17:12.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.238+0000 7f185d9f8780 1 < canceled part key=_multipart_J6RN3WULDLQE.2~FCE2CKTBUCM3.2 size=363152 2024-09-14T11:17:12.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.239+0000 7f185d9f8780 1 < canceled multipart upload key=J6RN3WULDLQE upload=FCE2CKTBUCM3 tag=LXZWNJFJNL77 type=write size=3508880 2024-09-14T11:17:12.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.242+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~78RPD8F0B5JJ.0 size=140627 2024-09-14T11:17:12.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.242+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=78RPD8F0B5JJ tag=AN9FHQ2APQZQ type=write size=1189203 2024-09-14T11:17:12.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.243+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~2H99IQEDZX1X.0 size=1048576 2024-09-14T11:17:12.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.244+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~2H99IQEDZX1X.1 size=465402 2024-09-14T11:17:12.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.246+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=2H99IQEDZX1X tag=FNZMHJXYJGCI type=write size=2562554 2024-09-14T11:17:12.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.248+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~VOX4Q1FHHR72.0 size=1048576 2024-09-14T11:17:12.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.249+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~VOX4Q1FHHR72.1 size=1048576 2024-09-14T11:17:12.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.250+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~VOX4Q1FHHR72.2 size=801396 2024-09-14T11:17:12.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.250+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=VOX4Q1FHHR72 tag=P2VV09DW1KXA type=write size=3947124 2024-09-14T11:17:12.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.251+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~EZWUP1G8HGRU.0 size=1048576 2024-09-14T11:17:12.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.252+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~EZWUP1G8HGRU.1 size=16465 2024-09-14T11:17:12.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.255+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=EZWUP1G8HGRU tag=48F5CRGTXFFT type=write size=2113617 2024-09-14T11:17:12.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.256+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=WAMZCMTZ131R type=del size=1401872 2024-09-14T11:17:12.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.257+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=DR97LP1CY4WR type=del 2024-09-14T11:17:12.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.259+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=5S0NZY2BTX2L type=write size=268209 2024-09-14T11:17:12.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.260+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=QTM7D9KBR3YO type=del 2024-09-14T11:17:12.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.262+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=3IH1S2R10FSN type=del size=1112568 2024-09-14T11:17:12.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.263+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~4BWLJ3QEKW0Q.0 size=1048576 2024-09-14T11:17:12.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.264+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~4BWLJ3QEKW0Q.1 size=1408 2024-09-14T11:17:12.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.266+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=4BWLJ3QEKW0Q tag=XDLWCFFT91K2 type=write size=2098560 2024-09-14T11:17:12.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.268+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~AXDD9K1JDG6G.0 size=154201 2024-09-14T11:17:12.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.268+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=AXDD9K1JDG6G tag=R3KR4JPRYODN type=write size=1202777 2024-09-14T11:17:12.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.271+0000 7f185d9f8780 1 < suggested remove operation key=M4FJDW1QHGBM tag=2NF1J38EXG7T type=del 2024-09-14T11:17:12.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.272+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=KN4SRWPG4AGO type=del size=1846276 2024-09-14T11:17:12.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.273+0000 7f185d9f8780 1 < completed write operation key=L4L83NVMXHXZ tag=X4BJ0R8O3HHX type=write size=273245 2024-09-14T11:17:12.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.274+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=Z74ZZ3JBON8M type=del size=553168 2024-09-14T11:17:12.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.277+0000 7f185d9f8780 1 < suggested remove operation key=XPMGVU0U52GS tag=WCVEQUQK1ZK8 type=del 2024-09-14T11:17:12.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.278+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=NJG5GD0WMV3L type=del size=2039362 2024-09-14T11:17:12.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.279+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~YGVYTEJHWW5K.0 size=1048576 2024-09-14T11:17:12.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.280+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~YGVYTEJHWW5K.1 size=1048576 2024-09-14T11:17:12.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.281+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~YGVYTEJHWW5K.2 size=348871 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.283+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=YGVYTEJHWW5K tag=K69CHHHBZ5UI type=write size=3494599 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.284+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=PK54HHDUKHWB type=del size=2723010 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.285+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~6UHGS3MS7IQG.0 size=1048576 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.285+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~6UHGS3MS7IQG.1 size=1048576 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.286+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~6UHGS3MS7IQG.2 size=807951 2024-09-14T11:17:12.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.288+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=6UHGS3MS7IQG tag=50U1SIAW0V6X type=write size=3953679 2024-09-14T11:17:12.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.289+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=7LXQ9IN3BKZ4 type=del size=3309427 2024-09-14T11:17:12.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.290+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~5W843LS4Q4E3.0 size=1042131 2024-09-14T11:17:12.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.292+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=5W843LS4Q4E3 tag=15OHQAMZWDCK type=write size=2090707 2024-09-14T11:17:12.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.293+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=4KMPF9ZLMXN7 type=del size=1852346 2024-09-14T11:17:12.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.294+0000 7f185d9f8780 1 < canceled operation key=830X857XIX9O tag=81N0Z5UGC2L3 type=del size=3095037 2024-09-14T11:17:12.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.297+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~JB0X1GJ5ZTPV.0 size=1048576 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.298+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~JB0X1GJ5ZTPV.1 size=10480 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.298+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=JB0X1GJ5ZTPV tag=H8ZA7GA71U5A type=write size=2107632 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.299+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=77XGXOKMSE0F type=del 2024-09-14T11:17:12.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.300+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=C0Y8AGRX8XO2 type=del size=1669018 2024-09-14T11:17:12.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.301+0000 7f185d9f8780 1 < completed write operation key=LGLAG80GX8GF tag=AZ39QXV1VUV4 type=write size=799091 2024-09-14T11:17:12.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.304+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=OJ978RBS1TT8 type=write size=213301 2024-09-14T11:17:12.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.304+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~CZKNK74TQ91R.0 size=717836 2024-09-14T11:17:12.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.306+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=CZKNK74TQ91R tag=451I20O8W3SL type=write size=1766412 2024-09-14T11:17:12.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.307+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=YVA5QU2Z08VH type=del size=2647038 2024-09-14T11:17:12.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.308+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~78RPD8F0B5JJ.0 size=140627 2024-09-14T11:17:12.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.310+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=78RPD8F0B5JJ tag=AN9FHQ2APQZQ type=write size=1189203 2024-09-14T11:17:12.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.311+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=9QAW8XRPGPZY type=del size=2348193 2024-09-14T11:17:12.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.311+0000 7f185d9f8780 1 < canceled part key=_multipart_MPZOX5RU0580.2~VOX4Q1FHHR72.0 size=1048576 2024-09-14T11:17:12.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.312+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~VOX4Q1FHHR72.1 size=1048576 2024-09-14T11:17:12.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.313+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~VOX4Q1FHHR72.2 size=801396 2024-09-14T11:17:12.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.315+0000 7f185d9f8780 1 < canceled multipart upload key=MPZOX5RU0580 upload=VOX4Q1FHHR72 tag=P2VV09DW1KXA type=write size=3947124 2024-09-14T11:17:12.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.317+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~L82FVXKDAC3P.0 size=1048576 2024-09-14T11:17:12.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.318+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~L82FVXKDAC3P.1 size=1048576 2024-09-14T11:17:12.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.319+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~L82FVXKDAC3P.2 size=18690 2024-09-14T11:17:12.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.319+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=L82FVXKDAC3P tag=6X1SDJRFJNGA type=write size=3164418 2024-09-14T11:17:12.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.320+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=WAMZCMTZ131R type=del 2024-09-14T11:17:12.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.321+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=IQK02OFYERTD type=del size=4002025 2024-09-14T11:17:12.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.324+0000 7f185d9f8780 1 < suggested update operation key=HLUMY48G90KB tag=5S0NZY2BTX2L type=write size=268209 2024-09-14T11:17:12.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.326+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~HHZORKM2Q3L9.0 size=1048576 2024-09-14T11:17:12.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.327+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~HHZORKM2Q3L9.1 size=1048576 2024-09-14T11:17:12.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.328+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~HHZORKM2Q3L9.2 size=847361 2024-09-14T11:17:12.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.328+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=HHZORKM2Q3L9 tag=VN1B95ZQT56P type=write size=3993089 2024-09-14T11:17:12.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.329+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=3IH1S2R10FSN type=del 2024-09-14T11:17:12.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.331+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~1ERFNVFSWLM3.0 size=1048576 2024-09-14T11:17:12.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.332+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~1ERFNVFSWLM3.1 size=445929 2024-09-14T11:17:12.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.332+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=1ERFNVFSWLM3 tag=JUXLE3PHY6XT type=write size=2543081 2024-09-14T11:17:12.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.333+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~AXDD9K1JDG6G.0 size=154201 2024-09-14T11:17:12.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.335+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=AXDD9K1JDG6G tag=R3KR4JPRYODN type=write size=1202777 2024-09-14T11:17:12.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.337+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=KKMD8FT5KFL3 type=write size=44939 2024-09-14T11:17:12.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.338+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=KN4SRWPG4AGO type=del 2024-09-14T11:17:12.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.339+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=QURKS9PQH8DC type=del size=965717 2024-09-14T11:17:12.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.342+0000 7f185d9f8780 1 < suggested update operation key=P30WF4R3UFPX tag=Z74ZZ3JBON8M type=del size=553168 2024-09-14T11:17:12.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.343+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=EIS2QTJ8I5H2 type=del size=3636416 2024-09-14T11:17:12.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.344+0000 7f185d9f8780 1 < canceled operation key=XPMGVU0U52GS tag=NJG5GD0WMV3L type=del size=2039362 2024-09-14T11:17:12.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.345+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=NGR9XD4AO6X4 type=del size=1879304 2024-09-14T11:17:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.346+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=PK54HHDUKHWB type=del 2024-09-14T11:17:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.348+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=FGQH03O1VDZ5 type=del size=2571865 2024-09-14T11:17:12.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.349+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=7LXQ9IN3BKZ4 type=del 2024-09-14T11:17:12.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.351+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~81J73S9UTM1X.0 size=418829 2024-09-14T11:17:12.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.351+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=81J73S9UTM1X tag=G5YIXCJMMFKU type=write size=1467405 2024-09-14T11:17:12.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.352+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=4KMPF9ZLMXN7 type=del 2024-09-14T11:17:12.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.354+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=JGIQMD3CS1AA type=del size=1622527 2024-09-14T11:17:12.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.355+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~JB0X1GJ5ZTPV.0 size=1048576 2024-09-14T11:17:12.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.356+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~JB0X1GJ5ZTPV.1 size=10480 2024-09-14T11:17:12.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.358+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=JB0X1GJ5ZTPV tag=H8ZA7GA71U5A type=write size=2107632 2024-09-14T11:17:12.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.360+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~EWD4FCJJGLGT.0 size=527136 2024-09-14T11:17:12.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.360+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=EWD4FCJJGLGT tag=XI9ONFLO8YB7 type=write size=1575712 2024-09-14T11:17:12.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.361+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=C0Y8AGRX8XO2 type=del 2024-09-14T11:17:12.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.362+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=29N3CBUBNPDO type=del size=210265 2024-09-14T11:17:12.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.363+0000 7f185d9f8780 1 < completed write operation key=087PN6V1BP65 tag=OJ978RBS1TT8 type=write size=213301 2024-09-14T11:17:12.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.365+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=0HH4RSEEN951 type=del size=1442378 2024-09-14T11:17:12.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.366+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=YVA5QU2Z08VH type=del 2024-09-14T11:17:12.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.367+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=0OF75FGL4BT6 type=del size=3062237 2024-09-14T11:17:12.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.368+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=9QAW8XRPGPZY type=del 2024-09-14T11:17:12.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.369+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=2P2FU1SDBJRV type=del size=1608750 2024-09-14T11:17:12.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.371+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~L82FVXKDAC3P.0 size=1048576 2024-09-14T11:17:12.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.372+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~L82FVXKDAC3P.1 size=1048576 2024-09-14T11:17:12.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.373+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~L82FVXKDAC3P.2 size=18690 2024-09-14T11:17:12.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.375+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=L82FVXKDAC3P tag=6X1SDJRFJNGA type=write size=3164418 2024-09-14T11:17:12.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.377+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=RFCTEQ56LSL6 type=del size=2960374 2024-09-14T11:17:12.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.378+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=IQK02OFYERTD type=del 2024-09-14T11:17:12.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.379+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=AN73IX2SG4QG type=del size=1998006 2024-09-14T11:17:12.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.381+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~HHZORKM2Q3L9.0 size=1048576 2024-09-14T11:17:12.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.382+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~HHZORKM2Q3L9.1 size=1048576 2024-09-14T11:17:12.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.382+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~HHZORKM2Q3L9.2 size=847361 2024-09-14T11:17:12.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.384+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=HHZORKM2Q3L9 tag=VN1B95ZQT56P type=write size=3993089 2024-09-14T11:17:12.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.386+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=VVMWL4OK9GSV type=del size=528274 2024-09-14T11:17:12.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.387+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~1ERFNVFSWLM3.0 size=1048576 2024-09-14T11:17:12.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.388+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~1ERFNVFSWLM3.1 size=445929 2024-09-14T11:17:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.390+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=1ERFNVFSWLM3 tag=JUXLE3PHY6XT type=write size=2543081 2024-09-14T11:17:12.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.392+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=S8IIER3H952M type=write size=621540 2024-09-14T11:17:12.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.393+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=KKMD8FT5KFL3 type=write size=44939 2024-09-14T11:17:12.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.396+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~EXJZFC7WSS21.0 size=1048576 2024-09-14T11:17:12.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.397+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~EXJZFC7WSS21.1 size=486313 2024-09-14T11:17:12.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.397+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=EXJZFC7WSS21 tag=6K9V0Y8963DA type=write size=2583465 2024-09-14T11:17:12.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.398+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=QURKS9PQH8DC type=del 2024-09-14T11:17:12.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.399+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=74OCTQHVP7YK type=del size=529223 2024-09-14T11:17:12.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.400+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=EIS2QTJ8I5H2 type=del 2024-09-14T11:17:12.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.402+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=KL4ZB82TV7B8 type=del size=2199359 2024-09-14T11:17:12.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.403+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=NGR9XD4AO6X4 type=del 2024-09-14T11:17:12.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.405+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~OO5IGIX3RYCU.0 size=1048576 2024-09-14T11:17:12.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.406+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~OO5IGIX3RYCU.1 size=994529 2024-09-14T11:17:12.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.406+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=OO5IGIX3RYCU tag=G0P2JF3GMT45 type=write size=3091681 2024-09-14T11:17:12.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.407+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=FGQH03O1VDZ5 type=del 2024-09-14T11:17:12.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.409+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~71WZT2ZDHY2U.0 size=523883 2024-09-14T11:17:12.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.409+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=71WZT2ZDHY2U tag=Y4WNOCH2AHGL type=write size=1572459 2024-09-14T11:17:12.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.410+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~81J73S9UTM1X.0 size=418829 2024-09-14T11:17:12.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.412+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=81J73S9UTM1X tag=G5YIXCJMMFKU type=write size=1467405 2024-09-14T11:17:12.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.413+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=SOOBO72OO4FE type=del size=1307905 2024-09-14T11:17:12.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.415+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=JGIQMD3CS1AA type=del 2024-09-14T11:17:12.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.418+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~RWS7K6PMOWRI.0 size=94317 2024-09-14T11:17:12.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.418+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=RWS7K6PMOWRI tag=HSN1LDKLE5T5 type=write size=1142893 2024-09-14T11:17:12.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.419+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~EWD4FCJJGLGT.0 size=527136 2024-09-14T11:17:12.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.421+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=EWD4FCJJGLGT tag=XI9ONFLO8YB7 type=write size=1575712 2024-09-14T11:17:12.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.423+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~269HH22S5AKC.0 size=503207 2024-09-14T11:17:12.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.423+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=269HH22S5AKC tag=W88OAMYGI2NB type=write size=1551783 2024-09-14T11:17:12.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.424+0000 7f185d9f8780 1 < canceled operation key=P30WF4R3UFPX tag=29N3CBUBNPDO type=del size=210265 2024-09-14T11:17:12.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.426+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~K9SPSE1G5Z8D.0 size=1048576 2024-09-14T11:17:12.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.427+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~K9SPSE1G5Z8D.1 size=1048576 2024-09-14T11:17:12.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.428+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~K9SPSE1G5Z8D.2 size=596191 2024-09-14T11:17:12.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.428+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=K9SPSE1G5Z8D tag=UWZN2LSMV65Q type=write size=3741919 2024-09-14T11:17:12.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.429+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=0HH4RSEEN951 type=del 2024-09-14T11:17:12.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.430+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=22ZM52QVHUF5 type=write size=595732 2024-09-14T11:17:12.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.432+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=0OF75FGL4BT6 type=del 2024-09-14T11:17:12.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.433+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=YM4BCI8VHRF9 type=del size=1983539 2024-09-14T11:17:12.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.434+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=2P2FU1SDBJRV type=del 2024-09-14T11:17:12.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.436+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~MDPA6E5TF685.0 size=1048576 2024-09-14T11:17:12.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.437+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~MDPA6E5TF685.1 size=1048576 2024-09-14T11:17:12.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.438+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~MDPA6E5TF685.2 size=134631 2024-09-14T11:17:12.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.438+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=MDPA6E5TF685 tag=8Y6R551NP4N4 type=write size=3280359 2024-09-14T11:17:12.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.439+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=RFCTEQ56LSL6 type=del size=2960374 2024-09-14T11:17:12.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.440+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=V0EIQYVNPUFE type=del size=1002678 2024-09-14T11:17:12.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.441+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=AN73IX2SG4QG type=del 2024-09-14T11:17:12.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.444+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~QOUFCEVZKA0U.0 size=1048576 2024-09-14T11:17:12.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.445+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~QOUFCEVZKA0U.1 size=386002 2024-09-14T11:17:12.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.445+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=QOUFCEVZKA0U tag=9XSP5TYCJ9J1 type=write size=2483154 2024-09-14T11:17:12.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.446+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=VVMWL4OK9GSV type=del 2024-09-14T11:17:12.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.447+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=UZ2ML8C0OWM8 type=del size=345003 2024-09-14T11:17:12.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.448+0000 7f185d9f8780 1 < completed write operation key=O2Y34FSQHS1S tag=S8IIER3H952M type=write size=621540 2024-09-14T11:17:12.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.449+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=10HBFW01B3JU type=del size=2673511 2024-09-14T11:17:12.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.450+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~EXJZFC7WSS21.0 size=1048576 2024-09-14T11:17:12.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.451+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~EXJZFC7WSS21.1 size=486313 2024-09-14T11:17:12.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.453+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=EXJZFC7WSS21 tag=6K9V0Y8963DA type=write size=2583465 2024-09-14T11:17:12.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.455+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~M42GMZ7I3ZDQ.0 size=184005 2024-09-14T11:17:12.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.455+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=M42GMZ7I3ZDQ tag=LL9GFMYD94C4 type=write size=1232581 2024-09-14T11:17:12.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.457+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=74OCTQHVP7YK type=del 2024-09-14T11:17:12.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.458+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=BAB1PA8IQ5FE type=del size=1613319 2024-09-14T11:17:12.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.460+0000 7f185d9f8780 1 < suggested update operation key=55K4D3SEM068 tag=KL4ZB82TV7B8 type=del size=2199359 2024-09-14T11:17:12.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.462+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~YHD6201LP67P.0 size=132877 2024-09-14T11:17:12.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.462+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=YHD6201LP67P tag=U5H7TC4I1JUI type=write size=1181453 2024-09-14T11:17:12.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.463+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~OO5IGIX3RYCU.0 size=1048576 2024-09-14T11:17:12.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.464+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~OO5IGIX3RYCU.1 size=994529 2024-09-14T11:17:12.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.466+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=OO5IGIX3RYCU tag=G0P2JF3GMT45 type=write size=3091681 2024-09-14T11:17:12.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.467+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=KAO386ZM1IIH type=del size=2828219 2024-09-14T11:17:12.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.469+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~71WZT2ZDHY2U.0 size=523883 2024-09-14T11:17:12.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.471+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=71WZT2ZDHY2U tag=Y4WNOCH2AHGL type=write size=1572459 2024-09-14T11:17:12.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.472+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=2FBZ32BJQSUQ type=del size=332174 2024-09-14T11:17:12.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.473+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=SOOBO72OO4FE type=del 2024-09-14T11:17:12.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.474+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=DXWDF8TK1AP6 type=del size=1376452 2024-09-14T11:17:12.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.475+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~RWS7K6PMOWRI.0 size=94317 2024-09-14T11:17:12.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.477+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=RWS7K6PMOWRI tag=HSN1LDKLE5T5 type=write size=1142893 2024-09-14T11:17:12.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.478+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=A1C6I902RS2X type=del size=1804984 2024-09-14T11:17:12.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.480+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~269HH22S5AKC.0 size=503207 2024-09-14T11:17:12.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.482+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=269HH22S5AKC tag=W88OAMYGI2NB type=write size=1551783 2024-09-14T11:17:12.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.483+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=J3M7OAK3BZMT type=del size=1586536 2024-09-14T11:17:12.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.484+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~K9SPSE1G5Z8D.0 size=1048576 2024-09-14T11:17:12.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.485+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~K9SPSE1G5Z8D.1 size=1048576 2024-09-14T11:17:12.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.486+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~K9SPSE1G5Z8D.2 size=596191 2024-09-14T11:17:12.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.489+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=K9SPSE1G5Z8D tag=UWZN2LSMV65Q type=write size=3741919 2024-09-14T11:17:12.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.491+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~5OUQP9AA4XV1.0 size=1048576 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.492+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~5OUQP9AA4XV1.1 size=557505 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.492+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=5OUQP9AA4XV1 tag=EUF6B35ROI30 type=write size=2654657 2024-09-14T11:17:12.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.493+0000 7f185d9f8780 1 < completed write operation key=830X857XIX9O tag=22ZM52QVHUF5 type=write size=595732 2024-09-14T11:17:12.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.494+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=L48C21XRWR5H type=del size=1002551 2024-09-14T11:17:12.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.496+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=YM4BCI8VHRF9 type=del 2024-09-14T11:17:12.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.498+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~ZBNN17GELWKY.0 size=891104 2024-09-14T11:17:12.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.498+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=ZBNN17GELWKY tag=ZJO8TNYUPGQU type=write size=1939680 2024-09-14T11:17:12.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.499+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~MDPA6E5TF685.0 size=1048576 2024-09-14T11:17:12.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.500+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~MDPA6E5TF685.1 size=1048576 2024-09-14T11:17:12.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.501+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~MDPA6E5TF685.2 size=134631 2024-09-14T11:17:12.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.503+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=MDPA6E5TF685 tag=8Y6R551NP4N4 type=write size=3280359 2024-09-14T11:17:12.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.504+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=GMN82U9M82GS type=del size=957374 2024-09-14T11:17:12.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.505+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=V0EIQYVNPUFE type=del 2024-09-14T11:17:12.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.507+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=QS0MHC3MLXRR type=write size=969889 2024-09-14T11:17:12.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.508+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~QOUFCEVZKA0U.0 size=1048576 2024-09-14T11:17:12.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.509+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~QOUFCEVZKA0U.1 size=386002 2024-09-14T11:17:12.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.511+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=QOUFCEVZKA0U tag=9XSP5TYCJ9J1 type=write size=2483154 2024-09-14T11:17:12.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.512+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=03XKV8SGSBL9 type=write size=313584 2024-09-14T11:17:12.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.514+0000 7f185d9f8780 1 < suggested update operation key=DAKWA1OCVTBG tag=UZ2ML8C0OWM8 type=del size=345003 2024-09-14T11:17:12.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.516+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~C63IMXNTX6OA.0 size=1048576 2024-09-14T11:17:12.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.517+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~C63IMXNTX6OA.1 size=905328 2024-09-14T11:17:12.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.517+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=C63IMXNTX6OA tag=BTFBWM3YW2EV type=write size=3002480 2024-09-14T11:17:12.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.518+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=10HBFW01B3JU type=del 2024-09-14T11:17:12.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.519+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=WNLVUWTEMLQ7 type=del size=3135826 2024-09-14T11:17:12.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.520+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~M42GMZ7I3ZDQ.0 size=184005 2024-09-14T11:17:12.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.521+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=M42GMZ7I3ZDQ tag=LL9GFMYD94C4 type=write size=1232581 2024-09-14T11:17:12.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.524+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~O51RCCZBMV84.0 size=554123 2024-09-14T11:17:12.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.524+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=O51RCCZBMV84 tag=VBIG135GCY06 type=write size=1602699 2024-09-14T11:17:12.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.525+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=BAB1PA8IQ5FE type=del 2024-09-14T11:17:12.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.528+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~4JHRG57BVN99.0 size=852745 2024-09-14T11:17:12.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.528+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=4JHRG57BVN99 tag=VUFT9KJU72RE type=write size=1901321 2024-09-14T11:17:12.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.529+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~YHD6201LP67P.0 size=132877 2024-09-14T11:17:12.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.532+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=YHD6201LP67P tag=U5H7TC4I1JUI type=write size=1181453 2024-09-14T11:17:12.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.534+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~14YTNVSQNOKF.0 size=1048576 2024-09-14T11:17:12.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.535+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~14YTNVSQNOKF.1 size=929119 2024-09-14T11:17:12.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.535+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=14YTNVSQNOKF tag=54UMH3G34HSC type=write size=3026271 2024-09-14T11:17:12.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.536+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=KAO386ZM1IIH type=del 2024-09-14T11:17:12.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.537+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=60HNI35SNY3O type=del size=2282090 2024-09-14T11:17:12.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.538+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=2FBZ32BJQSUQ type=del 2024-09-14T11:17:12.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.541+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~B3WLTXCGK2FO.0 size=798949 2024-09-14T11:17:12.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.541+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=B3WLTXCGK2FO tag=WB803JEXB97X type=write size=1847525 2024-09-14T11:17:12.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.542+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=DXWDF8TK1AP6 type=del 2024-09-14T11:17:12.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.543+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=VA5EXWY9NWEI type=del size=3758677 2024-09-14T11:17:12.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.544+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=A1C6I902RS2X type=del 2024-09-14T11:17:12.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.546+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=7GIUWZ8PF0I1 type=write size=686676 2024-09-14T11:17:12.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.548+0000 7f185d9f8780 1 < suggested remove operation key=7XGG5LBGRI4H tag=J3M7OAK3BZMT type=del 2024-09-14T11:17:12.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.550+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~BPPA0NQRFL4F.0 size=777628 2024-09-14T11:17:12.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.550+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=BPPA0NQRFL4F tag=5AZ1Y6NENUXI type=write size=1826204 2024-09-14T11:17:12.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.552+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~5OUQP9AA4XV1.0 size=1048576 2024-09-14T11:17:12.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.553+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~5OUQP9AA4XV1.1 size=557505 2024-09-14T11:17:12.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.554+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=5OUQP9AA4XV1 tag=EUF6B35ROI30 type=write size=2654657 2024-09-14T11:17:12.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.555+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=OQ1CHIN7OPWW type=del size=3683783 2024-09-14T11:17:12.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.556+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=L48C21XRWR5H type=del 2024-09-14T11:17:12.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.558+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=TU7LAXKEB50U type=del size=3676017 2024-09-14T11:17:12.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.560+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~ZBNN17GELWKY.0 size=891104 2024-09-14T11:17:12.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.561+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=ZBNN17GELWKY tag=ZJO8TNYUPGQU type=write size=1939680 2024-09-14T11:17:12.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.563+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=YCSNGIO6JSBH type=write size=879446 2024-09-14T11:17:12.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.565+0000 7f185d9f8780 1 < suggested update operation key=CVVKY636WXG9 tag=GMN82U9M82GS type=del size=957374 2024-09-14T11:17:12.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.567+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=QM60T75E9QAX type=del size=2608562 2024-09-14T11:17:12.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.568+0000 7f185d9f8780 1 < completed write operation key=U5S6L8GPSMU5 tag=QS0MHC3MLXRR type=write size=969889 2024-09-14T11:17:12.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.569+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=0O9RDB43XEVS type=del size=2899850 2024-09-14T11:17:12.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.571+0000 7f185d9f8780 1 < suggested remove operation key=087PN6V1BP65 tag=03XKV8SGSBL9 type=write 2024-09-14T11:17:12.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.573+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=AR6RN1EK167F type=del size=1363953 2024-09-14T11:17:12.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.574+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~C63IMXNTX6OA.0 size=1048576 2024-09-14T11:17:12.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.575+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~C63IMXNTX6OA.1 size=905328 2024-09-14T11:17:12.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.577+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=C63IMXNTX6OA tag=BTFBWM3YW2EV type=write size=3002480 2024-09-14T11:17:12.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.578+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=9T9YB2KOG7Z7 type=del size=2011264 2024-09-14T11:17:12.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.580+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=WNLVUWTEMLQ7 type=del 2024-09-14T11:17:12.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.581+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=5FBGV417QM5U type=del size=2016838 2024-09-14T11:17:12.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.582+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~O51RCCZBMV84.0 size=554123 2024-09-14T11:17:12.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.584+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=O51RCCZBMV84 tag=VBIG135GCY06 type=write size=1602699 2024-09-14T11:17:12.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.586+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~1L9LZIITTNPL.0 size=1048576 2024-09-14T11:17:12.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.587+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~1L9LZIITTNPL.1 size=1048576 2024-09-14T11:17:12.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.588+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~1L9LZIITTNPL.2 size=789158 2024-09-14T11:17:12.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.588+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=1L9LZIITTNPL tag=C9M8B9MPDJJP type=write size=3934886 2024-09-14T11:17:12.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.589+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~4JHRG57BVN99.0 size=852745 2024-09-14T11:17:12.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.591+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=4JHRG57BVN99 tag=VUFT9KJU72RE type=write size=1901321 2024-09-14T11:17:12.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.592+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=E7JWBLTGAA99 type=del size=1726997 2024-09-14T11:17:12.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.594+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~14YTNVSQNOKF.0 size=1048576 2024-09-14T11:17:12.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.595+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~14YTNVSQNOKF.1 size=929119 2024-09-14T11:17:12.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.597+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=14YTNVSQNOKF tag=54UMH3G34HSC type=write size=3026271 2024-09-14T11:17:12.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.599+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~18AGBJNSSF35.0 size=1048576 2024-09-14T11:17:12.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.600+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~18AGBJNSSF35.1 size=169235 2024-09-14T11:17:12.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.600+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=18AGBJNSSF35 tag=OCIGI3OP1JK8 type=write size=2266387 2024-09-14T11:17:12.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.601+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=60HNI35SNY3O type=del 2024-09-14T11:17:12.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.603+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~WX6A9T2TL3OL.0 size=1048576 2024-09-14T11:17:12.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.604+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~WX6A9T2TL3OL.1 size=332414 2024-09-14T11:17:12.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.604+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=WX6A9T2TL3OL tag=08GVC0I3XDYO type=write size=2429566 2024-09-14T11:17:12.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.605+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~B3WLTXCGK2FO.0 size=798949 2024-09-14T11:17:12.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.607+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=B3WLTXCGK2FO tag=WB803JEXB97X type=write size=1847525 2024-09-14T11:17:12.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.608+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=D7M5B2OUY4FW type=del size=3979514 2024-09-14T11:17:12.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.610+0000 7f185d9f8780 1 < suggested update operation key=6MZGLP5KPPB3 tag=VA5EXWY9NWEI type=del size=3758677 2024-09-14T11:17:12.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.612+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=5CQQGIAAIM12 type=write size=100867 2024-09-14T11:17:12.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.613+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=7GIUWZ8PF0I1 type=write size=686676 2024-09-14T11:17:12.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.614+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=7GEPO124DB1J type=write size=370378 2024-09-14T11:17:12.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.615+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~BPPA0NQRFL4F.0 size=777628 2024-09-14T11:17:12.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.617+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=BPPA0NQRFL4F tag=5AZ1Y6NENUXI type=write size=1826204 2024-09-14T11:17:12.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.619+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~N035XGM6QAVE.0 size=1048576 2024-09-14T11:17:12.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.620+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~N035XGM6QAVE.1 size=1048576 2024-09-14T11:17:12.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.621+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~N035XGM6QAVE.2 size=902885 2024-09-14T11:17:12.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.621+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=N035XGM6QAVE tag=83LFDO6G7002 type=write size=4048613 2024-09-14T11:17:12.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.623+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=OQ1CHIN7OPWW type=del 2024-09-14T11:17:12.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.624+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=2DRJ4ZEM6MNC type=del size=1580820 2024-09-14T11:17:12.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.626+0000 7f185d9f8780 1 < suggested update operation key=J6RN3WULDLQE tag=TU7LAXKEB50U type=del size=3676017 2024-09-14T11:17:12.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.627+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=M3YWQ83GA797 type=del size=2270523 2024-09-14T11:17:12.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.629+0000 7f185d9f8780 1 < completed write operation key=6B0SURI3Q8R6 tag=YCSNGIO6JSBH type=write size=879446 2024-09-14T11:17:12.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.631+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~CPYYV7VYO9T0.0 size=1048576 2024-09-14T11:17:12.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.632+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~CPYYV7VYO9T0.1 size=79308 2024-09-14T11:17:12.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.632+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=CPYYV7VYO9T0 tag=OZBQSD4NV49V type=write size=2176460 2024-09-14T11:17:12.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.634+0000 7f185d9f8780 1 < suggested remove operation key=MPZOX5RU0580 tag=QM60T75E9QAX type=del 2024-09-14T11:17:12.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.636+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=ASJ69B4JMYW2 type=del size=566247 2024-09-14T11:17:12.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.637+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=0O9RDB43XEVS type=del 2024-09-14T11:17:12.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.638+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=93DPUTV0V5IF type=del size=2254536 2024-09-14T11:17:12.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.640+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=AR6RN1EK167F type=del 2024-09-14T11:17:12.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.643+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~V8A8QBH9YEGM.0 size=1048576 2024-09-14T11:17:12.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.644+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~V8A8QBH9YEGM.1 size=1048576 2024-09-14T11:17:12.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.645+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~V8A8QBH9YEGM.2 size=25811 2024-09-14T11:17:12.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.645+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=V8A8QBH9YEGM tag=SEDKG2FOW9NF type=write size=3171539 2024-09-14T11:17:12.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.647+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=9T9YB2KOG7Z7 type=del 2024-09-14T11:17:12.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.649+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~2NQ63BAAD47K.0 size=1048576 2024-09-14T11:17:12.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.650+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~2NQ63BAAD47K.1 size=1048576 2024-09-14T11:17:12.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.651+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~2NQ63BAAD47K.2 size=927218 2024-09-14T11:17:12.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.651+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=2NQ63BAAD47K tag=SACO02M4T8KW type=write size=4072946 2024-09-14T11:17:12.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.653+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=5FBGV417QM5U type=del 2024-09-14T11:17:12.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.654+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=R0SO45NECOGB type=del size=3995033 2024-09-14T11:17:12.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.655+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~1L9LZIITTNPL.0 size=1048576 2024-09-14T11:17:12.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.656+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~1L9LZIITTNPL.1 size=1048576 2024-09-14T11:17:12.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.657+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~1L9LZIITTNPL.2 size=789158 2024-09-14T11:17:12.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.659+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=1L9LZIITTNPL tag=C9M8B9MPDJJP type=write size=3934886 2024-09-14T11:17:12.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.661+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~60JD1MMAGPO1.0 size=1048576 2024-09-14T11:17:12.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.662+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~60JD1MMAGPO1.1 size=541172 2024-09-14T11:17:12.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.662+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=60JD1MMAGPO1 tag=5SRVE1PWJZ8K type=write size=2638324 2024-09-14T11:17:12.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.663+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=E7JWBLTGAA99 type=del 2024-09-14T11:17:12.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.664+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=YCPR0SGEQGRS type=write size=269199 2024-09-14T11:17:12.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.666+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~18AGBJNSSF35.0 size=1048576 2024-09-14T11:17:12.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.666+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~18AGBJNSSF35.1 size=169235 2024-09-14T11:17:12.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.668+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=18AGBJNSSF35 tag=OCIGI3OP1JK8 type=write size=2266387 2024-09-14T11:17:12.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.669+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=212L9YN4AZ3T type=del size=2423264 2024-09-14T11:17:12.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.670+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~WX6A9T2TL3OL.0 size=1048576 2024-09-14T11:17:12.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.671+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~WX6A9T2TL3OL.1 size=332414 2024-09-14T11:17:12.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.673+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=WX6A9T2TL3OL tag=08GVC0I3XDYO type=write size=2429566 2024-09-14T11:17:12.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.675+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=FL0ZLC26F4KA type=del size=436283 2024-09-14T11:17:12.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.676+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=D7M5B2OUY4FW type=del 2024-09-14T11:17:12.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.677+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=7B5X4AZ11WD4 type=del size=4164047 2024-09-14T11:17:12.678 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.679+0000 7f185d9f8780 1 < suggested update operation key=7XGG5LBGRI4H tag=5CQQGIAAIM12 type=write size=100867 2024-09-14T11:17:12.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.681+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=TS77ZYF7H2I2 type=del size=220766 2024-09-14T11:17:12.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.682+0000 7f185d9f8780 1 < completed write operation key=ZR3IEW48CSCF tag=7GEPO124DB1J type=write size=370378 2024-09-14T11:17:12.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.683+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=B4HV38REM8PV type=del size=3705589 2024-09-14T11:17:12.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.684+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~N035XGM6QAVE.0 size=1048576 2024-09-14T11:17:12.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.685+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~N035XGM6QAVE.1 size=1048576 2024-09-14T11:17:12.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.686+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~N035XGM6QAVE.2 size=902885 2024-09-14T11:17:12.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.688+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=N035XGM6QAVE tag=83LFDO6G7002 type=write size=4048613 2024-09-14T11:17:12.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.689+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=RUQ6IYMZ7MLX type=del size=2411638 2024-09-14T11:17:12.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.690+0000 7f185d9f8780 -1 < failed to complete operation key=MPZOX5RU0580 tag=2DRJ4ZEM6MNC type=del size=1580820: (22) Invalid argument 2024-09-14T11:17:12.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.692+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~IY10UVTB7S25.0 size=1048576 2024-09-14T11:17:12.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.693+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~IY10UVTB7S25.1 size=257821 2024-09-14T11:17:12.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.693+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=IY10UVTB7S25 tag=6ZHG9RHOBAT4 type=write size=2354973 2024-09-14T11:17:12.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.695+0000 7f185d9f8780 1 < suggested update operation key=CVVKY636WXG9 tag=M3YWQ83GA797 type=del size=2270523 2024-09-14T11:17:12.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.696+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=BAJSRGYQO5HT type=del size=1937832 2024-09-14T11:17:12.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.698+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~CPYYV7VYO9T0.0 size=1048576 2024-09-14T11:17:12.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.699+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~CPYYV7VYO9T0.1 size=79308 2024-09-14T11:17:12.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.701+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=CPYYV7VYO9T0 tag=OZBQSD4NV49V type=write size=2176460 2024-09-14T11:17:12.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.702+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=JHDV1C438P7Z type=del size=1471778 2024-09-14T11:17:12.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.704+0000 7f185d9f8780 1 < canceled operation key=MPZOX5RU0580 tag=ASJ69B4JMYW2 type=del size=566247 2024-09-14T11:17:12.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.705+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=X54K9229XJ8Z type=del size=3538914 2024-09-14T11:17:12.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.707+0000 7f185d9f8780 1 < canceled operation key=087PN6V1BP65 tag=93DPUTV0V5IF type=del size=2254536 2024-09-14T11:17:12.707 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.709+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~1Z0SP3RSPUON.0 size=936614 2024-09-14T11:17:12.707 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.709+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=1Z0SP3RSPUON tag=L3DRD3RFZQN7 type=write size=1985190 2024-09-14T11:17:12.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.710+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~V8A8QBH9YEGM.0 size=1048576 2024-09-14T11:17:12.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.711+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~V8A8QBH9YEGM.1 size=1048576 2024-09-14T11:17:12.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.713+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~V8A8QBH9YEGM.2 size=25811 2024-09-14T11:17:12.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.715+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=V8A8QBH9YEGM tag=SEDKG2FOW9NF type=write size=3171539 2024-09-14T11:17:12.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.716+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=SQ83X6DCEWQ8 type=del size=1001197 2024-09-14T11:17:12.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.717+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~2NQ63BAAD47K.0 size=1048576 2024-09-14T11:17:12.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.718+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~2NQ63BAAD47K.1 size=1048576 2024-09-14T11:17:12.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.719+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~2NQ63BAAD47K.2 size=927218 2024-09-14T11:17:12.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.721+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=2NQ63BAAD47K tag=SACO02M4T8KW type=write size=4072946 2024-09-14T11:17:12.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.722+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=C0EDOH3SLMA9 type=del size=3935234 2024-09-14T11:17:12.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.723+0000 7f185d9f8780 1 < canceled operation key=N040R6OERAJP tag=R0SO45NECOGB type=del size=3995033 2024-09-14T11:17:12.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.724+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=MGCJO79ZADRJ type=write size=89572 2024-09-14T11:17:12.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.725+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~60JD1MMAGPO1.0 size=1048576 2024-09-14T11:17:12.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.726+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~60JD1MMAGPO1.1 size=541172 2024-09-14T11:17:12.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.728+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=60JD1MMAGPO1 tag=5SRVE1PWJZ8K type=write size=2638324 2024-09-14T11:17:12.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.730+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~BQXJM75VKBA9.0 size=824359 2024-09-14T11:17:12.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.730+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=BQXJM75VKBA9 tag=L3OQWNFBGD8H type=write size=1872935 2024-09-14T11:17:12.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.731+0000 7f185d9f8780 1 < completed write operation key=O2Y34FSQHS1S tag=YCPR0SGEQGRS type=write size=269199 2024-09-14T11:17:12.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.734+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~GSCRHT7S6TDV.0 size=207924 2024-09-14T11:17:12.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.734+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=GSCRHT7S6TDV tag=IELA7HR7UDVF type=write size=1256500 2024-09-14T11:17:12.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.735+0000 7f185d9f8780 -1 < failed to complete operation key=7XGG5LBGRI4H tag=212L9YN4AZ3T type=del size=2423264: (22) Invalid argument 2024-09-14T11:17:12.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.736+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=4VAQ7EG9Y4EB type=del size=1888024 2024-09-14T11:17:12.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.737+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=FL0ZLC26F4KA type=del 2024-09-14T11:17:12.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.738+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=XZJF3AWY9W7I type=del size=1192562 2024-09-14T11:17:12.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.739+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=7B5X4AZ11WD4 type=del 2024-09-14T11:17:12.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.742+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~IA9HKLUUJJI2.0 size=22877 2024-09-14T11:17:12.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.742+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=IA9HKLUUJJI2 tag=FGXG5CW663WY type=write size=1071453 2024-09-14T11:17:12.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.743+0000 7f185d9f8780 1 < canceled operation key=1BOZ331NA7JA tag=TS77ZYF7H2I2 type=del size=220766 2024-09-14T11:17:12.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.744+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=BYT0JZ7IWX7H type=del size=3130700 2024-09-14T11:17:12.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.745+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=B4HV38REM8PV type=del 2024-09-14T11:17:12.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.747+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~TJHENG5LB4JM.0 size=373770 2024-09-14T11:17:12.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.747+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=TJHENG5LB4JM tag=XASYAVVBQX0U type=write size=1422346 2024-09-14T11:17:12.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.748+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=RUQ6IYMZ7MLX type=del 2024-09-14T11:17:12.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.750+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=S2LDJ4EXD86X type=del size=3098664 2024-09-14T11:17:12.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.751+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~IY10UVTB7S25.0 size=1048576 2024-09-14T11:17:12.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.752+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~IY10UVTB7S25.1 size=257821 2024-09-14T11:17:12.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.754+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=IY10UVTB7S25 tag=6ZHG9RHOBAT4 type=write size=2354973 2024-09-14T11:17:12.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.756+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~2BYGVS6RO5VE.0 size=1048576 2024-09-14T11:17:12.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.758+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~2BYGVS6RO5VE.1 size=1048576 2024-09-14T11:17:12.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.759+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~2BYGVS6RO5VE.2 size=436803 2024-09-14T11:17:12.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.759+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=2BYGVS6RO5VE tag=EDR0FMBNKQAC type=write size=3582531 2024-09-14T11:17:12.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.760+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=BAJSRGYQO5HT type=del 2024-09-14T11:17:12.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.763+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~JCO9N6QFDPGZ.0 size=1048576 2024-09-14T11:17:12.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.764+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~JCO9N6QFDPGZ.1 size=1048576 2024-09-14T11:17:12.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.765+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~JCO9N6QFDPGZ.2 size=345911 2024-09-14T11:17:12.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.765+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=JCO9N6QFDPGZ tag=XY2CW2VCPTNA type=write size=3491639 2024-09-14T11:17:12.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.766+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=JHDV1C438P7Z type=del size=1471778 2024-09-14T11:17:12.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.768+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~QUCSLX6JO4YN.0 size=1048576 2024-09-14T11:17:12.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.769+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~QUCSLX6JO4YN.1 size=902154 2024-09-14T11:17:12.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.769+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=QUCSLX6JO4YN tag=WQIP3KTQGE3E type=write size=2999306 2024-09-14T11:17:12.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.770+0000 7f185d9f8780 1 < canceled operation key=55K4D3SEM068 tag=X54K9229XJ8Z type=del size=3538914 2024-09-14T11:17:12.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.772+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~1XZ61RKCH1QD.0 size=750147 2024-09-14T11:17:12.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.772+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=1XZ61RKCH1QD tag=7CWDEYB7EOYN type=write size=1798723 2024-09-14T11:17:12.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.774+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~1Z0SP3RSPUON.0 size=936614 2024-09-14T11:17:12.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.775+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=1Z0SP3RSPUON tag=L3DRD3RFZQN7 type=write size=1985190 2024-09-14T11:17:12.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.778+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~R8TWEC3RRQP0.0 size=69966 2024-09-14T11:17:12.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.778+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=R8TWEC3RRQP0 tag=E28S4R10WH4R type=write size=1118542 2024-09-14T11:17:12.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.780+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=SQ83X6DCEWQ8 type=del 2024-09-14T11:17:12.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.782+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~TKMXJU22I5ID.0 size=1048576 2024-09-14T11:17:12.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.783+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~TKMXJU22I5ID.1 size=1048576 2024-09-14T11:17:12.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.784+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~TKMXJU22I5ID.2 size=566086 2024-09-14T11:17:12.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.784+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=TKMXJU22I5ID tag=C8F9HMK3G82I type=write size=3711814 2024-09-14T11:17:12.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.785+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=C0EDOH3SLMA9 type=del 2024-09-14T11:17:12.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.788+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~SSKMVHZ3J9UJ.0 size=1048576 2024-09-14T11:17:12.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.789+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~SSKMVHZ3J9UJ.1 size=1008245 2024-09-14T11:17:12.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.789+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=SSKMVHZ3J9UJ tag=6V1IAQ86M0J0 type=write size=3105397 2024-09-14T11:17:12.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.790+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=MGCJO79ZADRJ type=write size=89572 2024-09-14T11:17:12.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.791+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=U0EJKALOYRF0 type=del size=2451160 2024-09-14T11:17:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.793+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~BQXJM75VKBA9.0 size=824359 2024-09-14T11:17:12.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.795+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=BQXJM75VKBA9 tag=L3OQWNFBGD8H type=write size=1872935 2024-09-14T11:17:12.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.796+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=H33BQDFTPX3V type=del size=190512 2024-09-14T11:17:12.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.797+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~GSCRHT7S6TDV.0 size=207924 2024-09-14T11:17:12.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.799+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=GSCRHT7S6TDV tag=IELA7HR7UDVF type=write size=1256500 2024-09-14T11:17:12.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.801+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~K50ZQHHF364D.0 size=1044628 2024-09-14T11:17:12.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.801+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=K50ZQHHF364D tag=0Q3EFMPBRB0K type=write size=2093204 2024-09-14T11:17:12.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.804+0000 7f185d9f8780 1 < suggested remove operation key=6B0SURI3Q8R6 tag=4VAQ7EG9Y4EB type=del 2024-09-14T11:17:12.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.805+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=R7G80R69M8GM type=del size=274199 2024-09-14T11:17:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.806+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=XZJF3AWY9W7I type=del 2024-09-14T11:17:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.808+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~WW3YKQW2G9OI.0 size=1048576 2024-09-14T11:17:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.809+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~WW3YKQW2G9OI.1 size=917379 2024-09-14T11:17:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.810+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=WW3YKQW2G9OI tag=C50H19YZC7HI type=write size=3014531 2024-09-14T11:17:12.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.811+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~IA9HKLUUJJI2.0 size=22877 2024-09-14T11:17:12.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.813+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=IA9HKLUUJJI2 tag=FGXG5CW663WY type=write size=1071453 2024-09-14T11:17:12.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.814+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=VGD500YMYD5Z type=del size=958807 2024-09-14T11:17:12.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.815+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=BYT0JZ7IWX7H type=del 2024-09-14T11:17:12.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.816+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=HC2VVMS0UE93 type=del size=575026 2024-09-14T11:17:12.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.818+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~TJHENG5LB4JM.0 size=373770 2024-09-14T11:17:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.820+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=TJHENG5LB4JM tag=XASYAVVBQX0U type=write size=1422346 2024-09-14T11:17:12.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.822+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~LA4ADCMF0LRS.0 size=1048576 2024-09-14T11:17:12.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.823+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~LA4ADCMF0LRS.1 size=456495 2024-09-14T11:17:12.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.823+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=LA4ADCMF0LRS tag=EF3731ZMDJ4C type=write size=2553647 2024-09-14T11:17:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.824+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=S2LDJ4EXD86X type=del 2024-09-14T11:17:12.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.825+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=Z66YDFVE693E type=del size=2771344 2024-09-14T11:17:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.826+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~2BYGVS6RO5VE.0 size=1048576 2024-09-14T11:17:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.827+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~2BYGVS6RO5VE.1 size=1048576 2024-09-14T11:17:12.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.828+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~2BYGVS6RO5VE.2 size=436803 2024-09-14T11:17:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.830+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=2BYGVS6RO5VE tag=EDR0FMBNKQAC type=write size=3582531 2024-09-14T11:17:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.833+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~EXW5V2WBEGS2.0 size=556234 2024-09-14T11:17:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.833+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=EXW5V2WBEGS2 tag=FZ91594CIFVH type=write size=1604810 2024-09-14T11:17:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.833+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~JCO9N6QFDPGZ.0 size=1048576 2024-09-14T11:17:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.833+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~JCO9N6QFDPGZ.1 size=1048576 2024-09-14T11:17:12.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.834+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~JCO9N6QFDPGZ.2 size=345911 2024-09-14T11:17:12.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.836+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=JCO9N6QFDPGZ tag=XY2CW2VCPTNA type=write size=3491639 2024-09-14T11:17:12.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.837+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=MYMGHJBMOA63 type=del size=369839 2024-09-14T11:17:12.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.837+0000 7f185d9f8780 1 < canceled part key=_multipart_55K4D3SEM068.2~QUCSLX6JO4YN.0 size=1048576 2024-09-14T11:17:12.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.838+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~QUCSLX6JO4YN.1 size=902154 2024-09-14T11:17:12.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.840+0000 7f185d9f8780 1 < canceled multipart upload key=55K4D3SEM068 upload=QUCSLX6JO4YN tag=WQIP3KTQGE3E type=write size=2999306 2024-09-14T11:17:12.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.841+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=7WI8G57PG8WS type=del size=2290232 2024-09-14T11:17:12.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.843+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~1XZ61RKCH1QD.0 size=750147 2024-09-14T11:17:12.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.845+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=1XZ61RKCH1QD tag=7CWDEYB7EOYN type=write size=1798723 2024-09-14T11:17:12.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.846+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=DRVI87JJUQEI type=write size=244824 2024-09-14T11:17:12.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.847+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~R8TWEC3RRQP0.0 size=69966 2024-09-14T11:17:12.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.849+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=R8TWEC3RRQP0 tag=E28S4R10WH4R type=write size=1118542 2024-09-14T11:17:12.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.852+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~ZT1VK3G8K7Y2.0 size=1048576 2024-09-14T11:17:12.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.852+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~ZT1VK3G8K7Y2.1 size=501519 2024-09-14T11:17:12.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.852+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=ZT1VK3G8K7Y2 tag=V4AGNGA5SCNZ type=write size=2598671 2024-09-14T11:17:12.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.854+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~TKMXJU22I5ID.0 size=1048576 2024-09-14T11:17:12.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.855+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~TKMXJU22I5ID.1 size=1048576 2024-09-14T11:17:12.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.856+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~TKMXJU22I5ID.2 size=566086 2024-09-14T11:17:12.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.858+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=TKMXJU22I5ID tag=C8F9HMK3G82I type=write size=3711814 2024-09-14T11:17:12.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.860+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~GLVR5MIOL2I1.0 size=1048576 2024-09-14T11:17:12.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.861+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~GLVR5MIOL2I1.1 size=372482 2024-09-14T11:17:12.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.861+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=GLVR5MIOL2I1 tag=30JPQACG5NJ6 type=write size=2469634 2024-09-14T11:17:12.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.862+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~SSKMVHZ3J9UJ.0 size=1048576 2024-09-14T11:17:12.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.862+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~SSKMVHZ3J9UJ.1 size=1008245 2024-09-14T11:17:12.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.864+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=SSKMVHZ3J9UJ tag=6V1IAQ86M0J0 type=write size=3105397 2024-09-14T11:17:12.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.866+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~AAFLZKKI080H.0 size=1048576 2024-09-14T11:17:12.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.867+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~AAFLZKKI080H.1 size=1048576 2024-09-14T11:17:12.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.868+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~AAFLZKKI080H.2 size=962707 2024-09-14T11:17:12.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.868+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=AAFLZKKI080H tag=ZA1PVSYT7N0I type=write size=4108435 2024-09-14T11:17:12.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.871+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=U0EJKALOYRF0 type=del 2024-09-14T11:17:12.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.873+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~6AG7EGIAN5QY.0 size=383191 2024-09-14T11:17:12.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.873+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=6AG7EGIAN5QY tag=PZOUD9Q0XA38 type=write size=1431767 2024-09-14T11:17:12.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.874+0000 7f185d9f8780 1 < canceled operation key=JL2IH8NEX1YF tag=H33BQDFTPX3V type=del size=190512 2024-09-14T11:17:12.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.875+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=DMC6981177CS type=write size=565158 2024-09-14T11:17:12.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.876+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~K50ZQHHF364D.0 size=1044628 2024-09-14T11:17:12.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.879+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=K50ZQHHF364D tag=0Q3EFMPBRB0K type=write size=2093204 2024-09-14T11:17:12.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.881+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~D31XJK29XSXS.0 size=599030 2024-09-14T11:17:12.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.881+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=D31XJK29XSXS tag=2IKJ5TD8VPPQ type=write size=1647606 2024-09-14T11:17:12.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.883+0000 7f185d9f8780 1 < suggested remove operation key=L4L83NVMXHXZ tag=R7G80R69M8GM type=del 2024-09-14T11:17:12.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.884+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=JZX3P182SJGD type=del size=1618601 2024-09-14T11:17:12.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.885+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~WW3YKQW2G9OI.0 size=1048576 2024-09-14T11:17:12.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.886+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~WW3YKQW2G9OI.1 size=917379 2024-09-14T11:17:12.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.888+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=WW3YKQW2G9OI tag=C50H19YZC7HI type=write size=3014531 2024-09-14T11:17:12.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.889+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=00W4DM19QPHB type=del size=1568039 2024-09-14T11:17:12.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.890+0000 7f185d9f8780 -1 < failed to complete operation key=L4L83NVMXHXZ tag=VGD500YMYD5Z type=del size=958807: (22) Invalid argument 2024-09-14T11:17:12.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.892+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=9J31Z31OJZV3 type=del size=3172519 2024-09-14T11:17:12.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.893+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=HC2VVMS0UE93 type=del 2024-09-14T11:17:12.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.895+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~3UYA629CKQFQ.0 size=1048576 2024-09-14T11:17:12.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.896+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~3UYA629CKQFQ.1 size=754651 2024-09-14T11:17:12.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.896+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=3UYA629CKQFQ tag=C9T2YWB4X07K type=write size=2851803 2024-09-14T11:17:12.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.897+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~LA4ADCMF0LRS.0 size=1048576 2024-09-14T11:17:12.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.898+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~LA4ADCMF0LRS.1 size=456495 2024-09-14T11:17:12.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.900+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=LA4ADCMF0LRS tag=EF3731ZMDJ4C type=write size=2553647 2024-09-14T11:17:12.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.902+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=V26ME97KA6KE type=write size=513459 2024-09-14T11:17:12.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.903+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=Z66YDFVE693E type=del 2024-09-14T11:17:12.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.904+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=1GFE5N03BI98 type=write size=230448 2024-09-14T11:17:12.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.906+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~EXW5V2WBEGS2.0 size=556234 2024-09-14T11:17:12.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.908+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=EXW5V2WBEGS2 tag=FZ91594CIFVH type=write size=1604810 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.909+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=T2LIVIAUMN10 type=del size=1848515 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.911+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=MYMGHJBMOA63 type=del 2024-09-14T11:17:12.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.913+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~7C8CBRQL8TR8.0 size=1048576 2024-09-14T11:17:12.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.914+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~7C8CBRQL8TR8.1 size=1048576 2024-09-14T11:17:12.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.915+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~7C8CBRQL8TR8.2 size=822741 2024-09-14T11:17:12.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.915+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=7C8CBRQL8TR8 tag=MOYOI743TOL8 type=write size=3968469 2024-09-14T11:17:12.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.916+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=7WI8G57PG8WS type=del 2024-09-14T11:17:12.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.919+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~1N5Q00B3M2TO.0 size=1048576 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.920+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~1N5Q00B3M2TO.1 size=598381 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.920+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=1N5Q00B3M2TO tag=MZDFZUJQRDWE type=write size=2695533 2024-09-14T11:17:12.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.922+0000 7f185d9f8780 1 < suggested update operation key=HLUMY48G90KB tag=DRVI87JJUQEI type=write size=244824 2024-09-14T11:17:12.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.923+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=GC8QE4O24JGJ type=del size=682327 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.925+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~ZT1VK3G8K7Y2.0 size=1048576 2024-09-14T11:17:12.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.926+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~ZT1VK3G8K7Y2.1 size=501519 2024-09-14T11:17:12.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.928+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=ZT1VK3G8K7Y2 tag=V4AGNGA5SCNZ type=write size=2598671 2024-09-14T11:17:12.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.929+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=6ZQFE4MK13PA type=del size=1619982 2024-09-14T11:17:12.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.930+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~GLVR5MIOL2I1.0 size=1048576 2024-09-14T11:17:12.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.931+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~GLVR5MIOL2I1.1 size=372482 2024-09-14T11:17:12.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.933+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=GLVR5MIOL2I1 tag=30JPQACG5NJ6 type=write size=2469634 2024-09-14T11:17:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.935+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~POHCTO46RMUL.0 size=461440 2024-09-14T11:17:12.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.935+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=POHCTO46RMUL tag=282HGKJJ5QCH type=write size=1510016 2024-09-14T11:17:12.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.937+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~AAFLZKKI080H.0 size=1048576 2024-09-14T11:17:12.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.938+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~AAFLZKKI080H.1 size=1048576 2024-09-14T11:17:12.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.939+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~AAFLZKKI080H.2 size=962707 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.941+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=AAFLZKKI080H tag=ZA1PVSYT7N0I type=write size=4108435 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.943+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~6BUEOI8V8K0M.0 size=167093 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.943+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=6BUEOI8V8K0M tag=X2GWL14LCO4V type=write size=1215669 2024-09-14T11:17:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.944+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~6AG7EGIAN5QY.0 size=383191 2024-09-14T11:17:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.946+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=6AG7EGIAN5QY tag=PZOUD9Q0XA38 type=write size=1431767 2024-09-14T11:17:12.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.947+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=3J3N2AJIPE7H type=del size=173353 2024-09-14T11:17:12.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.950+0000 7f185d9f8780 1 < suggested remove operation key=55K4D3SEM068 tag=DMC6981177CS type=write 2024-09-14T11:17:12.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.951+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=7LB0A8MB0Y22 type=del size=1415086 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.952+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~D31XJK29XSXS.0 size=599030 2024-09-14T11:17:12.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.954+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=D31XJK29XSXS tag=2IKJ5TD8VPPQ type=write size=1647606 2024-09-14T11:17:12.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.956+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=Q2ITB2UNJOD3 type=del size=1657015 2024-09-14T11:17:12.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.957+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=JZX3P182SJGD type=del 2024-09-14T11:17:12.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.959+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~VRT1I3M1BIFE.0 size=1048576 2024-09-14T11:17:12.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.960+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~VRT1I3M1BIFE.1 size=722538 2024-09-14T11:17:12.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.960+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=VRT1I3M1BIFE tag=BMP9NWP4DBGT type=write size=2819690 2024-09-14T11:17:12.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.961+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=00W4DM19QPHB type=del 2024-09-14T11:17:12.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.963+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=A5UJS5B73RN4 type=del size=904718 2024-09-14T11:17:12.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.965+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=9J31Z31OJZV3 type=del 2024-09-14T11:17:12.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.967+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~4D1Q0AG9MXA3.0 size=1048576 2024-09-14T11:17:12.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.968+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~4D1Q0AG9MXA3.1 size=666986 2024-09-14T11:17:12.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.968+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=4D1Q0AG9MXA3 tag=LMYDSNGVJXBR type=write size=2764138 2024-09-14T11:17:12.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.969+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~3UYA629CKQFQ.0 size=1048576 2024-09-14T11:17:12.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.970+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~3UYA629CKQFQ.1 size=754651 2024-09-14T11:17:12.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.973+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=3UYA629CKQFQ tag=C9T2YWB4X07K type=write size=2851803 2024-09-14T11:17:12.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.975+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~J7RAEVQMQWGR.0 size=1048576 2024-09-14T11:17:12.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.976+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~J7RAEVQMQWGR.1 size=1028132 2024-09-14T11:17:12.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.976+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=J7RAEVQMQWGR tag=SKZ6PZEHH48R type=write size=3125284 2024-09-14T11:17:12.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.977+0000 7f185d9f8780 -1 < failed to complete operation key=55K4D3SEM068 tag=V26ME97KA6KE type=write size=513459: (22) Invalid argument 2024-09-14T11:17:12.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.979+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~NFB8GGU81NKB.0 size=1048576 2024-09-14T11:17:12.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.980+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~NFB8GGU81NKB.1 size=1048576 2024-09-14T11:17:12.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.981+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~NFB8GGU81NKB.2 size=836962 2024-09-14T11:17:12.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.981+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=NFB8GGU81NKB tag=45XBP0D1TVS3 type=write size=3982690 2024-09-14T11:17:12.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.982+0000 7f185d9f8780 1 < completed write operation key=CJ6C03RXS0IW tag=1GFE5N03BI98 type=write size=230448 2024-09-14T11:17:12.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.985+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=DNOKVHU6KLSM type=del size=2712137 2024-09-14T11:17:12.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.986+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=T2LIVIAUMN10 type=del 2024-09-14T11:17:12.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.987+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=053Z8YEW3266 type=del size=1409743 2024-09-14T11:17:12.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.988+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~7C8CBRQL8TR8.0 size=1048576 2024-09-14T11:17:12.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.989+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~7C8CBRQL8TR8.1 size=1048576 2024-09-14T11:17:12.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.990+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~7C8CBRQL8TR8.2 size=822741 2024-09-14T11:17:12.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.992+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=7C8CBRQL8TR8 tag=MOYOI743TOL8 type=write size=3968469 2024-09-14T11:17:12.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.993+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=EMCEY4MKFGJH type=del size=2799926 2024-09-14T11:17:12.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.994+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~1N5Q00B3M2TO.0 size=1048576 2024-09-14T11:17:12.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.995+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~1N5Q00B3M2TO.1 size=598381 2024-09-14T11:17:12.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.997+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=1N5Q00B3M2TO tag=MZDFZUJQRDWE type=write size=2695533 2024-09-14T11:17:12.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:12.999+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=0JPIJGJSIXSU type=del size=3833668 2024-09-14T11:17:12.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.000+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=GC8QE4O24JGJ type=del 2024-09-14T11:17:12.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.001+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=2SO5QJU5JCA5 type=del size=2942443 2024-09-14T11:17:13.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.002+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=6ZQFE4MK13PA type=del 2024-09-14T11:17:13.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.004+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=RL30U724OA1D type=del size=3959056 2024-09-14T11:17:13.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.005+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~POHCTO46RMUL.0 size=461440 2024-09-14T11:17:13.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.007+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=POHCTO46RMUL tag=282HGKJJ5QCH type=write size=1510016 2024-09-14T11:17:13.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.008+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=85MW7K8A00D6 type=del size=991580 2024-09-14T11:17:13.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.009+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~6BUEOI8V8K0M.0 size=167093 2024-09-14T11:17:13.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.011+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=6BUEOI8V8K0M tag=X2GWL14LCO4V type=write size=1215669 2024-09-14T11:17:13.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.013+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=2WGF4YX0GL54 type=write size=290620 2024-09-14T11:17:13.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.015+0000 7f185d9f8780 1 < suggested remove operation key=6B0SURI3Q8R6 tag=3J3N2AJIPE7H type=del 2024-09-14T11:17:13.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.018+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~ET0NGEHIXOBX.0 size=1048576 2024-09-14T11:17:13.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.019+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~ET0NGEHIXOBX.1 size=417361 2024-09-14T11:17:13.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.019+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=ET0NGEHIXOBX tag=53WL3B0AVNH1 type=write size=2514513 2024-09-14T11:17:13.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.021+0000 7f185d9f8780 1 < suggested remove operation key=55K4D3SEM068 tag=7LB0A8MB0Y22 type=del 2024-09-14T11:17:13.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.022+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=U8N0CAWH6XZB type=del size=129433 2024-09-14T11:17:13.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.023+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=Q2ITB2UNJOD3 type=del 2024-09-14T11:17:13.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.025+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~6J4AMR2VP9KV.0 size=450049 2024-09-14T11:17:13.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.025+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=6J4AMR2VP9KV tag=WA0T69R9A67K type=write size=1498625 2024-09-14T11:17:13.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.026+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~VRT1I3M1BIFE.0 size=1048576 2024-09-14T11:17:13.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.026+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~VRT1I3M1BIFE.1 size=722538 2024-09-14T11:17:13.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.028+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=VRT1I3M1BIFE tag=BMP9NWP4DBGT type=write size=2819690 2024-09-14T11:17:13.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.030+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=XMJKNKO1DGFH type=write size=844017 2024-09-14T11:17:13.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.031+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=A5UJS5B73RN4 type=del 2024-09-14T11:17:13.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.032+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=IYANNS178QBT type=del size=3882084 2024-09-14T11:17:13.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.033+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~4D1Q0AG9MXA3.0 size=1048576 2024-09-14T11:17:13.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.034+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~4D1Q0AG9MXA3.1 size=666986 2024-09-14T11:17:13.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.036+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=4D1Q0AG9MXA3 tag=LMYDSNGVJXBR type=write size=2764138 2024-09-14T11:17:13.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.038+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=6QZTZ610SDSR type=write size=730433 2024-09-14T11:17:13.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.039+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~J7RAEVQMQWGR.0 size=1048576 2024-09-14T11:17:13.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.040+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~J7RAEVQMQWGR.1 size=1028132 2024-09-14T11:17:13.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.042+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=J7RAEVQMQWGR tag=SKZ6PZEHH48R type=write size=3125284 2024-09-14T11:17:13.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.043+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=9ZBSCX2OJ6VP type=write size=811786 2024-09-14T11:17:13.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.044+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~NFB8GGU81NKB.0 size=1048576 2024-09-14T11:17:13.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.045+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~NFB8GGU81NKB.1 size=1048576 2024-09-14T11:17:13.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.046+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~NFB8GGU81NKB.2 size=836962 2024-09-14T11:17:13.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.048+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=NFB8GGU81NKB tag=45XBP0D1TVS3 type=write size=3982690 2024-09-14T11:17:13.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.050+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=9PTU1ETG3PZK type=del size=3657009 2024-09-14T11:17:13.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.051+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=DNOKVHU6KLSM type=del 2024-09-14T11:17:13.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.052+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=I64LIJ9MHQ3Q type=del size=2547618 2024-09-14T11:17:13.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.053+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=053Z8YEW3266 type=del 2024-09-14T11:17:13.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.055+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=HDS8V8I7OKIX type=del size=103225 2024-09-14T11:17:13.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.056+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=EMCEY4MKFGJH type=del 2024-09-14T11:17:13.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.057+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=XWAHNBG5IID9 type=del size=946643 2024-09-14T11:17:13.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.059+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=0JPIJGJSIXSU type=del 2024-09-14T11:17:13.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.060+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=XF8KZBZRB2SL type=del size=2370720 2024-09-14T11:17:13.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.063+0000 7f185d9f8780 1 < suggested update operation key=H29SXBS4N9JK tag=2SO5QJU5JCA5 type=del size=2942443 2024-09-14T11:17:13.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.066+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~50749954DUUI.0 size=1048576 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.067+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~50749954DUUI.1 size=669223 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.067+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=50749954DUUI tag=VA023ELHW9VS type=write size=2766375 2024-09-14T11:17:13.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.068+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=RL30U724OA1D type=del 2024-09-14T11:17:13.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.071+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~J3Y20M7H49I9.0 size=686146 2024-09-14T11:17:13.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.071+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=J3Y20M7H49I9 tag=IN5VM4KY79N4 type=write size=1734722 2024-09-14T11:17:13.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.072+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=85MW7K8A00D6 type=del 2024-09-14T11:17:13.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.074+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=2E41INHNIMZW type=del size=934984 2024-09-14T11:17:13.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.076+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=2WGF4YX0GL54 type=write 2024-09-14T11:17:13.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.078+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=8B7205DK2TAD type=del size=865595 2024-09-14T11:17:13.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.079+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~ET0NGEHIXOBX.0 size=1048576 2024-09-14T11:17:13.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.080+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~ET0NGEHIXOBX.1 size=417361 2024-09-14T11:17:13.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.083+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=ET0NGEHIXOBX tag=53WL3B0AVNH1 type=write size=2514513 2024-09-14T11:17:13.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.084+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=JS4PVAU6M2B4 type=del size=2602947 2024-09-14T11:17:13.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.085+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=U8N0CAWH6XZB type=del 2024-09-14T11:17:13.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.088+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~XO87C7KXCXQC.0 size=1048576 2024-09-14T11:17:13.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.089+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~XO87C7KXCXQC.1 size=317829 2024-09-14T11:17:13.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.089+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=XO87C7KXCXQC tag=C7JYJ25XR6FA type=write size=2414981 2024-09-14T11:17:13.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.090+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~6J4AMR2VP9KV.0 size=450049 2024-09-14T11:17:13.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.092+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=6J4AMR2VP9KV tag=WA0T69R9A67K type=write size=1498625 2024-09-14T11:17:13.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.095+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~7A7NNUD2OIRS.0 size=65698 2024-09-14T11:17:13.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.095+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=7A7NNUD2OIRS tag=479BWC9QZ2I9 type=write size=1114274 2024-09-14T11:17:13.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.097+0000 7f185d9f8780 1 < suggested remove operation key=6B0SURI3Q8R6 tag=XMJKNKO1DGFH type=write 2024-09-14T11:17:13.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.098+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=O9NYACMW1EL6 type=del size=308309 2024-09-14T11:17:13.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.099+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=IYANNS178QBT type=del size=3882084 2024-09-14T11:17:13.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.101+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=Z6RMEUNCC93Y type=del size=3787434 2024-09-14T11:17:13.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.102+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=6QZTZ610SDSR type=write size=730433 2024-09-14T11:17:13.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.104+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=S03TLFJ8HN0F type=write size=632595 2024-09-14T11:17:13.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.106+0000 7f185d9f8780 1 < completed write operation key=830X857XIX9O tag=9ZBSCX2OJ6VP type=write size=811786 2024-09-14T11:17:13.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.108+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~RTQ1YWL52MFQ.0 size=1048576 2024-09-14T11:17:13.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.109+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~RTQ1YWL52MFQ.1 size=806660 2024-09-14T11:17:13.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.109+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=RTQ1YWL52MFQ tag=TCY13G9W8YYL type=write size=2903812 2024-09-14T11:17:13.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.112+0000 7f185d9f8780 1 < suggested update operation key=830X857XIX9O tag=9PTU1ETG3PZK type=del size=3657009 2024-09-14T11:17:13.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.113+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=EQJ59336NCSC type=write size=754923 2024-09-14T11:17:13.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.115+0000 7f185d9f8780 1 < suggested update operation key=N040R6OERAJP tag=I64LIJ9MHQ3Q type=del size=2547618 2024-09-14T11:17:13.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.117+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~3MHGH398LY2O.0 size=818069 2024-09-14T11:17:13.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.117+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=3MHGH398LY2O tag=26FMHK0IYWVG type=write size=1866645 2024-09-14T11:17:13.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.120+0000 7f185d9f8780 1 < suggested remove operation key=WPBYTFP7HRVE tag=HDS8V8I7OKIX type=del 2024-09-14T11:17:13.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.121+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=DCCLDVO1HPYZ type=del size=1453285 2024-09-14T11:17:13.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.122+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=XWAHNBG5IID9 type=del size=946643 2024-09-14T11:17:13.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.123+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=0IGL2F3CW5W8 type=write size=686604 2024-09-14T11:17:13.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.124+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=XF8KZBZRB2SL type=del 2024-09-14T11:17:13.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.125+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=S3K9KGNDT38G type=del size=1024352 2024-09-14T11:17:13.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.127+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~50749954DUUI.0 size=1048576 2024-09-14T11:17:13.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.127+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~50749954DUUI.1 size=669223 2024-09-14T11:17:13.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.129+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=50749954DUUI tag=VA023ELHW9VS type=write size=2766375 2024-09-14T11:17:13.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.130+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=LEKZP16GS29P type=write size=615028 2024-09-14T11:17:13.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.132+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~J3Y20M7H49I9.0 size=686146 2024-09-14T11:17:13.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.133+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=J3Y20M7H49I9 tag=IN5VM4KY79N4 type=write size=1734722 2024-09-14T11:17:13.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.135+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=09G5QPLE2OZI type=write size=910539 2024-09-14T11:17:13.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.136+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=2E41INHNIMZW type=del 2024-09-14T11:17:13.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.138+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~Y6O9LBQ5XXET.0 size=91390 2024-09-14T11:17:13.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.138+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=Y6O9LBQ5XXET tag=5KB30JX4J8FX type=write size=1139966 2024-09-14T11:17:13.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.139+0000 7f185d9f8780 1 < canceled operation key=H29SXBS4N9JK tag=8B7205DK2TAD type=del size=865595 2024-09-14T11:17:13.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.141+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~GBMYZVF9J33Z.0 size=367621 2024-09-14T11:17:13.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.141+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=GBMYZVF9J33Z tag=3M6GGCCN8XUQ type=write size=1416197 2024-09-14T11:17:13.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.142+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=JS4PVAU6M2B4 type=del 2024-09-14T11:17:13.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.143+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=NUBH9562S1DE type=write size=215904 2024-09-14T11:17:13.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.144+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~XO87C7KXCXQC.0 size=1048576 2024-09-14T11:17:13.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.144+0000 7f185d9f8780 1 < canceled part key=_multipart_OYZIXCSGXTHR.2~XO87C7KXCXQC.1 size=317829 2024-09-14T11:17:13.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.146+0000 7f185d9f8780 1 < canceled multipart upload key=OYZIXCSGXTHR upload=XO87C7KXCXQC tag=C7JYJ25XR6FA type=write size=2414981 2024-09-14T11:17:13.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.148+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~IZYISK3IOROC.0 size=515187 2024-09-14T11:17:13.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.148+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=IZYISK3IOROC tag=2OE0E7XCJU61 type=write size=1563763 2024-09-14T11:17:13.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.149+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~7A7NNUD2OIRS.0 size=65698 2024-09-14T11:17:13.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.151+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=7A7NNUD2OIRS tag=479BWC9QZ2I9 type=write size=1114274 2024-09-14T11:17:13.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.153+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~FGWSWQXGL6A6.0 size=684833 2024-09-14T11:17:13.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.153+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=FGWSWQXGL6A6 tag=Y3G9FU3FYW07 type=write size=1733409 2024-09-14T11:17:13.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.155+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=O9NYACMW1EL6 type=del 2024-09-14T11:17:13.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.157+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~JQN99XNUZ1DX.0 size=1048576 2024-09-14T11:17:13.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.158+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~JQN99XNUZ1DX.1 size=961401 2024-09-14T11:17:13.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.158+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=JQN99XNUZ1DX tag=Z8LKQ4A8R53A type=write size=3058553 2024-09-14T11:17:13.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.159+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=Z6RMEUNCC93Y type=del 2024-09-14T11:17:13.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.160+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=6B3FM92HOTKV type=del size=1985183 2024-09-14T11:17:13.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.162+0000 7f185d9f8780 1 < suggested remove operation key=OYZIXCSGXTHR tag=S03TLFJ8HN0F type=write 2024-09-14T11:17:13.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.164+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~RJTLO5EEMEX9.0 size=1048576 2024-09-14T11:17:13.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.165+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~RJTLO5EEMEX9.1 size=1048576 2024-09-14T11:17:13.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.166+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~RJTLO5EEMEX9.2 size=919859 2024-09-14T11:17:13.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.166+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=RJTLO5EEMEX9 tag=Y5EVWKWJLXNN type=write size=4065587 2024-09-14T11:17:13.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.167+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~RTQ1YWL52MFQ.0 size=1048576 2024-09-14T11:17:13.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.168+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~RTQ1YWL52MFQ.1 size=806660 2024-09-14T11:17:13.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.170+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=RTQ1YWL52MFQ tag=TCY13G9W8YYL type=write size=2903812 2024-09-14T11:17:13.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.171+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=H1BB39AYXWLA type=del size=4178889 2024-09-14T11:17:13.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.172+0000 7f185d9f8780 1 < completed write operation key=IXWIKD7J74RJ tag=EQJ59336NCSC type=write size=754923 2024-09-14T11:17:13.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.173+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=10LTEFI4OB02 type=write size=571128 2024-09-14T11:17:13.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.174+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~3MHGH398LY2O.0 size=818069 2024-09-14T11:17:13.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.176+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=3MHGH398LY2O tag=26FMHK0IYWVG type=write size=1866645 2024-09-14T11:17:13.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.178+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~SZV23QTQ4QA5.0 size=290476 2024-09-14T11:17:13.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.178+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=SZV23QTQ4QA5 tag=EBILE7HHV1DI type=write size=1339052 2024-09-14T11:17:13.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.180+0000 7f185d9f8780 1 < suggested remove operation key=M4FJDW1QHGBM tag=DCCLDVO1HPYZ type=del 2024-09-14T11:17:13.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.182+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~YNO3855LDHTJ.0 size=1048576 2024-09-14T11:17:13.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.183+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~YNO3855LDHTJ.1 size=75046 2024-09-14T11:17:13.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.183+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=YNO3855LDHTJ tag=GEYLLY6JUHCP type=write size=2172198 2024-09-14T11:17:13.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.183+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=M4FJDW1QHGBM tag=0IGL2F3CW5W8 type=write size=686604: (2) No such file or directory 2024-09-14T11:17:13.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.185+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~K5PKIJDEFUF9.0 size=1048576 2024-09-14T11:17:13.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.186+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~K5PKIJDEFUF9.1 size=262042 2024-09-14T11:17:13.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.186+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=K5PKIJDEFUF9 tag=Q6AODJFMR26W type=write size=2359194 2024-09-14T11:17:13.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.188+0000 7f185d9f8780 1 < canceled operation key=IXWIKD7J74RJ tag=S3K9KGNDT38G type=del size=1024352 2024-09-14T11:17:13.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.190+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~3S605AIINXMD.0 size=1048576 2024-09-14T11:17:13.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.191+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~3S605AIINXMD.1 size=775241 2024-09-14T11:17:13.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.191+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=3S605AIINXMD tag=2E1O3LRP4P95 type=write size=2872393 2024-09-14T11:17:13.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.192+0000 7f185d9f8780 1 < completed write operation key=IXWIKD7J74RJ tag=LEKZP16GS29P type=write size=615028 2024-09-14T11:17:13.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.193+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=EHXEZFC7PIVF type=del size=3296982 2024-09-14T11:17:13.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.194+0000 7f185d9f8780 1 < completed write operation key=HLUMY48G90KB tag=09G5QPLE2OZI type=write size=910539 2024-09-14T11:17:13.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.195+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=0RVGUYRFMIGF type=write size=425333 2024-09-14T11:17:13.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.196+0000 7f185d9f8780 1 < canceled part key=_multipart_O2Y34FSQHS1S.2~Y6O9LBQ5XXET.0 size=91390 2024-09-14T11:17:13.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.197+0000 7f185d9f8780 1 < canceled multipart upload key=O2Y34FSQHS1S upload=Y6O9LBQ5XXET tag=5KB30JX4J8FX type=write size=1139966 2024-09-14T11:17:13.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.199+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=N12WRRVPED1F type=del size=3273377 2024-09-14T11:17:13.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.200+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~GBMYZVF9J33Z.0 size=367621 2024-09-14T11:17:13.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.202+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=GBMYZVF9J33Z tag=3M6GGCCN8XUQ type=write size=1416197 2024-09-14T11:17:13.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.203+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=6THL6E4JV23Z type=del size=2582197 2024-09-14T11:17:13.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.205+0000 7f185d9f8780 1 < completed write operation key=P30WF4R3UFPX tag=NUBH9562S1DE type=write size=215904 2024-09-14T11:17:13.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.207+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~NV3J8USHHE7O.0 size=1048576 2024-09-14T11:17:13.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.208+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~NV3J8USHHE7O.1 size=490005 2024-09-14T11:17:13.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.208+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=NV3J8USHHE7O tag=VDDBR6ZNYI0B type=write size=2587157 2024-09-14T11:17:13.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.209+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~IZYISK3IOROC.0 size=515187 2024-09-14T11:17:13.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.211+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=IZYISK3IOROC tag=2OE0E7XCJU61 type=write size=1563763 2024-09-14T11:17:13.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.212+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=AEVEPI08HMRS type=del size=1795601 2024-09-14T11:17:13.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.215+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~FGWSWQXGL6A6.0 size=684833 2024-09-14T11:17:13.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.217+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=FGWSWQXGL6A6 tag=Y3G9FU3FYW07 type=write size=1733409 2024-09-14T11:17:13.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.219+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=YCL00G9YLZFZ type=del size=2199717 2024-09-14T11:17:13.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.220+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~JQN99XNUZ1DX.0 size=1048576 2024-09-14T11:17:13.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.221+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~JQN99XNUZ1DX.1 size=961401 2024-09-14T11:17:13.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.223+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=JQN99XNUZ1DX tag=Z8LKQ4A8R53A type=write size=3058553 2024-09-14T11:17:13.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.225+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~XP08XAZ114ZP.0 size=1048576 2024-09-14T11:17:13.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.226+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~XP08XAZ114ZP.1 size=27975 2024-09-14T11:17:13.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.226+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=XP08XAZ114ZP tag=P8HMOQD8Y7SP type=write size=2125127 2024-09-14T11:17:13.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.227+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=6B3FM92HOTKV type=del 2024-09-14T11:17:13.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.229+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=670HL5E3JK23 type=del size=3559462 2024-09-14T11:17:13.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.230+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~RJTLO5EEMEX9.0 size=1048576 2024-09-14T11:17:13.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.231+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~RJTLO5EEMEX9.1 size=1048576 2024-09-14T11:17:13.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.232+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~RJTLO5EEMEX9.2 size=919859 2024-09-14T11:17:13.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.234+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=RJTLO5EEMEX9 tag=Y5EVWKWJLXNN type=write size=4065587 2024-09-14T11:17:13.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.236+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~56LFT1SMJHPH.0 size=845733 2024-09-14T11:17:13.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.236+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=56LFT1SMJHPH tag=D7CKAEA0OHPJ type=write size=1894309 2024-09-14T11:17:13.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.237+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=H1BB39AYXWLA type=del 2024-09-14T11:17:13.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.238+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=AICLQ8PAG4TJ type=del size=1907192 2024-09-14T11:17:13.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.240+0000 7f185d9f8780 1 < completed write operation key=CVVKY636WXG9 tag=10LTEFI4OB02 type=write size=571128 2024-09-14T11:17:13.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.241+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=OI50THF4A1O2 type=del size=1627451 2024-09-14T11:17:13.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.242+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~SZV23QTQ4QA5.0 size=290476 2024-09-14T11:17:13.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.244+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=SZV23QTQ4QA5 tag=EBILE7HHV1DI type=write size=1339052 2024-09-14T11:17:13.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.245+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=D3A2DQUM9HWM type=del size=3310376 2024-09-14T11:17:13.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.246+0000 7f185d9f8780 1 < canceled part key=_multipart_P30WF4R3UFPX.2~YNO3855LDHTJ.0 size=1048576 2024-09-14T11:17:13.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.247+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~YNO3855LDHTJ.1 size=75046 2024-09-14T11:17:13.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.249+0000 7f185d9f8780 1 < canceled multipart upload key=P30WF4R3UFPX upload=YNO3855LDHTJ tag=GEYLLY6JUHCP type=write size=2172198 2024-09-14T11:17:13.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.250+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=8JE36WVHUTS0 type=del size=662242 2024-09-14T11:17:13.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.251+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~K5PKIJDEFUF9.0 size=1048576 2024-09-14T11:17:13.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.252+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~K5PKIJDEFUF9.1 size=262042 2024-09-14T11:17:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.254+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=K5PKIJDEFUF9 tag=Q6AODJFMR26W type=write size=2359194 2024-09-14T11:17:13.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.255+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=DYTGD7A2AV4I type=del size=1957020 2024-09-14T11:17:13.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.256+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~3S605AIINXMD.0 size=1048576 2024-09-14T11:17:13.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.257+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~3S605AIINXMD.1 size=775241 2024-09-14T11:17:13.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.259+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=3S605AIINXMD tag=2E1O3LRP4P95 type=write size=2872393 2024-09-14T11:17:13.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.261+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~CRUBF93GE0OH.0 size=1048576 2024-09-14T11:17:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.262+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~CRUBF93GE0OH.1 size=412823 2024-09-14T11:17:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.262+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=CRUBF93GE0OH tag=1GCHVQ8GCHUH type=write size=2509975 2024-09-14T11:17:13.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.263+0000 7f185d9f8780 1 < canceled operation key=CVVKY636WXG9 tag=EHXEZFC7PIVF type=del size=3296982 2024-09-14T11:17:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.265+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=KUCUQ7JVN0LL type=write size=181273 2024-09-14T11:17:13.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.266+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=0RVGUYRFMIGF type=write size=425333 2024-09-14T11:17:13.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.267+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=BJSU24645I22 type=del size=3912907 2024-09-14T11:17:13.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.268+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=N12WRRVPED1F type=del 2024-09-14T11:17:13.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.271+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~E1XQJPVXIVK2.0 size=1048576 2024-09-14T11:17:13.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.272+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~E1XQJPVXIVK2.1 size=1048576 2024-09-14T11:17:13.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.273+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~E1XQJPVXIVK2.2 size=67399 2024-09-14T11:17:13.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.273+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=E1XQJPVXIVK2 tag=1DX6V7480MVA type=write size=3213127 2024-09-14T11:17:13.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.275+0000 7f185d9f8780 1 < suggested update operation key=6B0SURI3Q8R6 tag=6THL6E4JV23Z type=del size=2582197 2024-09-14T11:17:13.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.277+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~F1JEB7CZ1AFG.0 size=56461 2024-09-14T11:17:13.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.277+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=F1JEB7CZ1AFG tag=K5E21UM2QUS0 type=write size=1105037 2024-09-14T11:17:13.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.279+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~NV3J8USHHE7O.0 size=1048576 2024-09-14T11:17:13.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.280+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~NV3J8USHHE7O.1 size=490005 2024-09-14T11:17:13.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.282+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=NV3J8USHHE7O tag=VDDBR6ZNYI0B type=write size=2587157 2024-09-14T11:17:13.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.284+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~7YY27DT856LO.0 size=666002 2024-09-14T11:17:13.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.284+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=7YY27DT856LO tag=B23R441FOCY9 type=write size=1714578 2024-09-14T11:17:13.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.286+0000 7f185d9f8780 1 < canceled operation key=ESN8NVVJB3B0 tag=AEVEPI08HMRS type=del size=1795601 2024-09-14T11:17:13.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.287+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=SL8JCOBZHUU6 type=del size=1101324 2024-09-14T11:17:13.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.288+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=YCL00G9YLZFZ type=del 2024-09-14T11:17:13.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.289+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=PXNX1I27KXYG type=del size=2232265 2024-09-14T11:17:13.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.291+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~XP08XAZ114ZP.0 size=1048576 2024-09-14T11:17:13.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.292+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~XP08XAZ114ZP.1 size=27975 2024-09-14T11:17:13.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.294+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=XP08XAZ114ZP tag=P8HMOQD8Y7SP type=write size=2125127 2024-09-14T11:17:13.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.295+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=3RH2NKTVIM9B type=del size=3908703 2024-09-14T11:17:13.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.296+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=670HL5E3JK23 type=del 2024-09-14T11:17:13.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.298+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=NW8ULJK8N10Q type=del size=2310425 2024-09-14T11:17:13.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.298+0000 7f185d9f8780 1 < canceled part key=_multipart_P30WF4R3UFPX.2~56LFT1SMJHPH.0 size=845733 2024-09-14T11:17:13.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.300+0000 7f185d9f8780 1 < canceled multipart upload key=P30WF4R3UFPX upload=56LFT1SMJHPH tag=D7CKAEA0OHPJ type=write size=1894309 2024-09-14T11:17:13.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.302+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=X06EL5V0BID8 type=write size=887353 2024-09-14T11:17:13.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.303+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=AICLQ8PAG4TJ type=del 2024-09-14T11:17:13.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.304+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=58TFD3PKI6PX type=del size=2391458 2024-09-14T11:17:13.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.305+0000 7f185d9f8780 1 < canceled operation key=JL2IH8NEX1YF tag=OI50THF4A1O2 type=del size=1627451 2024-09-14T11:17:13.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.307+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=5RJT01QL95LA type=del size=2158233 2024-09-14T11:17:13.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.308+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=D3A2DQUM9HWM type=del 2024-09-14T11:17:13.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.310+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~AZFGFEG37NLR.0 size=1048576 2024-09-14T11:17:13.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.311+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~AZFGFEG37NLR.1 size=437204 2024-09-14T11:17:13.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.311+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=AZFGFEG37NLR tag=2CATUNAEB2AM type=write size=2534356 2024-09-14T11:17:13.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.313+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=8JE36WVHUTS0 type=del 2024-09-14T11:17:13.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.314+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=7RKEH6D8Z30L type=write size=438163 2024-09-14T11:17:13.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.315+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=DYTGD7A2AV4I type=del 2024-09-14T11:17:13.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.318+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~8G23IQXKMLU6.0 size=1032988 2024-09-14T11:17:13.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.318+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=8G23IQXKMLU6 tag=TB6KSF4ID0MJ type=write size=2081564 2024-09-14T11:17:13.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.319+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~CRUBF93GE0OH.0 size=1048576 2024-09-14T11:17:13.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.320+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~CRUBF93GE0OH.1 size=412823 2024-09-14T11:17:13.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.322+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=CRUBF93GE0OH tag=1GCHVQ8GCHUH type=write size=2509975 2024-09-14T11:17:13.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.324+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~BV90Z4LZWQZX.0 size=1048576 2024-09-14T11:17:13.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.325+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~BV90Z4LZWQZX.1 size=1048576 2024-09-14T11:17:13.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.325+0000 7f185d9f8780 1 > prepared part key=_multipart_IXWIKD7J74RJ.2~BV90Z4LZWQZX.2 size=523439 2024-09-14T11:17:13.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.325+0000 7f185d9f8780 1 > prepared multipart upload key=IXWIKD7J74RJ upload=BV90Z4LZWQZX tag=B4SFFW4UFXMS type=write size=3669167 2024-09-14T11:17:13.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.327+0000 7f185d9f8780 1 < canceled operation key=55K4D3SEM068 tag=KUCUQ7JVN0LL type=write size=181273 2024-09-14T11:17:13.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.330+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~OPYT94SGI87O.0 size=1048576 2024-09-14T11:17:13.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.331+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~OPYT94SGI87O.1 size=1048576 2024-09-14T11:17:13.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.332+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~OPYT94SGI87O.2 size=906696 2024-09-14T11:17:13.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.332+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=OPYT94SGI87O tag=RMKF9B6LDUCA type=write size=4052424 2024-09-14T11:17:13.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.333+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=BJSU24645I22 type=del 2024-09-14T11:17:13.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.335+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~EEFVQFY1TG57.0 size=167883 2024-09-14T11:17:13.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.335+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=EEFVQFY1TG57 tag=W9LTT0VHQPVS type=write size=1216459 2024-09-14T11:17:13.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.336+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~E1XQJPVXIVK2.0 size=1048576 2024-09-14T11:17:13.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.337+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~E1XQJPVXIVK2.1 size=1048576 2024-09-14T11:17:13.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.338+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~E1XQJPVXIVK2.2 size=67399 2024-09-14T11:17:13.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.340+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=E1XQJPVXIVK2 tag=1DX6V7480MVA type=write size=3213127 2024-09-14T11:17:13.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.341+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=LF0HEI1II56P type=del size=3615262 2024-09-14T11:17:13.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.342+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~F1JEB7CZ1AFG.0 size=56461 2024-09-14T11:17:13.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.344+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=F1JEB7CZ1AFG tag=K5E21UM2QUS0 type=write size=1105037 2024-09-14T11:17:13.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.345+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=UGJ6IPOTB1OI type=del size=1752391 2024-09-14T11:17:13.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.346+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~7YY27DT856LO.0 size=666002 2024-09-14T11:17:13.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.348+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=7YY27DT856LO tag=B23R441FOCY9 type=write size=1714578 2024-09-14T11:17:13.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.349+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=ZNBB6JTYS0KM type=del size=1551266 2024-09-14T11:17:13.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.350+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=SL8JCOBZHUU6 type=del 2024-09-14T11:17:13.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.352+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=281H564156GF type=del size=1072083 2024-09-14T11:17:13.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.353+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=PXNX1I27KXYG type=del 2024-09-14T11:17:13.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.355+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~CQHFFZWWN2EW.0 size=1048576 2024-09-14T11:17:13.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.356+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~CQHFFZWWN2EW.1 size=287755 2024-09-14T11:17:13.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.356+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=CQHFFZWWN2EW tag=7OADRI180VP9 type=write size=2384907 2024-09-14T11:17:13.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.357+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=3RH2NKTVIM9B type=del 2024-09-14T11:17:13.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.359+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~1013UA3AE8M4.0 size=915617 2024-09-14T11:17:13.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.359+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=1013UA3AE8M4 tag=I9CZOMA9WTTV type=write size=1964193 2024-09-14T11:17:13.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.360+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=NW8ULJK8N10Q type=del 2024-09-14T11:17:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.362+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~9US259ARG48R.0 size=966128 2024-09-14T11:17:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.362+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=9US259ARG48R tag=MHOYBSNSHGON type=write size=2014704 2024-09-14T11:17:13.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.363+0000 7f185d9f8780 1 < completed write operation key=ZR3IEW48CSCF tag=X06EL5V0BID8 type=write size=887353 2024-09-14T11:17:13.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.366+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~ELMOME0PHCIE.0 size=1048576 2024-09-14T11:17:13.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.367+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~ELMOME0PHCIE.1 size=1048576 2024-09-14T11:17:13.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.368+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~ELMOME0PHCIE.2 size=1047823 2024-09-14T11:17:13.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.368+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=ELMOME0PHCIE tag=XZLWW33Q02OX type=write size=4193551 2024-09-14T11:17:13.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.370+0000 7f185d9f8780 1 < suggested update operation key=ESN8NVVJB3B0 tag=58TFD3PKI6PX type=del size=2391458 2024-09-14T11:17:13.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.371+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=H34T5TLQLFFR type=del size=2556018 2024-09-14T11:17:13.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.373+0000 7f185d9f8780 1 < suggested remove operation key=7XGG5LBGRI4H tag=5RJT01QL95LA type=del 2024-09-14T11:17:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.376+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~LRB3M2NBEAT1.0 size=1048576 2024-09-14T11:17:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.376+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~LRB3M2NBEAT1.1 size=24384 2024-09-14T11:17:13.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.376+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=LRB3M2NBEAT1 tag=DW46S4E0A9YF type=write size=2121536 2024-09-14T11:17:13.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.378+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~AZFGFEG37NLR.0 size=1048576 2024-09-14T11:17:13.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.378+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~AZFGFEG37NLR.1 size=437204 2024-09-14T11:17:13.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.381+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=AZFGFEG37NLR tag=2CATUNAEB2AM type=write size=2534356 2024-09-14T11:17:13.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.382+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=DPHEO42MZFP9 type=del size=2543054 2024-09-14T11:17:13.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.383+0000 7f185d9f8780 1 < completed write operation key=6MZGLP5KPPB3 tag=7RKEH6D8Z30L type=write size=438163 2024-09-14T11:17:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.384+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=3MEHL0L1SEFX type=del size=2397299 2024-09-14T11:17:13.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.385+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~8G23IQXKMLU6.0 size=1032988 2024-09-14T11:17:13.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.387+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=8G23IQXKMLU6 tag=TB6KSF4ID0MJ type=write size=2081564 2024-09-14T11:17:13.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.389+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=ICWQXEYCW29V type=del size=1100737 2024-09-14T11:17:13.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.390+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~BV90Z4LZWQZX.0 size=1048576 2024-09-14T11:17:13.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.391+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~BV90Z4LZWQZX.1 size=1048576 2024-09-14T11:17:13.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.392+0000 7f185d9f8780 1 < completed part key=_multipart_IXWIKD7J74RJ.2~BV90Z4LZWQZX.2 size=523439 2024-09-14T11:17:13.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.394+0000 7f185d9f8780 1 < completed multipart upload key=IXWIKD7J74RJ upload=BV90Z4LZWQZX tag=B4SFFW4UFXMS type=write size=3669167 2024-09-14T11:17:13.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.396+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~WMJYU4S9QCTF.0 size=503860 2024-09-14T11:17:13.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.396+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=WMJYU4S9QCTF tag=YVXH1R2T1OOE type=write size=1552436 2024-09-14T11:17:13.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.397+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~OPYT94SGI87O.0 size=1048576 2024-09-14T11:17:13.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.398+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~OPYT94SGI87O.1 size=1048576 2024-09-14T11:17:13.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.398+0000 7f185d9f8780 1 < canceled part key=_multipart_CJ6C03RXS0IW.2~OPYT94SGI87O.2 size=906696 2024-09-14T11:17:13.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.400+0000 7f185d9f8780 1 < canceled multipart upload key=CJ6C03RXS0IW upload=OPYT94SGI87O tag=RMKF9B6LDUCA type=write size=4052424 2024-09-14T11:17:13.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.402+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=F0IWLUX2OFUL type=del size=3156851 2024-09-14T11:17:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.403+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~EEFVQFY1TG57.0 size=167883 2024-09-14T11:17:13.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.405+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=EEFVQFY1TG57 tag=W9LTT0VHQPVS type=write size=1216459 2024-09-14T11:17:13.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.407+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~REJ28VMCKDMT.0 size=427612 2024-09-14T11:17:13.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.407+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=REJ28VMCKDMT tag=PIKN5475DSXU type=write size=1476188 2024-09-14T11:17:13.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.409+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=LF0HEI1II56P type=del 2024-09-14T11:17:13.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.410+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=IE11NFUGLLYU type=del size=243366 2024-09-14T11:17:13.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.412+0000 7f185d9f8780 1 < suggested remove operation key=CRZOT1D0U2F3 tag=UGJ6IPOTB1OI type=del 2024-09-14T11:17:13.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.413+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=2K31CMCYA1GG type=write size=404032 2024-09-14T11:17:13.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.415+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=ZNBB6JTYS0KM type=del 2024-09-14T11:17:13.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.417+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~7I92IIRTXH75.0 size=392433 2024-09-14T11:17:13.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.417+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=7I92IIRTXH75 tag=RS22S7XJZWKI type=write size=1441009 2024-09-14T11:17:13.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.418+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=281H564156GF type=del 2024-09-14T11:17:13.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.420+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~PRBWO0E9ZRCB.0 size=19580 2024-09-14T11:17:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.420+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=PRBWO0E9ZRCB tag=5DBIB8OR9O0R type=write size=1068156 2024-09-14T11:17:13.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.421+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~CQHFFZWWN2EW.0 size=1048576 2024-09-14T11:17:13.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.422+0000 7f185d9f8780 1 < canceled part key=_multipart_DAKWA1OCVTBG.2~CQHFFZWWN2EW.1 size=287755 2024-09-14T11:17:13.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.424+0000 7f185d9f8780 1 < canceled multipart upload key=DAKWA1OCVTBG upload=CQHFFZWWN2EW tag=7OADRI180VP9 type=write size=2384907 2024-09-14T11:17:13.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.425+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=6XK10GVS8CJ1 type=del size=186274 2024-09-14T11:17:13.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.426+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~1013UA3AE8M4.0 size=915617 2024-09-14T11:17:13.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.428+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=1013UA3AE8M4 tag=I9CZOMA9WTTV type=write size=1964193 2024-09-14T11:17:13.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.429+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=8A6A55KX1KWZ type=write size=335833 2024-09-14T11:17:13.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.429+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~9US259ARG48R.0 size=966128 2024-09-14T11:17:13.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.431+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=9US259ARG48R tag=MHOYBSNSHGON type=write size=2014704 2024-09-14T11:17:13.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.432+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=2RVL3UAG5YCS type=del size=152180 2024-09-14T11:17:13.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.434+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~ELMOME0PHCIE.0 size=1048576 2024-09-14T11:17:13.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.435+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~ELMOME0PHCIE.1 size=1048576 2024-09-14T11:17:13.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.436+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~ELMOME0PHCIE.2 size=1047823 2024-09-14T11:17:13.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.437+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=ELMOME0PHCIE tag=XZLWW33Q02OX type=write size=4193551 2024-09-14T11:17:13.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.440+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=O5H79ZAZOJY7 type=write size=61687 2024-09-14T11:17:13.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.441+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=H34T5TLQLFFR type=del 2024-09-14T11:17:13.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.443+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~4YV6VMABXOVV.0 size=876273 2024-09-14T11:17:13.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.443+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=4YV6VMABXOVV tag=9ORS2SBS8B34 type=write size=1924849 2024-09-14T11:17:13.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.444+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~LRB3M2NBEAT1.0 size=1048576 2024-09-14T11:17:13.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.445+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~LRB3M2NBEAT1.1 size=24384 2024-09-14T11:17:13.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.447+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=LRB3M2NBEAT1 tag=DW46S4E0A9YF type=write size=2121536 2024-09-14T11:17:13.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.449+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~5GHPT6CIIJ15.0 size=1048576 2024-09-14T11:17:13.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.450+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~5GHPT6CIIJ15.1 size=1048576 2024-09-14T11:17:13.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.451+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~5GHPT6CIIJ15.2 size=881791 2024-09-14T11:17:13.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.451+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=5GHPT6CIIJ15 tag=HTGB52JYXS9K type=write size=4027519 2024-09-14T11:17:13.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.453+0000 7f185d9f8780 1 < suggested update operation key=ESN8NVVJB3B0 tag=DPHEO42MZFP9 type=del size=2543054 2024-09-14T11:17:13.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.454+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=QM5262RM8IH6 type=del size=511711 2024-09-14T11:17:13.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.456+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=3MEHL0L1SEFX type=del 2024-09-14T11:17:13.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.458+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~85GHGZVF5T37.0 size=1048576 2024-09-14T11:17:13.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.459+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~85GHGZVF5T37.1 size=516873 2024-09-14T11:17:13.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.459+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=85GHGZVF5T37 tag=CQZA09F0D28O type=write size=2614025 2024-09-14T11:17:13.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.461+0000 7f185d9f8780 1 < suggested remove operation key=SEI774TP8YMJ tag=ICWQXEYCW29V type=del 2024-09-14T11:17:13.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.463+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~0HWWUOJFGJRP.0 size=469474 2024-09-14T11:17:13.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.463+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=0HWWUOJFGJRP tag=3D81LU3BNR97 type=write size=1518050 2024-09-14T11:17:13.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.463+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~WMJYU4S9QCTF.0 size=503860 2024-09-14T11:17:13.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.466+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=WMJYU4S9QCTF tag=YVXH1R2T1OOE type=write size=1552436 2024-09-14T11:17:13.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.467+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=GB90EFBQP242 type=write size=766601 2024-09-14T11:17:13.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.468+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=F0IWLUX2OFUL type=del 2024-09-14T11:17:13.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.469+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=1UCFC2CNDCGW type=del size=1675719 2024-09-14T11:17:13.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.471+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~REJ28VMCKDMT.0 size=427612 2024-09-14T11:17:13.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.473+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=REJ28VMCKDMT tag=PIKN5475DSXU type=write size=1476188 2024-09-14T11:17:13.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.475+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~F1EILMVWAIGZ.0 size=464471 2024-09-14T11:17:13.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.475+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=F1EILMVWAIGZ tag=48M1M1PMOTBX type=write size=1513047 2024-09-14T11:17:13.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.476+0000 7f185d9f8780 1 < canceled operation key=CJ6C03RXS0IW tag=IE11NFUGLLYU type=del size=243366 2024-09-14T11:17:13.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.477+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=C1ZPZG93X1ZZ type=del size=3345291 2024-09-14T11:17:13.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.479+0000 7f185d9f8780 1 < completed write operation key=MPZOX5RU0580 tag=2K31CMCYA1GG type=write size=404032 2024-09-14T11:17:13.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.480+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=32UIE6H9WODK type=del size=3764294 2024-09-14T11:17:13.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.481+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~7I92IIRTXH75.0 size=392433 2024-09-14T11:17:13.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.483+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=7I92IIRTXH75 tag=RS22S7XJZWKI type=write size=1441009 2024-09-14T11:17:13.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.485+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~DS15RI5OYVQK.0 size=1048576 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.486+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~DS15RI5OYVQK.1 size=1048576 2024-09-14T11:17:13.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.487+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~DS15RI5OYVQK.2 size=474363 2024-09-14T11:17:13.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.487+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=DS15RI5OYVQK tag=56MA0VGZ30GH type=write size=3620091 2024-09-14T11:17:13.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.488+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~PRBWO0E9ZRCB.0 size=19580 2024-09-14T11:17:13.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.490+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=PRBWO0E9ZRCB tag=5DBIB8OR9O0R type=write size=1068156 2024-09-14T11:17:13.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.492+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~Z5OFC394CYX9.0 size=220226 2024-09-14T11:17:13.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.492+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=Z5OFC394CYX9 tag=WC60Z72GU29Q type=write size=1268802 2024-09-14T11:17:13.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.495+0000 7f185d9f8780 1 < suggested remove operation key=N040R6OERAJP tag=6XK10GVS8CJ1 type=del 2024-09-14T11:17:13.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.496+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=SWOZQLIOBJMJ type=write size=312772 2024-09-14T11:17:13.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.498+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=8A6A55KX1KWZ type=write size=335833 2024-09-14T11:17:13.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.499+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=JTMRUAE24SY6 type=del size=1010703 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.500+0000 7f185d9f8780 1 < canceled operation key=PSL63WUBLB75 tag=2RVL3UAG5YCS type=del size=152180 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.501+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=UQW6Q8XBT0UZ type=del size=1923746 2024-09-14T11:17:13.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.503+0000 7f185d9f8780 -1 < failed to complete operation key=SEI774TP8YMJ tag=O5H79ZAZOJY7 type=write size=61687: (22) Invalid argument 2024-09-14T11:17:13.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.504+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=0X4R5UXW2BSM type=del size=1813921 2024-09-14T11:17:13.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.505+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~4YV6VMABXOVV.0 size=876273 2024-09-14T11:17:13.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.507+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=4YV6VMABXOVV tag=9ORS2SBS8B34 type=write size=1924849 2024-09-14T11:17:13.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.509+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~3CMU6S803CTY.0 size=1048576 2024-09-14T11:17:13.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.510+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~3CMU6S803CTY.1 size=569717 2024-09-14T11:17:13.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.510+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=3CMU6S803CTY tag=1DG2LTBLJXE8 type=write size=2666869 2024-09-14T11:17:13.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.511+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~5GHPT6CIIJ15.0 size=1048576 2024-09-14T11:17:13.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.512+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~5GHPT6CIIJ15.1 size=1048576 2024-09-14T11:17:13.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.513+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~5GHPT6CIIJ15.2 size=881791 2024-09-14T11:17:13.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.515+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=5GHPT6CIIJ15 tag=HTGB52JYXS9K type=write size=4027519 2024-09-14T11:17:13.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.516+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=YEMN1SH3CYY9 type=del size=3730308 2024-09-14T11:17:13.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.517+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=QM5262RM8IH6 type=del 2024-09-14T11:17:13.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.519+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=0QKJSE3YYJCA type=del size=1223794 2024-09-14T11:17:13.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.520+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~85GHGZVF5T37.0 size=1048576 2024-09-14T11:17:13.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.521+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~85GHGZVF5T37.1 size=516873 2024-09-14T11:17:13.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.523+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=85GHGZVF5T37 tag=CQZA09F0D28O type=write size=2614025 2024-09-14T11:17:13.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.524+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=03W7PY708AEI type=del size=1847488 2024-09-14T11:17:13.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.525+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~0HWWUOJFGJRP.0 size=469474 2024-09-14T11:17:13.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.527+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=0HWWUOJFGJRP tag=3D81LU3BNR97 type=write size=1518050 2024-09-14T11:17:13.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.529+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~45D2D37Z6BZC.0 size=1048576 2024-09-14T11:17:13.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.530+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~45D2D37Z6BZC.1 size=152090 2024-09-14T11:17:13.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.530+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=45D2D37Z6BZC tag=HMQ0532PRZ3H type=write size=2249242 2024-09-14T11:17:13.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.531+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=GB90EFBQP242 type=write size=766601 2024-09-14T11:17:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.533+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=78M6OXQVPFVS type=del size=80006 2024-09-14T11:17:13.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.534+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=1UCFC2CNDCGW type=del 2024-09-14T11:17:13.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.535+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=2ODFOXJ7K383 type=del size=933980 2024-09-14T11:17:13.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.536+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~F1EILMVWAIGZ.0 size=464471 2024-09-14T11:17:13.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.538+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=F1EILMVWAIGZ tag=48M1M1PMOTBX type=write size=1513047 2024-09-14T11:17:13.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.540+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~NCTXOUL2QJ5I.0 size=1048576 2024-09-14T11:17:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.541+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~NCTXOUL2QJ5I.1 size=1048576 2024-09-14T11:17:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.542+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~NCTXOUL2QJ5I.2 size=320015 2024-09-14T11:17:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.542+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=NCTXOUL2QJ5I tag=KS6C02QWCOCM type=write size=3465743 2024-09-14T11:17:13.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.544+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=C1ZPZG93X1ZZ type=del 2024-09-14T11:17:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.545+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=SD2F5NA82VVO type=write size=696545 2024-09-14T11:17:13.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.546+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=32UIE6H9WODK type=del 2024-09-14T11:17:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.547+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=ANCQT7EPLQJW type=del size=207491 2024-09-14T11:17:13.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.549+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~DS15RI5OYVQK.0 size=1048576 2024-09-14T11:17:13.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.549+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~DS15RI5OYVQK.1 size=1048576 2024-09-14T11:17:13.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.550+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~DS15RI5OYVQK.2 size=474363 2024-09-14T11:17:13.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.553+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=DS15RI5OYVQK tag=56MA0VGZ30GH type=write size=3620091 2024-09-14T11:17:13.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.555+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~FVVT8MK4IQJX.0 size=714308 2024-09-14T11:17:13.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.555+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=FVVT8MK4IQJX tag=8NSMEVTC9OMD type=write size=1762884 2024-09-14T11:17:13.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.556+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~Z5OFC394CYX9.0 size=220226 2024-09-14T11:17:13.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.558+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=Z5OFC394CYX9 tag=WC60Z72GU29Q type=write size=1268802 2024-09-14T11:17:13.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.559+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=WCUPXMSNFGGL type=del size=4013115 2024-09-14T11:17:13.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.561+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=SWOZQLIOBJMJ type=write size=312772 2024-09-14T11:17:13.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.562+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=3B4HTW70UOFM type=write size=310312 2024-09-14T11:17:13.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.563+0000 7f185d9f8780 1 < canceled operation key=MPZOX5RU0580 tag=JTMRUAE24SY6 type=del size=1010703 2024-09-14T11:17:13.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.565+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=VNA7JT6KVAZD type=del size=3363343 2024-09-14T11:17:13.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.566+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=UQW6Q8XBT0UZ type=del 2024-09-14T11:17:13.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.567+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=F2RSWEG52TZ5 type=del size=160200 2024-09-14T11:17:13.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.568+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=0X4R5UXW2BSM type=del 2024-09-14T11:17:13.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.569+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=HILCMFSAJ0Z0 type=del size=3072752 2024-09-14T11:17:13.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.571+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~3CMU6S803CTY.0 size=1048576 2024-09-14T11:17:13.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.572+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~3CMU6S803CTY.1 size=569717 2024-09-14T11:17:13.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.574+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=3CMU6S803CTY tag=1DG2LTBLJXE8 type=write size=2666869 2024-09-14T11:17:13.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.575+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=MIO75GNI0T4H type=del size=2688857 2024-09-14T11:17:13.574 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.576+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=YEMN1SH3CYY9 type=del 2024-09-14T11:17:13.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.577+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=V68XNK5QZ3ZE type=del size=2579178 2024-09-14T11:17:13.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.579+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=0QKJSE3YYJCA type=del 2024-09-14T11:17:13.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.581+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~330VKB772SFE.0 size=1048576 2024-09-14T11:17:13.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.582+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~330VKB772SFE.1 size=1048576 2024-09-14T11:17:13.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.583+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~330VKB772SFE.2 size=945285 2024-09-14T11:17:13.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.583+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=330VKB772SFE tag=XV652BIDL6O0 type=write size=4091013 2024-09-14T11:17:13.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.584+0000 7f185d9f8780 1 < canceled operation key=CRZOT1D0U2F3 tag=03W7PY708AEI type=del size=1847488 2024-09-14T11:17:13.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.585+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=3PYNHCU1SYHZ type=del size=2556264 2024-09-14T11:17:13.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.586+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~45D2D37Z6BZC.0 size=1048576 2024-09-14T11:17:13.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.587+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~45D2D37Z6BZC.1 size=152090 2024-09-14T11:17:13.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.589+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=45D2D37Z6BZC tag=HMQ0532PRZ3H type=write size=2249242 2024-09-14T11:17:13.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.590+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=PECK5VQ8YOWH type=del size=2757955 2024-09-14T11:17:13.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.592+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=78M6OXQVPFVS type=del 2024-09-14T11:17:13.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.593+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=L24MYTB4S7MU type=write size=703614 2024-09-14T11:17:13.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.594+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=2ODFOXJ7K383 type=del 2024-09-14T11:17:13.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.596+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=0KLKI945VCVW type=write size=75188 2024-09-14T11:17:13.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.597+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~NCTXOUL2QJ5I.0 size=1048576 2024-09-14T11:17:13.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.598+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~NCTXOUL2QJ5I.1 size=1048576 2024-09-14T11:17:13.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.599+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~NCTXOUL2QJ5I.2 size=320015 2024-09-14T11:17:13.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.601+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=NCTXOUL2QJ5I tag=KS6C02QWCOCM type=write size=3465743 2024-09-14T11:17:13.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.603+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~A94VOMCUHFQ4.0 size=1048576 2024-09-14T11:17:13.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.604+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~A94VOMCUHFQ4.1 size=1048576 2024-09-14T11:17:13.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.605+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~A94VOMCUHFQ4.2 size=783845 2024-09-14T11:17:13.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.605+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=A94VOMCUHFQ4 tag=L2P630ZYDW9Y type=write size=3929573 2024-09-14T11:17:13.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.606+0000 7f185d9f8780 1 < completed write operation key=HLUMY48G90KB tag=SD2F5NA82VVO type=write size=696545 2024-09-14T11:17:13.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.607+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=JSLGEH8BVU3X type=del size=772953 2024-09-14T11:17:13.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.609+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=ANCQT7EPLQJW type=del 2024-09-14T11:17:13.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.610+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=8RIEKHDSZAQA type=del size=2262167 2024-09-14T11:17:13.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.611+0000 7f185d9f8780 1 < canceled part key=_multipart_087PN6V1BP65.2~FVVT8MK4IQJX.0 size=714308 2024-09-14T11:17:13.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.613+0000 7f185d9f8780 1 < canceled multipart upload key=087PN6V1BP65 upload=FVVT8MK4IQJX tag=8NSMEVTC9OMD type=write size=1762884 2024-09-14T11:17:13.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.614+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=YX2KBL1ETVCW type=del size=3274515 2024-09-14T11:17:13.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.615+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=WCUPXMSNFGGL type=del 2024-09-14T11:17:13.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.617+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~021LWZF0ZMUM.0 size=1048576 2024-09-14T11:17:13.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.618+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~021LWZF0ZMUM.1 size=1048576 2024-09-14T11:17:13.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.619+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~021LWZF0ZMUM.2 size=792293 2024-09-14T11:17:13.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.619+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=021LWZF0ZMUM tag=UEBZGG0ZYGPO type=write size=3938021 2024-09-14T11:17:13.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.621+0000 7f185d9f8780 1 < suggested remove operation key=JL2IH8NEX1YF tag=3B4HTW70UOFM type=write 2024-09-14T11:17:13.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.622+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=2GBKS4EDWIR4 type=del size=1065554 2024-09-14T11:17:13.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.624+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=VNA7JT6KVAZD type=del 2024-09-14T11:17:13.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.625+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=0CEH19UU4N0B type=del size=1383075 2024-09-14T11:17:13.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.628+0000 7f185d9f8780 1 < suggested remove operation key=U5S6L8GPSMU5 tag=F2RSWEG52TZ5 type=del 2024-09-14T11:17:13.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.629+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=SBWE5A9KTHOP type=write size=613845 2024-09-14T11:17:13.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.630+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=HILCMFSAJ0Z0 type=del 2024-09-14T11:17:13.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.631+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=3SK5GV0EGNK9 type=del size=2472487 2024-09-14T11:17:13.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.634+0000 7f185d9f8780 1 < suggested update operation key=M4FJDW1QHGBM tag=MIO75GNI0T4H type=del size=2688857 2024-09-14T11:17:13.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.636+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~R8LRUXFSCCHD.0 size=1048576 2024-09-14T11:17:13.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.636+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~R8LRUXFSCCHD.1 size=1048576 2024-09-14T11:17:13.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.637+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~R8LRUXFSCCHD.2 size=533625 2024-09-14T11:17:13.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.637+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=R8LRUXFSCCHD tag=D2EM2YT2X0LN type=write size=3679353 2024-09-14T11:17:13.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.638+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=V68XNK5QZ3ZE type=del 2024-09-14T11:17:13.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.640+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=6AIDOWPZR5DZ type=del size=3280900 2024-09-14T11:17:13.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.641+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~330VKB772SFE.0 size=1048576 2024-09-14T11:17:13.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.641+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~330VKB772SFE.1 size=1048576 2024-09-14T11:17:13.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.641+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~330VKB772SFE.2 size=945285 2024-09-14T11:17:13.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.643+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=330VKB772SFE tag=XV652BIDL6O0 type=write size=4091013 2024-09-14T11:17:13.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.644+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=CHMECL4D9SX9 type=del size=2084041 2024-09-14T11:17:13.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.645+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=3PYNHCU1SYHZ type=del 2024-09-14T11:17:13.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.646+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=Z8ASR38FJG3G type=del size=899923 2024-09-14T11:17:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.648+0000 7f185d9f8780 1 < canceled operation key=CVVKY636WXG9 tag=PECK5VQ8YOWH type=del size=2757955 2024-09-14T11:17:13.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.649+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=0M3ONTF6Z32G type=del size=2486578 2024-09-14T11:17:13.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.650+0000 7f185d9f8780 1 < completed write operation key=XPMGVU0U52GS tag=L24MYTB4S7MU type=write size=703614 2024-09-14T11:17:13.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.651+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=OEVM9W90HCFY type=del size=2683536 2024-09-14T11:17:13.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.651+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=LGLAG80GX8GF tag=0KLKI945VCVW type=write size=75188: (2) No such file or directory 2024-09-14T11:17:13.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.654+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~PWU3PN396EUF.0 size=827311 2024-09-14T11:17:13.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.654+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=PWU3PN396EUF tag=4VV4SENGEQMM type=write size=1875887 2024-09-14T11:17:13.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.655+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~A94VOMCUHFQ4.0 size=1048576 2024-09-14T11:17:13.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.656+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~A94VOMCUHFQ4.1 size=1048576 2024-09-14T11:17:13.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.657+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~A94VOMCUHFQ4.2 size=783845 2024-09-14T11:17:13.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.659+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=A94VOMCUHFQ4 tag=L2P630ZYDW9Y type=write size=3929573 2024-09-14T11:17:13.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.660+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=EIMVJQGTKTEA type=write size=567633 2024-09-14T11:17:13.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.663+0000 7f185d9f8780 1 < suggested update operation key=1BOZ331NA7JA tag=JSLGEH8BVU3X type=del size=772953 2024-09-14T11:17:13.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.664+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=D74UR78ANOUD type=del size=2954194 2024-09-14T11:17:13.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.667+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=8RIEKHDSZAQA type=del 2024-09-14T11:17:13.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.668+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=4A8QP9Y10C3Q type=del size=1859409 2024-09-14T11:17:13.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.670+0000 7f185d9f8780 1 < suggested remove operation key=6B0SURI3Q8R6 tag=YX2KBL1ETVCW type=del 2024-09-14T11:17:13.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.672+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~6AH0D7UMBAYP.0 size=4578 2024-09-14T11:17:13.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.672+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=6AH0D7UMBAYP tag=AC5HR7GOL9FW type=write size=1053154 2024-09-14T11:17:13.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.674+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~021LWZF0ZMUM.0 size=1048576 2024-09-14T11:17:13.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.675+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~021LWZF0ZMUM.1 size=1048576 2024-09-14T11:17:13.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.676+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~021LWZF0ZMUM.2 size=792293 2024-09-14T11:17:13.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.678+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=021LWZF0ZMUM tag=UEBZGG0ZYGPO type=write size=3938021 2024-09-14T11:17:13.678 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.680+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~KGLS5UTW4U3Q.0 size=705597 2024-09-14T11:17:13.678 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.680+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=KGLS5UTW4U3Q tag=TKEYJ1VOTX7Z type=write size=1754173 2024-09-14T11:17:13.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.681+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=2GBKS4EDWIR4 type=del 2024-09-14T11:17:13.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.682+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=K7F44YDI6ZAB type=del size=877212 2024-09-14T11:17:13.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.684+0000 7f185d9f8780 1 < suggested remove operation key=JL2IH8NEX1YF tag=0CEH19UU4N0B type=del 2024-09-14T11:17:13.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.686+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=QBDGTFAMVAW0 type=del size=249140 2024-09-14T11:17:13.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.687+0000 7f185d9f8780 1 < completed write operation key=N040R6OERAJP tag=SBWE5A9KTHOP type=write size=613845 2024-09-14T11:17:13.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.688+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=M4724BTMP16W type=del size=3425541 2024-09-14T11:17:13.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.689+0000 7f185d9f8780 -1 < failed to complete operation key=M4FJDW1QHGBM tag=3SK5GV0EGNK9 type=del size=2472487: (22) Invalid argument 2024-09-14T11:17:13.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.691+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~OF29PZN10RIL.0 size=692960 2024-09-14T11:17:13.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.691+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=OF29PZN10RIL tag=E7I7EANE8GIK type=write size=1741536 2024-09-14T11:17:13.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.692+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~R8LRUXFSCCHD.0 size=1048576 2024-09-14T11:17:13.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.693+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~R8LRUXFSCCHD.1 size=1048576 2024-09-14T11:17:13.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.694+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~R8LRUXFSCCHD.2 size=533625 2024-09-14T11:17:13.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.696+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=R8LRUXFSCCHD tag=D2EM2YT2X0LN type=write size=3679353 2024-09-14T11:17:13.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.698+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~32DZTYF3NNXP.0 size=1048576 2024-09-14T11:17:13.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.699+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~32DZTYF3NNXP.1 size=683899 2024-09-14T11:17:13.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.699+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=32DZTYF3NNXP tag=NPX6WF1DAM27 type=write size=2781051 2024-09-14T11:17:13.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.702+0000 7f185d9f8780 1 < suggested update operation key=P30WF4R3UFPX tag=6AIDOWPZR5DZ type=del size=3280900 2024-09-14T11:17:13.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.703+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=H6WV67EH9BJT type=del size=2505328 2024-09-14T11:17:13.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.704+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=CHMECL4D9SX9 type=del 2024-09-14T11:17:13.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.705+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=EWK3265B47YO type=del size=3776037 2024-09-14T11:17:13.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.707+0000 7f185d9f8780 1 < completed delete operation key=6MZGLP5KPPB3 tag=Z8ASR38FJG3G type=del 2024-09-14T11:17:13.706 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.708+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=ICQ1M6G27PGO type=del size=1904902 2024-09-14T11:17:13.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.710+0000 7f185d9f8780 1 < suggested remove operation key=1BOZ331NA7JA tag=0M3ONTF6Z32G type=del 2024-09-14T11:17:13.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.711+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=W7AJAMY02QX6 type=del size=701301 2024-09-14T11:17:13.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.713+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=OEVM9W90HCFY type=del 2024-09-14T11:17:13.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.715+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~HBBML5LJND3D.0 size=1048576 2024-09-14T11:17:13.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.716+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~HBBML5LJND3D.1 size=901565 2024-09-14T11:17:13.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.716+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=HBBML5LJND3D tag=QID4P739XEYT type=write size=2998717 2024-09-14T11:17:13.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.717+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~PWU3PN396EUF.0 size=827311 2024-09-14T11:17:13.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.719+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=PWU3PN396EUF tag=4VV4SENGEQMM type=write size=1875887 2024-09-14T11:17:13.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.721+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~JRBP4885CJCY.0 size=1048576 2024-09-14T11:17:13.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.722+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~JRBP4885CJCY.1 size=240680 2024-09-14T11:17:13.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.722+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=JRBP4885CJCY tag=R6DVA0KYUECR type=write size=2337832 2024-09-14T11:17:13.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.723+0000 7f185d9f8780 -1 < failed to complete operation key=P30WF4R3UFPX tag=EIMVJQGTKTEA type=write size=567633: (22) Invalid argument 2024-09-14T11:17:13.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.725+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=A79770SP2V7Z type=write size=1047743 2024-09-14T11:17:13.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.727+0000 7f185d9f8780 1 < suggested remove operation key=SEI774TP8YMJ tag=D74UR78ANOUD type=del 2024-09-14T11:17:13.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.729+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~214PZC9A5RYW.0 size=858489 2024-09-14T11:17:13.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.729+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=214PZC9A5RYW tag=NTFXP97VWV98 type=write size=1907065 2024-09-14T11:17:13.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.731+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=4A8QP9Y10C3Q type=del 2024-09-14T11:17:13.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.732+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=74CLAI1AS06S type=del size=1359759 2024-09-14T11:17:13.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.732+0000 7f185d9f8780 1 < canceled part key=_multipart_SEI774TP8YMJ.2~6AH0D7UMBAYP.0 size=4578 2024-09-14T11:17:13.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.734+0000 7f185d9f8780 1 < canceled multipart upload key=SEI774TP8YMJ upload=6AH0D7UMBAYP tag=AC5HR7GOL9FW type=write size=1053154 2024-09-14T11:17:13.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.735+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=RZ4R6ZEGAV6T type=del size=1927509 2024-09-14T11:17:13.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.737+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~KGLS5UTW4U3Q.0 size=705597 2024-09-14T11:17:13.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.739+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=KGLS5UTW4U3Q tag=TKEYJ1VOTX7Z type=write size=1754173 2024-09-14T11:17:13.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.740+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=GBN8ALHGQH3D type=del size=2004820 2024-09-14T11:17:13.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.741+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=K7F44YDI6ZAB type=del 2024-09-14T11:17:13.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.742+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=0V24GH5YK5DR type=write size=858707 2024-09-14T11:17:13.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.745+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=QBDGTFAMVAW0 type=del 2024-09-14T11:17:13.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.746+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=H3JPH81ECZ37 type=del size=3368606 2024-09-14T11:17:13.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.747+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=M4724BTMP16W type=del 2024-09-14T11:17:13.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.748+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=XOCAA241M5ZW type=del size=3393483 2024-09-14T11:17:13.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.749+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~OF29PZN10RIL.0 size=692960 2024-09-14T11:17:13.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.751+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=OF29PZN10RIL tag=E7I7EANE8GIK type=write size=1741536 2024-09-14T11:17:13.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.753+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~Z87RRF35KIYL.0 size=814109 2024-09-14T11:17:13.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.753+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=Z87RRF35KIYL tag=GA9CSN87Z8XH type=write size=1862685 2024-09-14T11:17:13.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.755+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~32DZTYF3NNXP.0 size=1048576 2024-09-14T11:17:13.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.756+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~32DZTYF3NNXP.1 size=683899 2024-09-14T11:17:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.758+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=32DZTYF3NNXP tag=NPX6WF1DAM27 type=write size=2781051 2024-09-14T11:17:13.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.760+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~NF6EROPTQSUU.0 size=1048576 2024-09-14T11:17:13.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.761+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~NF6EROPTQSUU.1 size=1048576 2024-09-14T11:17:13.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.762+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~NF6EROPTQSUU.2 size=940997 2024-09-14T11:17:13.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.762+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=NF6EROPTQSUU tag=1DNTEKSDSYZI type=write size=4086725 2024-09-14T11:17:13.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.763+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=H6WV67EH9BJT type=del 2024-09-14T11:17:13.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.764+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=R29864JZVYV0 type=del size=932877 2024-09-14T11:17:13.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.765+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=EWK3265B47YO type=del 2024-09-14T11:17:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.766+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=IZITD23REMBW type=del size=3891208 2024-09-14T11:17:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.768+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=ICQ1M6G27PGO type=del size=1904902 2024-09-14T11:17:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.770+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~0BVUFPQNCWXI.0 size=1048576 2024-09-14T11:17:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.771+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~0BVUFPQNCWXI.1 size=1048576 2024-09-14T11:17:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.772+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~0BVUFPQNCWXI.2 size=1035325 2024-09-14T11:17:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.772+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=0BVUFPQNCWXI tag=UH92LKIFJ8RS type=write size=4181053 2024-09-14T11:17:13.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.774+0000 7f185d9f8780 1 < suggested update operation key=6MZGLP5KPPB3 tag=W7AJAMY02QX6 type=del size=701301 2024-09-14T11:17:13.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.776+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~VHR6STWBB9U4.0 size=1048576 2024-09-14T11:17:13.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.777+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~VHR6STWBB9U4.1 size=1048576 2024-09-14T11:17:13.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.780+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~VHR6STWBB9U4.2 size=614506 2024-09-14T11:17:13.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.780+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=VHR6STWBB9U4 tag=VL5Y9N5O99QO type=write size=3760234 2024-09-14T11:17:13.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.781+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~HBBML5LJND3D.0 size=1048576 2024-09-14T11:17:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.782+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~HBBML5LJND3D.1 size=901565 2024-09-14T11:17:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.784+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=HBBML5LJND3D tag=QID4P739XEYT type=write size=2998717 2024-09-14T11:17:13.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.786+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=6C29QOW43HUU type=del size=3898030 2024-09-14T11:17:13.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.787+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~JRBP4885CJCY.0 size=1048576 2024-09-14T11:17:13.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.788+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~JRBP4885CJCY.1 size=240680 2024-09-14T11:17:13.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.790+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=JRBP4885CJCY tag=R6DVA0KYUECR type=write size=2337832 2024-09-14T11:17:13.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.792+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~P4HFUP6S8ALU.0 size=611307 2024-09-14T11:17:13.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.792+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=P4HFUP6S8ALU tag=MTVB8WTX3AEC type=write size=1659883 2024-09-14T11:17:13.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.793+0000 7f185d9f8780 -1 < failed to complete operation key=6MZGLP5KPPB3 tag=A79770SP2V7Z type=write size=1047743: (22) Invalid argument 2024-09-14T11:17:13.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.795+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~FM908PWJ1OZS.0 size=1048576 2024-09-14T11:17:13.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.796+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~FM908PWJ1OZS.1 size=32600 2024-09-14T11:17:13.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.796+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=FM908PWJ1OZS tag=E9Q03SX2J9M0 type=write size=2129752 2024-09-14T11:17:13.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.798+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~214PZC9A5RYW.0 size=858489 2024-09-14T11:17:13.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.800+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=214PZC9A5RYW tag=NTFXP97VWV98 type=write size=1907065 2024-09-14T11:17:13.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.802+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~EAV6WQZS5YAE.0 size=1048576 2024-09-14T11:17:13.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.804+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~EAV6WQZS5YAE.1 size=65524 2024-09-14T11:17:13.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.804+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=EAV6WQZS5YAE tag=HY0SJODLBRDS type=write size=2162676 2024-09-14T11:17:13.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.806+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=74CLAI1AS06S type=del size=1359759 2024-09-14T11:17:13.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.807+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=YMVUXCVMS6OF type=del size=1597718 2024-09-14T11:17:13.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.808+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=RZ4R6ZEGAV6T type=del 2024-09-14T11:17:13.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.810+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~6FKUPOF15U78.0 size=726148 2024-09-14T11:17:13.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.810+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=6FKUPOF15U78 tag=0PS0Y6N8XTGI type=write size=1774724 2024-09-14T11:17:13.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.812+0000 7f185d9f8780 -1 < failed to complete operation key=CJ6C03RXS0IW tag=GBN8ALHGQH3D type=del size=2004820: (22) Invalid argument 2024-09-14T11:17:13.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.814+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~ZM59BSJ5QTQZ.0 size=398379 2024-09-14T11:17:13.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.814+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=ZM59BSJ5QTQZ tag=4LBQ7PGGGNOA type=write size=1446955 2024-09-14T11:17:13.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.815+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=0V24GH5YK5DR type=write size=858707 2024-09-14T11:17:13.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.816+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=RALSFE6DSIXN type=del size=520824 2024-09-14T11:17:13.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.817+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=H3JPH81ECZ37 type=del 2024-09-14T11:17:13.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.819+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=DCEQOFVW9STD type=del size=1862737 2024-09-14T11:17:13.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.820+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=XOCAA241M5ZW type=del 2024-09-14T11:17:13.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.823+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2NZGQ8PP5EAP.0 size=1048576 2024-09-14T11:17:13.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.824+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2NZGQ8PP5EAP.1 size=1048576 2024-09-14T11:17:13.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.825+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2NZGQ8PP5EAP.2 size=54290 2024-09-14T11:17:13.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.825+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=2NZGQ8PP5EAP tag=KGDLLM7BLFIH type=write size=3200018 2024-09-14T11:17:13.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.826+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~Z87RRF35KIYL.0 size=814109 2024-09-14T11:17:13.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.828+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=Z87RRF35KIYL tag=GA9CSN87Z8XH type=write size=1862685 2024-09-14T11:17:13.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.830+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=SJBZ2CRCDGIP type=del size=2179935 2024-09-14T11:17:13.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.831+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~NF6EROPTQSUU.0 size=1048576 2024-09-14T11:17:13.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.832+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~NF6EROPTQSUU.1 size=1048576 2024-09-14T11:17:13.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.833+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~NF6EROPTQSUU.2 size=940997 2024-09-14T11:17:13.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.835+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=NF6EROPTQSUU tag=1DNTEKSDSYZI type=write size=4086725 2024-09-14T11:17:13.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.837+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~1MJQTRZSZZZQ.0 size=363229 2024-09-14T11:17:13.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.837+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=1MJQTRZSZZZQ tag=Q8XWH9AA5KYC type=write size=1411805 2024-09-14T11:17:13.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.839+0000 7f185d9f8780 1 < suggested update operation key=M4FJDW1QHGBM tag=R29864JZVYV0 type=del size=932877 2024-09-14T11:17:13.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.841+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=B7ZSGSGBDFDR type=del size=3686841 2024-09-14T11:17:13.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.842+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=IZITD23REMBW type=del 2024-09-14T11:17:13.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.843+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=OQ6I2HLXUMA1 type=write size=247907 2024-09-14T11:17:13.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.845+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~0BVUFPQNCWXI.0 size=1048576 2024-09-14T11:17:13.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.846+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~0BVUFPQNCWXI.1 size=1048576 2024-09-14T11:17:13.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.847+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~0BVUFPQNCWXI.2 size=1035325 2024-09-14T11:17:13.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.849+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=0BVUFPQNCWXI tag=UH92LKIFJ8RS type=write size=4181053 2024-09-14T11:17:13.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.850+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=N6KW5PEGHV79 type=del size=193327 2024-09-14T11:17:13.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.851+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~VHR6STWBB9U4.0 size=1048576 2024-09-14T11:17:13.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.852+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~VHR6STWBB9U4.1 size=1048576 2024-09-14T11:17:13.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.853+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~VHR6STWBB9U4.2 size=614506 2024-09-14T11:17:13.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.855+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=VHR6STWBB9U4 tag=VL5Y9N5O99QO type=write size=3760234 2024-09-14T11:17:13.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.857+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~00BNEVUII6H1.0 size=1048576 2024-09-14T11:17:13.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.858+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~00BNEVUII6H1.1 size=814351 2024-09-14T11:17:13.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.858+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=00BNEVUII6H1 tag=TIXU9FYEZQR3 type=write size=2911503 2024-09-14T11:17:13.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.859+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=6C29QOW43HUU type=del 2024-09-14T11:17:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.862+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~U8AFAXAWRB9Q.0 size=1048576 2024-09-14T11:17:13.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.862+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~U8AFAXAWRB9Q.1 size=880601 2024-09-14T11:17:13.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.862+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=U8AFAXAWRB9Q tag=CKI40I02THOX type=write size=2977753 2024-09-14T11:17:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.864+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~P4HFUP6S8ALU.0 size=611307 2024-09-14T11:17:13.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.866+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=P4HFUP6S8ALU tag=MTVB8WTX3AEC type=write size=1659883 2024-09-14T11:17:13.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.866+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=C2C4M09MTF77 type=del size=2700455 2024-09-14T11:17:13.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.867+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~FM908PWJ1OZS.0 size=1048576 2024-09-14T11:17:13.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.868+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~FM908PWJ1OZS.1 size=32600 2024-09-14T11:17:13.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.870+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=FM908PWJ1OZS tag=E9Q03SX2J9M0 type=write size=2129752 2024-09-14T11:17:13.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.872+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~S42B8E594IN8.0 size=1048576 2024-09-14T11:17:13.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.873+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~S42B8E594IN8.1 size=1048576 2024-09-14T11:17:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.874+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~S42B8E594IN8.2 size=94562 2024-09-14T11:17:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.874+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=S42B8E594IN8 tag=5R29DQL37JPY type=write size=3240290 2024-09-14T11:17:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.875+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~EAV6WQZS5YAE.0 size=1048576 2024-09-14T11:17:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.876+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~EAV6WQZS5YAE.1 size=65524 2024-09-14T11:17:13.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.878+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=EAV6WQZS5YAE tag=HY0SJODLBRDS type=write size=2162676 2024-09-14T11:17:13.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.879+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=JYEZDAUDQBCI type=del size=2999784 2024-09-14T11:17:13.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.881+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=YMVUXCVMS6OF type=del 2024-09-14T11:17:13.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.882+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=UZQC0O7YNVWT type=del size=3884293 2024-09-14T11:17:13.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.884+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~6FKUPOF15U78.0 size=726148 2024-09-14T11:17:13.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.886+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=6FKUPOF15U78 tag=0PS0Y6N8XTGI type=write size=1774724 2024-09-14T11:17:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.888+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~URP5PQNZ4AWH.0 size=1048576 2024-09-14T11:17:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.889+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~URP5PQNZ4AWH.1 size=279509 2024-09-14T11:17:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.889+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=URP5PQNZ4AWH tag=N6CBJHZ685V1 type=write size=2376661 2024-09-14T11:17:13.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.890+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~ZM59BSJ5QTQZ.0 size=398379 2024-09-14T11:17:13.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.894+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=ZM59BSJ5QTQZ tag=4LBQ7PGGGNOA type=write size=1446955 2024-09-14T11:17:13.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.896+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~VH0ZV9713MP8.0 size=22660 2024-09-14T11:17:13.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.896+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=VH0ZV9713MP8 tag=BS405UBHM8V0 type=write size=1071236 2024-09-14T11:17:13.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.898+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=RALSFE6DSIXN type=del size=520824 2024-09-14T11:17:13.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.900+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~601UX6RNNHZD.0 size=1048576 2024-09-14T11:17:13.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.901+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~601UX6RNNHZD.1 size=659191 2024-09-14T11:17:13.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.901+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=601UX6RNNHZD tag=RLSNLQBDU4RE type=write size=2756343 2024-09-14T11:17:13.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.902+0000 7f185d9f8780 -1 < failed to complete operation key=M4FJDW1QHGBM tag=DCEQOFVW9STD type=del size=1862737: (22) Invalid argument 2024-09-14T11:17:13.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.904+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~IBBH080K8WG3.0 size=1048576 2024-09-14T11:17:13.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.905+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~IBBH080K8WG3.1 size=1048576 2024-09-14T11:17:13.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.906+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~IBBH080K8WG3.2 size=1029063 2024-09-14T11:17:13.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.906+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=IBBH080K8WG3 tag=418O0069BP24 type=write size=4174791 2024-09-14T11:17:13.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.907+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2NZGQ8PP5EAP.0 size=1048576 2024-09-14T11:17:13.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.908+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2NZGQ8PP5EAP.1 size=1048576 2024-09-14T11:17:13.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.908+0000 7f185d9f8780 1 < canceled part key=_multipart_CRZOT1D0U2F3.2~2NZGQ8PP5EAP.2 size=54290 2024-09-14T11:17:13.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.910+0000 7f185d9f8780 1 < canceled multipart upload key=CRZOT1D0U2F3 upload=2NZGQ8PP5EAP tag=KGDLLM7BLFIH type=write size=3200018 2024-09-14T11:17:13.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.912+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~BXPJJR9JK8S2.0 size=746360 2024-09-14T11:17:13.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.912+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=BXPJJR9JK8S2 tag=O71NV6T9ZHVZ type=write size=1794936 2024-09-14T11:17:13.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.914+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=SJBZ2CRCDGIP type=del 2024-09-14T11:17:13.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.916+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~7KN6VNVAXMXT.0 size=1048576 2024-09-14T11:17:13.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.917+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~7KN6VNVAXMXT.1 size=1048576 2024-09-14T11:17:13.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.918+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~7KN6VNVAXMXT.2 size=417403 2024-09-14T11:17:13.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.918+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=7KN6VNVAXMXT tag=STUV28X8A02F type=write size=3563131 2024-09-14T11:17:13.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.919+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~1MJQTRZSZZZQ.0 size=363229 2024-09-14T11:17:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.921+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=1MJQTRZSZZZQ tag=Q8XWH9AA5KYC type=write size=1411805 2024-09-14T11:17:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.922+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=OT97JWIAES1A type=del size=3083598 2024-09-14T11:17:13.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.925+0000 7f185d9f8780 1 < suggested update operation key=H29SXBS4N9JK tag=B7ZSGSGBDFDR type=del size=3686841 2024-09-14T11:17:13.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.926+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=9XT6F25TW1AV type=del size=1410060 2024-09-14T11:17:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.929+0000 7f185d9f8780 1 < suggested remove operation key=H29SXBS4N9JK tag=OQ6I2HLXUMA1 type=write 2024-09-14T11:17:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.931+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~N62SYS2TI2P7.0 size=868966 2024-09-14T11:17:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.931+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=N62SYS2TI2P7 tag=WKDVDR2RIROE type=write size=1917542 2024-09-14T11:17:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.932+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=N6KW5PEGHV79 type=del 2024-09-14T11:17:13.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.935+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~YXZO0ZEPFTCA.0 size=1048576 2024-09-14T11:17:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.936+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~YXZO0ZEPFTCA.1 size=1048576 2024-09-14T11:17:13.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.937+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~YXZO0ZEPFTCA.2 size=528001 2024-09-14T11:17:13.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.937+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=YXZO0ZEPFTCA tag=MUG50C2YKK07 type=write size=3673729 2024-09-14T11:17:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.938+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~00BNEVUII6H1.0 size=1048576 2024-09-14T11:17:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.939+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~00BNEVUII6H1.1 size=814351 2024-09-14T11:17:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.941+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=00BNEVUII6H1 tag=TIXU9FYEZQR3 type=write size=2911503 2024-09-14T11:17:13.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.942+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=6R50CZT44CIP type=del size=1535506 2024-09-14T11:17:13.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.943+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~U8AFAXAWRB9Q.0 size=1048576 2024-09-14T11:17:13.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.944+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~U8AFAXAWRB9Q.1 size=880601 2024-09-14T11:17:13.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.946+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=U8AFAXAWRB9Q tag=CKI40I02THOX type=write size=2977753 2024-09-14T11:17:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.948+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~FV8DEQFFWCXI.0 size=1048576 2024-09-14T11:17:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.949+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~FV8DEQFFWCXI.1 size=1019097 2024-09-14T11:17:13.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.949+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=FV8DEQFFWCXI tag=FB6Y12YUNA6B type=write size=3116249 2024-09-14T11:17:13.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.951+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=C2C4M09MTF77 type=del 2024-09-14T11:17:13.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.952+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=KSS8ATQY9ECB type=del size=2918634 2024-09-14T11:17:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.953+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~S42B8E594IN8.0 size=1048576 2024-09-14T11:17:13.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.954+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~S42B8E594IN8.1 size=1048576 2024-09-14T11:17:13.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.955+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~S42B8E594IN8.2 size=94562 2024-09-14T11:17:13.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.957+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=S42B8E594IN8 tag=5R29DQL37JPY type=write size=3240290 2024-09-14T11:17:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.958+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=S6NXD4VLDVIA type=del size=220233 2024-09-14T11:17:13.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.959+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=JYEZDAUDQBCI type=del 2024-09-14T11:17:13.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.960+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=3DZ6ZKV8Z6OB type=del size=3348722 2024-09-14T11:17:13.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.961+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=UZQC0O7YNVWT type=del 2024-09-14T11:17:13.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.964+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~RA3WPPAEXRNP.0 size=1048576 2024-09-14T11:17:13.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.964+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~RA3WPPAEXRNP.1 size=1048576 2024-09-14T11:17:13.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.965+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~RA3WPPAEXRNP.2 size=547336 2024-09-14T11:17:13.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.965+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=RA3WPPAEXRNP tag=KTD07WTDUKTL type=write size=3693064 2024-09-14T11:17:13.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.967+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~URP5PQNZ4AWH.0 size=1048576 2024-09-14T11:17:13.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.967+0000 7f185d9f8780 1 < canceled part key=_multipart_O2Y34FSQHS1S.2~URP5PQNZ4AWH.1 size=279509 2024-09-14T11:17:13.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.969+0000 7f185d9f8780 1 < canceled multipart upload key=O2Y34FSQHS1S upload=URP5PQNZ4AWH tag=N6CBJHZ685V1 type=write size=2376661 2024-09-14T11:17:13.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.970+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=X4WAIAOWX5HN type=del size=3055044 2024-09-14T11:17:13.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.971+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~VH0ZV9713MP8.0 size=22660 2024-09-14T11:17:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.973+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=VH0ZV9713MP8 tag=BS405UBHM8V0 type=write size=1071236 2024-09-14T11:17:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.975+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~EYXU119STBTM.0 size=1048576 2024-09-14T11:17:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.976+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~EYXU119STBTM.1 size=729999 2024-09-14T11:17:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.976+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=EYXU119STBTM tag=EKFGAAL1QP7A type=write size=2827151 2024-09-14T11:17:13.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.977+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~601UX6RNNHZD.0 size=1048576 2024-09-14T11:17:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.978+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~601UX6RNNHZD.1 size=659191 2024-09-14T11:17:13.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.980+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=601UX6RNNHZD tag=RLSNLQBDU4RE type=write size=2756343 2024-09-14T11:17:13.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.981+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=HRAB86RIZXZD type=del size=364959 2024-09-14T11:17:13.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.983+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~IBBH080K8WG3.0 size=1048576 2024-09-14T11:17:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.984+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~IBBH080K8WG3.1 size=1048576 2024-09-14T11:17:13.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.985+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~IBBH080K8WG3.2 size=1029063 2024-09-14T11:17:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.987+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=IBBH080K8WG3 tag=418O0069BP24 type=write size=4174791 2024-09-14T11:17:13.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.988+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=2DZUN5Y60V1A type=write size=469777 2024-09-14T11:17:13.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.989+0000 7f185d9f8780 1 < completed part key=_multipart_W24KN3J819EB.2~BXPJJR9JK8S2.0 size=746360 2024-09-14T11:17:13.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.991+0000 7f185d9f8780 1 < completed multipart upload key=W24KN3J819EB upload=BXPJJR9JK8S2 tag=O71NV6T9ZHVZ type=write size=1794936 2024-09-14T11:17:13.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.992+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=MNYRU7XLJW6X type=del size=1170952 2024-09-14T11:17:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.993+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~7KN6VNVAXMXT.0 size=1048576 2024-09-14T11:17:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.994+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~7KN6VNVAXMXT.1 size=1048576 2024-09-14T11:17:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.995+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~7KN6VNVAXMXT.2 size=417403 2024-09-14T11:17:13.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:13.997+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=7KN6VNVAXMXT tag=STUV28X8A02F type=write size=3563131 2024-09-14T11:17:13.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.000+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~Y45HX7YD6E4W.0 size=1048576 2024-09-14T11:17:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.002+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~Y45HX7YD6E4W.1 size=1023261 2024-09-14T11:17:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.002+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=Y45HX7YD6E4W tag=K7KSOTLTBS30 type=write size=3120413 2024-09-14T11:17:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.003+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=OT97JWIAES1A type=del 2024-09-14T11:17:14.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.004+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=9EBB6JEAP0XB type=del size=2566070 2024-09-14T11:17:14.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.006+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=9XT6F25TW1AV type=del 2024-09-14T11:17:14.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.007+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=Y0PSQMSG0E0W type=del size=3342145 2024-09-14T11:17:14.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.008+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~N62SYS2TI2P7.0 size=868966 2024-09-14T11:17:14.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.010+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=N62SYS2TI2P7 tag=WKDVDR2RIROE type=write size=1917542 2024-09-14T11:17:14.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.011+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=OX4KKVDS6SAP type=del size=1530886 2024-09-14T11:17:14.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.012+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~YXZO0ZEPFTCA.0 size=1048576 2024-09-14T11:17:14.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.013+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~YXZO0ZEPFTCA.1 size=1048576 2024-09-14T11:17:14.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.014+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~YXZO0ZEPFTCA.2 size=528001 2024-09-14T11:17:14.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.016+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=YXZO0ZEPFTCA tag=MUG50C2YKK07 type=write size=3673729 2024-09-14T11:17:14.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.018+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=Y9FMQMQ742S5 type=del size=204254 2024-09-14T11:17:14.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.019+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=6R50CZT44CIP type=del 2024-09-14T11:17:14.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.020+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=9CXN902E2ZSL type=del size=863375 2024-09-14T11:17:14.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.021+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~FV8DEQFFWCXI.0 size=1048576 2024-09-14T11:17:14.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.021+0000 7f185d9f8780 1 < canceled part key=_multipart_WPBYTFP7HRVE.2~FV8DEQFFWCXI.1 size=1019097 2024-09-14T11:17:14.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.023+0000 7f185d9f8780 1 < canceled multipart upload key=WPBYTFP7HRVE upload=FV8DEQFFWCXI tag=FB6Y12YUNA6B type=write size=3116249 2024-09-14T11:17:14.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.024+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=S6YK95WBEMG9 type=write size=838079 2024-09-14T11:17:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.026+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=KSS8ATQY9ECB type=del 2024-09-14T11:17:14.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.028+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~3ZF78GW0XZ2W.0 size=1048576 2024-09-14T11:17:14.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.029+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~3ZF78GW0XZ2W.1 size=1006918 2024-09-14T11:17:14.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.029+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=3ZF78GW0XZ2W tag=8PJGW5HS1U3I type=write size=3104070 2024-09-14T11:17:14.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.030+0000 7f185d9f8780 1 < canceled operation key=1BOZ331NA7JA tag=S6NXD4VLDVIA type=del size=220233 2024-09-14T11:17:14.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.031+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=7ONH2EB1ZDN7 type=write size=999055 2024-09-14T11:17:14.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.032+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=3DZ6ZKV8Z6OB type=del 2024-09-14T11:17:14.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.034+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=G8E9KYGC89PB type=write size=628956 2024-09-14T11:17:14.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.035+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~RA3WPPAEXRNP.0 size=1048576 2024-09-14T11:17:14.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.036+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~RA3WPPAEXRNP.1 size=1048576 2024-09-14T11:17:14.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.037+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~RA3WPPAEXRNP.2 size=547336 2024-09-14T11:17:14.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.039+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=RA3WPPAEXRNP tag=KTD07WTDUKTL type=write size=3693064 2024-09-14T11:17:14.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.041+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~IKG8XG7ZQ40K.0 size=1048576 2024-09-14T11:17:14.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.042+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~IKG8XG7ZQ40K.1 size=1048576 2024-09-14T11:17:14.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.043+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~IKG8XG7ZQ40K.2 size=311744 2024-09-14T11:17:14.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.043+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=IKG8XG7ZQ40K tag=4W1L4M12FEK6 type=write size=3457472 2024-09-14T11:17:14.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.044+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=X4WAIAOWX5HN type=del 2024-09-14T11:17:14.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.047+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~5E084CHWTHVS.0 size=1048576 2024-09-14T11:17:14.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.048+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~5E084CHWTHVS.1 size=270160 2024-09-14T11:17:14.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.048+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=5E084CHWTHVS tag=EO2FQKCWEM05 type=write size=2367312 2024-09-14T11:17:14.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.049+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~EYXU119STBTM.0 size=1048576 2024-09-14T11:17:14.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.050+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~EYXU119STBTM.1 size=729999 2024-09-14T11:17:14.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.052+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=EYXU119STBTM tag=EKFGAAL1QP7A type=write size=2827151 2024-09-14T11:17:14.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.053+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=H8VP8U9D6ASG type=del size=395398 2024-09-14T11:17:14.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.054+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=HRAB86RIZXZD type=del 2024-09-14T11:17:14.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.056+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=V926DA9V5K6M type=del size=1317569 2024-09-14T11:17:14.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.057+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=2DZUN5Y60V1A type=write size=469777 2024-09-14T11:17:14.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.058+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=MQDS0JUDK32Y type=del size=4171728 2024-09-14T11:17:14.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.059+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=MNYRU7XLJW6X type=del 2024-09-14T11:17:14.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.061+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~V0J319T8YA20.0 size=1048576 2024-09-14T11:17:14.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.062+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~V0J319T8YA20.1 size=689124 2024-09-14T11:17:14.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.062+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=V0J319T8YA20 tag=6KCDOAE5VETP type=write size=2786276 2024-09-14T11:17:14.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.063+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~Y45HX7YD6E4W.0 size=1048576 2024-09-14T11:17:14.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.064+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~Y45HX7YD6E4W.1 size=1023261 2024-09-14T11:17:14.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.066+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=Y45HX7YD6E4W tag=K7KSOTLTBS30 type=write size=3120413 2024-09-14T11:17:14.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.068+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~6IXS1VS81ZZ7.0 size=738282 2024-09-14T11:17:14.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.068+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=6IXS1VS81ZZ7 tag=AE6047392X4V type=write size=1786858 2024-09-14T11:17:14.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.070+0000 7f185d9f8780 1 < suggested update operation key=PSL63WUBLB75 tag=9EBB6JEAP0XB type=del size=2566070 2024-09-14T11:17:14.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.072+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~EJCPCABDY30D.0 size=1048576 2024-09-14T11:17:14.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.073+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~EJCPCABDY30D.1 size=360213 2024-09-14T11:17:14.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.073+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=EJCPCABDY30D tag=KQLTVS6WZPZ4 type=write size=2457365 2024-09-14T11:17:14.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.074+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=Y0PSQMSG0E0W type=del 2024-09-14T11:17:14.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.076+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=0MZP89FE41LU type=del size=3108359 2024-09-14T11:17:14.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.078+0000 7f185d9f8780 1 < suggested update operation key=CVVKY636WXG9 tag=OX4KKVDS6SAP type=del size=1530886 2024-09-14T11:17:14.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.080+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~K98WMTPPF0JS.0 size=922514 2024-09-14T11:17:14.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.080+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=K98WMTPPF0JS tag=UP6SJ3361PLZ type=write size=1971090 2024-09-14T11:17:14.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.082+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=Y9FMQMQ742S5 type=del 2024-09-14T11:17:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.084+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~YJB24HAH4V9X.0 size=1048576 2024-09-14T11:17:14.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.085+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~YJB24HAH4V9X.1 size=955180 2024-09-14T11:17:14.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.085+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=YJB24HAH4V9X tag=PQ7PS7IGEY7X type=write size=3052332 2024-09-14T11:17:14.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.087+0000 7f185d9f8780 1 < suggested update operation key=L4L83NVMXHXZ tag=9CXN902E2ZSL type=del size=863375 2024-09-14T11:17:14.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.089+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~3B43YWOJE2I7.0 size=1048576 2024-09-14T11:17:14.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.090+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~3B43YWOJE2I7.1 size=1048576 2024-09-14T11:17:14.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.091+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~3B43YWOJE2I7.2 size=1044938 2024-09-14T11:17:14.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.091+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=3B43YWOJE2I7 tag=4OP9N2ONSH1H type=write size=4190666 2024-09-14T11:17:14.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.093+0000 7f185d9f8780 1 < completed write operation key=DAKWA1OCVTBG tag=S6YK95WBEMG9 type=write size=838079 2024-09-14T11:17:14.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.094+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=J47DW6CLE0L3 type=write size=20307 2024-09-14T11:17:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.095+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~3ZF78GW0XZ2W.0 size=1048576 2024-09-14T11:17:14.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.096+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~3ZF78GW0XZ2W.1 size=1006918 2024-09-14T11:17:14.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.098+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=3ZF78GW0XZ2W tag=8PJGW5HS1U3I type=write size=3104070 2024-09-14T11:17:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.099+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=VF990DW9I0KV type=del size=1473806 2024-09-14T11:17:14.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.102+0000 7f185d9f8780 1 < suggested update operation key=SEI774TP8YMJ tag=7ONH2EB1ZDN7 type=write size=999055 2024-09-14T11:17:14.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.103+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=Y05XLWU1OKTX type=del size=527008 2024-09-14T11:17:14.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.104+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=G8E9KYGC89PB type=write size=628956 2024-09-14T11:17:14.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.106+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~1Q9AXC6N56RV.0 size=1048576 2024-09-14T11:17:14.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.107+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~1Q9AXC6N56RV.1 size=191238 2024-09-14T11:17:14.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.107+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=1Q9AXC6N56RV tag=H443RF0B3MLV type=write size=2288390 2024-09-14T11:17:14.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.108+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~IKG8XG7ZQ40K.0 size=1048576 2024-09-14T11:17:14.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.109+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~IKG8XG7ZQ40K.1 size=1048576 2024-09-14T11:17:14.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.110+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~IKG8XG7ZQ40K.2 size=311744 2024-09-14T11:17:14.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.112+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=IKG8XG7ZQ40K tag=4W1L4M12FEK6 type=write size=3457472 2024-09-14T11:17:14.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.115+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~90L42846XD7J.0 size=266389 2024-09-14T11:17:14.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.115+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=90L42846XD7J tag=PZF4NY4E08S2 type=write size=1314965 2024-09-14T11:17:14.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.116+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~5E084CHWTHVS.0 size=1048576 2024-09-14T11:17:14.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.117+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~5E084CHWTHVS.1 size=270160 2024-09-14T11:17:14.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.119+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=5E084CHWTHVS tag=EO2FQKCWEM05 type=write size=2367312 2024-09-14T11:17:14.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.121+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~TJE43OGGC3ZQ.0 size=782192 2024-09-14T11:17:14.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.121+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=TJE43OGGC3ZQ tag=X7KTYHNCHGO3 type=write size=1830768 2024-09-14T11:17:14.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.122+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=H8VP8U9D6ASG type=del 2024-09-14T11:17:14.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.123+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=N09EBUEG68ST type=write size=519650 2024-09-14T11:17:14.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.126+0000 7f185d9f8780 1 < suggested remove operation key=P30WF4R3UFPX tag=V926DA9V5K6M type=del 2024-09-14T11:17:14.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.128+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~DT72FEUPYPU8.0 size=1048576 2024-09-14T11:17:14.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.129+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~DT72FEUPYPU8.1 size=1048576 2024-09-14T11:17:14.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.129+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~DT72FEUPYPU8.2 size=475537 2024-09-14T11:17:14.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.129+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=DT72FEUPYPU8 tag=1BO61L2KJS1Y type=write size=3621265 2024-09-14T11:17:14.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.131+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=MQDS0JUDK32Y type=del 2024-09-14T11:17:14.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.132+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=XVAF3YZT1V9J type=del size=2739945 2024-09-14T11:17:14.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.133+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~V0J319T8YA20.0 size=1048576 2024-09-14T11:17:14.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.134+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~V0J319T8YA20.1 size=689124 2024-09-14T11:17:14.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.136+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=V0J319T8YA20 tag=6KCDOAE5VETP type=write size=2786276 2024-09-14T11:17:14.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.137+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=2U4OFC4IAH2Y type=del size=2246238 2024-09-14T11:17:14.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.138+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~6IXS1VS81ZZ7.0 size=738282 2024-09-14T11:17:14.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.141+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=6IXS1VS81ZZ7 tag=AE6047392X4V type=write size=1786858 2024-09-14T11:17:14.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.142+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=7UJTII0G2U0B type=write size=537199 2024-09-14T11:17:14.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.143+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~EJCPCABDY30D.0 size=1048576 2024-09-14T11:17:14.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.144+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~EJCPCABDY30D.1 size=360213 2024-09-14T11:17:14.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.146+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=EJCPCABDY30D tag=KQLTVS6WZPZ4 type=write size=2457365 2024-09-14T11:17:14.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.147+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=H7Z1WBDPCUUH type=del size=129933 2024-09-14T11:17:14.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.149+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=0MZP89FE41LU type=del 2024-09-14T11:17:14.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.150+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=BDHN7LF7H4EL type=del size=3000070 2024-09-14T11:17:14.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.151+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~K98WMTPPF0JS.0 size=922514 2024-09-14T11:17:14.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.153+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=K98WMTPPF0JS tag=UP6SJ3361PLZ type=write size=1971090 2024-09-14T11:17:14.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.154+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=PES22DVRLRJ9 type=del size=2066801 2024-09-14T11:17:14.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.156+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~YJB24HAH4V9X.0 size=1048576 2024-09-14T11:17:14.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.157+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~YJB24HAH4V9X.1 size=955180 2024-09-14T11:17:14.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.159+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=YJB24HAH4V9X tag=PQ7PS7IGEY7X type=write size=3052332 2024-09-14T11:17:14.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.160+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=6JAYO3U2YGDF type=del size=429849 2024-09-14T11:17:14.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.160+0000 7f185d9f8780 1 < canceled part key=_multipart_M4FJDW1QHGBM.2~3B43YWOJE2I7.0 size=1048576 2024-09-14T11:17:14.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.161+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~3B43YWOJE2I7.1 size=1048576 2024-09-14T11:17:14.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.162+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~3B43YWOJE2I7.2 size=1044938 2024-09-14T11:17:14.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.164+0000 7f185d9f8780 1 < canceled multipart upload key=M4FJDW1QHGBM upload=3B43YWOJE2I7 tag=4OP9N2ONSH1H type=write size=4190666 2024-09-14T11:17:14.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.167+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~6UK2FT9KN93U.0 size=1048576 2024-09-14T11:17:14.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.168+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~6UK2FT9KN93U.1 size=386245 2024-09-14T11:17:14.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.168+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=6UK2FT9KN93U tag=ZYED2GKONL1P type=write size=2483397 2024-09-14T11:17:14.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.169+0000 7f185d9f8780 1 < completed write operation key=O2Y34FSQHS1S tag=J47DW6CLE0L3 type=write size=20307 2024-09-14T11:17:14.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.171+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=D7RQUX9LO0FN type=del size=2208211 2024-09-14T11:17:14.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.174+0000 7f185d9f8780 1 < suggested remove operation key=OYZIXCSGXTHR tag=VF990DW9I0KV type=del 2024-09-14T11:17:14.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.175+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=RU8Z3VQNCYVR type=del size=1192534 2024-09-14T11:17:14.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.177+0000 7f185d9f8780 1 < suggested remove operation key=JL2IH8NEX1YF tag=Y05XLWU1OKTX type=del 2024-09-14T11:17:14.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.178+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=2KUNQ0G8J3FK type=del size=1494366 2024-09-14T11:17:14.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.180+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~1Q9AXC6N56RV.0 size=1048576 2024-09-14T11:17:14.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.181+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~1Q9AXC6N56RV.1 size=191238 2024-09-14T11:17:14.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.183+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=1Q9AXC6N56RV tag=H443RF0B3MLV type=write size=2288390 2024-09-14T11:17:14.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.184+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=AKMY6UQC1XFH type=del size=2036251 2024-09-14T11:17:14.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.185+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~90L42846XD7J.0 size=266389 2024-09-14T11:17:14.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.187+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=90L42846XD7J tag=PZF4NY4E08S2 type=write size=1314965 2024-09-14T11:17:14.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.188+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=SYY18VIOQGRN type=del size=807906 2024-09-14T11:17:14.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.189+0000 7f185d9f8780 1 < canceled part key=_multipart_1BOZ331NA7JA.2~TJE43OGGC3ZQ.0 size=782192 2024-09-14T11:17:14.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.191+0000 7f185d9f8780 1 < canceled multipart upload key=1BOZ331NA7JA upload=TJE43OGGC3ZQ tag=X7KTYHNCHGO3 type=write size=1830768 2024-09-14T11:17:14.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.193+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~13RF24LNAC97.0 size=1048576 2024-09-14T11:17:14.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.194+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~13RF24LNAC97.1 size=600913 2024-09-14T11:17:14.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.194+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=13RF24LNAC97 tag=X6K71KDL321M type=write size=2698065 2024-09-14T11:17:14.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.195+0000 7f185d9f8780 1 < completed write operation key=O2Y34FSQHS1S tag=N09EBUEG68ST type=write size=519650 2024-09-14T11:17:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.198+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~9G7EHW2QS8GJ.0 size=741421 2024-09-14T11:17:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.198+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=9G7EHW2QS8GJ tag=QCA3IJRUJTEM type=write size=1789997 2024-09-14T11:17:14.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.199+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~DT72FEUPYPU8.0 size=1048576 2024-09-14T11:17:14.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.199+0000 7f185d9f8780 1 < canceled part key=_multipart_830X857XIX9O.2~DT72FEUPYPU8.1 size=1048576 2024-09-14T11:17:14.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.200+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~DT72FEUPYPU8.2 size=475537 2024-09-14T11:17:14.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.202+0000 7f185d9f8780 1 < canceled multipart upload key=830X857XIX9O upload=DT72FEUPYPU8 tag=1BO61L2KJS1Y type=write size=3621265 2024-09-14T11:17:14.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.204+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=KZN6817IV0T5 type=del size=1004263 2024-09-14T11:17:14.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.205+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=XVAF3YZT1V9J type=del 2024-09-14T11:17:14.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.207+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~GWJAKJ18E6X0.0 size=795047 2024-09-14T11:17:14.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.207+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=GWJAKJ18E6X0 tag=M7UZRL06NF64 type=write size=1843623 2024-09-14T11:17:14.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.209+0000 7f185d9f8780 1 < suggested update operation key=HLUMY48G90KB tag=2U4OFC4IAH2Y type=del size=2246238 2024-09-14T11:17:14.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.211+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=VAV168AWOHTP type=del size=1789529 2024-09-14T11:17:14.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.212+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=7UJTII0G2U0B type=write size=537199 2024-09-14T11:17:14.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.214+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~OZCQ71OR8J5M.0 size=621633 2024-09-14T11:17:14.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.214+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=OZCQ71OR8J5M tag=VW8BJIRJEY7L type=write size=1670209 2024-09-14T11:17:14.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.215+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=H7Z1WBDPCUUH type=del 2024-09-14T11:17:14.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.218+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~SC3IMAB2IVH5.0 size=1048576 2024-09-14T11:17:14.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.218+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~SC3IMAB2IVH5.1 size=1048576 2024-09-14T11:17:14.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.219+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~SC3IMAB2IVH5.2 size=340260 2024-09-14T11:17:14.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.219+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=SC3IMAB2IVH5 tag=YFS7JG3SQURD type=write size=3485988 2024-09-14T11:17:14.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.221+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=BDHN7LF7H4EL type=del 2024-09-14T11:17:14.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.222+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=WRN81P2902G4 type=del size=2842522 2024-09-14T11:17:14.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.223+0000 7f185d9f8780 1 < canceled operation key=CJ6C03RXS0IW tag=PES22DVRLRJ9 type=del size=2066801 2024-09-14T11:17:14.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.225+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=MKUGBP0FZAJN type=del size=3748085 2024-09-14T11:17:14.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.226+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=6JAYO3U2YGDF type=del 2024-09-14T11:17:14.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.227+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=JQEXZ0YIFPLG type=del size=2841315 2024-09-14T11:17:14.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.230+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~6UK2FT9KN93U.0 size=1048576 2024-09-14T11:17:14.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.231+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~6UK2FT9KN93U.1 size=386245 2024-09-14T11:17:14.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.233+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=6UK2FT9KN93U tag=ZYED2GKONL1P type=write size=2483397 2024-09-14T11:17:14.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.235+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~4Y06XZO3CE7Z.0 size=1048576 2024-09-14T11:17:14.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.236+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~4Y06XZO3CE7Z.1 size=1048576 2024-09-14T11:17:14.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.237+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~4Y06XZO3CE7Z.2 size=145675 2024-09-14T11:17:14.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.237+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=4Y06XZO3CE7Z tag=ZDLANX8AOFV9 type=write size=3291403 2024-09-14T11:17:14.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.239+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=D7RQUX9LO0FN type=del 2024-09-14T11:17:14.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.241+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=9MMQTV2FDJ7Y type=del size=205721 2024-09-14T11:17:14.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.242+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=RU8Z3VQNCYVR type=del 2024-09-14T11:17:14.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.243+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=ZYUIH9BFPBQH type=del size=3090902 2024-09-14T11:17:14.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.244+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=2KUNQ0G8J3FK type=del 2024-09-14T11:17:14.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.247+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~LCMRH1LBR36T.0 size=1048576 2024-09-14T11:17:14.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.248+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~LCMRH1LBR36T.1 size=1048576 2024-09-14T11:17:14.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.249+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~LCMRH1LBR36T.2 size=1010884 2024-09-14T11:17:14.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.249+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=LCMRH1LBR36T tag=V9OEWTCME2N8 type=write size=4156612 2024-09-14T11:17:14.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.250+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=AKMY6UQC1XFH type=del 2024-09-14T11:17:14.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.251+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=YRN1UEMD1QEO type=del size=1343679 2024-09-14T11:17:14.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.252+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=SYY18VIOQGRN type=del 2024-09-14T11:17:14.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.254+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=BN4BLEOB2098 type=del size=2031380 2024-09-14T11:17:14.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.254+0000 7f185d9f8780 1 < canceled part key=_multipart_6MZGLP5KPPB3.2~13RF24LNAC97.0 size=1048576 2024-09-14T11:17:14.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.255+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~13RF24LNAC97.1 size=600913 2024-09-14T11:17:14.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.257+0000 7f185d9f8780 1 < canceled multipart upload key=6MZGLP5KPPB3 upload=13RF24LNAC97 tag=X6K71KDL321M type=write size=2698065 2024-09-14T11:17:14.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.258+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=J65YQLFA430J type=del size=3899511 2024-09-14T11:17:14.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.259+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~9G7EHW2QS8GJ.0 size=741421 2024-09-14T11:17:14.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.261+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=9G7EHW2QS8GJ tag=QCA3IJRUJTEM type=write size=1789997 2024-09-14T11:17:14.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.263+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~262KKGMJS0L4.0 size=1048576 2024-09-14T11:17:14.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.265+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~262KKGMJS0L4.1 size=942385 2024-09-14T11:17:14.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.265+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=262KKGMJS0L4 tag=AIN5QNU9ICEH type=write size=3039537 2024-09-14T11:17:14.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.266+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=KZN6817IV0T5 type=del 2024-09-14T11:17:14.266 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.267+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=5RMINUWEFVB1 type=write size=933985 2024-09-14T11:17:14.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.269+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~GWJAKJ18E6X0.0 size=795047 2024-09-14T11:17:14.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.271+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=GWJAKJ18E6X0 tag=M7UZRL06NF64 type=write size=1843623 2024-09-14T11:17:14.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.273+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~GZ83QR3MWL2O.0 size=1048576 2024-09-14T11:17:14.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.274+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~GZ83QR3MWL2O.1 size=331331 2024-09-14T11:17:14.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.274+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=GZ83QR3MWL2O tag=BOP0ZDZ5SI78 type=write size=2428483 2024-09-14T11:17:14.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.276+0000 7f185d9f8780 1 < suggested update operation key=CRZOT1D0U2F3 tag=VAV168AWOHTP type=del size=1789529 2024-09-14T11:17:14.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.278+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~E9HYU6MJHUTU.0 size=789265 2024-09-14T11:17:14.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.278+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=E9HYU6MJHUTU tag=II0C2H1ZHE24 type=write size=1837841 2024-09-14T11:17:14.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.278+0000 7f185d9f8780 1 < canceled part key=_multipart_087PN6V1BP65.2~OZCQ71OR8J5M.0 size=621633 2024-09-14T11:17:14.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.280+0000 7f185d9f8780 1 < canceled multipart upload key=087PN6V1BP65 upload=OZCQ71OR8J5M tag=VW8BJIRJEY7L type=write size=1670209 2024-09-14T11:17:14.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.282+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=1AQ38E5GR4AZ type=del size=1113878 2024-09-14T11:17:14.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.283+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~SC3IMAB2IVH5.0 size=1048576 2024-09-14T11:17:14.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.284+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~SC3IMAB2IVH5.1 size=1048576 2024-09-14T11:17:14.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.285+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~SC3IMAB2IVH5.2 size=340260 2024-09-14T11:17:14.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.287+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=SC3IMAB2IVH5 tag=YFS7JG3SQURD type=write size=3485988 2024-09-14T11:17:14.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.289+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~CDAUILUH3HUE.0 size=1048576 2024-09-14T11:17:14.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.290+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~CDAUILUH3HUE.1 size=988470 2024-09-14T11:17:14.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.290+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=CDAUILUH3HUE tag=2CTC69L7SOGA type=write size=3085622 2024-09-14T11:17:14.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.292+0000 7f185d9f8780 1 < suggested remove operation key=N040R6OERAJP tag=WRN81P2902G4 type=del 2024-09-14T11:17:14.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.293+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=L9BBOBXK3BX1 type=write size=284374 2024-09-14T11:17:14.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.296+0000 7f185d9f8780 1 < suggested remove operation key=L4L83NVMXHXZ tag=MKUGBP0FZAJN type=del 2024-09-14T11:17:14.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.297+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=MUZAKFLKOV2J type=write size=580546 2024-09-14T11:17:14.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.298+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=JQEXZ0YIFPLG type=del 2024-09-14T11:17:14.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.300+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=C23QZJLXGOL5 type=del size=367799 2024-09-14T11:17:14.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.301+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~4Y06XZO3CE7Z.0 size=1048576 2024-09-14T11:17:14.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.302+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~4Y06XZO3CE7Z.1 size=1048576 2024-09-14T11:17:14.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.303+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~4Y06XZO3CE7Z.2 size=145675 2024-09-14T11:17:14.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.305+0000 7f185d9f8780 1 < completed multipart upload key=7XGG5LBGRI4H upload=4Y06XZO3CE7Z tag=ZDLANX8AOFV9 type=write size=3291403 2024-09-14T11:17:14.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.306+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=DZ8RACWWCK7N type=del size=3004556 2024-09-14T11:17:14.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.307+0000 7f185d9f8780 1 < canceled operation key=IXWIKD7J74RJ tag=9MMQTV2FDJ7Y type=del size=205721 2024-09-14T11:17:14.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.309+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=14HSLKFU9WHA type=write size=605406 2024-09-14T11:17:14.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.311+0000 7f185d9f8780 1 < suggested update operation key=1BOZ331NA7JA tag=ZYUIH9BFPBQH type=del size=3090902 2024-09-14T11:17:14.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.312+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=G1DYO0CJNLMD type=del size=2714188 2024-09-14T11:17:14.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.314+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~LCMRH1LBR36T.0 size=1048576 2024-09-14T11:17:14.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.315+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~LCMRH1LBR36T.1 size=1048576 2024-09-14T11:17:14.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.316+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~LCMRH1LBR36T.2 size=1010884 2024-09-14T11:17:14.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.318+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=LCMRH1LBR36T tag=V9OEWTCME2N8 type=write size=4156612 2024-09-14T11:17:14.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.319+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=IKY0OE343EQB type=del size=1289011 2024-09-14T11:17:14.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.321+0000 7f185d9f8780 1 < suggested update operation key=1BOZ331NA7JA tag=YRN1UEMD1QEO type=del size=1343679 2024-09-14T11:17:14.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.323+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=URV25CSOC3BD type=del size=1650301 2024-09-14T11:17:14.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.324+0000 7f185d9f8780 1 < canceled operation key=HLUMY48G90KB tag=BN4BLEOB2098 type=del size=2031380 2024-09-14T11:17:14.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.325+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=P39EUVKL0QFE type=del size=379060 2024-09-14T11:17:14.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.327+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=J65YQLFA430J type=del 2024-09-14T11:17:14.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.328+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=TCX7URC20195 type=del size=2823878 2024-09-14T11:17:14.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.329+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~262KKGMJS0L4.0 size=1048576 2024-09-14T11:17:14.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.330+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~262KKGMJS0L4.1 size=942385 2024-09-14T11:17:14.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.332+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=262KKGMJS0L4 tag=AIN5QNU9ICEH type=write size=3039537 2024-09-14T11:17:14.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.334+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=FP4JAUH0E02N type=write size=989347 2024-09-14T11:17:14.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.335+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=5RMINUWEFVB1 type=write size=933985 2024-09-14T11:17:14.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.337+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=0WSYDRR2K1IQ type=write size=16478 2024-09-14T11:17:14.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.338+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~GZ83QR3MWL2O.0 size=1048576 2024-09-14T11:17:14.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.339+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~GZ83QR3MWL2O.1 size=331331 2024-09-14T11:17:14.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.341+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=GZ83QR3MWL2O tag=BOP0ZDZ5SI78 type=write size=2428483 2024-09-14T11:17:14.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.342+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=XDYYK59Q302J type=del size=1925555 2024-09-14T11:17:14.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.343+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~E9HYU6MJHUTU.0 size=789265 2024-09-14T11:17:14.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.347+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=E9HYU6MJHUTU tag=II0C2H1ZHE24 type=write size=1837841 2024-09-14T11:17:14.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.348+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=4N2T7LFNA5UG type=del size=3023937 2024-09-14T11:17:14.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.349+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=1AQ38E5GR4AZ type=del 2024-09-14T11:17:14.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.350+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=H0M5JVQVB8T9 type=del size=4153762 2024-09-14T11:17:14.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.350+0000 7f185d9f8780 1 < canceled part key=_multipart_087PN6V1BP65.2~CDAUILUH3HUE.0 size=1048576 2024-09-14T11:17:14.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.351+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~CDAUILUH3HUE.1 size=988470 2024-09-14T11:17:14.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.353+0000 7f185d9f8780 1 < canceled multipart upload key=087PN6V1BP65 upload=CDAUILUH3HUE tag=2CTC69L7SOGA type=write size=3085622 2024-09-14T11:17:14.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.355+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=FGMU6RDW0B03 type=del size=3867793 2024-09-14T11:17:14.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.356+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=L9BBOBXK3BX1 type=write size=284374 2024-09-14T11:17:14.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.358+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~OV7F0XRRU531.0 size=663499 2024-09-14T11:17:14.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.358+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=OV7F0XRRU531 tag=8FE5ZFR4HHIP type=write size=1712075 2024-09-14T11:17:14.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.359+0000 7f185d9f8780 1 < canceled operation key=6MZGLP5KPPB3 tag=MUZAKFLKOV2J type=write size=580546 2024-09-14T11:17:14.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.361+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~6K12ESCS1NZK.0 size=970710 2024-09-14T11:17:14.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.361+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=6K12ESCS1NZK tag=WE0FNNO6HROQ type=write size=2019286 2024-09-14T11:17:14.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.363+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=C23QZJLXGOL5 type=del 2024-09-14T11:17:14.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.364+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=C5TJDE91LC46 type=del size=1407793 2024-09-14T11:17:14.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.366+0000 7f185d9f8780 1 < suggested update operation key=P30WF4R3UFPX tag=DZ8RACWWCK7N type=del size=3004556 2024-09-14T11:17:14.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.367+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=GO69GOLCGNMI type=del size=1647517 2024-09-14T11:17:14.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.369+0000 7f185d9f8780 1 < completed write operation key=830X857XIX9O tag=14HSLKFU9WHA type=write size=605406 2024-09-14T11:17:14.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.370+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=9ST7GBEDS953 type=del size=848795 2024-09-14T11:17:14.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.371+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=G1DYO0CJNLMD type=del 2024-09-14T11:17:14.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.372+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=JPJCH9E1I377 type=del size=4091903 2024-09-14T11:17:14.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.373+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=IKY0OE343EQB type=del 2024-09-14T11:17:14.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.375+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=M9NM1A2XXAD5 type=del size=3999005 2024-09-14T11:17:14.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.377+0000 7f185d9f8780 1 < suggested update operation key=CRZOT1D0U2F3 tag=URV25CSOC3BD type=del size=1650301 2024-09-14T11:17:14.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.378+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=OK3S764C4HJP type=del size=3975019 2024-09-14T11:17:14.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.380+0000 7f185d9f8780 1 < suggested update operation key=CJ6C03RXS0IW tag=P39EUVKL0QFE type=del size=379060 2024-09-14T11:17:14.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.381+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=DYGR7I75G48S type=del size=1966884 2024-09-14T11:17:14.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.384+0000 7f185d9f8780 1 < suggested update operation key=IXWIKD7J74RJ tag=TCX7URC20195 type=del size=2823878 2024-09-14T11:17:14.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.385+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=JJKGHVF8I47Z type=del size=1572522 2024-09-14T11:17:14.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.386+0000 7f185d9f8780 1 < completed write operation key=087PN6V1BP65 tag=FP4JAUH0E02N type=write size=989347 2024-09-14T11:17:14.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.387+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=41K9R1TCSASI type=del size=1625606 2024-09-14T11:17:14.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.390+0000 7f185d9f8780 1 < suggested remove operation key=6B0SURI3Q8R6 tag=0WSYDRR2K1IQ type=write 2024-09-14T11:17:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.391+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=PSXRKW0NJP42 type=write size=155380 2024-09-14T11:17:14.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.392+0000 7f185d9f8780 -1 < failed to complete operation key=CRZOT1D0U2F3 tag=XDYYK59Q302J type=del size=1925555: (22) Invalid argument 2024-09-14T11:17:14.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.393+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=FR7SZVUHRFNL type=del size=239608 2024-09-14T11:17:14.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.396+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=4N2T7LFNA5UG type=del 2024-09-14T11:17:14.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.397+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=NTUMEKXUYJEZ type=del size=2970864 2024-09-14T11:17:14.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.399+0000 7f185d9f8780 1 < suggested remove operation key=PSL63WUBLB75 tag=H0M5JVQVB8T9 type=del 2024-09-14T11:17:14.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.400+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=WGWZX1V8AFIA type=del size=1659833 2024-09-14T11:17:14.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.401+0000 7f185d9f8780 -1 < no bi entry to suggest for operation key=CVVKY636WXG9 tag=FGMU6RDW0B03 type=del size=3867793: (2) No such file or directory 2024-09-14T11:17:14.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.403+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~OTQ7SOWTXVWB.0 size=1048576 2024-09-14T11:17:14.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.404+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~OTQ7SOWTXVWB.1 size=410414 2024-09-14T11:17:14.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.404+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=OTQ7SOWTXVWB tag=UKRCLYS03KU7 type=write size=2507566 2024-09-14T11:17:14.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.405+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~OV7F0XRRU531.0 size=663499 2024-09-14T11:17:14.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.407+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=OV7F0XRRU531 tag=8FE5ZFR4HHIP type=write size=1712075 2024-09-14T11:17:14.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.408+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=VMC2QQSWI83L type=del size=1333196 2024-09-14T11:17:14.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.409+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~6K12ESCS1NZK.0 size=970710 2024-09-14T11:17:14.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.411+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=6K12ESCS1NZK tag=WE0FNNO6HROQ type=write size=2019286 2024-09-14T11:17:14.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.413+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~FD1K29GEIE32.0 size=15794 2024-09-14T11:17:14.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.413+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=FD1K29GEIE32 tag=MZGBPL7UE5VM type=write size=1064370 2024-09-14T11:17:14.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.414+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=C5TJDE91LC46 type=del 2024-09-14T11:17:14.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.416+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~2B0IQXBTGIPW.0 size=652269 2024-09-14T11:17:14.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.416+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=2B0IQXBTGIPW tag=GV0VGVT9IM83 type=write size=1700845 2024-09-14T11:17:14.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.419+0000 7f185d9f8780 1 < suggested update operation key=55K4D3SEM068 tag=GO69GOLCGNMI type=del size=1647517 2024-09-14T11:17:14.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.421+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~C66KM6PBF80Z.0 size=1048576 2024-09-14T11:17:14.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.421+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~C66KM6PBF80Z.1 size=516614 2024-09-14T11:17:14.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.421+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=C66KM6PBF80Z tag=FDIZ0H40IVJI type=write size=2613766 2024-09-14T11:17:14.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.424+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=9ST7GBEDS953 type=del size=848795 2024-09-14T11:17:14.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.425+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=WYCH8LRD2ZCR type=del size=3953304 2024-09-14T11:17:14.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.426+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=JPJCH9E1I377 type=del 2024-09-14T11:17:14.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.428+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~DIPJ3OAMA1QA.0 size=1048576 2024-09-14T11:17:14.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.429+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~DIPJ3OAMA1QA.1 size=1048576 2024-09-14T11:17:14.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.430+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~DIPJ3OAMA1QA.2 size=210451 2024-09-14T11:17:14.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.430+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=DIPJ3OAMA1QA tag=QEHW9UP6D65D type=write size=3356179 2024-09-14T11:17:14.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.432+0000 7f185d9f8780 1 < suggested remove operation key=CJ6C03RXS0IW tag=M9NM1A2XXAD5 type=del 2024-09-14T11:17:14.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.433+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=116JICPHRLAD type=write size=270420 2024-09-14T11:17:14.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.434+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=OK3S764C4HJP type=del 2024-09-14T11:17:14.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.435+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=HU8FUR9318Q9 type=del size=3620571 2024-09-14T11:17:14.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.436+0000 7f185d9f8780 -1 < failed to complete operation key=WPBYTFP7HRVE tag=DYGR7I75G48S type=del size=1966884: (22) Invalid argument 2024-09-14T11:17:14.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.438+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=UFDFEDTBXBUX type=del size=310006 2024-09-14T11:17:14.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.439+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=JJKGHVF8I47Z type=del 2024-09-14T11:17:14.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.440+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=A9JDB1FPRSPD type=del size=289732 2024-09-14T11:17:14.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.441+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=41K9R1TCSASI type=del 2024-09-14T11:17:14.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.443+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~69P0QDYV44XF.0 size=1048576 2024-09-14T11:17:14.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.444+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~69P0QDYV44XF.1 size=917822 2024-09-14T11:17:14.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.444+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=69P0QDYV44XF tag=HUW0ZSMFLBKO type=write size=3014974 2024-09-14T11:17:14.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.445+0000 7f185d9f8780 1 < completed write operation key=ZR3IEW48CSCF tag=PSXRKW0NJP42 type=write size=155380 2024-09-14T11:17:14.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.447+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~7ZZGXCOYQOR0.0 size=1048576 2024-09-14T11:17:14.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.448+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~7ZZGXCOYQOR0.1 size=1048576 2024-09-14T11:17:14.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.449+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~7ZZGXCOYQOR0.2 size=368297 2024-09-14T11:17:14.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.449+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=7ZZGXCOYQOR0 tag=ZWKN4F2EXCYE type=write size=3514025 2024-09-14T11:17:14.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.450+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=FR7SZVUHRFNL type=del 2024-09-14T11:17:14.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.451+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=B0854EBS66Z0 type=del size=645230 2024-09-14T11:17:14.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.453+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=NTUMEKXUYJEZ type=del 2024-09-14T11:17:14.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.454+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=Z96RDE2JOIM9 type=del size=2421451 2024-09-14T11:17:14.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.455+0000 7f185d9f8780 1 < canceled operation key=7XGG5LBGRI4H tag=WGWZX1V8AFIA type=del size=1659833 2024-09-14T11:17:14.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.456+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=2FY8MR37OWXH type=write size=857004 2024-09-14T11:17:14.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.458+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~OTQ7SOWTXVWB.0 size=1048576 2024-09-14T11:17:14.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.459+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~OTQ7SOWTXVWB.1 size=410414 2024-09-14T11:17:14.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.461+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=OTQ7SOWTXVWB tag=UKRCLYS03KU7 type=write size=2507566 2024-09-14T11:17:14.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.462+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=NZJLMVR3KZIU type=del size=88520 2024-09-14T11:17:14.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.464+0000 7f185d9f8780 1 < canceled operation key=CVVKY636WXG9 tag=VMC2QQSWI83L type=del size=1333196 2024-09-14T11:17:14.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.465+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=11ZDX7XVR6O5 type=del size=2740276 2024-09-14T11:17:14.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.466+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~FD1K29GEIE32.0 size=15794 2024-09-14T11:17:14.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.468+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=FD1K29GEIE32 tag=MZGBPL7UE5VM type=write size=1064370 2024-09-14T11:17:14.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.469+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=MHSXN71SOJG0 type=del size=989437 2024-09-14T11:17:14.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.469+0000 7f185d9f8780 1 < canceled part key=_multipart_U5S6L8GPSMU5.2~2B0IQXBTGIPW.0 size=652269 2024-09-14T11:17:14.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.471+0000 7f185d9f8780 1 < canceled multipart upload key=U5S6L8GPSMU5 upload=2B0IQXBTGIPW tag=GV0VGVT9IM83 type=write size=1700845 2024-09-14T11:17:14.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.472+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=DLCFQH6FBONH type=del size=162956 2024-09-14T11:17:14.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.473+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~C66KM6PBF80Z.0 size=1048576 2024-09-14T11:17:14.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.474+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~C66KM6PBF80Z.1 size=516614 2024-09-14T11:17:14.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.476+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=C66KM6PBF80Z tag=FDIZ0H40IVJI type=write size=2613766 2024-09-14T11:17:14.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.478+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~BEYW07JRPTPA.0 size=1048576 2024-09-14T11:17:14.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.479+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~BEYW07JRPTPA.1 size=1048576 2024-09-14T11:17:14.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.480+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~BEYW07JRPTPA.2 size=633892 2024-09-14T11:17:14.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.480+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=BEYW07JRPTPA tag=KOUW2WKEPV1U type=write size=3779620 2024-09-14T11:17:14.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.481+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=WYCH8LRD2ZCR type=del 2024-09-14T11:17:14.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.483+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=B2DPDN9Z566S type=del size=2693583 2024-09-14T11:17:14.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.484+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~DIPJ3OAMA1QA.0 size=1048576 2024-09-14T11:17:14.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.484+0000 7f185d9f8780 1 < canceled part key=_multipart_L4L83NVMXHXZ.2~DIPJ3OAMA1QA.1 size=1048576 2024-09-14T11:17:14.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.485+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~DIPJ3OAMA1QA.2 size=210451 2024-09-14T11:17:14.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.487+0000 7f185d9f8780 1 < canceled multipart upload key=L4L83NVMXHXZ upload=DIPJ3OAMA1QA tag=QEHW9UP6D65D type=write size=3356179 2024-09-14T11:17:14.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.489+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~EU5H6AD27DPC.0 size=1048576 2024-09-14T11:17:14.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.490+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~EU5H6AD27DPC.1 size=1048576 2024-09-14T11:17:14.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.491+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~EU5H6AD27DPC.2 size=480429 2024-09-14T11:17:14.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.491+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=EU5H6AD27DPC tag=OH1ULNLCG2ES type=write size=3626157 2024-09-14T11:17:14.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.492+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=116JICPHRLAD type=write size=270420 2024-09-14T11:17:14.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.495+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~748VRXZJRBMV.0 size=39437 2024-09-14T11:17:14.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.495+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=748VRXZJRBMV tag=B3ONL71GMSBX type=write size=1088013 2024-09-14T11:17:14.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.497+0000 7f185d9f8780 1 < suggested remove operation key=XPMGVU0U52GS tag=HU8FUR9318Q9 type=del 2024-09-14T11:17:14.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.499+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~UKKWOHKEQWMS.0 size=1048576 2024-09-14T11:17:14.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.500+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~UKKWOHKEQWMS.1 size=981568 2024-09-14T11:17:14.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.500+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=UKKWOHKEQWMS tag=0TYDKPH89PDM type=write size=3078720 2024-09-14T11:17:14.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.502+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=UFDFEDTBXBUX type=del 2024-09-14T11:17:14.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.504+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~OKJPY4MZQD0X.0 size=1048576 2024-09-14T11:17:14.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.505+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~OKJPY4MZQD0X.1 size=1048576 2024-09-14T11:17:14.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.506+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~OKJPY4MZQD0X.2 size=114295 2024-09-14T11:17:14.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.506+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=OKJPY4MZQD0X tag=MMLKEV3BWA01 type=write size=3260023 2024-09-14T11:17:14.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.507+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=A9JDB1FPRSPD type=del 2024-09-14T11:17:14.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.508+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=BSS9U15B8ROG type=del size=1428657 2024-09-14T11:17:14.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.510+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~69P0QDYV44XF.0 size=1048576 2024-09-14T11:17:14.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.511+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~69P0QDYV44XF.1 size=917822 2024-09-14T11:17:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.513+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=69P0QDYV44XF tag=HUW0ZSMFLBKO type=write size=3014974 2024-09-14T11:17:14.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.515+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~ITRTXFPUTSEN.0 size=787328 2024-09-14T11:17:14.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.515+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=ITRTXFPUTSEN tag=ACN1NAA6O1UT type=write size=1835904 2024-09-14T11:17:14.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.516+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~7ZZGXCOYQOR0.0 size=1048576 2024-09-14T11:17:14.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.517+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~7ZZGXCOYQOR0.1 size=1048576 2024-09-14T11:17:14.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.518+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~7ZZGXCOYQOR0.2 size=368297 2024-09-14T11:17:14.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.520+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=7ZZGXCOYQOR0 tag=ZWKN4F2EXCYE type=write size=3514025 2024-09-14T11:17:14.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.521+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=3HF2BG5JIRHC type=del size=2155526 2024-09-14T11:17:14.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.523+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=B0854EBS66Z0 type=del 2024-09-14T11:17:14.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.525+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~4WZFP5YDUIDC.0 size=1048576 2024-09-14T11:17:14.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.526+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~4WZFP5YDUIDC.1 size=1048576 2024-09-14T11:17:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.527+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~4WZFP5YDUIDC.2 size=591866 2024-09-14T11:17:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.527+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=4WZFP5YDUIDC tag=TTFKDSQV2BBR type=write size=3737594 2024-09-14T11:17:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.528+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=Z96RDE2JOIM9 type=del 2024-09-14T11:17:14.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.529+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=LDQEARPA9K86 type=del size=1092243 2024-09-14T11:17:14.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.531+0000 7f185d9f8780 1 < suggested update operation key=ESN8NVVJB3B0 tag=2FY8MR37OWXH type=write size=857004 2024-09-14T11:17:14.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.534+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~5SOL7QDWA9LJ.0 size=1048576 2024-09-14T11:17:14.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.534+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~5SOL7QDWA9LJ.1 size=57417 2024-09-14T11:17:14.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.534+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=5SOL7QDWA9LJ tag=PA33K2QT7ODW type=write size=2154569 2024-09-14T11:17:14.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.536+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=NZJLMVR3KZIU type=del 2024-09-14T11:17:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.537+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=RZE0PQK2CES1 type=write size=719220 2024-09-14T11:17:14.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.538+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=11ZDX7XVR6O5 type=del 2024-09-14T11:17:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.540+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=XOT4FTQ6VITT type=del size=663640 2024-09-14T11:17:14.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.541+0000 7f185d9f8780 1 < canceled operation key=55K4D3SEM068 tag=MHSXN71SOJG0 type=del size=989437 2024-09-14T11:17:14.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.543+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~EAIUPJKWQXAR.0 size=1048576 2024-09-14T11:17:14.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.544+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~EAIUPJKWQXAR.1 size=1048576 2024-09-14T11:17:14.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.545+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~EAIUPJKWQXAR.2 size=113020 2024-09-14T11:17:14.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.545+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=EAIUPJKWQXAR tag=5IHUAJHWYNSL type=write size=3258748 2024-09-14T11:17:14.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.546+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=DLCFQH6FBONH type=del 2024-09-14T11:17:14.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.548+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=54RQTFGZ2T6U type=del size=4030811 2024-09-14T11:17:14.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.549+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~BEYW07JRPTPA.0 size=1048576 2024-09-14T11:17:14.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.550+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~BEYW07JRPTPA.1 size=1048576 2024-09-14T11:17:14.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.551+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~BEYW07JRPTPA.2 size=633892 2024-09-14T11:17:14.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.553+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=BEYW07JRPTPA tag=KOUW2WKEPV1U type=write size=3779620 2024-09-14T11:17:14.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.556+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~FC79U1LV5AJ1.0 size=1048576 2024-09-14T11:17:14.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.557+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~FC79U1LV5AJ1.1 size=729606 2024-09-14T11:17:14.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.557+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=FC79U1LV5AJ1 tag=26553BLXX4OM type=write size=2826758 2024-09-14T11:17:14.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.558+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=B2DPDN9Z566S type=del 2024-09-14T11:17:14.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.560+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~U34G0A4PB65F.0 size=1048576 2024-09-14T11:17:14.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.561+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~U34G0A4PB65F.1 size=1048576 2024-09-14T11:17:14.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.562+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~U34G0A4PB65F.2 size=249263 2024-09-14T11:17:14.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.562+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=U34G0A4PB65F tag=0D9NULXW4R60 type=write size=3394991 2024-09-14T11:17:14.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.563+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~EU5H6AD27DPC.0 size=1048576 2024-09-14T11:17:14.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.564+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~EU5H6AD27DPC.1 size=1048576 2024-09-14T11:17:14.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.565+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~EU5H6AD27DPC.2 size=480429 2024-09-14T11:17:14.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.567+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=EU5H6AD27DPC tag=OH1ULNLCG2ES type=write size=3626157 2024-09-14T11:17:14.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.571+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~QY8ZHVTUBDG8.0 size=1048576 2024-09-14T11:17:14.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.572+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~QY8ZHVTUBDG8.1 size=1048576 2024-09-14T11:17:14.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.572+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~QY8ZHVTUBDG8.2 size=1041759 2024-09-14T11:17:14.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.572+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=QY8ZHVTUBDG8 tag=MFOSTL3TJLD9 type=write size=4187487 2024-09-14T11:17:14.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.574+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~748VRXZJRBMV.0 size=39437 2024-09-14T11:17:14.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.576+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=748VRXZJRBMV tag=B3ONL71GMSBX type=write size=1088013 2024-09-14T11:17:14.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.577+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=8ZAA3BAB9VND type=del size=4176630 2024-09-14T11:17:14.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.578+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~UKKWOHKEQWMS.0 size=1048576 2024-09-14T11:17:14.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.579+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~UKKWOHKEQWMS.1 size=981568 2024-09-14T11:17:14.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.581+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=UKKWOHKEQWMS tag=0TYDKPH89PDM type=write size=3078720 2024-09-14T11:17:14.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.583+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DFA08I9POTD9.0 size=1048576 2024-09-14T11:17:14.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.584+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DFA08I9POTD9.1 size=1048576 2024-09-14T11:17:14.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.585+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~DFA08I9POTD9.2 size=214200 2024-09-14T11:17:14.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.585+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=DFA08I9POTD9 tag=PP4CL5V0TBQJ type=write size=3359928 2024-09-14T11:17:14.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.586+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~OKJPY4MZQD0X.0 size=1048576 2024-09-14T11:17:14.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.587+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~OKJPY4MZQD0X.1 size=1048576 2024-09-14T11:17:14.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.588+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~OKJPY4MZQD0X.2 size=114295 2024-09-14T11:17:14.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.590+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=OKJPY4MZQD0X tag=MMLKEV3BWA01 type=write size=3260023 2024-09-14T11:17:14.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.592+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~RD4TG0S5VNZ1.0 size=207219 2024-09-14T11:17:14.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.592+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=RD4TG0S5VNZ1 tag=6DLEM3297ZI9 type=write size=1255795 2024-09-14T11:17:14.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.595+0000 7f185d9f8780 1 < suggested remove operation key=SEI774TP8YMJ tag=BSS9U15B8ROG type=del 2024-09-14T11:17:14.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.597+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~YDY5E2VYH5GU.0 size=1048576 2024-09-14T11:17:14.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.598+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~YDY5E2VYH5GU.1 size=913636 2024-09-14T11:17:14.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.598+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=YDY5E2VYH5GU tag=UQPZH74S8XAY type=write size=3010788 2024-09-14T11:17:14.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.599+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~ITRTXFPUTSEN.0 size=787328 2024-09-14T11:17:14.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.601+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=ITRTXFPUTSEN tag=ACN1NAA6O1UT type=write size=1835904 2024-09-14T11:17:14.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.602+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=TXDQ90P3RLGE type=del size=1644284 2024-09-14T11:17:14.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.604+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=3HF2BG5JIRHC type=del 2024-09-14T11:17:14.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.605+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=S0SPNKMHS0RM type=write size=457818 2024-09-14T11:17:14.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.606+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~4WZFP5YDUIDC.0 size=1048576 2024-09-14T11:17:14.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.607+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~4WZFP5YDUIDC.1 size=1048576 2024-09-14T11:17:14.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.608+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~4WZFP5YDUIDC.2 size=591866 2024-09-14T11:17:14.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.610+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=4WZFP5YDUIDC tag=TTFKDSQV2BBR type=write size=3737594 2024-09-14T11:17:14.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.611+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=1NTH3ZLUQ0W7 type=del size=2531516 2024-09-14T11:17:14.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.614+0000 7f185d9f8780 1 < suggested remove operation key=1BOZ331NA7JA tag=LDQEARPA9K86 type=del 2024-09-14T11:17:14.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.615+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=KJETX5O95V0X type=del size=3835073 2024-09-14T11:17:14.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.616+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~5SOL7QDWA9LJ.0 size=1048576 2024-09-14T11:17:14.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.617+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~5SOL7QDWA9LJ.1 size=57417 2024-09-14T11:17:14.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.619+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=5SOL7QDWA9LJ tag=PA33K2QT7ODW type=write size=2154569 2024-09-14T11:17:14.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.621+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~62CY5DBXT8RA.0 size=1048576 2024-09-14T11:17:14.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.622+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~62CY5DBXT8RA.1 size=1048576 2024-09-14T11:17:14.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.623+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~62CY5DBXT8RA.2 size=1013484 2024-09-14T11:17:14.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.623+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=62CY5DBXT8RA tag=NWY0DTB7ON0T type=write size=4159212 2024-09-14T11:17:14.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.624+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=RZE0PQK2CES1 type=write size=719220 2024-09-14T11:17:14.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.627+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~QCMR0OASNXRI.0 size=747119 2024-09-14T11:17:14.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.627+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=QCMR0OASNXRI tag=U5VS0ZA3WEDZ type=write size=1795695 2024-09-14T11:17:14.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.628+0000 7f185d9f8780 1 < completed delete operation key=WPBYTFP7HRVE tag=XOT4FTQ6VITT type=del 2024-09-14T11:17:14.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.629+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=BFH33SEY30VR type=del size=190601 2024-09-14T11:17:14.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.630+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~EAIUPJKWQXAR.0 size=1048576 2024-09-14T11:17:14.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.631+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~EAIUPJKWQXAR.1 size=1048576 2024-09-14T11:17:14.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.632+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~EAIUPJKWQXAR.2 size=113020 2024-09-14T11:17:14.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.634+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=EAIUPJKWQXAR tag=5IHUAJHWYNSL type=write size=3258748 2024-09-14T11:17:14.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.635+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=JHT95XROUD52 type=del size=3709448 2024-09-14T11:17:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.638+0000 7f185d9f8780 1 < suggested update operation key=087PN6V1BP65 tag=54RQTFGZ2T6U type=del size=4030811 2024-09-14T11:17:14.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.639+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=YJ3RR6K5H75B type=del size=3321111 2024-09-14T11:17:14.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.639+0000 7f185d9f8780 1 < canceled part key=_multipart_ZR3IEW48CSCF.2~FC79U1LV5AJ1.0 size=1048576 2024-09-14T11:17:14.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.640+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~FC79U1LV5AJ1.1 size=729606 2024-09-14T11:17:14.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.642+0000 7f185d9f8780 1 < canceled multipart upload key=ZR3IEW48CSCF upload=FC79U1LV5AJ1 tag=26553BLXX4OM type=write size=2826758 2024-09-14T11:17:14.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.644+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~LMAG41P23INE.0 size=1048576 2024-09-14T11:17:14.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.645+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~LMAG41P23INE.1 size=1048576 2024-09-14T11:17:14.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.646+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~LMAG41P23INE.2 size=765617 2024-09-14T11:17:14.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.646+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=LMAG41P23INE tag=ZMV3DD80SSZK type=write size=3911345 2024-09-14T11:17:14.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.648+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~U34G0A4PB65F.0 size=1048576 2024-09-14T11:17:14.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.649+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~U34G0A4PB65F.1 size=1048576 2024-09-14T11:17:14.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.650+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~U34G0A4PB65F.2 size=249263 2024-09-14T11:17:14.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.652+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=U34G0A4PB65F tag=0D9NULXW4R60 type=write size=3394991 2024-09-14T11:17:14.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.654+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~W2VQKOCG3R7L.0 size=727663 2024-09-14T11:17:14.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.655+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=W2VQKOCG3R7L tag=3N9ITR06U3JG type=write size=1776239 2024-09-14T11:17:14.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.656+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~QY8ZHVTUBDG8.0 size=1048576 2024-09-14T11:17:14.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.657+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~QY8ZHVTUBDG8.1 size=1048576 2024-09-14T11:17:14.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.658+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~QY8ZHVTUBDG8.2 size=1041759 2024-09-14T11:17:14.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.660+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=QY8ZHVTUBDG8 tag=MFOSTL3TJLD9 type=write size=4187487 2024-09-14T11:17:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.661+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=L80UY2WL9G61 type=del size=880891 2024-09-14T11:17:14.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.662+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=8ZAA3BAB9VND type=del 2024-09-14T11:17:14.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.663+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=YZ206NHPWFOE type=del size=2645735 2024-09-14T11:17:14.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.664+0000 7f185d9f8780 1 < canceled part key=_multipart_ESN8NVVJB3B0.2~DFA08I9POTD9.0 size=1048576 2024-09-14T11:17:14.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.664+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DFA08I9POTD9.1 size=1048576 2024-09-14T11:17:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.665+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~DFA08I9POTD9.2 size=214200 2024-09-14T11:17:14.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.667+0000 7f185d9f8780 1 < canceled multipart upload key=ESN8NVVJB3B0 upload=DFA08I9POTD9 tag=PP4CL5V0TBQJ type=write size=3359928 2024-09-14T11:17:14.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.669+0000 7f185d9f8780 1 > prepared part key=_multipart_1BOZ331NA7JA.2~6T9FJAXF0F0Q.0 size=1044316 2024-09-14T11:17:14.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.669+0000 7f185d9f8780 1 > prepared multipart upload key=1BOZ331NA7JA upload=6T9FJAXF0F0Q tag=599GRAPXGIC8 type=write size=2092892 2024-09-14T11:17:14.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.670+0000 7f185d9f8780 1 < canceled part key=_multipart_LGLAG80GX8GF.2~RD4TG0S5VNZ1.0 size=207219 2024-09-14T11:17:14.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.672+0000 7f185d9f8780 1 < canceled multipart upload key=LGLAG80GX8GF upload=RD4TG0S5VNZ1 tag=6DLEM3297ZI9 type=write size=1255795 2024-09-14T11:17:14.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.674+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~SXTM34XDCBDQ.0 size=1048576 2024-09-14T11:17:14.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.674+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~SXTM34XDCBDQ.1 size=245386 2024-09-14T11:17:14.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.674+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=SXTM34XDCBDQ tag=IBZLJSF2WAMQ type=write size=2342538 2024-09-14T11:17:14.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.676+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~YDY5E2VYH5GU.0 size=1048576 2024-09-14T11:17:14.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.676+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~YDY5E2VYH5GU.1 size=913636 2024-09-14T11:17:14.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.680+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=YDY5E2VYH5GU tag=UQPZH74S8XAY type=write size=3010788 2024-09-14T11:17:14.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.681+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=NHTBQPGP452Z type=del size=1477464 2024-09-14T11:17:14.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.682+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=TXDQ90P3RLGE type=del 2024-09-14T11:17:14.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.683+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=J6PYKWQE5OSL type=del size=271647 2024-09-14T11:17:14.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.685+0000 7f185d9f8780 1 < completed write operation key=WPBYTFP7HRVE tag=S0SPNKMHS0RM type=write size=457818 2024-09-14T11:17:14.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.686+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=HCYE14Q5VED2 type=del size=4192323 2024-09-14T11:17:14.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.688+0000 7f185d9f8780 1 < suggested remove operation key=W24KN3J819EB tag=1NTH3ZLUQ0W7 type=del 2024-09-14T11:17:14.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.689+0000 7f185d9f8780 1 > prepared operation key=OYZIXCSGXTHR tag=3KP2D7093H0X type=del size=456445 2024-09-14T11:17:14.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.690+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=KJETX5O95V0X type=del 2024-09-14T11:17:14.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.692+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~TRF6XYAKY54D.0 size=148502 2024-09-14T11:17:14.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.692+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=TRF6XYAKY54D tag=LMYL8JE0DI97 type=write size=1197078 2024-09-14T11:17:14.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.693+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~62CY5DBXT8RA.0 size=1048576 2024-09-14T11:17:14.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.694+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~62CY5DBXT8RA.1 size=1048576 2024-09-14T11:17:14.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.694+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~62CY5DBXT8RA.2 size=1013484 2024-09-14T11:17:14.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.696+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=62CY5DBXT8RA tag=NWY0DTB7ON0T type=write size=4159212 2024-09-14T11:17:14.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.698+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~O8R66X2YPNN2.0 size=1048576 2024-09-14T11:17:14.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.699+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~O8R66X2YPNN2.1 size=1048576 2024-09-14T11:17:14.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.700+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~O8R66X2YPNN2.2 size=238460 2024-09-14T11:17:14.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.700+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=O8R66X2YPNN2 tag=1I3CB2PNUBVZ type=write size=3384188 2024-09-14T11:17:14.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.702+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~QCMR0OASNXRI.0 size=747119 2024-09-14T11:17:14.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.704+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=QCMR0OASNXRI tag=U5VS0ZA3WEDZ type=write size=1795695 2024-09-14T11:17:14.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.705+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=2O49QYNR6901 type=del size=3481644 2024-09-14T11:17:14.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.706+0000 7f185d9f8780 1 < canceled operation key=DAKWA1OCVTBG tag=BFH33SEY30VR type=del size=190601 2024-09-14T11:17:14.707 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.707+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=AK1TADHPZIFE type=del size=2592432 2024-09-14T11:17:14.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.709+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=JHT95XROUD52 type=del 2024-09-14T11:17:14.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.711+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~W3KSQUABVW2G.0 size=1048576 2024-09-14T11:17:14.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.712+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~W3KSQUABVW2G.1 size=1048576 2024-09-14T11:17:14.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.712+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~W3KSQUABVW2G.2 size=429486 2024-09-14T11:17:14.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.712+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=W3KSQUABVW2G tag=D51S9X6K70CH type=write size=3575214 2024-09-14T11:17:14.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.715+0000 7f185d9f8780 1 < suggested remove operation key=55K4D3SEM068 tag=YJ3RR6K5H75B type=del 2024-09-14T11:17:14.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.716+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=PROOIBF4D7DJ type=del size=1529722 2024-09-14T11:17:14.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.717+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~LMAG41P23INE.0 size=1048576 2024-09-14T11:17:14.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.718+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~LMAG41P23INE.1 size=1048576 2024-09-14T11:17:14.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.719+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~LMAG41P23INE.2 size=765617 2024-09-14T11:17:14.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.721+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=LMAG41P23INE tag=ZMV3DD80SSZK type=write size=3911345 2024-09-14T11:17:14.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.723+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CL1YDRBDSDR3.0 size=1048576 2024-09-14T11:17:14.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.724+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CL1YDRBDSDR3.1 size=1048576 2024-09-14T11:17:14.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.725+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CL1YDRBDSDR3.2 size=463212 2024-09-14T11:17:14.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.725+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=CL1YDRBDSDR3 tag=U08CXLYJ7629 type=write size=3608940 2024-09-14T11:17:14.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.726+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~W2VQKOCG3R7L.0 size=727663 2024-09-14T11:17:14.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.727+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=W2VQKOCG3R7L tag=3N9ITR06U3JG type=write size=1776239 2024-09-14T11:17:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.729+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~ORNJ4BILGTIU.0 size=1048576 2024-09-14T11:17:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.730+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~ORNJ4BILGTIU.1 size=277416 2024-09-14T11:17:14.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.730+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=ORNJ4BILGTIU tag=FIMCJY76IO0S type=write size=2374568 2024-09-14T11:17:14.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.732+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=L80UY2WL9G61 type=del 2024-09-14T11:17:14.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.733+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=DENG0K5ZZJOV type=write size=441878 2024-09-14T11:17:14.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.735+0000 7f185d9f8780 1 < suggested update operation key=O2Y34FSQHS1S tag=YZ206NHPWFOE type=del size=2645735 2024-09-14T11:17:14.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.737+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CXD8OJTEUH6C.0 size=1048576 2024-09-14T11:17:14.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.738+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~CXD8OJTEUH6C.1 size=860345 2024-09-14T11:17:14.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.738+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=CXD8OJTEUH6C tag=34IN18TQFKM8 type=write size=2957497 2024-09-14T11:17:14.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.740+0000 7f185d9f8780 1 < completed part key=_multipart_1BOZ331NA7JA.2~6T9FJAXF0F0Q.0 size=1044316 2024-09-14T11:17:14.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.741+0000 7f185d9f8780 1 < completed multipart upload key=1BOZ331NA7JA upload=6T9FJAXF0F0Q tag=599GRAPXGIC8 type=write size=2092892 2024-09-14T11:17:14.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.743+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~RJQ8W7YL452G.0 size=88483 2024-09-14T11:17:14.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.743+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=RJQ8W7YL452G tag=YH595J8A7RFR type=write size=1137059 2024-09-14T11:17:14.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.745+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~SXTM34XDCBDQ.0 size=1048576 2024-09-14T11:17:14.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.745+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~SXTM34XDCBDQ.1 size=245386 2024-09-14T11:17:14.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.747+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=SXTM34XDCBDQ tag=IBZLJSF2WAMQ type=write size=2342538 2024-09-14T11:17:14.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.748+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=LUZX2N37TV4N type=del size=3112123 2024-09-14T11:17:14.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.751+0000 7f185d9f8780 1 < suggested remove operation key=CJ6C03RXS0IW tag=NHTBQPGP452Z type=del 2024-09-14T11:17:14.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.752+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=HRA4JVG4JRVO type=del size=905506 2024-09-14T11:17:14.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.753+0000 7f185d9f8780 -1 < failed to complete operation key=W24KN3J819EB tag=J6PYKWQE5OSL type=del size=271647: (22) Invalid argument 2024-09-14T11:17:14.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.754+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=0NB9QULVDBJA type=del size=3214949 2024-09-14T11:17:14.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.755+0000 7f185d9f8780 -1 < failed to complete operation key=W24KN3J819EB tag=HCYE14Q5VED2 type=del size=4192323: (22) Invalid argument 2024-09-14T11:17:14.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.757+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~2AT0Y03AULBI.0 size=667662 2024-09-14T11:17:14.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.757+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=2AT0Y03AULBI tag=9ZDW2XWKG9BC type=write size=1716238 2024-09-14T11:17:14.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.758+0000 7f185d9f8780 1 < completed delete operation key=OYZIXCSGXTHR tag=3KP2D7093H0X type=del 2024-09-14T11:17:14.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.760+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~36J43ONWWTVW.0 size=200800 2024-09-14T11:17:14.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.760+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=36J43ONWWTVW tag=YCJG1ZIBRHL7 type=write size=1249376 2024-09-14T11:17:14.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.761+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~TRF6XYAKY54D.0 size=148502 2024-09-14T11:17:14.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.763+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=TRF6XYAKY54D tag=LMYL8JE0DI97 type=write size=1197078 2024-09-14T11:17:14.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.765+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~I9SNJ3767PDK.0 size=1048576 2024-09-14T11:17:14.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.766+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~I9SNJ3767PDK.1 size=1048576 2024-09-14T11:17:14.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.767+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~I9SNJ3767PDK.2 size=507445 2024-09-14T11:17:14.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.767+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=I9SNJ3767PDK tag=EPPD7G5SHXNZ type=write size=3653173 2024-09-14T11:17:14.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.768+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~O8R66X2YPNN2.0 size=1048576 2024-09-14T11:17:14.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.769+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~O8R66X2YPNN2.1 size=1048576 2024-09-14T11:17:14.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.769+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~O8R66X2YPNN2.2 size=238460 2024-09-14T11:17:14.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.771+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=O8R66X2YPNN2 tag=1I3CB2PNUBVZ type=write size=3384188 2024-09-14T11:17:14.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.773+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=2WCM79HFR8AQ type=del size=1696863 2024-09-14T11:17:14.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.775+0000 7f185d9f8780 1 < suggested remove operation key=XPMGVU0U52GS tag=2O49QYNR6901 type=del 2024-09-14T11:17:14.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.776+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=XZ63IR4V0FUC type=del size=2038685 2024-09-14T11:17:14.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.779+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=AK1TADHPZIFE type=del 2024-09-14T11:17:14.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.780+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=QXD33D1EAZH1 type=del size=2441128 2024-09-14T11:17:14.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.782+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~W3KSQUABVW2G.0 size=1048576 2024-09-14T11:17:14.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.782+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~W3KSQUABVW2G.1 size=1048576 2024-09-14T11:17:14.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.782+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~W3KSQUABVW2G.2 size=429486 2024-09-14T11:17:14.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.785+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=W3KSQUABVW2G tag=D51S9X6K70CH type=write size=3575214 2024-09-14T11:17:14.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.787+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=JXWSEUULHVQN type=write size=438040 2024-09-14T11:17:14.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.789+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=PROOIBF4D7DJ type=del 2024-09-14T11:17:14.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.790+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=GORGEAM1KNQH type=del size=966362 2024-09-14T11:17:14.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.791+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~CL1YDRBDSDR3.0 size=1048576 2024-09-14T11:17:14.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.792+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~CL1YDRBDSDR3.1 size=1048576 2024-09-14T11:17:14.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.792+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~CL1YDRBDSDR3.2 size=463212 2024-09-14T11:17:14.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.794+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=CL1YDRBDSDR3 tag=U08CXLYJ7629 type=write size=3608940 2024-09-14T11:17:14.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.796+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~WPT21BXII94O.0 size=1048576 2024-09-14T11:17:14.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.797+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~WPT21BXII94O.1 size=1048576 2024-09-14T11:17:14.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.798+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~WPT21BXII94O.2 size=30355 2024-09-14T11:17:14.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.798+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=WPT21BXII94O tag=MABJH3HV8FR7 type=write size=3176083 2024-09-14T11:17:14.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.798+0000 7f185d9f8780 1 < canceled part key=_multipart_6MZGLP5KPPB3.2~ORNJ4BILGTIU.0 size=1048576 2024-09-14T11:17:14.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.799+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~ORNJ4BILGTIU.1 size=277416 2024-09-14T11:17:14.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.801+0000 7f185d9f8780 1 < canceled multipart upload key=6MZGLP5KPPB3 upload=ORNJ4BILGTIU tag=FIMCJY76IO0S type=write size=2374568 2024-09-14T11:17:14.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.802+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=UTFK54DSO0E9 type=del size=2418521 2024-09-14T11:17:14.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.804+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=DENG0K5ZZJOV type=write size=441878 2024-09-14T11:17:14.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.805+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=FV4RU7KSCWN0 type=del size=1798490 2024-09-14T11:17:14.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.806+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~CXD8OJTEUH6C.0 size=1048576 2024-09-14T11:17:14.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.806+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~CXD8OJTEUH6C.1 size=860345 2024-09-14T11:17:14.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.808+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=CXD8OJTEUH6C tag=34IN18TQFKM8 type=write size=2957497 2024-09-14T11:17:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.810+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~RZP7D4UGK00T.0 size=1048576 2024-09-14T11:17:14.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.811+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~RZP7D4UGK00T.1 size=1048576 2024-09-14T11:17:14.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.812+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~RZP7D4UGK00T.2 size=447168 2024-09-14T11:17:14.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.812+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=RZP7D4UGK00T tag=Y4H29VWQFTXW type=write size=3592896 2024-09-14T11:17:14.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.813+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~RJQ8W7YL452G.0 size=88483 2024-09-14T11:17:14.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.815+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=RJQ8W7YL452G tag=YH595J8A7RFR type=write size=1137059 2024-09-14T11:17:14.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.817+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~J851TS3GI4QT.0 size=1048576 2024-09-14T11:17:14.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.818+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~J851TS3GI4QT.1 size=652439 2024-09-14T11:17:14.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.818+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=J851TS3GI4QT tag=FOT4GU25TINI type=write size=2749591 2024-09-14T11:17:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.819+0000 7f185d9f8780 -1 < failed to complete operation key=XPMGVU0U52GS tag=LUZX2N37TV4N type=del size=3112123: (22) Invalid argument 2024-09-14T11:17:14.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.821+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=4QHQ4Y0T5PW7 type=write size=754163 2024-09-14T11:17:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.823+0000 7f185d9f8780 1 < suggested update operation key=CVVKY636WXG9 tag=HRA4JVG4JRVO type=del size=905506 2024-09-14T11:17:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.824+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=WHN4EGVNQVRK type=del size=1528253 2024-09-14T11:17:14.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.825+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=0NB9QULVDBJA type=del 2024-09-14T11:17:14.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.828+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~OV5T93I6C5PF.0 size=1048576 2024-09-14T11:17:14.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.828+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~OV5T93I6C5PF.1 size=1048576 2024-09-14T11:17:14.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.829+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~OV5T93I6C5PF.2 size=921993 2024-09-14T11:17:14.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.829+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=OV5T93I6C5PF tag=MZWHL0MZQZWT type=write size=4067721 2024-09-14T11:17:14.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.831+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~2AT0Y03AULBI.0 size=667662 2024-09-14T11:17:14.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.833+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=2AT0Y03AULBI tag=9ZDW2XWKG9BC type=write size=1716238 2024-09-14T11:17:14.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.834+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=YBA5A6C1AB8X type=del size=2468795 2024-09-14T11:17:14.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.835+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~36J43ONWWTVW.0 size=200800 2024-09-14T11:17:14.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.837+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=36J43ONWWTVW tag=YCJG1ZIBRHL7 type=write size=1249376 2024-09-14T11:17:14.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.839+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~DHBZUMTQLDMN.0 size=1048576 2024-09-14T11:17:14.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.840+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~DHBZUMTQLDMN.1 size=1048576 2024-09-14T11:17:14.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.841+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~DHBZUMTQLDMN.2 size=687420 2024-09-14T11:17:14.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.841+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=DHBZUMTQLDMN tag=AK5TSLW23EFP type=write size=3833148 2024-09-14T11:17:14.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.842+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~I9SNJ3767PDK.0 size=1048576 2024-09-14T11:17:14.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.843+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~I9SNJ3767PDK.1 size=1048576 2024-09-14T11:17:14.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.843+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~I9SNJ3767PDK.2 size=507445 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.845+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=I9SNJ3767PDK tag=EPPD7G5SHXNZ type=write size=3653173 2024-09-14T11:17:14.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.847+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~CIE00G28DNXD.0 size=1048576 2024-09-14T11:17:14.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.848+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~CIE00G28DNXD.1 size=1048576 2024-09-14T11:17:14.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.849+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~CIE00G28DNXD.2 size=562750 2024-09-14T11:17:14.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.849+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=CIE00G28DNXD tag=0ZMLG1E3ZXQT type=write size=3708478 2024-09-14T11:17:14.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.851+0000 7f185d9f8780 1 < suggested remove operation key=ZR3IEW48CSCF tag=2WCM79HFR8AQ type=del 2024-09-14T11:17:14.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.852+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=N0FO1A534KZX type=del size=1083442 2024-09-14T11:17:14.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.854+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=XZ63IR4V0FUC type=del 2024-09-14T11:17:14.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.856+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~VAKKDGZ8K10Q.0 size=1048576 2024-09-14T11:17:14.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.857+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~VAKKDGZ8K10Q.1 size=1048576 2024-09-14T11:17:14.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.858+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~VAKKDGZ8K10Q.2 size=280450 2024-09-14T11:17:14.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.858+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=VAKKDGZ8K10Q tag=MNTR5LGNLLA6 type=write size=3426178 2024-09-14T11:17:14.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.860+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=QXD33D1EAZH1 type=del 2024-09-14T11:17:14.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.862+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~QFT00T8UQ2FC.0 size=1048576 2024-09-14T11:17:14.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.863+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~QFT00T8UQ2FC.1 size=1048576 2024-09-14T11:17:14.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.864+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~QFT00T8UQ2FC.2 size=687369 2024-09-14T11:17:14.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.864+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=QFT00T8UQ2FC tag=9KP10LLHNMRC type=write size=3833097 2024-09-14T11:17:14.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.865+0000 7f185d9f8780 1 < completed write operation key=IXWIKD7J74RJ tag=JXWSEUULHVQN type=write size=438040 2024-09-14T11:17:14.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.867+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~F0W72ING6XNK.0 size=237477 2024-09-14T11:17:14.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.867+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=F0W72ING6XNK tag=BAZW4FOA72YS type=write size=1286053 2024-09-14T11:17:14.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.870+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=GORGEAM1KNQH type=del 2024-09-14T11:17:14.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.871+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=6A73XMV9RFNZ type=del size=487981 2024-09-14T11:17:14.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.872+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~WPT21BXII94O.0 size=1048576 2024-09-14T11:17:14.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.873+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~WPT21BXII94O.1 size=1048576 2024-09-14T11:17:14.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.873+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~WPT21BXII94O.2 size=30355 2024-09-14T11:17:14.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.875+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=WPT21BXII94O tag=MABJH3HV8FR7 type=write size=3176083 2024-09-14T11:17:14.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.876+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=W8NRHMS81KM4 type=del size=3251079 2024-09-14T11:17:14.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.878+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=UTFK54DSO0E9 type=del 2024-09-14T11:17:14.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.879+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=NB2PM8O7RFA8 type=del size=1146197 2024-09-14T11:17:14.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.880+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=FV4RU7KSCWN0 type=del 2024-09-14T11:17:14.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.881+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=9ZPQIOK1PSVU type=del size=1630208 2024-09-14T11:17:14.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.883+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~RZP7D4UGK00T.0 size=1048576 2024-09-14T11:17:14.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.884+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~RZP7D4UGK00T.1 size=1048576 2024-09-14T11:17:14.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.885+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~RZP7D4UGK00T.2 size=447168 2024-09-14T11:17:14.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.887+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=RZP7D4UGK00T tag=Y4H29VWQFTXW type=write size=3592896 2024-09-14T11:17:14.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.888+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=ZKQQ2V2L7T8G type=del size=957600 2024-09-14T11:17:14.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.889+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~J851TS3GI4QT.0 size=1048576 2024-09-14T11:17:14.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.890+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~J851TS3GI4QT.1 size=652439 2024-09-14T11:17:14.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.892+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=J851TS3GI4QT tag=FOT4GU25TINI type=write size=2749591 2024-09-14T11:17:14.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.894+0000 7f185d9f8780 1 > prepared part key=_multipart_ZR3IEW48CSCF.2~M82R79XTTAFK.0 size=648784 2024-09-14T11:17:14.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.894+0000 7f185d9f8780 1 > prepared multipart upload key=ZR3IEW48CSCF upload=M82R79XTTAFK tag=T4TUV52VS1HF type=write size=1697360 2024-09-14T11:17:14.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.898+0000 7f185d9f8780 1 < suggested remove operation key=55K4D3SEM068 tag=4QHQ4Y0T5PW7 type=write 2024-09-14T11:17:14.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.899+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=TN7EHQSLR0XV type=write size=41086 2024-09-14T11:17:14.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.900+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=WHN4EGVNQVRK type=del 2024-09-14T11:17:14.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.902+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=1N231HY75OB1 type=del size=3534559 2024-09-14T11:17:14.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.903+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~OV5T93I6C5PF.0 size=1048576 2024-09-14T11:17:14.903 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.904+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~OV5T93I6C5PF.1 size=1048576 2024-09-14T11:17:14.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.905+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~OV5T93I6C5PF.2 size=921993 2024-09-14T11:17:14.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.907+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=OV5T93I6C5PF tag=MZWHL0MZQZWT type=write size=4067721 2024-09-14T11:17:14.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.908+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=FROE3JTBXAKU type=del size=771096 2024-09-14T11:17:14.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.909+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=YBA5A6C1AB8X type=del 2024-09-14T11:17:14.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.911+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=T8AITSP0ML11 type=del size=4042202 2024-09-14T11:17:14.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.912+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~DHBZUMTQLDMN.0 size=1048576 2024-09-14T11:17:14.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.913+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~DHBZUMTQLDMN.1 size=1048576 2024-09-14T11:17:14.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.914+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~DHBZUMTQLDMN.2 size=687420 2024-09-14T11:17:14.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.916+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=DHBZUMTQLDMN tag=AK5TSLW23EFP type=write size=3833148 2024-09-14T11:17:14.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.917+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=RARU61659R6A type=write size=326453 2024-09-14T11:17:14.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.918+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~CIE00G28DNXD.0 size=1048576 2024-09-14T11:17:14.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.919+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~CIE00G28DNXD.1 size=1048576 2024-09-14T11:17:14.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.920+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~CIE00G28DNXD.2 size=562750 2024-09-14T11:17:14.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.923+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=CIE00G28DNXD tag=0ZMLG1E3ZXQT type=write size=3708478 2024-09-14T11:17:14.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.924+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=YZJ2MJ5ZACBD type=del size=2091133 2024-09-14T11:17:14.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.925+0000 7f185d9f8780 -1 < failed to complete operation key=CVVKY636WXG9 tag=N0FO1A534KZX type=del size=1083442: (22) Invalid argument 2024-09-14T11:17:14.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.927+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=H2PYL5S6AAS5 type=del size=247399 2024-09-14T11:17:14.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.928+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~VAKKDGZ8K10Q.0 size=1048576 2024-09-14T11:17:14.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.929+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~VAKKDGZ8K10Q.1 size=1048576 2024-09-14T11:17:14.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.930+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~VAKKDGZ8K10Q.2 size=280450 2024-09-14T11:17:14.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.932+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=VAKKDGZ8K10Q tag=MNTR5LGNLLA6 type=write size=3426178 2024-09-14T11:17:14.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.935+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~9JBFV14YHA11.0 size=857251 2024-09-14T11:17:14.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.935+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=9JBFV14YHA11 tag=M0A8T4WV4OV2 type=write size=1905827 2024-09-14T11:17:14.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.936+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~QFT00T8UQ2FC.0 size=1048576 2024-09-14T11:17:14.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.937+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~QFT00T8UQ2FC.1 size=1048576 2024-09-14T11:17:14.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.938+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~QFT00T8UQ2FC.2 size=687369 2024-09-14T11:17:14.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.940+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=QFT00T8UQ2FC tag=9KP10LLHNMRC type=write size=3833097 2024-09-14T11:17:14.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.941+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=R6LTKZDF765T type=write size=423211 2024-09-14T11:17:14.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.942+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~F0W72ING6XNK.0 size=237477 2024-09-14T11:17:14.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.944+0000 7f185d9f8780 1 < completed multipart upload key=JL2IH8NEX1YF upload=F0W72ING6XNK tag=BAZW4FOA72YS type=write size=1286053 2024-09-14T11:17:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.945+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=2KVDMT58M356 type=write size=494506 2024-09-14T11:17:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.946+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=6A73XMV9RFNZ type=del 2024-09-14T11:17:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.948+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=TQPFDLQ9F70U type=del size=1368388 2024-09-14T11:17:14.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.949+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=W8NRHMS81KM4 type=del 2024-09-14T11:17:14.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.950+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=N65XB089A0UI type=write size=271954 2024-09-14T11:17:14.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.951+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=NB2PM8O7RFA8 type=del 2024-09-14T11:17:14.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.953+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~PI1GA81ABCM8.0 size=876349 2024-09-14T11:17:14.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.953+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=PI1GA81ABCM8 tag=DT6J6S35ZUYH type=write size=1924925 2024-09-14T11:17:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.955+0000 7f185d9f8780 1 < completed delete operation key=J6RN3WULDLQE tag=9ZPQIOK1PSVU type=del 2024-09-14T11:17:14.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.957+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~GN3A11YR7ZEL.0 size=1048576 2024-09-14T11:17:14.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.958+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~GN3A11YR7ZEL.1 size=526221 2024-09-14T11:17:14.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.958+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=GN3A11YR7ZEL tag=0P9AC80HW1AB type=write size=2623373 2024-09-14T11:17:14.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.959+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=ZKQQ2V2L7T8G type=del 2024-09-14T11:17:14.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.961+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=SC0N4RFNBN3A type=del size=3775391 2024-09-14T11:17:14.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.962+0000 7f185d9f8780 1 < completed part key=_multipart_ZR3IEW48CSCF.2~M82R79XTTAFK.0 size=648784 2024-09-14T11:17:14.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.964+0000 7f185d9f8780 1 < completed multipart upload key=ZR3IEW48CSCF upload=M82R79XTTAFK tag=T4TUV52VS1HF type=write size=1697360 2024-09-14T11:17:14.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.965+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=R9E05I0QWSYD type=del size=1006947 2024-09-14T11:17:14.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.967+0000 7f185d9f8780 1 < canceled operation key=L4L83NVMXHXZ tag=TN7EHQSLR0XV type=write size=41086 2024-09-14T11:17:14.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.969+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~N7QYAY9SASPB.0 size=1048576 2024-09-14T11:17:14.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.970+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~N7QYAY9SASPB.1 size=1048576 2024-09-14T11:17:14.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.971+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~N7QYAY9SASPB.2 size=222071 2024-09-14T11:17:14.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.971+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=N7QYAY9SASPB tag=0AXYTHEK4IP3 type=write size=3367799 2024-09-14T11:17:14.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.972+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=1N231HY75OB1 type=del 2024-09-14T11:17:14.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.974+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~DFMB7G1F7SED.0 size=1048576 2024-09-14T11:17:14.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.975+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~DFMB7G1F7SED.1 size=1048576 2024-09-14T11:17:14.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.976+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~DFMB7G1F7SED.2 size=1017638 2024-09-14T11:17:14.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.976+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=DFMB7G1F7SED tag=BYQQG6TKG2ZO type=write size=4163366 2024-09-14T11:17:14.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.977+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=FROE3JTBXAKU type=del 2024-09-14T11:17:14.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.979+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~NTRYEQDEC7GG.0 size=441804 2024-09-14T11:17:14.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.979+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=NTRYEQDEC7GG tag=N45JXGZYD08J type=write size=1490380 2024-09-14T11:17:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.980+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=T8AITSP0ML11 type=del 2024-09-14T11:17:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.982+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=5WKUFKTADO4Y type=del size=4186371 2024-09-14T11:17:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.983+0000 7f185d9f8780 1 < completed write operation key=PSL63WUBLB75 tag=RARU61659R6A type=write size=326453 2024-09-14T11:17:14.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.985+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~NUDQGXUNJT0U.0 size=930521 2024-09-14T11:17:14.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.985+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=NUDQGXUNJT0U tag=JIV2X1CWOM6H type=write size=1979097 2024-09-14T11:17:14.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.986+0000 7f185d9f8780 1 < completed delete operation key=7XGG5LBGRI4H tag=YZJ2MJ5ZACBD type=del 2024-09-14T11:17:14.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.988+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~7MNADKLSBME9.0 size=1048576 2024-09-14T11:17:14.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.989+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~7MNADKLSBME9.1 size=1048576 2024-09-14T11:17:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.990+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~7MNADKLSBME9.2 size=603772 2024-09-14T11:17:14.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.990+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=7MNADKLSBME9 tag=VA9RIV9CFFYT type=write size=3749500 2024-09-14T11:17:14.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.993+0000 7f185d9f8780 1 < suggested remove operation key=JL2IH8NEX1YF tag=H2PYL5S6AAS5 type=del 2024-09-14T11:17:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.995+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~WDZ4TU000CAG.0 size=57934 2024-09-14T11:17:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.995+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=WDZ4TU000CAG tag=N9Q8I99F3S1E type=write size=1106510 2024-09-14T11:17:14.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.996+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~9JBFV14YHA11.0 size=857251 2024-09-14T11:17:14.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.998+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=9JBFV14YHA11 tag=M0A8T4WV4OV2 type=write size=1905827 2024-09-14T11:17:14.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:14.999+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=V4GBRTDZFJQZ type=del size=1034876 2024-09-14T11:17:15.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.001+0000 7f185d9f8780 1 < completed write operation key=ZR3IEW48CSCF tag=R6LTKZDF765T type=write size=423211 2024-09-14T11:17:15.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.003+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~Q3RIYIOZFJLA.0 size=381104 2024-09-14T11:17:15.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.003+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=Q3RIYIOZFJLA tag=XTUQS1LG5HY3 type=write size=1429680 2024-09-14T11:17:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.004+0000 7f185d9f8780 1 < completed write operation key=CVVKY636WXG9 tag=2KVDMT58M356 type=write size=494506 2024-09-14T11:17:15.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.005+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=9MK045YKSFY5 type=del size=4019812 2024-09-14T11:17:15.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.006+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=TQPFDLQ9F70U type=del 2024-09-14T11:17:15.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.008+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=UO9UEGKUM5G0 type=write size=190399 2024-09-14T11:17:15.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.009+0000 7f185d9f8780 1 < completed write operation key=CJ6C03RXS0IW tag=N65XB089A0UI type=write size=271954 2024-09-14T11:17:15.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.012+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=M150UKFQFNW2 type=write size=261717 2024-09-14T11:17:15.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.014+0000 7f185d9f8780 1 < completed part key=_multipart_N040R6OERAJP.2~PI1GA81ABCM8.0 size=876349 2024-09-14T11:17:15.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.016+0000 7f185d9f8780 1 < completed multipart upload key=N040R6OERAJP upload=PI1GA81ABCM8 tag=DT6J6S35ZUYH type=write size=1924925 2024-09-14T11:17:15.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.017+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=1LMRHO0KCXEI type=del size=1238708 2024-09-14T11:17:15.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.018+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~GN3A11YR7ZEL.0 size=1048576 2024-09-14T11:17:15.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.019+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~GN3A11YR7ZEL.1 size=526221 2024-09-14T11:17:15.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.022+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=GN3A11YR7ZEL tag=0P9AC80HW1AB type=write size=2623373 2024-09-14T11:17:15.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.024+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~QO9V2RNAOBIJ.0 size=1048576 2024-09-14T11:17:15.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.025+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~QO9V2RNAOBIJ.1 size=1048576 2024-09-14T11:17:15.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.025+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~QO9V2RNAOBIJ.2 size=327912 2024-09-14T11:17:15.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.025+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=QO9V2RNAOBIJ tag=LP6UAIHORY78 type=write size=3473640 2024-09-14T11:17:15.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.027+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=SC0N4RFNBN3A type=del size=3775391 2024-09-14T11:17:15.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.029+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~QZKR7ZL6JN4R.0 size=1048576 2024-09-14T11:17:15.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.029+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~QZKR7ZL6JN4R.1 size=798461 2024-09-14T11:17:15.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.029+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=QZKR7ZL6JN4R tag=LDKPLAA7J7DA type=write size=2895613 2024-09-14T11:17:15.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.031+0000 7f185d9f8780 1 < completed delete operation key=CJ6C03RXS0IW tag=R9E05I0QWSYD type=del 2024-09-14T11:17:15.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.032+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=VUMCA1XFJTA1 type=write size=441274 2024-09-14T11:17:15.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.033+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~N7QYAY9SASPB.0 size=1048576 2024-09-14T11:17:15.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.034+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~N7QYAY9SASPB.1 size=1048576 2024-09-14T11:17:15.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.035+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~N7QYAY9SASPB.2 size=222071 2024-09-14T11:17:15.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.036+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=N7QYAY9SASPB tag=0AXYTHEK4IP3 type=write size=3367799 2024-09-14T11:17:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.038+0000 7f185d9f8780 1 > prepared part key=_multipart_SEI774TP8YMJ.2~FF9PY0G3H02T.0 size=827380 2024-09-14T11:17:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.038+0000 7f185d9f8780 1 > prepared multipart upload key=SEI774TP8YMJ upload=FF9PY0G3H02T tag=Y3208YDU5AI9 type=write size=1875956 2024-09-14T11:17:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.040+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~DFMB7G1F7SED.0 size=1048576 2024-09-14T11:17:15.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.040+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~DFMB7G1F7SED.1 size=1048576 2024-09-14T11:17:15.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.041+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~DFMB7G1F7SED.2 size=1017638 2024-09-14T11:17:15.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.043+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=DFMB7G1F7SED tag=BYQQG6TKG2ZO type=write size=4163366 2024-09-14T11:17:15.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.044+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=VZQ9IKOJUX7Y type=write size=483888 2024-09-14T11:17:15.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.045+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~NTRYEQDEC7GG.0 size=441804 2024-09-14T11:17:15.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.047+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=NTRYEQDEC7GG tag=N45JXGZYD08J type=write size=1490380 2024-09-14T11:17:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.049+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=091QRM45XY0R type=write size=991536 2024-09-14T11:17:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.050+0000 7f185d9f8780 1 < completed delete operation key=N040R6OERAJP tag=5WKUFKTADO4Y type=del 2024-09-14T11:17:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.051+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=XZJ9OD3LAO3R type=del size=3557904 2024-09-14T11:17:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.051+0000 7f185d9f8780 1 < canceled part key=_multipart_N040R6OERAJP.2~NUDQGXUNJT0U.0 size=930521 2024-09-14T11:17:15.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.053+0000 7f185d9f8780 1 < canceled multipart upload key=N040R6OERAJP upload=NUDQGXUNJT0U tag=JIV2X1CWOM6H type=write size=1979097 2024-09-14T11:17:15.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.054+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=BRY2OCWU2KLI type=del size=3243492 2024-09-14T11:17:15.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.055+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~7MNADKLSBME9.0 size=1048576 2024-09-14T11:17:15.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.056+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~7MNADKLSBME9.1 size=1048576 2024-09-14T11:17:15.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.057+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~7MNADKLSBME9.2 size=603772 2024-09-14T11:17:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.059+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=7MNADKLSBME9 tag=VA9RIV9CFFYT type=write size=3749500 2024-09-14T11:17:15.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.061+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~57DE01K8D2C6.0 size=1048576 2024-09-14T11:17:15.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.062+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~57DE01K8D2C6.1 size=1048576 2024-09-14T11:17:15.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.063+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~57DE01K8D2C6.2 size=760623 2024-09-14T11:17:15.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.063+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=57DE01K8D2C6 tag=F99QXKK5F58A type=write size=3906351 2024-09-14T11:17:15.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.064+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~WDZ4TU000CAG.0 size=57934 2024-09-14T11:17:15.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.066+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=WDZ4TU000CAG tag=N9Q8I99F3S1E type=write size=1106510 2024-09-14T11:17:15.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.068+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~J1J3R2UF675J.0 size=1048576 2024-09-14T11:17:15.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.069+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~J1J3R2UF675J.1 size=279471 2024-09-14T11:17:15.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.069+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=J1J3R2UF675J tag=GKXG33BM6OK9 type=write size=2376623 2024-09-14T11:17:15.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.071+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=V4GBRTDZFJQZ type=del 2024-09-14T11:17:15.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.073+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~X1LUGUC1F12I.0 size=526740 2024-09-14T11:17:15.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.073+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=X1LUGUC1F12I tag=85B4Z2OX405W type=write size=1575316 2024-09-14T11:17:15.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.074+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~Q3RIYIOZFJLA.0 size=381104 2024-09-14T11:17:15.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.076+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=Q3RIYIOZFJLA tag=XTUQS1LG5HY3 type=write size=1429680 2024-09-14T11:17:15.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.077+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=GPKSZWGQTI89 type=del size=2620722 2024-09-14T11:17:15.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.078+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=9MK045YKSFY5 type=del 2024-09-14T11:17:15.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.079+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=4M2I6XMY8NQX type=del size=1204458 2024-09-14T11:17:15.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.081+0000 7f185d9f8780 1 < completed write operation key=1BOZ331NA7JA tag=UO9UEGKUM5G0 type=write size=190399 2024-09-14T11:17:15.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.082+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=WUO89WMFMHR2 type=del size=1676161 2024-09-14T11:17:15.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.083+0000 7f185d9f8780 1 < completed write operation key=N040R6OERAJP tag=M150UKFQFNW2 type=write size=261717 2024-09-14T11:17:15.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.085+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~ZPI53ELW9D35.0 size=1048576 2024-09-14T11:17:15.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.086+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~ZPI53ELW9D35.1 size=1048576 2024-09-14T11:17:15.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.087+0000 7f185d9f8780 1 > prepared part key=_multipart_7XGG5LBGRI4H.2~ZPI53ELW9D35.2 size=119797 2024-09-14T11:17:15.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.087+0000 7f185d9f8780 1 > prepared multipart upload key=7XGG5LBGRI4H upload=ZPI53ELW9D35 tag=KBVE5KCP2SB9 type=write size=3265525 2024-09-14T11:17:15.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.088+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=1LMRHO0KCXEI type=del 2024-09-14T11:17:15.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.091+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~5D1JJYZCO0B9.0 size=1048576 2024-09-14T11:17:15.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.092+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~5D1JJYZCO0B9.1 size=1048576 2024-09-14T11:17:15.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.092+0000 7f185d9f8780 1 > prepared part key=_multipart_JL2IH8NEX1YF.2~5D1JJYZCO0B9.2 size=703278 2024-09-14T11:17:15.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.092+0000 7f185d9f8780 1 > prepared multipart upload key=JL2IH8NEX1YF upload=5D1JJYZCO0B9 tag=0YCFOOD11JVO type=write size=3849006 2024-09-14T11:17:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.094+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~QO9V2RNAOBIJ.0 size=1048576 2024-09-14T11:17:15.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.095+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~QO9V2RNAOBIJ.1 size=1048576 2024-09-14T11:17:15.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.096+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~QO9V2RNAOBIJ.2 size=327912 2024-09-14T11:17:15.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.098+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=QO9V2RNAOBIJ tag=LP6UAIHORY78 type=write size=3473640 2024-09-14T11:17:15.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.100+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~Z0V26YKLTPOV.0 size=201778 2024-09-14T11:17:15.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.100+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=Z0V26YKLTPOV tag=FB7058H4OIV0 type=write size=1250354 2024-09-14T11:17:15.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.101+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~QZKR7ZL6JN4R.0 size=1048576 2024-09-14T11:17:15.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.102+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~QZKR7ZL6JN4R.1 size=798461 2024-09-14T11:17:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.104+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=QZKR7ZL6JN4R tag=LDKPLAA7J7DA type=write size=2895613 2024-09-14T11:17:15.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.106+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~24DM2TUHZO7L.0 size=1048576 2024-09-14T11:17:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.107+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~24DM2TUHZO7L.1 size=391443 2024-09-14T11:17:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.107+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=24DM2TUHZO7L tag=9IW1TM95RDPY type=write size=2488595 2024-09-14T11:17:15.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.108+0000 7f185d9f8780 1 < completed write operation key=JL2IH8NEX1YF tag=VUMCA1XFJTA1 type=write size=441274 2024-09-14T11:17:15.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.110+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~YTG5BI4PLY3X.0 size=1048576 2024-09-14T11:17:15.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.111+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~YTG5BI4PLY3X.1 size=737858 2024-09-14T11:17:15.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.111+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=YTG5BI4PLY3X tag=A0JJL8W6516Z type=write size=2835010 2024-09-14T11:17:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.113+0000 7f185d9f8780 1 < completed part key=_multipart_SEI774TP8YMJ.2~FF9PY0G3H02T.0 size=827380 2024-09-14T11:17:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.115+0000 7f185d9f8780 1 < completed multipart upload key=SEI774TP8YMJ upload=FF9PY0G3H02T tag=Y3208YDU5AI9 type=write size=1875956 2024-09-14T11:17:15.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.116+0000 7f185d9f8780 1 > prepared operation key=U5S6L8GPSMU5 tag=S1TZ60RI2VMG type=del size=3726044 2024-09-14T11:17:15.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.117+0000 7f185d9f8780 1 < completed write operation key=LGLAG80GX8GF tag=VZQ9IKOJUX7Y type=write size=483888 2024-09-14T11:17:15.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.120+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=YZH62FK1222V type=del size=823815 2024-09-14T11:17:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.121+0000 7f185d9f8780 1 < completed write operation key=CRZOT1D0U2F3 tag=091QRM45XY0R type=write size=991536 2024-09-14T11:17:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.122+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=MMD1VO2Q8CYL type=del size=1051587 2024-09-14T11:17:15.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.123+0000 7f185d9f8780 1 < completed delete operation key=CRZOT1D0U2F3 tag=XZJ9OD3LAO3R type=del 2024-09-14T11:17:15.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.126+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~Q6GKJSBX10Q5.0 size=1048576 2024-09-14T11:17:15.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.126+0000 7f185d9f8780 1 > prepared part key=_multipart_U5S6L8GPSMU5.2~Q6GKJSBX10Q5.1 size=394113 2024-09-14T11:17:15.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.126+0000 7f185d9f8780 1 > prepared multipart upload key=U5S6L8GPSMU5 upload=Q6GKJSBX10Q5 tag=0T9HD2KLV24F type=write size=2491265 2024-09-14T11:17:15.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.129+0000 7f185d9f8780 1 < suggested remove operation key=J6RN3WULDLQE tag=BRY2OCWU2KLI type=del 2024-09-14T11:17:15.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.131+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~LXWOC7VIZ2NU.0 size=1048576 2024-09-14T11:17:15.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.132+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~LXWOC7VIZ2NU.1 size=392141 2024-09-14T11:17:15.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.132+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=LXWOC7VIZ2NU tag=7PT1NP12WTT3 type=write size=2489293 2024-09-14T11:17:15.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.133+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~57DE01K8D2C6.0 size=1048576 2024-09-14T11:17:15.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.134+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~57DE01K8D2C6.1 size=1048576 2024-09-14T11:17:15.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.135+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~57DE01K8D2C6.2 size=760623 2024-09-14T11:17:15.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.137+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=57DE01K8D2C6 tag=F99QXKK5F58A type=write size=3906351 2024-09-14T11:17:15.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.138+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=KJYTQOFEGDAP type=del size=2088987 2024-09-14T11:17:15.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.139+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~J1J3R2UF675J.0 size=1048576 2024-09-14T11:17:15.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.140+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~J1J3R2UF675J.1 size=279471 2024-09-14T11:17:15.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.142+0000 7f185d9f8780 1 < completed multipart upload key=6B0SURI3Q8R6 upload=J1J3R2UF675J tag=GKXG33BM6OK9 type=write size=2376623 2024-09-14T11:17:15.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.144+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~8YHWVNT9PZA4.0 size=1048576 2024-09-14T11:17:15.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.145+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~8YHWVNT9PZA4.1 size=1048576 2024-09-14T11:17:15.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.146+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~8YHWVNT9PZA4.2 size=764993 2024-09-14T11:17:15.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.146+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=8YHWVNT9PZA4 tag=FN2DUMH09RI5 type=write size=3910721 2024-09-14T11:17:15.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.146+0000 7f185d9f8780 1 < canceled part key=_multipart_DAKWA1OCVTBG.2~X1LUGUC1F12I.0 size=526740 2024-09-14T11:17:15.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.148+0000 7f185d9f8780 1 < canceled multipart upload key=DAKWA1OCVTBG upload=X1LUGUC1F12I tag=85B4Z2OX405W type=write size=1575316 2024-09-14T11:17:15.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.149+0000 7f185d9f8780 1 > prepared operation key=JL2IH8NEX1YF tag=E8ZIWJ43WQLA type=write size=262563 2024-09-14T11:17:15.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.150+0000 7f185d9f8780 1 < canceled operation key=U5S6L8GPSMU5 tag=GPKSZWGQTI89 type=del size=2620722 2024-09-14T11:17:15.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.152+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~XRZK68YWS0S7.0 size=1048576 2024-09-14T11:17:15.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.153+0000 7f185d9f8780 1 > prepared part key=_multipart_OYZIXCSGXTHR.2~XRZK68YWS0S7.1 size=633698 2024-09-14T11:17:15.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.153+0000 7f185d9f8780 1 > prepared multipart upload key=OYZIXCSGXTHR upload=XRZK68YWS0S7 tag=1ZUBS3WED579 type=write size=2730850 2024-09-14T11:17:15.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.154+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=4M2I6XMY8NQX type=del 2024-09-14T11:17:15.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.156+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~8TGI7D3WKAHS.0 size=1048576 2024-09-14T11:17:15.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.157+0000 7f185d9f8780 1 > prepared part key=_multipart_6B0SURI3Q8R6.2~8TGI7D3WKAHS.1 size=345818 2024-09-14T11:17:15.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.157+0000 7f185d9f8780 1 > prepared multipart upload key=6B0SURI3Q8R6 upload=8TGI7D3WKAHS tag=D4ACQCIC7RTQ type=write size=2442970 2024-09-14T11:17:15.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.159+0000 7f185d9f8780 1 < suggested update operation key=M4FJDW1QHGBM tag=WUO89WMFMHR2 type=del size=1676161 2024-09-14T11:17:15.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.160+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=0X1VQ9HY6WCF type=del size=1877046 2024-09-14T11:17:15.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.161+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~ZPI53ELW9D35.0 size=1048576 2024-09-14T11:17:15.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.162+0000 7f185d9f8780 1 < completed part key=_multipart_7XGG5LBGRI4H.2~ZPI53ELW9D35.1 size=1048576 2024-09-14T11:17:15.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.162+0000 7f185d9f8780 1 < canceled part key=_multipart_7XGG5LBGRI4H.2~ZPI53ELW9D35.2 size=119797 2024-09-14T11:17:15.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.164+0000 7f185d9f8780 1 < canceled multipart upload key=7XGG5LBGRI4H upload=ZPI53ELW9D35 tag=KBVE5KCP2SB9 type=write size=3265525 2024-09-14T11:17:15.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.165+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=8AF1I6LRR3Q1 type=del size=1661317 2024-09-14T11:17:15.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.165+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~5D1JJYZCO0B9.0 size=1048576 2024-09-14T11:17:15.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.166+0000 7f185d9f8780 1 < completed part key=_multipart_JL2IH8NEX1YF.2~5D1JJYZCO0B9.1 size=1048576 2024-09-14T11:17:15.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.166+0000 7f185d9f8780 1 < canceled part key=_multipart_JL2IH8NEX1YF.2~5D1JJYZCO0B9.2 size=703278 2024-09-14T11:17:15.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.168+0000 7f185d9f8780 1 < canceled multipart upload key=JL2IH8NEX1YF upload=5D1JJYZCO0B9 tag=0YCFOOD11JVO type=write size=3849006 2024-09-14T11:17:15.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.170+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=M8EUR6QXXGB2 type=del size=3586555 2024-09-14T11:17:15.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.171+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~Z0V26YKLTPOV.0 size=201778 2024-09-14T11:17:15.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.174+0000 7f185d9f8780 1 < completed multipart upload key=HLUMY48G90KB upload=Z0V26YKLTPOV tag=FB7058H4OIV0 type=write size=1250354 2024-09-14T11:17:15.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.175+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=C4T47KMJSL5L type=del size=915456 2024-09-14T11:17:15.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.176+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~24DM2TUHZO7L.0 size=1048576 2024-09-14T11:17:15.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.177+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~24DM2TUHZO7L.1 size=391443 2024-09-14T11:17:15.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.179+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=24DM2TUHZO7L tag=9IW1TM95RDPY type=write size=2488595 2024-09-14T11:17:15.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.181+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~GORKCO3MJMXR.0 size=652426 2024-09-14T11:17:15.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.181+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=GORKCO3MJMXR tag=TVRU92MPKRZ8 type=write size=1701002 2024-09-14T11:17:15.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.182+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~YTG5BI4PLY3X.0 size=1048576 2024-09-14T11:17:15.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.183+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~YTG5BI4PLY3X.1 size=737858 2024-09-14T11:17:15.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.185+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=YTG5BI4PLY3X tag=A0JJL8W6516Z type=write size=2835010 2024-09-14T11:17:15.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.186+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=8R1QVUWXE0PU type=del size=2920230 2024-09-14T11:17:15.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.188+0000 7f185d9f8780 1 < completed delete operation key=U5S6L8GPSMU5 tag=S1TZ60RI2VMG type=del 2024-09-14T11:17:15.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.190+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~MAXZP2QFKAFP.0 size=65629 2024-09-14T11:17:15.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.190+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=MAXZP2QFKAFP tag=7MKQ1MG4TKJT type=write size=1114205 2024-09-14T11:17:15.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.191+0000 7f185d9f8780 1 < canceled operation key=SEI774TP8YMJ tag=YZH62FK1222V type=del size=823815 2024-09-14T11:17:15.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.192+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=M542LUEDC8AJ type=write size=1016079 2024-09-14T11:17:15.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.193+0000 7f185d9f8780 1 < completed delete operation key=JL2IH8NEX1YF tag=MMD1VO2Q8CYL type=del 2024-09-14T11:17:15.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.194+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=WZA9JN3GGYO0 type=write size=548822 2024-09-14T11:17:15.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.195+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~Q6GKJSBX10Q5.0 size=1048576 2024-09-14T11:17:15.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.196+0000 7f185d9f8780 1 < completed part key=_multipart_U5S6L8GPSMU5.2~Q6GKJSBX10Q5.1 size=394113 2024-09-14T11:17:15.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.198+0000 7f185d9f8780 1 < completed multipart upload key=U5S6L8GPSMU5 upload=Q6GKJSBX10Q5 tag=0T9HD2KLV24F type=write size=2491265 2024-09-14T11:17:15.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.200+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=OCXMKK6EFB4J type=del size=2789210 2024-09-14T11:17:15.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.201+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~LXWOC7VIZ2NU.0 size=1048576 2024-09-14T11:17:15.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.202+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~LXWOC7VIZ2NU.1 size=392141 2024-09-14T11:17:15.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.204+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=LXWOC7VIZ2NU tag=7PT1NP12WTT3 type=write size=2489293 2024-09-14T11:17:15.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.206+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~LSN1O4X9T202.0 size=81538 2024-09-14T11:17:15.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.206+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=LSN1O4X9T202 tag=Y284EZA9J6HG type=write size=1130114 2024-09-14T11:17:15.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.208+0000 7f185d9f8780 1 < completed delete operation key=ESN8NVVJB3B0 tag=KJYTQOFEGDAP type=del 2024-09-14T11:17:15.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.209+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=EQ89QTOBT8DJ type=del size=352266 2024-09-14T11:17:15.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.211+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~8YHWVNT9PZA4.0 size=1048576 2024-09-14T11:17:15.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.212+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~8YHWVNT9PZA4.1 size=1048576 2024-09-14T11:17:15.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.213+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~8YHWVNT9PZA4.2 size=764993 2024-09-14T11:17:15.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.215+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=8YHWVNT9PZA4 tag=FN2DUMH09RI5 type=write size=3910721 2024-09-14T11:17:15.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.217+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~8VPFHF1CW37W.0 size=208555 2024-09-14T11:17:15.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.217+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=8VPFHF1CW37W tag=0FGW1YPORD07 type=write size=1257131 2024-09-14T11:17:15.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.219+0000 7f185d9f8780 1 < completed write operation key=JL2IH8NEX1YF tag=E8ZIWJ43WQLA type=write size=262563 2024-09-14T11:17:15.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.221+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~T8N7PQ3MN2DX.0 size=1048576 2024-09-14T11:17:15.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.222+0000 7f185d9f8780 1 > prepared part key=_multipart_MPZOX5RU0580.2~T8N7PQ3MN2DX.1 size=255340 2024-09-14T11:17:15.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.222+0000 7f185d9f8780 1 > prepared multipart upload key=MPZOX5RU0580 upload=T8N7PQ3MN2DX tag=MYMY9LUMJ60T type=write size=2352492 2024-09-14T11:17:15.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.223+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~XRZK68YWS0S7.0 size=1048576 2024-09-14T11:17:15.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.224+0000 7f185d9f8780 1 < completed part key=_multipart_OYZIXCSGXTHR.2~XRZK68YWS0S7.1 size=633698 2024-09-14T11:17:15.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.226+0000 7f185d9f8780 1 < completed multipart upload key=OYZIXCSGXTHR upload=XRZK68YWS0S7 tag=1ZUBS3WED579 type=write size=2730850 2024-09-14T11:17:15.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.227+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=76XTEPTYB3HN type=del size=833655 2024-09-14T11:17:15.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.227+0000 7f185d9f8780 1 < canceled part key=_multipart_6B0SURI3Q8R6.2~8TGI7D3WKAHS.0 size=1048576 2024-09-14T11:17:15.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.229+0000 7f185d9f8780 1 < completed part key=_multipart_6B0SURI3Q8R6.2~8TGI7D3WKAHS.1 size=345818 2024-09-14T11:17:15.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.231+0000 7f185d9f8780 1 < canceled multipart upload key=6B0SURI3Q8R6 upload=8TGI7D3WKAHS tag=D4ACQCIC7RTQ type=write size=2442970 2024-09-14T11:17:15.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.232+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=QQNU3G62QWSP type=del size=978245 2024-09-14T11:17:15.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.235+0000 7f185d9f8780 1 < suggested remove operation key=087PN6V1BP65 tag=0X1VQ9HY6WCF type=del 2024-09-14T11:17:15.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.237+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2HYKVFW2ZQNI.0 size=1048576 2024-09-14T11:17:15.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.237+0000 7f185d9f8780 1 > prepared part key=_multipart_CRZOT1D0U2F3.2~2HYKVFW2ZQNI.1 size=876601 2024-09-14T11:17:15.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.237+0000 7f185d9f8780 1 > prepared multipart upload key=CRZOT1D0U2F3 upload=2HYKVFW2ZQNI tag=0SN97DOGODUO type=write size=2973753 2024-09-14T11:17:15.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.239+0000 7f185d9f8780 -1 < failed to complete operation key=087PN6V1BP65 tag=8AF1I6LRR3Q1 type=del size=1661317: (22) Invalid argument 2024-09-14T11:17:15.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.241+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~RPV06Z0OCZQU.0 size=1048576 2024-09-14T11:17:15.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.241+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~RPV06Z0OCZQU.1 size=1048576 2024-09-14T11:17:15.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.242+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~RPV06Z0OCZQU.2 size=260315 2024-09-14T11:17:15.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.242+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=RPV06Z0OCZQU tag=QBD62FYMOTWC type=write size=3406043 2024-09-14T11:17:15.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.243+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=M8EUR6QXXGB2 type=del 2024-09-14T11:17:15.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.245+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=UQUR3AY2XQ8B type=del size=3848470 2024-09-14T11:17:15.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.246+0000 7f185d9f8780 1 < canceled operation key=L4L83NVMXHXZ tag=C4T47KMJSL5L type=del size=915456 2024-09-14T11:17:15.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.247+0000 7f185d9f8780 1 > prepared operation key=WPBYTFP7HRVE tag=FWOTFN6EDSO5 type=del size=1156625 2024-09-14T11:17:15.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.248+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~GORKCO3MJMXR.0 size=652426 2024-09-14T11:17:15.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.250+0000 7f185d9f8780 1 < completed multipart upload key=O2Y34FSQHS1S upload=GORKCO3MJMXR tag=TVRU92MPKRZ8 type=write size=1701002 2024-09-14T11:17:15.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.251+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=YF18B6C00RDY type=del size=3287210 2024-09-14T11:17:15.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.252+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=8R1QVUWXE0PU type=del 2024-09-14T11:17:15.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.254+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=3BUNP09QWDJ2 type=del size=1161123 2024-09-14T11:17:15.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.255+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~MAXZP2QFKAFP.0 size=65629 2024-09-14T11:17:15.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.256+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=MAXZP2QFKAFP tag=7MKQ1MG4TKJT type=write size=1114205 2024-09-14T11:17:15.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.258+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=5IGSB43SCFXI type=write size=811619 2024-09-14T11:17:15.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.259+0000 7f185d9f8780 1 < completed write operation key=7XGG5LBGRI4H tag=M542LUEDC8AJ type=write size=1016079 2024-09-14T11:17:15.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.260+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=DHS1Y4VV0BMK type=del size=1976379 2024-09-14T11:17:15.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.261+0000 7f185d9f8780 1 < canceled operation key=W24KN3J819EB tag=WZA9JN3GGYO0 type=write size=548822 2024-09-14T11:17:15.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.262+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=AT40I2Q0914K type=del size=2880791 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.263+0000 7f185d9f8780 -1 < failed to complete operation key=087PN6V1BP65 tag=OCXMKK6EFB4J type=del size=2789210: (22) Invalid argument 2024-09-14T11:17:15.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.265+0000 7f185d9f8780 1 > prepared part key=_multipart_LGLAG80GX8GF.2~0K6U1F78GF47.0 size=234306 2024-09-14T11:17:15.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.265+0000 7f185d9f8780 1 > prepared multipart upload key=LGLAG80GX8GF upload=0K6U1F78GF47 tag=47CI6GJ6XWKZ type=write size=1282882 2024-09-14T11:17:15.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.266+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~LSN1O4X9T202.0 size=81538 2024-09-14T11:17:15.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.268+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=LSN1O4X9T202 tag=Y284EZA9J6HG type=write size=1130114 2024-09-14T11:17:15.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.269+0000 7f185d9f8780 1 > prepared operation key=DAKWA1OCVTBG tag=N2UV0QD9YADU type=del size=1827019 2024-09-14T11:17:15.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.270+0000 7f185d9f8780 1 < completed delete operation key=MPZOX5RU0580 tag=EQ89QTOBT8DJ type=del 2024-09-14T11:17:15.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.271+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=Z87R8A63VBBP type=del size=3057430 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.273+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~8VPFHF1CW37W.0 size=208555 2024-09-14T11:17:15.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.274+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=8VPFHF1CW37W tag=0FGW1YPORD07 type=write size=1257131 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.275+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=MKAFW26SQ433 type=del size=3621517 2024-09-14T11:17:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.277+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~T8N7PQ3MN2DX.0 size=1048576 2024-09-14T11:17:15.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.277+0000 7f185d9f8780 1 < completed part key=_multipart_MPZOX5RU0580.2~T8N7PQ3MN2DX.1 size=255340 2024-09-14T11:17:15.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.279+0000 7f185d9f8780 1 < completed multipart upload key=MPZOX5RU0580 upload=T8N7PQ3MN2DX tag=MYMY9LUMJ60T type=write size=2352492 2024-09-14T11:17:15.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.280+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=DGER6CH0IVXF type=write size=766155 2024-09-14T11:17:15.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.282+0000 7f185d9f8780 1 < canceled operation key=J6RN3WULDLQE tag=76XTEPTYB3HN type=del size=833655 2024-09-14T11:17:15.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.283+0000 7f185d9f8780 1 > prepared operation key=L4L83NVMXHXZ tag=EBK235WABG2A type=del size=3870648 2024-09-14T11:17:15.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.284+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=QQNU3G62QWSP type=del 2024-09-14T11:17:15.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.285+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=X1Z3FC8LVLJ1 type=del size=2381915 2024-09-14T11:17:15.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.286+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2HYKVFW2ZQNI.0 size=1048576 2024-09-14T11:17:15.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.287+0000 7f185d9f8780 1 < completed part key=_multipart_CRZOT1D0U2F3.2~2HYKVFW2ZQNI.1 size=876601 2024-09-14T11:17:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.289+0000 7f185d9f8780 1 < completed multipart upload key=CRZOT1D0U2F3 upload=2HYKVFW2ZQNI tag=0SN97DOGODUO type=write size=2973753 2024-09-14T11:17:15.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.290+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=ZZPIVM7BGNUX type=write size=591864 2024-09-14T11:17:15.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.290+0000 7f185d9f8780 1 < canceled part key=_multipart_LGLAG80GX8GF.2~RPV06Z0OCZQU.0 size=1048576 2024-09-14T11:17:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.291+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~RPV06Z0OCZQU.1 size=1048576 2024-09-14T11:17:15.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.292+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~RPV06Z0OCZQU.2 size=260315 2024-09-14T11:17:15.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.294+0000 7f185d9f8780 1 < canceled multipart upload key=LGLAG80GX8GF upload=RPV06Z0OCZQU tag=QBD62FYMOTWC type=write size=3406043 2024-09-14T11:17:15.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.295+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=B8UR5KLRMPA8 type=del size=4036263 2024-09-14T11:17:15.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.297+0000 7f185d9f8780 1 < suggested update operation key=H29SXBS4N9JK tag=UQUR3AY2XQ8B type=del size=3848470 2024-09-14T11:17:15.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.298+0000 7f185d9f8780 1 > prepared operation key=CJ6C03RXS0IW tag=4DYJ7IFCD993 type=del size=2664762 2024-09-14T11:17:15.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.300+0000 7f185d9f8780 1 < suggested update operation key=WPBYTFP7HRVE tag=FWOTFN6EDSO5 type=del size=1156625 2024-09-14T11:17:15.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.301+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=PBQE053P5SMY type=del size=3976333 2024-09-14T11:17:15.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.303+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=YF18B6C00RDY type=del 2024-09-14T11:17:15.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.304+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=SY2EH748VJBW type=del size=887920 2024-09-14T11:17:15.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.305+0000 7f185d9f8780 1 < canceled operation key=L4L83NVMXHXZ tag=3BUNP09QWDJ2 type=del size=1161123 2024-09-14T11:17:15.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.306+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=JWJ0ROB0PDW8 type=del size=1359917 2024-09-14T11:17:15.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.307+0000 7f185d9f8780 1 < completed write operation key=ESN8NVVJB3B0 tag=5IGSB43SCFXI type=write size=811619 2024-09-14T11:17:15.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.309+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=09H5YYMNJ2C7 type=write size=715379 2024-09-14T11:17:15.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.310+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=DHS1Y4VV0BMK type=del 2024-09-14T11:17:15.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.311+0000 7f185d9f8780 1 > prepared operation key=XPMGVU0U52GS tag=LAPUYDG4ABLJ type=del size=518400 2024-09-14T11:17:15.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.313+0000 7f185d9f8780 1 < suggested remove operation key=CJ6C03RXS0IW tag=AT40I2Q0914K type=del 2024-09-14T11:17:15.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.315+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~1UU01LENSK2C.0 size=1048576 2024-09-14T11:17:15.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.316+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~1UU01LENSK2C.1 size=1048576 2024-09-14T11:17:15.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.317+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~1UU01LENSK2C.2 size=134469 2024-09-14T11:17:15.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.317+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=1UU01LENSK2C tag=7YALQ0IKV0SH type=write size=3280197 2024-09-14T11:17:15.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.319+0000 7f185d9f8780 1 < completed part key=_multipart_LGLAG80GX8GF.2~0K6U1F78GF47.0 size=234306 2024-09-14T11:17:15.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.321+0000 7f185d9f8780 1 < completed multipart upload key=LGLAG80GX8GF upload=0K6U1F78GF47 tag=47CI6GJ6XWKZ type=write size=1282882 2024-09-14T11:17:15.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.322+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=6Q04WLWWJY69 type=del size=1076825 2024-09-14T11:17:15.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.323+0000 7f185d9f8780 1 < completed delete operation key=DAKWA1OCVTBG tag=N2UV0QD9YADU type=del 2024-09-14T11:17:15.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.325+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=0RYO47NFMPW5 type=del size=3396202 2024-09-14T11:17:15.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.326+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=Z87R8A63VBBP type=del 2024-09-14T11:17:15.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.327+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=VUAIA2PGCDEY type=del size=1564875 2024-09-14T11:17:15.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.328+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=MKAFW26SQ433 type=del 2024-09-14T11:17:15.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.330+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~9KE7B90A63YN.0 size=1048576 2024-09-14T11:17:15.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.331+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~9KE7B90A63YN.1 size=979449 2024-09-14T11:17:15.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.331+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=9KE7B90A63YN tag=F1D7UBKEC3L6 type=write size=3076601 2024-09-14T11:17:15.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.334+0000 7f185d9f8780 1 < suggested update operation key=7XGG5LBGRI4H tag=DGER6CH0IVXF type=write size=766155 2024-09-14T11:17:15.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.335+0000 7f185d9f8780 1 > prepared operation key=MPZOX5RU0580 tag=AHEGV25TMLZV type=del size=275169 2024-09-14T11:17:15.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.336+0000 7f185d9f8780 1 < completed delete operation key=L4L83NVMXHXZ tag=EBK235WABG2A type=del 2024-09-14T11:17:15.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.339+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~FFVEUCZ7B0V9.0 size=1048576 2024-09-14T11:17:15.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.340+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~FFVEUCZ7B0V9.1 size=436615 2024-09-14T11:17:15.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.340+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=FFVEUCZ7B0V9 tag=OC316580LRVZ type=write size=2533767 2024-09-14T11:17:15.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.343+0000 7f185d9f8780 1 < suggested remove operation key=MPZOX5RU0580 tag=X1Z3FC8LVLJ1 type=del 2024-09-14T11:17:15.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.344+0000 7f185d9f8780 1 > prepared operation key=ZR3IEW48CSCF tag=95RL90NA8CF0 type=del size=226133 2024-09-14T11:17:15.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.346+0000 7f185d9f8780 -1 < failed to complete operation key=7XGG5LBGRI4H tag=ZZPIVM7BGNUX type=write size=591864: (22) Invalid argument 2024-09-14T11:17:15.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.347+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=232WIR4J0AYT type=del size=3212607 2024-09-14T11:17:15.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.348+0000 7f185d9f8780 1 < canceled operation key=O2Y34FSQHS1S tag=B8UR5KLRMPA8 type=del size=4036263 2024-09-14T11:17:15.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.349+0000 7f185d9f8780 1 > prepared operation key=6B0SURI3Q8R6 tag=ZCMMT8LOL4WN type=del size=1761244 2024-09-14T11:17:15.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.350+0000 7f185d9f8780 -1 < failed to complete operation key=CJ6C03RXS0IW tag=4DYJ7IFCD993 type=del size=2664762: (22) Invalid argument 2024-09-14T11:17:15.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.353+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~81WSGDUTU27T.0 size=1048576 2024-09-14T11:17:15.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.354+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~81WSGDUTU27T.1 size=277329 2024-09-14T11:17:15.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.354+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=81WSGDUTU27T tag=9EP69YJZ7M2M type=write size=2374481 2024-09-14T11:17:15.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.356+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=PBQE053P5SMY type=del 2024-09-14T11:17:15.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.358+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~SHKOI53306VB.0 size=1048576 2024-09-14T11:17:15.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.360+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~SHKOI53306VB.1 size=660548 2024-09-14T11:17:15.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.360+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=SHKOI53306VB tag=FFB7J4KGQOWP type=write size=2757700 2024-09-14T11:17:15.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.361+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=SY2EH748VJBW type=del 2024-09-14T11:17:15.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.362+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=60LN3OTZJ30Q type=write size=294075 2024-09-14T11:17:15.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.363+0000 7f185d9f8780 1 < canceled operation key=6MZGLP5KPPB3 tag=JWJ0ROB0PDW8 type=del size=1359917 2024-09-14T11:17:15.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.365+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=VN4ZLGDYT27Q type=del size=1016093 2024-09-14T11:17:15.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.366+0000 7f185d9f8780 1 < completed write operation key=LGLAG80GX8GF tag=09H5YYMNJ2C7 type=write size=715379 2024-09-14T11:17:15.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.367+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=UPABLMZSB1SN type=del size=4126461 2024-09-14T11:17:15.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.368+0000 7f185d9f8780 1 < completed delete operation key=XPMGVU0U52GS tag=LAPUYDG4ABLJ type=del 2024-09-14T11:17:15.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.370+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=UYW1138LSSTJ type=del size=856929 2024-09-14T11:17:15.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.370+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~1UU01LENSK2C.0 size=1048576 2024-09-14T11:17:15.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.371+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~1UU01LENSK2C.1 size=1048576 2024-09-14T11:17:15.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.372+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~1UU01LENSK2C.2 size=134469 2024-09-14T11:17:15.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.374+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=1UU01LENSK2C tag=7YALQ0IKV0SH type=write size=3280197 2024-09-14T11:17:15.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.375+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=VAVT3QW5N9Q0 type=del size=2850094 2024-09-14T11:17:15.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.376+0000 7f185d9f8780 -1 < failed to complete operation key=MPZOX5RU0580 tag=6Q04WLWWJY69 type=del size=1076825: (22) Invalid argument 2024-09-14T11:17:15.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.378+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=GR85H6AX3BRU type=write size=716591 2024-09-14T11:17:15.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.379+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=0RYO47NFMPW5 type=del 2024-09-14T11:17:15.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.380+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=CU2W7NR6ZG4L type=write size=846415 2024-09-14T11:17:15.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.382+0000 7f185d9f8780 1 < canceled operation key=M4FJDW1QHGBM tag=VUAIA2PGCDEY type=del size=1564875 2024-09-14T11:17:15.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.383+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=IDKVC3WWTQFU type=del size=2491804 2024-09-14T11:17:15.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.384+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~9KE7B90A63YN.0 size=1048576 2024-09-14T11:17:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.385+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~9KE7B90A63YN.1 size=979449 2024-09-14T11:17:15.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.387+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=9KE7B90A63YN tag=F1D7UBKEC3L6 type=write size=3076601 2024-09-14T11:17:15.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.388+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=9UCMSEW203E8 type=del size=3714943 2024-09-14T11:17:15.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.389+0000 7f185d9f8780 -1 < failed to complete operation key=MPZOX5RU0580 tag=AHEGV25TMLZV type=del size=275169: (22) Invalid argument 2024-09-14T11:17:15.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.392+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~1ZPUIBT5XAJR.0 size=1048576 2024-09-14T11:17:15.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.393+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~1ZPUIBT5XAJR.1 size=1048576 2024-09-14T11:17:15.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.393+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~1ZPUIBT5XAJR.2 size=455436 2024-09-14T11:17:15.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.393+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=1ZPUIBT5XAJR tag=QFAE3GI9VLL4 type=write size=3601164 2024-09-14T11:17:15.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.394+0000 7f185d9f8780 1 < canceled part key=_multipart_CVVKY636WXG9.2~FFVEUCZ7B0V9.0 size=1048576 2024-09-14T11:17:15.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.395+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~FFVEUCZ7B0V9.1 size=436615 2024-09-14T11:17:15.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.397+0000 7f185d9f8780 1 < canceled multipart upload key=CVVKY636WXG9 upload=FFVEUCZ7B0V9 tag=OC316580LRVZ type=write size=2533767 2024-09-14T11:17:15.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.398+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=O9H35EIVIAQU type=write size=364561 2024-09-14T11:17:15.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.400+0000 7f185d9f8780 1 < completed delete operation key=ZR3IEW48CSCF tag=95RL90NA8CF0 type=del 2024-09-14T11:17:15.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.401+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=KMWVLSJ9CGMN type=write size=295380 2024-09-14T11:17:15.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.403+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=232WIR4J0AYT type=del 2024-09-14T11:17:15.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.405+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~YZB1DOP53127.0 size=1048576 2024-09-14T11:17:15.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.406+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~YZB1DOP53127.1 size=1048576 2024-09-14T11:17:15.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.407+0000 7f185d9f8780 1 > prepared part key=_multipart_HLUMY48G90KB.2~YZB1DOP53127.2 size=925142 2024-09-14T11:17:15.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.407+0000 7f185d9f8780 1 > prepared multipart upload key=HLUMY48G90KB upload=YZB1DOP53127 tag=5NBOJMBG4LXJ type=write size=4070870 2024-09-14T11:17:15.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.409+0000 7f185d9f8780 1 < completed delete operation key=6B0SURI3Q8R6 tag=ZCMMT8LOL4WN type=del 2024-09-14T11:17:15.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.410+0000 7f185d9f8780 1 > prepared operation key=087PN6V1BP65 tag=W6QGQ38OEKCA type=del size=3429487 2024-09-14T11:17:15.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.411+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~81WSGDUTU27T.0 size=1048576 2024-09-14T11:17:15.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.411+0000 7f185d9f8780 1 < canceled part key=_multipart_M4FJDW1QHGBM.2~81WSGDUTU27T.1 size=277329 2024-09-14T11:17:15.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.413+0000 7f185d9f8780 1 < canceled multipart upload key=M4FJDW1QHGBM upload=81WSGDUTU27T tag=9EP69YJZ7M2M type=write size=2374481 2024-09-14T11:17:15.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.416+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~10NNTX2V2OCL.0 size=1048576 2024-09-14T11:17:15.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.417+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~10NNTX2V2OCL.1 size=859890 2024-09-14T11:17:15.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.417+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=10NNTX2V2OCL tag=KEEECJW9R801 type=write size=2957042 2024-09-14T11:17:15.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.417+0000 7f185d9f8780 1 < canceled part key=_multipart_CJ6C03RXS0IW.2~SHKOI53306VB.0 size=1048576 2024-09-14T11:17:15.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.418+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~SHKOI53306VB.1 size=660548 2024-09-14T11:17:15.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.420+0000 7f185d9f8780 1 < canceled multipart upload key=CJ6C03RXS0IW upload=SHKOI53306VB tag=FFB7J4KGQOWP type=write size=2757700 2024-09-14T11:17:15.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.422+0000 7f185d9f8780 1 > prepared part key=_multipart_WPBYTFP7HRVE.2~YGCPV9WRJPRR.0 size=910529 2024-09-14T11:17:15.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.422+0000 7f185d9f8780 1 > prepared multipart upload key=WPBYTFP7HRVE upload=YGCPV9WRJPRR tag=BHS8IDRXKVO3 type=write size=1959105 2024-09-14T11:17:15.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.423+0000 7f185d9f8780 1 < completed write operation key=6MZGLP5KPPB3 tag=60LN3OTZJ30Q type=write size=294075 2024-09-14T11:17:15.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.425+0000 7f185d9f8780 1 > prepared operation key=6MZGLP5KPPB3 tag=O64301I2X9CK type=del size=2758305 2024-09-14T11:17:15.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.428+0000 7f185d9f8780 1 < suggested remove operation key=LGLAG80GX8GF tag=VN4ZLGDYT27Q type=del 2024-09-14T11:17:15.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.429+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=3URACULVVXGB type=del size=184523 2024-09-14T11:17:15.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.430+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=UPABLMZSB1SN type=del 2024-09-14T11:17:15.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.431+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=JZP4L7W4XEZ6 type=del size=1557335 2024-09-14T11:17:15.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.434+0000 7f185d9f8780 1 < suggested remove operation key=6MZGLP5KPPB3 tag=UYW1138LSSTJ type=del 2024-09-14T11:17:15.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.436+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~SSIAAXXE69KH.0 size=1048576 2024-09-14T11:17:15.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.437+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~SSIAAXXE69KH.1 size=779120 2024-09-14T11:17:15.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.437+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=SSIAAXXE69KH tag=Y9DTJI4FEEVG type=write size=2876272 2024-09-14T11:17:15.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.439+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=VAVT3QW5N9Q0 type=del 2024-09-14T11:17:15.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.441+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~9QWHKGWBF5P5.0 size=1048576 2024-09-14T11:17:15.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.442+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~9QWHKGWBF5P5.1 size=1048576 2024-09-14T11:17:15.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.443+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~9QWHKGWBF5P5.2 size=865043 2024-09-14T11:17:15.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.443+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=9QWHKGWBF5P5 tag=RN1S25WVO1CT type=write size=4010771 2024-09-14T11:17:15.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.445+0000 7f185d9f8780 1 < suggested update operation key=CRZOT1D0U2F3 tag=GR85H6AX3BRU type=write size=716591 2024-09-14T11:17:15.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.446+0000 7f185d9f8780 1 > prepared operation key=ESN8NVVJB3B0 tag=FDWRGTPMXFRU type=write size=247672 2024-09-14T11:17:15.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.447+0000 7f185d9f8780 1 < completed write operation key=J6RN3WULDLQE tag=CU2W7NR6ZG4L type=write size=846415 2024-09-14T11:17:15.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.449+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~NYBIRNAYEL4S.0 size=866659 2024-09-14T11:17:15.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.449+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=NYBIRNAYEL4S tag=48ODIX7483OT type=write size=1915235 2024-09-14T11:17:15.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.451+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=IDKVC3WWTQFU type=del 2024-09-14T11:17:15.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.453+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0NCIFTR1QKKV.0 size=1048576 2024-09-14T11:17:15.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.454+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0NCIFTR1QKKV.1 size=1048576 2024-09-14T11:17:15.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.455+0000 7f185d9f8780 1 > prepared part key=_multipart_ESN8NVVJB3B0.2~0NCIFTR1QKKV.2 size=774359 2024-09-14T11:17:15.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.455+0000 7f185d9f8780 1 > prepared multipart upload key=ESN8NVVJB3B0 upload=0NCIFTR1QKKV tag=AE73163H84WX type=write size=3920087 2024-09-14T11:17:15.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.457+0000 7f185d9f8780 1 < completed delete operation key=SEI774TP8YMJ tag=9UCMSEW203E8 type=del 2024-09-14T11:17:15.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.459+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E4F179VESTSG.0 size=1048576 2024-09-14T11:17:15.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.460+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~E4F179VESTSG.1 size=556363 2024-09-14T11:17:15.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.460+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=E4F179VESTSG tag=W7JD7RVSXE4I type=write size=2653515 2024-09-14T11:17:15.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.461+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~1ZPUIBT5XAJR.0 size=1048576 2024-09-14T11:17:15.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.462+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~1ZPUIBT5XAJR.1 size=1048576 2024-09-14T11:17:15.462 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.463+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~1ZPUIBT5XAJR.2 size=455436 2024-09-14T11:17:15.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.465+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=1ZPUIBT5XAJR tag=QFAE3GI9VLL4 type=write size=3601164 2024-09-14T11:17:15.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.467+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~VGW9F7PNQ374.0 size=1048576 2024-09-14T11:17:15.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.468+0000 7f185d9f8780 1 > prepared part key=_multipart_M4FJDW1QHGBM.2~VGW9F7PNQ374.1 size=751431 2024-09-14T11:17:15.468 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.468+0000 7f185d9f8780 1 > prepared multipart upload key=M4FJDW1QHGBM upload=VGW9F7PNQ374 tag=CZATZFUYFN40 type=write size=2848583 2024-09-14T11:17:15.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.471+0000 7f185d9f8780 1 < suggested remove operation key=7XGG5LBGRI4H tag=O9H35EIVIAQU type=write 2024-09-14T11:17:15.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.472+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=W2SD9H5293NY type=write size=334208 2024-09-14T11:17:15.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.473+0000 7f185d9f8780 1 < completed write operation key=M4FJDW1QHGBM tag=KMWVLSJ9CGMN type=write size=295380 2024-09-14T11:17:15.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.476+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~YNQ781EQ9J3A.0 size=1048576 2024-09-14T11:17:15.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.477+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~YNQ781EQ9J3A.1 size=1048576 2024-09-14T11:17:15.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.478+0000 7f185d9f8780 1 > prepared part key=_multipart_O2Y34FSQHS1S.2~YNQ781EQ9J3A.2 size=633041 2024-09-14T11:17:15.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.478+0000 7f185d9f8780 1 > prepared multipart upload key=O2Y34FSQHS1S upload=YNQ781EQ9J3A tag=PCNJDHSMPWM6 type=write size=3778769 2024-09-14T11:17:15.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.479+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~YZB1DOP53127.0 size=1048576 2024-09-14T11:17:15.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.480+0000 7f185d9f8780 1 < completed part key=_multipart_HLUMY48G90KB.2~YZB1DOP53127.1 size=1048576 2024-09-14T11:17:15.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.480+0000 7f185d9f8780 1 < canceled part key=_multipart_HLUMY48G90KB.2~YZB1DOP53127.2 size=925142 2024-09-14T11:17:15.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.482+0000 7f185d9f8780 1 < canceled multipart upload key=HLUMY48G90KB upload=YZB1DOP53127 tag=5NBOJMBG4LXJ type=write size=4070870 2024-09-14T11:17:15.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.484+0000 7f185d9f8780 1 > prepared operation key=O2Y34FSQHS1S tag=CUCP0MHJDTVL type=del size=3229774 2024-09-14T11:17:15.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.485+0000 7f185d9f8780 1 < completed delete operation key=087PN6V1BP65 tag=W6QGQ38OEKCA type=del 2024-09-14T11:17:15.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.487+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~OWO7U3WJLZ1K.0 size=1048576 2024-09-14T11:17:15.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.489+0000 7f185d9f8780 1 > prepared part key=_multipart_6MZGLP5KPPB3.2~OWO7U3WJLZ1K.1 size=29517 2024-09-14T11:17:15.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.489+0000 7f185d9f8780 1 > prepared multipart upload key=6MZGLP5KPPB3 upload=OWO7U3WJLZ1K tag=6SMIJKURE3WS type=write size=2126669 2024-09-14T11:17:15.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.490+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~10NNTX2V2OCL.0 size=1048576 2024-09-14T11:17:15.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.491+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~10NNTX2V2OCL.1 size=859890 2024-09-14T11:17:15.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.493+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=10NNTX2V2OCL tag=KEEECJW9R801 type=write size=2957042 2024-09-14T11:17:15.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.496+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~R5DF3ZM1D7R5.0 size=1048576 2024-09-14T11:17:15.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.497+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~R5DF3ZM1D7R5.1 size=1048576 2024-09-14T11:17:15.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.498+0000 7f185d9f8780 1 > prepared part key=_multipart_DAKWA1OCVTBG.2~R5DF3ZM1D7R5.2 size=101786 2024-09-14T11:17:15.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.498+0000 7f185d9f8780 1 > prepared multipart upload key=DAKWA1OCVTBG upload=R5DF3ZM1D7R5 tag=P83VPJWPL6K6 type=write size=3247514 2024-09-14T11:17:15.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.499+0000 7f185d9f8780 1 < completed part key=_multipart_WPBYTFP7HRVE.2~YGCPV9WRJPRR.0 size=910529 2024-09-14T11:17:15.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.501+0000 7f185d9f8780 1 < completed multipart upload key=WPBYTFP7HRVE upload=YGCPV9WRJPRR tag=BHS8IDRXKVO3 type=write size=1959105 2024-09-14T11:17:15.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.503+0000 7f185d9f8780 1 > prepared part key=_multipart_H29SXBS4N9JK.2~OMM6FIBSI24V.0 size=491085 2024-09-14T11:17:15.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.503+0000 7f185d9f8780 1 > prepared multipart upload key=H29SXBS4N9JK upload=OMM6FIBSI24V tag=IGGDVYM1R0VB type=write size=1539661 2024-09-14T11:17:15.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.505+0000 7f185d9f8780 -1 < failed to complete operation key=6MZGLP5KPPB3 tag=O64301I2X9CK type=del size=2758305: (22) Invalid argument 2024-09-14T11:17:15.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.506+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=9VXGRI55XB5V type=del size=2416337 2024-09-14T11:17:15.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.507+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=3URACULVVXGB type=del 2024-09-14T11:17:15.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.508+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=1UF3YOLBQ9B2 type=del size=1931590 2024-09-14T11:17:15.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.509+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=JZP4L7W4XEZ6 type=del 2024-09-14T11:17:15.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.511+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~2FXDC2837OHD.0 size=1048576 2024-09-14T11:17:15.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.512+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~2FXDC2837OHD.1 size=380437 2024-09-14T11:17:15.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.512+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=2FXDC2837OHD tag=MF7JCL01Y82L type=write size=2477589 2024-09-14T11:17:15.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.513+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~SSIAAXXE69KH.0 size=1048576 2024-09-14T11:17:15.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.514+0000 7f185d9f8780 1 < completed part key=_multipart_L4L83NVMXHXZ.2~SSIAAXXE69KH.1 size=779120 2024-09-14T11:17:15.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.516+0000 7f185d9f8780 1 < completed multipart upload key=L4L83NVMXHXZ upload=SSIAAXXE69KH tag=Y9DTJI4FEEVG type=write size=2876272 2024-09-14T11:17:15.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.517+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=P1ORVNDFSLXY type=del size=2918632 2024-09-14T11:17:15.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.519+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~9QWHKGWBF5P5.0 size=1048576 2024-09-14T11:17:15.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.520+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~9QWHKGWBF5P5.1 size=1048576 2024-09-14T11:17:15.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.521+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~9QWHKGWBF5P5.2 size=865043 2024-09-14T11:17:15.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.523+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=9QWHKGWBF5P5 tag=RN1S25WVO1CT type=write size=4010771 2024-09-14T11:17:15.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.524+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=3U4XZN2FU9X1 type=del size=3773912 2024-09-14T11:17:15.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.525+0000 7f185d9f8780 1 < completed write operation key=ESN8NVVJB3B0 tag=FDWRGTPMXFRU type=write size=247672 2024-09-14T11:17:15.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.526+0000 7f185d9f8780 1 > prepared operation key=1BOZ331NA7JA tag=Q3MJ80ZT91DX type=del size=3269083 2024-09-14T11:17:15.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.527+0000 7f185d9f8780 1 < completed part key=_multipart_087PN6V1BP65.2~NYBIRNAYEL4S.0 size=866659 2024-09-14T11:17:15.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.529+0000 7f185d9f8780 1 < completed multipart upload key=087PN6V1BP65 upload=NYBIRNAYEL4S tag=48ODIX7483OT type=write size=1915235 2024-09-14T11:17:15.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.531+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~Q0LEETMZGHCI.0 size=1048576 2024-09-14T11:17:15.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.532+0000 7f185d9f8780 1 > prepared part key=_multipart_CVVKY636WXG9.2~Q0LEETMZGHCI.1 size=168806 2024-09-14T11:17:15.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.532+0000 7f185d9f8780 1 > prepared multipart upload key=CVVKY636WXG9 upload=Q0LEETMZGHCI tag=5SZC6B1I2VIN type=write size=2265958 2024-09-14T11:17:15.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.534+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~0NCIFTR1QKKV.0 size=1048576 2024-09-14T11:17:15.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.534+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~0NCIFTR1QKKV.1 size=1048576 2024-09-14T11:17:15.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.536+0000 7f185d9f8780 1 < completed part key=_multipart_ESN8NVVJB3B0.2~0NCIFTR1QKKV.2 size=774359 2024-09-14T11:17:15.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.538+0000 7f185d9f8780 1 < completed multipart upload key=ESN8NVVJB3B0 upload=0NCIFTR1QKKV tag=AE73163H84WX type=write size=3920087 2024-09-14T11:17:15.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.540+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~B4Q1S9K3LXCS.0 size=1048576 2024-09-14T11:17:15.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.541+0000 7f185d9f8780 1 > prepared part key=_multipart_55K4D3SEM068.2~B4Q1S9K3LXCS.1 size=831317 2024-09-14T11:17:15.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.541+0000 7f185d9f8780 1 > prepared multipart upload key=55K4D3SEM068 upload=B4Q1S9K3LXCS tag=F0UZ6VDC2HHW type=write size=2928469 2024-09-14T11:17:15.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.542+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~E4F179VESTSG.0 size=1048576 2024-09-14T11:17:15.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.543+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~E4F179VESTSG.1 size=556363 2024-09-14T11:17:15.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.545+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=E4F179VESTSG tag=W7JD7RVSXE4I type=write size=2653515 2024-09-14T11:17:15.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.546+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=K5F2LBD8G63B type=del size=2596043 2024-09-14T11:17:15.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.547+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~VGW9F7PNQ374.0 size=1048576 2024-09-14T11:17:15.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.548+0000 7f185d9f8780 1 < completed part key=_multipart_M4FJDW1QHGBM.2~VGW9F7PNQ374.1 size=751431 2024-09-14T11:17:15.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.550+0000 7f185d9f8780 1 < completed multipart upload key=M4FJDW1QHGBM upload=VGW9F7PNQ374 tag=CZATZFUYFN40 type=write size=2848583 2024-09-14T11:17:15.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.551+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=O2BSDRIW6A9D type=del size=560182 2024-09-14T11:17:15.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.553+0000 7f185d9f8780 1 < completed write operation key=830X857XIX9O tag=W2SD9H5293NY type=write size=334208 2024-09-14T11:17:15.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.554+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=6RFUL1JK6NG2 type=del size=2634899 2024-09-14T11:17:15.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.555+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~YNQ781EQ9J3A.0 size=1048576 2024-09-14T11:17:15.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.556+0000 7f185d9f8780 1 < completed part key=_multipart_O2Y34FSQHS1S.2~YNQ781EQ9J3A.1 size=1048576 2024-09-14T11:17:15.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.556+0000 7f185d9f8780 1 < canceled part key=_multipart_O2Y34FSQHS1S.2~YNQ781EQ9J3A.2 size=633041 2024-09-14T11:17:15.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.558+0000 7f185d9f8780 1 < canceled multipart upload key=O2Y34FSQHS1S upload=YNQ781EQ9J3A tag=PCNJDHSMPWM6 type=write size=3778769 2024-09-14T11:17:15.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.559+0000 7f185d9f8780 1 > prepared operation key=H29SXBS4N9JK tag=AIEYGK1SM2EQ type=write size=818737 2024-09-14T11:17:15.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.561+0000 7f185d9f8780 1 < completed delete operation key=O2Y34FSQHS1S tag=CUCP0MHJDTVL type=del 2024-09-14T11:17:15.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.562+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=DKOQS4BUVN97 type=del size=38228 2024-09-14T11:17:15.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.563+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~OWO7U3WJLZ1K.0 size=1048576 2024-09-14T11:17:15.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.564+0000 7f185d9f8780 1 < completed part key=_multipart_6MZGLP5KPPB3.2~OWO7U3WJLZ1K.1 size=29517 2024-09-14T11:17:15.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.566+0000 7f185d9f8780 1 < completed multipart upload key=6MZGLP5KPPB3 upload=OWO7U3WJLZ1K tag=6SMIJKURE3WS type=write size=2126669 2024-09-14T11:17:15.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.569+0000 7f185d9f8780 1 > prepared operation key=LGLAG80GX8GF tag=7F1L31UEA282 type=del size=1854924 2024-09-14T11:17:15.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.570+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~R5DF3ZM1D7R5.0 size=1048576 2024-09-14T11:17:15.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.571+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~R5DF3ZM1D7R5.1 size=1048576 2024-09-14T11:17:15.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.572+0000 7f185d9f8780 1 < completed part key=_multipart_DAKWA1OCVTBG.2~R5DF3ZM1D7R5.2 size=101786 2024-09-14T11:17:15.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.574+0000 7f185d9f8780 1 < completed multipart upload key=DAKWA1OCVTBG upload=R5DF3ZM1D7R5 tag=P83VPJWPL6K6 type=write size=3247514 2024-09-14T11:17:15.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.575+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=P8737JS8JPF8 type=del size=1878866 2024-09-14T11:17:15.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.577+0000 7f185d9f8780 1 < completed part key=_multipart_H29SXBS4N9JK.2~OMM6FIBSI24V.0 size=491085 2024-09-14T11:17:15.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.579+0000 7f185d9f8780 1 < completed multipart upload key=H29SXBS4N9JK upload=OMM6FIBSI24V tag=IGGDVYM1R0VB type=write size=1539661 2024-09-14T11:17:15.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.581+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~0BG0INDLAG8S.0 size=1048576 2024-09-14T11:17:15.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.581+0000 7f185d9f8780 1 > prepared part key=_multipart_CJ6C03RXS0IW.2~0BG0INDLAG8S.1 size=998715 2024-09-14T11:17:15.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.581+0000 7f185d9f8780 1 > prepared multipart upload key=CJ6C03RXS0IW upload=0BG0INDLAG8S tag=FRIZM54KIQJ2 type=write size=3095867 2024-09-14T11:17:15.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.584+0000 7f185d9f8780 1 < suggested remove operation key=CVVKY636WXG9 tag=9VXGRI55XB5V type=del 2024-09-14T11:17:15.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.585+0000 7f185d9f8780 1 > prepared operation key=830X857XIX9O tag=CX4M36SH0S55 type=del size=717873 2024-09-14T11:17:15.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.586+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=1UF3YOLBQ9B2 type=del 2024-09-14T11:17:15.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.587+0000 7f185d9f8780 1 > prepared operation key=M4FJDW1QHGBM tag=HFNTE2A8VQ5Z type=del size=2719561 2024-09-14T11:17:15.587 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.588+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~2FXDC2837OHD.0 size=1048576 2024-09-14T11:17:15.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.589+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~2FXDC2837OHD.1 size=380437 2024-09-14T11:17:15.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.591+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=2FXDC2837OHD tag=MF7JCL01Y82L type=write size=2477589 2024-09-14T11:17:15.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.592+0000 7f185d9f8780 1 > prepared operation key=CVVKY636WXG9 tag=1CVU6LEDUBFU type=del size=1068063 2024-09-14T11:17:15.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.593+0000 7f185d9f8780 1 < completed delete operation key=W24KN3J819EB tag=P1ORVNDFSLXY type=del 2024-09-14T11:17:15.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.595+0000 7f185d9f8780 1 > prepared part key=_multipart_J6RN3WULDLQE.2~5QUP3WVZ47MX.0 size=316583 2024-09-14T11:17:15.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.595+0000 7f185d9f8780 1 > prepared multipart upload key=J6RN3WULDLQE upload=5QUP3WVZ47MX tag=01YQ1BVBV6Y5 type=write size=1365159 2024-09-14T11:17:15.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.597+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=3U4XZN2FU9X1 type=del 2024-09-14T11:17:15.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.599+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~BIZTQHR7LO7V.0 size=1048576 2024-09-14T11:17:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.600+0000 7f185d9f8780 1 > prepared part key=_multipart_XPMGVU0U52GS.2~BIZTQHR7LO7V.1 size=1003157 2024-09-14T11:17:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.600+0000 7f185d9f8780 1 > prepared multipart upload key=XPMGVU0U52GS upload=BIZTQHR7LO7V tag=XF01LKLBX56O type=write size=3100309 2024-09-14T11:17:15.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.601+0000 7f185d9f8780 1 < completed delete operation key=1BOZ331NA7JA tag=Q3MJ80ZT91DX type=del 2024-09-14T11:17:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.602+0000 7f185d9f8780 1 > prepared operation key=P30WF4R3UFPX tag=N2LPVTM33XT9 type=del size=34889 2024-09-14T11:17:15.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.604+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~Q0LEETMZGHCI.0 size=1048576 2024-09-14T11:17:15.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.605+0000 7f185d9f8780 1 < completed part key=_multipart_CVVKY636WXG9.2~Q0LEETMZGHCI.1 size=168806 2024-09-14T11:17:15.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.607+0000 7f185d9f8780 1 < completed multipart upload key=CVVKY636WXG9 upload=Q0LEETMZGHCI tag=5SZC6B1I2VIN type=write size=2265958 2024-09-14T11:17:15.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.609+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~LVVWAJ4V6SD1.0 size=1048576 2024-09-14T11:17:15.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.610+0000 7f185d9f8780 1 > prepared part key=_multipart_830X857XIX9O.2~LVVWAJ4V6SD1.1 size=541039 2024-09-14T11:17:15.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.610+0000 7f185d9f8780 1 > prepared multipart upload key=830X857XIX9O upload=LVVWAJ4V6SD1 tag=XFC32GI3B2ZL type=write size=2638191 2024-09-14T11:17:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.611+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~B4Q1S9K3LXCS.0 size=1048576 2024-09-14T11:17:15.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.612+0000 7f185d9f8780 1 < completed part key=_multipart_55K4D3SEM068.2~B4Q1S9K3LXCS.1 size=831317 2024-09-14T11:17:15.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.614+0000 7f185d9f8780 1 < completed multipart upload key=55K4D3SEM068 upload=B4Q1S9K3LXCS tag=F0UZ6VDC2HHW type=write size=2928469 2024-09-14T11:17:15.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.617+0000 7f185d9f8780 1 > prepared part key=_multipart_P30WF4R3UFPX.2~TRSH4B0XJ3DX.0 size=280072 2024-09-14T11:17:15.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.617+0000 7f185d9f8780 1 > prepared multipart upload key=P30WF4R3UFPX upload=TRSH4B0XJ3DX tag=JIJQKPESTN4A type=write size=1328648 2024-09-14T11:17:15.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.618+0000 7f185d9f8780 1 < completed delete operation key=HLUMY48G90KB tag=K5F2LBD8G63B type=del 2024-09-14T11:17:15.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.619+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=J0LESSQ1A85H type=del size=1894436 2024-09-14T11:17:15.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.620+0000 7f185d9f8780 1 < completed delete operation key=H29SXBS4N9JK tag=O2BSDRIW6A9D type=del 2024-09-14T11:17:15.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.621+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=Y3S1AMR2BIPB type=del size=1917300 2024-09-14T11:17:15.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.623+0000 7f185d9f8780 1 < completed delete operation key=P30WF4R3UFPX tag=6RFUL1JK6NG2 type=del 2024-09-14T11:17:15.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.624+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=V893U83U89OZ type=write size=358394 2024-09-14T11:17:15.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.625+0000 7f185d9f8780 1 < completed write operation key=H29SXBS4N9JK tag=AIEYGK1SM2EQ type=write size=818737 2024-09-14T11:17:15.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.627+0000 7f185d9f8780 1 > prepared part key=_multipart_PSL63WUBLB75.2~YLPTO2I3Z86L.0 size=716587 2024-09-14T11:17:15.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.627+0000 7f185d9f8780 1 > prepared multipart upload key=PSL63WUBLB75 upload=YLPTO2I3Z86L tag=C2ZI2EPNAD77 type=write size=1765163 2024-09-14T11:17:15.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.628+0000 7f185d9f8780 1 < completed delete operation key=55K4D3SEM068 tag=DKOQS4BUVN97 type=del 2024-09-14T11:17:15.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.629+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=XU3N3EZ0SVGG type=del size=1880723 2024-09-14T11:17:15.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.631+0000 7f185d9f8780 1 < completed delete operation key=LGLAG80GX8GF tag=7F1L31UEA282 type=del 2024-09-14T11:17:15.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.632+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=N0HQT0IYG86I type=del size=2256720 2024-09-14T11:17:15.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.634+0000 7f185d9f8780 1 < suggested remove operation key=HLUMY48G90KB tag=P8737JS8JPF8 type=del 2024-09-14T11:17:15.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.636+0000 7f185d9f8780 1 > prepared operation key=SEI774TP8YMJ tag=2BFFN63WWQ2F type=write size=226113 2024-09-14T11:17:15.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.637+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~0BG0INDLAG8S.0 size=1048576 2024-09-14T11:17:15.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.638+0000 7f185d9f8780 1 < completed part key=_multipart_CJ6C03RXS0IW.2~0BG0INDLAG8S.1 size=998715 2024-09-14T11:17:15.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.640+0000 7f185d9f8780 1 < completed multipart upload key=CJ6C03RXS0IW upload=0BG0INDLAG8S tag=FRIZM54KIQJ2 type=write size=3095867 2024-09-14T11:17:15.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.642+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~IP33CSXDF6ZQ.0 size=1048576 2024-09-14T11:17:15.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.643+0000 7f185d9f8780 1 > prepared part key=_multipart_087PN6V1BP65.2~IP33CSXDF6ZQ.1 size=809040 2024-09-14T11:17:15.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.643+0000 7f185d9f8780 1 > prepared multipart upload key=087PN6V1BP65 upload=IP33CSXDF6ZQ tag=HRF2EOHVPRPG type=write size=2906192 2024-09-14T11:17:15.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.644+0000 7f185d9f8780 1 < completed delete operation key=830X857XIX9O tag=CX4M36SH0S55 type=del 2024-09-14T11:17:15.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.645+0000 7f185d9f8780 1 > prepared operation key=7XGG5LBGRI4H tag=XOD9JENW0ZES type=del size=2291117 2024-09-14T11:17:15.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.647+0000 7f185d9f8780 1 < completed delete operation key=M4FJDW1QHGBM tag=HFNTE2A8VQ5Z type=del 2024-09-14T11:17:15.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.648+0000 7f185d9f8780 1 > prepared operation key=W24KN3J819EB tag=4Y0ZB6VIIVBW type=write size=262010 2024-09-14T11:17:15.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.649+0000 7f185d9f8780 1 < completed delete operation key=CVVKY636WXG9 tag=1CVU6LEDUBFU type=del 2024-09-14T11:17:15.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.650+0000 7f185d9f8780 1 > prepared operation key=55K4D3SEM068 tag=8H7CBKS3JM37 type=write size=137408 2024-09-14T11:17:15.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.651+0000 7f185d9f8780 1 < completed part key=_multipart_J6RN3WULDLQE.2~5QUP3WVZ47MX.0 size=316583 2024-09-14T11:17:15.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.653+0000 7f185d9f8780 1 < completed multipart upload key=J6RN3WULDLQE upload=5QUP3WVZ47MX tag=01YQ1BVBV6Y5 type=write size=1365159 2024-09-14T11:17:15.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.654+0000 7f185d9f8780 1 > prepared operation key=PSL63WUBLB75 tag=IBV2YKBT5Q8U type=del size=3220421 2024-09-14T11:17:15.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.656+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~BIZTQHR7LO7V.0 size=1048576 2024-09-14T11:17:15.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.657+0000 7f185d9f8780 1 < completed part key=_multipart_XPMGVU0U52GS.2~BIZTQHR7LO7V.1 size=1003157 2024-09-14T11:17:15.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.658+0000 7f185d9f8780 1 < completed multipart upload key=XPMGVU0U52GS upload=BIZTQHR7LO7V tag=XF01LKLBX56O type=write size=3100309 2024-09-14T11:17:15.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.661+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~8H5LS76NV5D2.0 size=5675 2024-09-14T11:17:15.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.661+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=8H5LS76NV5D2 tag=JLD1TGQHN60U type=write size=1054251 2024-09-14T11:17:15.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.663+0000 7f185d9f8780 1 < suggested remove operation key=P30WF4R3UFPX tag=N2LPVTM33XT9 type=del 2024-09-14T11:17:15.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.664+0000 7f185d9f8780 1 > prepared operation key=CRZOT1D0U2F3 tag=HYOI7LYK0ZY2 type=del size=1337429 2024-09-14T11:17:15.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.665+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~LVVWAJ4V6SD1.0 size=1048576 2024-09-14T11:17:15.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.666+0000 7f185d9f8780 1 < completed part key=_multipart_830X857XIX9O.2~LVVWAJ4V6SD1.1 size=541039 2024-09-14T11:17:15.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.668+0000 7f185d9f8780 1 < completed multipart upload key=830X857XIX9O upload=LVVWAJ4V6SD1 tag=XFC32GI3B2ZL type=write size=2638191 2024-09-14T11:17:15.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.669+0000 7f185d9f8780 1 > prepared operation key=IXWIKD7J74RJ tag=XG65MT33JMUS type=del size=1103501 2024-09-14T11:17:15.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.670+0000 7f185d9f8780 1 < completed part key=_multipart_P30WF4R3UFPX.2~TRSH4B0XJ3DX.0 size=280072 2024-09-14T11:17:15.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.672+0000 7f185d9f8780 1 < completed multipart upload key=P30WF4R3UFPX upload=TRSH4B0XJ3DX tag=JIJQKPESTN4A type=write size=1328648 2024-09-14T11:17:15.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.674+0000 7f185d9f8780 1 > prepared operation key=N040R6OERAJP tag=1YY286347Z1K type=del size=593987 2024-09-14T11:17:15.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.675+0000 7f185d9f8780 1 < completed delete operation key=PSL63WUBLB75 tag=J0LESSQ1A85H type=del 2024-09-14T11:17:15.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.676+0000 7f185d9f8780 1 > prepared operation key=J6RN3WULDLQE tag=L0IXEL4CZPZR type=del size=2203663 2024-09-14T11:17:15.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.677+0000 7f185d9f8780 1 < canceled operation key=J6RN3WULDLQE tag=Y3S1AMR2BIPB type=del size=1917300 2024-09-14T11:17:15.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.681+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~2RTC9LEZIGFS.0 size=1048576 2024-09-14T11:17:15.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.682+0000 7f185d9f8780 1 > prepared part key=_multipart_N040R6OERAJP.2~2RTC9LEZIGFS.1 size=302982 2024-09-14T11:17:15.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.682+0000 7f185d9f8780 1 > prepared multipart upload key=N040R6OERAJP upload=2RTC9LEZIGFS tag=NH9R0W31T0DQ type=write size=2400134 2024-09-14T11:17:15.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.683+0000 7f185d9f8780 1 < completed write operation key=PSL63WUBLB75 tag=V893U83U89OZ type=write size=358394 2024-09-14T11:17:15.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.684+0000 7f185d9f8780 1 > prepared operation key=HLUMY48G90KB tag=V658C1J6YAB4 type=write size=223201 2024-09-14T11:17:15.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.685+0000 7f185d9f8780 1 < completed part key=_multipart_PSL63WUBLB75.2~YLPTO2I3Z86L.0 size=716587 2024-09-14T11:17:15.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.687+0000 7f185d9f8780 1 < completed multipart upload key=PSL63WUBLB75 upload=YLPTO2I3Z86L tag=C2ZI2EPNAD77 type=write size=1765163 2024-09-14T11:17:15.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.690+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~W8Z3H59XXIK7.0 size=1048576 2024-09-14T11:17:15.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.690+0000 7f185d9f8780 1 > prepared part key=_multipart_W24KN3J819EB.2~W8Z3H59XXIK7.1 size=497168 2024-09-14T11:17:15.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.690+0000 7f185d9f8780 1 > prepared multipart upload key=W24KN3J819EB upload=W8Z3H59XXIK7 tag=D2IATH33TFE7 type=write size=2594320 2024-09-14T11:17:15.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.692+0000 7f185d9f8780 1 < completed delete operation key=IXWIKD7J74RJ tag=XU3N3EZ0SVGG type=del 2024-09-14T11:17:15.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.694+0000 7f185d9f8780 1 > prepared part key=_multipart_L4L83NVMXHXZ.2~FYW7WJYJNWM1.0 size=125567 2024-09-14T11:17:15.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:17:15.694+0000 7f185d9f8780 1 > prepared multipart upload key=L4L83NVMXHXZ upload=FYW7WJYJNWM1 tag=OLH8VIN4S963 type=write size=1174143 2024-09-14T11:17:15.693 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] cls_rgw_stats.simulate (8934 ms) 2024-09-14T11:17:15.693 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 1 test from cls_rgw_stats (8934 ms total) 2024-09-14T11:17:15.693 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:17:15.693 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:15.786 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 1 test from 1 test suite ran. (10894 ms total) 2024-09-14T11:17:15.786 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 1 test. 2024-09-14T11:17:15.789 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:15.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:15.869 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:17:15.870 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:17:15.870 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:17:15.954 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:15.954 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:17:15.955 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:17.797 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:17:17.797 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:17:17.815 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (19 ms) 2024-09-14T11:17:17.815 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:17:17.821 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-14T11:17:17.821 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:17:17.823 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T11:17:17.824 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:17:17.827 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-14T11:17:17.827 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:17:17.834 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-14T11:17:17.834 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:17:17.841 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-14T11:17:17.841 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:17:17.844 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-14T11:17:17.845 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:17:17.848 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-14T11:17:17.848 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:17:17.853 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-14T11:17:17.853 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:17:17.857 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-14T11:17:17.857 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:17:17.858 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T11:17:17.858 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:17:17.858 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-14T11:17:17.859 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:17:17.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-14T11:17:17.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:17:17.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-14T11:17:17.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:17:17.880 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-14T11:17:17.880 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:17:17.886 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-14T11:17:17.887 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:17:17.895 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-14T11:17:17.895 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:17:17.904 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2024-09-14T11:17:17.904 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:17:17.908 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:17:17.908 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:17:17.910 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-14T11:17:17.910 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:17:17.911 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:17:17.912 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:17:17.912 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-14T11:17:17.912 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:17:17.919 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (8 ms) 2024-09-14T11:17:17.919 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:17:17.925 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-14T11:17:17.925 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:17:17.933 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T11:17:17.933 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:17:17.941 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-09-14T11:17:17.941 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:17:17.943 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T11:17:17.944 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:17:17.946 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-09-14T11:17:17.946 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-14T11:17:17.947 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:17:17.955 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-14T11:17:17.955 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 31 tests from CmpOmap (158 ms total) 2024-09-14T11:17:17.955 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:17:17.955 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:18.799 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 31 tests from 1 test suite ran. (2844 ms total) 2024-09-14T11:17:18.799 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 31 tests. 2024-09-14T11:17:18.801 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:18.801 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:18.845 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:17:18.846 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:17:18.846 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:17:18.933 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:18.933 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:17:18.933 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:18.933 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:17:18.933 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:17:21.813 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2880 ms) 2024-09-14T11:17:21.813 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:17:24.829 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3016 ms) 2024-09-14T11:17:24.829 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:17:27.863 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.Reserve (3033 ms) 2024-09-14T11:17:27.864 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:17:30.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3010 ms) 2024-09-14T11:17:30.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:17:33.889 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.Commit (3016 ms) 2024-09-14T11:17:33.889 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:17:36.896 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.Stats (3006 ms) 2024-09-14T11:17:36.896 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:17:40.973 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4077 ms) 2024-09-14T11:17:40.973 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:17:43.982 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.Abort (3007 ms) 2024-09-14T11:17:43.982 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:17:47.005 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.ReserveError (3025 ms) 2024-09-14T11:17:47.005 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:17:50.027 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.CommitError (3022 ms) 2024-09-14T11:17:50.027 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:17:53.052 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.AbortError (3024 ms) 2024-09-14T11:17:53.053 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:17:56.064 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3013 ms) 2024-09-14T11:17:56.065 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:17:59.092 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3027 ms) 2024-09-14T11:17:59.092 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:18:02.114 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3022 ms) 2024-09-14T11:18:02.115 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:18:05.133 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3019 ms) 2024-09-14T11:18:05.134 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:18:08.148 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3013 ms) 2024-09-14T11:18:08.148 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:18:11.152 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3005 ms) 2024-09-14T11:18:11.152 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:18:14.175 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.Cleanup (3023 ms) 2024-09-14T11:18:14.175 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:18:24.658 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10482 ms) 2024-09-14T11:18:24.658 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:18:27.683 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3025 ms) 2024-09-14T11:18:27.683 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:18:41.001 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13318 ms) 2024-09-14T11:18:41.002 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:18:45.027 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4026 ms) 2024-09-14T11:18:45.027 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:18:51.070 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6042 ms) 2024-09-14T11:18:51.070 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:18:56.089 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5019 ms) 2024-09-14T11:18:56.090 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from TestCls2PCQueue (97156 ms total) 2024-09-14T11:18:56.090 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:18:56.090 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:18:56.090 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 24 tests from 1 test suite ran. (97156 ms total) 2024-09-14T11:18:56.090 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 24 tests. 2024-09-14T11:18:56.093 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:18:56.093 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:18:56.140 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:18:56.141 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:18:56.141 DEBUG:teuthology.orchestra.run.smithi028:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:18:56.197 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:56.197 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:56.197 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:18:56.197 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:18:58.085 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:18:58.085 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:18:58.112 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsAccount.add (27 ms) 2024-09-14T11:18:58.112 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:18:58.117 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-14T11:18:58.117 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:18:58.124 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-14T11:18:58.124 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:18:58.142 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] ClsAccount.list (17 ms) 2024-09-14T11:18:58.142 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 4 tests from ClsAccount (57 ms total) 2024-09-14T11:18:58.142 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:18:58.142 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:18:59.091 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 4 tests from 1 test suite ran. (2894 ms total) 2024-09-14T11:18:59.091 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 4 tests. 2024-09-14T11:18:59.096 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:18:59.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:18:59.141 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:18:59.142 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:18:59.142 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:18:59.237 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:59.237 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:59.237 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:18:59.237 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:01.114 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:19:01.114 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:19:01.125 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] rgw_gc_log.init_existing_queue (12 ms) 2024-09-14T11:19:01.125 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:19:01.128 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-14T11:19:01.128 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:19:01.132 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-14T11:19:01.132 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:19:01.133 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:19:01.133 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:19:01.136 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-14T11:19:01.136 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:19:01.138 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-09-14T11:19:01.138 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 6 tests from rgw_gc_log (24 ms total) 2024-09-14T11:19:01.138 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:19:01.138 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:02.112 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 6 tests from 1 test suite ran. (2874 ms total) 2024-09-14T11:19:02.112 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 6 tests. 2024-09-14T11:19:02.118 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:02.118 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:02.163 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:19:02.164 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:19:02.165 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns= i= 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns= i= 2024-09-14T11:19:02.227 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns= i= 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.228 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.229 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.230 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.231 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.232 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.233 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.234 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.235 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.236 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.237 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.238 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.239 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.240 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.241 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.242 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.243 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: _obj[v1] 2024-09-14T11:19:02.244 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.245 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.246 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.247 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.248 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_obj", 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.249 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns= i= 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns= i= 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns= i= 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.250 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.251 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.252 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.253 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.254 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.255 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.256 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.257 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.258 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.259 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.260 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.261 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.262 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.263 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.264 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.265 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:02.266 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout:parsed: obj[v1] 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "obj1": { 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.267 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "obj2": { 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.268 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.269 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3": { 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.270 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "obj3-2": { 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.271 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "obj", 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "v1", 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.272 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.273 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.274 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker_myobj", 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.275 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.276 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.277 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.278 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker_myobj", 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.279 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.280 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.281 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.282 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.283 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.284 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.285 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.286 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.287 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.288 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.289 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.290 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.291 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.292 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.293 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.294 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.295 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.296 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.297 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.298 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.299 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.300 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.301 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:02.302 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.303 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.304 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.305 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj", 2024-09-14T11:19:02.306 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.307 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.308 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.309 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj", 2024-09-14T11:19:02.310 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.311 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.312 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.313 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:02.314 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.315 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.316 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.317 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.318 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.319 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.320 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.321 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:02.322 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.323 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.324 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.325 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.326 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.327 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.328 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.329 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.330 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.331 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.332 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.333 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:02.334 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.335 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.336 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.337 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.338 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.339 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.340 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.341 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:02.342 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.343 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.344 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.345 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.346 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.347 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.348 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.349 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.350 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.351 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.352 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.353 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.354 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.355 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.356 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.357 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.358 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.359 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.360 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.361 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": "default-placement.data", 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.362 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "test", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": "", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": "" 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.363 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.364 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "obj": { 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.365 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.366 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.367 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker_myobj", 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.368 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.369 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker_myobj", 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.370 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.371 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.372 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.373 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.374 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.375 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.376 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.377 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.378 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.379 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.380 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:19:02.381 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.382 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "myobj", 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.383 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.384 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj", 2024-09-14T11:19:02.385 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.386 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.387 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.388 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.389 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.390 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.391 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.392 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj" 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.393 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:19:02.394 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.395 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.396 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.397 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj", 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.398 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.399 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.400 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.401 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.402 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.403 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.404 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "", 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:19:02.405 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.406 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.407 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.408 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.409 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "" 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj": { 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.410 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj": { 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.411 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "raw_obj2": { 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "pool": ".data-pool", 2024-09-14T11:19:02.412 INFO:tasks.workunit.client.0.smithi028.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "loc": "" 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "new_obj2": { 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket": { 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "ebtest", 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "marker": "marker", 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "tenant": "", 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "explicit_placement": { 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:02.413 INFO:tasks.workunit.client.0.smithi028.stdout: "data_extra_pool": "", 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: "key": { 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: "name": "_myobj_", 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: "instance": "inst", 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: "ns": "ns" 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:19:02.414 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:19:02.415 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:19:02.415 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:02.415 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:19:02.415 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 4 tests. 2024-09-14T11:19:02.415 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:02.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:02.458 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:19:02.459 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:19:02.459 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:19:02.593 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:02.593 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:02.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.638+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.640+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.640+0000 7f1bc5d2e800 20 realm 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.640+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.640+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.640+0000 7f1bc5d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.640+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:02.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.641+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:02.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.641+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:02.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.642+0000 7f1bc5d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:02.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.642+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:02.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.642+0000 7f1bc5d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:02.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.642+0000 7f1bc5d2e800 20 searching for the correct realm 2024-09-14T11:19:02.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.648+0000 7f1bc1163640 0 -- 172.21.15.28:0/2231746683 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f1bb4061520 msgr2=0x7f1bb4069420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:02.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:02.855+0000 7f1bc1964640 0 -- 172.21.15.28:0/2231746683 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f1bb80c4bf0 msgr2=0x7f1bb80b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:19:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:19:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:03.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:03.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.061+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:03.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 zone default found 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 4 Realm: () 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 zonegroup default 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.062+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 started sync module instance, tier type = 2024-09-14T11:19:03.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.063+0000 7f1bc5d2e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:19:03.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=0 2024-09-14T11:19:03.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=1 2024-09-14T11:19:03.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=2 2024-09-14T11:19:03.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=3 2024-09-14T11:19:03.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=4 2024-09-14T11:19:03.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=5 2024-09-14T11:19:03.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.074+0000 7f1bc5d2e800 20 add_watcher() i=6 2024-09-14T11:19:03.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.075+0000 7f1bc5d2e800 20 add_watcher() i=7 2024-09-14T11:19:03.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.075+0000 7f1bc5d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:03.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.077+0000 7f1a73fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:03.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.077+0000 7f1bc5d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:03.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.077+0000 7f1bc5d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:03.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.077+0000 7f1bc5d2e800 5 note: GC not initialized 2024-09-14T11:19:03.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.078+0000 7f1a72ffd640 20 reqs_thread_entry: start 2024-09-14T11:19:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.078+0000 7f1bc5d2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.078+0000 7f1bc5d2e800 20 Filter name: none 2024-09-14T11:19:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.078+0000 7f1a70ff9640 20 reqs_thread_entry: start 2024-09-14T11:19:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.078+0000 7f1bc5d2e800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:19:03.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.078+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:19:03.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache get: name=default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= : miss 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache put: name=default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= info.flags=0x0 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 adding default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= to cache LRU end 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache get: name=default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= : hit (negative entry) 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.079+0000 7f1bc5d2e800 10 cache get: name=default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= : hit (negative entry) 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.081+0000 7f1bc5d2e800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.081+0000 7f1bc5d2e800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.081+0000 7f1bc5d2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:19:03.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.081+0000 7f1aa57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 94481935109120 notifier 5481 bl.length()=697 2024-09-14T11:19:03.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.081+0000 7f1aa57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:19:03.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.081+0000 7f1aa57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.085+0000 7f1bc5d2e800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:19:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.085+0000 7f1bc5d2e800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.085+0000 7f1bc5d2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:19:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.085+0000 7f1aa57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791296 cookie 94481935100496 notifier 5481 bl.length()=194 2024-09-14T11:19:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.085+0000 7f1aa57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:19:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.085+0000 7f1aa57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:03.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.089+0000 7f1bc5d2e800 10 cache put: name=default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= info.flags=0x7 2024-09-14T11:19:03.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.089+0000 7f1bc5d2e800 10 moving default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= to cache LRU end 2024-09-14T11:19:03.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.089+0000 7f1bc5d2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:sAl4am5cbiYs0k6csTdT5/Z2gH0=, ofs0, ns] 2024-09-14T11:19:03.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.089+0000 7f1aa57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 94481935102224 notifier 5481 bl.length()=203 2024-09-14T11:19:03.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.089+0000 7f1aa57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= info.flags=0x7 2024-09-14T11:19:03.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.089+0000 7f1aa57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+sAl4am5cbiYs0k6csTdT5/Z2gH0= to cache LRU end 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "display_name": "librgw test user", 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "email": "librgw@example.com", 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "suspended": 0, 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "subusers": [], 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "keys": [ 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: { 2024-09-14T11:19:03.090 INFO:tasks.workunit.client.0.smithi028.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "access_key": "sAl4am5cbiYs0k6csTdT5/Z2gH0=", 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "secret_key": "XkUoJQBId61ca+BLYFFKSSLJSVOPVhTIseKwD3f7UHDUkFGUnMooTg==", 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "active": true, 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "create_date": "2024-09-14T11:19:03.081567Z" 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: ], 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "swift_keys": [], 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "caps": [], 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "default_placement": "", 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "placement_tags": [], 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_quota": { 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "enabled": false, 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:19:03.091 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size": -1, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "max_objects": -1 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "user_quota": { 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "enabled": false, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size": -1, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "max_objects": -1 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "type": "rgw", 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "account_id": "", 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "path": "/", 2024-09-14T11:19:03.092 INFO:tasks.workunit.client.0.smithi028.stdout: "create_date": "2024-09-14T11:19:03.081554Z", 2024-09-14T11:19:03.093 INFO:tasks.workunit.client.0.smithi028.stdout: "tags": [], 2024-09-14T11:19:03.093 INFO:tasks.workunit.client.0.smithi028.stdout: "group_ids": [] 2024-09-14T11:19:03.093 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:19:03.093 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:19:03.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.092+0000 7f1a73fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:03.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.095+0000 7f1bc5d2e800 20 remove_watcher() i=0 2024-09-14T11:19:03.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.095+0000 7f1bc5d2e800 2 removed watcher, disabling cache 2024-09-14T11:19:03.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.096+0000 7f1bc5d2e800 20 remove_watcher() i=1 2024-09-14T11:19:03.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.097+0000 7f1bc5d2e800 20 remove_watcher() i=2 2024-09-14T11:19:03.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.098+0000 7f1bc5d2e800 20 remove_watcher() i=3 2024-09-14T11:19:03.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.099+0000 7f1bc5d2e800 20 remove_watcher() i=4 2024-09-14T11:19:03.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.100+0000 7f1bc5d2e800 20 remove_watcher() i=5 2024-09-14T11:19:03.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.101+0000 7f1bc5d2e800 20 remove_watcher() i=6 2024-09-14T11:19:03.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.103+0000 7f1bc5d2e800 20 remove_watcher() i=7 2024-09-14T11:19:03.114 INFO:tasks.workunit.client.0.smithi028.stdout:phase 1.1 2024-09-14T11:19:03.138 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:19:03.138 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:03.138 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:19:03.138 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:19:03.149 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:03.149 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:03.325 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (188 ms) 2024-09-14T11:19:03.325 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:19:03.327 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:19:03.327 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:19:03.327 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:19:03.327 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:19:03.337 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:19:03.342 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/f1 2024-09-14T11:19:03.346 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/f2 2024-09-14T11:19:03.349 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:19:03.353 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:19:03.355 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:19:03.358 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:19:03.361 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:19:03.364 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:19:03.367 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:19:03.369 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:19:03.377 INFO:tasks.workunit.client.0.smithi028.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:19:03.379 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETUP_HIER1 (53 ms) 2024-09-14T11:19:03.380 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:19:03.480 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETUP_DIRS1 (100 ms) 2024-09-14T11:19:03.480 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:19:03.480 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:19:03.480 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:19:03.495 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (15 ms) 2024-09-14T11:19:03.495 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:19:03.536 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (41 ms) 2024-09-14T11:19:03.536 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:19:03.536 INFO:tasks.workunit.client.0.smithi028.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:19:03.543 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-14T11:19:03.543 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:19:03.543 INFO:tasks.workunit.client.0.smithi028.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:03.550 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:03.551 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:19:03.552 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:03.553 INFO:tasks.workunit.client.0.smithi028.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:19:03.553 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:19:03.554 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:03.554 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:19:03.555 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:03.555 INFO:tasks.workunit.client.0.smithi028.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:19:03.555 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:19:03.557 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:03.557 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:19:03.558 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:03.558 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-14T11:19:03.558 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READF_SETUP1 (182 ms) 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:19:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:19:03.748 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:19:03.749 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:19:03.751 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:19:03.753 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:19:03.756 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:19:03.756 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:19:03.756 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:19:03.757 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:19:03.758 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:19:03.758 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:19:03.759 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:19:03.760 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:19:03.761 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:19:03.762 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:19:03.762 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:19:03.762 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:19:03.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.761+0000 7f820872d8c0 -1 shutting down 2024-09-14T11:19:03.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:03.762+0000 7f80e0631640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62724, si_uid : 1000, si_addr0x3e80000f504, si_status0 2024-09-14T11:19:33.439 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (29679 ms) 2024-09-14T11:19:33.440 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from LibRGW (30302 ms total) 2024-09-14T11:19:33.440 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:19:33.440 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:33.440 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 24 tests from 1 test suite ran. (30302 ms total) 2024-09-14T11:19:33.440 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 24 tests. 2024-09-14T11:19:33.446 INFO:tasks.workunit.client.0.smithi028.stdout:phase 1.2 2024-09-14T11:19:33.471 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:19:33.471 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:33.472 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:19:33.472 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:19:33.480 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:33.480 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:33.871 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-14T11:19:33.871 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:19:33.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:19:33.874 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:19:33.875 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:33.873+0000 7f765c1348c0 -1 shutting down 2024-09-14T11:19:33.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:19:33.874+0000 7f753403c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63343, si_uid : 1000, si_addr0x3e80000f76f, si_status0 2024-09-14T11:20:04.314 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30441 ms) 2024-09-14T11:20:04.314 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from LibRGW (30842 ms total) 2024-09-14T11:20:04.314 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:20:04.314 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:04.314 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 24 tests from 1 test suite ran. (30842 ms total) 2024-09-14T11:20:04.314 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 24 tests. 2024-09-14T11:20:04.321 INFO:tasks.workunit.client.0.smithi028.stdout:phase 1.3 2024-09-14T11:20:04.346 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:20:04.346 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:04.346 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:20:04.346 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:04.357 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:04.357 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:05.153 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (807 ms) 2024-09-14T11:20:05.153 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:20:05.154 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:20:05.154 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:05.154 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:20:05.154 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-14T11:20:05.160 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETUP_DIRS1 (64 ms) 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:20:05.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:05.225 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:20:05.226 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:20:05.226 INFO:tasks.workunit.client.0.smithi028.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:20:05.226 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:20:05.226 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:05.226 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:20:05.227 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:05.227 INFO:tasks.workunit.client.0.smithi028.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:20:05.227 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:20:05.228 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:05.228 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:20:05.229 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:05.230 INFO:tasks.workunit.client.0.smithi028.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:20:05.230 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:20:05.231 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:05.231 INFO:tasks.workunit.client.0.smithi028.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:20:05.232 INFO:tasks.workunit.client.0.smithi028.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:05.232 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-14T11:20:05.232 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:05.233 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:05.234 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:05.234 INFO:tasks.workunit.client.0.smithi028.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:05.234 INFO:tasks.workunit.client.0.smithi028.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:05.234 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:20:05.234 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:20:05.240 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:20:05.240 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:20:05.242 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:20:05.244 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:20:05.247 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:20:05.247 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:20:05.248 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:20:05.248 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:20:05.249 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:20:05.249 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:20:05.250 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:20:05.252 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:20:05.252+0000 7f8ce87288c0 -1 shutting down 2024-09-14T11:20:05.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:20:05.253+0000 7f8bc0588640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63962, si_uid : 1000, si_addr0x3e80000f9da, si_status0 2024-09-14T11:20:35.390 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30138 ms) 2024-09-14T11:20:35.390 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 24 tests from LibRGW (31044 ms total) 2024-09-14T11:20:35.390 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:20:35.390 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:35.391 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 24 tests from 1 test suite ran. (31044 ms total) 2024-09-14T11:20:35.391 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 24 tests. 2024-09-14T11:20:35.397 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2.1 2024-09-14T11:20:35.423 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:20:35.423 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:35.423 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:20:35.423 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:35.433 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:35.433 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:35.822 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-14T11:20:35.822 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:35.823 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:20:35.823 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:20:35.833 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-14T11:20:35.833 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:20:35.834 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:20:35.834 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:20:35.842 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave0 2024-09-14T11:20:35.852 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave1 2024-09-14T11:20:35.861 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave2 2024-09-14T11:20:35.870 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave3 2024-09-14T11:20:35.879 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave4 2024-09-14T11:20:35.889 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave5 2024-09-14T11:20:35.898 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave6 2024-09-14T11:20:35.907 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave7 2024-09-14T11:20:35.917 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave8 2024-09-14T11:20:35.928 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave9 2024-09-14T11:20:35.928 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (94 ms) 2024-09-14T11:20:35.928 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:20:36.105 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (178 ms) 2024-09-14T11:20:36.105 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:36.105 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:36.105 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:36.106 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:36.106 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:36.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:20:36.107+0000 7f5dba7498c0 -1 shutting down 2024-09-14T11:20:36.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:20:36.108+0000 7f5c94486640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64581, si_uid : 1000, si_addr0x3e80000fc45, si_status0 2024-09-14T11:21:05.897 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (29791 ms) 2024-09-14T11:21:05.897 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 9 tests from LibRGW (30474 ms total) 2024-09-14T11:21:05.897 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:21:05.897 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:05.897 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 9 tests from 1 test suite ran. (30474 ms total) 2024-09-14T11:21:05.897 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 9 tests. 2024-09-14T11:21:05.903 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2.2 2024-09-14T11:21:05.930 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:21:05.930 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:05.930 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:21:05.930 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:05.939 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:05.940 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:06.122 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (193 ms) 2024-09-14T11:21:06.123 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:06.123 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:21:06.123 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:21:06.123 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:21:06.123 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:21:06.143 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET (19 ms) 2024-09-14T11:21:06.143 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:21:06.152 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave0 2024-09-14T11:21:06.161 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave1 2024-09-14T11:21:06.170 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave2 2024-09-14T11:21:06.179 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave3 2024-09-14T11:21:06.188 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave4 2024-09-14T11:21:06.196 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave5 2024-09-14T11:21:06.205 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave6 2024-09-14T11:21:06.214 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave7 2024-09-14T11:21:06.223 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave8 2024-09-14T11:21:06.231 INFO:tasks.workunit.client.0.smithi028.stdout:created: sorrydave9 2024-09-14T11:21:06.232 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (89 ms) 2024-09-14T11:21:06.232 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:21:06.406 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (174 ms) 2024-09-14T11:21:06.406 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:06.407 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:06.407 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:06.407 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:06.407 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:06.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:21:06.408+0000 7fab1af3d8c0 -1 shutting down 2024-09-14T11:21:06.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:21:06.409+0000 7fa9f2f3c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65201, si_uid : 1000, si_addr0x3e80000feb1, si_status0 2024-09-14T11:21:36.307 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (29901 ms) 2024-09-14T11:21:36.307 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 9 tests from LibRGW (30377 ms total) 2024-09-14T11:21:36.307 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:21:36.307 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:36.307 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 9 tests from 1 test suite ran. (30377 ms total) 2024-09-14T11:21:36.307 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 9 tests. 2024-09-14T11:21:36.313 INFO:tasks.workunit.client.0.smithi028.stdout:phase 3.1 2024-09-14T11:21:36.645 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:21:36.645 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:36.645 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:21:36.645 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:36.654 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:36.655 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:37.035 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-14T11:21:37.035 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:37.036 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:21:37.036 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:21:37.046 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-14T11:21:37.046 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:21:37.050 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:21:37.050 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:21:37.052 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:21:37.052 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:21:37.104 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LARGE1 (53 ms) 2024-09-14T11:21:37.104 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:21:37.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LARGE2 (39 ms) 2024-09-14T11:21:37.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:21:37.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:21:37.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:21:37.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:21:37.144 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:37.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:21:37.146+0000 7f112beab8c0 -1 shutting down 2024-09-14T11:21:37.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:21:37.148+0000 7f1005bea640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65821, si_uid : 1000, si_addr0x3e80001011d, si_status0 2024-09-14T11:22:07.197 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30053 ms) 2024-09-14T11:22:07.197 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 13 tests from LibRGW (30551 ms total) 2024-09-14T11:22:07.197 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:22:07.197 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:07.198 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 13 tests from 1 test suite ran. (30551 ms total) 2024-09-14T11:22:07.198 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 13 tests. 2024-09-14T11:22:07.205 INFO:tasks.workunit.client.0.smithi028.stdout:phase 3.2 2024-09-14T11:22:07.539 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:22:07.539 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:07.540 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:22:07.540 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:07.548 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:07.548 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:07.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-14T11:22:07.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:07.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:07.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:07.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:22:07.934 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:07.940 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:22:07.940 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:07.945 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:22:07.945 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:22:08.007 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LARGE1 (63 ms) 2024-09-14T11:22:08.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:22:08.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:22:08.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:08.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:08.008 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:08.012 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-14T11:22:08.012 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:08.030 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET (19 ms) 2024-09-14T11:22:08.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:08.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:08.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:08.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:08.031 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:08.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:22:08.032+0000 7f06f55338c0 -1 shutting down 2024-09-14T11:22:08.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:22:08.034+0000 7f05cd501640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66440, si_uid : 1000, si_addr0x3e800010388, si_status0 2024-09-14T11:22:38.065 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30034 ms) 2024-09-14T11:22:38.065 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 13 tests from LibRGW (30525 ms total) 2024-09-14T11:22:38.065 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:22:38.065 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:38.065 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 13 tests from 1 test suite ran. (30525 ms total) 2024-09-14T11:22:38.065 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 13 tests. 2024-09-14T11:22:38.073 INFO:tasks.workunit.client.0.smithi028.stdout:phase 4.1 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:read i1: 64001 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:read s1: blunderbuss 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:22:38.100 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:38.112 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:38.112 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:38.713 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (613 ms) 2024-09-14T11:22:38.713 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:38.713 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:38.714 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:22:38.732 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-14T11:22:38.732 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_0 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_1 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_2 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_3 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_4 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_5 2024-09-14T11:22:39.299 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_6 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_7 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_8 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_9 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_10 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_11 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_12 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_13 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_14 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_15 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_16 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_17 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_18 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_19 2024-09-14T11:22:39.300 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_20 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_21 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_22 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_23 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_24 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_25 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_26 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_27 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_28 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_29 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_30 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_31 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_32 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_33 2024-09-14T11:22:39.301 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_34 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_35 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_36 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_37 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_38 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_39 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_40 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_41 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_42 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_43 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_44 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_45 2024-09-14T11:22:39.302 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_46 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_47 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_48 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_49 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_50 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_51 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_52 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_53 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_54 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_55 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_56 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_57 2024-09-14T11:22:39.303 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_58 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_59 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_60 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_61 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_62 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_63 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_64 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_65 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_66 2024-09-14T11:22:39.304 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_67 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_68 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_69 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_70 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_71 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_72 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_73 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_74 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_75 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_76 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_77 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_78 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_79 2024-09-14T11:22:39.305 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_80 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_81 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_82 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_83 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_84 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_85 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_86 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_87 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_88 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_89 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_90 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_91 2024-09-14T11:22:39.306 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_92 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_93 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_94 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_95 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_96 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_97 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_98 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:created: dmarker:f_99 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (567 ms) 2024-09-14T11:22:39.307 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:22:39.308 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:22:39.308 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:22:39.309 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:22:39.310 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:22:39.311 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:22:39.312 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:22:39.313 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:22:39.314 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:22:39.315 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:22:39.316 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:22:39.317 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:22:39.318 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:22:39.319 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:22:39.320 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:22:39.321 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:22:39.322 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:22:39.307+0000 7fddac11f8c0 -1 shutting down 2024-09-14T11:22:39.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:22:39.308+0000 7fdc834c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67059, si_uid : 1000, si_addr0x3e8000105f3, si_status0 2024-09-14T11:23:09.043 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (29738 ms) 2024-09-14T11:23:09.043 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 11 tests from LibRGW (30943 ms total) 2024-09-14T11:23:09.043 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:23:09.043 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:09.043 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 11 tests from 1 test suite ran. (30943 ms total) 2024-09-14T11:23:09.043 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 11 tests. 2024-09-14T11:23:09.050 INFO:tasks.workunit.client.0.smithi028.stdout:phase 4.2 2024-09-14T11:23:09.076 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:23:09.076 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:09.076 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:23:09.076 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:23:09.076 INFO:tasks.workunit.client.0.smithi028.stdout:read i1: 64001 2024-09-14T11:23:09.077 INFO:tasks.workunit.client.0.smithi028.stdout:read s1: blunderbuss 2024-09-14T11:23:09.077 INFO:tasks.workunit.client.0.smithi028.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:23:09.077 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:09.085 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:09.085 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:09.686 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (609 ms) 2024-09-14T11:23:09.686 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:09.687 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:23:09.687 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:09.697 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2024-09-14T11:23:09.697 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:09.697 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:23:09.697 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:09.697 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:23:09.698 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:23:09.701 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:09.701 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:09.702 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:09.703 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:09.704 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:09.705 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:09.706 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:09.707 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:09.708 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:09.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:23:09.703+0000 7f046b3518c0 -1 shutting down 2024-09-14T11:23:09.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:23:09.705+0000 7f034334c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67678, si_uid : 1000, si_addr0x3e80001085e, si_status0 2024-09-14T11:23:39.999 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30297 ms) 2024-09-14T11:23:39.999 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 11 tests from LibRGW (30922 ms total) 2024-09-14T11:23:39.999 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:23:40.000 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:40.000 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 11 tests from 1 test suite ran. (30922 ms total) 2024-09-14T11:23:40.000 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 11 tests. 2024-09-14T11:23:40.005 INFO:tasks.workunit.client.0.smithi028.stdout:phase 5.1 2024-09-14T11:23:40.041 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:23:40.041 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:40.041 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:23:40.041 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:40.051 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:40.051 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:40.235 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (194 ms) 2024-09-14T11:23:40.235 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:40.236 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:23:40.236 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:23:40.246 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-14T11:23:40.246 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:23:40.249 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:23:40.249 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:23:40.249 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:23:40.249 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:23:40.251 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:23:40.251 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:23:40.251 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:23:40.251 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:23:40.256 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-14T11:23:40.256 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:23:40.257 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:23:40.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:23:40.258+0000 7ff0b02c18c0 -1 shutting down 2024-09-14T11:23:40.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:23:40.259+0000 7fef8755a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68297, si_uid : 1000, si_addr0x3e800010ac9, si_status0 2024-09-14T11:24:10.427 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30169 ms) 2024-09-14T11:24:10.427 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 19 tests from LibRGW (30386 ms total) 2024-09-14T11:24:10.427 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:24:10.427 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:10.427 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 19 tests from 1 test suite ran. (30386 ms total) 2024-09-14T11:24:10.427 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 19 tests. 2024-09-14T11:24:10.433 INFO:tasks.workunit.client.0.smithi028.stdout:phase 5.2 2024-09-14T11:24:10.468 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:24:10.468 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:10.468 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:24:10.468 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:10.476 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:10.476 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:10.864 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-09-14T11:24:10.864 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:10.865 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:10.865 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:10.865 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:24:10.865 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:24:10.871 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:24:10.871 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:24:10.871 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:24:10.871 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:24:10.872 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:24:10.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:24:10.873 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:24:10.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:24:10.876 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:10.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.DELETE_BUCKET (17 ms) 2024-09-14T11:24:10.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:10.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:10.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:10.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:10.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:10.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:24:10.895+0000 7f086fd3f8c0 -1 shutting down 2024-09-14T11:24:10.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:24:10.896+0000 7f0747c3f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68916, si_uid : 1000, si_addr0x3e800010d34, si_status0 2024-09-14T11:24:41.224 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30331 ms) 2024-09-14T11:24:41.224 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 19 tests from LibRGW (30757 ms total) 2024-09-14T11:24:41.225 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:24:41.225 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:41.225 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 19 tests from 1 test suite ran. (30757 ms total) 2024-09-14T11:24:41.225 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 19 tests. 2024-09-14T11:24:41.231 INFO:tasks.workunit.client.0.smithi028.stdout:phase 6.1 2024-09-14T11:24:41.257 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:24:41.257 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:41.258 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:24:41.258 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:41.265 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:41.265 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:41.865 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.INIT (608 ms) 2024-09-14T11:24:41.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:41.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:41.866 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:24:41.886 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CREATE_BUCKETS (20 ms) 2024-09-14T11:24:41.886 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:24:41.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-14T11:24:41.894 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:24:41.913 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.TOPDIR_RENAME (19 ms) 2024-09-14T11:24:41.913 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:24:41.936 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SUBDIR_RENAME (23 ms) 2024-09-14T11:24:41.936 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:24:41.959 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (23 ms) 2024-09-14T11:24:41.959 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:41.959 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:41.960 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:41.960 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:41.960 INFO:tasks.workunit.client.0.smithi028.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:41.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:24:41.960+0000 7fc9366408c0 -1 shutting down 2024-09-14T11:24:41.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:24:41.961+0000 7fc81037f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69535, si_uid : 1000, si_addr0x3e800010f9f, si_status0 2024-09-14T11:25:12.215 INFO:tasks.workunit.client.0.smithi028.stdout:[ OK ] LibRGW.SHUTDOWN (30255 ms) 2024-09-14T11:25:12.215 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] 10 tests from LibRGW (30957 ms total) 2024-09-14T11:25:12.215 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:25:12.215 INFO:tasks.workunit.client.0.smithi028.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:12.216 INFO:tasks.workunit.client.0.smithi028.stdout:[==========] 10 tests from 1 test suite ran. (30957 ms total) 2024-09-14T11:25:12.216 INFO:tasks.workunit.client.0.smithi028.stdout:[ PASSED ] 10 tests. 2024-09-14T11:25:12.223 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:12.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:12.269 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:25:12.270 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:25:12.270 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:25:12.307 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -z ']' 2024-09-14T11:25:12.307 INFO:tasks.workunit.client.0.smithi028.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:12.307 INFO:tasks.workunit.client.0.smithi028.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:12.307 INFO:tasks.workunit.client.0.smithi028.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:12.307 INFO:tasks.workunit.client.0.smithi028.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:12.307 INFO:tasks.workunit.client.0.smithi028.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:25:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:12.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.388+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.389+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.389+0000 7f28b2692800 20 realm 2024-09-14T11:25:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.389+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.389+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.389+0000 7f28b2692800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:12.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.389+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.390+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.390+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.391+0000 7f28b2692800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:12.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.391+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.391+0000 7f28b2692800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:12.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.391+0000 7f28b2692800 20 searching for the correct realm 2024-09-14T11:25:12.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.394+0000 7f28af97b640 0 -- 172.21.15.28:0/3100747319 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f28a004bbf0 msgr2=0x7f28a00779f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:12.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.600+0000 7f28b017c640 0 -- 172.21.15.28:0/3100747319 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f28a40a6410 msgr2=0x7f28a40a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:25:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:25:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.807+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 20 zone default found 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 4 Realm: () 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:25:12.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 20 zonegroup default 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.808+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.809+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.809+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.809+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.809+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.809+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.810+0000 7f28b2692800 20 started sync module instance, tier type = 2024-09-14T11:25:12.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.810+0000 7f28b2692800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=0 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=1 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=2 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=3 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=4 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=5 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.819+0000 7f28b2692800 20 add_watcher() i=6 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.820+0000 7f28b2692800 20 add_watcher() i=7 2024-09-14T11:25:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.820+0000 7f28b2692800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:12.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.822+0000 7f2766fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.823+0000 7f28b2692800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.823+0000 7f28b2692800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.823+0000 7f28b2692800 5 note: GC not initialized 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.823+0000 7f2765fdb640 20 reqs_thread_entry: start 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.823+0000 7f28b2692800 20 init_complete bucket index max shards: 1 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.823+0000 7f28b2692800 20 Filter name: none 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f26d77fe640 20 reqs_thread_entry: start 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:25:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 20 rados->read ofs=0 len=0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.824+0000 7f28b2692800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.825+0000 7f28b2692800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:25:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.825+0000 7f28b2692800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:25:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.826+0000 7f28b2692800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:25:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.826+0000 7f28b2692800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.826+0000 7f28b2692800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:25:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.826+0000 7f27877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791301 cookie 94346881649744 notifier 5447 bl.length()=677 2024-09-14T11:25:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.826+0000 7f27877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:25:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.826+0000 7f27877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.829+0000 7f28b2692800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:25:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.829+0000 7f28b2692800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.829+0000 7f28b2692800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:25:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.830+0000 7f27877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791308 cookie 94346881631632 notifier 5447 bl.length()=187 2024-09-14T11:25:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.830+0000 7f27877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:25:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.830+0000 7f27877fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:12.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.832+0000 7f28b2692800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:25:12.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.832+0000 7f28b2692800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.832+0000 7f28b2692800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:25:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.833+0000 7f27877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791309 cookie 94346881631632 notifier 5447 bl.length()=197 2024-09-14T11:25:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.833+0000 7f27877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:25:12.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.833+0000 7f27877fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:12.832 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:25:12.832 INFO:tasks.workunit.client.0.smithi028.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:25:12.832 INFO:tasks.workunit.client.0.smithi028.stdout: "display_name": "maven test user", 2024-09-14T11:25:12.832 INFO:tasks.workunit.client.0.smithi028.stdout: "email": "sigv4@example.com", 2024-09-14T11:25:12.832 INFO:tasks.workunit.client.0.smithi028.stdout: "suspended": 0, 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "subusers": [], 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "keys": [ 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: { 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "user": "ceph-test-maven", 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "active": true, 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "create_date": "2024-09-14T11:25:12.825675Z" 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: ], 2024-09-14T11:25:12.833 INFO:tasks.workunit.client.0.smithi028.stdout: "swift_keys": [], 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "caps": [], 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "default_placement": "", 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "placement_tags": [], 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_quota": { 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "enabled": false, 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size": -1, 2024-09-14T11:25:12.834 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "max_objects": -1 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "user_quota": { 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "enabled": false, 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size": -1, 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:25:12.835 INFO:tasks.workunit.client.0.smithi028.stdout: "max_objects": -1 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "type": "rgw", 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "account_id": "", 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "path": "/", 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "create_date": "2024-09-14T11:25:12.825649Z", 2024-09-14T11:25:12.836 INFO:tasks.workunit.client.0.smithi028.stdout: "tags": [], 2024-09-14T11:25:12.837 INFO:tasks.workunit.client.0.smithi028.stdout: "group_ids": [] 2024-09-14T11:25:12.837 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:25:12.837 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:25:12.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.835+0000 7f2766fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:12.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.837+0000 7f28b2692800 20 remove_watcher() i=0 2024-09-14T11:25:12.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.837+0000 7f28b2692800 2 removed watcher, disabling cache 2024-09-14T11:25:12.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.838+0000 7f28b2692800 20 remove_watcher() i=1 2024-09-14T11:25:12.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.840+0000 7f28b2692800 20 remove_watcher() i=2 2024-09-14T11:25:12.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.841+0000 7f28b2692800 20 remove_watcher() i=3 2024-09-14T11:25:12.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.842+0000 7f28b2692800 20 remove_watcher() i=4 2024-09-14T11:25:12.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.843+0000 7f28b2692800 20 remove_watcher() i=5 2024-09-14T11:25:12.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.844+0000 7f28b2692800 20 remove_watcher() i=6 2024-09-14T11:25:12.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:25:12.845+0000 7f28b2692800 20 remove_watcher() i=7 2024-09-14T11:25:12.854 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -z ']' 2024-09-14T11:25:12.854 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:25:12.855 INFO:tasks.workunit.client.0.smithi028.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:25:12.856 INFO:tasks.workunit.client.0.smithi028.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi028.front.sepia.ceph.com:80 2024-09-14T11:25:12.856 INFO:tasks.workunit.client.0.smithi028.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi028.front.sepia.ceph.com:80 2024-09-14T11:25:12.856 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:25:12.856 INFO:tasks.workunit.client.0.smithi028.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:25:12.856 INFO:tasks.workunit.client.0.smithi028.stderr:+ ./mvnw clean package 2024-09-14T11:25:12.873 INFO:tasks.workunit.client.0.smithi028.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:25:14.512 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Scanning for projects... 2024-09-14T11:25:14.630 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:25:14.712 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 67 kB/s) 2024-09-14T11:25:14.722 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:25:14.762 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T11:25:14.769 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:25:14.788 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-14T11:25:14.811 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:14.811 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:25:14.811 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:25:14.811 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] from pom.xml 2024-09-14T11:25:14.811 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:25:14.813 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:25:14.829 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:25:14.835 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:25:14.850 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-14T11:25:14.853 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:25:14.870 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:25:14.874 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:25:14.890 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-14T11:25:14.902 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:25:14.919 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.2/36 kB Progress (1): 21/36 kB Progress (1): 30/36 kB Progress (1): 34/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-14T11:25:14.928 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:25:14.944 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-09-14T11:25:14.947 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:25:14.962 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-14T11:25:14.965 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:25:14.982 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/48 kB Progress (1): 18/48 kB Progress (1): 21/48 kB Progress (1): 32/48 kB Progress (1): 42/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-14T11:25:14.988 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:25:15.003 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-14T11:25:15.011 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:25:15.029 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/31 kB Progress (1): 18/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-14T11:25:15.037 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:25:15.051 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-14T11:25:15.057 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:25:15.074 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T11:25:15.083 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:25:15.098 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-14T11:25:15.101 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:25:15.116 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-14T11:25:15.120 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:25:15.136 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-14T11:25:15.142 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:25:15.158 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.8/24 kB Progress (1): 18/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T11:25:15.166 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:25:15.180 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-14T11:25:15.185 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:25:15.201 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T11:25:15.211 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:25:15.228 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-14T11:25:15.232 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:25:15.247 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-14T11:25:15.251 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:25:15.267 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-14T11:25:15.271 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:25:15.286 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-14T11:25:15.291 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:25:15.306 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:25:15.320 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:25:15.335 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T11:25:15.337 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:25:15.352 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-14T11:25:15.357 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:25:15.371 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:25:15.380 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:25:15.396 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-14T11:25:15.399 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:25:15.413 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:25:15.415 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:25:15.430 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-14T11:25:15.436 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:25:15.451 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-14T11:25:15.457 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:25:15.473 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-14T11:25:15.479 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:25:15.494 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-14T11:25:15.500 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:25:15.515 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-14T11:25:15.520 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:25:15.535 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-14T11:25:15.539 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:25:15.553 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-14T11:25:15.558 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:25:15.572 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T11:25:15.575 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:25:15.589 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 295 kB/s) 2024-09-14T11:25:15.590 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:25:15.604 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-14T11:25:15.609 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:25:15.624 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:25:15.629 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:25:15.644 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-14T11:25:15.649 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:25:15.664 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-14T11:25:15.669 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:25:15.683 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 529 kB/s) 2024-09-14T11:25:15.688 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:25:15.706 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-09-14T11:25:15.711 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:25:15.725 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-14T11:25:15.731 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:25:15.746 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-14T11:25:15.749 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:25:15.764 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:25:15.768 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:25:15.782 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:25:15.786 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:25:15.801 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-14T11:25:15.804 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:25:15.819 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-14T11:25:15.822 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:25:15.837 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-14T11:25:15.841 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:25:15.855 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-14T11:25:15.856 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:25:15.871 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:25:15.874 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:25:15.888 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-14T11:25:15.890 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:25:15.904 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-14T11:25:15.907 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:25:15.921 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-14T11:25:15.924 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:25:15.938 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:15.942 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:25:15.956 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:25:15.958 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:25:15.972 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-14T11:25:15.976 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:25:15.990 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-14T11:25:15.992 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:25:16.008 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:25:16.013 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:25:16.027 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-14T11:25:16.031 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:25:16.045 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:16.047 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:25:16.063 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.3 MB/s) 2024-09-14T11:25:16.067 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:25:16.081 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-14T11:25:16.084 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:25:16.099 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/20 kB Progress (1): 5.5/20 kB Progress (1): 8.2/20 kB Progress (1): 9.6/20 kB Progress (1): 14/20 kB Progress (1): 16/20 kB Progress (1): 19/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-14T11:25:16.102 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:25:16.118 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 63/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-14T11:25:16.123 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:25:16.137 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T11:25:16.139 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:25:16.153 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-14T11:25:16.156 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:25:16.170 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:16.172 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:25:16.187 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-14T11:25:16.188 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:25:16.203 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:25:16.205 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:25:16.219 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-14T11:25:16.221 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:25:16.235 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-14T11:25:16.237 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:25:16.254 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-14T11:25:16.256 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:25:16.271 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:16.272 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:25:16.286 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:16.289 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:25:16.302 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:25:16.306 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:25:16.320 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:25:16.322 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:25:16.336 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:25:16.338 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:25:16.352 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T11:25:16.354 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:25:16.369 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-14T11:25:16.371 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:25:16.385 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:25:16.387 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:25:16.401 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:25:16.418 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:25:16.496 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 42 MB/s) 2024-09-14T11:25:16.498 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:25:16.498 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:25:16.498 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:25:16.498 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:25:16.498 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:25:16.517 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 65/98 kB Progress (1): 81/98 kB Progress (1): 97/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.9 MB/s) 2024-09-14T11:25:16.517 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:25:16.534 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 446 kB/s) 2024-09-14T11:25:16.534 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:25:16.548 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/71 kB Progress (2): 1.4/71 kB | 1.4/35 kB Progress (3): 1.4/71 kB | 1.4/35 kB | 1.4/49 kB Progress (4): 1.4/71 kB | 1.4/35 kB | 1.4/49 kB | 1.4/16 kB Progress (4): 1.4/71 kB | 2.8/35 kB | 1.4/49 kB | 1.4/16 kB Progress (4): 2.8/71 kB | 2.8/35 kB | 1.4/49 kB | 1.4/16 kB Progress (4): 2.8/71 kB | 2.8/35 kB | 1.4/49 kB | 2.8/16 kB Progress (4): 2.8/71 kB | 2.8/35 kB | 2.8/49 kB | 2.8/16 kB Progress (4): 2.8/71 kB | 2.8/35 kB | 2.8/49 kB | 4.1/16 kB Progress (4): 4.1/71 kB | 2.8/35 kB | 2.8/49 kB | 4.1/16 kB Progress (4): 4.1/71 kB | 4.1/35 kB | 2.8/49 kB | 4.1/16 kB Progress (4): 5.5/71 kB | 4.1/35 kB | 2.8/49 kB | 4.1/16 kB Progress (4): 5.5/71 kB | 4.1/35 kB | 2.8/49 kB | 5.5/16 kB Progress (4): 5.5/71 kB | 4.1/35 kB | 4.1/49 kB | 5.5/16 kB Progress (4): 5.5/71 kB | 4.1/35 kB | 4.1/49 kB | 6.9/16 kB Progress (4): 6.9/71 kB | 4.1/35 kB | 4.1/49 kB | 6.9/16 kB Progress (4): 6.9/71 kB | 5.5/35 kB | 4.1/49 kB | 6.9/16 kB Progress (4): 8.3/71 kB | 5.5/35 kB | 4.1/49 kB | 6.9/16 kB Progress (4): 8.3/71 kB | 5.5/35 kB | 4.1/49 kB | 8.3/16 kB Progress (4): 8.3/71 kB | 5.5/35 kB | 5.5/49 kB | 8.3/16 kB Progress (4): 8.3/71 kB | 5.5/35 kB | 5.5/49 kB | 9.7/16 kB Progress (4): 8.3/71 kB | 6.9/35 kB | 5.5/49 kB | 9.7/16 kB Progress (4): 9.7/71 kB | 6.9/35 kB | 5.5/49 kB | 9.7/16 kB Progress (4): 9.7/71 kB | 6.9/35 kB | 5.5/49 kB | 11/16 kB Progress (4): 9.7/71 kB | 6.9/35 kB | 6.9/49 kB | 11/16 kB Progress (4): 9.7/71 kB | 6.9/35 kB | 6.9/49 kB | 12/16 kB Progress (4): 11/71 kB | 6.9/35 kB | 6.9/49 kB | 12/16 kB Progress (4): 11/71 kB | 8.3/35 kB | 6.9/49 kB | 12/16 kB Progress (4): 12/71 kB | 8.3/35 kB | 6.9/49 kB | 12/16 kB Progress (4): 12/71 kB | 8.3/35 kB | 6.9/49 kB | 14/16 kB Progress (4): 12/71 kB | 8.3/35 kB | 8.3/49 kB | 14/16 kB Progress (4): 12/71 kB | 8.3/35 kB | 8.3/49 kB | 15/16 kB Progress (4): 12/71 kB | 9.7/35 kB | 8.3/49 kB | 15/16 kB Progress (4): 14/71 kB | 9.7/35 kB | 8.3/49 kB | 15/16 kB Progress (4): 14/71 kB | 9.7/35 kB | 8.3/49 kB | 16 kB Progress (4): 14/71 kB | 9.7/35 kB | 9.7/49 kB | 16 kB Progress (4): 15/71 kB | 9.7/35 kB | 9.7/49 kB | 16 kB Progress (4): 15/71 kB | 9.7/35 kB | 11/49 kB | 16 kB Progress (4): 15/71 kB | 11/35 kB | 11/49 kB | 16 kB Progress (4): 15/71 kB | 11/35 kB | 12/49 kB | 16 kB Progress (4): 17/71 kB | 11/35 kB | 12/49 kB | 16 kB Progress (4): 17/71 kB | 11/35 kB | 14/49 kB | 16 kB Progress (4): 17/71 kB | 12/35 kB | 14/49 kB | 16 kB Progress (4): 17/71 kB | 12/35 kB | 15/49 kB | 16 kB Progress (4): 18/71 kB | 12/35 kB | 15/49 kB | 16 kB Progress (4): 18/71 kB | 12/35 kB | 17/49 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 336 kB/s) 2024-09-14T11:25:16.548 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 18/71 kB | 14/35 kB | 17/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:25:16.556 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 18/71 kB | 14/35 kB | 18/49 kB Progress (3): 19/71 kB | 14/35 kB | 18/49 kB Progress (3): 19/71 kB | 14/35 kB | 19/49 kB Progress (3): 19/71 kB | 15/35 kB | 19/49 kB Progress (3): 19/71 kB | 15/35 kB | 21/49 kB Progress (3): 19/71 kB | 17/35 kB | 21/49 kB Progress (3): 19/71 kB | 17/35 kB | 22/49 kB Progress (3): 19/71 kB | 18/35 kB | 22/49 kB Progress (3): 21/71 kB | 18/35 kB | 22/49 kB Progress (3): 21/71 kB | 19/35 kB | 22/49 kB Progress (3): 22/71 kB | 19/35 kB | 22/49 kB Progress (3): 22/71 kB | 19/35 kB | 23/49 kB Progress (3): 22/71 kB | 21/35 kB | 23/49 kB Progress (3): 23/71 kB | 21/35 kB | 23/49 kB Progress (3): 23/71 kB | 21/35 kB | 25/49 kB Progress (3): 23/71 kB | 22/35 kB | 25/49 kB Progress (3): 25/71 kB | 22/35 kB | 25/49 kB Progress (3): 25/71 kB | 23/35 kB | 25/49 kB Progress (3): 26/71 kB | 23/35 kB | 25/49 kB Progress (3): 26/71 kB | 23/35 kB | 26/49 kB Progress (3): 26/71 kB | 25/35 kB | 26/49 kB Progress (3): 26/71 kB | 25/35 kB | 28/49 kB Progress (3): 28/71 kB | 25/35 kB | 28/49 kB Progress (3): 28/71 kB | 26/35 kB | 28/49 kB Progress (3): 29/71 kB | 26/35 kB | 28/49 kB Progress (3): 29/71 kB | 26/35 kB | 29/49 kB Progress (3): 30/71 kB | 26/35 kB | 29/49 kB Progress (3): 30/71 kB | 28/35 kB | 29/49 kB Progress (3): 30/71 kB | 28/35 kB | 30/49 kB Progress (3): 30/71 kB | 29/35 kB | 30/49 kB Progress (3): 30/71 kB | 30/35 kB | 30/49 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 16/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 33/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 49/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 66/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 82/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 98/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 115/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 131/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 147/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 164/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 180/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 197/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 213/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 229/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 246/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 262/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 278/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 295/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 311/782 kB Progress (4): 32/71 kB | 30/35 kB | 30/49 kB | 311/782 kB Progress (4): 32/71 kB | 30/35 kB | 32/49 kB | 311/782 kB Progress (4): 33/71 kB | 30/35 kB | 32/49 kB | 311/782 kB Progress (4): 33/71 kB | 32/35 kB | 32/49 kB | 311/782 kB Progress (4): 34/71 kB | 32/35 kB | 32/49 kB | 311/782 kB Progress (4): 34/71 kB | 33/35 kB | 32/49 kB | 311/782 kB Progress (4): 34/71 kB | 33/35 kB | 33/49 kB | 311/782 kB Progress (4): 34/71 kB | 34/35 kB | 33/49 kB | 311/782 kB Progress (4): 34/71 kB | 34/35 kB | 34/49 kB | 311/782 kB Progress (4): 36/71 kB | 34/35 kB | 34/49 kB | 311/782 kB Progress (4): 36/71 kB | 34/35 kB | 34/49 kB | 328/782 kB Progress (4): 37/71 kB | 34/35 kB | 34/49 kB | 328/782 kB Progress (4): 37/71 kB | 34/35 kB | 36/49 kB | 328/782 kB Progress (4): 37/71 kB | 35 kB | 36/49 kB | 328/782 kB Progress (4): 37/71 kB | 35 kB | 36/49 kB | 344/782 kB Progress (4): 37/71 kB | 35 kB | 37/49 kB | 344/782 kB Progress (4): 39/71 kB | 35 kB | 37/49 kB | 344/782 kB Progress (4): 39/71 kB | 35 kB | 39/49 kB | 344/782 kB Progress (4): 40/71 kB | 35 kB | 39/49 kB | 344/782 kB Progress (4): 40/71 kB | 35 kB | 40/49 kB | 344/782 kB Progress (4): 40/71 kB | 35 kB | 40/49 kB | 360/782 kB Progress (4): 40/71 kB | 35 kB | 41/49 kB | 360/782 kB Progress (4): 41/71 kB | 35 kB | 41/49 kB | 360/782 kB Progress (4): 41/71 kB | 35 kB | 43/49 kB | 360/782 kB Progress (4): 43/71 kB | 35 kB | 43/49 kB | 360/782 kB Progress (4): 43/71 kB | 35 kB | 43/49 kB | 377/782 kB Progress (4): 44/71 kB | 35 kB | 43/49 kB | 377/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-09-14T11:25:16.557 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 46/71 kB | 43/49 kB | 377/782 kB Progress (3): 46/71 kB | 44/49 kB | 377/782 kB Progress (3): 46/71 kB | 44/49 kB | 393/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:25:16.557 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 46/71 kB | 44/49 kB | 410/782 kB Progress (3): 46/71 kB | 44/49 kB | 426/782 kB Progress (3): 47/71 kB | 44/49 kB | 426/782 kB Progress (3): 47/71 kB | 46/49 kB | 426/782 kB Progress (3): 48/71 kB | 46/49 kB | 426/782 kB Progress (3): 48/71 kB | 46/49 kB | 442/782 kB Progress (3): 48/71 kB | 47/49 kB | 442/782 kB Progress (3): 49/71 kB | 47/49 kB | 442/782 kB Progress (3): 49/71 kB | 48/49 kB | 442/782 kB Progress (3): 49/71 kB | 49 kB | 442/782 kB Progress (3): 49/71 kB | 49 kB | 459/782 kB Progress (3): 49/71 kB | 49 kB | 475/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 849 kB/s) 2024-09-14T11:25:16.557 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 49/71 kB | 491/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:25:16.561 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 49/71 kB | 508/782 kB Progress (2): 49/71 kB | 524/782 kB Progress (2): 49/71 kB | 541/782 kB Progress (2): 49/71 kB | 557/782 kB Progress (2): 49/71 kB | 573/782 kB Progress (2): 49/71 kB | 590/782 kB Progress (2): 49/71 kB | 606/782 kB Progress (3): 49/71 kB | 606/782 kB | 1.4/11 kB Progress (3): 49/71 kB | 606/782 kB | 2.8/11 kB Progress (3): 49/71 kB | 623/782 kB | 2.8/11 kB Progress (3): 49/71 kB | 623/782 kB | 4.1/11 kB Progress (3): 49/71 kB | 623/782 kB | 5.5/11 kB Progress (3): 49/71 kB | 639/782 kB | 5.5/11 kB Progress (3): 49/71 kB | 639/782 kB | 6.9/11 kB Progress (3): 49/71 kB | 639/782 kB | 8.3/11 kB Progress (3): 49/71 kB | 639/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 655/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 672/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 672/782 kB | 11/11 kB Progress (3): 49/71 kB | 672/782 kB | 11 kB Progress (3): 49/71 kB | 688/782 kB | 11 kB Progress (3): 49/71 kB | 704/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 183 kB/s) 2024-09-14T11:25:16.561 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 49/71 kB | 721/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:25:16.562 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 49/71 kB | 737/782 kB Progress (2): 49/71 kB | 754/782 kB Progress (2): 49/71 kB | 770/782 kB Progress (2): 49/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-14T11:25:16.563 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:25:16.565 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.1 MB/s) 2024-09-14T11:25:16.565 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:25:16.572 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/205 kB Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 31/205 kB Progress (2): 31/205 kB | 16/30 kB Progress (2): 31/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 414 kB/s) 2024-09-14T11:25:16.573 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:25:16.579 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 31/205 kB | 1.4/81 kB Progress (2): 31/205 kB | 2.8/81 kB Progress (2): 31/205 kB | 4.1/81 kB Progress (2): 31/205 kB | 5.5/81 kB Progress (2): 31/205 kB | 6.9/81 kB Progress (2): 31/205 kB | 8.3/81 kB Progress (2): 31/205 kB | 9.7/81 kB Progress (3): 31/205 kB | 9.7/81 kB | 16/798 kB Progress (3): 31/205 kB | 9.7/81 kB | 33/798 kB Progress (3): 31/205 kB | 11/81 kB | 33/798 kB Progress (3): 31/205 kB | 12/81 kB | 33/798 kB Progress (3): 31/205 kB | 14/81 kB | 33/798 kB Progress (3): 31/205 kB | 14/81 kB | 49/798 kB Progress (3): 31/205 kB | 15/81 kB | 49/798 kB Progress (3): 31/205 kB | 16/81 kB | 49/798 kB Progress (3): 31/205 kB | 16/81 kB | 66/798 kB Progress (3): 31/205 kB | 16/81 kB | 82/798 kB Progress (3): 31/205 kB | 16/81 kB | 95/798 kB Progress (3): 31/205 kB | 16/81 kB | 111/798 kB Progress (3): 31/205 kB | 16/81 kB | 128/798 kB Progress (3): 31/205 kB | 16/81 kB | 144/798 kB Progress (4): 31/205 kB | 16/81 kB | 144/798 kB | 13 kB Progress (4): 31/205 kB | 16/81 kB | 160/798 kB | 13 kB Progress (4): 31/205 kB | 16/81 kB | 177/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 166 kB/s) 2024-09-14T11:25:16.579 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:25:16.590 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 31/205 kB | 16/81 kB | 193/798 kB Progress (3): 48/205 kB | 16/81 kB | 193/798 kB Progress (3): 48/205 kB | 16/81 kB | 209/798 kB Progress (3): 48/205 kB | 16/81 kB | 226/798 kB Progress (3): 48/205 kB | 16/81 kB | 242/798 kB Progress (3): 64/205 kB | 16/81 kB | 242/798 kB Progress (3): 64/205 kB | 16/81 kB | 259/798 kB Progress (3): 64/205 kB | 16/81 kB | 275/798 kB Progress (3): 64/205 kB | 16/81 kB | 291/798 kB Progress (3): 64/205 kB | 16/81 kB | 308/798 kB Progress (3): 64/205 kB | 16/81 kB | 324/798 kB Progress (3): 81/205 kB | 16/81 kB | 324/798 kB Progress (3): 81/205 kB | 16/81 kB | 341/798 kB Progress (3): 81/205 kB | 16/81 kB | 357/798 kB Progress (3): 81/205 kB | 16/81 kB | 373/798 kB Progress (3): 81/205 kB | 16/81 kB | 390/798 kB Progress (3): 97/205 kB | 16/81 kB | 390/798 kB Progress (3): 97/205 kB | 16/81 kB | 406/798 kB Progress (3): 97/205 kB | 16/81 kB | 422/798 kB Progress (3): 97/205 kB | 16/81 kB | 439/798 kB Progress (3): 97/205 kB | 16/81 kB | 455/798 kB Progress (3): 113/205 kB | 16/81 kB | 455/798 kB Progress (3): 113/205 kB | 16/81 kB | 472/798 kB Progress (3): 113/205 kB | 16/81 kB | 488/798 kB Progress (3): 113/205 kB | 16/81 kB | 504/798 kB Progress (3): 130/205 kB | 16/81 kB | 504/798 kB Progress (3): 130/205 kB | 16/81 kB | 521/798 kB Progress (3): 130/205 kB | 16/81 kB | 537/798 kB Progress (3): 146/205 kB | 16/81 kB | 537/798 kB Progress (3): 146/205 kB | 16/81 kB | 554/798 kB Progress (3): 146/205 kB | 16/81 kB | 570/798 kB Progress (3): 146/205 kB | 16/81 kB | 586/798 kB Progress (3): 146/205 kB | 16/81 kB | 603/798 kB Progress (3): 146/205 kB | 16/81 kB | 619/798 kB Progress (3): 146/205 kB | 16/81 kB | 635/798 kB Progress (3): 146/205 kB | 33/81 kB | 635/798 kB Progress (4): 146/205 kB | 33/81 kB | 635/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 652/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 668/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 685/798 kB | 16/182 kB Progress (4): 146/205 kB | 33/81 kB | 701/798 kB | 16/182 kB Progress (4): 146/205 kB | 49/81 kB | 701/798 kB | 16/182 kB Progress (4): 146/205 kB | 49/81 kB | 717/798 kB | 16/182 kB Progress (4): 146/205 kB | 49/81 kB | 717/798 kB | 33/182 kB Progress (4): 146/205 kB | 49/81 kB | 734/798 kB | 33/182 kB Progress (4): 146/205 kB | 49/81 kB | 750/798 kB | 33/182 kB Progress (4): 146/205 kB | 49/81 kB | 766/798 kB | 33/182 kB Progress (4): 146/205 kB | 49/81 kB | 766/798 kB | 49/182 kB Progress (4): 146/205 kB | 49/81 kB | 783/798 kB | 49/182 kB Progress (4): 146/205 kB | 64/81 kB | 783/798 kB | 49/182 kB Progress (4): 146/205 kB | 64/81 kB | 798 kB | 49/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 8.8 MB/s) 2024-09-14T11:25:16.591 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:25:16.592 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 162/205 kB | 64/81 kB | 49/182 kB Progress (3): 162/205 kB | 80/81 kB | 49/182 kB Progress (3): 162/205 kB | 80/81 kB | 62/182 kB Progress (3): 162/205 kB | 81 kB | 62/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 883 kB/s) 2024-09-14T11:25:16.592 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 179/205 kB | 62/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:25:16.594 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 195/205 kB | 62/182 kB Progress (2): 205 kB | 62/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-14T11:25:16.594 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:25:16.605 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 62/182 kB | 16/151 kB Progress (2): 62/182 kB | 33/151 kB Progress (2): 62/182 kB | 49/151 kB Progress (2): 78/182 kB | 49/151 kB Progress (2): 94/182 kB | 49/151 kB Progress (2): 94/182 kB | 66/151 kB Progress (2): 111/182 kB | 66/151 kB Progress (2): 127/182 kB | 66/151 kB Progress (2): 143/182 kB | 66/151 kB Progress (2): 160/182 kB | 66/151 kB Progress (2): 176/182 kB | 66/151 kB Progress (2): 182 kB | 66/151 kB Progress (3): 182 kB | 66/151 kB | 15/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:25:16.605 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 66/151 kB | 27 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:25:16.605 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 257 kB/s) 2024-09-14T11:25:16.605 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:25:16.606 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 66/151 kB | 16/30 kB Progress (2): 66/151 kB | 30 kB Progress (2): 82/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 281 kB/s) 2024-09-14T11:25:16.607 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:25:16.610 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 98/151 kB Progress (2): 98/151 kB | 16/385 kB Progress (2): 98/151 kB | 33/385 kB Progress (2): 111/151 kB | 33/385 kB Progress (2): 111/151 kB | 49/385 kB Progress (2): 111/151 kB | 66/385 kB Progress (2): 128/151 kB | 66/385 kB Progress (2): 128/151 kB | 82/385 kB Progress (2): 128/151 kB | 98/385 kB Progress (2): 144/151 kB | 98/385 kB Progress (2): 144/151 kB | 115/385 kB Progress (2): 151 kB | 115/385 kB Progress (2): 151 kB | 131/385 kB Progress (2): 151 kB | 147/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-14T11:25:16.610 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:25:16.620 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 197/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 246/385 kB Progress (1): 262/385 kB Progress (2): 262/385 kB | 13 kB Progress (2): 279/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 111 kB/s) 2024-09-14T11:25:16.620 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 279/385 kB | 16/75 kB Progress (2): 295/385 kB | 16/75 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:25:16.621 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 311/385 kB | 16/75 kB Progress (2): 311/385 kB | 33/75 kB Progress (2): 328/385 kB | 33/75 kB Progress (2): 328/385 kB | 49/75 kB Progress (2): 344/385 kB | 49/75 kB Progress (2): 344/385 kB | 66/75 kB Progress (2): 360/385 kB | 66/75 kB Progress (2): 360/385 kB | 75 kB Progress (3): 360/385 kB | 75 kB | 16/780 kB Progress (3): 377/385 kB | 75 kB | 16/780 kB Progress (3): 385 kB | 75 kB | 16/780 kB Progress (3): 385 kB | 75 kB | 33/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 621 kB/s) 2024-09-14T11:25:16.621 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:25:16.621 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.2 MB/s) 2024-09-14T11:25:16.621 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:25:16.641 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (1): 82/780 kB Progress (1): 94/780 kB Progress (2): 94/780 kB | 16/329 kB Progress (2): 111/780 kB | 16/329 kB Progress (2): 111/780 kB | 33/329 kB Progress (2): 127/780 kB | 33/329 kB Progress (2): 127/780 kB | 49/329 kB Progress (2): 144/780 kB | 49/329 kB Progress (3): 144/780 kB | 49/329 kB | 16/41 kB Progress (4): 144/780 kB | 49/329 kB | 16/41 kB | 16/501 kB Progress (4): 144/780 kB | 65/329 kB | 16/41 kB | 16/501 kB Progress (5): 144/780 kB | 65/329 kB | 16/41 kB | 16/501 kB | 16/354 kB Progress (5): 160/780 kB | 65/329 kB | 16/41 kB | 16/501 kB | 16/354 kB Progress (5): 160/780 kB | 65/329 kB | 33/41 kB | 16/501 kB | 16/354 kB Progress (5): 160/780 kB | 65/329 kB | 33/41 kB | 33/501 kB | 16/354 kB Progress (5): 160/780 kB | 82/329 kB | 33/41 kB | 33/501 kB | 16/354 kB Progress (5): 160/780 kB | 82/329 kB | 41 kB | 33/501 kB | 16/354 kB Progress (5): 160/780 kB | 82/329 kB | 41 kB | 33/501 kB | 33/354 kB Progress (5): 176/780 kB | 82/329 kB | 41 kB | 33/501 kB | 33/354 kB Progress (5): 176/780 kB | 82/329 kB | 41 kB | 49/501 kB | 33/354 kB Progress (5): 176/780 kB | 98/329 kB | 41 kB | 49/501 kB | 33/354 kB Progress (5): 193/780 kB | 98/329 kB | 41 kB | 49/501 kB | 33/354 kB Progress (5): 193/780 kB | 98/329 kB | 41 kB | 49/501 kB | 49/354 kB Progress (5): 193/780 kB | 98/329 kB | 41 kB | 66/501 kB | 49/354 kB Progress (5): 193/780 kB | 114/329 kB | 41 kB | 66/501 kB | 49/354 kB Progress (5): 209/780 kB | 114/329 kB | 41 kB | 66/501 kB | 49/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 298 kB/s) 2024-09-14T11:25:16.641 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (4): 209/780 kB | 114/329 kB | 66/501 kB | 66/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:25:16.646 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (4): 209/780 kB | 114/329 kB | 82/501 kB | 66/354 kB Progress (4): 209/780 kB | 131/329 kB | 82/501 kB | 66/354 kB Progress (4): 225/780 kB | 131/329 kB | 82/501 kB | 66/354 kB Progress (4): 225/780 kB | 131/329 kB | 82/501 kB | 82/354 kB Progress (4): 225/780 kB | 131/329 kB | 98/501 kB | 82/354 kB Progress (4): 225/780 kB | 147/329 kB | 98/501 kB | 82/354 kB Progress (4): 242/780 kB | 147/329 kB | 98/501 kB | 82/354 kB Progress (4): 242/780 kB | 147/329 kB | 98/501 kB | 98/354 kB Progress (4): 242/780 kB | 147/329 kB | 112/501 kB | 98/354 kB Progress (4): 258/780 kB | 147/329 kB | 112/501 kB | 98/354 kB Progress (4): 258/780 kB | 164/329 kB | 112/501 kB | 98/354 kB Progress (4): 258/780 kB | 164/329 kB | 112/501 kB | 115/354 kB Progress (4): 275/780 kB | 164/329 kB | 112/501 kB | 115/354 kB Progress (4): 275/780 kB | 164/329 kB | 128/501 kB | 115/354 kB Progress (4): 275/780 kB | 180/329 kB | 128/501 kB | 115/354 kB Progress (4): 275/780 kB | 180/329 kB | 128/501 kB | 131/354 kB Progress (4): 291/780 kB | 180/329 kB | 128/501 kB | 131/354 kB Progress (4): 291/780 kB | 180/329 kB | 145/501 kB | 131/354 kB Progress (4): 291/780 kB | 196/329 kB | 145/501 kB | 131/354 kB Progress (4): 291/780 kB | 196/329 kB | 145/501 kB | 147/354 kB Progress (4): 291/780 kB | 196/329 kB | 161/501 kB | 147/354 kB Progress (4): 291/780 kB | 213/329 kB | 161/501 kB | 147/354 kB Progress (4): 291/780 kB | 213/329 kB | 161/501 kB | 164/354 kB Progress (4): 291/780 kB | 213/329 kB | 177/501 kB | 164/354 kB Progress (4): 291/780 kB | 229/329 kB | 177/501 kB | 164/354 kB Progress (4): 291/780 kB | 229/329 kB | 177/501 kB | 180/354 kB Progress (4): 291/780 kB | 229/329 kB | 194/501 kB | 180/354 kB Progress (4): 291/780 kB | 245/329 kB | 194/501 kB | 180/354 kB Progress (4): 291/780 kB | 245/329 kB | 194/501 kB | 197/354 kB Progress (4): 291/780 kB | 245/329 kB | 210/501 kB | 197/354 kB Progress (4): 291/780 kB | 262/329 kB | 210/501 kB | 197/354 kB Progress (4): 291/780 kB | 262/329 kB | 210/501 kB | 213/354 kB Progress (4): 291/780 kB | 262/329 kB | 227/501 kB | 213/354 kB Progress (4): 291/780 kB | 278/329 kB | 227/501 kB | 213/354 kB Progress (4): 291/780 kB | 278/329 kB | 227/501 kB | 229/354 kB Progress (4): 291/780 kB | 278/329 kB | 243/501 kB | 229/354 kB Progress (4): 291/780 kB | 295/329 kB | 243/501 kB | 229/354 kB Progress (4): 291/780 kB | 295/329 kB | 243/501 kB | 246/354 kB Progress (4): 291/780 kB | 295/329 kB | 259/501 kB | 246/354 kB Progress (4): 291/780 kB | 311/329 kB | 259/501 kB | 246/354 kB Progress (4): 291/780 kB | 311/329 kB | 259/501 kB | 262/354 kB Progress (4): 291/780 kB | 311/329 kB | 276/501 kB | 262/354 kB Progress (4): 291/780 kB | 323/329 kB | 276/501 kB | 262/354 kB Progress (4): 291/780 kB | 323/329 kB | 276/501 kB | 279/354 kB Progress (4): 291/780 kB | 329 kB | 276/501 kB | 279/354 kB Progress (4): 291/780 kB | 329 kB | 292/501 kB | 279/354 kB Progress (4): 291/780 kB | 329 kB | 292/501 kB | 295/354 kB Progress (4): 291/780 kB | 329 kB | 309/501 kB | 295/354 kB Progress (4): 291/780 kB | 329 kB | 309/501 kB | 311/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.3 MB/s) 2024-09-14T11:25:16.646 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 291/780 kB | 325/501 kB | 311/354 kB Progress (3): 291/780 kB | 325/501 kB | 328/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:25:16.646 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 291/780 kB | 341/501 kB | 328/354 kB Progress (3): 291/780 kB | 341/501 kB | 344/354 kB Progress (3): 291/780 kB | 341/501 kB | 354 kB Progress (3): 291/780 kB | 358/501 kB | 354 kB Progress (3): 291/780 kB | 374/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-14T11:25:16.646 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:25:16.650 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 291/780 kB | 390/501 kB Progress (2): 291/780 kB | 407/501 kB Progress (2): 291/780 kB | 423/501 kB Progress (2): 291/780 kB | 440/501 kB Progress (2): 291/780 kB | 456/501 kB Progress (2): 291/780 kB | 472/501 kB Progress (2): 307/780 kB | 472/501 kB Progress (2): 307/780 kB | 489/501 kB Progress (2): 324/780 kB | 489/501 kB Progress (2): 324/780 kB | 501 kB Progress (2): 340/780 kB | 501 kB Progress (2): 356/780 kB | 501 kB Progress (2): 373/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.4 MB/s) 2024-09-14T11:25:16.650 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:25:16.654 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 389/780 kB Progress (1): 406/780 kB Progress (1): 422/780 kB Progress (1): 438/780 kB Progress (1): 455/780 kB Progress (1): 471/780 kB Progress (1): 488/780 kB Progress (1): 504/780 kB Progress (1): 520/780 kB Progress (1): 537/780 kB Progress (1): 553/780 kB Progress (2): 553/780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 42 kB/s) 2024-09-14T11:25:16.654 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:25:16.664 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 553/780 kB | 16/586 kB Progress (3): 553/780 kB | 16/586 kB | 16/211 kB Progress (3): 553/780 kB | 33/586 kB | 16/211 kB Progress (3): 553/780 kB | 33/586 kB | 33/211 kB Progress (3): 553/780 kB | 33/586 kB | 49/211 kB Progress (3): 553/780 kB | 49/586 kB | 49/211 kB Progress (3): 569/780 kB | 49/586 kB | 49/211 kB Progress (3): 569/780 kB | 49/586 kB | 66/211 kB Progress (3): 569/780 kB | 62/586 kB | 66/211 kB Progress (3): 569/780 kB | 62/586 kB | 82/211 kB Progress (3): 586/780 kB | 62/586 kB | 82/211 kB Progress (3): 586/780 kB | 62/586 kB | 98/211 kB Progress (3): 602/780 kB | 62/586 kB | 98/211 kB Progress (3): 602/780 kB | 78/586 kB | 98/211 kB Progress (3): 602/780 kB | 78/586 kB | 114/211 kB Progress (3): 619/780 kB | 78/586 kB | 114/211 kB Progress (3): 619/780 kB | 95/586 kB | 114/211 kB Progress (3): 619/780 kB | 95/586 kB | 131/211 kB Progress (3): 635/780 kB | 95/586 kB | 131/211 kB Progress (3): 635/780 kB | 95/586 kB | 147/211 kB Progress (3): 651/780 kB | 95/586 kB | 147/211 kB Progress (3): 651/780 kB | 111/586 kB | 147/211 kB Progress (3): 651/780 kB | 111/586 kB | 163/211 kB Progress (3): 668/780 kB | 111/586 kB | 163/211 kB Progress (3): 668/780 kB | 127/586 kB | 163/211 kB Progress (3): 668/780 kB | 127/586 kB | 180/211 kB Progress (3): 684/780 kB | 127/586 kB | 180/211 kB Progress (3): 684/780 kB | 127/586 kB | 196/211 kB Progress (3): 701/780 kB | 127/586 kB | 196/211 kB Progress (3): 701/780 kB | 144/586 kB | 196/211 kB Progress (3): 701/780 kB | 144/586 kB | 211 kB Progress (3): 717/780 kB | 144/586 kB | 211 kB Progress (3): 717/780 kB | 160/586 kB | 211 kB Progress (3): 733/780 kB | 160/586 kB | 211 kB Progress (3): 733/780 kB | 176/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.3 MB/s) 2024-09-14T11:25:16.664 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:25:16.664 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 750/780 kB | 176/586 kB Progress (3): 750/780 kB | 176/586 kB | 14 kB Progress (3): 750/780 kB | 193/586 kB | 14 kB Progress (3): 766/780 kB | 193/586 kB | 14 kB Progress (3): 766/780 kB | 209/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 87 kB/s) 2024-09-14T11:25:16.665 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:25:16.665 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 780 kB | 209/586 kB Progress (2): 780 kB | 226/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.7 MB/s) 2024-09-14T11:25:16.665 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 242/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:25:16.670 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (2): 324/586 kB | 16/106 kB Progress (2): 340/586 kB | 16/106 kB Progress (2): 340/586 kB | 33/106 kB Progress (2): 357/586 kB | 33/106 kB Progress (2): 357/586 kB | 49/106 kB Progress (2): 357/586 kB | 66/106 kB Progress (2): 373/586 kB | 66/106 kB Progress (2): 373/586 kB | 82/106 kB Progress (2): 389/586 kB | 82/106 kB Progress (2): 406/586 kB | 82/106 kB Progress (2): 406/586 kB | 98/106 kB Progress (2): 406/586 kB | 106 kB Progress (2): 422/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 629 kB/s) 2024-09-14T11:25:16.670 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 439/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:25:16.674 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 455/586 kB Progress (1): 471/586 kB Progress (1): 488/586 kB Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.4 MB/s) 2024-09-14T11:25:16.674 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:25:16.677 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-14T11:25:16.678 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:25:16.682 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/245 kB Progress (2): 16/245 kB | 16/205 kB Progress (2): 33/245 kB | 16/205 kB Progress (2): 33/245 kB | 33/205 kB Progress (2): 33/245 kB | 49/205 kB Progress (2): 49/245 kB | 49/205 kB Progress (2): 49/245 kB | 66/205 kB Progress (2): 66/245 kB | 66/205 kB Progress (2): 66/245 kB | 82/205 kB Progress (2): 82/245 kB | 82/205 kB Progress (2): 82/245 kB | 98/205 kB Progress (2): 82/245 kB | 115/205 kB Progress (2): 95/245 kB | 115/205 kB Progress (2): 95/245 kB | 131/205 kB Progress (2): 112/245 kB | 131/205 kB Progress (2): 112/245 kB | 147/205 kB Progress (2): 128/245 kB | 147/205 kB Progress (2): 128/245 kB | 164/205 kB Progress (2): 128/245 kB | 180/205 kB Progress (2): 145/245 kB | 180/205 kB Progress (2): 145/245 kB | 197/205 kB Progress (2): 145/245 kB | 205 kB Progress (2): 161/245 kB | 205 kB Progress (2): 177/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:25:16.682 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:25:16.684 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 194/245 kB Progress (1): 210/245 kB Progress (1): 226/245 kB Progress (2): 226/245 kB | 15 kB Progress (2): 243/245 kB | 15 kB Progress (2): 245 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 83 kB/s) 2024-09-14T11:25:16.684 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:25:16.684 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-14T11:25:16.684 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:25:16.688 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 88 kB/s) 2024-09-14T11:25:16.688 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:25:16.691 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-14T11:25:16.697 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 116 kB/s) 2024-09-14T11:25:16.698 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 123 kB/s) 2024-09-14T11:25:16.698 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 88 kB/s) 2024-09-14T11:25:16.706 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15/184 kB Progress (1): 31/184 kB Progress (1): 48/184 kB Progress (1): 64/184 kB Progress (1): 81/184 kB Progress (1): 94/184 kB Progress (1): 110/184 kB Progress (1): 126/184 kB Progress (1): 143/184 kB Progress (1): 159/184 kB Progress (1): 175/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 897 kB/s) 2024-09-14T11:25:16.725 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:16.725 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:25:16.731 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:25:16.746 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-14T11:25:16.748 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:25:16.763 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:25:16.765 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:25:16.780 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 3.1 MB/s) 2024-09-14T11:25:16.784 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:25:16.798 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:16.802 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:25:16.819 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T11:25:16.819 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:25:16.836 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 130/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 13 MB/s) 2024-09-14T11:25:16.873 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:16.873 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:25:16.876 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:25:16.890 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:25:16.891 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:25:16.905 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:25:16.908 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:25:16.923 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-14T11:25:16.925 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:25:16.939 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:25:16.943 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:25:16.958 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:25:16.960 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:25:16.974 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:25:16.977 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:25:16.991 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 47 kB/s) 2024-09-14T11:25:16.992 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:25:17.005 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 211 kB/s) 2024-09-14T11:25:17.007 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:25:17.020 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.1 MB/s) 2024-09-14T11:25:17.023 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:25:17.037 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:17.039 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:25:17.052 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-14T11:25:17.054 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:25:17.067 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 643 kB/s) 2024-09-14T11:25:17.070 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:25:17.083 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:25:17.087 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:25:17.100 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:25:17.106 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:25:17.121 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-09-14T11:25:17.124 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:25:17.138 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:25:17.143 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:25:17.157 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-14T11:25:17.162 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:25:17.177 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-14T11:25:17.178 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:25:17.178 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:25:17.178 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:25:17.178 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:25:17.178 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:25:17.193 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/41 kB Progress (2): 16/41 kB | 15/55 kB Progress (3): 16/41 kB | 15/55 kB | 16/269 kB Progress (4): 16/41 kB | 15/55 kB | 16/269 kB | 8.5 kB Progress (4): 16/41 kB | 31/55 kB | 16/269 kB | 8.5 kB Progress (4): 33/41 kB | 31/55 kB | 16/269 kB | 8.5 kB Progress (4): 33/41 kB | 48/55 kB | 16/269 kB | 8.5 kB Progress (4): 33/41 kB | 48/55 kB | 33/269 kB | 8.5 kB Progress (4): 41 kB | 48/55 kB | 33/269 kB | 8.5 kB Progress (4): 41 kB | 55 kB | 33/269 kB | 8.5 kB Progress (4): 41 kB | 55 kB | 49/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-14T11:25:17.193 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:25:17.193 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-14T11:25:17.193 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:25:17.193 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-14T11:25:17.194 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 63/269 kB Progress (1): 80/269 kB Progress (2): 80/269 kB | 2.5 kB Progress (2): 96/269 kB | 2.5 kB Progress (2): 112/269 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-14T11:25:17.197 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-14T11:25:17.211 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (1): 81/327 kB Progress (1): 98/327 kB Progress (1): 114/327 kB Progress (1): 130/327 kB Progress (1): 147/327 kB Progress (2): 147/327 kB | 14/587 kB Progress (2): 147/327 kB | 15/587 kB Progress (2): 163/327 kB | 15/587 kB Progress (2): 163/327 kB | 31/587 kB Progress (2): 179/327 kB | 31/587 kB Progress (2): 179/327 kB | 48/587 kB Progress (2): 196/327 kB | 48/587 kB Progress (2): 196/327 kB | 64/587 kB Progress (2): 212/327 kB | 64/587 kB Progress (2): 212/327 kB | 77/587 kB Progress (2): 229/327 kB | 77/587 kB Progress (2): 229/327 kB | 93/587 kB Progress (2): 245/327 kB | 93/587 kB Progress (2): 245/327 kB | 109/587 kB Progress (2): 261/327 kB | 109/587 kB Progress (2): 278/327 kB | 109/587 kB Progress (2): 294/327 kB | 109/587 kB Progress (2): 294/327 kB | 126/587 kB Progress (2): 311/327 kB | 126/587 kB Progress (2): 311/327 kB | 142/587 kB Progress (2): 327/327 kB | 142/587 kB Progress (2): 327 kB | 142/587 kB Progress (2): 327 kB | 158/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.9 MB/s) 2024-09-14T11:25:17.225 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 175/587 kB Progress (1): 191/587 kB Progress (1): 208/587 kB Progress (1): 224/587 kB Progress (1): 240/587 kB Progress (1): 257/587 kB Progress (1): 273/587 kB Progress (1): 281/587 kB Progress (1): 298/587 kB Progress (1): 314/587 kB Progress (1): 330/587 kB Progress (1): 347/587 kB Progress (1): 363/587 kB Progress (1): 376/587 kB Progress (1): 392/587 kB Progress (1): 408/587 kB Progress (1): 425/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 507/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 556/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 12 MB/s) 2024-09-14T11:25:17.263 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:25:17.264 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:17.264 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:25:17.269 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:25:17.285 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 0.6/4.7 kB Progress (1): 4.7/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-09-14T11:25:17.288 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:25:17.301 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:25:17.303 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:25:17.317 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:25:17.319 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:25:17.332 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 1.1 MB/s) 2024-09-14T11:25:17.335 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:25:17.348 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 63 kB/s) 2024-09-14T11:25:17.350 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:25:17.364 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T11:25:17.366 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:25:17.380 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:17.384 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:25:17.397 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-14T11:25:17.399 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:25:17.413 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-14T11:25:17.415 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:25:17.429 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:25:17.431 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:25:17.445 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-14T11:25:17.448 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:25:17.461 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:17.464 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:25:17.477 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:25:17.480 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:25:17.495 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-14T11:25:17.497 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:25:17.510 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-14T11:25:17.512 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:25:17.526 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 206 kB/s) 2024-09-14T11:25:17.528 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:25:17.542 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 433 kB/s) 2024-09-14T11:25:17.544 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:25:17.558 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-14T11:25:17.561 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:25:17.575 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-14T11:25:17.576 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:25:17.590 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:25:17.592 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:25:17.606 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T11:25:17.609 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:25:17.622 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 93 kB/s) 2024-09-14T11:25:17.624 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:25:17.638 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 102 kB/s) 2024-09-14T11:25:17.643 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:25:17.657 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-14T11:25:17.658 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:25:17.658 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:25:17.658 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:25:17.658 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:25:17.658 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:25:17.674 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:25:17.674 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:25:17.674 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/334 kB Progress (2): 16/334 kB | 16/27 kB Progress (3): 16/334 kB | 16/27 kB | 16/55 kB Progress (3): 16/334 kB | 27 kB | 16/55 kB Progress (3): 33/334 kB | 27 kB | 16/55 kB Progress (3): 33/334 kB | 27 kB | 33/55 kB Progress (4): 33/334 kB | 27 kB | 33/55 kB | 16/122 kB Progress (4): 33/334 kB | 27 kB | 49/55 kB | 16/122 kB Progress (4): 49/334 kB | 27 kB | 49/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:25:17.674 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 49/334 kB | 49/55 kB | 33/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:25:17.675 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 49/334 kB | 55 kB | 33/122 kB Progress (3): 62/334 kB | 55 kB | 33/122 kB Progress (3): 62/334 kB | 55 kB | 49/122 kB Progress (3): 78/334 kB | 55 kB | 49/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-14T11:25:17.675 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:25:17.675 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 78/334 kB | 66/122 kB Progress (2): 94/334 kB | 66/122 kB Progress (2): 94/334 kB | 82/122 kB Progress (2): 111/334 kB | 82/122 kB Progress (2): 111/334 kB | 98/122 kB Progress (2): 127/334 kB | 98/122 kB Progress (2): 127/334 kB | 115/122 kB Progress (2): 143/334 kB | 115/122 kB Progress (2): 143/334 kB | 122 kB Progress (2): 160/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-14T11:25:17.677 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 176/334 kB Progress (1): 193/334 kB Progress (1): 209/334 kB Progress (1): 225/334 kB Progress (1): 242/334 kB Progress (1): 258/334 kB Progress (1): 275/334 kB Progress (1): 291/334 kB Progress (1): 307/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-14T11:25:17.686 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (2): 33/267 kB | 4.7 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 63/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-14T11:25:17.687 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 80/267 kB Progress (1): 96/267 kB Progress (2): 96/267 kB | 16/23 kB Progress (2): 96/267 kB | 23 kB Progress (2): 112/267 kB | 23 kB Progress (2): 129/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-14T11:25:17.689 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.9 MB/s) 2024-09-14T11:25:17.738 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:25:17.739 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:25:18.371 INFO:tasks.workunit.client.0.smithi028.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:25:18.371 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:18.371 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:25:18.373 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:25:18.373 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:18.374 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:25:18.378 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:25:18.378 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:25:18.578 INFO:tasks.workunit.client.0.smithi028.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:25:18.578 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:18.578 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:25:18.583 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:25:18.597 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-14T11:25:18.601 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:25:18.615 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:25:18.619 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:25:18.635 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-14T11:25:18.638 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:25:18.652 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:25:18.656 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:25:18.671 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-14T11:25:18.674 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:25:18.689 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:25:18.693 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:25:18.707 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:25:18.711 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:25:18.725 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T11:25:18.726 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:25:18.741 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:25:18.745 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:25:18.759 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:25:18.761 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:25:18.775 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:25:18.779 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:25:18.793 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:25:18.796 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:25:18.810 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T11:25:18.812 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:25:18.827 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/37 kB Progress (1): 31/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-14T11:25:18.829 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:25:18.843 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:18.847 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:25:18.861 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:25:18.863 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:25:18.877 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-14T11:25:18.880 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:25:18.895 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:25:18.898 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:25:18.912 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:25:18.915 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:25:18.929 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-14T11:25:18.932 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:25:18.946 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-14T11:25:18.948 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:25:18.961 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:25:18.963 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:25:18.976 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:25:18.978 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:25:18.992 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-14T11:25:18.993 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:25:19.006 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:19.009 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:25:19.023 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:25:19.024 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:25:19.038 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-14T11:25:19.039 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:25:19.052 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:25:19.054 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:25:19.068 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:25:19.070 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:25:19.084 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 171 kB/s) 2024-09-14T11:25:19.086 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:25:19.100 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-14T11:25:19.103 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:25:19.117 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:19.119 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:25:19.132 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:25:19.135 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:25:19.148 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:25:19.150 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:25:19.163 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 368 kB/s) 2024-09-14T11:25:19.165 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:25:19.179 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:25:19.181 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:25:19.195 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-14T11:25:19.198 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:25:19.211 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:19.213 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:25:19.227 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:19.230 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:25:19.243 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:25:19.245 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:25:19.258 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-14T11:25:19.261 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:25:19.274 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:25:19.277 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:25:19.291 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:25:19.293 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:25:19.307 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:25:19.310 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:25:19.324 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:25:19.326 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:25:19.340 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:25:19.344 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:25:19.357 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:25:19.358 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:25:19.372 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:25:19.374 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:25:19.389 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-14T11:25:19.391 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:25:19.404 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 28 kB/s) 2024-09-14T11:25:19.406 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:25:19.419 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-14T11:25:19.421 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:25:19.434 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-14T11:25:19.436 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:25:19.449 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-14T11:25:19.452 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:25:19.466 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-14T11:25:19.468 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:25:19.482 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:25:19.484 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:25:19.499 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.6 MB/s) 2024-09-14T11:25:19.502 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:25:19.516 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-14T11:25:19.519 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:25:19.533 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-14T11:25:19.535 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:25:19.549 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-14T11:25:19.550 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:25:19.564 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-14T11:25:19.565 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:25:19.579 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:25:19.581 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:25:19.595 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-14T11:25:19.600 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:25:19.618 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T11:25:19.619 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:25:19.619 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:25:19.619 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:25:19.619 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:25:19.619 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 16/26 kB Progress (3): 16/171 kB | 16/26 kB | 16/118 kB Progress (3): 33/171 kB | 16/26 kB | 16/118 kB Progress (3): 33/171 kB | 26 kB | 16/118 kB Progress (3): 49/171 kB | 26 kB | 16/118 kB Progress (3): 49/171 kB | 26 kB | 33/118 kB Progress (3): 64/171 kB | 26 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.7 MB/s) 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 64/171 kB | 49/118 kB Progress (2): 81/171 kB | 49/118 kB Progress (3): 81/171 kB | 49/118 kB | 8.2 kB Progress (3): 97/171 kB | 49/118 kB | 8.2 kB Progress (3): 97/171 kB | 64/118 kB | 8.2 kB Progress (3): 113/171 kB | 64/118 kB | 8.2 kB Progress (4): 113/171 kB | 64/118 kB | 8.2 kB | 14 kB Progress (4): 113/171 kB | 80/118 kB | 8.2 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 545 kB/s) 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 130/171 kB | 80/118 kB | 14 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 146/171 kB | 80/118 kB | 14 kB Progress (3): 146/171 kB | 97/118 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 849 kB/s) 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 163/171 kB | 97/118 kB Progress (2): 171 kB | 97/118 kB Progress (2): 171 kB | 113/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 10 MB/s) 2024-09-14T11:25:19.636 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:25:19.637 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-14T11:25:19.637 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:25:19.653 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/136 kB Progress (2): 16/146 kB | 33/136 kB Progress (2): 33/146 kB | 33/136 kB Progress (2): 33/146 kB | 49/136 kB Progress (2): 49/146 kB | 49/136 kB Progress (3): 49/146 kB | 49/136 kB | 16/61 kB Progress (3): 49/146 kB | 66/136 kB | 16/61 kB Progress (3): 66/146 kB | 66/136 kB | 16/61 kB Progress (3): 66/146 kB | 66/136 kB | 33/61 kB Progress (3): 66/146 kB | 82/136 kB | 33/61 kB Progress (4): 66/146 kB | 82/136 kB | 33/61 kB | 16/58 kB Progress (4): 82/146 kB | 82/136 kB | 33/61 kB | 16/58 kB Progress (4): 82/146 kB | 82/136 kB | 49/61 kB | 16/58 kB Progress (4): 82/146 kB | 98/136 kB | 49/61 kB | 16/58 kB Progress (4): 98/146 kB | 98/136 kB | 49/61 kB | 16/58 kB Progress (4): 98/146 kB | 114/136 kB | 49/61 kB | 16/58 kB Progress (4): 98/146 kB | 114/136 kB | 49/61 kB | 33/58 kB Progress (4): 115/146 kB | 114/136 kB | 49/61 kB | 33/58 kB Progress (4): 131/146 kB | 114/136 kB | 49/61 kB | 33/58 kB Progress (4): 131/146 kB | 130/136 kB | 49/61 kB | 33/58 kB Progress (5): 131/146 kB | 130/136 kB | 49/61 kB | 33/58 kB | 16/501 kB Progress (5): 131/146 kB | 130/136 kB | 61 kB | 33/58 kB | 16/501 kB Progress (5): 131/146 kB | 136 kB | 61 kB | 33/58 kB | 16/501 kB Progress (5): 146 kB | 136 kB | 61 kB | 33/58 kB | 16/501 kB Progress (5): 146 kB | 136 kB | 61 kB | 33/58 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-14T11:25:19.653 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (4): 136 kB | 61 kB | 49/58 kB | 33/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:25:19.653 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (4): 136 kB | 61 kB | 49/58 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-14T11:25:19.653 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 136 kB | 58 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.3 MB/s) 2024-09-14T11:25:19.653 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:25:19.653 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 58 kB | 63/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-14T11:25:19.659 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 80/501 kB Progress (1): 96/501 kB Progress (1): 112/501 kB Progress (1): 129/501 kB Progress (1): 145/501 kB Progress (1): 162/501 kB Progress (1): 178/501 kB Progress (1): 194/501 kB Progress (1): 211/501 kB Progress (1): 227/501 kB Progress (1): 243/501 kB Progress (1): 260/501 kB Progress (1): 276/501 kB Progress (1): 293/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (1): 342/501 kB Progress (1): 358/501 kB Progress (1): 375/501 kB Progress (1): 391/501 kB Progress (1): 407/501 kB Progress (1): 424/501 kB Progress (1): 440/501 kB Progress (1): 452/501 kB Progress (1): 456/501 kB Progress (1): 473/501 kB Progress (1): 489/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-14T11:25:19.667 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15/124 kB Progress (2): 15/124 kB | 0/2.4 MB Progress (2): 31/124 kB | 0/2.4 MB Progress (2): 48/124 kB | 0/2.4 MB Progress (2): 48/124 kB | 0/2.4 MB Progress (2): 64/124 kB | 0/2.4 MB Progress (2): 78/124 kB | 0/2.4 MB Progress (2): 78/124 kB | 0/2.4 MB Progress (2): 94/124 kB | 0/2.4 MB Progress (2): 94/124 kB | 0.1/2.4 MB Progress (2): 110/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-14T11:25:19.718 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 25 MB/s) 2024-09-14T11:25:19.804 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:19.804 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:25:19.806 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:25:19.821 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T11:25:19.822 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:25:19.836 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:25:19.838 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:25:19.852 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-14T11:25:19.854 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:25:19.868 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-14T11:25:19.871 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:25:19.885 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 399 kB/s) 2024-09-14T11:25:19.887 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:25:19.901 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 302 kB/s) 2024-09-14T11:25:19.903 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:25:19.917 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 463 kB/s) 2024-09-14T11:25:19.919 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:25:19.933 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:25:19.935 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:25:19.949 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.5 MB/s) 2024-09-14T11:25:19.952 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:25:19.966 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:25:19.968 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:25:19.982 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:25:19.984 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:25:19.998 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-14T11:25:19.999 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:25:20.013 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-14T11:25:20.018 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:25:20.033 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:25:20.033 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:25:20.033 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:25:20.033 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:25:20.033 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:25:20.034 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:25:20.047 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Progress (2): 26 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.9 MB/s) 2024-09-14T11:25:20.047 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:25:20.051 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 16/58 kB | 16/79 kB Progress (2): 33/58 kB | 16/79 kB Progress (2): 49/58 kB | 16/79 kB Progress (2): 49/58 kB | 33/79 kB Progress (2): 58 kB | 33/79 kB Progress (3): 58 kB | 33/79 kB | 16/211 kB Progress (3): 58 kB | 33/79 kB | 32/211 kB Progress (3): 58 kB | 49/79 kB | 32/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-14T11:25:20.051 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 49/79 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:25:20.051 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 66/79 kB | 49/211 kB Progress (2): 66/79 kB | 65/211 kB Progress (2): 66/79 kB | 81/211 kB Progress (2): 79 kB | 81/211 kB Progress (3): 79 kB | 81/211 kB | 0/1.0 MB Progress (3): 79 kB | 98/211 kB | 0/1.0 MB Progress (3): 79 kB | 98/211 kB | 0/1.0 MB Progress (3): 79 kB | 114/211 kB | 0/1.0 MB Progress (3): 79 kB | 114/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-14T11:25:20.051 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (2): 131/211 kB | 0/1.0 MB Progress (2): 131/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 147/211 kB | 0.1/1.0 MB Progress (2): 163/211 kB | 0.1/1.0 MB Progress (2): 163/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 180/211 kB | 0.1/1.0 MB Progress (2): 196/211 kB | 0.1/1.0 MB Progress (2): 196/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 12 MB/s) 2024-09-14T11:25:20.062 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.9/1.0 MB | 33/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 66/116 kB Progress (2): 0.9/1.0 MB | 66/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 98/116 kB Progress (2): 0.9/1.0 MB | 98/116 kB Progress (2): 0.9/1.0 MB | 115/116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (2): 0.9/1.0 MB | 116 kB Progress (2): 1.0/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 4.1 MB/s) 2024-09-14T11:25:20.064 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 33/267 kB Progress (2): 1.0/1.0 MB | 33/267 kB Progress (2): 1.0 MB | 33/267 kB Progress (2): 1.0 MB | 49/267 kB Progress (2): 1.0 MB | 66/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 34 MB/s) 2024-09-14T11:25:20.066 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.1 MB/s) 2024-09-14T11:25:20.233 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:25:20.283 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:20.283 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:25:20.283 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:20.284 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Total time: 5.802 s 2024-09-14T11:25:20.284 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Finished at: 2024-09-14T11:25:20Z 2024-09-14T11:25:20.284 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:20.306 INFO:tasks.workunit.client.0.smithi028.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:25:20.315 INFO:tasks.workunit.client.0.smithi028.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:25:21.397 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Scanning for projects... 2024-09-14T11:25:21.476 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:21.476 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:25:21.476 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:25:21.476 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] from pom.xml 2024-09-14T11:25:21.476 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:25:21.728 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:21.728 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:25:21.831 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:25:21.832 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:21.832 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:25:21.925 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:25:21.925 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:21.925 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:25:21.927 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:25:21.927 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:21.928 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:25:21.933 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:25:21.933 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:21.933 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:25:22.184 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:25:22.372 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:25:22.561 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:25:22.569 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:25:22.588 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-14T11:25:22.593 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:25:22.609 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 176 kB/s) 2024-09-14T11:25:22.615 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:25:22.631 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:25:22.634 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:25:22.649 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:25:22.652 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:25:22.667 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:25:22.669 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:25:22.684 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 189 kB/s) 2024-09-14T11:25:22.689 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:25:22.709 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.4 MB/s) 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:25:22.711 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:25:22.712 INFO:tasks.workunit.client.0.smithi028.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:25:22.730 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 836 kB/s) 2024-09-14T11:25:22.763 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (2): 2.8/7.7 kB | 1.4/169 kB Progress (2): 4.1/7.7 kB | 1.4/169 kB Progress (3): 4.1/7.7 kB | 1.4/169 kB | 1.4/189 kB Progress (4): 4.1/7.7 kB | 1.4/169 kB | 1.4/189 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 1.4/169 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 1.4/169 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 2.8/169 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 6.9/7.7 kB | 2.8/169 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 6.9/7.7 kB | 2.8/169 kB | 4.1/189 kB | 1.4/103 kB Progress (4): 6.9/7.7 kB | 2.8/169 kB | 4.1/189 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 2.8/169 kB | 5.5/189 kB | 2.8/103 kB Progress (4): 7.7 kB | 2.8/169 kB | 5.5/189 kB | 2.8/103 kB Progress (4): 7.7 kB | 4.1/169 kB | 5.5/189 kB | 2.8/103 kB Progress (4): 7.7 kB | 4.1/169 kB | 6.9/189 kB | 2.8/103 kB Progress (4): 7.7 kB | 5.5/169 kB | 6.9/189 kB | 2.8/103 kB Progress (4): 7.7 kB | 5.5/169 kB | 6.9/189 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 6.9/189 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 8.3/189 kB | 4.1/103 kB Progress (4): 7.7 kB | 8.3/169 kB | 8.3/189 kB | 4.1/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 150 kB/s) 2024-09-14T11:25:22.795 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (3): 8.3/169 kB | 9.7/189 kB | 4.1/103 kB Progress (3): 8.3/169 kB | 9.7/189 kB | 5.5/103 kB Progress (3): 8.3/169 kB | 11/189 kB | 5.5/103 kB Progress (3): 9.7/169 kB | 11/189 kB | 5.5/103 kB Progress (3): 9.7/169 kB | 12/189 kB | 5.5/103 kB Progress (3): 9.7/169 kB | 12/189 kB | 6.9/103 kB Progress (3): 9.7/169 kB | 14/189 kB | 6.9/103 kB Progress (3): 11/169 kB | 14/189 kB | 6.9/103 kB Progress (3): 11/169 kB | 15/189 kB | 6.9/103 kB Progress (3): 11/169 kB | 15/189 kB | 8.3/103 kB Progress (3): 11/169 kB | 16/189 kB | 8.3/103 kB Progress (3): 12/169 kB | 16/189 kB | 8.3/103 kB Progress (3): 12/169 kB | 18/189 kB | 8.3/103 kB Progress (3): 12/169 kB | 18/189 kB | 9.7/103 kB Progress (3): 12/169 kB | 19/189 kB | 9.7/103 kB Progress (3): 14/169 kB | 19/189 kB | 9.7/103 kB Progress (3): 14/169 kB | 21/189 kB | 9.7/103 kB Progress (3): 14/169 kB | 21/189 kB | 11/103 kB Progress (3): 14/169 kB | 22/189 kB | 11/103 kB Progress (3): 15/169 kB | 22/189 kB | 11/103 kB Progress (3): 15/169 kB | 23/189 kB | 11/103 kB Progress (3): 15/169 kB | 23/189 kB | 12/103 kB Progress (3): 15/169 kB | 25/189 kB | 12/103 kB Progress (3): 16/169 kB | 25/189 kB | 12/103 kB Progress (3): 16/169 kB | 26/189 kB | 12/103 kB Progress (3): 16/169 kB | 26/189 kB | 14/103 kB Progress (3): 16/169 kB | 27/189 kB | 14/103 kB Progress (3): 16/169 kB | 27/189 kB | 15/103 kB Progress (3): 16/169 kB | 29/189 kB | 15/103 kB Progress (3): 16/169 kB | 29/189 kB | 16/103 kB Progress (3): 16/169 kB | 30/189 kB | 16/103 kB Progress (3): 16/169 kB | 30/189 kB | 18/103 kB Progress (3): 16/169 kB | 32/189 kB | 18/103 kB Progress (3): 16/169 kB | 32/189 kB | 19/103 kB Progress (3): 33/169 kB | 32/189 kB | 19/103 kB Progress (3): 33/169 kB | 32/189 kB | 21/103 kB Progress (3): 33/169 kB | 33/189 kB | 21/103 kB Progress (3): 33/169 kB | 33/189 kB | 22/103 kB Progress (3): 33/169 kB | 34/189 kB | 22/103 kB Progress (3): 33/169 kB | 34/189 kB | 23/103 kB Progress (3): 33/169 kB | 36/189 kB | 23/103 kB Progress (3): 33/169 kB | 36/189 kB | 25/103 kB Progress (3): 33/169 kB | 37/189 kB | 25/103 kB Progress (3): 33/169 kB | 37/189 kB | 26/103 kB Progress (3): 49/169 kB | 37/189 kB | 26/103 kB Progress (3): 49/169 kB | 37/189 kB | 27/103 kB Progress (3): 49/169 kB | 38/189 kB | 27/103 kB Progress (3): 49/169 kB | 38/189 kB | 29/103 kB Progress (3): 49/169 kB | 40/189 kB | 29/103 kB Progress (3): 49/169 kB | 40/189 kB | 30/103 kB Progress (3): 49/169 kB | 41/189 kB | 30/103 kB Progress (3): 49/169 kB | 41/189 kB | 32/103 kB Progress (3): 49/169 kB | 43/189 kB | 32/103 kB Progress (3): 49/169 kB | 43/189 kB | 33/103 kB Progress (3): 49/169 kB | 44/189 kB | 33/103 kB Progress (3): 49/169 kB | 44/189 kB | 34/103 kB Progress (3): 49/169 kB | 45/189 kB | 34/103 kB Progress (3): 49/169 kB | 45/189 kB | 36/103 kB Progress (3): 49/169 kB | 47/189 kB | 36/103 kB Progress (3): 49/169 kB | 47/189 kB | 37/103 kB Progress (3): 49/169 kB | 48/189 kB | 37/103 kB Progress (3): 49/169 kB | 48/189 kB | 38/103 kB Progress (3): 49/169 kB | 49/189 kB | 38/103 kB Progress (3): 49/169 kB | 49/189 kB | 40/103 kB Progress (3): 49/169 kB | 51/189 kB | 40/103 kB Progress (3): 49/169 kB | 51/189 kB | 41/103 kB Progress (3): 49/169 kB | 52/189 kB | 41/103 kB Progress (3): 66/169 kB | 52/189 kB | 41/103 kB Progress (3): 66/169 kB | 54/189 kB | 41/103 kB Progress (3): 66/169 kB | 54/189 kB | 43/103 kB Progress (3): 66/169 kB | 55/189 kB | 43/103 kB Progress (3): 66/169 kB | 55/189 kB | 44/103 kB Progress (3): 66/169 kB | 56/189 kB | 44/103 kB Progress (3): 66/169 kB | 56/189 kB | 45/103 kB Progress (3): 66/169 kB | 58/189 kB | 45/103 kB Progress (3): 82/169 kB | 58/189 kB | 45/103 kB Progress (3): 82/169 kB | 58/189 kB | 47/103 kB Progress (3): 82/169 kB | 59/189 kB | 47/103 kB Progress (3): 82/169 kB | 59/189 kB | 48/103 kB Progress (3): 82/169 kB | 61/189 kB | 48/103 kB Progress (3): 82/169 kB | 61/189 kB | 49/103 kB Progress (3): 82/169 kB | 62/189 kB | 49/103 kB Progress (3): 82/169 kB | 62/189 kB | 51/103 kB Progress (3): 82/169 kB | 63/189 kB | 51/103 kB Progress (3): 82/169 kB | 63/189 kB | 52/103 kB Progress (3): 82/169 kB | 63/189 kB | 54/103 kB Progress (3): 82/169 kB | 79/189 kB | 54/103 kB Progress (3): 82/169 kB | 79/189 kB | 55/103 kB Progress (3): 82/169 kB | 79/189 kB | 56/103 kB Progress (3): 82/169 kB | 96/189 kB | 56/103 kB Progress (3): 82/169 kB | 96/189 kB | 58/103 kB Progress (3): 82/169 kB | 96/189 kB | 59/103 kB Progress (3): 82/169 kB | 112/189 kB | 59/103 kB Progress (3): 82/169 kB | 112/189 kB | 61/103 kB Progress (3): 82/169 kB | 112/189 kB | 62/103 kB Progress (3): 82/169 kB | 128/189 kB | 62/103 kB Progress (3): 82/169 kB | 128/189 kB | 62/103 kB Progress (3): 82/169 kB | 145/189 kB | 62/103 kB Progress (3): 82/169 kB | 145/189 kB | 79/103 kB Progress (3): 98/169 kB | 145/189 kB | 79/103 kB Progress (3): 98/169 kB | 145/189 kB | 95/103 kB Progress (3): 98/169 kB | 161/189 kB | 95/103 kB Progress (3): 98/169 kB | 178/189 kB | 95/103 kB Progress (3): 98/169 kB | 178/189 kB | 103 kB Progress (3): 115/169 kB | 178/189 kB | 103 kB Progress (3): 115/169 kB | 189 kB | 103 kB Progress (3): 131/169 kB | 189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:25:22.795 INFO:tasks.workunit.client.0.smithi028.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.3 MB/s) 2024-09-14T11:25:22.803 INFO:tasks.workunit.client.0.smithi028.stdout:Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.8 MB/s) 2024-09-14T11:25:22.817 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:25:22.817 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:25:22.817 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] T E S T S 2024-09-14T11:25:22.817 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:25:23.280 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:25:23.396 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjects.java: starting test run: 2024-09-14T11:25:23.396 INFO:tasks.workunit.client.0.smithi028.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:23.396 INFO:tasks.workunit.client.0.smithi028.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:23.396 INFO:tasks.workunit.client.0.smithi028.stdout: EndpointUrl=http://smithi028.front.sepia.ceph.com:80 2024-09-14T11:25:23.396 INFO:tasks.workunit.client.0.smithi028.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:25:23.494 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Environment Variables Read 2024-09-14T11:25:23.796 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:25:23.796 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generating File 2024-09-14T11:25:23.796 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: File Generated 2024-09-14T11:25:23.796 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generating File 2024-09-14T11:25:23.796 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: File Generated 2024-09-14T11:25:23.796 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generating File 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: File Generated 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generating File 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: File Generated 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generating File 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: File Generated 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generating File 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: File Generated 2024-09-14T11:25:23.797 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Generated Big Files 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi028.stdout:HeadBucketResponse() 2024-09-14T11:25:24.074 INFO:tasks.workunit.client.0.smithi028.stdout:sheik is ready 2024-09-14T11:25:24.075 INFO:tasks.workunit.client.0.smithi028.stdout:DEBUG: Test Bucket Created 2024-09-14T11:25:24.196 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:25:24.296 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:25:24.496 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:25:24.697 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:25:24.797 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:25:24.897 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:25:25.097 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:25:25.398 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:25:25.598 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:25:25.999 INFO:tasks.workunit.client.0.smithi028.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:25:29.605 INFO:tasks.workunit.client.0.smithi028.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:25:32.409 INFO:tasks.workunit.client.0.smithi028.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:25:58.099 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-0b 2024-09-14T11:25:58.100 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-8b 2024-09-14T11:25:58.101 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-200b 2024-09-14T11:25:58.102 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-21983b 2024-09-14T11:25:58.103 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-5519b 2024-09-14T11:25:58.104 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-204329b 2024-09-14T11:25:58.105 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-256k 2024-09-14T11:25:58.106 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-1m 2024-09-14T11:25:58.107 INFO:tasks.workunit.client.0.smithi028.stdout:arg: file-1038757b 2024-09-14T11:25:58.140 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:25:58.240 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:58.341 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:25:58.341 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:58.441 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:25:58.541 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:58.641 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:25:58.641 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:58.741 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:25:58.841 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:58.946 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:25:58.987 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:59.041 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:25:59.129 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:59.141 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:25:59.442 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:59.542 INFO:tasks.workunit.client.0.smithi028.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:25:59.843 INFO:tasks.workunit.client.0.smithi028.stdout:PutObjectResponse 2024-09-14T11:25:59.943 INFO:tasks.workunit.client.0.smithi028.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:26:01.545 INFO:tasks.workunit.client.0.smithi028.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:26:04.047 INFO:tasks.workunit.client.0.smithi028.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:26:49.450 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.16 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:26:49.461 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:26:49.461 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Results: 2024-09-14T11:26:49.461 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:26:49.461 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:26:49.461 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] 2024-09-14T11:26:49.463 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:49.463 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:26:49.463 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:49.464 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Total time: 01:28 min 2024-09-14T11:26:49.464 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] Finished at: 2024-09-14T11:26:49Z 2024-09-14T11:26:49.464 INFO:tasks.workunit.client.0.smithi028.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:49.476 INFO:tasks.workunit.client.0.smithi028.stderr:+ exit 2024-09-14T11:26:49.477 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:26:49.477 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:26:49.555 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:26:49.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:26:49.941 DEBUG:teuthology.parallel:result is None 2024-09-14T11:26:49.941 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:49.981 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:49.981 DEBUG:teuthology.orchestra.run.smithi028:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:50.050 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:50.050 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:26:50.059 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:26:50.059 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:26:50.060 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:50.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:26:50.119 INFO:teuthology.orchestra.run.smithi028.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:26:50.120 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:50.189 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:50.189 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:26:50.258 INFO:tasks.workunit:timeout=3h 2024-09-14T11:26:50.258 INFO:tasks.workunit:cleanup=True 2024-09-14T11:26:50.259 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:26:50.329 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:27:46.846 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 94% (12120/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:27:47.470 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.471 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-09-14T11:27:47.472 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.472 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-09-14T11:27:47.472 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.472 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:27:47.472 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:27:47.472 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:27:47.473 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:27:47.543 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:27:47.546 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:27:47.546 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:27:47.596 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:27:47.647 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:27:47.687 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:27:47.689 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:27:47.689 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:27:47.728 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:27:47.732 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:27:47.732 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:27:47.802 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:27:47.804 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:27:47.804 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:27:47.879 INFO:tasks.workunit.client.0.smithi028.stdout:INFO: fully qualified domain name: smithi028.front.sepia.ceph.com 2024-09-14T11:27:47.879 INFO:tasks.workunit.client.0.smithi028.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:27:47.879 INFO:tasks.workunit.client.0.smithi028.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:27:50.514 INFO:tasks.workunit.client.0.smithi028.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:27:50.699 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting pip 2024-09-14T11:27:50.704 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:27:50.751 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: pip 2024-09-14T11:27:50.751 INFO:tasks.workunit.client.0.smithi028.stdout: Attempting uninstall: pip 2024-09-14T11:27:50.751 INFO:tasks.workunit.client.0.smithi028.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:27:50.915 INFO:tasks.workunit.client.0.smithi028.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:27:50.921 INFO:tasks.workunit.client.0.smithi028.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:27:51.686 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed pip-24.2 2024-09-14T11:27:52.537 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting boto3 2024-09-14T11:27:52.538 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:27:53.142 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:27:53.143 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:27:53.196 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:27:53.198 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:27:53.252 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:27:53.252 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:27:53.301 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:53.302 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:27:53.380 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:53.381 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:27:53.631 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:53.632 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:27:53.637 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:27:53.638 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:27:53.647 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:27:53.649 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:27:53.650 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:27:53.651 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:27:53.653 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:27:53.728 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:27:54.802 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:27:55.243 INFO:tasks.workunit.client.0.smithi028.stdout:INFO: creating user 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout:{ 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "user_id": "testid", 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "display_name": "M. Tester", 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "email": "tester@ceph.com", 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "suspended": 0, 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "subusers": [], 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "keys": [ 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: { 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "user": "testid", 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:27:55.362 INFO:tasks.workunit.client.0.smithi028.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "active": true, 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "create_date": "2024-09-14T11:27:55.355104Z" 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: } 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: ], 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "swift_keys": [], 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "caps": [], 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "default_placement": "", 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "placement_tags": [], 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "bucket_quota": { 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "enabled": false, 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:27:55.363 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size": -1, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "max_objects": -1 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "user_quota": { 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "enabled": false, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size": -1, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "max_objects": -1 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: }, 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "type": "rgw", 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:27:55.364 INFO:tasks.workunit.client.0.smithi028.stdout: "account_id": "", 2024-09-14T11:27:55.365 INFO:tasks.workunit.client.0.smithi028.stdout: "path": "/", 2024-09-14T11:27:55.365 INFO:tasks.workunit.client.0.smithi028.stdout: "create_date": "2024-09-14T11:27:55.355092Z", 2024-09-14T11:27:55.365 INFO:tasks.workunit.client.0.smithi028.stdout: "tags": [], 2024-09-14T11:27:55.365 INFO:tasks.workunit.client.0.smithi028.stdout: "group_ids": [] 2024-09-14T11:27:55.365 INFO:tasks.workunit.client.0.smithi028.stdout:} 2024-09-14T11:27:55.365 INFO:tasks.workunit.client.0.smithi028.stdout: 2024-09-14T11:27:55.683 INFO:tasks.workunit.client.0.smithi028.stderr:5+0 records in 2024-09-14T11:27:55.683 INFO:tasks.workunit.client.0.smithi028.stderr:5+0 records out 2024-09-14T11:27:55.683 INFO:tasks.workunit.client.0.smithi028.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142875 s, 367 MB/s 2024-09-14T11:28:05.662 INFO:tasks.workunit.client.0.smithi028.stdout:bucket nams is reupload-bkt-112296 2024-09-14T11:28:05.662 INFO:tasks.workunit.client.0.smithi028.stdout:endpoint is http://smithi028.front.sepia.ceph.com:80 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:start UploadId=2~QZTj1M9ILShjeHZXO0YloM1ucZ-fM1W 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 1 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 1 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 2} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.663 INFO:tasks.workunit.client.0.smithi028.stdout:phase 2 uploaded part {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1} 2024-09-14T11:28:05.664 INFO:tasks.workunit.client.0.smithi028.stdout:completing multipart upload, parts=[{'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 1}, {'ETag': '"f7317b2d27d5a613e222853aed12ddea"', 'PartNumber': 2}] 2024-09-14T11:28:06.918 INFO:tasks.workunit.client.0.smithi028.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:28:06.919 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3_mpu_test4 2024-09-14T11:28:06.919 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3__multipart_mpu_test4.2~QZTj1M9ILShjeHZXO0YloM1ucZ-fM1W.2 2024-09-14T11:28:06.919 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3__multipart_mpu_test4.FcrS19lx_-OOU8RiiioDOzKXekiFsbC0.1 2024-09-14T11:28:06.919 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3__:upaRfA3Rzwq8J9uW-YKR9a-4QInB1vG_mpu_test4 2024-09-14T11:28:06.979 INFO:tasks.workunit.client.0.smithi028.stdout:rados ls: 2024-09-14T11:28:06.980 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3_mpu_test4 2024-09-14T11:28:06.980 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3__multipart_mpu_test4.2~QZTj1M9ILShjeHZXO0YloM1ucZ-fM1W.2 2024-09-14T11:28:06.980 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3__multipart_mpu_test4.FcrS19lx_-OOU8RiiioDOzKXekiFsbC0.1 2024-09-14T11:28:06.980 INFO:tasks.workunit.client.0.smithi028.stdout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3__:upaRfA3Rzwq8J9uW-YKR9a-4QInB1vG_mpu_test4 2024-09-14T11:28:06.990 INFO:tasks.workunit.client.0.smithi028.stdout:== PASSED == 2024-09-14T11:28:06.990 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:28:06.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:28:07.071 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:28:07.071 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:28:07.468 DEBUG:teuthology.parallel:result is None 2024-09-14T11:28:07.468 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:28:07.507 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:28:07.507 DEBUG:teuthology.orchestra.run.smithi028:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:28:07.577 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:28:07.577 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:28:07.595 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:28:07.595 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:28:07.595 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:28:07.596 DEBUG:teuthology.orchestra.run.smithi028:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:28:07.647 INFO:teuthology.orchestra.run.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:28:07.675 INFO:teuthology.orchestra.run.smithi028.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:28:07.675 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:28:07.677 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:28:07.677 DEBUG:teuthology.orchestra.run.smithi028:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:28:07.746 INFO:teuthology.orchestra.run.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:28:07.892 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:28:07.893 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:28:07.893 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key SAYBWXTOLNBMMMSJWZFA --secret VZRcQRHn+ch+YY/RbGUeVTOLjZ0Wa+eFwrzWznzXaphKtL91O2Gvsg== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:28:08.001 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:08.001 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:08.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.040+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 realm 2024-09-14T11:28:08.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:08.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.041+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.042+0000 7fb00f087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:08.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.042+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.043+0000 7fb00f087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:08.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.043+0000 7fb00f087800 20 searching for the correct realm 2024-09-14T11:28:08.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.047+0000 7fb00d372640 0 -- 172.21.15.28:0/3970658252 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55650bdc84e0 msgr2=0x55650bdca950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:08.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.050+0000 7fb00c370640 0 -- 172.21.15.28:0/3970658252 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7faffc030020 msgr2=0x7faffc0026e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.054+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:08.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 zone default found 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 4 Realm: () 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 zonegroup default 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.055+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.056+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.056+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.056+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.056+0000 7fb00f087800 20 started sync module instance, tier type = 2024-09-14T11:28:08.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.056+0000 7fb00f087800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:28:08.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=0 2024-09-14T11:28:08.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=1 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=2 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=3 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=4 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=5 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.065+0000 7fb00f087800 20 add_watcher() i=6 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.066+0000 7fb00f087800 20 add_watcher() i=7 2024-09-14T11:28:08.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.066+0000 7fb00f087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:08.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7faec37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 5 note: GC not initialized 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7faec27e4640 20 reqs_thread_entry: start 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 20 init_complete bucket index max shards: 1 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 20 Filter name: none 2024-09-14T11:28:08.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7faebbfff640 20 reqs_thread_entry: start 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.068+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 10 cache get: name=default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA : miss 2024-09-14T11:28:08.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.069+0000 7fb00f087800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.070+0000 7fb00f087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.070+0000 7fb00f087800 10 cache put: name=default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA info.flags=0x0 2024-09-14T11:28:08.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.070+0000 7fb00f087800 10 adding default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA to cache LRU end 2024-09-14T11:28:08.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.070+0000 7fb00f087800 10 cache get: name=default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA : hit (negative entry) 2024-09-14T11:28:08.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.070+0000 7fb00f087800 10 cache get: name=default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA : hit (negative entry) 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.071+0000 7fb00f087800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.071+0000 7fb00f087800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.071+0000 7fb00f087800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.071+0000 7faee3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693207 cookie 93892479122352 notifier 5841 bl.length()=675 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.071+0000 7faee3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.071+0000 7faee3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:28:08.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.074+0000 7fb00f087800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:28:08.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.074+0000 7fb00f087800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:28:08.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.074+0000 7fb00f087800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:28:08.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.075+0000 7faee3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 93892479115520 notifier 5841 bl.length()=202 2024-09-14T11:28:08.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.075+0000 7faee3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:28:08.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.075+0000 7faee3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:28:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.078+0000 7fb00f087800 10 cache put: name=default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA info.flags=0x7 2024-09-14T11:28:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.078+0000 7fb00f087800 10 moving default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA to cache LRU end 2024-09-14T11:28:08.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.078+0000 7fb00f087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:SAYBWXTOLNBMMMSJWZFA, ofs0, ns] 2024-09-14T11:28:08.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.078+0000 7faee3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693229 cookie 93892479113424 notifier 5841 bl.length()=190 2024-09-14T11:28:08.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.078+0000 7faee3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA info.flags=0x7 2024-09-14T11:28:08.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.078+0000 7faee3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SAYBWXTOLNBMMMSJWZFA to cache LRU end 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "ragweed.client.0", 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "SAYBWXTOLNBMMMSJWZFA", 2024-09-14T11:28:08.079 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "VZRcQRHn+ch+YY/RbGUeVTOLjZ0Wa+eFwrzWznzXaphKtL91O2Gvsg==", 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:28:08.071756Z" 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:28:08.080 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:28:08.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "rgw", 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "", 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:28:08.071746Z", 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:28:08.082 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:28:08.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.081+0000 7faec37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:08.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.083+0000 7fb00f087800 20 remove_watcher() i=0 2024-09-14T11:28:08.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.083+0000 7fb00f087800 2 removed watcher, disabling cache 2024-09-14T11:28:08.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.084+0000 7fb00f087800 20 remove_watcher() i=1 2024-09-14T11:28:08.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.085+0000 7fb00f087800 20 remove_watcher() i=2 2024-09-14T11:28:08.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.087+0000 7fb00f087800 20 remove_watcher() i=3 2024-09-14T11:28:08.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.088+0000 7fb00f087800 20 remove_watcher() i=4 2024-09-14T11:28:08.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.090+0000 7fb00f087800 20 remove_watcher() i=5 2024-09-14T11:28:08.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.091+0000 7fb00f087800 20 remove_watcher() i=6 2024-09-14T11:28:08.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.092+0000 7fb00f087800 20 remove_watcher() i=7 2024-09-14T11:28:08.102 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:28:08.102 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key RSLKECZAQJARAPXTXTTL --secret 5ThssP7mpReCcjQEoQMdOMeRvGhJ4E0WCAOf+ue016L7onRnnYymaQ== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:28:08.171 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:08.171 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:08.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.210+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 realm 2024-09-14T11:28:08.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:08.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.211+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.212+0000 7f59d1a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:08.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.212+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.213+0000 7f59d1a15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:08.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.213+0000 7f59d1a15800 20 searching for the correct realm 2024-09-14T11:28:08.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.216+0000 7f59cd993640 0 -- 172.21.15.28:0/3315091877 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f59c4036070 msgr2=0x7f59c402b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:28:08.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.220+0000 7f59cd192640 0 -- 172.21.15.28:0/3315091877 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f59c4042940 msgr2=0x7f59c401c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.426+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 zone default found 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 4 Realm: () 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 zonegroup default 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.427+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.428+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.428+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.428+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.428+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.429+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.429+0000 7f59d1a15800 20 started sync module instance, tier type = 2024-09-14T11:28:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.429+0000 7f59d1a15800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=0 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=1 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=2 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=3 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=4 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=5 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.438+0000 7f59d1a15800 20 add_watcher() i=6 2024-09-14T11:28:08.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.439+0000 7f59d1a15800 20 add_watcher() i=7 2024-09-14T11:28:08.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.439+0000 7f59d1a15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:08.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.440+0000 7f5883fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:08.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.440+0000 7f59d1a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:08.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.440+0000 7f59d1a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:08.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.440+0000 7f59d1a15800 5 note: GC not initialized 2024-09-14T11:28:08.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f5882fe5640 20 reqs_thread_entry: start 2024-09-14T11:28:08.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 20 init_complete bucket index max shards: 1 2024-09-14T11:28:08.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 20 Filter name: none 2024-09-14T11:28:08.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f5880fe1640 20 reqs_thread_entry: start 2024-09-14T11:28:08.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:28:08.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.441+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 cache get: name=default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL : miss 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 20 rados->read ofs=0 len=0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:08.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 cache put: name=default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL info.flags=0x0 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 adding default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL to cache LRU end 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 cache get: name=default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL : hit (negative entry) 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.442+0000 7f59d1a15800 10 cache get: name=default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL : hit (negative entry) 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.444+0000 7f59d1a15800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.444+0000 7f59d1a15800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.444+0000 7f59d1a15800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:28:08.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.444+0000 7f58b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693199 cookie 93983201410704 notifier 5859 bl.length()=675 2024-09-14T11:28:08.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.444+0000 7f58b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:28:08.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.444+0000 7f58b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:28:08.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.447+0000 7f59d1a15800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:28:08.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.447+0000 7f59d1a15800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:28:08.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.447+0000 7f59d1a15800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:28:08.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.447+0000 7f58b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693208 cookie 93983201416816 notifier 5859 bl.length()=202 2024-09-14T11:28:08.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.447+0000 7f58b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:28:08.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.447+0000 7f58b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:28:08.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.450+0000 7f59d1a15800 10 cache put: name=default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL info.flags=0x7 2024-09-14T11:28:08.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.450+0000 7f59d1a15800 10 moving default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL to cache LRU end 2024-09-14T11:28:08.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.450+0000 7f59d1a15800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:RSLKECZAQJARAPXTXTTL, ofs0, ns] 2024-09-14T11:28:08.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.451+0000 7f58b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693200 cookie 93983201410704 notifier 5859 bl.length()=190 2024-09-14T11:28:08.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.451+0000 7f58b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL info.flags=0x7 2024-09-14T11:28:08.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.451+0000 7f58b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RSLKECZAQJARAPXTXTTL to cache LRU end 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:28:08.451 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "sysuser.client.0", 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "RSLKECZAQJARAPXTXTTL", 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "5ThssP7mpReCcjQEoQMdOMeRvGhJ4E0WCAOf+ue016L7onRnnYymaQ==", 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:28:08.444286Z" 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "system": true, 2024-09-14T11:28:08.452 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:28:08.453 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "rgw", 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "", 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:28:08.444275Z", 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:28:08.454 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:28:08.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.453+0000 7f5883fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:08.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.455+0000 7f59d1a15800 20 remove_watcher() i=0 2024-09-14T11:28:08.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.455+0000 7f59d1a15800 2 removed watcher, disabling cache 2024-09-14T11:28:08.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.456+0000 7f59d1a15800 20 remove_watcher() i=1 2024-09-14T11:28:08.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.457+0000 7f59d1a15800 20 remove_watcher() i=2 2024-09-14T11:28:08.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.458+0000 7f59d1a15800 20 remove_watcher() i=3 2024-09-14T11:28:08.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.459+0000 7f59d1a15800 20 remove_watcher() i=4 2024-09-14T11:28:08.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.460+0000 7f59d1a15800 20 remove_watcher() i=5 2024-09-14T11:28:08.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.461+0000 7f59d1a15800 20 remove_watcher() i=6 2024-09-14T11:28:08.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:08.462+0000 7f59d1a15800 20 remove_watcher() i=7 2024-09-14T11:28:08.473 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:28:08.473 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:28:08.473 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:28:08.503 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:28:08.503 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:28:08.504 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:28:08.574 DEBUG:teuthology.orchestra.run.smithi028:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:28:08.768 INFO:teuthology.orchestra.run.smithi028.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:28:08.934 INFO:teuthology.orchestra.run.smithi028.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:28:09.541 INFO:teuthology.orchestra.run.smithi028.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:28:15.687 INFO:teuthology.orchestra.run.smithi028.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:28:19.392 INFO:teuthology.orchestra.run.smithi028.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=c17d432f29236d64b19c1b2b844636d3ba5f922d4f1341199033c87eb81fab55,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:28:19.392 INFO:teuthology.orchestra.run.smithi028.stdout:py run-test-pre: PYTHONHASHSEED='2922417033' 2024-09-14T11:28:19.392 INFO:teuthology.orchestra.run.smithi028.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:28:19.599 INFO:teuthology.orchestra.run.smithi028.stdout:============================= test session starts ============================== 2024-09-14T11:28:19.599 INFO:teuthology.orchestra.run.smithi028.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:28:19.599 INFO:teuthology.orchestra.run.smithi028.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:28:19.599 INFO:teuthology.orchestra.run.smithi028.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:28:19.599 INFO:teuthology.orchestra.run.smithi028.stdout:configfile: pytest.ini 2024-09-14T11:28:19.700 INFO:teuthology.orchestra.run.smithi028.stdout:collecting ... collected 9 items 2024-09-14T11:28:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:28:21.912 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:28:24.344 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:28:26.407 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:28:28.808 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:28:31.315 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:28:39.824 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:28:45.387 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:28:50.175 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:28:59.288 INFO:teuthology.orchestra.run.smithi028.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:28:59.288 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:28:59.288 INFO:teuthology.orchestra.run.smithi028.stdout:=============================== warnings summary =============================== 2024-09-14T11:28:59.289 INFO:teuthology.orchestra.run.smithi028.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:28:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:28:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: import imp 2024-09-14T11:28:59.289 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:28:59.289 INFO:teuthology.orchestra.run.smithi028.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:28:59.289 INFO:teuthology.orchestra.run.smithi028.stdout:======================== 9 passed, 1 warning in 39.69s ========================= 2024-09-14T11:28:59.319 INFO:teuthology.orchestra.run.smithi028.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:28:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: py: commands succeeded 2024-09-14T11:28:59.320 INFO:teuthology.orchestra.run.smithi028.stdout: congratulations :) 2024-09-14T11:28:59.338 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:28:59.339 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:28:59.368 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:28:59.466 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:28:59.466 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:28:59.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.504+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.505+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.505+0000 7f87a7214800 20 realm 2024-09-14T11:28:59.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.505+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.505+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.505+0000 7f87a7214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:28:59.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.505+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.506+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.506+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.507+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:59.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.507+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.507+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:28:59.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.507+0000 7f87a7214800 20 searching for the correct realm 2024-09-14T11:28:59.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.511+0000 7f87a21df640 0 -- 172.21.15.28:0/3999841462 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55dbdebb2c70 msgr2=0x55dbdebb5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:59.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.515+0000 7f87a29e0640 0 -- 172.21.15.28:0/3999841462 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f87980613b0 msgr2=0x7f879804e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:28:59.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.520+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 zone default found 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 4 Realm: () 2024-09-14T11:28:59.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 zonegroup default 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 started sync module instance, tier type = 2024-09-14T11:28:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.521+0000 7f87a7214800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=0 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=1 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=2 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=3 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=4 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=5 2024-09-14T11:28:59.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.531+0000 7f87a7214800 20 add_watcher() i=6 2024-09-14T11:28:59.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.532+0000 7f87a7214800 20 add_watcher() i=7 2024-09-14T11:28:59.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.532+0000 7f87a7214800 2 all 8 watchers are set, enabling cache 2024-09-14T11:28:59.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.533+0000 7f86597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:59.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.533+0000 7f87a7214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:28:59.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.533+0000 7f87a7214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:28:59.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.571+0000 7f85d3fff640 20 reqs_thread_entry: start 2024-09-14T11:28:59.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.571+0000 7f87a7214800 20 init_complete bucket index max shards: 1 2024-09-14T11:28:59.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.571+0000 7f87a7214800 20 Filter name: none 2024-09-14T11:28:59.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f85d1ffb640 20 reqs_thread_entry: start 2024-09-14T11:28:59.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f87a7214800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:28:59.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:28:59.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f87a7214800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:28:59.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f87a7214800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:28:59.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.572+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 : miss 2024-09-14T11:28:59.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 info.flags=0x17 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 to cache LRU end 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.573+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:28:59.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.574+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55dbdec73528 s->prefetch_data=0 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.575+0000 7f87a7214800 10 manifest: total_size = 7547 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.575+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.410272632151745687 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.575+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55dbdec73528 s->prefetch_data=0 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.575+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec73528 2024-09-14T11:28:59.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.575+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=7547 stripe_ofs=7547 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.410272632151745687 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.qBK5FqkUJrrw1hxmMHLt3Pa65zXkOd2_0 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.577+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.410272632151745687 2024-09-14T11:28:59.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f86867fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:28:59.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f87a7214800 10 manifest: total_size = 4968 2024-09-14T11:28:59.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11839809087806523955 2024-09-14T11:28:59.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.579+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=4968 stripe_ofs=4968 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11839809087806523955 2024-09-14T11:28:59.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.S1iH5QtAfMWppSTenUJhXW1M5F31KG5_0 2024-09-14T11:28:59.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.582+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11839809087806523955 2024-09-14T11:28:59.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.583+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:28:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.584+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.584+0000 7f87a7214800 10 manifest: total_size = 4851 2024-09-14T11:28:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.584+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17226315883231890528 2024-09-14T11:28:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.584+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.584+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.584+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=4851 stripe_ofs=4851 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17226315883231890528 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.ERdWmrcDDZLZ_lhwOVV8nGQbcGawog9_0 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.587+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17226315883231890528 2024-09-14T11:28:59.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.588+0000 7f86867fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:28:59.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.588+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.589+0000 7f87a7214800 10 manifest: total_size = 7502 2024-09-14T11:28:59.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.589+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10561234786362021107 2024-09-14T11:28:59.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.589+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.589+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.589+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=7502 stripe_ofs=7502 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10561234786362021107 2024-09-14T11:28:59.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.GFmcwL5mrqmRMbadaTm5RP3j11Rp5ii_0 2024-09-14T11:28:59.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.591+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10561234786362021107 2024-09-14T11:28:59.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.592+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:28:59.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.592+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.593+0000 7f87a7214800 10 manifest: total_size = 13549 2024-09-14T11:28:59.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.593+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11442312043225487800 2024-09-14T11:28:59.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.593+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.593+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.593+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=13549 stripe_ofs=13549 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11442312043225487800 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.w5Sse029EkV-FuW7GqRaSco7wGt5RB5_0 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.596+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11442312043225487800 2024-09-14T11:28:59.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.597+0000 7f86867fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:28:59.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.598+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.598+0000 7f87a7214800 10 manifest: total_size = 7687 2024-09-14T11:28:59.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.598+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15247205443938848791 2024-09-14T11:28:59.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.598+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.598+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.598+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=7687 stripe_ofs=7687 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15247205443938848791 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.qW1ceOXICBkQh5Mj07Cu0Zvn0ZjgLKU_0 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.601+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15247205443938848791 2024-09-14T11:28:59.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:28:59.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f87a7214800 20 get_obj_state: octx=0x7f8798022f50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f87a7214800 10 manifest: total_size = 7805 2024-09-14T11:28:59.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4379367918304863798 2024-09-14T11:28:59.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f87a7214800 20 get_obj_state: octx=0x7f8798022f50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.602+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=7805 stripe_ofs=7805 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4379367918304863798 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.5NSo4vK8fuDAeDdG7oXp2nIVHfR0jwO_0 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.605+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4379367918304863798 2024-09-14T11:28:59.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f86867fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:28:59.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f87a7214800 10 manifest: total_size = 7732 2024-09-14T11:28:59.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17723806025036879217 2024-09-14T11:28:59.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.606+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=7732 stripe_ofs=7732 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17723806025036879217 2024-09-14T11:28:59.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_._x_qo4xCDMHaUxcdU-UrfeL__C7qpYO_0 2024-09-14T11:28:59.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.609+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17723806025036879217 2024-09-14T11:28:59.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.610+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:28:59.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.611+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8080 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.611+0000 7f87a7214800 10 manifest: total_size = 8745 2024-09-14T11:28:59.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.611+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14588621262169849017 2024-09-14T11:28:59.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.611+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8080 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.611+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.611+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4.0 2024-09-14T11:28:59.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=8745 stripe_ofs=8745 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14588621262169849017 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.vvDDUBfsYKw7q6SOMRbmgnEtUhFRytD_0 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.613+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14588621262169849017 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f86867fc640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.615+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.616+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:28:59.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.616+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.617+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:28:59.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.617+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:28:59.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.617+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:28:59.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.618+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:28:59.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.618+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:28:59.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.618+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94402823014560 notifier 5889 bl.length()=162 2024-09-14T11:28:59.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.621+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 from cache 2024-09-14T11:28:59.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.621+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4, ofs0, ns] 2024-09-14T11:28:59.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.621+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94402823023008 notifier 5889 bl.length()=219 2024-09-14T11:28:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.624+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 : miss 2024-09-14T11:28:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.624+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.624+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.624+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 info.flags=0x0 2024-09-14T11:28:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.624+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4 to cache LRU end 2024-09-14T11:28:59.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.626+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 : miss 2024-09-14T11:28:59.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.626+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:28:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 info.flags=0x17 2024-09-14T11:28:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 to cache LRU end 2024-09-14T11:28:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.627+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.628+0000 7f87a7214800 10 manifest: total_size = 18874368 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.628+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1984925730932589218 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.628+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.628+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.628+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11.0 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:28:59.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1984925730932589218 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.1 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.630+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.2 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.3 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.4 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:28:59.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.631+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1984925730932589218 2024-09-14T11:28:59.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:28:59.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.632+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.634+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.634+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.634+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:28:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.634+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:28:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.634+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:28:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.635+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:28:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.635+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:28:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.636+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94402823020912 notifier 5889 bl.length()=191 2024-09-14T11:28:59.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.638+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 from cache 2024-09-14T11:28:59.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.638+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11, ofs0, ns] 2024-09-14T11:28:59.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.638+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94402823014560 notifier 5889 bl.length()=249 2024-09-14T11:28:59.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.641+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 : miss 2024-09-14T11:28:59.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.641+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.641+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.641+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 info.flags=0x0 2024-09-14T11:28:59.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.641+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11 to cache LRU end 2024-09-14T11:28:59.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.643+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 : miss 2024-09-14T11:28:59.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.643+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.644+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:28:59.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.644+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 info.flags=0x17 2024-09-14T11:28:59.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.644+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 to cache LRU end 2024-09-14T11:28:59.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.644+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.644+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.644+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 2024-09-14T11:28:59.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.645+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:28:59.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.645+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf50a0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.646+0000 7f87a7214800 10 manifest: total_size = 886297 2024-09-14T11:28:59.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.646+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12257585176736507624 2024-09-14T11:28:59.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.646+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf50a0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55dbdec72ba8 s->prefetch_data=0 2024-09-14T11:28:59.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.646+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec72ba8 2024-09-14T11:28:59.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.646+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12.0 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.648+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.648+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.648+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.648+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.648+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.648+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:28:59.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12257585176736507624 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.1 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.2 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.3 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.4 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.649+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12257585176736507624 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.650+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.652+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:28:59.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.652+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.652+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:28:59.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.652+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:28:59.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.652+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:28:59.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.653+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:28:59.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.653+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:28:59.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.653+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94402823023008 notifier 5889 bl.length()=198 2024-09-14T11:28:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.656+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 from cache 2024-09-14T11:28:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.656+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12, ofs0, ns] 2024-09-14T11:28:59.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.656+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94402823031056 notifier 5889 bl.length()=256 2024-09-14T11:28:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.658+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 : miss 2024-09-14T11:28:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.658+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.659+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.659+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 info.flags=0x0 2024-09-14T11:28:59.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.659+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12 to cache LRU end 2024-09-14T11:28:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 : miss 2024-09-14T11:28:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:28:59.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 info.flags=0x17 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 to cache LRU end 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.661+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.662+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo[971ChcUFpPc0L0IUoIjBPMJglt.sSCp] 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.662+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10.0 2024-09-14T11:28:59.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.662+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.663+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to 1irefoq1v0ud3v7vxdl3626l5q05s9qq 2024-09-14T11:28:59.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.663+0000 7f87a7214800 20 get_obj_state_impl: setting s->olh_tag to n9j88t8tv2w44pvps17vgg5x2jegzdn6 2024-09-14T11:28:59.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.663+0000 7f87a7214800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=n9j88t8tv2w44pvps17vgg5x2jegzdn6 2024-09-14T11:28:59.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.664+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10.0 2024-09-14T11:28:59.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.665+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10.0 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 olh_log_entry: epoch=3 op=3 key=foo[971ChcUFpPc0L0IUoIjBPMJglt.sSCp] 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-multipart-index-versioning.1:_:971ChcUFpPc0L0IUoIjBPMJglt.sSCp_foo state=0x55dbdec0c5c8 s->prefetch_data=0 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 10 manifest: total_size = 18874368 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12615630125417983705 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-multipart-index-versioning.1:_:971ChcUFpPc0L0IUoIjBPMJglt.sSCp_foo state=0x55dbdec0c5c8 s->prefetch_data=0 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec0c5c8 2024-09-14T11:28:59.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.666+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10.0 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:28:59.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12615630125417983705 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.1 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.2 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.3 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.4 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:28:59.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.668+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12615630125417983705 2024-09-14T11:28:59.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.670+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo[971ChcUFpPc0L0IUoIjBPMJglt.sSCp] 2024-09-14T11:28:59.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.671+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.673+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10.0 2024-09-14T11:28:59.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10.0 2024-09-14T11:28:59.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.674+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.676+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:28:59.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.676+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.676+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:28:59.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.676+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:28:59.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.676+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:28:59.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.677+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:28:59.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.677+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:28:59.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.677+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94402823023008 notifier 5889 bl.length()=193 2024-09-14T11:28:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.680+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 from cache 2024-09-14T11:28:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.680+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10, ofs0, ns] 2024-09-14T11:28:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.680+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94402823025680 notifier 5889 bl.length()=251 2024-09-14T11:28:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.683+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 : miss 2024-09-14T11:28:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.683+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.683+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.683+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 info.flags=0x0 2024-09-14T11:28:59.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.683+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10 to cache LRU end 2024-09-14T11:28:59.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 : miss 2024-09-14T11:28:59.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 info.flags=0x17 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 to cache LRU end 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.685+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:28:59.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 10 manifest: total_size = 18874368 2024-09-14T11:28:59.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9278974766397323582 2024-09-14T11:28:59.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.686+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9.0 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:28:59.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9278974766397323582 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.1 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.2 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.3 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.4 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.688+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9278974766397323582 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.690+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.692+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:28:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.692+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.692+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:28:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.692+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:28:59.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.692+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:28:59.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.693+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:28:59.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.693+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:28:59.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.694+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94402823028368 notifier 5889 bl.length()=183 2024-09-14T11:28:59.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.696+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 from cache 2024-09-14T11:28:59.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.696+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9, ofs0, ns] 2024-09-14T11:28:59.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.696+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94402823014560 notifier 5889 bl.length()=240 2024-09-14T11:28:59.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.699+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 : miss 2024-09-14T11:28:59.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.699+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.699+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.699+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 info.flags=0x0 2024-09-14T11:28:59.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.699+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9 to cache LRU end 2024-09-14T11:28:59.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.701+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 : miss 2024-09-14T11:28:59.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.701+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.702+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:28:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.702+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 info.flags=0x17 2024-09-14T11:28:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.702+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 to cache LRU end 2024-09-14T11:28:59.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.702+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.702+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.702+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 2024-09-14T11:28:59.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf4960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9917622254044609002 2024-09-14T11:28:59.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf4960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.703+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9917622254044609002 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.p78kpdV52aYPpLZj2oybwt3xkkuGgRI_0 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.706+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9917622254044609002 2024-09-14T11:28:59.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:28:59.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf4960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14530070020947783184 2024-09-14T11:28:59.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf4960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.707+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14530070020947783184 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.p78kpdV52aYPpLZj2oybwt3xkkuGgRI_0 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.709+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14530070020947783184 2024-09-14T11:28:59.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:28:59.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec72d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _4Rbq9VHLLyMO2EdC0HWc0X1j-RSW3eF 2024-09-14T11:28:59.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec72d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.711+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _4Rbq9VHLLyMO2EdC0HWc0X1j-RSW3eF 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.UMRYugiQz5X3eHS4IX4TLX2dJEsthnN_0 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:28:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.714+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _4Rbq9VHLLyMO2EdC0HWc0X1j-RSW3eF 2024-09-14T11:28:59.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.715+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:28:59.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.715+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec72d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.716+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.716+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _HeHWscBBFl-YFzP8bHr_dvRrLpw-_LT 2024-09-14T11:28:59.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.716+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec72d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.716+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.716+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _HeHWscBBFl-YFzP8bHr_dvRrLpw-_LT 2024-09-14T11:28:59.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.GNHK22LzSiHmTOKffueWqwLrFtKIGDf_0 2024-09-14T11:28:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:28:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.719+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _HeHWscBBFl-YFzP8bHr_dvRrLpw-_LT 2024-09-14T11:28:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.720+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:28:59.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.721+0000 7f87a7214800 20 get_obj_state: octx=0x7f87940c3810 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.721+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.721+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10747697034428838850 2024-09-14T11:28:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.721+0000 7f87a7214800 20 get_obj_state: octx=0x7f87940c3810 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.721+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.721+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10747697034428838850 2024-09-14T11:28:59.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.jB9AMLxfvKhKMfPiRuBs2GMTIECQEhn_0 2024-09-14T11:28:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:28:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.723+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10747697034428838850 2024-09-14T11:28:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.724+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:28:59.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.724+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec02ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.725+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.725+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _PpuFaM6NT6VyqBjvon2IMjiE5gQ13F_ 2024-09-14T11:28:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.725+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec02ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.725+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.725+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _PpuFaM6NT6VyqBjvon2IMjiE5gQ13F_ 2024-09-14T11:28:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.CWapFkvG-VEDILbvfBlapQmA47-Gke3_0 2024-09-14T11:28:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:28:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.727+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _PpuFaM6NT6VyqBjvon2IMjiE5gQ13F_ 2024-09-14T11:28:59.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.728+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:28:59.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.729+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.729+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.729+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7593415417622269435 2024-09-14T11:28:59.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.729+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.729+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.729+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7593415417622269435 2024-09-14T11:28:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.jB9AMLxfvKhKMfPiRuBs2GMTIECQEhn_0 2024-09-14T11:28:59.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:28:59.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.731+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7593415417622269435 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.732+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec04f70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.733+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.733+0000 7f87a7214800 10 manifest: total_size = 5242880 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.733+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _Z6Nnhkb-zJp2D-HS18JeFM9Px-W-MJ3 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.733+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec04f70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.733+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.733+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _Z6Nnhkb-zJp2D-HS18JeFM9Px-W-MJ3 2024-09-14T11:28:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.d4zO0lnq6-C6XsWDfh6EWJFdsX--YB6_0 2024-09-14T11:28:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:28:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.735+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _Z6Nnhkb-zJp2D-HS18JeFM9Px-W-MJ3 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f87a7214800 10 manifest: total_size = 2046 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9249874322767009814 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c010e00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.737+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9249874322767009814 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.WUR5J-0PAoYkukXSLmSQeOwfK0s6Lm1_0 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.740+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9249874322767009814 2024-09-14T11:28:59.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.741+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:28:59.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.741+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf83e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.742+0000 7f87a7214800 10 manifest: total_size = 2046 2024-09-14T11:28:59.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.742+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _NmqZt8X3HMrwRYiQrPlpFH0tI7MncOX 2024-09-14T11:28:59.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.742+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf83e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.742+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.742+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _NmqZt8X3HMrwRYiQrPlpFH0tI7MncOX 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.3Y7TnbR6P8-gFgZNVUpYVENFEYFQ5eG_0 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.744+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _NmqZt8X3HMrwRYiQrPlpFH0tI7MncOX 2024-09-14T11:28:59.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.745+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:28:59.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.746+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdeb73c60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.746+0000 7f87a7214800 10 manifest: total_size = 2046 2024-09-14T11:28:59.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.746+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _r4KIJz8rpzYaHMlA3H8THxSINdTD2b- 2024-09-14T11:28:59.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.746+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdeb73c60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.746+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.746+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _r4KIJz8rpzYaHMlA3H8THxSINdTD2b- 2024-09-14T11:28:59.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.Wz0Bh_XMBA5BmMz8WJ7M9C9ksj3o_pk_0 2024-09-14T11:28:59.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:28:59.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.748+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _r4KIJz8rpzYaHMlA3H8THxSINdTD2b- 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.749+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.749+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec05090 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.750+0000 7f87a7214800 10 manifest: total_size = 2046 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.750+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15911631428240488331 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.750+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec05090 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55dbdebf6d18 s->prefetch_data=0 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.750+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebf6d18 2024-09-14T11:28:59.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.750+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15.0 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=2046 stripe_ofs=2046 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15911631428240488331 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.WUR5J-0PAoYkukXSLmSQeOwfK0s6Lm1_0 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.752+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15911631428240488331 2024-09-14T11:28:59.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:28:59.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.753+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.755+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:28:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.755+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.755+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:28:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.755+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:28:59.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.755+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:28:59.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.756+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:28:59.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.756+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:28:59.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.757+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94402823023008 notifier 5889 bl.length()=189 2024-09-14T11:28:59.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.759+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 from cache 2024-09-14T11:28:59.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.759+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15, ofs0, ns] 2024-09-14T11:28:59.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.759+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94402823025680 notifier 5889 bl.length()=247 2024-09-14T11:28:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.762+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 : miss 2024-09-14T11:28:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.762+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.762+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.762+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 info.flags=0x0 2024-09-14T11:28:59.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.762+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15 to cache LRU end 2024-09-14T11:28:59.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.764+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 : miss 2024-09-14T11:28:59.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.764+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.765+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:28:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.765+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 info.flags=0x17 2024-09-14T11:28:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.765+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 to cache LRU end 2024-09-14T11:28:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.765+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.765+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.765+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 2024-09-14T11:28:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:28:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:28:59.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18248190607811706600 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.766+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18248190607811706600 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.1 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:28:59.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.2 2024-09-14T11:28:59.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:28:59.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.3 2024-09-14T11:28:59.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:28:59.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.768+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18248190607811706600 2024-09-14T11:28:59.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:28:59.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2552178503002795843 2024-09-14T11:28:59.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.770+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2552178503002795843 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.1 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.2 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.3 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.773+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2552178503002795843 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _g6TfvXZU4c4KdAN0lxaEJpsseDSMI-V 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.774+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _g6TfvXZU4c4KdAN0lxaEJpsseDSMI-V 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.WhVz8o99WXwpOQc-sXE3HNBWlRrng-N_0 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.WhVz8o99WXwpOQc-sXE3HNBWlRrng-N_1 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.777+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _g6TfvXZU4c4KdAN0lxaEJpsseDSMI-V 2024-09-14T11:28:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:28:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _e6LPYuQSECwNqPXUDBGbXo7d2fsDsOt 2024-09-14T11:28:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.778+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _e6LPYuQSECwNqPXUDBGbXo7d2fsDsOt 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.zIl3asmJhpYG8dKPMiVBnD7Vw-PjzWp_0 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.zIl3asmJhpYG8dKPMiVBnD7Vw-PjzWp_1 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.781+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _e6LPYuQSECwNqPXUDBGbXo7d2fsDsOt 2024-09-14T11:28:59.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.782+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:28:59.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.782+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.783+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.783+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16674753374394908474 2024-09-14T11:28:59.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.783+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.783+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.783+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:28:59.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16674753374394908474 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.1 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.2 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.3 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.785+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16674753374394908474 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8760 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _P6a5fy0uXZORU5ejsagGmOsTetOxJXa 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf8760 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.786+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _P6a5fy0uXZORU5ejsagGmOsTetOxJXa 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.ynB2KonMRhDti7ByyY8Tm9Z_R7mk6zp_0 2024-09-14T11:28:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:28:59.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.ynB2KonMRhDti7ByyY8Tm9Z_R7mk6zp_1 2024-09-14T11:28:59.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:28:59.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.789+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _P6a5fy0uXZORU5ejsagGmOsTetOxJXa 2024-09-14T11:28:59.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.790+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:28:59.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.790+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf50a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.791+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.791+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11078692438920241506 2024-09-14T11:28:59.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.791+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf50a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.791+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.791+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11078692438920241506 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.1 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.2 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.3 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.793+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11078692438920241506 2024-09-14T11:28:59.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:28:59.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _OMYY34WCSxH40BxrC7HAMzQiL5j-rpb 2024-09-14T11:28:59.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55dbdec03338 s->prefetch_data=0 2024-09-14T11:28:59.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec03338 2024-09-14T11:28:59.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.794+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _OMYY34WCSxH40BxrC7HAMzQiL5j-rpb 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.mihM9EZGqpM2wBs5CLGrS-TPn0nIiXB_0 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.mihM9EZGqpM2wBs5CLGrS-TPn0nIiXB_1 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.797+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _OMYY34WCSxH40BxrC7HAMzQiL5j-rpb 2024-09-14T11:28:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:28:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f87a7214800 10 manifest: total_size = 541681 2024-09-14T11:28:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6427946067330895270 2024-09-14T11:28:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebfb688 2024-09-14T11:28:59.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.798+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:28:59.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:28:59.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6427946067330895270 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.1 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.2 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.3 2024-09-14T11:28:59.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:28:59.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.801+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6427946067330895270 2024-09-14T11:28:59.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.802+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:28:59.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.802+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf75f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.803+0000 7f87a7214800 10 manifest: total_size = 541681 2024-09-14T11:28:59.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.803+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _SV9IsREU-pRLWwm5zavz6iX-acFnJ0D 2024-09-14T11:28:59.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.803+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf75f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.803+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebfb688 2024-09-14T11:28:59.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.803+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _SV9IsREU-pRLWwm5zavz6iX-acFnJ0D 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.LHKhLl0Ah8XwP6-1mxIqxv3tSTw16w-_0 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.805+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _SV9IsREU-pRLWwm5zavz6iX-acFnJ0D 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.806+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf50a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.806+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.807+0000 7f87a7214800 10 manifest: total_size = 541681 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.807+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to _o_Iyy_13bnhiY2UzkrOoMcb9jfCiWsK 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.807+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf50a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.807+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebfb688 2024-09-14T11:28:59.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.807+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: _o_Iyy_13bnhiY2UzkrOoMcb9jfCiWsK 2024-09-14T11:28:59.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.y3ktAuHWSE2XaCejyjRCMAEg0j7kIIc_0 2024-09-14T11:28:59.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:28:59.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.809+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _o_Iyy_13bnhiY2UzkrOoMcb9jfCiWsK 2024-09-14T11:28:59.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.810+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:28:59.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.810+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.811+0000 7f87a7214800 10 manifest: total_size = 541681 2024-09-14T11:28:59.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.811+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5359005391369959706 2024-09-14T11:28:59.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.811+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55dbdebfb688 s->prefetch_data=0 2024-09-14T11:28:59.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.811+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdebfb688 2024-09-14T11:28:59.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.811+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16.0 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:28:59.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5359005391369959706 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.1 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.2 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.3 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:28:59.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.813+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5359005391369959706 2024-09-14T11:28:59.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.814+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:28:59.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.814+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.814+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.815+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.815+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.815+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.815+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.815+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.816+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:28:59.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.816+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.817+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:28:59.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.817+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:28:59.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.817+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:28:59.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.818+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:28:59.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.818+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:28:59.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.818+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94402823025680 notifier 5889 bl.length()=199 2024-09-14T11:28:59.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.821+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 from cache 2024-09-14T11:28:59.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.821+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16, ofs0, ns] 2024-09-14T11:28:59.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.821+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94402823034656 notifier 5889 bl.length()=257 2024-09-14T11:28:59.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.823+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 : miss 2024-09-14T11:28:59.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.823+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.824+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.824+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 info.flags=0x0 2024-09-14T11:28:59.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.824+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16 to cache LRU end 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 : miss 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 info.flags=0x17 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 to cache LRU end 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.826+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 2024-09-14T11:28:59.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:28:59.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:28:59.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:28:59.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec72b70 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55dbdeb722f8 s->prefetch_data=0 2024-09-14T11:28:59.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15064651361079182889 2024-09-14T11:28:59.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec72b70 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55dbdeb722f8 s->prefetch_data=0 2024-09-14T11:28:59.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdeb722f8 2024-09-14T11:28:59.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.827+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14.0 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:28:59.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15064651361079182889 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-FROZEN.2~S2nWRp-YWOGhDLcEohcEebBpnjNTPrg.1 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-FROZEN.2~S2nWRp-YWOGhDLcEohcEebBpnjNTPrg.2 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-FROZEN.2~S2nWRp-YWOGhDLcEohcEebBpnjNTPrg.3 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.830+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15064651361079182889 2024-09-14T11:28:59.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.831+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:28:59.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.831+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55dbdeb722f8 s->prefetch_data=0 2024-09-14T11:28:59.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.832+0000 7f87a7214800 10 manifest: total_size = 11534336 2024-09-14T11:28:59.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.832+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12051460584173364442 2024-09-14T11:28:59.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.832+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55dbdeb722f8 s->prefetch_data=0 2024-09-14T11:28:59.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.832+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdeb722f8 2024-09-14T11:28:59.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.832+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14.0 2024-09-14T11:28:59.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:28:59.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:28:59.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:28:59.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12051460584173364442 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-LUKEWARM.2~O-gB3a95o6mSdABYAzBBkaMrjsKsygA.1 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-LUKEWARM.2~O-gB3a95o6mSdABYAzBBkaMrjsKsygA.2 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-LUKEWARM.2~O-gB3a95o6mSdABYAzBBkaMrjsKsygA.3 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.834+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12051460584173364442 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.835+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.835+0000 7f87a7214800 20 get_obj_state: octx=0x7f87940c3c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55dbdec0bfe8 s->prefetch_data=0 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.836+0000 7f87a7214800 10 manifest: total_size = 16377 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.836+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16979323654813005121 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.836+0000 7f87a7214800 20 get_obj_state: octx=0x7f87940c3c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55dbdec0bfe8 s->prefetch_data=0 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.836+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec0bfe8 2024-09-14T11:28:59.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.836+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14.0 2024-09-14T11:28:59.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=7668 rules.size()=3 2024-09-14T11:28:59.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7668 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=7668 stripe_ofs=7668 part_ofs=7668 rule->part_size=7674 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6299124 part_ofs=7668 rule->part_size=7674 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16979323654813005121 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-STANDARD.2~_yw8hA7SUBI5LYl6PBhcJJB6F6jPYf6.1 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:28:59.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-STANDARD.2~_yw8hA7SUBI5LYl6PBhcJJB6F6jPYf6.2 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-STANDARD.2~_yw8hA7SUBI5LYl6PBhcJJB6F6jPYf6.3 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.838+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16979323654813005121 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.839+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:28:59.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.839+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.839+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.840+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.840+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.840+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.840+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.840+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.841+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:28:59.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.841+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.842+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:28:59.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.842+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:28:59.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.842+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:28:59.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.843+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:28:59.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.843+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:28:59.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.843+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94402823031056 notifier 5889 bl.length()=194 2024-09-14T11:28:59.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.846+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 from cache 2024-09-14T11:28:59.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.846+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14, ofs0, ns] 2024-09-14T11:28:59.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.846+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94402823034656 notifier 5889 bl.length()=252 2024-09-14T11:28:59.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.848+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 : miss 2024-09-14T11:28:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.848+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.849+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.849+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 info.flags=0x0 2024-09-14T11:28:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.849+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14 to cache LRU end 2024-09-14T11:28:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 : miss 2024-09-14T11:28:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:28:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 info.flags=0x17 2024-09-14T11:28:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 to cache LRU end 2024-09-14T11:28:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.851+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebfd360 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 10 manifest: total_size = 10485760 2024-09-14T11:28:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13114460131410691278 2024-09-14T11:28:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebfd360 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.852+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13.0 2024-09-14T11:28:59.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13114460131410691278 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.qbfqqUar8xx6j0EVvv3c6qXP8vahmc2_0 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.qbfqqUar8xx6j0EVvv3c6qXP8vahmc2_1 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.854+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13114460131410691278 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f87a7214800 10 manifest: total_size = 10485760 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2418940898311599750 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.856+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13.0 2024-09-14T11:28:59.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2418940898311599750 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.0HAgipF-Cr5J8q3ZN_pnHe9UETc3L9c_0 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.0HAgipF-Cr5J8q3ZN_pnHe9UETc3L9c_1 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.858+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2418940898311599750 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.859+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.860+0000 7f87a7214800 20 get_obj_state: octx=0x7f87980a0550 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.860+0000 7f87a7214800 10 manifest: total_size = 649292 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.860+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8243198575594217825 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.860+0000 7f87a7214800 20 get_obj_state: octx=0x7f87980a0550 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.860+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.860+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13.0 2024-09-14T11:28:59.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=649292 stripe_ofs=649292 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8243198575594217825 2024-09-14T11:28:59.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.8oDZc4c53DcsCCf0Iq5QC3Px9-IGApT_0 2024-09-14T11:28:59.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:28:59.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.862+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8243198575594217825 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.863+0000 7f86867fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.864+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.865+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:28:59.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.865+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.866+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:28:59.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.866+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:28:59.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.866+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:28:59.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.867+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:28:59.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.867+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:28:59.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.867+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94402823023008 notifier 5889 bl.length()=184 2024-09-14T11:28:59.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.869+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 from cache 2024-09-14T11:28:59.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.869+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13, ofs0, ns] 2024-09-14T11:28:59.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.870+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94402823031056 notifier 5889 bl.length()=242 2024-09-14T11:28:59.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.872+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 : miss 2024-09-14T11:28:59.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.872+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.873+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.873+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 info.flags=0x0 2024-09-14T11:28:59.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.873+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13 to cache LRU end 2024-09-14T11:28:59.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 : miss 2024-09-14T11:28:59.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:28:59.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 info.flags=0x17 2024-09-14T11:28:59.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 to cache LRU end 2024-09-14T11:28:59.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.875+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec09860 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.876+0000 7f87a7214800 10 manifest: total_size = 0 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.876+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2171189300847480407 2024-09-14T11:28:59.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.876+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdec09860 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.876+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.876+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6.0 2024-09-14T11:28:59.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.879+0000 7f87a7214800 20 get_obj_state: octx=0x7f879805fff0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.879+0000 7f87a7214800 10 manifest: total_size = 0 2024-09-14T11:28:59.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.879+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14127305963067905396 2024-09-14T11:28:59.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.879+0000 7f87a7214800 20 get_obj_state: octx=0x7f879805fff0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.879+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.879+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6.0 2024-09-14T11:28:59.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.880+0000 7f86867fc640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:28:59.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.881+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019830 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.882+0000 7f87a7214800 10 manifest: total_size = 0 2024-09-14T11:28:59.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.882+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6340249987201650800 2024-09-14T11:28:59.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.882+0000 7f87a7214800 20 get_obj_state: octx=0x7f879c019830 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.882+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.882+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6.0 2024-09-14T11:28:59.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.882+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:28:59.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.884+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.884+0000 7f87a7214800 10 manifest: total_size = 0 2024-09-14T11:28:59.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.884+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16710781521341992306 2024-09-14T11:28:59.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.884+0000 7f87a7214800 20 get_obj_state: octx=0x7f8794089980 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55dbdec07f98 s->prefetch_data=0 2024-09-14T11:28:59.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.884+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec07f98 2024-09-14T11:28:59.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.884+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6.0 2024-09-14T11:28:59.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.885+0000 7f86867fc640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:28:59.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.887+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.887+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.888+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:28:59.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.888+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.888+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.888+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.888+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.888+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.889+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:28:59.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.889+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.889+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:28:59.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.890+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:28:59.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.890+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:28:59.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.891+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:28:59.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.891+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:28:59.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.891+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94402823020912 notifier 5889 bl.length()=181 2024-09-14T11:28:59.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.894+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 from cache 2024-09-14T11:28:59.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.894+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6, ofs0, ns] 2024-09-14T11:28:59.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.894+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94402823031056 notifier 5889 bl.length()=238 2024-09-14T11:28:59.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.897+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 : miss 2024-09-14T11:28:59.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.897+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.897+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.897+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 info.flags=0x0 2024-09-14T11:28:59.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.897+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6 to cache LRU end 2024-09-14T11:28:59.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.899+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 : miss 2024-09-14T11:28:59.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.899+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:28:59.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 info.flags=0x17 2024-09-14T11:28:59.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 to cache LRU end 2024-09-14T11:28:59.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.900+0000 7f87a7214800 20 get_obj_state: octx=0x7f8798022f50 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.901+0000 7f87a7214800 10 manifest: total_size = 527 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.901+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3103797265614144232 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.901+0000 7f87a7214800 20 get_obj_state: octx=0x7f8798022f50 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.901+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.901+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7.0 2024-09-14T11:28:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3103797265614144232 2024-09-14T11:28:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.BhaxkMMgQ5KwsZomQ4yQ9UE4PzPNa33_0 2024-09-14T11:28:59.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:28:59.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.903+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3103797265614144232 2024-09-14T11:28:59.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.904+0000 7f86867fc640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:28:59.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.905+0000 7f87a7214800 20 get_obj_state: octx=0x7f8798022f50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.905+0000 7f87a7214800 10 manifest: total_size = 524288 2024-09-14T11:28:59.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.905+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17791078375121622139 2024-09-14T11:28:59.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.905+0000 7f87a7214800 20 get_obj_state: octx=0x7f8798022f50 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.905+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.905+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7.0 2024-09-14T11:28:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17791078375121622139 2024-09-14T11:28:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.00xarYAdMbWbodsn3vptITWsHYGhkcF_0 2024-09-14T11:28:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.907+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17791078375121622139 2024-09-14T11:28:59.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:28:59.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf80e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f87a7214800 10 manifest: total_size = 524288 2024-09-14T11:28:59.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6010429430815641249 2024-09-14T11:28:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf80e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.909+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7.0 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6010429430815641249 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.qJryRxoRqhXdSpntTC8GzOFLxKsaQ4s_0 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:28:59.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.912+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6010429430815641249 2024-09-14T11:28:59.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.913+0000 7f86867fc640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:28:59.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.913+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf80e0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.914+0000 7f87a7214800 10 manifest: total_size = 24595 2024-09-14T11:28:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.914+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7726686259177976609 2024-09-14T11:28:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.914+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebf80e0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.914+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.914+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7.0 2024-09-14T11:28:59.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7726686259177976609 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.wjgMv-5pGRqIIS7sxxF3mPOtdVQ7k7Y_0 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.916+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7726686259177976609 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.918+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.919+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:28:59.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.919+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.920+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:28:59.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.920+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:28:59.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.920+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:28:59.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.921+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:28:59.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.921+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:28:59.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.921+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94402823020912 notifier 5889 bl.length()=181 2024-09-14T11:28:59.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.924+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 from cache 2024-09-14T11:28:59.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.924+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7, ofs0, ns] 2024-09-14T11:28:59.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.924+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94402823031056 notifier 5889 bl.length()=238 2024-09-14T11:28:59.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.926+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 : miss 2024-09-14T11:28:59.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.926+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.926+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.926+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 info.flags=0x0 2024-09-14T11:28:59.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.926+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7 to cache LRU end 2024-09-14T11:28:59.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 : miss 2024-09-14T11:28:59.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:28:59.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 info.flags=0x17 2024-09-14T11:28:59.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 to cache LRU end 2024-09-14T11:28:59.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:28:59.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:28:59.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.929+0000 7f87a7214800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 2024-09-14T11:28:59.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:28:59.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:28:59.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 10 manifest: total_size = 55 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15655933806367240889 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.930+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8.0 2024-09-14T11:28:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15655933806367240889 2024-09-14T11:28:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.gSm_JCypaFhVp9Ylm8tBg9OHL2s9wx1_0 2024-09-14T11:28:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.933+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15655933806367240889 2024-09-14T11:28:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:28:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f87a7214800 10 manifest: total_size = 1048576 2024-09-14T11:28:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9226941631435626217 2024-09-14T11:28:59.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.936+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8.0 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9226941631435626217 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.49Xl2ZTq2SD4sMYp010NOfF8RslVVPT_0 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.939+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9226941631435626217 2024-09-14T11:28:59.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f86867fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:28:59.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f87a7214800 10 manifest: total_size = 1035 2024-09-14T11:28:59.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17654703972353555858 2024-09-14T11:28:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.940+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8.0 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17654703972353555858 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.1Rdjr4NNZEAyodsSyNkutEzSHu_LpOh_0 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.943+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17654703972353555858 2024-09-14T11:28:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f8685ffb640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:28:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f87a7214800 10 manifest: total_size = 55 2024-09-14T11:28:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f87a7214800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12529201841508755892 2024-09-14T11:28:59.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f87a7214800 20 get_obj_state: octx=0x55dbdebffd70 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55dbdec09df8 s->prefetch_data=0 2024-09-14T11:28:59.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f87a7214800 20 prepare_atomic_modification: state is not atomic. state=0x55dbdec09df8 2024-09-14T11:28:59.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.944+0000 7f87a7214800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8.0 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12529201841508755892 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.nEOujBPdwmGfNwiZMuPkoqGdSsCzHQT_0 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:28:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:28:59.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.947+0000 7f87a7214800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12529201841508755892 2024-09-14T11:28:59.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.948+0000 7f87a7214800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:28:59.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.948+0000 7f87a7214800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:28:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.948+0000 7f86867fc640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:28:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.949+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:28:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.949+0000 7f87a7214800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:28:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.949+0000 7f87a7214800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:28:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.949+0000 7f87a7214800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:28:59.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.949+0000 7f87a7214800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:28:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.950+0000 7f87a7214800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:28:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.950+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.950+0000 7f87a7214800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:28:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.950+0000 7f87a7214800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:28:59.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.950+0000 7f87a7214800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:28:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.951+0000 7f87a7214800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:28:59.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.951+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:28:59.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.952+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94402823020912 notifier 5889 bl.length()=181 2024-09-14T11:28:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.954+0000 7f87a7214800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 from cache 2024-09-14T11:28:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.954+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8, ofs0, ns] 2024-09-14T11:28:59.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.954+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94402823031056 notifier 5889 bl.length()=238 2024-09-14T11:28:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.957+0000 7f87a7214800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 : miss 2024-09-14T11:28:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.957+0000 7f87a7214800 20 rados->read ofs=0 len=0 2024-09-14T11:28:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.957+0000 7f87a7214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:28:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.957+0000 7f87a7214800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 info.flags=0x0 2024-09-14T11:28:59.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.957+0000 7f87a7214800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8 to cache LRU end 2024-09-14T11:28:59.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.959+0000 7f87a7214800 10 removing key index: SAYBWXTOLNBMMMSJWZFA 2024-09-14T11:28:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.960+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:SAYBWXTOLNBMMMSJWZFA, ofs0, ns] 2024-09-14T11:28:59.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.960+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94402823020912 notifier 5889 bl.length()=170 2024-09-14T11:28:59.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.962+0000 7f87a7214800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:28:59.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.963+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:28:59.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.963+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94402823023008 notifier 5889 bl.length()=182 2024-09-14T11:28:59.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.965+0000 7f87a7214800 10 removing user buckets index 2024-09-14T11:28:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.966+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:28:59.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.966+0000 7f86867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94402823031056 notifier 5889 bl.length()=173 2024-09-14T11:28:59.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.967+0000 7f87a7214800 10 removing user index: ragweed.client.0 2024-09-14T11:28:59.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.968+0000 7f87a7214800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:28:59.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.968+0000 7f87a7214800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:28:59.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.969+0000 7f8685ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94402823028368 notifier 5889 bl.length()=165 2024-09-14T11:28:59.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.972+0000 7f86597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:28:59.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.975+0000 7f87a7214800 20 remove_watcher() i=0 2024-09-14T11:28:59.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.975+0000 7f87a7214800 2 removed watcher, disabling cache 2024-09-14T11:28:59.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.976+0000 7f87a7214800 20 remove_watcher() i=1 2024-09-14T11:28:59.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.977+0000 7f87a7214800 20 remove_watcher() i=2 2024-09-14T11:28:59.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.978+0000 7f87a7214800 20 remove_watcher() i=3 2024-09-14T11:28:59.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.979+0000 7f87a7214800 20 remove_watcher() i=4 2024-09-14T11:28:59.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.980+0000 7f87a7214800 20 remove_watcher() i=5 2024-09-14T11:28:59.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.981+0000 7f87a7214800 20 remove_watcher() i=6 2024-09-14T11:28:59.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:28:59.982+0000 7f87a7214800 20 remove_watcher() i=7 2024-09-14T11:28:59.992 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:29:00.050 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:00.050 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:00.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.087+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.088+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.088+0000 7f18baf40800 20 realm 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.088+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.089+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.089+0000 7f18baf40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.089+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.089+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.089+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.090+0000 7f18baf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.090+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.090+0000 7f18baf40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:00.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.090+0000 7f18baf40800 20 searching for the correct realm 2024-09-14T11:29:00.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.093+0000 7f18b74c1640 0 -- 172.21.15.28:0/986734787 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f18a007bc20 msgr2=0x7f18a008aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:00.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.097+0000 7f18b6cc0640 0 -- 172.21.15.28:0/986734787 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f18a0095050 msgr2=0x7f18a005a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:00.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:29:00.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:00.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:00.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:29:00.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:00.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:00.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.304+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:00.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 zone default found 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 4 Realm: () 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 zonegroup default 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.305+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.306+0000 7f18baf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.306+0000 7f18baf40800 20 started sync module instance, tier type = 2024-09-14T11:29:00.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.306+0000 7f18baf40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:29:00.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=0 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=1 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=2 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=3 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=4 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=5 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.314+0000 7f18baf40800 20 add_watcher() i=6 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.315+0000 7f18baf40800 20 add_watcher() i=7 2024-09-14T11:29:00.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.315+0000 7f18baf40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:00.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.317+0000 7f176d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:00.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.317+0000 7f18baf40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:00.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.317+0000 7f18baf40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:00.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.351+0000 7f16e7fff640 20 reqs_thread_entry: start 2024-09-14T11:29:00.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.351+0000 7f18baf40800 20 init_complete bucket index max shards: 1 2024-09-14T11:29:00.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.351+0000 7f18baf40800 20 Filter name: none 2024-09-14T11:29:00.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.351+0000 7f16e5ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:00.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.351+0000 7f18baf40800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:29:00.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.351+0000 7f18baf40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:00.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.352+0000 7f18baf40800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:29:00.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.352+0000 7f18baf40800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:29:00.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.352+0000 7f18baf40800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:29:00.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.352+0000 7f18baf40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:00.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.352+0000 7f18baf40800 10 removing key index: RSLKECZAQJARAPXTXTTL 2024-09-14T11:29:00.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.353+0000 7f18baf40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:RSLKECZAQJARAPXTXTTL, ofs0, ns] 2024-09-14T11:29:00.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.354+0000 7f179a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94027684817440 notifier 5615 bl.length()=170 2024-09-14T11:29:00.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.355+0000 7f18baf40800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:29:00.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.356+0000 7f18baf40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:29:00.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.356+0000 7f179a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94027684824144 notifier 5615 bl.length()=182 2024-09-14T11:29:00.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.358+0000 7f18baf40800 10 removing user buckets index 2024-09-14T11:29:00.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.359+0000 7f18baf40800 10 removing user index: sysuser.client.0 2024-09-14T11:29:00.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.360+0000 7f18baf40800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:29:00.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.360+0000 7f18baf40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:29:00.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.360+0000 7f1799ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94027684817440 notifier 5615 bl.length()=165 2024-09-14T11:29:00.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.362+0000 7f176d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:00.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.365+0000 7f18baf40800 20 remove_watcher() i=0 2024-09-14T11:29:00.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.365+0000 7f18baf40800 2 removed watcher, disabling cache 2024-09-14T11:29:00.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.366+0000 7f18baf40800 20 remove_watcher() i=1 2024-09-14T11:29:00.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.367+0000 7f18baf40800 20 remove_watcher() i=2 2024-09-14T11:29:00.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.368+0000 7f18baf40800 20 remove_watcher() i=3 2024-09-14T11:29:00.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.369+0000 7f18baf40800 20 remove_watcher() i=4 2024-09-14T11:29:00.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.370+0000 7f18baf40800 20 remove_watcher() i=5 2024-09-14T11:29:00.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.371+0000 7f18baf40800 20 remove_watcher() i=6 2024-09-14T11:29:00.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:29:00.372+0000 7f18baf40800 20 remove_watcher() i=7 2024-09-14T11:29:00.381 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:29:00.382 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:29:00.466 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:29:00.476 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:29:00.476 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:29:00.476 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:00.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:29:00.506 INFO:teuthology.orchestra.run.smithi028.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:29:00.506 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:00.575 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:00.575 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:29:00.644 INFO:tasks.workunit:timeout=3h 2024-09-14T11:29:00.644 INFO:tasks.workunit:cleanup=True 2024-09-14T11:29:00.645 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:29:00.715 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:29:57.356 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 96% (12413/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-09-14T11:29:57.728 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:29:57.729 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:29:57.730 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:29:57.799 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:29:57.802 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:29:57.802 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:29:57.852 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:29:57.902 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:29:57.942 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:29:57.943 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:29:57.944 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:29:57.983 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:29:57.987 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:29:57.987 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:29:58.056 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:29:58.057 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:29:58.057 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:29:58.130 INFO:tasks.workunit.client.0.smithi028.stderr:+ ulimit -c 0 2024-09-14T11:29:58.130 INFO:tasks.workunit.client.0.smithi028.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:29:58.131 INFO:tasks.workunit.client.0.smithi028.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:29:58.131 INFO:tasks.workunit.client.0.smithi028.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ deactivate nondestructive 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ hash -r 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ export VIRTUAL_ENV 2024-09-14T11:30:00.495 INFO:tasks.workunit.client.0.smithi028.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:30:00.496 INFO:tasks.workunit.client.0.smithi028.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ export PATH 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -z '' ']' 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ PS1='(rgw) ' 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ export PS1 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:++ hash -r 2024-09-14T11:30:00.497 INFO:tasks.workunit.client.0.smithi028.stderr:+ pip install pip --upgrade 2024-09-14T11:30:00.735 INFO:tasks.workunit.client.0.smithi028.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:30:00.926 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting pip 2024-09-14T11:30:00.932 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:30:00.979 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: pip 2024-09-14T11:30:00.979 INFO:tasks.workunit.client.0.smithi028.stdout: Attempting uninstall: pip 2024-09-14T11:30:00.979 INFO:tasks.workunit.client.0.smithi028.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:30:01.139 INFO:tasks.workunit.client.0.smithi028.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:30:01.145 INFO:tasks.workunit.client.0.smithi028.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:30:01.922 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed pip-24.2 2024-09-14T11:30:01.970 INFO:tasks.workunit.client.0.smithi028.stderr:+ pip install boto3 2024-09-14T11:30:02.778 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting boto3 2024-09-14T11:30:02.780 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:30:03.342 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:30:03.344 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:30:03.392 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:30:03.393 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:30:03.447 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:30:03.449 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:30:03.499 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:30:03.500 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:30:03.576 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:30:03.577 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:30:03.720 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:30:03.722 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:30:03.726 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:30:03.727 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:30:03.737 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:30:03.738 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:30:03.740 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:30:03.741 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:30:03.742 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:30:03.818 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:30:04.915 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:30:05.033 INFO:tasks.workunit.client.0.smithi028.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:30:05.162 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:30:05.197 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:05.198 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:05.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.239+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 realm 2024-09-14T11:30:05.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:05.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.241+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.242+0000 7f459b11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:05.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.242+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.242+0000 7f459b11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:05.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.242+0000 7f459b11f800 20 searching for the correct realm 2024-09-14T11:30:05.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.246+0000 7f45966a1640 0 -- 172.21.15.28:0/4281219743 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5581cf4eb810 msgr2=0x5581cf4edcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:05.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.250+0000 7f4596ea2640 0 -- 172.21.15.28:0/4281219743 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f458c0b1950 msgr2=0x7f458c0b03d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:05.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.254+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:05.254 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 zone default found 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 4 Realm: () 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 zonegroup default 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.255+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.256+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.256+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.256+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.256+0000 7f459b11f800 20 started sync module instance, tier type = 2024-09-14T11:30:05.256 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.256+0000 7f459b11f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=0 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=1 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=2 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=3 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=4 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=5 2024-09-14T11:30:05.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.266+0000 7f459b11f800 20 add_watcher() i=6 2024-09-14T11:30:05.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.267+0000 7f459b11f800 20 add_watcher() i=7 2024-09-14T11:30:05.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.267+0000 7f459b11f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:05.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.268+0000 7f444d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:05.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f459b11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:05.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f459b11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:05.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f459b11f800 5 note: GC not initialized 2024-09-14T11:30:05.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f43c7fff640 20 reqs_thread_entry: start 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f459b11f800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f459b11f800 20 Filter name: none 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.269+0000 7f43c5ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T11:30:05.269 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:30:05.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:30:05.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.270+0000 7f459b11f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:30:05.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.271+0000 7f459b11f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:30:05.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.271+0000 7f459b11f800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:30:05.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.271+0000 7f459b11f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-14T11:30:05.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.272+0000 7f447a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94016017214880 notifier 5931 bl.length()=569 2024-09-14T11:30:05.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.272+0000 7f447a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:30:05.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.272+0000 7f447a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:30:05.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.274+0000 7f459b11f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:30:05.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.274+0000 7f459b11f800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:30:05.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.274+0000 7f459b11f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T11:30:05.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.274+0000 7f447a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94016017212544 notifier 5931 bl.length()=180 2024-09-14T11:30:05.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.274+0000 7f447a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:30:05.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.274+0000 7f447a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:30:05.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.277+0000 7f444d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:05.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.279+0000 7f459b11f800 20 remove_watcher() i=0 2024-09-14T11:30:05.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.279+0000 7f459b11f800 2 removed watcher, disabling cache 2024-09-14T11:30:05.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.280+0000 7f459b11f800 20 remove_watcher() i=1 2024-09-14T11:30:05.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.281+0000 7f459b11f800 20 remove_watcher() i=2 2024-09-14T11:30:05.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.283+0000 7f459b11f800 20 remove_watcher() i=3 2024-09-14T11:30:05.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.284+0000 7f459b11f800 20 remove_watcher() i=4 2024-09-14T11:30:05.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.285+0000 7f459b11f800 20 remove_watcher() i=5 2024-09-14T11:30:05.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.286+0000 7f459b11f800 20 remove_watcher() i=6 2024-09-14T11:30:05.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.287+0000 7f459b11f800 20 remove_watcher() i=7 2024-09-14T11:30:05.662 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard add 2024-09-14T11:30:05.662 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:05.663 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:30:05.693 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:05.693 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:05.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.734+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.736+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.736+0000 7fe340810800 20 realm 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.736+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.736+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.736+0000 7fe340810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.736+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.737+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.737+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.738+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:05.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.738+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.738+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:05.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.738+0000 7fe340810800 20 searching for the correct realm 2024-09-14T11:30:05.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.740+0000 7fe33bfbc640 0 -- 172.21.15.28:0/2896219374 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fe334065070 msgr2=0x7fe3340a92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:05.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.947+0000 7fe33c7bd640 0 -- 172.21.15.28:0/2896219374 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fe330042020 msgr2=0x7fe330073fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:05.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:05.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.953+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 zone default found 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 4 Realm: () 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 zonegroup default 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.954+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.955+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.955+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.955+0000 7fe340810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.955+0000 7fe340810800 20 started sync module instance, tier type = 2024-09-14T11:30:05.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.955+0000 7fe340810800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=0 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=1 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=2 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=3 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=4 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=5 2024-09-14T11:30:05.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.965+0000 7fe340810800 20 add_watcher() i=6 2024-09-14T11:30:05.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.966+0000 7fe340810800 20 add_watcher() i=7 2024-09-14T11:30:05.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.966+0000 7fe340810800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:05.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.967+0000 7fe1f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:05.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe340810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:05.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe340810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:05.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe340810800 5 note: GC not initialized 2024-09-14T11:30:05.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe1f0fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:05.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe340810800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:05.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe340810800 20 Filter name: none 2024-09-14T11:30:05.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe16a7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:05.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.968+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.969+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:05.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.969+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.970+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:05.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.970+0000 7fe340810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:05.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.970+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.971+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:05.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.971+0000 7fe340810800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.971+0000 7fe340810800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:05.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.971+0000 7fe340810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:05.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.972+0000 7fe1f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:05.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.975+0000 7fe340810800 20 remove_watcher() i=0 2024-09-14T11:30:05.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.975+0000 7fe340810800 2 removed watcher, disabling cache 2024-09-14T11:30:05.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.976+0000 7fe340810800 20 remove_watcher() i=1 2024-09-14T11:30:05.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.977+0000 7fe340810800 20 remove_watcher() i=2 2024-09-14T11:30:05.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.978+0000 7fe340810800 20 remove_watcher() i=3 2024-09-14T11:30:05.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.980+0000 7fe340810800 20 remove_watcher() i=4 2024-09-14T11:30:05.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.980+0000 7fe340810800 20 remove_watcher() i=5 2024-09-14T11:30:05.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.981+0000 7fe340810800 20 remove_watcher() i=6 2024-09-14T11:30:05.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:05.982+0000 7fe340810800 20 remove_watcher() i=7 2024-09-14T11:30:05.992 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:05.992 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:05.992 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-14T11:30:05.992 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:05.993 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-14T11:30:06.025 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:06.025 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:06.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.066+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 realm 2024-09-14T11:30:06.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:06.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.068+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.069+0000 7fdccbf3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:06.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.069+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.069+0000 7fdccbf3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:06.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.069+0000 7fdccbf3c800 20 searching for the correct realm 2024-09-14T11:30:06.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.074+0000 7fdcc8482640 0 -- 172.21.15.28:0/4069595717 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fdcb0085130 msgr2=0x7fdcb0099a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:06.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.281+0000 7fdcc7c81640 0 -- 172.21.15.28:0/4069595717 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x55c4f6693770 msgr2=0x55c4f6695b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:06.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:06.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:06.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:06.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:06.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:06.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:06.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.284+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 zone default found 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 4 Realm: () 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 zonegroup default 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.285+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.286+0000 7fdccbf3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.286+0000 7fdccbf3c800 20 started sync module instance, tier type = 2024-09-14T11:30:06.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.286+0000 7fdccbf3c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=0 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=1 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=2 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=3 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=4 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=5 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.295+0000 7fdccbf3c800 20 add_watcher() i=6 2024-09-14T11:30:06.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.296+0000 7fdccbf3c800 20 add_watcher() i=7 2024-09-14T11:30:06.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.296+0000 7fdccbf3c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:06.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.298+0000 7fdb7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:06.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 5 note: GC not initialized 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdb7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 20 Filter name: none 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdaf67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:30:06.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.299+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:06.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:06.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.300+0000 7fdccbf3c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:06.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.303+0000 7fdb7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:06.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.305+0000 7fdccbf3c800 20 remove_watcher() i=0 2024-09-14T11:30:06.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.305+0000 7fdccbf3c800 2 removed watcher, disabling cache 2024-09-14T11:30:06.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.306+0000 7fdccbf3c800 20 remove_watcher() i=1 2024-09-14T11:30:06.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.307+0000 7fdccbf3c800 20 remove_watcher() i=2 2024-09-14T11:30:06.306 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.308+0000 7fdccbf3c800 20 remove_watcher() i=3 2024-09-14T11:30:06.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.309+0000 7fdccbf3c800 20 remove_watcher() i=4 2024-09-14T11:30:06.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.310+0000 7fdccbf3c800 20 remove_watcher() i=5 2024-09-14T11:30:06.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.311+0000 7fdccbf3c800 20 remove_watcher() i=6 2024-09-14T11:30:06.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.312+0000 7fdccbf3c800 20 remove_watcher() i=7 2024-09-14T11:30:06.323 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshard list 2024-09-14T11:30:06.349 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:06.350 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:06.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.390+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 realm 2024-09-14T11:30:06.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:06.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.392+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.393+0000 7f95f3525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:06.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.393+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.394+0000 7f95f3525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:06.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.394+0000 7f95f3525800 20 searching for the correct realm 2024-09-14T11:30:06.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.397+0000 7f95efaa3640 0 -- 172.21.15.28:0/168173295 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f95d8041020 msgr2=0x7f95d806ccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:06.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.400+0000 7f95ef2a2640 0 -- 172.21.15.28:0/168173295 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f95d8077500 msgr2=0x7f95d800c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:06.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:06.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:06.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:06.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:06.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:06.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:06.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.607+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:06.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:06.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 zone default found 2024-09-14T11:30:06.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 4 Realm: () 2024-09-14T11:30:06.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:06.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:06.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:06.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 zonegroup default 2024-09-14T11:30:06.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.608+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.609+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.609+0000 7f95f3525800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.609+0000 7f95f3525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.609+0000 7f95f3525800 20 started sync module instance, tier type = 2024-09-14T11:30:06.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.609+0000 7f95f3525800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:06.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=0 2024-09-14T11:30:06.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=1 2024-09-14T11:30:06.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=2 2024-09-14T11:30:06.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=3 2024-09-14T11:30:06.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=4 2024-09-14T11:30:06.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=5 2024-09-14T11:30:06.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.619+0000 7f95f3525800 20 add_watcher() i=6 2024-09-14T11:30:06.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.620+0000 7f95f3525800 20 add_watcher() i=7 2024-09-14T11:30:06.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.620+0000 7f95f3525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:06.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.622+0000 7f94a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:06.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f95f3525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:06.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f95f3525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:06.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f95f3525800 5 note: GC not initialized 2024-09-14T11:30:06.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f94a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:06.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f95f3525800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:06.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f95f3525800 20 Filter name: none 2024-09-14T11:30:06.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.623+0000 7f941e7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:06.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.630+0000 7f94a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:06.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.633+0000 7f95f3525800 20 remove_watcher() i=0 2024-09-14T11:30:06.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.633+0000 7f95f3525800 2 removed watcher, disabling cache 2024-09-14T11:30:06.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.634+0000 7f95f3525800 20 remove_watcher() i=1 2024-09-14T11:30:06.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.635+0000 7f95f3525800 20 remove_watcher() i=2 2024-09-14T11:30:06.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.636+0000 7f95f3525800 20 remove_watcher() i=3 2024-09-14T11:30:06.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.638+0000 7f95f3525800 20 remove_watcher() i=4 2024-09-14T11:30:06.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.639+0000 7f95f3525800 20 remove_watcher() i=5 2024-09-14T11:30:06.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.640+0000 7f95f3525800 20 remove_watcher() i=6 2024-09-14T11:30:06.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.641+0000 7f95f3525800 20 remove_watcher() i=7 2024-09-14T11:30:06.650 INFO:tasks.workunit.client.0.smithi028.stderr:bucket name a-bucket 2024-09-14T11:30:06.651 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard process 2024-09-14T11:30:06.651 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:06.652 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshard process 2024-09-14T11:30:06.679 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:06.679 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:06.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.720+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.721+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.721+0000 7f5a2bb26800 20 realm 2024-09-14T11:30:06.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.721+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.722+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.722+0000 7f5a2bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:06.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.722+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.722+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.722+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.723+0000 7f5a2bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:06.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.723+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.723+0000 7f5a2bb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:06.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.723+0000 7f5a2bb26800 20 searching for the correct realm 2024-09-14T11:30:06.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.727+0000 7f5a2704a640 0 -- 172.21.15.28:0/569106731 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x564597a33890 msgr2=0x564597a35d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:06.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.731+0000 7f5a2784b640 0 -- 172.21.15.28:0/569106731 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5a1c03f040 msgr2=0x7f5a1c032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:06.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:06.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:06.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:06.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:06.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:06.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:06.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.735+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:06.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:06.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 zone default found 2024-09-14T11:30:06.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 4 Realm: () 2024-09-14T11:30:06.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:06.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:06.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:06.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 zonegroup default 2024-09-14T11:30:06.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.736+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.737+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.737+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.737+0000 7f5a2bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:06.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.737+0000 7f5a2bb26800 20 started sync module instance, tier type = 2024-09-14T11:30:06.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.737+0000 7f5a2bb26800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:06.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=0 2024-09-14T11:30:06.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=1 2024-09-14T11:30:06.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=2 2024-09-14T11:30:06.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=3 2024-09-14T11:30:06.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=4 2024-09-14T11:30:06.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=5 2024-09-14T11:30:06.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=6 2024-09-14T11:30:06.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 20 add_watcher() i=7 2024-09-14T11:30:06.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.746+0000 7f5a2bb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:06.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.748+0000 7f58ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:06.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.748+0000 7f5a2bb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:06.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.748+0000 7f5a2bb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:06.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.748+0000 7f5a2bb26800 5 note: GC not initialized 2024-09-14T11:30:06.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.749+0000 7f58dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:06.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.749+0000 7f5a2bb26800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:06.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.749+0000 7f5a2bb26800 20 Filter name: none 2024-09-14T11:30:06.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.749+0000 7f58567fc640 20 reqs_thread_entry: start 2024-09-14T11:30:06.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.749+0000 7f5a2bb26800 20 processing logshard = reshard.0000000000 2024-09-14T11:30:06.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.752+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:30:06.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.752+0000 7f5a2bb26800 20 processing logshard = reshard.0000000001 2024-09-14T11:30:06.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.755+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:30:06.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.755+0000 7f5a2bb26800 20 processing logshard = reshard.0000000002 2024-09-14T11:30:06.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.757+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:30:06.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.757+0000 7f5a2bb26800 20 processing logshard = reshard.0000000003 2024-09-14T11:30:06.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.760+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:30:06.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.760+0000 7f5a2bb26800 20 processing logshard = reshard.0000000004 2024-09-14T11:30:06.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.763+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:30:06.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.763+0000 7f5a2bb26800 20 processing logshard = reshard.0000000005 2024-09-14T11:30:06.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.765+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:30:06.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.765+0000 7f5a2bb26800 20 processing logshard = reshard.0000000006 2024-09-14T11:30:06.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.766+0000 7f5a2bb26800 20 process_entry resharding a-bucket 2024-09-14T11:30:06.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.766+0000 7f5a2bb26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:30:06.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.766+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.766+0000 7f5a2bb26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:06.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.766+0000 7f5a2bb26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:30:06.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.766+0000 7f5a2bb26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:30:06.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:30:06.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:30:06.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:06.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:06.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.767+0000 7f5a2bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:06.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f5a2bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f5a2bb26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f5a2bb26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f5a2bb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:30:06.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f59067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94856896795904 notifier 5693 bl.length()=827 2024-09-14T11:30:06.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f59067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f59067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.772+0000 7f59067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.774+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:30:06.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.774+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:30:06.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.774+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:30:06.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.774+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:30:06.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.776+0000 7f5a2bb26800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.0 2024-09-14T11:30:06.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.776+0000 7f5a2bb26800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.0 2024-09-14T11:30:06.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.776+0000 7f5a2bb26800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.1 2024-09-14T11:30:06.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.776+0000 7f5a2bb26800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.1 2024-09-14T11:30:06.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.776+0000 7f5a2bb26800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.0 2024-09-14T11:30:06.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.777+0000 7f5a2bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:06.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.777+0000 7f5a2bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:06.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.778+0000 7f5a2bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.778+0000 7f5a2bb26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.778+0000 7f5a2bb26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.778+0000 7f5a2bb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:30:06.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.779+0000 7f59067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94856896795904 notifier 5693 bl.length()=827 2024-09-14T11:30:06.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.779+0000 7f59067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.779+0000 7f59067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.779+0000 7f59067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.780+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:30:06.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.780+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:30:06.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.780+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:30:06.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.780+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:30:06.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.781+0000 7f5a2bb26800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.0 2024-09-14T11:30:06.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.782+0000 7f5a2bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:06.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.782+0000 7f5a2bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:06.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f5a2bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f5a2bb26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f5a2bb26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f5a2bb26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:30:06.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f59067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94856896795904 notifier 5693 bl.length()=795 2024-09-14T11:30:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f59067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f59067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.783+0000 7f59067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.785+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:30:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.785+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:30:06.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.785+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:30:06.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.785+0000 7f5a2bb26800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:30:06.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.786+0000 7f5a2bb26800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-14T11:30:06.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.787+0000 7f5a2bb26800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:30:06.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.789+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:30:06.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.789+0000 7f5a2bb26800 20 processing logshard = reshard.0000000007 2024-09-14T11:30:06.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.791+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:30:06.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.791+0000 7f5a2bb26800 20 processing logshard = reshard.0000000008 2024-09-14T11:30:06.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.793+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:30:06.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.793+0000 7f5a2bb26800 20 processing logshard = reshard.0000000009 2024-09-14T11:30:06.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.795+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:30:06.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.795+0000 7f5a2bb26800 20 processing logshard = reshard.0000000010 2024-09-14T11:30:06.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.798+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:30:06.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.798+0000 7f5a2bb26800 20 processing logshard = reshard.0000000011 2024-09-14T11:30:06.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.801+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:30:06.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.801+0000 7f5a2bb26800 20 processing logshard = reshard.0000000012 2024-09-14T11:30:06.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.803+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:30:06.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.803+0000 7f5a2bb26800 20 processing logshard = reshard.0000000013 2024-09-14T11:30:06.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.806+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:30:06.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.806+0000 7f5a2bb26800 20 processing logshard = reshard.0000000014 2024-09-14T11:30:06.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.808+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:30:06.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.808+0000 7f5a2bb26800 20 processing logshard = reshard.0000000015 2024-09-14T11:30:06.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.811+0000 7f5a2bb26800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:30:06.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.812+0000 7f58ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:06.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.815+0000 7f5a2bb26800 20 remove_watcher() i=0 2024-09-14T11:30:06.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.815+0000 7f5a2bb26800 2 removed watcher, disabling cache 2024-09-14T11:30:06.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.816+0000 7f5a2bb26800 20 remove_watcher() i=1 2024-09-14T11:30:06.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.817+0000 7f5a2bb26800 20 remove_watcher() i=2 2024-09-14T11:30:06.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.818+0000 7f5a2bb26800 20 remove_watcher() i=3 2024-09-14T11:30:06.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.819+0000 7f5a2bb26800 20 remove_watcher() i=4 2024-09-14T11:30:06.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.820+0000 7f5a2bb26800 20 remove_watcher() i=5 2024-09-14T11:30:06.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.821+0000 7f5a2bb26800 20 remove_watcher() i=6 2024-09-14T11:30:06.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:06.822+0000 7f5a2bb26800 20 remove_watcher() i=7 2024-09-14T11:30:11.839 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:30:11.874 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:11.874 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:11.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.923+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.925+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.925+0000 7fd6ab923800 20 realm 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.925+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.925+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.925+0000 7fd6ab923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.925+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:11.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.926+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:11.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.926+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:11.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.927+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:11.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.927+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:11.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.927+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:11.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.927+0000 7fd6ab923800 20 searching for the correct realm 2024-09-14T11:30:11.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:11.930+0000 7fd69ee0b640 0 -- 172.21.15.28:0/1774346429 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fd6980433e0 msgr2=0x7fd698043840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:12.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.138+0000 7fd6a760c640 0 -- 172.21.15.28:0/1774346429 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fd6900bae50 msgr2=0x7fd6900ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:12.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:12.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:12.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.346+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 20 zone default found 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 4 Realm: () 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 20 zonegroup default 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.347+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 started sync module instance, tier type = 2024-09-14T11:30:12.347 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.348+0000 7fd6ab923800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:12.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=0 2024-09-14T11:30:12.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=1 2024-09-14T11:30:12.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=2 2024-09-14T11:30:12.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=3 2024-09-14T11:30:12.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=4 2024-09-14T11:30:12.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=5 2024-09-14T11:30:12.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.360+0000 7fd6ab923800 20 add_watcher() i=6 2024-09-14T11:30:12.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.361+0000 7fd6ab923800 20 add_watcher() i=7 2024-09-14T11:30:12.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.361+0000 7fd6ab923800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:12.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.363+0000 7fd55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:12.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.364+0000 7fd6ab923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:12.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.364+0000 7fd6ab923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:12.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.364+0000 7fd6ab923800 5 note: GC not initialized 2024-09-14T11:30:12.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.364+0000 7fd55cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:12.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.364+0000 7fd6ab923800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:12.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.364+0000 7fd6ab923800 20 Filter name: none 2024-09-14T11:30:12.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.365+0000 7fd4d67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:12.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.365+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.365+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:12.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.365+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.366+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:12.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.366+0000 7fd6ab923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:12.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.366+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.366+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:12.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.366+0000 7fd6ab923800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.367+0000 7fd6ab923800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:12.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.367+0000 7fd6ab923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:12.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.369+0000 7fd55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:12.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.372+0000 7fd6ab923800 20 remove_watcher() i=0 2024-09-14T11:30:12.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.372+0000 7fd6ab923800 2 removed watcher, disabling cache 2024-09-14T11:30:12.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.374+0000 7fd6ab923800 20 remove_watcher() i=1 2024-09-14T11:30:12.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.375+0000 7fd6ab923800 20 remove_watcher() i=2 2024-09-14T11:30:12.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.376+0000 7fd6ab923800 20 remove_watcher() i=3 2024-09-14T11:30:12.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.378+0000 7fd6ab923800 20 remove_watcher() i=4 2024-09-14T11:30:12.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.379+0000 7fd6ab923800 20 remove_watcher() i=5 2024-09-14T11:30:12.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.380+0000 7fd6ab923800 20 remove_watcher() i=6 2024-09-14T11:30:12.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.381+0000 7fd6ab923800 20 remove_watcher() i=7 2024-09-14T11:30:12.394 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:12.394 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:12.394 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-14T11:30:12.394 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:12.394 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard add non empty bucket 2024-09-14T11:30:12.394 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:12.721 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:30:12.750 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:12.750 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:12.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.791+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.792+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.792+0000 7f06c9614800 20 realm 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.792+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.793+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.793+0000 7f06c9614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.793+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.793+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.793+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.794+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:12.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.794+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.794+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:12.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.794+0000 7f06c9614800 20 searching for the correct realm 2024-09-14T11:30:12.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.797+0000 7f06c44ca640 0 -- 172.21.15.28:0/1389724310 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x564243c674d0 msgr2=0x564243c698c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:12.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.801+0000 7f06c4ccb640 0 -- 172.21.15.28:0/1389724310 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f06b80ce9c0 msgr2=0x7f06b80e59e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:12.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.805+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 zone default found 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 4 Realm: () 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 zonegroup default 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.806+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.807+0000 7f06c9614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.807+0000 7f06c9614800 20 started sync module instance, tier type = 2024-09-14T11:30:12.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.807+0000 7f06c9614800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:12.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=0 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=1 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=2 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=3 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=4 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=5 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.815+0000 7f06c9614800 20 add_watcher() i=6 2024-09-14T11:30:12.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.816+0000 7f06c9614800 20 add_watcher() i=7 2024-09-14T11:30:12.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.816+0000 7f06c9614800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:12.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.817+0000 7f057afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:12.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f06c9614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:12.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f06c9614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:12.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f06c9614800 5 note: GC not initialized 2024-09-14T11:30:12.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f0579fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:12.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f06c9614800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:12.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f06c9614800 20 Filter name: none 2024-09-14T11:30:12.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f04eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:12.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.818+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.819+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.819+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.819+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.819+0000 7f06c9614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.819+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.820+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:12.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.820+0000 7f06c9614800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.820+0000 7f06c9614800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:12.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.820+0000 7f06c9614800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:12.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.821+0000 7f057afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:12.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.823+0000 7f06c9614800 20 remove_watcher() i=0 2024-09-14T11:30:12.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.823+0000 7f06c9614800 2 removed watcher, disabling cache 2024-09-14T11:30:12.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.824+0000 7f06c9614800 20 remove_watcher() i=1 2024-09-14T11:30:12.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.825+0000 7f06c9614800 20 remove_watcher() i=2 2024-09-14T11:30:12.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.826+0000 7f06c9614800 20 remove_watcher() i=3 2024-09-14T11:30:12.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.827+0000 7f06c9614800 20 remove_watcher() i=4 2024-09-14T11:30:12.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.828+0000 7f06c9614800 20 remove_watcher() i=5 2024-09-14T11:30:12.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.829+0000 7f06c9614800 20 remove_watcher() i=6 2024-09-14T11:30:12.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.830+0000 7f06c9614800 20 remove_watcher() i=7 2024-09-14T11:30:12.840 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:12.840 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:12.840 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-14T11:30:12.840 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:12.841 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-14T11:30:12.873 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:12.873 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:12.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.916+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 realm 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.918+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.919+0000 7f038a932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:12.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.919+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.919+0000 7f038a932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:12.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.919+0000 7f038a932800 20 searching for the correct realm 2024-09-14T11:30:12.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.923+0000 7f0386dbd640 0 -- 172.21.15.28:0/2462755015 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55c5396a3590 msgr2=0x55c5396a59b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:12.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.926+0000 7f0385dbb640 0 -- 172.21.15.28:0/2462755015 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f03780d1040 msgr2=0x7f03780add40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:12.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.930+0000 7f038a932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 zone default found 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 4 Realm: () 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 zonegroup default 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.931+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.932+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.932+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.932+0000 7f038a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:12.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.932+0000 7f038a932800 20 started sync module instance, tier type = 2024-09-14T11:30:12.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.932+0000 7f038a932800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:12.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=0 2024-09-14T11:30:12.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=1 2024-09-14T11:30:12.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=2 2024-09-14T11:30:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=3 2024-09-14T11:30:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=4 2024-09-14T11:30:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=5 2024-09-14T11:30:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.940+0000 7f038a932800 20 add_watcher() i=6 2024-09-14T11:30:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.941+0000 7f038a932800 20 add_watcher() i=7 2024-09-14T11:30:12.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.941+0000 7f038a932800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.943+0000 7f023cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.943+0000 7f038a932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.943+0000 7f038a932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.943+0000 7f038a932800 5 note: GC not initialized 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.943+0000 7f01b77fe640 20 reqs_thread_entry: start 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.943+0000 7f038a932800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 20 Filter name: none 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f01b57fa640 20 reqs_thread_entry: start 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:30:12.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:12.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:30:12.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.944+0000 7f038a932800 20 rados->read ofs=0 len=0 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.945+0000 7f038a932800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.945+0000 7f038a932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.945+0000 7f038a932800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.945+0000 7f038a932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.945+0000 7f038a932800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:12.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.945+0000 7f038a932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:12.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.947+0000 7f023cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:12.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.949+0000 7f038a932800 20 remove_watcher() i=0 2024-09-14T11:30:12.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.949+0000 7f038a932800 2 removed watcher, disabling cache 2024-09-14T11:30:12.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.950+0000 7f038a932800 20 remove_watcher() i=1 2024-09-14T11:30:12.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.951+0000 7f038a932800 20 remove_watcher() i=2 2024-09-14T11:30:12.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.952+0000 7f038a932800 20 remove_watcher() i=3 2024-09-14T11:30:12.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.953+0000 7f038a932800 20 remove_watcher() i=4 2024-09-14T11:30:12.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.954+0000 7f038a932800 20 remove_watcher() i=5 2024-09-14T11:30:12.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.955+0000 7f038a932800 20 remove_watcher() i=6 2024-09-14T11:30:12.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:12.956+0000 7f038a932800 20 remove_watcher() i=7 2024-09-14T11:30:12.967 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshard list 2024-09-14T11:30:12.994 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:12.994 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:13.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.035+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 realm 2024-09-14T11:30:13.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:13.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.037+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.038+0000 7f624c325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:13.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.038+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.038+0000 7f624c325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:13.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.038+0000 7f624c325800 20 searching for the correct realm 2024-09-14T11:30:13.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.041+0000 7f6247732640 0 -- 172.21.15.28:0/3426693295 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f6238046030 msgr2=0x7f6238074f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:13.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.044+0000 7f6247f33640 0 -- 172.21.15.28:0/3426693295 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f623c0983f0 msgr2=0x7f623c098870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:13.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:13.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:13.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:13.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:13.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 zone default found 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 4 Realm: () 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:13.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 zonegroup default 2024-09-14T11:30:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.251+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.252 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 started sync module instance, tier type = 2024-09-14T11:30:13.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.252+0000 7f624c325800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=0 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=1 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=2 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=3 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=4 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=5 2024-09-14T11:30:13.260 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=6 2024-09-14T11:30:13.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 20 add_watcher() i=7 2024-09-14T11:30:13.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.262+0000 7f624c325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.264+0000 7f60fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.264+0000 7f624c325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.264+0000 7f624c325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.265+0000 7f624c325800 5 note: GC not initialized 2024-09-14T11:30:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.265+0000 7f60fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:13.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.265+0000 7f624c325800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:13.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.265+0000 7f624c325800 20 Filter name: none 2024-09-14T11:30:13.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.265+0000 7f60767fc640 20 reqs_thread_entry: start 2024-09-14T11:30:13.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.272+0000 7f60fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:13.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.274+0000 7f624c325800 20 remove_watcher() i=0 2024-09-14T11:30:13.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.274+0000 7f624c325800 2 removed watcher, disabling cache 2024-09-14T11:30:13.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.275+0000 7f624c325800 20 remove_watcher() i=1 2024-09-14T11:30:13.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.276+0000 7f624c325800 20 remove_watcher() i=2 2024-09-14T11:30:13.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.278+0000 7f624c325800 20 remove_watcher() i=3 2024-09-14T11:30:13.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.279+0000 7f624c325800 20 remove_watcher() i=4 2024-09-14T11:30:13.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.280+0000 7f624c325800 20 remove_watcher() i=5 2024-09-14T11:30:13.279 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.281+0000 7f624c325800 20 remove_watcher() i=6 2024-09-14T11:30:13.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.282+0000 7f624c325800 20 remove_watcher() i=7 2024-09-14T11:30:13.291 INFO:tasks.workunit.client.0.smithi028.stderr:bucket name a-bucket 2024-09-14T11:30:13.291 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard process non empty bucket 2024-09-14T11:30:13.291 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:13.293 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshard process 2024-09-14T11:30:13.320 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:13.320 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:13.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.360+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 realm 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.362+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.363+0000 7fa4daa1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:13.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.363+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.363+0000 7fa4daa1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:13.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.363+0000 7fa4daa1d800 20 searching for the correct realm 2024-09-14T11:30:13.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.367+0000 7fa4d59ea640 0 -- 172.21.15.28:0/1428654679 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fa4c80bac80 msgr2=0x7fa4c80a5d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:13.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.370+0000 7fa4d69ec640 0 -- 172.21.15.28:0/1428654679 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fa4cc04c410 msgr2=0x7fa4cc04c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:13.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.374+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 zone default found 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 4 Realm: () 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 zonegroup default 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 started sync module instance, tier type = 2024-09-14T11:30:13.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.375+0000 7fa4daa1d800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=0 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=1 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=2 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=3 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=4 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=5 2024-09-14T11:30:13.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.384+0000 7fa4daa1d800 20 add_watcher() i=6 2024-09-14T11:30:13.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.385+0000 7fa4daa1d800 20 add_watcher() i=7 2024-09-14T11:30:13.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.385+0000 7fa4daa1d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:13.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.386+0000 7fa38cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:13.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa4daa1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:13.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa4daa1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:13.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa4daa1d800 5 note: GC not initialized 2024-09-14T11:30:13.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa3077fe640 20 reqs_thread_entry: start 2024-09-14T11:30:13.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa4daa1d800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:13.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa4daa1d800 20 Filter name: none 2024-09-14T11:30:13.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa3057fa640 20 reqs_thread_entry: start 2024-09-14T11:30:13.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.387+0000 7fa4daa1d800 20 processing logshard = reshard.0000000000 2024-09-14T11:30:13.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.389+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:30:13.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.389+0000 7fa4daa1d800 20 processing logshard = reshard.0000000001 2024-09-14T11:30:13.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.391+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:30:13.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.391+0000 7fa4daa1d800 20 processing logshard = reshard.0000000002 2024-09-14T11:30:13.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.394+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:30:13.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.394+0000 7fa4daa1d800 20 processing logshard = reshard.0000000003 2024-09-14T11:30:13.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.396+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:30:13.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.396+0000 7fa4daa1d800 20 processing logshard = reshard.0000000004 2024-09-14T11:30:13.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.398+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:30:13.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.398+0000 7fa4daa1d800 20 processing logshard = reshard.0000000005 2024-09-14T11:30:13.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.401+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:30:13.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.401+0000 7fa4daa1d800 20 processing logshard = reshard.0000000006 2024-09-14T11:30:13.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 20 process_entry resharding a-bucket 2024-09-14T11:30:13.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:30:13.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.402+0000 7fa4daa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.403+0000 7fa4daa1d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.403+0000 7fa4daa1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.403+0000 7fa4daa1d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.403+0000 7fa4daa1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:13.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.403+0000 7fa4daa1d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.403+0000 7fa4daa1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:13.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.408+0000 7fa4daa1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.408+0000 7fa4daa1d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.408+0000 7fa4daa1d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.408+0000 7fa4daa1d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:30:13.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.409+0000 7fa3b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94404921264432 notifier 5777 bl.length()=827 2024-09-14T11:30:13.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.409+0000 7fa3b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.409+0000 7fa3b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.409+0000 7fa3b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.410+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:30:13.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.410+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:30:13.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.410+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:30:13.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.410+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:30:13.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.0 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.412+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.0 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.413+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.1 2024-09-14T11:30:13.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.413+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.1 2024-09-14T11:30:13.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.415+0000 7fa4daa1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:13.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.415+0000 7fa4daa1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa4daa1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa4daa1d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa4daa1d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa4daa1d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa3b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94404921264432 notifier 5777 bl.length()=827 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa3b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa3b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.416+0000 7fa3b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.418+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:30:13.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.418+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:30:13.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.418+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:30:13.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.418+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:30:13.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.419+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.0 2024-09-14T11:30:13.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.419+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.0 2024-09-14T11:30:13.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.419+0000 7fa4daa1d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.1 2024-09-14T11:30:13.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.419+0000 7fa4daa1d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.1.1 2024-09-14T11:30:13.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.419+0000 7fa4daa1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:13.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.419+0000 7fa4daa1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.420+0000 7fa4daa1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.420+0000 7fa4daa1d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.420+0000 7fa4daa1d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.420+0000 7fa4daa1d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.421+0000 7fa3b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94404921264432 notifier 5777 bl.length()=795 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.421+0000 7fa3b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.421+0000 7fa3b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:30:13.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.421+0000 7fa3b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:30:13.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.423+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:30:13.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.423+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:30:13.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.423+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:30:13.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.423+0000 7fa4daa1d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:30:13.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.424+0000 7fa4daa1d800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-14T11:30:13.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.425+0000 7fa4daa1d800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:30:13.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.427+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:30:13.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.427+0000 7fa4daa1d800 20 processing logshard = reshard.0000000007 2024-09-14T11:30:13.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.429+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:30:13.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.429+0000 7fa4daa1d800 20 processing logshard = reshard.0000000008 2024-09-14T11:30:13.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.431+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:30:13.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.431+0000 7fa4daa1d800 20 processing logshard = reshard.0000000009 2024-09-14T11:30:13.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.434+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:30:13.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.434+0000 7fa4daa1d800 20 processing logshard = reshard.0000000010 2024-09-14T11:30:13.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.436+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:30:13.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.436+0000 7fa4daa1d800 20 processing logshard = reshard.0000000011 2024-09-14T11:30:13.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.438+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:30:13.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.438+0000 7fa4daa1d800 20 processing logshard = reshard.0000000012 2024-09-14T11:30:13.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.441+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:30:13.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.441+0000 7fa4daa1d800 20 processing logshard = reshard.0000000013 2024-09-14T11:30:13.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.443+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:30:13.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.443+0000 7fa4daa1d800 20 processing logshard = reshard.0000000014 2024-09-14T11:30:13.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.446+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:30:13.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.446+0000 7fa4daa1d800 20 processing logshard = reshard.0000000015 2024-09-14T11:30:13.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.448+0000 7fa4daa1d800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:30:13.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.449+0000 7fa38cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:13.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.451+0000 7fa4daa1d800 20 remove_watcher() i=0 2024-09-14T11:30:13.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.451+0000 7fa4daa1d800 2 removed watcher, disabling cache 2024-09-14T11:30:13.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.452+0000 7fa4daa1d800 20 remove_watcher() i=1 2024-09-14T11:30:13.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.453+0000 7fa4daa1d800 20 remove_watcher() i=2 2024-09-14T11:30:13.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.454+0000 7fa4daa1d800 20 remove_watcher() i=3 2024-09-14T11:30:13.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.455+0000 7fa4daa1d800 20 remove_watcher() i=4 2024-09-14T11:30:13.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.456+0000 7fa4daa1d800 20 remove_watcher() i=5 2024-09-14T11:30:13.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.457+0000 7fa4daa1d800 20 remove_watcher() i=6 2024-09-14T11:30:13.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.458+0000 7fa4daa1d800 20 remove_watcher() i=7 2024-09-14T11:30:13.469 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:30:13.498 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:13.498 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.541+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 realm 2024-09-14T11:30:13.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:13.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.542+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.543+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:13.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.543+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.543+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:13.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.543+0000 7f924652c800 20 searching for the correct realm 2024-09-14T11:30:13.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.545+0000 7f924224f640 0 -- 172.21.15.28:0/567716137 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f923c020040 msgr2=0x7f923c085590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:13.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.750+0000 7f9242a50640 0 -- 172.21.15.28:0/567716137 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f92380ae350 msgr2=0x7f92380bf130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:13.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:13.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:13.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:13.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:13.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:13.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.756+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 zone default found 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 4 Realm: () 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 zonegroup default 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.757+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.758+0000 7f924652c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:13.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.758+0000 7f924652c800 20 started sync module instance, tier type = 2024-09-14T11:30:13.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.758+0000 7f924652c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=0 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=1 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=2 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=3 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=4 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=5 2024-09-14T11:30:13.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.767+0000 7f924652c800 20 add_watcher() i=6 2024-09-14T11:30:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.768+0000 7f924652c800 20 add_watcher() i=7 2024-09-14T11:30:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.768+0000 7f924652c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.769+0000 7f90f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f924652c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f924652c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f924652c800 5 note: GC not initialized 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f90737fe640 20 reqs_thread_entry: start 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f924652c800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f924652c800 20 Filter name: none 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f90717fa640 20 reqs_thread_entry: start 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.770+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.771+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.771+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.771+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.771+0000 7f924652c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.771+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.772+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:30:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.772+0000 7f924652c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:13.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.772+0000 7f924652c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:30:13.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.772+0000 7f924652c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:13.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.774+0000 7f90f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:13.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.776+0000 7f924652c800 20 remove_watcher() i=0 2024-09-14T11:30:13.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.776+0000 7f924652c800 2 removed watcher, disabling cache 2024-09-14T11:30:13.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.777+0000 7f924652c800 20 remove_watcher() i=1 2024-09-14T11:30:13.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.778+0000 7f924652c800 20 remove_watcher() i=2 2024-09-14T11:30:13.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.779+0000 7f924652c800 20 remove_watcher() i=3 2024-09-14T11:30:13.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.780+0000 7f924652c800 20 remove_watcher() i=4 2024-09-14T11:30:13.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.781+0000 7f924652c800 20 remove_watcher() i=5 2024-09-14T11:30:13.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.782+0000 7f924652c800 20 remove_watcher() i=6 2024-09-14T11:30:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:13.782+0000 7f924652c800 20 remove_watcher() i=7 2024-09-14T11:30:13.792 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:13.792 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:13.792 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-14T11:30:13.792 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:13.792 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:30:13.792 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:14.657 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:30:14.687 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:14.687 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:14.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.728+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.730+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.730+0000 7f190f016800 20 realm 2024-09-14T11:30:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.730+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.731+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.731+0000 7f190f016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:14.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.731+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.731+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.731+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.732+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:14.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.732+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.732+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:14.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.732+0000 7f190f016800 20 searching for the correct realm 2024-09-14T11:30:14.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.735+0000 7f1909fe6640 0 -- 172.21.15.28:0/1267994105 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f18fc06d3d0 msgr2=0x7f18fc0618a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:14.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.739+0000 7f190a7e7640 0 -- 172.21.15.28:0/1267994105 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f19000a4910 msgr2=0x7f19000873f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:14.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:14.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:14.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:14.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:14.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 zone default found 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 4 Realm: () 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 zonegroup default 2024-09-14T11:30:14.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.945+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 started sync module instance, tier type = 2024-09-14T11:30:14.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.946+0000 7f190f016800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=0 2024-09-14T11:30:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=1 2024-09-14T11:30:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=2 2024-09-14T11:30:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=3 2024-09-14T11:30:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=4 2024-09-14T11:30:14.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=5 2024-09-14T11:30:14.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.955+0000 7f190f016800 20 add_watcher() i=6 2024-09-14T11:30:14.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.956+0000 7f190f016800 20 add_watcher() i=7 2024-09-14T11:30:14.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.956+0000 7f190f016800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:14.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.958+0000 7f17c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f190f016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f190f016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f190f016800 5 note: GC not initialized 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f173b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f190f016800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f190f016800 20 Filter name: none 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f17397fa640 20 reqs_thread_entry: start 2024-09-14T11:30:14.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.959+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.960+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:14.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.960+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.961+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:14.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.961+0000 7f190f016800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:14.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.961+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.961+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:14.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.961+0000 7f190f016800 20 rados->read ofs=0 len=0 2024-09-14T11:30:14.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.962+0000 7f190f016800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:14.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.962+0000 7f190f016800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:14.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.963+0000 7f17c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:14.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.966+0000 7f190f016800 20 remove_watcher() i=0 2024-09-14T11:30:14.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.966+0000 7f190f016800 2 removed watcher, disabling cache 2024-09-14T11:30:14.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.967+0000 7f190f016800 20 remove_watcher() i=1 2024-09-14T11:30:14.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.968+0000 7f190f016800 20 remove_watcher() i=2 2024-09-14T11:30:14.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.969+0000 7f190f016800 20 remove_watcher() i=3 2024-09-14T11:30:14.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.970+0000 7f190f016800 20 remove_watcher() i=4 2024-09-14T11:30:14.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.971+0000 7f190f016800 20 remove_watcher() i=5 2024-09-14T11:30:14.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.972+0000 7f190f016800 20 remove_watcher() i=6 2024-09-14T11:30:14.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:14.973+0000 7f190f016800 20 remove_watcher() i=7 2024-09-14T11:30:14.982 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-init-index id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:14.982 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:14.984 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:30:15.018 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:15.018 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.059+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 realm 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.061+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.062+0000 7f26c9539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:15.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.062+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.062+0000 7f26c9539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:15.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.062+0000 7f26c9539800 20 searching for the correct realm 2024-09-14T11:30:15.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.065+0000 7f26c49c6640 0 -- 172.21.15.28:0/2171646733 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f26b80513f0 msgr2=0x7f26b8051870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.069+0000 7f26c51c7640 0 -- 172.21.15.28:0/2171646733 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f26bc0db900 msgr2=0x7f26bc0a3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:15.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:15.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:15.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:15.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:15.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.275+0000 7f26c9539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 zone default found 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 4 Realm: () 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:15.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 zonegroup default 2024-09-14T11:30:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.276+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.277+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.276 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.277+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.277+0000 7f26c9539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.277+0000 7f26c9539800 20 started sync module instance, tier type = 2024-09-14T11:30:15.277 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.277+0000 7f26c9539800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:15.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=0 2024-09-14T11:30:15.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=1 2024-09-14T11:30:15.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=2 2024-09-14T11:30:15.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=3 2024-09-14T11:30:15.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=4 2024-09-14T11:30:15.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=5 2024-09-14T11:30:15.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.286+0000 7f26c9539800 20 add_watcher() i=6 2024-09-14T11:30:15.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.287+0000 7f26c9539800 20 add_watcher() i=7 2024-09-14T11:30:15.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.287+0000 7f26c9539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:15.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f257bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:15.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f26c9539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:15.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f26c9539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:15.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f26c9539800 5 note: GC not initialized 2024-09-14T11:30:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f257afe5640 20 reqs_thread_entry: start 2024-09-14T11:30:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f26c9539800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.289+0000 7f26c9539800 20 Filter name: none 2024-09-14T11:30:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f2578fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:30:15.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:15.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:30:15.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 : miss 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.290+0000 7f26c9539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.291+0000 7f26c9539800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.291+0000 7f26c9539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.291+0000 7f26c9539800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.291+0000 7f26c9539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.291+0000 7f26c9539800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.291+0000 7f26c9539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 2024-09-14T11:30:15.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.292+0000 7f26c9539800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:30:15.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.292+0000 7f26c9539800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:30:15.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.294+0000 7f257bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:15.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.296+0000 7f26c9539800 20 remove_watcher() i=0 2024-09-14T11:30:15.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.296+0000 7f26c9539800 2 removed watcher, disabling cache 2024-09-14T11:30:15.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.297+0000 7f26c9539800 20 remove_watcher() i=1 2024-09-14T11:30:15.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.298+0000 7f26c9539800 20 remove_watcher() i=2 2024-09-14T11:30:15.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.299+0000 7f26c9539800 20 remove_watcher() i=3 2024-09-14T11:30:15.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.300+0000 7f26c9539800 20 remove_watcher() i=4 2024-09-14T11:30:15.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.301+0000 7f26c9539800 20 remove_watcher() i=5 2024-09-14T11:30:15.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.302+0000 7f26c9539800 20 remove_watcher() i=6 2024-09-14T11:30:15.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.303+0000 7f26c9539800 20 remove_watcher() i=7 2024-09-14T11:30:15.313 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:30:15.343 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:15.343 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:15.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.384+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.385+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.385+0000 7fa53e413800 20 realm 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.385+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.386+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.386+0000 7fa53e413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.386+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.386+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.386+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.387+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:15.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.387+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.387+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:15.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.387+0000 7fa53e413800 20 searching for the correct realm 2024-09-14T11:30:15.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.390+0000 7fa539347640 0 -- 172.21.15.28:0/1444392930 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fa52c07c040 msgr2=0x7fa52c08ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:15.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.393+0000 7fa539b48640 0 -- 172.21.15.28:0/1444392930 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fa5300b4040 msgr2=0x7fa5300b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:15.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:15.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.600+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 zone default found 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 4 Realm: () 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 zonegroup default 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.601+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.602+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.602+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.602+0000 7fa53e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.602+0000 7fa53e413800 20 started sync module instance, tier type = 2024-09-14T11:30:15.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.602+0000 7fa53e413800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:15.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=0 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=1 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=2 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=3 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=4 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=5 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.611+0000 7fa53e413800 20 add_watcher() i=6 2024-09-14T11:30:15.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.612+0000 7fa53e413800 20 add_watcher() i=7 2024-09-14T11:30:15.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.612+0000 7fa53e413800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:15.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.614+0000 7fa3eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:15.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.614+0000 7fa53e413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:15.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.614+0000 7fa53e413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:15.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa53e413800 5 note: GC not initialized 2024-09-14T11:30:15.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa3ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:15.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa53e413800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:15.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa53e413800 20 Filter name: none 2024-09-14T11:30:15.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa35bfff640 20 reqs_thread_entry: start 2024-09-14T11:30:15.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.615+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.616+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.616+0000 7fa53e413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.616+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.616+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.616+0000 7fa53e413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.617+0000 7fa53e413800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:15.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.617+0000 7fa53e413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:15.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.618+0000 7fa3eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:15.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.620+0000 7fa53e413800 20 remove_watcher() i=0 2024-09-14T11:30:15.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.620+0000 7fa53e413800 2 removed watcher, disabling cache 2024-09-14T11:30:15.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.621+0000 7fa53e413800 20 remove_watcher() i=1 2024-09-14T11:30:15.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.622+0000 7fa53e413800 20 remove_watcher() i=2 2024-09-14T11:30:15.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.624+0000 7fa53e413800 20 remove_watcher() i=3 2024-09-14T11:30:15.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.625+0000 7fa53e413800 20 remove_watcher() i=4 2024-09-14T11:30:15.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.626+0000 7fa53e413800 20 remove_watcher() i=5 2024-09-14T11:30:15.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.627+0000 7fa53e413800 20 remove_watcher() i=6 2024-09-14T11:30:15.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.628+0000 7fa53e413800 20 remove_watcher() i=7 2024-09-14T11:30:15.638 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:15.638 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:15.638 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-init-index id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:15.638 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:15.732 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:15.765 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:15.765 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:15.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.806+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.807+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.807+0000 7f2f9871f800 20 realm 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.807+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.807+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.807+0000 7f2f9871f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.807+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.808+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:15.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.808+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.808+0000 7f2f9871f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:15.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.808+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:15.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.809+0000 7f2f9871f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:15.807 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.809+0000 7f2f9871f800 20 searching for the correct realm 2024-09-14T11:30:15.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.812+0000 7f2f94ca3640 0 -- 172.21.15.28:0/2950950826 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f2f7c01f030 msgr2=0x7f2f7c02c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:15.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:15.815+0000 7f2f944a2640 0 -- 172.21.15.28:0/2950950826 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f2f7c02c410 msgr2=0x7f2f7c02c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.021+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:16.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 zone default found 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 4 Realm: () 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 zonegroup default 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.022+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.023+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.023+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.023+0000 7f2f9871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.023+0000 7f2f9871f800 20 started sync module instance, tier type = 2024-09-14T11:30:16.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.023+0000 7f2f9871f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=0 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=1 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=2 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=3 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=4 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=5 2024-09-14T11:30:16.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.032+0000 7f2f9871f800 20 add_watcher() i=6 2024-09-14T11:30:16.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.033+0000 7f2f9871f800 20 add_watcher() i=7 2024-09-14T11:30:16.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.033+0000 7f2f9871f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:16.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.034+0000 7f2e4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:16.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:16.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 5 note: GC not initialized 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2e497e2640 20 reqs_thread_entry: start 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 20 Filter name: none 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2dbaffd640 20 reqs_thread_entry: start 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:30:16.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.035+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.036+0000 7f2f9871f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.036+0000 7f2f9871f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.036+0000 7f2f9871f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.036+0000 7f2f9871f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 : miss 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.036+0000 7f2f9871f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.037+0000 7f2f9871f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.037+0000 7f2f9871f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.037+0000 7f2f9871f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.037+0000 7f2f9871f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:16.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.037+0000 7f2f9871f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.037+0000 7f2f9871f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 2024-09-14T11:30:16.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.040+0000 7f2f9871f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.040+0000 7f2f9871f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.040+0000 7f2f9871f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.040+0000 7f2f9871f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19, ofs0, ns] 2024-09-14T11:30:16.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.041+0000 7f2e6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 93861345164128 notifier 6192 bl.length()=911 2024-09-14T11:30:16.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.041+0000 7f2e6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.041+0000 7f2e6b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.041+0000 7f2e6b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.043+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): orig_sources= new_sources= 2024-09-14T11:30:16.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.043+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): potential sources added=[] removed=[] 2024-09-14T11:30:16.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.043+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): orig_dests= new_dests= 2024-09-14T11:30:16.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.043+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): potential dests added=[] removed=[] 2024-09-14T11:30:16.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.046+0000 7f2f9871f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19.1.0 2024-09-14T11:30:16.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.046+0000 7f2f9871f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19.1.0 2024-09-14T11:30:16.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.046+0000 7f2f9871f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19.1.1 2024-09-14T11:30:16.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.046+0000 7f2f9871f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19.1.1 2024-09-14T11:30:16.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.046+0000 7f2f9871f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19.0 2024-09-14T11:30:16.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.048+0000 7f2f9871f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:16.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.048+0000 7f2f9871f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 2024-09-14T11:30:16.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2f9871f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2f9871f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2f9871f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2f9871f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19, ofs0, ns] 2024-09-14T11:30:16.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2e6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 93861345164128 notifier 6192 bl.length()=911 2024-09-14T11:30:16.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2e6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2e6b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.049+0000 7f2e6b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.051+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): orig_sources= new_sources= 2024-09-14T11:30:16.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.051+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): potential sources added=[] removed=[] 2024-09-14T11:30:16.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.051+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): orig_dests= new_dests= 2024-09-14T11:30:16.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.051+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): potential dests added=[] removed=[] 2024-09-14T11:30:16.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.052+0000 7f2f9871f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19.0 2024-09-14T11:30:16.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.052+0000 7f2f9871f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:16.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.052+0000 7f2f9871f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2f9871f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2f9871f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2f9871f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2f9871f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19, ofs0, ns] 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2e6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 93861345164128 notifier 6192 bl.length()=879 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2e6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 info.flags=0x17 2024-09-14T11:30:16.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2e6b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 to cache LRU end 2024-09-14T11:30:16.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.054+0000 7f2e6b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:16.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.056+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): orig_sources= new_sources= 2024-09-14T11:30:16.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.056+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): potential sources added=[] removed=[] 2024-09-14T11:30:16.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.056+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): orig_dests= new_dests= 2024-09-14T11:30:16.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.056+0000 7f2f9871f800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19]): potential dests added=[] removed=[] 2024-09-14T11:30:16.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.057+0000 7f2f9871f800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-14T11:30:16.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.059+0000 7f2e4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:16.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.061+0000 7f2f9871f800 20 remove_watcher() i=0 2024-09-14T11:30:16.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.061+0000 7f2f9871f800 2 removed watcher, disabling cache 2024-09-14T11:30:16.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.062+0000 7f2f9871f800 20 remove_watcher() i=1 2024-09-14T11:30:16.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.063+0000 7f2f9871f800 20 remove_watcher() i=2 2024-09-14T11:30:16.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.064+0000 7f2f9871f800 20 remove_watcher() i=3 2024-09-14T11:30:16.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.065+0000 7f2f9871f800 20 remove_watcher() i=4 2024-09-14T11:30:16.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.066+0000 7f2f9871f800 20 remove_watcher() i=5 2024-09-14T11:30:16.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.067+0000 7f2f9871f800 20 remove_watcher() i=6 2024-09-14T11:30:16.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.068+0000 7f2f9871f800 20 remove_watcher() i=7 2024-09-14T11:30:16.079 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:30:16.109 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:16.109 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:16.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.149+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.151+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.151+0000 7f7927e14800 20 realm 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.151+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.151+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.151+0000 7f7927e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.151+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.152+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.152+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.152+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:16.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.152+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.153+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:16.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.153+0000 7f7927e14800 20 searching for the correct realm 2024-09-14T11:30:16.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.156+0000 7f7922ddf640 0 -- 172.21.15.28:0/3697544656 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55f1cc4603c0 msgr2=0x55f1cc4627b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:16.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.159+0000 7f79235e0640 0 -- 172.21.15.28:0/3697544656 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f791804eb80 msgr2=0x7f791801d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.163+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:16.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:16.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 zone default found 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 4 Realm: () 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 zonegroup default 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.164+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.165+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.165+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.165+0000 7f7927e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.165+0000 7f7927e14800 20 started sync module instance, tier type = 2024-09-14T11:30:16.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.165+0000 7f7927e14800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:16.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=0 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=1 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=2 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=3 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=4 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=5 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.173+0000 7f7927e14800 20 add_watcher() i=6 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.174+0000 7f7927e14800 20 add_watcher() i=7 2024-09-14T11:30:16.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.174+0000 7f7927e14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:16.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.176+0000 7f77d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:16.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f7927e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:16.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f7927e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:16.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f7927e14800 5 note: GC not initialized 2024-09-14T11:30:16.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f77d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:16.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f7927e14800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:16.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f7927e14800 20 Filter name: none 2024-09-14T11:30:16.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f77527fc640 20 reqs_thread_entry: start 2024-09-14T11:30:16.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.177+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.178+0000 7f7927e14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.179+0000 7f7927e14800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:16.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.179+0000 7f7927e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:16.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.180+0000 7f77d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:16.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.182+0000 7f7927e14800 20 remove_watcher() i=0 2024-09-14T11:30:16.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.182+0000 7f7927e14800 2 removed watcher, disabling cache 2024-09-14T11:30:16.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.184+0000 7f7927e14800 20 remove_watcher() i=1 2024-09-14T11:30:16.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.184+0000 7f7927e14800 20 remove_watcher() i=2 2024-09-14T11:30:16.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.185+0000 7f7927e14800 20 remove_watcher() i=3 2024-09-14T11:30:16.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.186+0000 7f7927e14800 20 remove_watcher() i=4 2024-09-14T11:30:16.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.187+0000 7f7927e14800 20 remove_watcher() i=5 2024-09-14T11:30:16.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.188+0000 7f7927e14800 20 remove_watcher() i=6 2024-09-14T11:30:16.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:16.189+0000 7f7927e14800 20 remove_watcher() i=7 2024-09-14T11:30:16.199 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:16.199 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:16.199 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-init-index id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:30:16.199 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:16.526 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:30:16.526 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:17.377 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:30:17.406 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:17.406 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:17.444 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.447+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.448+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.448+0000 7f5387213800 20 realm 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.448+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.449+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.449+0000 7f5387213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.449+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.449+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.449+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.450+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:17.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.450+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.450+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:17.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.450+0000 7f5387213800 20 searching for the correct realm 2024-09-14T11:30:17.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.453+0000 7f5382147640 0 -- 172.21.15.28:0/397767680 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5374067c20 msgr2=0x7f537406fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:17.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.457+0000 7f5382948640 0 -- 172.21.15.28:0/397767680 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f537807b2a0 msgr2=0x7f5378073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:17.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.663+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 zone default found 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 4 Realm: () 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 zonegroup default 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.664+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.665+0000 7f5387213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.665+0000 7f5387213800 20 started sync module instance, tier type = 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.665+0000 7f5387213800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=0 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=1 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=2 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=3 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=4 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=5 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.675+0000 7f5387213800 20 add_watcher() i=6 2024-09-14T11:30:17.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.676+0000 7f5387213800 20 add_watcher() i=7 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.676+0000 7f5387213800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.677+0000 7f52397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f5387213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f5387213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f5387213800 5 note: GC not initialized 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f51b3fff640 20 reqs_thread_entry: start 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f5387213800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f5387213800 20 Filter name: none 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f51b1ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.678+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.679+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:17.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.679+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.680+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.680+0000 7f5387213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.680+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.680+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.680+0000 7f5387213800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.681+0000 7f5387213800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.681+0000 7f5387213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.682+0000 7f52397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.685+0000 7f5387213800 20 remove_watcher() i=0 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.685+0000 7f5387213800 2 removed watcher, disabling cache 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.687+0000 7f5387213800 20 remove_watcher() i=1 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.689+0000 7f5387213800 20 remove_watcher() i=2 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.691+0000 7f5387213800 20 remove_watcher() i=3 2024-09-14T11:30:17.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.693+0000 7f5387213800 20 remove_watcher() i=4 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.694+0000 7f5387213800 20 remove_watcher() i=5 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.695+0000 7f5387213800 20 remove_watcher() i=6 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.696+0000 7f5387213800 20 remove_watcher() i=7 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-init-index id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:17.719 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:30:17.744 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:17.744 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:17.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.784+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 realm 2024-09-14T11:30:17.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:17.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.786+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.787+0000 7f4577726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:17.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.787+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.788+0000 7f4577726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:17.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.788+0000 7f4577726800 20 searching for the correct realm 2024-09-14T11:30:17.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.791+0000 7f4573b5e640 0 -- 172.21.15.28:0/1217748935 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x56403b213550 msgr2=0x56403b215940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:17.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.795+0000 7f457335d640 0 -- 172.21.15.28:0/1217748935 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f456806e310 msgr2=0x7f456806d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.798+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:17.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 zone default found 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 4 Realm: () 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 zonegroup default 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.799+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 started sync module instance, tier type = 2024-09-14T11:30:17.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.800+0000 7f4577726800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:17.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=0 2024-09-14T11:30:17.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=1 2024-09-14T11:30:17.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=2 2024-09-14T11:30:17.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=3 2024-09-14T11:30:17.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=4 2024-09-14T11:30:17.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=5 2024-09-14T11:30:17.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.810+0000 7f4577726800 20 add_watcher() i=6 2024-09-14T11:30:17.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.812+0000 7f4577726800 20 add_watcher() i=7 2024-09-14T11:30:17.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.812+0000 7f4577726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:17.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.814+0000 7f4429fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.814+0000 7f4577726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.814+0000 7f4577726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.814+0000 7f4577726800 5 note: GC not initialized 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.814+0000 7f4428fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.814+0000 7f4577726800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 20 Filter name: none 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f43a27fc640 20 reqs_thread_entry: start 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:30:17.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 : miss 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 info.flags=0x17 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 to cache LRU end 2024-09-14T11:30:17.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:17.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:17.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.815+0000 7f4577726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 2024-09-14T11:30:17.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.817+0000 7f4577726800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:30:17.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.817+0000 7f4577726800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4577726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 info.flags=0x17 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4577726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 to cache LRU end 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4577726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4577726800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20, ofs0, ns] 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4456ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94833869982048 notifier 5900 bl.length()=911 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4456ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 info.flags=0x17 2024-09-14T11:30:17.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4456ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 to cache LRU end 2024-09-14T11:30:17.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.819+0000 7f4456ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:17.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.821+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): orig_sources= new_sources= 2024-09-14T11:30:17.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.821+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): potential sources added=[] removed=[] 2024-09-14T11:30:17.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.821+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): orig_dests= new_dests= 2024-09-14T11:30:17.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.821+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): potential dests added=[] removed=[] 2024-09-14T11:30:17.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.823+0000 7f4577726800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20.1.0 2024-09-14T11:30:17.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.823+0000 7f4577726800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20.1.0 2024-09-14T11:30:17.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.823+0000 7f4577726800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20.1.1 2024-09-14T11:30:17.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.823+0000 7f4577726800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20.1.1 2024-09-14T11:30:17.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.823+0000 7f4577726800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20.0 2024-09-14T11:30:17.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.825+0000 7f4577726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:17.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.825+0000 7f4577726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 2024-09-14T11:30:17.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f4577726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 info.flags=0x17 2024-09-14T11:30:17.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f4577726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 to cache LRU end 2024-09-14T11:30:17.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f4577726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:17.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f4577726800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20, ofs0, ns] 2024-09-14T11:30:17.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f44567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94833869982048 notifier 5900 bl.length()=879 2024-09-14T11:30:17.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f44567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 info.flags=0x17 2024-09-14T11:30:17.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f44567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 to cache LRU end 2024-09-14T11:30:17.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.826+0000 7f44567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:17.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.828+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): orig_sources= new_sources= 2024-09-14T11:30:17.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.828+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): potential sources added=[] removed=[] 2024-09-14T11:30:17.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.828+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): orig_dests= new_dests= 2024-09-14T11:30:17.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.828+0000 7f4577726800 20 handle_bi_update(): bucket=:error-at-init-index[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20]): potential dests added=[] removed=[] 2024-09-14T11:30:17.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.829+0000 7f4577726800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-14T11:30:17.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.831+0000 7f4429fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:17.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.834+0000 7f4577726800 20 remove_watcher() i=0 2024-09-14T11:30:17.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.834+0000 7f4577726800 2 removed watcher, disabling cache 2024-09-14T11:30:17.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.835+0000 7f4577726800 20 remove_watcher() i=1 2024-09-14T11:30:17.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.836+0000 7f4577726800 20 remove_watcher() i=2 2024-09-14T11:30:17.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.837+0000 7f4577726800 20 remove_watcher() i=3 2024-09-14T11:30:17.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.837+0000 7f4577726800 20 remove_watcher() i=4 2024-09-14T11:30:17.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.838+0000 7f4577726800 20 remove_watcher() i=5 2024-09-14T11:30:17.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.839+0000 7f4577726800 20 remove_watcher() i=6 2024-09-14T11:30:17.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.840+0000 7f4577726800 20 remove_watcher() i=7 2024-09-14T11:30:17.851 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:30:17.880 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:17.880 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:17.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.921+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 realm 2024-09-14T11:30:17.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.923+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.924+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:17.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.924+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:17.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.925+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:17.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.925+0000 7f579e72e800 20 searching for the correct realm 2024-09-14T11:30:17.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.928+0000 7f579acde640 0 -- 172.21.15.28:0/100579303 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f579006f430 msgr2=0x7f579006f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:17.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:17.931+0000 7f579a4dd640 0 -- 172.21.15.28:0/100579303 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5790085420 msgr2=0x7f5790085860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:18.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.137+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 20 zone default found 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 4 Realm: () 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 20 zonegroup default 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.138+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.139+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.139+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.139+0000 7f579e72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:18.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.139+0000 7f579e72e800 20 started sync module instance, tier type = 2024-09-14T11:30:18.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.139+0000 7f579e72e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=0 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=1 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=2 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=3 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=4 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=5 2024-09-14T11:30:18.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.148+0000 7f579e72e800 20 add_watcher() i=6 2024-09-14T11:30:18.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.149+0000 7f579e72e800 20 add_watcher() i=7 2024-09-14T11:30:18.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.149+0000 7f579e72e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:18.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.150+0000 7f5650fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:18.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f579e72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:18.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f579e72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:18.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f579e72e800 5 note: GC not initialized 2024-09-14T11:30:18.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f55cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:18.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f579e72e800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:18.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f579e72e800 20 Filter name: none 2024-09-14T11:30:18.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f55c97fa640 20 reqs_thread_entry: start 2024-09-14T11:30:18.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.151+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.152+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:18.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.152+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.152+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.152+0000 7f579e72e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.152+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.153+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.153+0000 7f579e72e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.153+0000 7f579e72e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:30:18.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.153+0000 7f579e72e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:18.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.154+0000 7f5650fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:18.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.156+0000 7f579e72e800 20 remove_watcher() i=0 2024-09-14T11:30:18.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.156+0000 7f579e72e800 2 removed watcher, disabling cache 2024-09-14T11:30:18.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.157+0000 7f579e72e800 20 remove_watcher() i=1 2024-09-14T11:30:18.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.158+0000 7f579e72e800 20 remove_watcher() i=2 2024-09-14T11:30:18.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.160+0000 7f579e72e800 20 remove_watcher() i=3 2024-09-14T11:30:18.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.161+0000 7f579e72e800 20 remove_watcher() i=4 2024-09-14T11:30:18.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.162+0000 7f579e72e800 20 remove_watcher() i=5 2024-09-14T11:30:18.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.163+0000 7f579e72e800 20 remove_watcher() i=6 2024-09-14T11:30:18.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:18.164+0000 7f579e72e800 20 remove_watcher() i=7 2024-09-14T11:30:18.173 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:18.173 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:18.173 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-init-index id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:30:18.173 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:18.495 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:30:18.495 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:19.347 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:30:19.376 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:19.376 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:19.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.417+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 realm 2024-09-14T11:30:19.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:19.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.419+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.420+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.420+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.420+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:19.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.420+0000 7f89b4f23800 20 searching for the correct realm 2024-09-14T11:30:19.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.423+0000 7f89b140d640 0 -- 172.21.15.28:0/551778451 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f89a403c030 msgr2=0x7f89a40719a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.426+0000 7f89b0c0c640 0 -- 172.21.15.28:0/551778451 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f89a4074220 msgr2=0x7f89a4074900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:19.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.631+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 zone default found 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 4 Realm: () 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 zonegroup default 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.632+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 started sync module instance, tier type = 2024-09-14T11:30:19.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.633+0000 7f89b4f23800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:19.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=0 2024-09-14T11:30:19.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=1 2024-09-14T11:30:19.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=2 2024-09-14T11:30:19.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=3 2024-09-14T11:30:19.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=4 2024-09-14T11:30:19.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=5 2024-09-14T11:30:19.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.642+0000 7f89b4f23800 20 add_watcher() i=6 2024-09-14T11:30:19.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.643+0000 7f89b4f23800 20 add_watcher() i=7 2024-09-14T11:30:19.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.643+0000 7f89b4f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:19.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f8866fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f89b4f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:19.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f89b4f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:19.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f89b4f23800 5 note: GC not initialized 2024-09-14T11:30:19.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f8865fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:19.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f89b4f23800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:19.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f89b4f23800 20 Filter name: none 2024-09-14T11:30:19.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f87d77fe640 20 reqs_thread_entry: start 2024-09-14T11:30:19.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.645+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.646+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.646+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.646+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.646+0000 7f89b4f23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.646+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.647+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:19.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.647+0000 7f89b4f23800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.647+0000 7f89b4f23800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.647+0000 7f89b4f23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:19.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.649+0000 7f8866fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.651+0000 7f89b4f23800 20 remove_watcher() i=0 2024-09-14T11:30:19.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.651+0000 7f89b4f23800 2 removed watcher, disabling cache 2024-09-14T11:30:19.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.652+0000 7f89b4f23800 20 remove_watcher() i=1 2024-09-14T11:30:19.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.653+0000 7f89b4f23800 20 remove_watcher() i=2 2024-09-14T11:30:19.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.654+0000 7f89b4f23800 20 remove_watcher() i=3 2024-09-14T11:30:19.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.655+0000 7f89b4f23800 20 remove_watcher() i=4 2024-09-14T11:30:19.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.656+0000 7f89b4f23800 20 remove_watcher() i=5 2024-09-14T11:30:19.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.656+0000 7f89b4f23800 20 remove_watcher() i=6 2024-09-14T11:30:19.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.657+0000 7f89b4f23800 20 remove_watcher() i=7 2024-09-14T11:30:19.666 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:19.667 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:19.667 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-init-indext id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:19.667 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:19.668 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:30:19.703 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:19.703 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:19.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.743+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.745+0000 7efd3f263800 20 realm 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.745+0000 7efd3f263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.747+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:19.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.747+0000 7efd3f263800 20 searching for the correct realm 2024-09-14T11:30:19.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.750+0000 7efd3c553640 0 -- 172.21.15.28:0/2896994122 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7efd2c076f60 msgr2=0x7efd2c0602d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.753+0000 7efd3cd54640 0 -- 172.21.15.28:0/2896994122 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7efd240b0a80 msgr2=0x7efd240e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:19.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:19.958 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 zone default found 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 4 Realm: () 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 zonegroup default 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:19.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.961+0000 7efd3f263800 20 started sync module instance, tier type = 2024-09-14T11:30:19.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.961+0000 7efd3f263800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=0 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=1 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=2 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=3 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=4 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=5 2024-09-14T11:30:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=6 2024-09-14T11:30:19.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.971+0000 7efd3f263800 20 add_watcher() i=7 2024-09-14T11:30:19.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.971+0000 7efd3f263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.972+0000 7efbf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 5 note: GC not initialized 2024-09-14T11:30:19.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efbf27e4640 20 reqs_thread_entry: start 2024-09-14T11:30:19.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:19.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 20 Filter name: none 2024-09-14T11:30:19.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efbebfff640 20 reqs_thread_entry: start 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.973+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : miss 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:19.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:19.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:19.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.974+0000 7efd3f263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:19.974 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd3f263800 time 2024-09-14T11:30:19.976474+0000 2024-09-14T11:30:19.974 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd4278c76a] 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:19.975 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7efd3f263800 thread_name:radosgw-admin 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.976+0000 7efd3f263800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd3f263800 time 2024-09-14T11:30:19.976474+0000 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd4278c76a] 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:19.976 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:19.977 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:19.977 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:19.977 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:19.998 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:19.998 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd4143e6f0] 2024-09-14T11:30:19.998 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd4148b99c] 2024-09-14T11:30:19.998 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:19.998 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd4278c7c4] 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:19.977+0000 7efd3f263800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7efd3f263800 thread_name:radosgw-admin 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:19.999 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd4143e6f0] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd4148b99c] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd4278c7c4] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:20.000 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:30:19.726+0000 7efd3d555640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:30:19.726+0000 7efd3d555640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: dump: 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.001 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:30:19.726+0000 7efd3f263800 5 monclient: authenticate success, global_id 6297 2024-09-14T11:30:20.002 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:30:19.726+0000 7efd3f263800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:30:19.726+0000 7efd3f263800 4 set_mon_vals no callback set 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: dump: 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.003 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: shutdown 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 asok(0x564a372bb270) unregister_commands rotate-key 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.004 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding auth protocol: cephx 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding auth protocol: cephx 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding auth protocol: cephx 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.005 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:30:19.727+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: starting msgr at 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: starting objecter 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 asok(0x564a372bb270) register_command objecter_requests hook 0x564a374e1700 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: setting wanted keys 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: calling monclient init 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding auth protocol: cephx 2024-09-14T11:30:20.006 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding auth protocol: cephx 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding auth protocol: cephx 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.007 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:30:19.728+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:30:19.728+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:30:19.728+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key hook 0x564a374dd7d8 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a37394870 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a37426b60 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a374274a0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.008 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.369381s 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a37394870 auth_method 0 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a374274a0 auth_method 0 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.009 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a37426b60 auth_method 0 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_done global_id 6300 payload 824 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:30:19.728+0000 7efd3cd54640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:30:19.728+0000 7efc2960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:30:19.728+0000 7efc2960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:30:19.728+0000 7efc2960a640 10 monclient: dump: 2024-09-14T11:30:20.010 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.011 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: dump: 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:30:19.729+0000 7efd3f263800 5 monclient: authenticate success, global_id 6300 2024-09-14T11:30:20.012 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:30:19.729+0000 7efc2ae0d640 4 set_mon_vals no callback set 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:30:19.729+0000 7efd3f263800 1 librados: init done 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:30:19.731+0000 7efc2960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:30:19.731+0000 7efc2960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.013 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:30:19.731+0000 7efc2960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:30:19.731+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efc24077260 auth_method 0 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:30:19.731+0000 7efd3d555640 10 monclient: get_auth_request con 0x564a37504690 auth_method 0 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:30:19.732+0000 7efd3cd54640 10 monclient: get_auth_request con 0x564a37529140 auth_method 0 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:30:19.733+0000 7efd3c553640 10 monclient: get_auth_request con 0x564a3752e1d0 auth_method 0 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:30:19.734+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:30:19.734+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:30:19.734+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.014 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding auth protocol: cephx 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding auth protocol: cephx 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding auth protocol: cephx 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.015 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:30:19.734+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 asok(0x564a372bb270) register_command objecter_requests cmddesc objecter_requests hook 0x564a37535700 EEXIST 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding auth protocol: cephx 2024-09-14T11:30:20.016 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding auth protocol: cephx 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding auth protocol: cephx 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.017 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:30:19.735+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:30:19.735+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key cmddesc rotate-key hook 0x564a375311c0 EEXIST 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a37559a20 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a37559e00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a37558730 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.376572s 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a37559a20 auth_method 0 2024-09-14T11:30:20.018 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a37559e00 auth_method 0 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a37558730 auth_method 0 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.019 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_done global_id 5945 payload 824 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:30:19.735+0000 7efd3cd54640 1 monclient: found mon.noname-c 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: dump: 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.020 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.021 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: dump: 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:30:19.736+0000 7efd3f263800 5 monclient: authenticate success, global_id 5945 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:20.022 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:30:19.736+0000 7efd3dd56640 4 set_mon_vals no callback set 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:30:19.738+0000 7efc227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:30:19.738+0000 7efc227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:30:19.738+0000 7efc227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:30:19.738+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efc14077140 auth_method 0 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: get_monmap_and_config 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:30:19.738+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.023 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding auth protocol: cephx 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding auth protocol: cephx 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding auth protocol: cephx 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.024 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:30:19.738+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding auth protocol: cephx 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding auth protocol: cephx 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding auth protocol: cephx 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.025 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:30:19.739+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:30:19.739+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:30:19.739+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key cmddesc rotate-key hook 0x7ffe497e3978 EEXIST 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:20.026 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a375adef0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a3759e840 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a375a9320 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.380354s 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a375a9320 auth_method 0 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a3759e840 auth_method 0 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.027 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a375adef0 auth_method 0 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.028 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_done global_id 6306 payload 274 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:30:19.739+0000 7efd3d555640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: dump: 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.029 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:30:19.740+0000 7efc13fff640 10 monclient: dump: 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.030 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 monclient: authenticate success, global_id 6306 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:30:19.740+0000 7efd3f263800 4 set_mon_vals no callback set 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: shutdown 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:30:19.740+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.031 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding auth protocol: cephx 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding auth protocol: cephx 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding auth protocol: cephx 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.032 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:30:19.740+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:30:19.740+0000 7efd3f263800 1 librados: starting msgr at 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:30:19.740+0000 7efd3f263800 1 librados: starting objecter 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 asok(0x564a372bb270) register_command objecter_requests cmddesc objecter_requests hook 0x564a3755a200 EEXIST 2024-09-14T11:30:20.033 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:30:19.741+0000 7efd3f263800 1 librados: setting wanted keys 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:30:19.741+0000 7efd3f263800 1 librados: calling monclient init 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding auth protocol: cephx 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding auth protocol: cephx 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding auth protocol: cephx 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.034 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:30:19.741+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:30:19.741+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key cmddesc rotate-key hook 0x564a3756e428 EEXIST 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a3759e840 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a375a9320 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a375adef0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.035 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.382614s 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a375a9320 auth_method 0 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a3759e840 auth_method 0 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.036 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a375adef0 auth_method 0 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_done global_id 6309 payload 824 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:30:19.742+0000 7efd3c553640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:30:19.742+0000 7efd3c553640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.037 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: dump: 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.038 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: dump: 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:30:19.742+0000 7efd3f263800 5 monclient: authenticate success, global_id 6309 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.039 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:30:19.742+0000 7efc13fff640 4 set_mon_vals no callback set 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:30:19.742+0000 7efd3f263800 1 librados: init done 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:30:19.742+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cr dump hook 0x564a375a3718 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:30:19.743+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:30:19.744+0000 7efc127fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:30:19.744+0000 7efc127fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:30:19.744+0000 7efc127fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:30:19.745+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efc08077260 auth_method 0 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:30:19.745+0000 7efd3d555640 10 monclient: get_auth_request con 0x564a375c8750 auth_method 0 2024-09-14T11:30:20.040 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 realm 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:30:19.745+0000 7efd3f263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:30:19.746+0000 7efd3cd54640 10 monclient: get_auth_request con 0x564a375cc950 auth_method 0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:30:19.747+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:30:19.747+0000 7efd3f263800 20 searching for the correct realm 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:30:19.747+0000 7efd3c553640 10 monclient: get_auth_request con 0x564a375d1830 auth_method 0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:30:19.748+0000 7efd3d555640 10 monclient: get_auth_request con 0x7efd24090070 auth_method 0 2024-09-14T11:30:20.041 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:30:19.748+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efd34022030 auth_method 0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:30:19.749+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efd2c076f60 auth_method 0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:30:19.750+0000 7efd3c553640 0 -- 172.21.15.28:0/2896994122 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7efd2c076f60 msgr2=0x7efd2c0602d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:30:19.750+0000 7efc127fc640 1 client.6309.objecter ms_handle_reset 0x7efd2c076f60 session 0x7efd2c087070 osd.4 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:30:19.750+0000 7efc127fc640 10 monclient: _renew_subs 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:30:19.750+0000 7efc127fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:30:19.750+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efc08087a10 auth_method 0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:30:19.751+0000 7efd3d555640 10 monclient: get_auth_request con 0x7efd240e2040 auth_method 0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:30:19.753+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efd240b0a80 auth_method 0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:30:19.753+0000 7efd3cd54640 0 -- 172.21.15.28:0/2896994122 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7efd240b0a80 msgr2=0x7efd240e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:30:19.954+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efd240b0a80 auth_method 0 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:20.042 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 zone default found 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:30:19.960+0000 7efd3f263800 4 Realm: () 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:30:19.960+0000 7efd3f263800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:30:19.960+0000 7efd3f263800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:30:19.960+0000 7efd3f263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 zonegroup default 2024-09-14T11:30:20.043 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 started sync module instance, tier type = 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=0 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=1 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=2 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=3 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=4 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=5 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=6 2024-09-14T11:30:20.044 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:30:19.971+0000 7efd3f263800 20 add_watcher() i=7 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:30:19.971+0000 7efd3f263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding auth protocol: cephx 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding auth protocol: cephx 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding auth protocol: cephx 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.045 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:30:19.972+0000 7efbf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:30:19.973+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache list hook 0x564a375a2fa0 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache inspect hook 0x564a375a2fa0 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache erase hook 0x564a375a2fa0 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache zap hook 0x564a375a2fa0 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 note: GC not initialized 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:30:19.973+0000 7efbf27e4640 20 reqs_thread_entry: start 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace show hook 0x7efd34009400 2024-09-14T11:30:20.046 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace history hook 0x7efd34009400 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace active hook 0x7efd34009400 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace active_short hook 0x7efd34009400 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 Filter name: none 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:30:19.973+0000 7efbebfff640 20 reqs_thread_entry: start 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:30:19.973+0000 7efd3f263800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : miss 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:20.047 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:30:19.976+0000 7efd3f263800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd3f263800 time 2024-09-14T11:30:19.976474+0000 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd4278c76a] 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:20.048 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:30:19.977+0000 7efd3f263800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7efd3f263800 thread_name:radosgw-admin 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd4143e6f0] 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd4148b99c] 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd4278c7c4] 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:20.049 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:30:20.050 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:20.051 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:30:20.052 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:30:20.053 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:30:20.054 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:20.055 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:20.056 INFO:tasks.workunit.client.0.smithi028.stderr: 7efbebfff640 / http_manager 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efbf27e4640 / http_manager 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efbf37e6640 / rgw_dt_lg_renew 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc127fc640 / ms_dispatch 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc13fff640 / io_context_pool 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc227fc640 / ms_dispatch 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc2960a640 / ms_dispatch 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc2ae0d640 / io_context_pool 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3c553640 / msgr-worker-2 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3cd54640 / msgr-worker-1 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3d555640 / msgr-worker-0 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3dd56640 / io_context_pool 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3f263800 / radosgw-admin 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:30:20.057 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.89043.log 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:30:19.726+0000 7efd3d555640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:30:19.726+0000 7efd3d555640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: dump: 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.058 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:30:19.726+0000 7efd3f263800 5 monclient: authenticate success, global_id 6297 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:30:19.726+0000 7efd3f263800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:30:19.726+0000 7efd3f263800 4 set_mon_vals no callback set 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:30:19.726+0000 7efc2ae0d640 10 monclient: dump: 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.059 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: shutdown 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 asok(0x564a372bb270) unregister_commands rotate-key 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.060 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding auth protocol: cephx 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding auth protocol: cephx 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding auth protocol: cephx 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.061 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: crc 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374e3230) adding con mode: secure 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:30:19.727+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: starting msgr at 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: starting objecter 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 asok(0x564a372bb270) register_command objecter_requests hook 0x564a374e1700 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: setting wanted keys 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:30:19.727+0000 7efd3f263800 1 librados: calling monclient init 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:30:19.727+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding auth protocol: cephx 2024-09-14T11:30:20.062 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding auth protocol: cephx 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding auth protocol: cephx 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: crc 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:30:19.727+0000 7efd3f263800 5 AuthRegistry(0x564a374dd690) adding con mode: secure 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:30:19.728+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.063 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:30:19.728+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:30:19.728+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key hook 0x564a374dd7d8 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a37394870 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a37426b60 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a374274a0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:30:19.728+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.369381s 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a37394870 auth_method 0 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.064 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a374274a0 auth_method 0 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:30:19.728+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a37426b60 auth_method 0 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:30:19.728+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.065 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient(hunting): handle_auth_done global_id 6300 payload 824 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:30:19.728+0000 7efd3cd54640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:30:19.728+0000 7efd3cd54640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:30:19.728+0000 7efc2960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:30:19.728+0000 7efc2960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:30:19.728+0000 7efc2960a640 10 monclient: dump: 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.066 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:30:19.729+0000 7efc2960a640 10 monclient: dump: 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.067 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:30:19.729+0000 7efd3f263800 5 monclient: authenticate success, global_id 6300 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:30:19.729+0000 7efc2ae0d640 4 set_mon_vals no callback set 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:30:19.729+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:30:19.729+0000 7efd3f263800 1 librados: init done 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:30:19.731+0000 7efc2960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:30:19.731+0000 7efc2960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:30:19.731+0000 7efc2960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:30:19.731+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efc24077260 auth_method 0 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:30:19.731+0000 7efd3d555640 10 monclient: get_auth_request con 0x564a37504690 auth_method 0 2024-09-14T11:30:20.068 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:30:19.732+0000 7efd3cd54640 10 monclient: get_auth_request con 0x564a37529140 auth_method 0 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:30:19.733+0000 7efd3c553640 10 monclient: get_auth_request con 0x564a3752e1d0 auth_method 0 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:30:19.734+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:30:19.734+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:30:19.734+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding auth protocol: cephx 2024-09-14T11:30:20.069 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding auth protocol: cephx 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding auth protocol: cephx 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: crc 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 AuthRegistry(0x564a375321d0) adding con mode: secure 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:30:19.734+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.070 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:30:19.734+0000 7efd3f263800 5 asok(0x564a372bb270) register_command objecter_requests cmddesc objecter_requests hook 0x564a37535700 EEXIST 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding auth protocol: cephx 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding auth protocol: cephx 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding auth protocol: cephx 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: crc 2024-09-14T11:30:20.071 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 AuthRegistry(0x564a37531078) adding con mode: secure 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:30:19.735+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:30:19.735+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:30:19.735+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key cmddesc rotate-key hook 0x564a375311c0 EEXIST 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a37559a20 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a37559e00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a37558730 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:30:19.735+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.376572s 2024-09-14T11:30:20.072 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a37559a20 auth_method 0 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a37559e00 auth_method 0 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a37558730 auth_method 0 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.073 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:30:19.735+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:30:19.735+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient(hunting): handle_auth_done global_id 5945 payload 824 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:30:19.735+0000 7efd3cd54640 1 monclient: found mon.noname-c 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:30:19.735+0000 7efd3cd54640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: dump: 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.074 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:30:19.736+0000 7efc227fc640 10 monclient: dump: 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.075 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:30:19.736+0000 7efd3f263800 5 monclient: authenticate success, global_id 5945 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:30:19.736+0000 7efd3dd56640 4 set_mon_vals no callback set 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:30:19.736+0000 7efd3f263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:30:19.738+0000 7efc227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:20.076 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:30:19.738+0000 7efc227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:30:19.738+0000 7efc227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:30:19.738+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efc14077140 auth_method 0 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: get_monmap_and_config 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:30:19.738+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.077 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding auth protocol: cephx 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding auth protocol: cephx 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding auth protocol: cephx 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.078 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: crc 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x564a375798d0) adding con mode: secure 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:30:19.738+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:30:19.738+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding auth protocol: cephx 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding auth protocol: cephx 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding auth protocol: cephx 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.079 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: crc 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:30:19.738+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3830) adding con mode: secure 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:30:19.739+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:30:19.739+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:30:19.739+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key cmddesc rotate-key hook 0x7ffe497e3978 EEXIST 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a375adef0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a3759e840 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a375a9320 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.080 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:30:19.739+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.380354s 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a375a9320 auth_method 0 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a3759e840 auth_method 0 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a375adef0 auth_method 0 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.081 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:30:19.739+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:30:19.739+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient(hunting): handle_auth_done global_id 6306 payload 274 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:30:19.739+0000 7efd3d555640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:30:19.739+0000 7efd3d555640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: dump: 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.082 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:30:19.739+0000 7efc13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:30:19.740+0000 7efc13fff640 10 monclient: dump: 2024-09-14T11:30:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 monclient: authenticate success, global_id 6306 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:30:19.740+0000 7efd3f263800 4 set_mon_vals no callback set 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: shutdown 2024-09-14T11:30:20.084 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: build_initial_monmap 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:30:19.740+0000 7efd3f263800 1 build_initial for_mkfs: 0 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:30:19.740+0000 7efd3f263800 10 monclient: monmap: 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding auth protocol: cephx 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding auth protocol: cephx 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding auth protocol: cephx 2024-09-14T11:30:20.085 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: crc 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 AuthRegistry(0x564a3759ed30) adding con mode: secure 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:30:19.740+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:30:19.740+0000 7efd3f263800 1 librados: starting msgr at 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:30:19.740+0000 7efd3f263800 1 librados: starting objecter 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:30:19.740+0000 7efd3f263800 5 asok(0x564a372bb270) register_command objecter_requests cmddesc objecter_requests hook 0x564a3755a200 EEXIST 2024-09-14T11:30:20.086 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:30:19.741+0000 7efd3f263800 1 librados: setting wanted keys 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:30:19.741+0000 7efd3f263800 1 librados: calling monclient init 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient: init 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding auth protocol: cephx 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding auth protocol: cephx 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding auth protocol: cephx 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.087 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: crc 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 AuthRegistry(0x564a3756e2e0) adding con mode: secure 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:30:19.741+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:30:19.741+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:30:19.741+0000 7efd3f263800 5 asok(0x564a372bb270) register_command rotate-key cmddesc rotate-key hook 0x564a3756e428 EEXIST 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-c con 0x564a3759e840 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-a con 0x564a375a9320 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): picked mon.noname-b con 0x564a375adef0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:20.088 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:30:19.741+0000 7efd3f263800 10 monclient(hunting): authenticate will time out at 1957.382614s 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): get_auth_request con 0x564a375a9320 auth_method 0 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): get_auth_request con 0x564a3759e840 auth_method 0 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:30:19.741+0000 7efd3cd54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:20.089 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): get_auth_request con 0x564a375adef0 auth_method 0 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:30:19.741+0000 7efd3d555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient(hunting): handle_auth_done global_id 6309 payload 824 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:30:19.741+0000 7efd3c553640 10 monclient: _finish_hunting 0 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:30:19.742+0000 7efd3c553640 1 monclient: found mon.noname-a 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:30:19.742+0000 7efd3c553640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: dump: 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.090 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: _finish_auth 0 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: _check_auth_tickets 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:30:19.742+0000 7efc127fc640 10 monclient: dump: 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:20.091 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:30:19.742+0000 7efd3f263800 5 monclient: authenticate success, global_id 6309 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:30:19.742+0000 7efc13fff640 4 set_mon_vals no callback set 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _renew_subs 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:30:19.742+0000 7efd3f263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:30:19.742+0000 7efd3f263800 1 librados: init done 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:30:19.742+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cr dump hook 0x564a375a3718 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:30:19.743+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.092 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:30:19.744+0000 7efc127fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:30:19.744+0000 7efc127fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:30:19.744+0000 7efc127fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:30:19.745+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efc08077260 auth_method 0 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:30:19.745+0000 7efd3d555640 10 monclient: get_auth_request con 0x564a375c8750 auth_method 0 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 realm 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.093 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:30:19.745+0000 7efd3f263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:30:19.745+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:30:19.746+0000 7efd3cd54640 10 monclient: get_auth_request con 0x564a375cc950 auth_method 0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:30:19.746+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:30:19.747+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:30:19.747+0000 7efd3f263800 20 searching for the correct realm 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:30:19.747+0000 7efd3c553640 10 monclient: get_auth_request con 0x564a375d1830 auth_method 0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:30:19.748+0000 7efd3d555640 10 monclient: get_auth_request con 0x7efd24090070 auth_method 0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:30:19.748+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efd34022030 auth_method 0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:30:19.749+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efd2c076f60 auth_method 0 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:30:19.750+0000 7efd3c553640 0 -- 172.21.15.28:0/2896994122 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7efd2c076f60 msgr2=0x7efd2c0602d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.094 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:30:19.750+0000 7efc127fc640 1 client.6309.objecter ms_handle_reset 0x7efd2c076f60 session 0x7efd2c087070 osd.4 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:30:19.750+0000 7efc127fc640 10 monclient: _renew_subs 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:30:19.750+0000 7efc127fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:30:19.750+0000 7efd3c553640 10 monclient: get_auth_request con 0x7efc08087a10 auth_method 0 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:30:19.751+0000 7efd3d555640 10 monclient: get_auth_request con 0x7efd240e2040 auth_method 0 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:30:19.753+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efd240b0a80 auth_method 0 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:30:19.753+0000 7efd3cd54640 0 -- 172.21.15.28:0/2896994122 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7efd240b0a80 msgr2=0x7efd240e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:30:19.954+0000 7efd3cd54640 10 monclient: get_auth_request con 0x7efd240b0a80 auth_method 0 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.095 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:30:19.959+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 zone default found 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:30:19.960+0000 7efd3f263800 4 Realm: () 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:30:19.960+0000 7efd3f263800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:30:19.960+0000 7efd3f263800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:30:19.960+0000 7efd3f263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 zonegroup default 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:30:19.960+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.096 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 started sync module instance, tier type = 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:30:19.961+0000 7efd3f263800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=0 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=1 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=2 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=3 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=4 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=5 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:30:19.970+0000 7efd3f263800 20 add_watcher() i=6 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:30:19.971+0000 7efd3f263800 20 add_watcher() i=7 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:30:19.971+0000 7efd3f263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding auth protocol: cephx 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding auth protocol: cephx 2024-09-14T11:30:20.097 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding auth protocol: cephx 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:30:19.972+0000 7efbf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: crc 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:30:19.972+0000 7efd3f263800 5 AuthRegistry(0x7ffe497e3d10) adding con mode: secure 2024-09-14T11:30:20.098 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:30:19.973+0000 7efd3f263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache list hook 0x564a375a2fa0 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache inspect hook 0x564a375a2fa0 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache erase hook 0x564a375a2fa0 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command cache zap hook 0x564a375a2fa0 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 note: GC not initialized 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:30:19.973+0000 7efbf27e4640 20 reqs_thread_entry: start 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace show hook 0x7efd34009400 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace history hook 0x7efd34009400 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace active hook 0x7efd34009400 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:30:19.973+0000 7efd3f263800 5 asok(0x564a372bb270) register_command sync trace active_short hook 0x7efd34009400 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 Filter name: none 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:30:19.973+0000 7efbebfff640 20 reqs_thread_entry: start 2024-09-14T11:30:20.099 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:30:19.973+0000 7efd3f263800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:30:19.973+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : miss 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:30:19.974+0000 7efd3f263800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:30:19.974+0000 7efd3f263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:30:19.976+0000 7efd3f263800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efd3f263800 time 2024-09-14T11:30:19.976474+0000 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:20.100 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efd4278c76a] 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:30:19.977+0000 7efd3f263800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7efd3f263800 thread_name:radosgw-admin 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.101 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efd4143e6f0] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efd4148b99c] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efd4278c7c4] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efd4278c928] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564a353d80b1] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd882d4) [0x564a358eb2d4] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x564a353e7efd] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efd41429590] 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.102 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:30:20.103 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:30:20.104 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:30:20.105 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:30:20.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:20.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:20.108 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efbebfff640 / http_manager 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efbf27e4640 / http_manager 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efbf37e6640 / rgw_dt_lg_renew 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc127fc640 / ms_dispatch 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc13fff640 / io_context_pool 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc227fc640 / ms_dispatch 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc2960a640 / ms_dispatch 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efc2ae0d640 / io_context_pool 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3c553640 / msgr-worker-2 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3cd54640 / msgr-worker-1 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3d555640 / msgr-worker-0 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3dd56640 / io_context_pool 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: 7efd3f263800 / radosgw-admin 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:30:20.109 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:30:20.110 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:30:19.978165Z_28c0d951-83c0-4b6a-b74a-a6701cce2f76/log 2024-09-14T11:30:20.110 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:30:20.110 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.056+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.057+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.057+0000 7f71e4f2a800 20 realm 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.057+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.058+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.058+0000 7f71e4f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.058+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.058+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.058+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.059+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.059+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.059+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.059+0000 7f71e4f2a800 20 searching for the correct realm 2024-09-14T11:30:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.061+0000 7f71e0c17640 0 -- 172.21.15.28:0/3819563911 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f71d0003c90 msgr2=0x7f71dc061e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.267+0000 7f71e1418640 0 -- 172.21.15.28:0/3819563911 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f71cc035400 msgr2=0x7f71cc035860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.273+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 20 zone default found 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 4 Realm: () 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 20 zonegroup default 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.274+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.275+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.275+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.275+0000 7f71e4f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.275+0000 7f71e4f2a800 20 started sync module instance, tier type = 2024-09-14T11:30:20.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.275+0000 7f71e4f2a800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=0 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=1 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=2 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=3 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=4 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=5 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.284+0000 7f71e4f2a800 20 add_watcher() i=6 2024-09-14T11:30:20.282 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.285+0000 7f71e4f2a800 20 add_watcher() i=7 2024-09-14T11:30:20.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.285+0000 7f71e4f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.287+0000 7f7096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.287+0000 7f71e4f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.287+0000 7f71e4f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.287+0000 7f71e4f2a800 5 note: GC not initialized 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f7095fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f71e4f2a800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f71e4f2a800 20 Filter name: none 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f70077fe640 20 reqs_thread_entry: start 2024-09-14T11:30:20.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.288+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.289+0000 7f71e4f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:20.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.291+0000 7f7096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:20.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.293+0000 7f71e4f2a800 20 remove_watcher() i=0 2024-09-14T11:30:20.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.293+0000 7f71e4f2a800 2 removed watcher, disabling cache 2024-09-14T11:30:20.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.296+0000 7f71e4f2a800 20 remove_watcher() i=1 2024-09-14T11:30:20.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.297+0000 7f71e4f2a800 20 remove_watcher() i=2 2024-09-14T11:30:20.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.298+0000 7f71e4f2a800 20 remove_watcher() i=3 2024-09-14T11:30:20.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.299+0000 7f71e4f2a800 20 remove_watcher() i=4 2024-09-14T11:30:20.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.300+0000 7f71e4f2a800 20 remove_watcher() i=5 2024-09-14T11:30:20.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.301+0000 7f71e4f2a800 20 remove_watcher() i=6 2024-09-14T11:30:20.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.302+0000 7f71e4f2a800 20 remove_watcher() i=7 2024-09-14T11:30:20.311 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.311 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:20.312 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-init-indext id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:20.312 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:20.404 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:20.436 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:20.436 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:20.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.476+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 realm 2024-09-14T11:30:20.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:20.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:20.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.478+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.479+0000 7f6b77336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:20.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.479+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:20.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.479+0000 7f6b77336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:20.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.479+0000 7f6b77336800 20 searching for the correct realm 2024-09-14T11:30:20.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:20.683+0000 7f6b728b6640 0 -- 172.21.15.28:0/490712824 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f6b640b15b0 msgr2=0x7f6b640dae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:21.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.090+0000 7f6b730b7640 0 -- 172.21.15.28:0/490712824 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f6b680423b0 msgr2=0x7f6b680427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.297+0000 7f6b77336800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.297+0000 7f6b77336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.297+0000 7f6b77336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.297+0000 7f6b77336800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.297+0000 7f6b77336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.297+0000 7f6b77336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:21.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.298+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.298+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.298+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.298+0000 7f6b77336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.298+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 20 zone default found 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 4 Realm: () 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 20 zonegroup default 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.299+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.300+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.300+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.300+0000 7f6b77336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:21.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.300+0000 7f6b77336800 20 started sync module instance, tier type = 2024-09-14T11:30:21.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.300+0000 7f6b77336800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:21.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=0 2024-09-14T11:30:21.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=1 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=2 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=3 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=4 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=5 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.311+0000 7f6b77336800 20 add_watcher() i=6 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.312+0000 7f6b77336800 20 add_watcher() i=7 2024-09-14T11:30:21.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.312+0000 7f6b77336800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:21.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.314+0000 7f6a29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:21.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:21.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:21.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 5 note: GC not initialized 2024-09-14T11:30:21.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6a28fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:21.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:21.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 20 Filter name: none 2024-09-14T11:30:21.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f69a27fc640 20 reqs_thread_entry: start 2024-09-14T11:30:21.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:30:21.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.315+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.316+0000 7f6b77336800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.316+0000 7f6b77336800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.316+0000 7f6b77336800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.316+0000 7f6b77336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : miss 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.316+0000 7f6b77336800 20 rados->read ofs=0 len=0 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.317+0000 7f6b77336800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.317+0000 7f6b77336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.317+0000 7f6b77336800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.317+0000 7f6b77336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.317+0000 7f6b77336800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:21.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.317+0000 7f6b77336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:21.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.318+0000 7f6b77336800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to be held by another RGW process; skipping for now 2024-09-14T11:30:21.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.319+0000 7f6a29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:21.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.321+0000 7f6b77336800 20 remove_watcher() i=0 2024-09-14T11:30:21.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.321+0000 7f6b77336800 2 removed watcher, disabling cache 2024-09-14T11:30:21.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.322+0000 7f6b77336800 20 remove_watcher() i=1 2024-09-14T11:30:21.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.324+0000 7f6b77336800 20 remove_watcher() i=2 2024-09-14T11:30:21.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.325+0000 7f6b77336800 20 remove_watcher() i=3 2024-09-14T11:30:21.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.326+0000 7f6b77336800 20 remove_watcher() i=4 2024-09-14T11:30:21.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.327+0000 7f6b77336800 20 remove_watcher() i=5 2024-09-14T11:30:21.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.329+0000 7f6b77336800 20 remove_watcher() i=6 2024-09-14T11:30:21.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:21.330+0000 7f6b77336800 20 remove_watcher() i=7 2024-09-14T11:30:21.342 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:30:51.365 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:51.402 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:51.402 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:51.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.449+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 realm 2024-09-14T11:30:51.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:51.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.451+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.452+0000 7ff5b6a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:51.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.452+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.453+0000 7ff5b6a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:51.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.453+0000 7ff5b6a98800 20 searching for the correct realm 2024-09-14T11:30:51.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.456+0000 7ff5b3d81640 0 -- 172.21.15.28:0/1410503587 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7ff5a4073040 msgr2=0x7ff5a407d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:51.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.460+0000 7ff5b4582640 0 -- 172.21.15.28:0/1410503587 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ff5a8072600 msgr2=0x7ff5a808b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:51.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:51.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:51.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:51.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:51.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:51.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:51.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.667+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 zone default found 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 4 Realm: () 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 zonegroup default 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.668+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.669+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.669+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.669+0000 7ff5b6a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.669+0000 7ff5b6a98800 20 started sync module instance, tier type = 2024-09-14T11:30:51.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.669+0000 7ff5b6a98800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=0 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=1 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=2 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=3 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=4 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=5 2024-09-14T11:30:51.679 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.681+0000 7ff5b6a98800 20 add_watcher() i=6 2024-09-14T11:30:51.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.682+0000 7ff5b6a98800 20 add_watcher() i=7 2024-09-14T11:30:51.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.682+0000 7ff5b6a98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:51.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.684+0000 7ff46afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.684+0000 7ff5b6a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.684+0000 7ff5b6a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.684+0000 7ff5b6a98800 5 note: GC not initialized 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff469fdb640 20 reqs_thread_entry: start 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 20 Filter name: none 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff3db7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:30:51.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:51.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:30:51.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:30:51.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : miss 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.685+0000 7ff5b6a98800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.686+0000 7ff5b6a98800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.686+0000 7ff5b6a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.686+0000 7ff5b6a98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.686+0000 7ff5b6a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.686+0000 7ff5b6a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.686+0000 7ff5b6a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.690+0000 7ff5b6a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.690+0000 7ff5b6a98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.690+0000 7ff5b6a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.690+0000 7ff5b6a98800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21, ofs0, ns] 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.691+0000 7ff48b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94009886767840 notifier 6002 bl.length()=913 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.691+0000 7ff48b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.691+0000 7ff48b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.691+0000 7ff48b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.693+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): orig_sources= new_sources= 2024-09-14T11:30:51.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.693+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): potential sources added=[] removed=[] 2024-09-14T11:30:51.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.693+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): orig_dests= new_dests= 2024-09-14T11:30:51.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.693+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): potential dests added=[] removed=[] 2024-09-14T11:30:51.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.696+0000 7ff5b6a98800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21.1.0 2024-09-14T11:30:51.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.696+0000 7ff5b6a98800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21.1.0 2024-09-14T11:30:51.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.696+0000 7ff5b6a98800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21.1.1 2024-09-14T11:30:51.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.696+0000 7ff5b6a98800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21.1.1 2024-09-14T11:30:51.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.696+0000 7ff5b6a98800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21.0 2024-09-14T11:30:51.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.699+0000 7ff5b6a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:51.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.699+0000 7ff5b6a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:51.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.700+0000 7ff5b6a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.700+0000 7ff5b6a98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.700+0000 7ff5b6a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.698 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.700+0000 7ff5b6a98800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21, ofs0, ns] 2024-09-14T11:30:51.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.701+0000 7ff48b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94009886767840 notifier 6002 bl.length()=913 2024-09-14T11:30:51.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.701+0000 7ff48b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.701+0000 7ff48b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.701+0000 7ff48b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.702+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): orig_sources= new_sources= 2024-09-14T11:30:51.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.702+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): potential sources added=[] removed=[] 2024-09-14T11:30:51.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.702+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): orig_dests= new_dests= 2024-09-14T11:30:51.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.702+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): potential dests added=[] removed=[] 2024-09-14T11:30:51.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.703+0000 7ff5b6a98800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21.0 2024-09-14T11:30:51.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.704+0000 7ff5b6a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:51.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.704+0000 7ff5b6a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 2024-09-14T11:30:51.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.705+0000 7ff5b6a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.705+0000 7ff5b6a98800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.705+0000 7ff5b6a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.705+0000 7ff5b6a98800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21, ofs0, ns] 2024-09-14T11:30:51.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.706+0000 7ff48b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94009886767840 notifier 6002 bl.length()=881 2024-09-14T11:30:51.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.706+0000 7ff48b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 info.flags=0x17 2024-09-14T11:30:51.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.706+0000 7ff48b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 to cache LRU end 2024-09-14T11:30:51.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.706+0000 7ff48b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:51.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.707+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): orig_sources= new_sources= 2024-09-14T11:30:51.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.707+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): potential sources added=[] removed=[] 2024-09-14T11:30:51.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.707+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): orig_dests= new_dests= 2024-09-14T11:30:51.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.707+0000 7ff5b6a98800 20 handle_bi_update(): bucket=:abort-at-init-indext[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21]): potential dests added=[] removed=[] 2024-09-14T11:30:51.706 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.708+0000 7ff5b6a98800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-14T11:30:51.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.711+0000 7ff46afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:51.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.714+0000 7ff5b6a98800 20 remove_watcher() i=0 2024-09-14T11:30:51.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.714+0000 7ff5b6a98800 2 removed watcher, disabling cache 2024-09-14T11:30:51.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.715+0000 7ff5b6a98800 20 remove_watcher() i=1 2024-09-14T11:30:51.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.716+0000 7ff5b6a98800 20 remove_watcher() i=2 2024-09-14T11:30:51.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.717+0000 7ff5b6a98800 20 remove_watcher() i=3 2024-09-14T11:30:51.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.718+0000 7ff5b6a98800 20 remove_watcher() i=4 2024-09-14T11:30:51.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.719+0000 7ff5b6a98800 20 remove_watcher() i=5 2024-09-14T11:30:51.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.721+0000 7ff5b6a98800 20 remove_watcher() i=6 2024-09-14T11:30:51.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.722+0000 7ff5b6a98800 20 remove_watcher() i=7 2024-09-14T11:30:51.734 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:30:51.764 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:51.764 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:51.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.807+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.809+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.809+0000 7fbdc0b2e800 20 realm 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.809+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.809+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.809+0000 7fbdc0b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.809+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.810+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:51.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.810+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.811+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:51.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.811+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:51.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.811+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:51.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.811+0000 7fbdc0b2e800 20 searching for the correct realm 2024-09-14T11:30:51.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:51.813+0000 7fbdbc8dd640 0 -- 172.21.15.28:0/14153234 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fbda8003c30 msgr2=0x7fbdb40435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:52.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.019+0000 7fbdbd0de640 0 -- 172.21.15.28:0/14153234 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fbda4078070 msgr2=0x7fbda40ab3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:52.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.026+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 zone default found 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 4 Realm: () 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 zonegroup default 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:52.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:52.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.027+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.028+0000 7fbdc0b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:52.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.028+0000 7fbdc0b2e800 20 started sync module instance, tier type = 2024-09-14T11:30:52.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.028+0000 7fbdc0b2e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=0 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=1 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=2 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=3 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=4 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=5 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.038+0000 7fbdc0b2e800 20 add_watcher() i=6 2024-09-14T11:30:52.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.039+0000 7fbdc0b2e800 20 add_watcher() i=7 2024-09-14T11:30:52.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.039+0000 7fbdc0b2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.040+0000 7fbc72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbdc0b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbdc0b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbdc0b2e800 5 note: GC not initialized 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbc71fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbdc0b2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbdc0b2e800 20 Filter name: none 2024-09-14T11:30:52.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbbe37fe640 20 reqs_thread_entry: start 2024-09-14T11:30:52.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.041+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.042+0000 7fbdc0b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.043+0000 7fbdc0b2e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:30:52.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.043+0000 7fbdc0b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:52.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.044+0000 7fbc72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:52.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.047+0000 7fbdc0b2e800 20 remove_watcher() i=0 2024-09-14T11:30:52.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.047+0000 7fbdc0b2e800 2 removed watcher, disabling cache 2024-09-14T11:30:52.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.048+0000 7fbdc0b2e800 20 remove_watcher() i=1 2024-09-14T11:30:52.047 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.049+0000 7fbdc0b2e800 20 remove_watcher() i=2 2024-09-14T11:30:52.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.050+0000 7fbdc0b2e800 20 remove_watcher() i=3 2024-09-14T11:30:52.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.051+0000 7fbdc0b2e800 20 remove_watcher() i=4 2024-09-14T11:30:52.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.052+0000 7fbdc0b2e800 20 remove_watcher() i=5 2024-09-14T11:30:52.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.053+0000 7fbdc0b2e800 20 remove_watcher() i=6 2024-09-14T11:30:52.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:52.054+0000 7fbdc0b2e800 20 remove_watcher() i=7 2024-09-14T11:30:52.064 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:52.064 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:52.064 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-init-indext id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:30:52.064 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:52.377 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:30:52.378 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:53.237 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:53.266 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:53.266 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:53.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.307+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.309+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.309+0000 7f9a3dbad800 20 realm 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.309+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.309+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.309+0000 7f9a3dbad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.309+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.310+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.310+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.310+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:53.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.310+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.311+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:53.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.311+0000 7f9a3dbad800 20 searching for the correct realm 2024-09-14T11:30:53.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.314+0000 7f9a3ae96640 0 -- 172.21.15.28:0/3762056267 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9a2c090070 msgr2=0x7f9a2c057ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:53.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.521+0000 7f9a3b697640 0 -- 172.21.15.28:0/3762056267 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9a3004d460 msgr2=0x7f9a3004d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.728+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:53.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 zone default found 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 4 Realm: () 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 zonegroup default 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.729+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.730+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.730+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.730+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.730+0000 7f9a3dbad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.730+0000 7f9a3dbad800 20 started sync module instance, tier type = 2024-09-14T11:30:53.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.730+0000 7f9a3dbad800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=0 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=1 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=2 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=3 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=4 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=5 2024-09-14T11:30:53.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.740+0000 7f9a3dbad800 20 add_watcher() i=6 2024-09-14T11:30:53.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.741+0000 7f9a3dbad800 20 add_watcher() i=7 2024-09-14T11:30:53.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.741+0000 7f9a3dbad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:53.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f98f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:53.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f9a3dbad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:53.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f9a3dbad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f9a3dbad800 5 note: GC not initialized 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f98f0fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f9a3dbad800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f9a3dbad800 20 Filter name: none 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f986a7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.743+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.744+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:53.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.744+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.745+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:53.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.745+0000 7f9a3dbad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:53.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.745+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.745+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:53.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.745+0000 7f9a3dbad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.746+0000 7f9a3dbad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:53.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.746+0000 7f9a3dbad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:53.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.747+0000 7f98f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:53.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.749+0000 7f9a3dbad800 20 remove_watcher() i=0 2024-09-14T11:30:53.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.749+0000 7f9a3dbad800 2 removed watcher, disabling cache 2024-09-14T11:30:53.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.750+0000 7f9a3dbad800 20 remove_watcher() i=1 2024-09-14T11:30:53.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.751+0000 7f9a3dbad800 20 remove_watcher() i=2 2024-09-14T11:30:53.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.753+0000 7f9a3dbad800 20 remove_watcher() i=3 2024-09-14T11:30:53.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.754+0000 7f9a3dbad800 20 remove_watcher() i=4 2024-09-14T11:30:53.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.755+0000 7f9a3dbad800 20 remove_watcher() i=5 2024-09-14T11:30:53.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.756+0000 7f9a3dbad800 20 remove_watcher() i=6 2024-09-14T11:30:53.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.757+0000 7f9a3dbad800 20 remove_watcher() i=7 2024-09-14T11:30:53.766 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:53.766 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:53.766 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:53.766 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:53.767 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:30:53.802 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:53.802 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:53.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.843+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 realm 2024-09-14T11:30:53.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:53.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.845+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.846+0000 7fce52a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:53.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.846+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.847+0000 7fce52a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:53.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.847+0000 7fce52a2f800 20 searching for the correct realm 2024-09-14T11:30:53.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.850+0000 7fce4fd18640 0 -- 172.21.15.28:0/661074138 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x558064a33c00 msgr2=0x558064a360c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:53.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.854+0000 7fce50519640 0 -- 172.21.15.28:0/661074138 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fce44014460 msgr2=0x7fce440148c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.859+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 zone default found 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 4 Realm: () 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 zonegroup default 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.860+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 started sync module instance, tier type = 2024-09-14T11:30:53.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.861+0000 7fce52a2f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:53.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=0 2024-09-14T11:30:53.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=1 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=2 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=3 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=4 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=5 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.870+0000 7fce52a2f800 20 add_watcher() i=6 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.871+0000 7fce52a2f800 20 add_watcher() i=7 2024-09-14T11:30:53.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.871+0000 7fce52a2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:53.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.873+0000 7fcd06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.873+0000 7fce52a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.873+0000 7fce52a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.873+0000 7fce52a2f800 5 note: GC not initialized 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fcd05fdb640 20 reqs_thread_entry: start 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 20 Filter name: none 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fcc777fe640 20 reqs_thread_entry: start 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:30:53.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:53.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:30:53.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:30:53.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 : miss 2024-09-14T11:30:53.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.874+0000 7fce52a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.875+0000 7fce52a2f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:53.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.875+0000 7fce52a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:53.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.875+0000 7fce52a2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:53.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.875+0000 7fce52a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:53.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.875+0000 7fce52a2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:53.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.875+0000 7fce52a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 2024-09-14T11:30:53.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.878+0000 7fce52a2f800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:30:53.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.878+0000 7fce52a2f800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:30:53.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.881+0000 7fcd06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:53.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.883+0000 7fce52a2f800 20 remove_watcher() i=0 2024-09-14T11:30:53.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.883+0000 7fce52a2f800 2 removed watcher, disabling cache 2024-09-14T11:30:53.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.885+0000 7fce52a2f800 20 remove_watcher() i=1 2024-09-14T11:30:53.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.886+0000 7fce52a2f800 20 remove_watcher() i=2 2024-09-14T11:30:53.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.887+0000 7fce52a2f800 20 remove_watcher() i=3 2024-09-14T11:30:53.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.888+0000 7fce52a2f800 20 remove_watcher() i=4 2024-09-14T11:30:53.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.889+0000 7fce52a2f800 20 remove_watcher() i=5 2024-09-14T11:30:53.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.890+0000 7fce52a2f800 20 remove_watcher() i=6 2024-09-14T11:30:53.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.891+0000 7fce52a2f800 20 remove_watcher() i=7 2024-09-14T11:30:53.901 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:53.930 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:53.930 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:53.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.971+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 realm 2024-09-14T11:30:53.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:53.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.973+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.974+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:53.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.974+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.974+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:53.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.974+0000 7f74bf413800 20 searching for the correct realm 2024-09-14T11:30:53.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.978+0000 7f74ba347640 0 -- 172.21.15.28:0/4104448429 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f74ac0700c0 msgr2=0x7f74ac067fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:53.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.982+0000 7f74bb349640 0 -- 172.21.15.28:0/4104448429 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f74a4025b80 msgr2=0x7f74a404e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.985+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:53.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:53.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 zone default found 2024-09-14T11:30:53.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 4 Realm: () 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 zonegroup default 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.986+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.987+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.987+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.987+0000 7f74bf413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.987+0000 7f74bf413800 20 started sync module instance, tier type = 2024-09-14T11:30:53.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.987+0000 7f74bf413800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=0 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=1 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=2 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=3 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=4 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=5 2024-09-14T11:30:53.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.996+0000 7f74bf413800 20 add_watcher() i=6 2024-09-14T11:30:53.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.997+0000 7f74bf413800 20 add_watcher() i=7 2024-09-14T11:30:53.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.997+0000 7f74bf413800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:53.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.998+0000 7f73717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:53.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f74bf413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:53.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f74bf413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:53.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f74bf413800 5 note: GC not initialized 2024-09-14T11:30:53.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f72ebfff640 20 reqs_thread_entry: start 2024-09-14T11:30:53.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f74bf413800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:53.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f74bf413800 20 Filter name: none 2024-09-14T11:30:53.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f72e9ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:53.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:53.999+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.000+0000 7f74bf413800 20 rados->read ofs=0 len=0 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.001+0000 7f74bf413800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:53.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.001+0000 7f74bf413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:54.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.002+0000 7f73717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:54.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.004+0000 7f74bf413800 20 remove_watcher() i=0 2024-09-14T11:30:54.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.004+0000 7f74bf413800 2 removed watcher, disabling cache 2024-09-14T11:30:54.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.006+0000 7f74bf413800 20 remove_watcher() i=1 2024-09-14T11:30:54.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.007+0000 7f74bf413800 20 remove_watcher() i=2 2024-09-14T11:30:54.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.008+0000 7f74bf413800 20 remove_watcher() i=3 2024-09-14T11:30:54.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.009+0000 7f74bf413800 20 remove_watcher() i=4 2024-09-14T11:30:54.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.009+0000 7f74bf413800 20 remove_watcher() i=5 2024-09-14T11:30:54.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.010+0000 7f74bf413800 20 remove_watcher() i=6 2024-09-14T11:30:54.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.011+0000 7f74bf413800 20 remove_watcher() i=7 2024-09-14T11:30:54.020 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:54.020 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:54.020 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:54.021 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:54.114 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:54.147 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:54.147 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:54.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.188+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.189+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 20 realm 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.190+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.191+0000 7fd6d0f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:54.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.191+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.191+0000 7fd6d0f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:54.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.191+0000 7fd6d0f40800 20 searching for the correct realm 2024-09-14T11:30:54.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.195+0000 7fd6cd4c1640 0 -- 172.21.15.28:0/2386761996 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fd6c003a030 msgr2=0x7fd6c0008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:54.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.198+0000 7fd6cccc0640 0 -- 172.21.15.28:0/2386761996 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fd6c00158d0 msgr2=0x7fd6c003b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.404+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 zone default found 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 4 Realm: () 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 zonegroup default 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.405+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.406+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.406+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.406+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.406+0000 7fd6d0f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.406+0000 7fd6d0f40800 20 started sync module instance, tier type = 2024-09-14T11:30:54.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.406+0000 7fd6d0f40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=0 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=1 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=2 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=3 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=4 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=5 2024-09-14T11:30:54.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.416+0000 7fd6d0f40800 20 add_watcher() i=6 2024-09-14T11:30:54.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.417+0000 7fd6d0f40800 20 add_watcher() i=7 2024-09-14T11:30:54.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.417+0000 7fd6d0f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:54.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd582fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:54.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd6d0f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd6d0f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd6d0f40800 5 note: GC not initialized 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd581fe3640 20 reqs_thread_entry: start 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd6d0f40800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.419+0000 7fd6d0f40800 20 Filter name: none 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd4f37fe640 20 reqs_thread_entry: start 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:30:54.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 : miss 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:54.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.420+0000 7fd6d0f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.421+0000 7fd6d0f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 2024-09-14T11:30:54.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.424+0000 7fd6d0f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.424+0000 7fd6d0f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.424+0000 7fd6d0f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.424+0000 7fd6d0f40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22, ofs0, ns] 2024-09-14T11:30:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.425+0000 7fd5a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 93902742954176 notifier 6450 bl.length()=925 2024-09-14T11:30:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.425+0000 7fd5a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.425+0000 7fd5a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.425+0000 7fd5a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.427+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): orig_sources= new_sources= 2024-09-14T11:30:54.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.427+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): potential sources added=[] removed=[] 2024-09-14T11:30:54.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.427+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): orig_dests= new_dests= 2024-09-14T11:30:54.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.427+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): potential dests added=[] removed=[] 2024-09-14T11:30:54.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.429+0000 7fd6d0f40800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22.1.0 2024-09-14T11:30:54.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.429+0000 7fd6d0f40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22.1.0 2024-09-14T11:30:54.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.429+0000 7fd6d0f40800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22.1.1 2024-09-14T11:30:54.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.429+0000 7fd6d0f40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22.1.1 2024-09-14T11:30:54.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.429+0000 7fd6d0f40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22.0 2024-09-14T11:30:54.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.431+0000 7fd6d0f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:54.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.431+0000 7fd6d0f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd6d0f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd6d0f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd6d0f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd6d0f40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22, ofs0, ns] 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd5a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 93902742954176 notifier 6450 bl.length()=925 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd5a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd5a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.433+0000 7fd5a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.435+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): orig_sources= new_sources= 2024-09-14T11:30:54.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.435+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): potential sources added=[] removed=[] 2024-09-14T11:30:54.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.435+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): orig_dests= new_dests= 2024-09-14T11:30:54.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.435+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): potential dests added=[] removed=[] 2024-09-14T11:30:54.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.436+0000 7fd6d0f40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22.0 2024-09-14T11:30:54.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.436+0000 7fd6d0f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:54.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.436+0000 7fd6d0f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 2024-09-14T11:30:54.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.437+0000 7fd6d0f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.437+0000 7fd6d0f40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.437+0000 7fd6d0f40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.437+0000 7fd6d0f40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22, ofs0, ns] 2024-09-14T11:30:54.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.438+0000 7fd5a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 93902742954176 notifier 6450 bl.length()=893 2024-09-14T11:30:54.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.438+0000 7fd5a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 info.flags=0x17 2024-09-14T11:30:54.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.438+0000 7fd5a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 to cache LRU end 2024-09-14T11:30:54.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.438+0000 7fd5a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:54.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.439+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): orig_sources= new_sources= 2024-09-14T11:30:54.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.439+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): potential sources added=[] removed=[] 2024-09-14T11:30:54.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.439+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): orig_dests= new_dests= 2024-09-14T11:30:54.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.439+0000 7fd6d0f40800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22]): potential dests added=[] removed=[] 2024-09-14T11:30:54.438 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.440+0000 7fd6d0f40800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:30:54.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.442+0000 7fd582fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:54.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.445+0000 7fd6d0f40800 20 remove_watcher() i=0 2024-09-14T11:30:54.442 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.445+0000 7fd6d0f40800 2 removed watcher, disabling cache 2024-09-14T11:30:54.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.446+0000 7fd6d0f40800 20 remove_watcher() i=1 2024-09-14T11:30:54.445 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.447+0000 7fd6d0f40800 20 remove_watcher() i=2 2024-09-14T11:30:54.446 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.448+0000 7fd6d0f40800 20 remove_watcher() i=3 2024-09-14T11:30:54.447 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.449+0000 7fd6d0f40800 20 remove_watcher() i=4 2024-09-14T11:30:54.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.450+0000 7fd6d0f40800 20 remove_watcher() i=5 2024-09-14T11:30:54.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.451+0000 7fd6d0f40800 20 remove_watcher() i=6 2024-09-14T11:30:54.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.452+0000 7fd6d0f40800 20 remove_watcher() i=7 2024-09-14T11:30:54.463 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:54.492 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:54.492 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:54.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.532+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 realm 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.534+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.535+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:54.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.535+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.535+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:54.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.535+0000 7f589a123800 20 searching for the correct realm 2024-09-14T11:30:54.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.539+0000 7f58955ad640 0 -- 172.21.15.28:0/804036439 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55e3fa5a95d0 msgr2=0x55e3fa5ab9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:54.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.543+0000 7f5895dae640 0 -- 172.21.15.28:0/804036439 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f588c0bb040 msgr2=0x7f588c0af6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.547+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:54.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:54.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 zone default found 2024-09-14T11:30:54.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 4 Realm: () 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 zonegroup default 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.548+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 started sync module instance, tier type = 2024-09-14T11:30:54.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.549+0000 7f589a123800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:54.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=0 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=1 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=2 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=3 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=4 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=5 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.558+0000 7f589a123800 20 add_watcher() i=6 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.559+0000 7f589a123800 20 add_watcher() i=7 2024-09-14T11:30:54.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.559+0000 7f589a123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:54.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.561+0000 7f57477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:54.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.561+0000 7f589a123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:54.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.561+0000 7f589a123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:54.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f589a123800 5 note: GC not initialized 2024-09-14T11:30:54.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f57467fc640 20 reqs_thread_entry: start 2024-09-14T11:30:54.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f589a123800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:54.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f589a123800 20 Filter name: none 2024-09-14T11:30:54.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f56b7fff640 20 reqs_thread_entry: start 2024-09-14T11:30:54.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:54.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.562+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.563+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.563+0000 7f589a123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.563+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.563+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.563+0000 7f589a123800 20 rados->read ofs=0 len=0 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.564+0000 7f589a123800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:54.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.564+0000 7f589a123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:54.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.565+0000 7f57477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:54.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.567+0000 7f589a123800 20 remove_watcher() i=0 2024-09-14T11:30:54.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.567+0000 7f589a123800 2 removed watcher, disabling cache 2024-09-14T11:30:54.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.568+0000 7f589a123800 20 remove_watcher() i=1 2024-09-14T11:30:54.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.569+0000 7f589a123800 20 remove_watcher() i=2 2024-09-14T11:30:54.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.571+0000 7f589a123800 20 remove_watcher() i=3 2024-09-14T11:30:54.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.572+0000 7f589a123800 20 remove_watcher() i=4 2024-09-14T11:30:54.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.572+0000 7f589a123800 20 remove_watcher() i=5 2024-09-14T11:30:54.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.573+0000 7f589a123800 20 remove_watcher() i=6 2024-09-14T11:30:54.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:54.574+0000 7f589a123800 20 remove_watcher() i=7 2024-09-14T11:30:54.584 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:54.585 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:54.585 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:30:54.585 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:54.905 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:30:54.905 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:55.759 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:55.788 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:55.788 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:55.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.827+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:55.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 realm 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:55.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.829+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:55.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.830+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:55.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.830+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:55.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.831+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:55.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.831+0000 7fe296daf800 20 searching for the correct realm 2024-09-14T11:30:55.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.834+0000 7fe294098640 0 -- 172.21.15.28:0/1898405970 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fe284030020 msgr2=0x7fe28408b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:55.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:55.837+0000 7fe294899640 0 -- 172.21.15.28:0/1898405970 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fe2880a80e0 msgr2=0x7fe288094910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:56.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:56.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:56.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:56.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:56.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:56.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.044+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 zone default found 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 4 Realm: () 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 zonegroup default 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.045+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.046+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.046+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.046+0000 7fe296daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.046+0000 7fe296daf800 20 started sync module instance, tier type = 2024-09-14T11:30:56.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.046+0000 7fe296daf800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:56.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=0 2024-09-14T11:30:56.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=1 2024-09-14T11:30:56.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=2 2024-09-14T11:30:56.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=3 2024-09-14T11:30:56.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=4 2024-09-14T11:30:56.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=5 2024-09-14T11:30:56.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.055+0000 7fe296daf800 20 add_watcher() i=6 2024-09-14T11:30:56.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.056+0000 7fe296daf800 20 add_watcher() i=7 2024-09-14T11:30:56.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.056+0000 7fe296daf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:56.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.058+0000 7fe14b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.058+0000 7fe296daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.058+0000 7fe296daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.058+0000 7fe296daf800 5 note: GC not initialized 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe14a7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe296daf800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe296daf800 20 Filter name: none 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe143fff640 20 reqs_thread_entry: start 2024-09-14T11:30:56.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.059+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.060+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.060+0000 7fe296daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.060+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.060+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.060+0000 7fe296daf800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.061+0000 7fe296daf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:56.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.061+0000 7fe296daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:56.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.062+0000 7fe14b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.064+0000 7fe296daf800 20 remove_watcher() i=0 2024-09-14T11:30:56.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.064+0000 7fe296daf800 2 removed watcher, disabling cache 2024-09-14T11:30:56.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.065+0000 7fe296daf800 20 remove_watcher() i=1 2024-09-14T11:30:56.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.066+0000 7fe296daf800 20 remove_watcher() i=2 2024-09-14T11:30:56.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.067+0000 7fe296daf800 20 remove_watcher() i=3 2024-09-14T11:30:56.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.068+0000 7fe296daf800 20 remove_watcher() i=4 2024-09-14T11:30:56.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.069+0000 7fe296daf800 20 remove_watcher() i=5 2024-09-14T11:30:56.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.070+0000 7fe296daf800 20 remove_watcher() i=6 2024-09-14T11:30:56.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.071+0000 7fe296daf800 20 remove_watcher() i=7 2024-09-14T11:30:56.082 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:56.082 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:56.082 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:56.082 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:56.083 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:30:56.122 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:56.122 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:56.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.163+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.164+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.164+0000 7f2a8d487800 20 realm 2024-09-14T11:30:56.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.164+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.164+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.164+0000 7f2a8d487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:56.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.164+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.165+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.164 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.165+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.165+0000 7f2a8d487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.165+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.166+0000 7f2a8d487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:56.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.166+0000 7f2a8d487800 20 searching for the correct realm 2024-09-14T11:30:56.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.169+0000 7f2a8a770640 0 -- 172.21.15.28:0/3361414358 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f2a7c0ba620 msgr2=0x7f2a7c0b9ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.172+0000 7f2a8af71640 0 -- 172.21.15.28:0/3361414358 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f2a8008bb30 msgr2=0x7f2a8008b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.379+0000 7f2a8d487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:56.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 zone default found 2024-09-14T11:30:56.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 4 Realm: () 2024-09-14T11:30:56.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 zonegroup default 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.380+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.381+0000 7f2a8d487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.381+0000 7f2a8d487800 20 started sync module instance, tier type = 2024-09-14T11:30:56.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.381+0000 7f2a8d487800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=0 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=1 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=2 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=3 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=4 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=5 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.390+0000 7f2a8d487800 20 add_watcher() i=6 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.391+0000 7f2a8d487800 20 add_watcher() i=7 2024-09-14T11:30:56.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.391+0000 7f2a8d487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:56.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.392+0000 7f29417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:56.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:56.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 5 note: GC not initialized 2024-09-14T11:30:56.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f28bbfff640 20 reqs_thread_entry: start 2024-09-14T11:30:56.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:56.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 20 Filter name: none 2024-09-14T11:30:56.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f28b9ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:56.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:30:56.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.393+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 : miss 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.394+0000 7f2a8d487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 2024-09-14T11:30:56.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.397+0000 7f2a8d487800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:30:56.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.398+0000 7f2a8d487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.398+0000 7f2a8d487800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.398+0000 7f2a8d487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.398+0000 7f2a8d487800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23, ofs0, ns] 2024-09-14T11:30:56.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.399+0000 7f296dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 94702178437376 notifier 6507 bl.length()=925 2024-09-14T11:30:56.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.399+0000 7f296dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.399+0000 7f296dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.399+0000 7f296dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.401+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): orig_sources= new_sources= 2024-09-14T11:30:56.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.401+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): potential sources added=[] removed=[] 2024-09-14T11:30:56.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.401+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): orig_dests= new_dests= 2024-09-14T11:30:56.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.401+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): potential dests added=[] removed=[] 2024-09-14T11:30:56.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.403+0000 7f2a8d487800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23.1.0 2024-09-14T11:30:56.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.403+0000 7f2a8d487800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23.1.0 2024-09-14T11:30:56.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.403+0000 7f2a8d487800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23.1.1 2024-09-14T11:30:56.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.403+0000 7f2a8d487800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23.1.1 2024-09-14T11:30:56.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.403+0000 7f2a8d487800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23.0 2024-09-14T11:30:56.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.406+0000 7f2a8d487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:56.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.406+0000 7f2a8d487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 2024-09-14T11:30:56.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.407+0000 7f2a8d487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.407+0000 7f2a8d487800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.407+0000 7f2a8d487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.407+0000 7f2a8d487800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23, ofs0, ns] 2024-09-14T11:30:56.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.408+0000 7f296dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94702178437376 notifier 6507 bl.length()=925 2024-09-14T11:30:56.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.408+0000 7f296dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.408+0000 7f296dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.408+0000 7f296dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.409+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): orig_sources= new_sources= 2024-09-14T11:30:56.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.409+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): potential sources added=[] removed=[] 2024-09-14T11:30:56.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.409+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): orig_dests= new_dests= 2024-09-14T11:30:56.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.409+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): potential dests added=[] removed=[] 2024-09-14T11:30:56.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.410+0000 7f2a8d487800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23.0 2024-09-14T11:30:56.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.410+0000 7f2a8d487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:56.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.411+0000 7f2a8d487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 2024-09-14T11:30:56.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f2a8d487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f2a8d487800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f2a8d487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f2a8d487800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23, ofs0, ns] 2024-09-14T11:30:56.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f296e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94702178437376 notifier 6507 bl.length()=893 2024-09-14T11:30:56.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f296e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 info.flags=0x17 2024-09-14T11:30:56.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f296e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 to cache LRU end 2024-09-14T11:30:56.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.412+0000 7f296e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:56.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.414+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): orig_sources= new_sources= 2024-09-14T11:30:56.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.414+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): potential sources added=[] removed=[] 2024-09-14T11:30:56.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.414+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): orig_dests= new_dests= 2024-09-14T11:30:56.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.414+0000 7f2a8d487800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23]): potential dests added=[] removed=[] 2024-09-14T11:30:56.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.414+0000 7f2a8d487800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:30:56.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.416+0000 7f29417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.418+0000 7f2a8d487800 20 remove_watcher() i=0 2024-09-14T11:30:56.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.418+0000 7f2a8d487800 2 removed watcher, disabling cache 2024-09-14T11:30:56.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.420+0000 7f2a8d487800 20 remove_watcher() i=1 2024-09-14T11:30:56.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.421+0000 7f2a8d487800 20 remove_watcher() i=2 2024-09-14T11:30:56.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.422+0000 7f2a8d487800 20 remove_watcher() i=3 2024-09-14T11:30:56.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.423+0000 7f2a8d487800 20 remove_watcher() i=4 2024-09-14T11:30:56.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.424+0000 7f2a8d487800 20 remove_watcher() i=5 2024-09-14T11:30:56.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.425+0000 7f2a8d487800 20 remove_watcher() i=6 2024-09-14T11:30:56.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.426+0000 7f2a8d487800 20 remove_watcher() i=7 2024-09-14T11:30:56.438 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:56.467 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:56.467 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:56.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.507+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.509+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.509+0000 7f250032e800 20 realm 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.509+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.509+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.509+0000 7f250032e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.509+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.510+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.510+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.511+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.511+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.511+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:56.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.511+0000 7f250032e800 20 searching for the correct realm 2024-09-14T11:30:56.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.513+0000 7f24fbf64640 0 -- 172.21.15.28:0/1902113252 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f24f4074040 msgr2=0x7f24f405a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.718+0000 7f24fc765640 0 -- 172.21.15.28:0/1902113252 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f24e408e070 msgr2=0x7f24e4070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:56.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:56.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.723+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:56.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:56.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 zone default found 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 4 Realm: () 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 zonegroup default 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.724+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.725+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.725+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.725+0000 7f250032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.725+0000 7f250032e800 20 started sync module instance, tier type = 2024-09-14T11:30:56.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.725+0000 7f250032e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:56.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=0 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=1 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=2 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=3 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=4 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=5 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.734+0000 7f250032e800 20 add_watcher() i=6 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.735+0000 7f250032e800 20 add_watcher() i=7 2024-09-14T11:30:56.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.735+0000 7f250032e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:56.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.737+0000 7f23b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.737+0000 7f250032e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.737+0000 7f250032e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.737+0000 7f250032e800 5 note: GC not initialized 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f23b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f250032e800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f250032e800 20 Filter name: none 2024-09-14T11:30:56.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f232a7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:56.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:56.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.738+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.739+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.739+0000 7f250032e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.739+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.739+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.739+0000 7f250032e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.740+0000 7f250032e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:56.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.740+0000 7f250032e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:56.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.741+0000 7f23b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:56.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.743+0000 7f250032e800 20 remove_watcher() i=0 2024-09-14T11:30:56.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.743+0000 7f250032e800 2 removed watcher, disabling cache 2024-09-14T11:30:56.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.744+0000 7f250032e800 20 remove_watcher() i=1 2024-09-14T11:30:56.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.745+0000 7f250032e800 20 remove_watcher() i=2 2024-09-14T11:30:56.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.746+0000 7f250032e800 20 remove_watcher() i=3 2024-09-14T11:30:56.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.747+0000 7f250032e800 20 remove_watcher() i=4 2024-09-14T11:30:56.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.748+0000 7f250032e800 20 remove_watcher() i=5 2024-09-14T11:30:56.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.749+0000 7f250032e800 20 remove_watcher() i=6 2024-09-14T11:30:56.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:56.750+0000 7f250032e800 20 remove_watcher() i=7 2024-09-14T11:30:56.760 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:56.760 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:56.760 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:30:56.760 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:57.087 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:30:57.087 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:57.933 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:30:57.962 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:57.962 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:58.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.002+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 realm 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.004+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.005+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.005+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.005+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.005+0000 7f3cac134800 20 searching for the correct realm 2024-09-14T11:30:58.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.008+0000 7f3ca76b6640 0 -- 172.21.15.28:0/2962839057 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f3c98018070 msgr2=0x7f3c9808a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.011+0000 7f3ca7eb7640 0 -- 172.21.15.28:0/2962839057 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f3c90043430 msgr2=0x7f3c90043890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:58.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:58.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:58.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.217+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 zone default found 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 4 Realm: () 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 zonegroup default 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.218+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.219+0000 7f3cac134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.219+0000 7f3cac134800 20 started sync module instance, tier type = 2024-09-14T11:30:58.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.219+0000 7f3cac134800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=0 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=1 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=2 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=3 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=4 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=5 2024-09-14T11:30:58.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.228+0000 7f3cac134800 20 add_watcher() i=6 2024-09-14T11:30:58.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.229+0000 7f3cac134800 20 add_watcher() i=7 2024-09-14T11:30:58.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.229+0000 7f3cac134800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.230+0000 7f3b5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3cac134800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3cac134800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3cac134800 5 note: GC not initialized 2024-09-14T11:30:58.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3b5cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:58.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3cac134800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:58.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3cac134800 20 Filter name: none 2024-09-14T11:30:58.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3ad67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:58.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.231+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.232+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.232+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.233+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.233+0000 7f3cac134800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:58.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.233+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.233+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.233+0000 7f3cac134800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.234+0000 7f3cac134800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.234+0000 7f3cac134800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:58.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.235+0000 7f3b5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.237+0000 7f3cac134800 20 remove_watcher() i=0 2024-09-14T11:30:58.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.237+0000 7f3cac134800 2 removed watcher, disabling cache 2024-09-14T11:30:58.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.238+0000 7f3cac134800 20 remove_watcher() i=1 2024-09-14T11:30:58.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.239+0000 7f3cac134800 20 remove_watcher() i=2 2024-09-14T11:30:58.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.240+0000 7f3cac134800 20 remove_watcher() i=3 2024-09-14T11:30:58.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.241+0000 7f3cac134800 20 remove_watcher() i=4 2024-09-14T11:30:58.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.242+0000 7f3cac134800 20 remove_watcher() i=5 2024-09-14T11:30:58.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.243+0000 7f3cac134800 20 remove_watcher() i=6 2024-09-14T11:30:58.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.244+0000 7f3cac134800 20 remove_watcher() i=7 2024-09-14T11:30:58.254 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.254 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:58.254 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:58.254 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.255 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:30:58.290 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:58.290 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:58.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.331+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.332+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.332+0000 7f95545ad800 20 realm 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.332+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.333+0000 7f95545ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.334+0000 7f95545ad800 20 searching for the correct realm 2024-09-14T11:30:58.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.337+0000 7f9551896640 0 -- 172.21.15.28:0/2239302733 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9544027040 msgr2=0x7f95440389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.340+0000 7f9552097640 0 -- 172.21.15.28:0/2239302733 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9548060190 msgr2=0x7f9548049700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.546+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 zone default found 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 4 Realm: () 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 zonegroup default 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.548+0000 7f95545ad800 20 started sync module instance, tier type = 2024-09-14T11:30:58.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.548+0000 7f95545ad800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:58.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=0 2024-09-14T11:30:58.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=1 2024-09-14T11:30:58.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=2 2024-09-14T11:30:58.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=3 2024-09-14T11:30:58.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=4 2024-09-14T11:30:58.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=5 2024-09-14T11:30:58.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=6 2024-09-14T11:30:58.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.558+0000 7f95545ad800 20 add_watcher() i=7 2024-09-14T11:30:58.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.558+0000 7f95545ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f9408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f95545ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f95545ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f95545ad800 5 note: GC not initialized 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f93837fe640 20 reqs_thread_entry: start 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f95545ad800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.560+0000 7f95545ad800 20 Filter name: none 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f93817fa640 20 reqs_thread_entry: start 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:58.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : miss 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:58.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:58.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.561+0000 7f95545ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:30:58.563 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95545ad800 time 2024-09-14T11:30:58.565883+0000 2024-09-14T11:30:58.563 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9557b8c76a] 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.565+0000 7f95545ad800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95545ad800 time 2024-09-14T11:30:58.565883+0000 2024-09-14T11:30:58.564 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9557b8c76a] 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:30:58.565 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f95545ad800 thread_name:radosgw-admin 2024-09-14T11:30:58.584 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f955683e6f0] 2024-09-14T11:30:58.584 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f955688b99c] 2024-09-14T11:30:58.584 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:58.584 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:58.584 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9557b8c7c4] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.565+0000 7f95545ad800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f95545ad800 thread_name:radosgw-admin 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f955683e6f0] 2024-09-14T11:30:58.585 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f955688b99c] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9557b8c7c4] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:30:58.586 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: dump: 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.587 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 monclient: authenticate success, global_id 6176 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: dump: 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.588 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:30:58.313+0000 7f95545ad800 4 set_mon_vals no callback set 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: shutdown 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 asok(0x55f25ed58270) unregister_commands rotate-key 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:30:58.313+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.589 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding auth protocol: cephx 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding auth protocol: cephx 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding auth protocol: cephx 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.590 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:30:58.314+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: starting msgr at 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: starting objecter 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command objecter_requests hook 0x55f25ef7c6f0 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: setting wanted keys 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: calling monclient init 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding auth protocol: cephx 2024-09-14T11:30:58.591 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding auth protocol: cephx 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding auth protocol: cephx 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.592 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:30:58.314+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:30:58.314+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key hook 0x55f25ef78808 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25ee02170 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25ee25ec0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25eebb940 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.593 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.956911s 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25ee25ec0 auth_method 0 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25eebb940 auth_method 0 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25ee02170 auth_method 0 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.594 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_done global_id 6179 payload 824 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:30:58.315+0000 7f9551896640 1 monclient: found mon.noname-c 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.595 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: dump: 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.596 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: dump: 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.597 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:30:58.315+0000 7f95545ad800 5 monclient: authenticate success, global_id 6179 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:30:58.315+0000 7f9440608640 4 set_mon_vals no callback set 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:30:58.315+0000 7f95545ad800 1 librados: init done 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:30:58.317+0000 7f943ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:30:58.317+0000 7f943ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:30:58.317+0000 7f943ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:30:58.317+0000 7f9552097640 10 monclient: get_auth_request con 0x7f9438077230 auth_method 0 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:30:58.318+0000 7f9552898640 10 monclient: get_auth_request con 0x55f25efa1650 auth_method 0 2024-09-14T11:30:58.598 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:30:58.318+0000 7f9552097640 10 monclient: get_auth_request con 0x55f25efc3fd0 auth_method 0 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:30:58.320+0000 7f9551896640 10 monclient: get_auth_request con 0x55f25efc9060 auth_method 0 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:30:58.321+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:30:58.321+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:30:58.321+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding auth protocol: cephx 2024-09-14T11:30:58.599 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding auth protocol: cephx 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding auth protocol: cephx 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.600 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:30:58.321+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command objecter_requests cmddesc objecter_requests hook 0x55f25efd0540 EEXIST 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:30:58.321+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding auth protocol: cephx 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding auth protocol: cephx 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding auth protocol: cephx 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.601 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:30:58.322+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:30:58.322+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:30:58.322+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key cmddesc rotate-key hook 0x55f25efcc0e0 EEXIST 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25eff4860 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25eff4c40 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25eff3570 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.602 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.964387s 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25eff4c40 auth_method 0 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25eff3570 auth_method 0 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.603 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25eff4860 auth_method 0 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_done global_id 6182 payload 824 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:30:58.322+0000 7f9552898640 1 monclient: found mon.noname-c 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: dump: 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.604 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: dump: 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.605 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:30:58.323+0000 7f95545ad800 5 monclient: authenticate success, global_id 6182 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:30:58.323+0000 7f9553099640 4 set_mon_vals no callback set 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:30:58.325+0000 7f9437fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:58.606 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:30:58.325+0000 7f9437fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:30:58.325+0000 7f9437fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:30:58.325+0000 7f9552097640 10 monclient: get_auth_request con 0x7f942c077140 auth_method 0 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: get_monmap_and_config 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:30:58.325+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.607 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding auth protocol: cephx 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding auth protocol: cephx 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding auth protocol: cephx 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.608 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:30:58.325+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding auth protocol: cephx 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding auth protocol: cephx 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding auth protocol: cephx 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.609 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:30:58.326+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:30:58.326+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:30:58.326+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:30:58.326+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key cmddesc rotate-key hook 0x7ffcd782f778 EEXIST 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25f048d50 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25f019ca0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25f0445f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.610 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.968538s 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25f048d50 auth_method 0 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25f019ca0 auth_method 0 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25f0445f0 auth_method 0 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.611 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_done global_id 6185 payload 274 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:30:58.326+0000 7f9551896640 1 monclient: found mon.noname-c 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: dump: 2024-09-14T11:30:58.612 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 monclient: authenticate success, global_id 6185 2024-09-14T11:30:58.613 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:30:58.327+0000 7f95545ad800 4 set_mon_vals no callback set 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: dump: 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.614 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: shutdown 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:30:58.327+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.615 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding auth protocol: cephx 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding auth protocol: cephx 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding auth protocol: cephx 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:30:58.328+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.616 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: starting msgr at 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: starting objecter 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command objecter_requests cmddesc objecter_requests hook 0x55f25f044a50 EEXIST 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: setting wanted keys 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: calling monclient init 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding auth protocol: cephx 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding auth protocol: cephx 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding auth protocol: cephx 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.617 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:30:58.328+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:30:58.328+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key cmddesc rotate-key hook 0x55f25f009268 EEXIST 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:58.618 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25f019ca0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25f0445f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25f048d50 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.970775s 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25f019ca0 auth_method 0 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.619 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25f048d50 auth_method 0 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:30:58.329+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:30:58.329+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.620 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25f0445f0 auth_method 0 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:30:58.329+0000 7f9552097640 10 monclient(hunting): handle_auth_done global_id 6561 payload 824 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:30:58.329+0000 7f9552097640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:30:58.329+0000 7f9552097640 1 monclient: found mon.noname-a 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:30:58.329+0000 7f9552097640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: dump: 2024-09-14T11:30:58.621 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.622 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: dump: 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:30:58.329+0000 7f95545ad800 5 monclient: authenticate success, global_id 6561 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:30:58.329+0000 7f9435ffb640 4 set_mon_vals no callback set 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.623 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:30:58.329+0000 7f95545ad800 1 librados: init done 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:30:58.329+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cr dump hook 0x55f25f03f978 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:30:58.331+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:30:58.331+0000 7f9423fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:30:58.331+0000 7f9423fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:30:58.331+0000 7f9423fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:30:58.332+0000 7f9551896640 10 monclient: get_auth_request con 0x7f941c077230 auth_method 0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:30:58.332+0000 7f9552898640 10 monclient: get_auth_request con 0x55f25f063350 auth_method 0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:30:58.332+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:30:58.332+0000 7f95545ad800 20 realm 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:30:58.332+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:30:58.333+0000 7f95545ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.624 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:30:58.333+0000 7f9552097640 10 monclient: get_auth_request con 0x55f25f067580 auth_method 0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 searching for the correct realm 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:30:58.334+0000 7f9551896640 10 monclient: get_auth_request con 0x55f25f06c830 auth_method 0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:30:58.335+0000 7f9552898640 10 monclient: get_auth_request con 0x7f954806b210 auth_method 0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:30:58.336+0000 7f9552097640 10 monclient: get_auth_request con 0x7f954c0bfbe0 auth_method 0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:30:58.336+0000 7f9551896640 10 monclient: get_auth_request con 0x7f9544027040 auth_method 0 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:30:58.337+0000 7f9551896640 0 -- 172.21.15.28:0/2239302733 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9544027040 msgr2=0x7f95440389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:30:58.337+0000 7f9423fff640 1 client.6561.objecter ms_handle_reset 0x7f9544027040 session 0x7f9544040040 osd.4 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:30:58.337+0000 7f9423fff640 10 monclient: _renew_subs 2024-09-14T11:30:58.625 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:30:58.337+0000 7f9423fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:30:58.337+0000 7f9551896640 10 monclient: get_auth_request con 0x7f941c087960 auth_method 0 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:30:58.338+0000 7f9552898640 10 monclient: get_auth_request con 0x7f954805d2c0 auth_method 0 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:30:58.340+0000 7f9552097640 10 monclient: get_auth_request con 0x7f9548060190 auth_method 0 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:30:58.340+0000 7f9552097640 0 -- 172.21.15.28:0/2239302733 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9548060190 msgr2=0x7f9548049700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:30:58.541+0000 7f9552097640 10 monclient: get_auth_request con 0x7f9548060190 auth_method 0 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.626 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 zone default found 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:30:58.547+0000 7f95545ad800 4 Realm: () 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:30:58.547+0000 7f95545ad800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:30:58.547+0000 7f95545ad800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:30:58.547+0000 7f95545ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 zonegroup default 2024-09-14T11:30:58.627 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 started sync module instance, tier type = 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=0 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=1 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=2 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=3 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=4 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=5 2024-09-14T11:30:58.628 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=6 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:30:58.558+0000 7f95545ad800 20 add_watcher() i=7 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:30:58.558+0000 7f95545ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding auth protocol: cephx 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding auth protocol: cephx 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding auth protocol: cephx 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.629 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:30:58.560+0000 7f9408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:30:58.560+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache list hook 0x55f25f041f30 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache inspect hook 0x55f25f041f30 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache erase hook 0x55f25f041f30 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache zap hook 0x55f25f041f30 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 note: GC not initialized 2024-09-14T11:30:58.630 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:30:58.560+0000 7f93837fe640 20 reqs_thread_entry: start 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace show hook 0x7f954800f070 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace history hook 0x7f954800f070 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace active hook 0x7f954800f070 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace active_short hook 0x7f954800f070 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 Filter name: none 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:30:58.561+0000 7f93817fa640 20 reqs_thread_entry: start 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : miss 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.631 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:30:58.565+0000 7f95545ad800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95545ad800 time 2024-09-14T11:30:58.565883+0000 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9557b8c76a] 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.632 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:30:58.565+0000 7f95545ad800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f95545ad800 thread_name:radosgw-admin 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f955683e6f0] 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f955688b99c] 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:58.633 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9557b8c7c4] 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:30:58.634 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:30:58.635 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:30:58.636 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:30:58.637 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:30:58.638 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:58.639 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:30:58.640 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 7f93817fa640 / http_manager 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 7f93837fe640 / http_manager 2024-09-14T11:30:58.641 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9408fe1640 / rgw_dt_lg_renew 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9423fff640 / ms_dispatch 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9435ffb640 / io_context_pool 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9437fff640 / ms_dispatch 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f943ee05640 / ms_dispatch 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9440608640 / io_context_pool 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9551896640 / msgr-worker-2 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9552097640 / msgr-worker-1 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9552898640 / msgr-worker-0 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9553099640 / io_context_pool 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: 7f95545ad800 / radosgw-admin 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.97290.log 2024-09-14T11:30:58.642 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: dump: 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.643 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 monclient: authenticate success, global_id 6176 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:30:58.313+0000 7f9440608640 10 monclient: dump: 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.644 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:30:58.313+0000 7f95545ad800 4 set_mon_vals no callback set 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: shutdown 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 asok(0x55f25ed58270) unregister_commands rotate-key 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:30:58.313+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:30:58.313+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.645 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding auth protocol: cephx 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding auth protocol: cephx 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding auth protocol: cephx 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.646 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: crc 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:30:58.313+0000 7f95545ad800 5 AuthRegistry(0x55f25ef7e240) adding con mode: secure 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:30:58.314+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: starting msgr at 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: starting objecter 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command objecter_requests hook 0x55f25ef7c6f0 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: setting wanted keys 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:30:58.314+0000 7f95545ad800 1 librados: calling monclient init 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding auth protocol: cephx 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding auth protocol: cephx 2024-09-14T11:30:58.647 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding auth protocol: cephx 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: crc 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 AuthRegistry(0x55f25ef786c0) adding con mode: secure 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:30:58.314+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.648 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:30:58.314+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:30:58.314+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key hook 0x55f25ef78808 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25ee02170 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25ee25ec0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25eebb940 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:30:58.314+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.956911s 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25ee25ec0 auth_method 0 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.649 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25eebb940 auth_method 0 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25ee02170 auth_method 0 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.650 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:30:58.315+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:30:58.315+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient(hunting): handle_auth_done global_id 6179 payload 824 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:30:58.315+0000 7f9551896640 1 monclient: found mon.noname-c 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:30:58.315+0000 7f9551896640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: dump: 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.651 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.652 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:30:58.315+0000 7f943ee05640 10 monclient: dump: 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:30:58.315+0000 7f95545ad800 5 monclient: authenticate success, global_id 6179 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:30:58.315+0000 7f9440608640 4 set_mon_vals no callback set 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.653 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:30:58.315+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:30:58.315+0000 7f95545ad800 1 librados: init done 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:30:58.317+0000 7f943ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:30:58.317+0000 7f943ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:30:58.317+0000 7f943ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:30:58.317+0000 7f9552097640 10 monclient: get_auth_request con 0x7f9438077230 auth_method 0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:30:58.318+0000 7f9552898640 10 monclient: get_auth_request con 0x55f25efa1650 auth_method 0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:30:58.318+0000 7f9552097640 10 monclient: get_auth_request con 0x55f25efc3fd0 auth_method 0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:30:58.320+0000 7f9551896640 10 monclient: get_auth_request con 0x55f25efc9060 auth_method 0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:30:58.321+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:30:58.321+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:30:58.321+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.654 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding auth protocol: cephx 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding auth protocol: cephx 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding auth protocol: cephx 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.655 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: crc 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcd120) adding con mode: secure 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:30:58.321+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command objecter_requests cmddesc objecter_requests hook 0x55f25efd0540 EEXIST 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:30:58.321+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding auth protocol: cephx 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding auth protocol: cephx 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding auth protocol: cephx 2024-09-14T11:30:58.656 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: crc 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:30:58.321+0000 7f95545ad800 5 AuthRegistry(0x55f25efcbf98) adding con mode: secure 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:30:58.322+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:30:58.322+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:30:58.322+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key cmddesc rotate-key hook 0x55f25efcc0e0 EEXIST 2024-09-14T11:30:58.657 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25eff4860 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25eff4c40 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25eff3570 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:30:58.322+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.964387s 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25eff4c40 auth_method 0 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25eff3570 auth_method 0 2024-09-14T11:30:58.658 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:30:58.322+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25eff4860 auth_method 0 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:30:58.322+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient(hunting): handle_auth_done global_id 6182 payload 824 2024-09-14T11:30:58.659 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:30:58.322+0000 7f9552898640 1 monclient: found mon.noname-c 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:30:58.322+0000 7f9552898640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: dump: 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.660 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:30:58.323+0000 7f9437fff640 10 monclient: dump: 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.661 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:30:58.323+0000 7f95545ad800 5 monclient: authenticate success, global_id 6182 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:30:58.323+0000 7f9553099640 4 set_mon_vals no callback set 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:30:58.323+0000 7f95545ad800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:30:58.325+0000 7f9437fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:30:58.325+0000 7f9437fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:30:58.325+0000 7f9437fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.662 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:30:58.325+0000 7f9552097640 10 monclient: get_auth_request con 0x7f942c077140 auth_method 0 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: get_monmap_and_config 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:30:58.325+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.663 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding auth protocol: cephx 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding auth protocol: cephx 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding auth protocol: cephx 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: crc 2024-09-14T11:30:58.664 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x55f25f0146b0) adding con mode: secure 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:30:58.325+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:30:58.325+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding auth protocol: cephx 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding auth protocol: cephx 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding auth protocol: cephx 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.665 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:30:58.325+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: crc 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:30:58.326+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782f630) adding con mode: secure 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:30:58.326+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:30:58.326+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:30:58.326+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key cmddesc rotate-key hook 0x7ffcd782f778 EEXIST 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25f048d50 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25f019ca0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25f0445f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.666 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:30:58.326+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.968538s 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25f048d50 auth_method 0 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25f019ca0 auth_method 0 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25f0445f0 auth_method 0 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.667 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:30:58.326+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:30:58.326+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient(hunting): handle_auth_done global_id 6185 payload 274 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:30:58.326+0000 7f9551896640 1 monclient: found mon.noname-c 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:30:58.326+0000 7f9551896640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: dump: 2024-09-14T11:30:58.668 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 monclient: authenticate success, global_id 6185 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:58.669 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:30:58.327+0000 7f95545ad800 4 set_mon_vals no callback set 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:30:58.327+0000 7f9435ffb640 10 monclient: dump: 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.670 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: shutdown 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: build_initial_monmap 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:30:58.327+0000 7f95545ad800 1 build_initial for_mkfs: 0 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:30:58.327+0000 7f95545ad800 10 monclient: monmap: 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:30:58.671 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding auth protocol: cephx 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding auth protocol: cephx 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding auth protocol: cephx 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: crc 2024-09-14T11:30:58.672 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:30:58.327+0000 7f95545ad800 5 AuthRegistry(0x55f25f03b220) adding con mode: secure 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:30:58.328+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: starting msgr at 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: starting objecter 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command objecter_requests cmddesc objecter_requests hook 0x55f25f044a50 EEXIST 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: setting wanted keys 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:30:58.328+0000 7f95545ad800 1 librados: calling monclient init 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient: init 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding auth protocol: cephx 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding auth protocol: cephx 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding auth protocol: cephx 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.673 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: crc 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 AuthRegistry(0x55f25f009120) adding con mode: secure 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:30:58.328+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:30:58.328+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:30:58.328+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command rotate-key cmddesc rotate-key hook 0x55f25f009268 EEXIST 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-a con 0x55f25f019ca0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-b con 0x55f25f0445f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): picked mon.noname-c con 0x55f25f048d50 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:30:58.674 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:30:58.328+0000 7f95545ad800 10 monclient(hunting): authenticate will time out at 1995.970775s 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): get_auth_request con 0x55f25f019ca0 auth_method 0 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): get_auth_request con 0x55f25f048d50 auth_method 0 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.675 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:30:58.328+0000 7f9552097640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:30:58.328+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:30:58.329+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:30:58.329+0000 7f9552898640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): get_auth_request con 0x55f25f0445f0 auth_method 0 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:30:58.329+0000 7f9551896640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:30:58.329+0000 7f9552097640 10 monclient(hunting): handle_auth_done global_id 6561 payload 824 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:30:58.329+0000 7f9552097640 10 monclient: _finish_hunting 0 2024-09-14T11:30:58.676 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:30:58.329+0000 7f9552097640 1 monclient: found mon.noname-a 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:30:58.329+0000 7f9552097640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: dump: 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.677 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: _finish_auth 0 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:30:58.329+0000 7f9423fff640 10 monclient: dump: 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:30:58.678 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:30:58.329+0000 7f95545ad800 5 monclient: authenticate success, global_id 6561 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:30:58.329+0000 7f9435ffb640 4 set_mon_vals no callback set 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _renew_subs 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:30:58.329+0000 7f95545ad800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:30:58.329+0000 7f95545ad800 1 librados: init done 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:30:58.329+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cr dump hook 0x55f25f03f978 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:30:58.331+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:30:58.331+0000 7f9423fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:30:58.331+0000 7f9423fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:30:58.331+0000 7f9423fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:30:58.679 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:30:58.332+0000 7f9551896640 10 monclient: get_auth_request con 0x7f941c077230 auth_method 0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:30:58.332+0000 7f9552898640 10 monclient: get_auth_request con 0x55f25f063350 auth_method 0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:30:58.332+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:30:58.332+0000 7f95545ad800 20 realm 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:30:58.332+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:30:58.333+0000 7f95545ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:30:58.333+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:30:58.333+0000 7f9552097640 10 monclient: get_auth_request con 0x55f25f067580 auth_method 0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.680 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:30:58.334+0000 7f95545ad800 20 searching for the correct realm 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:30:58.334+0000 7f9551896640 10 monclient: get_auth_request con 0x55f25f06c830 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:30:58.335+0000 7f9552898640 10 monclient: get_auth_request con 0x7f954806b210 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:30:58.336+0000 7f9552097640 10 monclient: get_auth_request con 0x7f954c0bfbe0 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:30:58.336+0000 7f9551896640 10 monclient: get_auth_request con 0x7f9544027040 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:30:58.337+0000 7f9551896640 0 -- 172.21.15.28:0/2239302733 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9544027040 msgr2=0x7f95440389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:30:58.337+0000 7f9423fff640 1 client.6561.objecter ms_handle_reset 0x7f9544027040 session 0x7f9544040040 osd.4 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:30:58.337+0000 7f9423fff640 10 monclient: _renew_subs 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:30:58.337+0000 7f9423fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:30:58.337+0000 7f9551896640 10 monclient: get_auth_request con 0x7f941c087960 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:30:58.338+0000 7f9552898640 10 monclient: get_auth_request con 0x7f954805d2c0 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:30:58.340+0000 7f9552097640 10 monclient: get_auth_request con 0x7f9548060190 auth_method 0 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:30:58.340+0000 7f9552097640 0 -- 172.21.15.28:0/2239302733 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9548060190 msgr2=0x7f9548049700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.681 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:30:58.541+0000 7f9552097640 10 monclient: get_auth_request con 0x7f9548060190 auth_method 0 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:30:58.546+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 zone default found 2024-09-14T11:30:58.682 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:30:58.547+0000 7f95545ad800 4 Realm: () 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:30:58.547+0000 7f95545ad800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:30:58.547+0000 7f95545ad800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:30:58.547+0000 7f95545ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 zonegroup default 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:30:58.547+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 started sync module instance, tier type = 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:30:58.548+0000 7f95545ad800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:58.683 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=0 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=1 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=2 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=3 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=4 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=5 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:30:58.557+0000 7f95545ad800 20 add_watcher() i=6 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:30:58.558+0000 7f95545ad800 20 add_watcher() i=7 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:30:58.558+0000 7f95545ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding auth protocol: cephx 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding auth protocol: cephx 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding auth protocol: cephx 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.684 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:30:58.560+0000 7f9408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: crc 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 AuthRegistry(0x7ffcd782fb10) adding con mode: secure 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:30:58.560+0000 7f95545ad800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache list hook 0x55f25f041f30 2024-09-14T11:30:58.685 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache inspect hook 0x55f25f041f30 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache erase hook 0x55f25f041f30 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command cache zap hook 0x55f25f041f30 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 note: GC not initialized 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:30:58.560+0000 7f93837fe640 20 reqs_thread_entry: start 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace show hook 0x7f954800f070 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace history hook 0x7f954800f070 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace active hook 0x7f954800f070 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:30:58.560+0000 7f95545ad800 5 asok(0x55f25ed58270) register_command sync trace active_short hook 0x7f954800f070 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:30:58.560+0000 7f95545ad800 20 Filter name: none 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:30:58.561+0000 7f93817fa640 20 reqs_thread_entry: start 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.686 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : miss 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:30:58.561+0000 7f95545ad800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:30:58.561+0000 7f95545ad800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:30:58.565+0000 7f95545ad800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f95545ad800 time 2024-09-14T11:30:58.565883+0000 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9557b8c76a] 2024-09-14T11:30:58.687 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:30:58.565+0000 7f95545ad800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f95545ad800 thread_name:radosgw-admin 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:58.688 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f955683e6f0] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f955688b99c] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9557b8c7c4] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9557b8c928] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f25d2fb0b1] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd88418) [0x55f25d80e418] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f25d30aefd] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9556829590] 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:30:58.689 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:30:58.690 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:30:58.691 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:58.692 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:30:58.693 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:30:58.694 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:30:58.695 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 7f93817fa640 / http_manager 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 7f93837fe640 / http_manager 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9408fe1640 / rgw_dt_lg_renew 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9423fff640 / ms_dispatch 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9435ffb640 / io_context_pool 2024-09-14T11:30:58.696 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9437fff640 / ms_dispatch 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f943ee05640 / ms_dispatch 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9440608640 / io_context_pool 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9551896640 / msgr-worker-2 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9552097640 / msgr-worker-1 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9552898640 / msgr-worker-0 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9553099640 / io_context_pool 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: 7f95545ad800 / radosgw-admin 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:30:58.567581Z_504e6f21-f73d-4959-87ea-f3d057f66cb7/log 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:30:58.697 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.646+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.648+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.648+0000 7f952d542800 20 realm 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.648+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.649+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.649+0000 7f952d542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.649+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.649+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.649+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.650+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.650+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.650+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:58.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.650+0000 7f952d542800 20 searching for the correct realm 2024-09-14T11:30:58.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.652+0000 7f9529286640 0 -- 172.21.15.28:0/410030727 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x557576f2bb90 msgr2=0x7f9524016400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.857+0000 7f9529a87640 0 -- 172.21.15.28:0/410030727 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f95200c0e20 msgr2=0x7f95200aa9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:58.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:58.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.863+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:58.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:58.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 zone default found 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 4 Realm: () 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 zonegroup default 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.864+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.865+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.865+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.865+0000 7f952d542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.865+0000 7f952d542800 20 started sync module instance, tier type = 2024-09-14T11:30:58.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.865+0000 7f952d542800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:58.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=0 2024-09-14T11:30:58.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=1 2024-09-14T11:30:58.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=2 2024-09-14T11:30:58.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=3 2024-09-14T11:30:58.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=4 2024-09-14T11:30:58.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=5 2024-09-14T11:30:58.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.874+0000 7f952d542800 20 add_watcher() i=6 2024-09-14T11:30:58.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.875+0000 7f952d542800 20 add_watcher() i=7 2024-09-14T11:30:58.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.875+0000 7f952d542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:58.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f93dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f952d542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f952d542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f952d542800 5 note: GC not initialized 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f93defe5640 20 reqs_thread_entry: start 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f952d542800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f952d542800 20 Filter name: none 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.877+0000 7f93dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:58.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.878+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.878+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.878+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.878+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.878+0000 7f952d542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.879+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.879+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.879+0000 7f952d542800 20 rados->read ofs=0 len=0 2024-09-14T11:30:58.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.879+0000 7f952d542800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:58.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.879+0000 7f952d542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:58.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.881+0000 7f93dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:58.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.884+0000 7f952d542800 20 remove_watcher() i=0 2024-09-14T11:30:58.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.884+0000 7f952d542800 2 removed watcher, disabling cache 2024-09-14T11:30:58.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.885+0000 7f952d542800 20 remove_watcher() i=1 2024-09-14T11:30:58.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.886+0000 7f952d542800 20 remove_watcher() i=2 2024-09-14T11:30:58.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.887+0000 7f952d542800 20 remove_watcher() i=3 2024-09-14T11:30:58.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.888+0000 7f952d542800 20 remove_watcher() i=4 2024-09-14T11:30:58.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.889+0000 7f952d542800 20 remove_watcher() i=5 2024-09-14T11:30:58.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.890+0000 7f952d542800 20 remove_watcher() i=6 2024-09-14T11:30:58.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:58.891+0000 7f952d542800 20 remove_watcher() i=7 2024-09-14T11:30:58.900 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.901 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:30:58.901 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:30:58.901 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:30:58.993 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:59.026 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:59.027 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:59.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.067+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 realm 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.069+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.070+0000 7fc22bc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:59.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.070+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.070+0000 7fc22bc14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:59.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.070+0000 7fc22bc14800 20 searching for the correct realm 2024-09-14T11:30:59.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.073+0000 7fc226aca640 0 -- 172.21.15.28:0/2720964131 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5599d28a68a0 msgr2=0x5599d28a8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:59.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.077+0000 7fc2272cb640 0 -- 172.21.15.28:0/2720964131 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fc21c0770b0 msgr2=0x7fc21c0797a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.081+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.082+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.082+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.082+0000 7fc22bc14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.082+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 zone default found 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 4 Realm: () 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 zonegroup default 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.083+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.084+0000 7fc22bc14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:59.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.084+0000 7fc22bc14800 20 started sync module instance, tier type = 2024-09-14T11:30:59.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.084+0000 7fc22bc14800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:30:59.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=0 2024-09-14T11:30:59.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=1 2024-09-14T11:30:59.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=2 2024-09-14T11:30:59.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=3 2024-09-14T11:30:59.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=4 2024-09-14T11:30:59.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=5 2024-09-14T11:30:59.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.092+0000 7fc22bc14800 20 add_watcher() i=6 2024-09-14T11:30:59.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.093+0000 7fc22bc14800 20 add_watcher() i=7 2024-09-14T11:30:59.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.093+0000 7fc22bc14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:59.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.095+0000 7fc0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.095+0000 7fc22bc14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.095+0000 7fc22bc14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.095+0000 7fc22bc14800 5 note: GC not initialized 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.096+0000 7fc0dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.096+0000 7fc22bc14800 20 init_complete bucket index max shards: 1 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.096+0000 7fc22bc14800 20 Filter name: none 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.096+0000 7fc0567fc640 20 reqs_thread_entry: start 2024-09-14T11:30:59.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.096+0000 7fc22bc14800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:59.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.096+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : miss 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 20 rados->read ofs=0 len=0 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:30:59.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.097+0000 7fc22bc14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:30:59.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.099+0000 7fc22bc14800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to be held by another RGW process; skipping for now 2024-09-14T11:30:59.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.099+0000 7fc0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:59.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.102+0000 7fc22bc14800 20 remove_watcher() i=0 2024-09-14T11:30:59.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.102+0000 7fc22bc14800 2 removed watcher, disabling cache 2024-09-14T11:30:59.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.103+0000 7fc22bc14800 20 remove_watcher() i=1 2024-09-14T11:30:59.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.104+0000 7fc22bc14800 20 remove_watcher() i=2 2024-09-14T11:30:59.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.105+0000 7fc22bc14800 20 remove_watcher() i=3 2024-09-14T11:30:59.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.106+0000 7fc22bc14800 20 remove_watcher() i=4 2024-09-14T11:30:59.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.107+0000 7fc22bc14800 20 remove_watcher() i=5 2024-09-14T11:30:59.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.108+0000 7fc22bc14800 20 remove_watcher() i=6 2024-09-14T11:30:59.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:30:59.109+0000 7fc22bc14800 20 remove_watcher() i=7 2024-09-14T11:30:59.119 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:31:29.152 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:29.190 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:29.190 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:29.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.238+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 realm 2024-09-14T11:31:29.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:29.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.240+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.241+0000 7f413ce40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:29.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.241+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.242+0000 7f413ce40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:29.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.242+0000 7f413ce40800 20 searching for the correct realm 2024-09-14T11:31:29.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.244+0000 7f413a92a640 0 -- 172.21.15.28:0/2293184758 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f413402d060 msgr2=0x7f413406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:29.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.450+0000 7f413b12b640 0 -- 172.21.15.28:0/2293184758 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f4130030950 msgr2=0x7f413003a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:29.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:29.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:29.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:29.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.457+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 zone default found 2024-09-14T11:31:29.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 4 Realm: () 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 zonegroup default 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.458+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.459+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.459+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.459+0000 7f413ce40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.459+0000 7f413ce40800 20 started sync module instance, tier type = 2024-09-14T11:31:29.461 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.459+0000 7f413ce40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=0 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=1 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=2 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=3 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=4 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=5 2024-09-14T11:31:29.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.469+0000 7f413ce40800 20 add_watcher() i=6 2024-09-14T11:31:29.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.470+0000 7f413ce40800 20 add_watcher() i=7 2024-09-14T11:31:29.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.470+0000 7f413ce40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:29.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.472+0000 7f3ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:29.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.473+0000 7f413ce40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.473+0000 7f413ce40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.473+0000 7f413ce40800 5 note: GC not initialized 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.473+0000 7f3ff0fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.473+0000 7f413ce40800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.473+0000 7f413ce40800 20 Filter name: none 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f3fe9ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:31:29.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:31:29.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:31:29.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : miss 2024-09-14T11:31:29.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.474+0000 7f413ce40800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.475+0000 7f413ce40800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:31:29.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.475+0000 7f413ce40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.475+0000 7f413ce40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.475+0000 7f413ce40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:29.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.475+0000 7f413ce40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.475+0000 7f413ce40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:31:29.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f413ce40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f413ce40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f413ce40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f413ce40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24, ofs0, ns] 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f401e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94192025214896 notifier 6615 bl.length()=925 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f401e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f401e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.479+0000 7f401e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.481+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): orig_sources= new_sources= 2024-09-14T11:31:29.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.481+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): potential sources added=[] removed=[] 2024-09-14T11:31:29.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.481+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): orig_dests= new_dests= 2024-09-14T11:31:29.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.481+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): potential dests added=[] removed=[] 2024-09-14T11:31:29.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.484+0000 7f413ce40800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24.1.0 2024-09-14T11:31:29.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.484+0000 7f413ce40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24.1.0 2024-09-14T11:31:29.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.484+0000 7f413ce40800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24.1.1 2024-09-14T11:31:29.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.484+0000 7f413ce40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24.1.1 2024-09-14T11:31:29.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.484+0000 7f413ce40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24.0 2024-09-14T11:31:29.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.487+0000 7f413ce40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:29.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.487+0000 7f413ce40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:31:29.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.488+0000 7f413ce40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.488+0000 7f413ce40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.488+0000 7f413ce40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.488+0000 7f413ce40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24, ofs0, ns] 2024-09-14T11:31:29.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.489+0000 7f401e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94192025214896 notifier 6615 bl.length()=925 2024-09-14T11:31:29.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.489+0000 7f401e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.489+0000 7f401e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.489+0000 7f401e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.490+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): orig_sources= new_sources= 2024-09-14T11:31:29.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.490+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): potential sources added=[] removed=[] 2024-09-14T11:31:29.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.490+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): orig_dests= new_dests= 2024-09-14T11:31:29.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.490+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): potential dests added=[] removed=[] 2024-09-14T11:31:29.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.491+0000 7f413ce40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24.0 2024-09-14T11:31:29.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.492+0000 7f413ce40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:29.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.492+0000 7f413ce40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 2024-09-14T11:31:29.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.493+0000 7f413ce40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.493+0000 7f413ce40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.493+0000 7f413ce40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.493+0000 7f413ce40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24, ofs0, ns] 2024-09-14T11:31:29.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.494+0000 7f401e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94192025214896 notifier 6615 bl.length()=893 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.494+0000 7f401e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 info.flags=0x17 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.494+0000 7f401e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 to cache LRU end 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.494+0000 7f401e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.495+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): orig_sources= new_sources= 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.495+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): potential sources added=[] removed=[] 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.495+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): orig_dests= new_dests= 2024-09-14T11:31:29.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.495+0000 7f413ce40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24]): potential dests added=[] removed=[] 2024-09-14T11:31:29.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.496+0000 7f413ce40800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:31:29.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.499+0000 7f3ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:29.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.501+0000 7f413ce40800 20 remove_watcher() i=0 2024-09-14T11:31:29.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.501+0000 7f413ce40800 2 removed watcher, disabling cache 2024-09-14T11:31:29.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.503+0000 7f413ce40800 20 remove_watcher() i=1 2024-09-14T11:31:29.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.504+0000 7f413ce40800 20 remove_watcher() i=2 2024-09-14T11:31:29.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.505+0000 7f413ce40800 20 remove_watcher() i=3 2024-09-14T11:31:29.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.506+0000 7f413ce40800 20 remove_watcher() i=4 2024-09-14T11:31:29.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.507+0000 7f413ce40800 20 remove_watcher() i=5 2024-09-14T11:31:29.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.508+0000 7f413ce40800 20 remove_watcher() i=6 2024-09-14T11:31:29.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.509+0000 7f413ce40800 20 remove_watcher() i=7 2024-09-14T11:31:29.522 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:31:29.552 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:29.552 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:29.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.593+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 realm 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.595+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.596+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:29.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.596+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.597+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:29.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.597+0000 7f1a9e72a800 20 searching for the correct realm 2024-09-14T11:31:29.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.599+0000 7f1a9a4ad640 0 -- 172.21.15.28:0/2724409967 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x55b10b8c1b30 msgr2=0x7f1a940623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:29.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.804+0000 7f1a9acae640 0 -- 172.21.15.28:0/2724409967 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f1a9002e070 msgr2=0x7f1a90070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:29.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.809+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 zone default found 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 4 Realm: () 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:29.812 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 zonegroup default 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.810+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 started sync module instance, tier type = 2024-09-14T11:31:29.813 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.811+0000 7f1a9e72a800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:29.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=0 2024-09-14T11:31:29.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=1 2024-09-14T11:31:29.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=2 2024-09-14T11:31:29.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=3 2024-09-14T11:31:29.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=4 2024-09-14T11:31:29.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=5 2024-09-14T11:31:29.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.822+0000 7f1a9e72a800 20 add_watcher() i=6 2024-09-14T11:31:29.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.823+0000 7f1a9e72a800 20 add_watcher() i=7 2024-09-14T11:31:29.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.823+0000 7f1a9e72a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:29.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.825+0000 7f1950fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:29.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.825+0000 7f1a9e72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.825+0000 7f1a9e72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.825+0000 7f1a9e72a800 5 note: GC not initialized 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.825+0000 7f18cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.825+0000 7f1a9e72a800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.826+0000 7f1a9e72a800 20 Filter name: none 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.826+0000 7f18c97fa640 20 reqs_thread_entry: start 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.826+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.826+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:31:29.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.826+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.827+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.827+0000 7f1a9e72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.827+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.828+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.828+0000 7f1a9e72a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.828+0000 7f1a9e72a800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:31:29.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.828+0000 7f1a9e72a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:29.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.830+0000 7f1950fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:29.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.832+0000 7f1a9e72a800 20 remove_watcher() i=0 2024-09-14T11:31:29.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.832+0000 7f1a9e72a800 2 removed watcher, disabling cache 2024-09-14T11:31:29.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.833+0000 7f1a9e72a800 20 remove_watcher() i=1 2024-09-14T11:31:29.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.834+0000 7f1a9e72a800 20 remove_watcher() i=2 2024-09-14T11:31:29.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.835+0000 7f1a9e72a800 20 remove_watcher() i=3 2024-09-14T11:31:29.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.836+0000 7f1a9e72a800 20 remove_watcher() i=4 2024-09-14T11:31:29.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.837+0000 7f1a9e72a800 20 remove_watcher() i=5 2024-09-14T11:31:29.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.838+0000 7f1a9e72a800 20 remove_watcher() i=6 2024-09-14T11:31:29.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:29.839+0000 7f1a9e72a800 20 remove_watcher() i=7 2024-09-14T11:31:29.849 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:29.850 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:29.850 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-set-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:31:29.850 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:30.157 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:31:30.157 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:31.012 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:31:31.041 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:31.041 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:31.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.080+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.082+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.082+0000 7fbd8c410800 20 realm 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.082+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.082+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.082+0000 7fbd8c410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.082+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.083+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.083+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.083+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.083+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.084+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:31.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.084+0000 7fbd8c410800 20 searching for the correct realm 2024-09-14T11:31:31.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.086+0000 7fbd873df640 0 -- 172.21.15.28:0/3896507968 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fbd78046030 msgr2=0x7fbd78046920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.090+0000 7fbd87be0640 0 -- 172.21.15.28:0/3896507968 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fbd7c0564a0 msgr2=0x7fbd7c06a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:31.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:31.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:31.296 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.296+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:31.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 zone default found 2024-09-14T11:31:31.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 4 Realm: () 2024-09-14T11:31:31.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:31.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:31.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 zonegroup default 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.297+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.298+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.298+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.298+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.298+0000 7fbd8c410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.298+0000 7fbd8c410800 20 started sync module instance, tier type = 2024-09-14T11:31:31.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.298+0000 7fbd8c410800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:31.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=0 2024-09-14T11:31:31.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=1 2024-09-14T11:31:31.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=2 2024-09-14T11:31:31.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=3 2024-09-14T11:31:31.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=4 2024-09-14T11:31:31.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=5 2024-09-14T11:31:31.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=6 2024-09-14T11:31:31.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 20 add_watcher() i=7 2024-09-14T11:31:31.308 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.308+0000 7fbd8c410800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.310+0000 7fbc3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.310+0000 7fbd8c410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.310+0000 7fbd8c410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.310+0000 7fbd8c410800 5 note: GC not initialized 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.310+0000 7fbc3cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.310+0000 7fbd8c410800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:31.310 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.311+0000 7fbd8c410800 20 Filter name: none 2024-09-14T11:31:31.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.311+0000 7fbbb67fc640 20 reqs_thread_entry: start 2024-09-14T11:31:31.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.311+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.311+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:31.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.311+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.312+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:31.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.312+0000 7fbd8c410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:31.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.312+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.312+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:31.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.312+0000 7fbd8c410800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.313+0000 7fbd8c410800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:31.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.313+0000 7fbd8c410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:31.313 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.314+0000 7fbc3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.316+0000 7fbd8c410800 20 remove_watcher() i=0 2024-09-14T11:31:31.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.316+0000 7fbd8c410800 2 removed watcher, disabling cache 2024-09-14T11:31:31.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.317+0000 7fbd8c410800 20 remove_watcher() i=1 2024-09-14T11:31:31.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.318+0000 7fbd8c410800 20 remove_watcher() i=2 2024-09-14T11:31:31.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.319+0000 7fbd8c410800 20 remove_watcher() i=3 2024-09-14T11:31:31.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.320+0000 7fbd8c410800 20 remove_watcher() i=4 2024-09-14T11:31:31.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.321+0000 7fbd8c410800 20 remove_watcher() i=5 2024-09-14T11:31:31.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.322+0000 7fbd8c410800 20 remove_watcher() i=6 2024-09-14T11:31:31.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.323+0000 7fbd8c410800 20 remove_watcher() i=7 2024-09-14T11:31:31.333 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:31.333 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:31.334 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:31:31.334 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:31.335 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:31:31.370 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:31.370 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:31.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.410+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 realm 2024-09-14T11:31:31.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:31.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.412+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.413+0000 7ffab0f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.413+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.413+0000 7ffab0f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:31.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.413+0000 7ffab0f25800 20 searching for the correct realm 2024-09-14T11:31:31.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.416+0000 7ffaa7fff640 0 -- 172.21.15.28:0/3941011031 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7ffaa0078020 msgr2=0x7ffaa006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.622+0000 7ffaacb33640 0 -- 172.21.15.28:0/3941011031 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ffa98082b20 msgr2=0x7ffa9807e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:31.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:31.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:31.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:31.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.827+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 zone default found 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 4 Realm: () 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 zonegroup default 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.828+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 started sync module instance, tier type = 2024-09-14T11:31:31.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.829+0000 7ffab0f25800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:31.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=0 2024-09-14T11:31:31.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=1 2024-09-14T11:31:31.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=2 2024-09-14T11:31:31.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=3 2024-09-14T11:31:31.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=4 2024-09-14T11:31:31.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=5 2024-09-14T11:31:31.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.839+0000 7ffab0f25800 20 add_watcher() i=6 2024-09-14T11:31:31.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.840+0000 7ffab0f25800 20 add_watcher() i=7 2024-09-14T11:31:31.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.840+0000 7ffab0f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:31.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.841+0000 7ff962fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 5 note: GC not initialized 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ff961fe3640 20 reqs_thread_entry: start 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 20 Filter name: none 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ff8d37fe640 20 reqs_thread_entry: start 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:31:31.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.842+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.843+0000 7ffab0f25800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:31.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.843+0000 7ffab0f25800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:31.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.843+0000 7ffab0f25800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:31.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.843+0000 7ffab0f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 : miss 2024-09-14T11:31:31.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.843+0000 7ffab0f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.844+0000 7ffab0f25800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:31.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.844+0000 7ffab0f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:31.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.844+0000 7ffab0f25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:31.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.844+0000 7ffab0f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:31.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.844+0000 7ffab0f25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:31.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.844+0000 7ffab0f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 2024-09-14T11:31:31.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ffab0f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:31.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ffab0f25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:31.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ffab0f25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:31.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ffab0f25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25, ofs0, ns] 2024-09-14T11:31:31.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ff9837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94099684786992 notifier 6281 bl.length()=939 2024-09-14T11:31:31.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ff9837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:31.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ff9837fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:31.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.848+0000 7ff9837fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:31.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.850+0000 7ffab0f25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_sources= new_sources= 2024-09-14T11:31:31.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.850+0000 7ffab0f25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential sources added=[] removed=[] 2024-09-14T11:31:31.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.850+0000 7ffab0f25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_dests= new_dests= 2024-09-14T11:31:31.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.850+0000 7ffab0f25800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential dests added=[] removed=[] 2024-09-14T11:31:31.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.850+0000 7ffab0f25800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:31:31.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.850+0000 7ffab0f25800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:31:31.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.852+0000 7ff962fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:31.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.854+0000 7ffab0f25800 20 remove_watcher() i=0 2024-09-14T11:31:31.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.854+0000 7ffab0f25800 2 removed watcher, disabling cache 2024-09-14T11:31:31.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.855+0000 7ffab0f25800 20 remove_watcher() i=1 2024-09-14T11:31:31.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.856+0000 7ffab0f25800 20 remove_watcher() i=2 2024-09-14T11:31:31.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.857+0000 7ffab0f25800 20 remove_watcher() i=3 2024-09-14T11:31:31.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.859+0000 7ffab0f25800 20 remove_watcher() i=4 2024-09-14T11:31:31.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.860+0000 7ffab0f25800 20 remove_watcher() i=5 2024-09-14T11:31:31.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.861+0000 7ffab0f25800 20 remove_watcher() i=6 2024-09-14T11:31:31.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.862+0000 7ffab0f25800 20 remove_watcher() i=7 2024-09-14T11:31:31.874 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:31:31.904 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:31.904 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:31.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.945+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.946+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.946+0000 7ff3c3d32800 20 realm 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.946+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.946+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.946+0000 7ff3c3d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.947+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.947+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:31.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.947+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.948+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:31.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.948+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:31.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.948+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:31.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.948+0000 7ff3c3d32800 20 searching for the correct realm 2024-09-14T11:31:31.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:31.949+0000 7ff3bf9bc640 0 -- 172.21.15.28:0/146707133 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x559641bd4b30 msgr2=0x7ff3b80bc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.154+0000 7ff3c01bd640 0 -- 172.21.15.28:0/146707133 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7ff3b4018040 msgr2=0x7ff3b4036430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:32.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:32.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:32.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:32.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:32.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:32.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.160+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 zone default found 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 4 Realm: () 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 zonegroup default 2024-09-14T11:31:32.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 started sync module instance, tier type = 2024-09-14T11:31:32.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.161+0000 7ff3c3d32800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:32.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=0 2024-09-14T11:31:32.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=1 2024-09-14T11:31:32.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=2 2024-09-14T11:31:32.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=3 2024-09-14T11:31:32.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=4 2024-09-14T11:31:32.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=5 2024-09-14T11:31:32.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.170+0000 7ff3c3d32800 20 add_watcher() i=6 2024-09-14T11:31:32.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.171+0000 7ff3c3d32800 20 add_watcher() i=7 2024-09-14T11:31:32.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.171+0000 7ff3c3d32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:32.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.173+0000 7ff275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.173+0000 7ff3c3d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:32.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.173+0000 7ff3c3d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:32.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.173+0000 7ff3c3d32800 5 note: GC not initialized 2024-09-14T11:31:32.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff274fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:32.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff3c3d32800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:32.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff3c3d32800 20 Filter name: none 2024-09-14T11:31:32.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff1ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:32.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.174+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.175+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.175+0000 7ff3c3d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.175+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.175+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.175+0000 7ff3c3d32800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.176+0000 7ff3c3d32800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:31:32.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.176+0000 7ff3c3d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:32.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.177+0000 7ff275fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.179+0000 7ff3c3d32800 20 remove_watcher() i=0 2024-09-14T11:31:32.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.179+0000 7ff3c3d32800 2 removed watcher, disabling cache 2024-09-14T11:31:32.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.180+0000 7ff3c3d32800 20 remove_watcher() i=1 2024-09-14T11:31:32.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.181+0000 7ff3c3d32800 20 remove_watcher() i=2 2024-09-14T11:31:32.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.183+0000 7ff3c3d32800 20 remove_watcher() i=3 2024-09-14T11:31:32.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.184+0000 7ff3c3d32800 20 remove_watcher() i=4 2024-09-14T11:31:32.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.185+0000 7ff3c3d32800 20 remove_watcher() i=5 2024-09-14T11:31:32.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.186+0000 7ff3c3d32800 20 remove_watcher() i=6 2024-09-14T11:31:32.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.187+0000 7ff3c3d32800 20 remove_watcher() i=7 2024-09-14T11:31:32.197 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:32.197 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:32.197 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:31:32.198 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:32.293 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:32.325 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:32.325 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:32.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.365+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 realm 2024-09-14T11:31:32.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:32.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.367+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.368+0000 7ff925b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.368+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.369+0000 7ff925b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:32.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.369+0000 7ff925b1f800 20 searching for the correct realm 2024-09-14T11:31:32.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.372+0000 7ff9210a1640 0 -- 172.21.15.28:0/2633822975 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7ff914075030 msgr2=0x7ff914001ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:32.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.376+0000 7ff9210a1640 0 -- 172.21.15.28:0/2633822975 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7ff7ec087b80 msgr2=0x7ff7ec089fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:32.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:32.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.380+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:32.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 zone default found 2024-09-14T11:31:32.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 4 Realm: () 2024-09-14T11:31:32.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 zonegroup default 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.381+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.382+0000 7ff925b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.382+0000 7ff925b1f800 20 started sync module instance, tier type = 2024-09-14T11:31:32.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.382+0000 7ff925b1f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:32.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=0 2024-09-14T11:31:32.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=1 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=2 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=3 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=4 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=5 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.390+0000 7ff925b1f800 20 add_watcher() i=6 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.391+0000 7ff925b1f800 20 add_watcher() i=7 2024-09-14T11:31:32.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.391+0000 7ff925b1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:32.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff7cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff925b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:32.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff925b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff925b1f800 5 note: GC not initialized 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff7ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff925b1f800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.393+0000 7ff925b1f800 20 Filter name: none 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff743fff640 20 reqs_thread_entry: start 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:31:32.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 : miss 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.394+0000 7ff925b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 2024-09-14T11:31:32.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.396+0000 7ff925b1f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:31:32.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff925b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff925b1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff925b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff925b1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25, ofs0, ns] 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff8057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94759490009216 notifier 6314 bl.length()=939 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff8057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff8057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.399+0000 7ff8057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.401+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_sources= new_sources= 2024-09-14T11:31:32.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.401+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential sources added=[] removed=[] 2024-09-14T11:31:32.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.401+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_dests= new_dests= 2024-09-14T11:31:32.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.401+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential dests added=[] removed=[] 2024-09-14T11:31:32.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.404+0000 7ff925b1f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25.2.0 2024-09-14T11:31:32.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.404+0000 7ff925b1f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25.2.0 2024-09-14T11:31:32.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.404+0000 7ff925b1f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25.2.1 2024-09-14T11:31:32.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.404+0000 7ff925b1f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25.2.1 2024-09-14T11:31:32.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.404+0000 7ff925b1f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25.0 2024-09-14T11:31:32.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.406+0000 7ff925b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:32.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.406+0000 7ff925b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.407+0000 7ff925b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.407+0000 7ff925b1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.407+0000 7ff925b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.407+0000 7ff925b1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25, ofs0, ns] 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.408+0000 7ff8057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94759490009216 notifier 6314 bl.length()=939 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.408+0000 7ff8057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.408+0000 7ff8057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.408+0000 7ff8057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.409+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_sources= new_sources= 2024-09-14T11:31:32.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.409+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential sources added=[] removed=[] 2024-09-14T11:31:32.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.409+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_dests= new_dests= 2024-09-14T11:31:32.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.409+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential dests added=[] removed=[] 2024-09-14T11:31:32.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.410+0000 7ff925b1f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25.0 2024-09-14T11:31:32.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.410+0000 7ff925b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:32.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.410+0000 7ff925b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff925b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff925b1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff925b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff925b1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25, ofs0, ns] 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff804ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94759490009216 notifier 6314 bl.length()=907 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff804ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 info.flags=0x17 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff804ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 to cache LRU end 2024-09-14T11:31:32.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.412+0000 7ff804ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:32.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.413+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_sources= new_sources= 2024-09-14T11:31:32.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.413+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential sources added=[] removed=[] 2024-09-14T11:31:32.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.413+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): orig_dests= new_dests= 2024-09-14T11:31:32.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.413+0000 7ff925b1f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25]): potential dests added=[] removed=[] 2024-09-14T11:31:32.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.414+0000 7ff925b1f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-14T11:31:32.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.416+0000 7ff7cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.419+0000 7ff925b1f800 20 remove_watcher() i=0 2024-09-14T11:31:32.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.419+0000 7ff925b1f800 2 removed watcher, disabling cache 2024-09-14T11:31:32.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.420+0000 7ff925b1f800 20 remove_watcher() i=1 2024-09-14T11:31:32.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.420+0000 7ff925b1f800 20 remove_watcher() i=2 2024-09-14T11:31:32.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.422+0000 7ff925b1f800 20 remove_watcher() i=3 2024-09-14T11:31:32.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.423+0000 7ff925b1f800 20 remove_watcher() i=4 2024-09-14T11:31:32.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.424+0000 7ff925b1f800 20 remove_watcher() i=5 2024-09-14T11:31:32.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.425+0000 7ff925b1f800 20 remove_watcher() i=6 2024-09-14T11:31:32.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.426+0000 7ff925b1f800 20 remove_watcher() i=7 2024-09-14T11:31:32.437 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:31:32.467 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:32.467 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:32.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.506+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 realm 2024-09-14T11:31:32.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:32.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.508+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.509+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.509+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.509+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:32.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.509+0000 7f71ddf3e800 20 searching for the correct realm 2024-09-14T11:31:32.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.513+0000 7f71da4ee640 0 -- 172.21.15.28:0/2401605230 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f71d0044c70 msgr2=0x7f71d003eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.718+0000 7f71d9ced640 0 -- 172.21.15.28:0/2401605230 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x55b7a34a5070 msgr2=0x55b7a34a7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:32.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.721+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:32.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 zone default found 2024-09-14T11:31:32.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 4 Realm: () 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 zonegroup default 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.722+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.723+0000 7f71ddf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:32.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.723+0000 7f71ddf3e800 20 started sync module instance, tier type = 2024-09-14T11:31:32.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.723+0000 7f71ddf3e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=0 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=1 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=2 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=3 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=4 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=5 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=6 2024-09-14T11:31:32.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 20 add_watcher() i=7 2024-09-14T11:31:32.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.733+0000 7f71ddf3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:32.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.735+0000 7f708b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f71ddf3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:32.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f71ddf3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:32.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f71ddf3e800 5 note: GC not initialized 2024-09-14T11:31:32.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f708a7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:32.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f71ddf3e800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:32.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f71ddf3e800 20 Filter name: none 2024-09-14T11:31:32.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f6ffbfff640 20 reqs_thread_entry: start 2024-09-14T11:31:32.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.736+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.737+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.737+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.737+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.737+0000 7f71ddf3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.737+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.738+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.738+0000 7f71ddf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.738+0000 7f71ddf3e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:32.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.738+0000 7f71ddf3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:32.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.739+0000 7f708b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:32.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.741+0000 7f71ddf3e800 20 remove_watcher() i=0 2024-09-14T11:31:32.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.741+0000 7f71ddf3e800 2 removed watcher, disabling cache 2024-09-14T11:31:32.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.742+0000 7f71ddf3e800 20 remove_watcher() i=1 2024-09-14T11:31:32.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.743+0000 7f71ddf3e800 20 remove_watcher() i=2 2024-09-14T11:31:32.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.744+0000 7f71ddf3e800 20 remove_watcher() i=3 2024-09-14T11:31:32.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.746+0000 7f71ddf3e800 20 remove_watcher() i=4 2024-09-14T11:31:32.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.747+0000 7f71ddf3e800 20 remove_watcher() i=5 2024-09-14T11:31:32.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.748+0000 7f71ddf3e800 20 remove_watcher() i=6 2024-09-14T11:31:32.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:32.749+0000 7f71ddf3e800 20 remove_watcher() i=7 2024-09-14T11:31:32.759 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:32.759 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:32.759 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:31:32.759 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:33.082 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:31:33.082 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:34.034 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:31:34.063 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:34.064 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:34.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.108+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.110+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.110+0000 7fd037f22800 20 realm 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.110+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.110+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.110+0000 7fd037f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.110+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.111+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.111+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.111+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.111+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.112+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:34.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.112+0000 7fd037f22800 20 searching for the correct realm 2024-09-14T11:31:34.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.115+0000 7fd02bfff640 0 -- 172.21.15.28:0/1192679744 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fd02406b020 msgr2=0x7fd024059820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:34.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.321+0000 7fd033bae640 0 -- 172.21.15.28:0/1192679744 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fd01c017040 msgr2=0x7fd01c017420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:34.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:34.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:34.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:34.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:34.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.527+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 zone default found 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 4 Realm: () 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 zonegroup default 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.528+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.529+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.529+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.529+0000 7fd037f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.529+0000 7fd037f22800 20 started sync module instance, tier type = 2024-09-14T11:31:34.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.529+0000 7fd037f22800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=0 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=1 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=2 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=3 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=4 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=5 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=6 2024-09-14T11:31:34.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 20 add_watcher() i=7 2024-09-14T11:31:34.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.538+0000 7fd037f22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.541+0000 7fcee9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.541+0000 7fd037f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.541+0000 7fd037f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.541+0000 7fd037f22800 5 note: GC not initialized 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fcee8fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fd037f22800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fd037f22800 20 Filter name: none 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fce627fc640 20 reqs_thread_entry: start 2024-09-14T11:31:34.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:34.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.542+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.543+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:34.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.543+0000 7fd037f22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:34.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.543+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.543+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:34.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.543+0000 7fd037f22800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.544+0000 7fd037f22800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:34.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.544+0000 7fd037f22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:34.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.545+0000 7fcee9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.547+0000 7fd037f22800 20 remove_watcher() i=0 2024-09-14T11:31:34.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.547+0000 7fd037f22800 2 removed watcher, disabling cache 2024-09-14T11:31:34.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.549+0000 7fd037f22800 20 remove_watcher() i=1 2024-09-14T11:31:34.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.549+0000 7fd037f22800 20 remove_watcher() i=2 2024-09-14T11:31:34.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.551+0000 7fd037f22800 20 remove_watcher() i=3 2024-09-14T11:31:34.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.551+0000 7fd037f22800 20 remove_watcher() i=4 2024-09-14T11:31:34.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.552+0000 7fd037f22800 20 remove_watcher() i=5 2024-09-14T11:31:34.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.553+0000 7fd037f22800 20 remove_watcher() i=6 2024-09-14T11:31:34.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.554+0000 7fd037f22800 20 remove_watcher() i=7 2024-09-14T11:31:34.565 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:34.565 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:34.565 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:31:34.565 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:34.566 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:31:34.603 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:34.603 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:34.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.645+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.646+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.646+0000 7f64c6020800 20 realm 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.646+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.647+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.647+0000 7f64c6020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.647+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.647+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.647+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.648+0000 7f64c6020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.648+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.648+0000 7f64c6020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:34.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.648+0000 7f64c6020800 20 searching for the correct realm 2024-09-14T11:31:34.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.651+0000 7f64c3309640 0 -- 172.21.15.28:0/1498766743 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f64b4092040 msgr2=0x7f64b406b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.654+0000 7f64c3b0a640 0 -- 172.21.15.28:0/1498766743 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f64ac001b70 msgr2=0x7f64ac0b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:34.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:34.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:34.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:34.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.860+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:34.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 20 zone default found 2024-09-14T11:31:34.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 4 Realm: () 2024-09-14T11:31:34.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:34.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 20 zonegroup default 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.861+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.862+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.862+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.862+0000 7f64c6020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.862+0000 7f64c6020800 20 started sync module instance, tier type = 2024-09-14T11:31:34.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.862+0000 7f64c6020800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=0 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=1 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=2 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=3 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=4 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=5 2024-09-14T11:31:34.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.871+0000 7f64c6020800 20 add_watcher() i=6 2024-09-14T11:31:34.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.872+0000 7f64c6020800 20 add_watcher() i=7 2024-09-14T11:31:34.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.872+0000 7f64c6020800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:34.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.873+0000 7f6379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 5 note: GC not initialized 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f6378fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 20 Filter name: none 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f62f27fc640 20 reqs_thread_entry: start 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:31:34.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.874+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.875+0000 7f64c6020800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.875+0000 7f64c6020800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.875+0000 7f64c6020800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.875+0000 7f64c6020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 : miss 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.875+0000 7f64c6020800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.876+0000 7f64c6020800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.876+0000 7f64c6020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 info.flags=0x17 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.876+0000 7f64c6020800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 to cache LRU end 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.876+0000 7f64c6020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.876+0000 7f64c6020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:34.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.876+0000 7f64c6020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 2024-09-14T11:31:34.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f64c6020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 info.flags=0x17 2024-09-14T11:31:34.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f64c6020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 to cache LRU end 2024-09-14T11:31:34.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f64c6020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:34.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f64c6020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26, ofs0, ns] 2024-09-14T11:31:34.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f63a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 94324198888064 notifier 6362 bl.length()=939 2024-09-14T11:31:34.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f63a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 info.flags=0x17 2024-09-14T11:31:34.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f63a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 to cache LRU end 2024-09-14T11:31:34.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.879+0000 7f63a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:34.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.881+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): orig_sources= new_sources= 2024-09-14T11:31:34.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.881+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): potential sources added=[] removed=[] 2024-09-14T11:31:34.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.881+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): orig_dests= new_dests= 2024-09-14T11:31:34.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.881+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): potential dests added=[] removed=[] 2024-09-14T11:31:34.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.881+0000 7f64c6020800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:31:34.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.881+0000 7f64c6020800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:31:34.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.882+0000 7f64c6020800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26.1.0 2024-09-14T11:31:34.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.882+0000 7f64c6020800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26.1.0 2024-09-14T11:31:34.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.882+0000 7f64c6020800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26.1.1 2024-09-14T11:31:34.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.882+0000 7f64c6020800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26.1.1 2024-09-14T11:31:34.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.882+0000 7f64c6020800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26.0 2024-09-14T11:31:34.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.885+0000 7f64c6020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:34.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.885+0000 7f64c6020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.886+0000 7f64c6020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 info.flags=0x17 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.886+0000 7f64c6020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 to cache LRU end 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.886+0000 7f64c6020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.886+0000 7f64c6020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26, ofs0, ns] 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.886+0000 7f63a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 94324198888064 notifier 6362 bl.length()=907 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.887+0000 7f63a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 info.flags=0x17 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.887+0000 7f63a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 to cache LRU end 2024-09-14T11:31:34.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.887+0000 7f63a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:34.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.888+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): orig_sources= new_sources= 2024-09-14T11:31:34.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.888+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): potential sources added=[] removed=[] 2024-09-14T11:31:34.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.888+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): orig_dests= new_dests= 2024-09-14T11:31:34.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.888+0000 7f64c6020800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26]): potential dests added=[] removed=[] 2024-09-14T11:31:34.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.889+0000 7f64c6020800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-14T11:31:34.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.891+0000 7f6379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:34.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.893+0000 7f64c6020800 20 remove_watcher() i=0 2024-09-14T11:31:34.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.893+0000 7f64c6020800 2 removed watcher, disabling cache 2024-09-14T11:31:34.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.894+0000 7f64c6020800 20 remove_watcher() i=1 2024-09-14T11:31:34.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.896+0000 7f64c6020800 20 remove_watcher() i=2 2024-09-14T11:31:34.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.897+0000 7f64c6020800 20 remove_watcher() i=3 2024-09-14T11:31:34.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.898+0000 7f64c6020800 20 remove_watcher() i=4 2024-09-14T11:31:34.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.899+0000 7f64c6020800 20 remove_watcher() i=5 2024-09-14T11:31:34.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.900+0000 7f64c6020800 20 remove_watcher() i=6 2024-09-14T11:31:34.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.901+0000 7f64c6020800 20 remove_watcher() i=7 2024-09-14T11:31:34.912 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:31:34.942 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:34.942 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:34.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.982+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 realm 2024-09-14T11:31:34.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.984+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.985+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:34.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.985+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:34.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.986+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:34.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.986+0000 7efcbc81d800 20 searching for the correct realm 2024-09-14T11:31:34.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:34.988+0000 7efcb77ea640 0 -- 172.21.15.28:0/1051723860 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7efca809f040 msgr2=0x7efca8076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:35.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.194+0000 7efcb7feb640 0 -- 172.21.15.28:0/1051723860 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7efcac017810 msgr2=0x7efcac028130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:35.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:35.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:35.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:35.399 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:35.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:35.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:35.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.400 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.400+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:35.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:35.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 zone default found 2024-09-14T11:31:35.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 4 Realm: () 2024-09-14T11:31:35.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 zonegroup default 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.401+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.402+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.402+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.402+0000 7efcbc81d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.402+0000 7efcbc81d800 20 started sync module instance, tier type = 2024-09-14T11:31:35.402 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.402+0000 7efcbc81d800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=0 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=1 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=2 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=3 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=4 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=5 2024-09-14T11:31:35.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.412+0000 7efcbc81d800 20 add_watcher() i=6 2024-09-14T11:31:35.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.413+0000 7efcbc81d800 20 add_watcher() i=7 2024-09-14T11:31:35.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.413+0000 7efcbc81d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:35.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.414+0000 7efb6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:35.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efcbc81d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:35.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efcbc81d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:35.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efcbc81d800 5 note: GC not initialized 2024-09-14T11:31:35.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efb6cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efcbc81d800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efcbc81d800 20 Filter name: none 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efae67fc640 20 reqs_thread_entry: start 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.415+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.416+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:35.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.416+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.416+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:35.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.416+0000 7efcbc81d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:35.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.417+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.417+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:35.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.417+0000 7efcbc81d800 20 rados->read ofs=0 len=0 2024-09-14T11:31:35.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.417+0000 7efcbc81d800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:35.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.417+0000 7efcbc81d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:35.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.419+0000 7efb6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:35.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.421+0000 7efcbc81d800 20 remove_watcher() i=0 2024-09-14T11:31:35.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.421+0000 7efcbc81d800 2 removed watcher, disabling cache 2024-09-14T11:31:35.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.422+0000 7efcbc81d800 20 remove_watcher() i=1 2024-09-14T11:31:35.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.423+0000 7efcbc81d800 20 remove_watcher() i=2 2024-09-14T11:31:35.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.424+0000 7efcbc81d800 20 remove_watcher() i=3 2024-09-14T11:31:35.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.425+0000 7efcbc81d800 20 remove_watcher() i=4 2024-09-14T11:31:35.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.426+0000 7efcbc81d800 20 remove_watcher() i=5 2024-09-14T11:31:35.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.427+0000 7efcbc81d800 20 remove_watcher() i=6 2024-09-14T11:31:35.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:35.429+0000 7efcbc81d800 20 remove_watcher() i=7 2024-09-14T11:31:35.439 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:35.440 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:35.440 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:31:35.440 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:35.752 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:31:35.753 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:36.611 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:31:36.641 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:36.641 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:36.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.682+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 realm 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.684+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.685+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:36.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.685+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.685+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:36.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.685+0000 7fe1f6924800 20 searching for the correct realm 2024-09-14T11:31:36.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.687+0000 7fe1f2502640 0 -- 172.21.15.28:0/3167832940 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fe1ec07a040 msgr2=0x7fe1ec04f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:36.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.892+0000 7fe1f2d03640 0 -- 172.21.15.28:0/3167832940 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fe1e8018040 msgr2=0x7fe1e8068490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:36.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:36.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:36.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:36.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:36.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:36.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:36.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.897+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 zone default found 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 4 Realm: () 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:36.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 zonegroup default 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.898+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.899+0000 7fe1f6924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.899+0000 7fe1f6924800 20 started sync module instance, tier type = 2024-09-14T11:31:36.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.899+0000 7fe1f6924800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:36.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=0 2024-09-14T11:31:36.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=1 2024-09-14T11:31:36.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=2 2024-09-14T11:31:36.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=3 2024-09-14T11:31:36.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=4 2024-09-14T11:31:36.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=5 2024-09-14T11:31:36.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.908+0000 7fe1f6924800 20 add_watcher() i=6 2024-09-14T11:31:36.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.909+0000 7fe1f6924800 20 add_watcher() i=7 2024-09-14T11:31:36.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.909+0000 7fe1f6924800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:36.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe0a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:36.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe1f6924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe1f6924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe1f6924800 5 note: GC not initialized 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe0237fe640 20 reqs_thread_entry: start 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe1f6924800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe1f6924800 20 Filter name: none 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.911+0000 7fe0217fa640 20 reqs_thread_entry: start 2024-09-14T11:31:36.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.912+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.912+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.912+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:36.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 rados->read ofs=0 len=0 2024-09-14T11:31:36.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:36.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.913+0000 7fe1f6924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:36.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.915+0000 7fe0a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:36.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.917+0000 7fe1f6924800 20 remove_watcher() i=0 2024-09-14T11:31:36.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.917+0000 7fe1f6924800 2 removed watcher, disabling cache 2024-09-14T11:31:36.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.918+0000 7fe1f6924800 20 remove_watcher() i=1 2024-09-14T11:31:36.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.919+0000 7fe1f6924800 20 remove_watcher() i=2 2024-09-14T11:31:36.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.920+0000 7fe1f6924800 20 remove_watcher() i=3 2024-09-14T11:31:36.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.921+0000 7fe1f6924800 20 remove_watcher() i=4 2024-09-14T11:31:36.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.922+0000 7fe1f6924800 20 remove_watcher() i=5 2024-09-14T11:31:36.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.923+0000 7fe1f6924800 20 remove_watcher() i=6 2024-09-14T11:31:36.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:36.924+0000 7fe1f6924800 20 remove_watcher() i=7 2024-09-14T11:31:36.934 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:36.934 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:36.934 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:31:36.934 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:36.935 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:31:36.971 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:36.971 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.010+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 realm 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.013+0000 7f0c36f46800 20 searching for the correct realm 2024-09-14T11:31:37.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.017+0000 7f0c3422f640 0 -- 172.21.15.28:0/3708800225 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55c51210c5b0 msgr2=0x55c51210ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.020+0000 7f0c34a30640 0 -- 172.21.15.28:0/3708800225 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f0c28015070 msgr2=0x7f0c2808b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:37.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:37.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.024+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 zone default found 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 4 Realm: () 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 zonegroup default 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.026+0000 7f0c36f46800 20 started sync module instance, tier type = 2024-09-14T11:31:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.026+0000 7f0c36f46800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:37.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=0 2024-09-14T11:31:37.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=1 2024-09-14T11:31:37.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=2 2024-09-14T11:31:37.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=3 2024-09-14T11:31:37.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=4 2024-09-14T11:31:37.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=5 2024-09-14T11:31:37.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=6 2024-09-14T11:31:37.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.036+0000 7f0c36f46800 20 add_watcher() i=7 2024-09-14T11:31:37.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.036+0000 7f0c36f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.038+0000 7f0aeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.038+0000 7f0c36f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.038+0000 7f0c36f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.038+0000 7f0c36f46800 5 note: GC not initialized 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.039+0000 7f0aea7e4640 20 reqs_thread_entry: start 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.039+0000 7f0c36f46800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.039+0000 7f0c36f46800 20 Filter name: none 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.039+0000 7f0ae3fff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.039+0000 7f0c36f46800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.039+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:37.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : miss 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.040+0000 7f0c36f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.043+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.043+0000 7f0c36f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.043+0000 7f0c36f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.043+0000 7f0c36f46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27, ofs0, ns] 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94304900012160 notifier 6413 bl.length()=939 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_sources= new_sources= 2024-09-14T11:31:37.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential sources added=[] removed=[] 2024-09-14T11:31:37.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_dests= new_dests= 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential dests added=[] removed=[] 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0c36f46800 time 2024-09-14T11:31:37.047516+0000 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3a58c76a] 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.045 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.046+0000 7f0c36f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0c36f46800 time 2024-09-14T11:31:37.047516+0000 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3a58c76a] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.046 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:31:37.047 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.047 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:31:37.047 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:31:37.047 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.047 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:31:37.047 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f0c36f46800 thread_name:radosgw-admin 2024-09-14T11:31:37.062 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0c3923e6f0] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0c3928b99c] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3a58c7c4] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:31:37.063 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.047+0000 7f0c36f46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f0c36f46800 thread_name:radosgw-admin 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0c3923e6f0] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0c3928b99c] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3a58c7c4] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.064 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:31:36.993+0000 7f0b22e0d640 10 monclient: dump: 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.065 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:31:36.993+0000 7f0c36f46800 10 monclient: shutdown 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 asok(0x55c511df9270) unregister_commands rotate-key 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:31:36.993+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:31:36.993+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:31:36.993+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.066 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding auth protocol: cephx 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding auth protocol: cephx 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding auth protocol: cephx 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.067 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:31:36.994+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: starting msgr at 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: starting objecter 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command objecter_requests hook 0x55c51201e970 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: setting wanted keys 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: calling monclient init 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding auth protocol: cephx 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding auth protocol: cephx 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding auth protocol: cephx 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.068 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:31:36.994+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:31:36.994+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key hook 0x55c5120196e8 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.069 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c511ea3170 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c511ec6ec0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c511f5c940 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.636955s 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c511ec6ec0 auth_method 0 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c511f5c940 auth_method 0 2024-09-14T11:31:37.070 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c511ea3170 auth_method 0 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6813 payload 824 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.071 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:31:36.995+0000 7f0c3422f640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: dump: 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.072 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: dump: 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.073 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:31:36.995+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6813 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:31:36.995+0000 7f0b22e0d640 4 set_mon_vals no callback set 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:31:36.995+0000 7f0c36f46800 1 librados: init done 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:31:36.997+0000 7f0b2160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:31:36.997+0000 7f0b2160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:31:36.997+0000 7f0b2160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:31:36.998+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0b1c077230 auth_method 0 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:31:36.998+0000 7f0c35231640 10 monclient: get_auth_request con 0x55c5120424e0 auth_method 0 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:31:36.999+0000 7f0c34a30640 10 monclient: get_auth_request con 0x55c512064e60 auth_method 0 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:31:37.000+0000 7f0c3422f640 10 monclient: get_auth_request con 0x55c512069ef0 auth_method 0 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:31:37.000+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.074 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:31:37.000+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:31:37.000+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding auth protocol: cephx 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding auth protocol: cephx 2024-09-14T11:31:37.075 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding auth protocol: cephx 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:31:37.001+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5120714c0 EEXIST 2024-09-14T11:31:37.076 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding auth protocol: cephx 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding auth protocol: cephx 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding auth protocol: cephx 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.077 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:31:37.001+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:31:37.001+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key cmddesc rotate-key hook 0x55c51206cfc0 EEXIST 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c5120957e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c512095bc0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c5120944f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.643992s 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c5120957e0 auth_method 0 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.078 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c512095bc0 auth_method 0 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c5120944f0 auth_method 0 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.079 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6407 payload 824 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:31:37.002+0000 7f0c3422f640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: dump: 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.080 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:31:37.002+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6407 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: dump: 2024-09-14T11:31:37.081 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:31:37.002+0000 7f0c35a32640 4 set_mon_vals no callback set 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:31:37.004+0000 7f0b1a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:31:37.004+0000 7f0b1a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:31:37.004+0000 7f0b1a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.082 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:31:37.004+0000 7f0c36f46800 10 monclient: get_monmap_and_config 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:31:37.004+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:31:37.004+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:31:37.004+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding auth protocol: cephx 2024-09-14T11:31:37.083 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding auth protocol: cephx 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding auth protocol: cephx 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:31:37.004+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0b0c077140 auth_method 0 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:31:37.005+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.084 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding auth protocol: cephx 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding auth protocol: cephx 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding auth protocol: cephx 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.085 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:31:37.005+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:31:37.005+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key cmddesc rotate-key hook 0x7ffc65e64da8 EEXIST 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c5120e9850 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c5120da4c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c5120e4c80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.647887s 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c5120e9850 auth_method 0 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.086 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c5120da4c0 auth_method 0 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c5120e4c80 auth_method 0 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.087 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6410 payload 274 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:31:37.006+0000 7f0c3422f640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: dump: 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.088 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: dump: 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.089 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:31:37.006+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6410 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:31:37.006+0000 7f0c36f46800 10 monclient: get_monmap_and_config success 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:31:37.006+0000 7f0c36f46800 4 set_mon_vals no callback set 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: shutdown 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.090 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding auth protocol: cephx 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding auth protocol: cephx 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding auth protocol: cephx 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.091 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:31:37.007+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: starting msgr at 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: starting objecter 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5120b4f30 EEXIST 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: setting wanted keys 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: calling monclient init 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding auth protocol: cephx 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding auth protocol: cephx 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding auth protocol: cephx 2024-09-14T11:31:37.092 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:31:37.007+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:31:37.008+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:31:37.008+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key cmddesc rotate-key hook 0x55c5120aa1e8 EEXIST 2024-09-14T11:31:37.093 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c5120e4c80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c5120e9850 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c5120b6690 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.650183s 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c5120e9850 auth_method 0 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c5120b6690 auth_method 0 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.094 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c5120e4c80 auth_method 0 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6413 payload 824 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:31:37.008+0000 7f0c3422f640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.095 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: dump: 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.096 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: dump: 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:31:37.008+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6413 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.097 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:31:37.008+0000 7f0b0bfff640 4 set_mon_vals no callback set 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:31:37.008+0000 7f0c36f46800 1 librados: init done 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:31:37.008+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cr dump hook 0x55c5120ba968 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:31:37.010+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:31:37.011+0000 7f0b0a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:31:37.011+0000 7f0b0a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:31:37.011+0000 7f0b0a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:31:37.011+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0b000772b0 auth_method 0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:31:37.011+0000 7f0c35231640 10 monclient: get_auth_request con 0x55c5121030e0 auth_method 0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 realm 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:31:37.012+0000 7f0c36f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.098 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:31:37.012+0000 7f0c34a30640 10 monclient: get_auth_request con 0x55c5121072b0 auth_method 0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 searching for the correct realm 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:31:37.013+0000 7f0c3422f640 10 monclient: get_auth_request con 0x55c51210c5b0 auth_method 0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:31:37.014+0000 7f0c35231640 10 monclient: get_auth_request con 0x55c5120da4c0 auth_method 0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:31:37.015+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0c2c072040 auth_method 0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:31:37.016+0000 7f0c3422f640 10 monclient: get_auth_request con 0x7f0c24028c20 auth_method 0 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:31:37.017+0000 7f0c3422f640 0 -- 172.21.15.28:0/3708800225 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55c51210c5b0 msgr2=0x55c51210ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:31:37.017+0000 7f0b0a7fc640 1 client.6413.objecter ms_handle_reset 0x55c51210c5b0 session 0x55c51210bf30 osd.3 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:31:37.017+0000 7f0b0a7fc640 10 monclient: _renew_subs 2024-09-14T11:31:37.099 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:31:37.017+0000 7f0b0a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:31:37.017+0000 7f0c3422f640 10 monclient: get_auth_request con 0x7f0b00087ae0 auth_method 0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:31:37.017+0000 7f0c35231640 10 monclient: get_auth_request con 0x7f0c2802a060 auth_method 0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:31:37.020+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0c28015070 auth_method 0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:31:37.020+0000 7f0c34a30640 0 -- 172.21.15.28:0/3708800225 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f0c28015070 msgr2=0x7f0c2808b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:31:37.020+0000 7f0b0a7fc640 1 client.6413.objecter ms_handle_reset 0x7f0c28015070 session 0x7f0c28060ae0 osd.0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:31:37.020+0000 7f0c34a30640 10 monclient: get_auth_request con 0x55c51210c5b0 auth_method 0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.100 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 zone default found 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:31:37.025+0000 7f0c36f46800 4 Realm: () 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:31:37.025+0000 7f0c36f46800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:31:37.025+0000 7f0c36f46800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:31:37.025+0000 7f0c36f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 zonegroup default 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.101 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 started sync module instance, tier type = 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=0 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=1 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=2 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=3 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=4 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=5 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=6 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:31:37.036+0000 7f0c36f46800 20 add_watcher() i=7 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:31:37.036+0000 7f0c36f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding auth protocol: cephx 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding auth protocol: cephx 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding auth protocol: cephx 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.102 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:31:37.038+0000 7f0aeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:31:37.038+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:31:37.038+0000 7f0c36f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:31:37.038+0000 7f0c36f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache list hook 0x55c5120dff50 2024-09-14T11:31:37.103 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache inspect hook 0x55c5120dff50 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache erase hook 0x55c5120dff50 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache zap hook 0x55c5120dff50 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 note: GC not initialized 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:31:37.039+0000 7f0aea7e4640 20 reqs_thread_entry: start 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace show hook 0x7f0c2806f020 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace history hook 0x7f0c2806f020 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace active hook 0x7f0c2806f020 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace active_short hook 0x7f0c2806f020 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:31:37.039+0000 7f0c36f46800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:31:37.039+0000 7f0c36f46800 20 Filter name: none 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:31:37.039+0000 7f0ae3fff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:31:37.039+0000 7f0c36f46800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:31:37.039+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.104 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : miss 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.105 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27, ofs0, ns] 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94304900012160 notifier 6413 bl.length()=939 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_sources= new_sources= 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential sources added=[] removed=[] 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_dests= new_dests= 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential dests added=[] removed=[] 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:31:37.046+0000 7f0c36f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0c36f46800 time 2024-09-14T11:31:37.047516+0000 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3a58c76a] 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.106 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:31:37.047+0000 7f0c36f46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f0c36f46800 thread_name:radosgw-admin 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0c3923e6f0] 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0c3928b99c] 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:31:37.107 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3a58c7c4] 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:31:37.108 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:31:37.109 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:31:37.110 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:31:37.111 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:31:37.112 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:37.113 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0ae3fff640 / http_manager 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0aea7e4640 / http_manager 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0aeb7e6640 / rgw_dt_lg_renew 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b0a7fc640 / ms_dispatch 2024-09-14T11:31:37.114 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b0bfff640 / io_context_pool 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b1a7fc640 / ms_dispatch 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b2160a640 / ms_dispatch 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b22e0d640 / io_context_pool 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c3422f640 / msgr-worker-2 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c34a30640 / msgr-worker-1 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c35231640 / msgr-worker-0 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c35a32640 / io_context_pool 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c36f46800 / radosgw-admin 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.105536.log 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:31:36.993+0000 7f0b22e0d640 10 monclient: dump: 2024-09-14T11:31:37.115 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:31:36.993+0000 7f0c36f46800 10 monclient: shutdown 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 asok(0x55c511df9270) unregister_commands rotate-key 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:31:36.993+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:31:36.993+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.116 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:31:36.993+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding auth protocol: cephx 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding auth protocol: cephx 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding auth protocol: cephx 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.117 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: crc 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:31:36.993+0000 7f0c36f46800 5 AuthRegistry(0x55c51201f230) adding con mode: secure 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:31:36.994+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: starting msgr at 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: starting objecter 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command objecter_requests hook 0x55c51201e970 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: setting wanted keys 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:31:36.994+0000 7f0c36f46800 1 librados: calling monclient init 2024-09-14T11:31:37.118 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding auth protocol: cephx 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding auth protocol: cephx 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding auth protocol: cephx 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: crc 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 AuthRegistry(0x55c5120195a0) adding con mode: secure 2024-09-14T11:31:37.119 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:31:36.994+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:31:36.994+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:31:36.994+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key hook 0x55c5120196e8 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c511ea3170 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c511ec6ec0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c511f5c940 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:31:36.994+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.636955s 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c511ec6ec0 auth_method 0 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.120 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c511f5c940 auth_method 0 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:31:36.995+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c511ea3170 auth_method 0 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.121 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:31:36.995+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6813 payload 824 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:31:36.995+0000 7f0c3422f640 1 monclient: found mon.noname-a 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:31:36.995+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: dump: 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.122 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:31:36.995+0000 7f0b2160a640 10 monclient: dump: 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.123 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:31:36.995+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6813 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:31:36.995+0000 7f0b22e0d640 4 set_mon_vals no callback set 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:31:36.995+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:31:36.995+0000 7f0c36f46800 1 librados: init done 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:31:36.997+0000 7f0b2160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.124 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:31:36.997+0000 7f0b2160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:31:36.997+0000 7f0b2160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:31:36.998+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0b1c077230 auth_method 0 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:31:36.998+0000 7f0c35231640 10 monclient: get_auth_request con 0x55c5120424e0 auth_method 0 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:31:36.999+0000 7f0c34a30640 10 monclient: get_auth_request con 0x55c512064e60 auth_method 0 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:31:37.000+0000 7f0c3422f640 10 monclient: get_auth_request con 0x55c512069ef0 auth_method 0 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:31:37.000+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:31:37.000+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:31:37.000+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.125 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding auth protocol: cephx 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding auth protocol: cephx 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding auth protocol: cephx 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.126 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: crc 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:31:37.000+0000 7f0c36f46800 5 AuthRegistry(0x55c51206dfd0) adding con mode: secure 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:31:37.001+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5120714c0 EEXIST 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding auth protocol: cephx 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding auth protocol: cephx 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding auth protocol: cephx 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.127 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: crc 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 AuthRegistry(0x55c51206ce78) adding con mode: secure 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:31:37.001+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:31:37.001+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:31:37.001+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key cmddesc rotate-key hook 0x55c51206cfc0 EEXIST 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c5120957e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.128 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c512095bc0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c5120944f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:31:37.001+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.643992s 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c5120957e0 auth_method 0 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c512095bc0 auth_method 0 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.129 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c5120944f0 auth_method 0 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:31:37.002+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:31:37.002+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6407 payload 824 2024-09-14T11:31:37.130 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:31:37.002+0000 7f0c3422f640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:31:37.002+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: dump: 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.131 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:31:37.002+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6407 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:31:37.002+0000 7f0b1a7fc640 10 monclient: dump: 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.132 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:31:37.002+0000 7f0c35a32640 4 set_mon_vals no callback set 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:31:37.002+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:31:37.004+0000 7f0b1a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:31:37.004+0000 7f0b1a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:31:37.004+0000 7f0b1a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:31:37.004+0000 7f0c36f46800 10 monclient: get_monmap_and_config 2024-09-14T11:31:37.133 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:31:37.004+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:31:37.004+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:31:37.004+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding auth protocol: cephx 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding auth protocol: cephx 2024-09-14T11:31:37.134 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding auth protocol: cephx 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: crc 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:31:37.004+0000 7f0c36f46800 5 AuthRegistry(0x55c5120b51f0) adding con mode: secure 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:31:37.004+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0b0c077140 auth_method 0 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:31:37.005+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.135 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding auth protocol: cephx 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding auth protocol: cephx 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding auth protocol: cephx 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.136 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: crc 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e64c60) adding con mode: secure 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:31:37.005+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:31:37.005+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:31:37.005+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key cmddesc rotate-key hook 0x7ffc65e64da8 EEXIST 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c5120e9850 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c5120da4c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c5120e4c80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:31:37.005+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.647887s 2024-09-14T11:31:37.137 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c5120e9850 auth_method 0 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c5120da4c0 auth_method 0 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c5120e4c80 auth_method 0 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.138 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:31:37.006+0000 7f0c34a30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:31:37.006+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6410 payload 274 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:31:37.006+0000 7f0c3422f640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:31:37.006+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: dump: 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.139 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:31:37.006+0000 7f0b0bfff640 10 monclient: dump: 2024-09-14T11:31:37.140 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:31:37.006+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6410 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:31:37.006+0000 7f0c36f46800 10 monclient: get_monmap_and_config success 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:31:37.006+0000 7f0c36f46800 4 set_mon_vals no callback set 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: shutdown 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: build_initial_monmap 2024-09-14T11:31:37.141 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 build_initial for_mkfs: 0 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: monmap: 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding auth protocol: cephx 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding auth protocol: cephx 2024-09-14T11:31:37.142 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding auth protocol: cephx 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: crc 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120da970) adding con mode: secure 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:31:37.007+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: starting msgr at 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: starting objecter 2024-09-14T11:31:37.143 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command objecter_requests cmddesc objecter_requests hook 0x55c5120b4f30 EEXIST 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: setting wanted keys 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:31:37.007+0000 7f0c36f46800 1 librados: calling monclient init 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:31:37.007+0000 7f0c36f46800 10 monclient: init 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding auth protocol: cephx 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding auth protocol: cephx 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding auth protocol: cephx 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.144 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: crc 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:31:37.007+0000 7f0c36f46800 5 AuthRegistry(0x55c5120aa0a0) adding con mode: secure 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:31:37.007+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:31:37.008+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:31:37.008+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command rotate-key cmddesc rotate-key hook 0x55c5120aa1e8 EEXIST 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-b con 0x55c5120e4c80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-c con 0x55c5120e9850 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): picked mon.noname-a con 0x55c5120b6690 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:37.145 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient(hunting): authenticate will time out at 2034.650183s 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): get_auth_request con 0x55c5120e9850 auth_method 0 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): get_auth_request con 0x55c5120b6690 auth_method 0 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:31:37.008+0000 7f0c35231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:37.146 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): get_auth_request con 0x55c5120e4c80 auth_method 0 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:31:37.008+0000 7f0c34a30640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient(hunting): handle_auth_done global_id 6413 payload 824 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient: _finish_hunting 0 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:31:37.008+0000 7f0c3422f640 1 monclient: found mon.noname-c 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:31:37.008+0000 7f0c3422f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: dump: 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.147 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:37.148 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:31:37.008+0000 7f0b0a7fc640 10 monclient: dump: 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:31:37.008+0000 7f0c36f46800 5 monclient: authenticate success, global_id 6413 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.149 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:31:37.008+0000 7f0b0bfff640 4 set_mon_vals no callback set 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _renew_subs 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:31:37.008+0000 7f0c36f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:31:37.008+0000 7f0c36f46800 1 librados: init done 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:31:37.008+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cr dump hook 0x55c5120ba968 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:31:37.010+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:31:37.011+0000 7f0b0a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:31:37.011+0000 7f0b0a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:31:37.011+0000 7f0b0a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:31:37.011+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0b000772b0 auth_method 0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:31:37.011+0000 7f0c35231640 10 monclient: get_auth_request con 0x55c5121030e0 auth_method 0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 realm 2024-09-14T11:31:37.150 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:31:37.012+0000 7f0c36f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:31:37.012+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:31:37.012+0000 7f0c34a30640 10 monclient: get_auth_request con 0x55c5121072b0 auth_method 0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:31:37.013+0000 7f0c36f46800 20 searching for the correct realm 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:31:37.013+0000 7f0c3422f640 10 monclient: get_auth_request con 0x55c51210c5b0 auth_method 0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:31:37.014+0000 7f0c35231640 10 monclient: get_auth_request con 0x55c5120da4c0 auth_method 0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:31:37.015+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0c2c072040 auth_method 0 2024-09-14T11:31:37.151 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:31:37.016+0000 7f0c3422f640 10 monclient: get_auth_request con 0x7f0c24028c20 auth_method 0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:31:37.017+0000 7f0c3422f640 0 -- 172.21.15.28:0/3708800225 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55c51210c5b0 msgr2=0x55c51210ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:31:37.017+0000 7f0b0a7fc640 1 client.6413.objecter ms_handle_reset 0x55c51210c5b0 session 0x55c51210bf30 osd.3 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:31:37.017+0000 7f0b0a7fc640 10 monclient: _renew_subs 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:31:37.017+0000 7f0b0a7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:31:37.017+0000 7f0c3422f640 10 monclient: get_auth_request con 0x7f0b00087ae0 auth_method 0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:31:37.017+0000 7f0c35231640 10 monclient: get_auth_request con 0x7f0c2802a060 auth_method 0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:31:37.020+0000 7f0c34a30640 10 monclient: get_auth_request con 0x7f0c28015070 auth_method 0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:31:37.020+0000 7f0c34a30640 0 -- 172.21.15.28:0/3708800225 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f0c28015070 msgr2=0x7f0c2808b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:31:37.020+0000 7f0b0a7fc640 1 client.6413.objecter ms_handle_reset 0x7f0c28015070 session 0x7f0c28060ae0 osd.0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:31:37.020+0000 7f0c34a30640 10 monclient: get_auth_request con 0x55c51210c5b0 auth_method 0 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:37.152 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:31:37.024+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 zone default found 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:31:37.025+0000 7f0c36f46800 4 Realm: () 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:31:37.025+0000 7f0c36f46800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:31:37.025+0000 7f0c36f46800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:31:37.025+0000 7f0c36f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 zonegroup default 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.153 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:31:37.025+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 started sync module instance, tier type = 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:31:37.026+0000 7f0c36f46800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=0 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=1 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=2 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=3 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=4 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=5 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:31:37.035+0000 7f0c36f46800 20 add_watcher() i=6 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:31:37.036+0000 7f0c36f46800 20 add_watcher() i=7 2024-09-14T11:31:37.154 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:31:37.036+0000 7f0c36f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding auth protocol: cephx 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding auth protocol: cephx 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding auth protocol: cephx 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:31:37.038+0000 7f0aeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: crc 2024-09-14T11:31:37.155 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 AuthRegistry(0x7ffc65e65140) adding con mode: secure 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:31:37.038+0000 7f0c36f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:31:37.038+0000 7f0c36f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:31:37.038+0000 7f0c36f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache list hook 0x55c5120dff50 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache inspect hook 0x55c5120dff50 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache erase hook 0x55c5120dff50 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command cache zap hook 0x55c5120dff50 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:31:37.038+0000 7f0c36f46800 5 note: GC not initialized 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:31:37.039+0000 7f0aea7e4640 20 reqs_thread_entry: start 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace show hook 0x7f0c2806f020 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace history hook 0x7f0c2806f020 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace active hook 0x7f0c2806f020 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:31:37.039+0000 7f0c36f46800 5 asok(0x55c511df9270) register_command sync trace active_short hook 0x7f0c2806f020 2024-09-14T11:31:37.156 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:31:37.039+0000 7f0c36f46800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:31:37.039+0000 7f0c36f46800 20 Filter name: none 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:31:37.039+0000 7f0ae3fff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:31:37.039+0000 7f0c36f46800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:31:37.039+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : miss 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:31:37.040+0000 7f0c36f46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.157 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:31:37.040+0000 7f0c36f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:31:37.043+0000 7f0c36f46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27, ofs0, ns] 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94304900012160 notifier 6413 bl.length()=939 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:31:37.044+0000 7f0b0bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_sources= new_sources= 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential sources added=[] removed=[] 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_dests= new_dests= 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:31:37.045+0000 7f0c36f46800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential dests added=[] removed=[] 2024-09-14T11:31:37.158 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:31:37.046+0000 7f0c36f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0c36f46800 time 2024-09-14T11:31:37.047516+0000 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0c3a58c76a] 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.159 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:31:37.047+0000 7f0c36f46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f0c36f46800 thread_name:radosgw-admin 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0c3923e6f0] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0c3928b99c] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0c3a58c7c4] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0c3a58c928] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5104d00b1] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8900e) [0x55c5109e400e] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c5104dfefd] 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:31:37.160 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0c39229590] 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:31:37.161 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:31:37.162 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:31:37.163 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:31:37.164 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:31:37.165 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:37.166 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:37.167 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0ae3fff640 / http_manager 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0aea7e4640 / http_manager 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0aeb7e6640 / rgw_dt_lg_renew 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b0a7fc640 / ms_dispatch 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b0bfff640 / io_context_pool 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b1a7fc640 / ms_dispatch 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b2160a640 / ms_dispatch 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0b22e0d640 / io_context_pool 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c3422f640 / msgr-worker-2 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c34a30640 / msgr-worker-1 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c35231640 / msgr-worker-0 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c35a32640 / io_context_pool 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: 7f0c36f46800 / radosgw-admin 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:31:37.168 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:31:37.049178Z_2aca9f45-2941-4a32-80a6-e62c5489bacd/log 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:31:37.169 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:31:37.170 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:37.170 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:37.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.126+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 realm 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.128+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.129+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.129+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.129+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.129+0000 7fda8c413800 20 searching for the correct realm 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.132+0000 7fda87347640 0 -- 172.21.15.28:0/3748389322 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fda78022040 msgr2=0x7fda78068770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.135+0000 7fda87b48640 0 -- 172.21.15.28:0/3748389322 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fda70047030 msgr2=0x7fda70045900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.341+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 zone default found 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 4 Realm: () 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 zonegroup default 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.342+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.343+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.343+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.343+0000 7fda8c413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.343+0000 7fda8c413800 20 started sync module instance, tier type = 2024-09-14T11:31:37.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.343+0000 7fda8c413800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=0 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=1 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=2 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=3 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=4 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=5 2024-09-14T11:31:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.353+0000 7fda8c413800 20 add_watcher() i=6 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.354+0000 7fda8c413800 20 add_watcher() i=7 2024-09-14T11:31:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.354+0000 7fda8c413800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.355+0000 7fd93dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.355+0000 7fda8c413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fda8c413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fda8c413800 5 note: GC not initialized 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fd93cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fda8c413800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fda8c413800 20 Filter name: none 2024-09-14T11:31:37.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fd8b67fc640 20 reqs_thread_entry: start 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.356+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.357+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.357+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.357+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.357+0000 7fda8c413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:37.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.357+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.358+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.358+0000 7fda8c413800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.358+0000 7fda8c413800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:31:37.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.358+0000 7fda8c413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:37.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.359+0000 7fd93dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.363+0000 7fda8c413800 20 remove_watcher() i=0 2024-09-14T11:31:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.363+0000 7fda8c413800 2 removed watcher, disabling cache 2024-09-14T11:31:37.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.364+0000 7fda8c413800 20 remove_watcher() i=1 2024-09-14T11:31:37.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.365+0000 7fda8c413800 20 remove_watcher() i=2 2024-09-14T11:31:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.366+0000 7fda8c413800 20 remove_watcher() i=3 2024-09-14T11:31:37.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.367+0000 7fda8c413800 20 remove_watcher() i=4 2024-09-14T11:31:37.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.368+0000 7fda8c413800 20 remove_watcher() i=5 2024-09-14T11:31:37.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.369+0000 7fda8c413800 20 remove_watcher() i=6 2024-09-14T11:31:37.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.370+0000 7fda8c413800 20 remove_watcher() i=7 2024-09-14T11:31:37.380 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.381 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:31:37.381 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:31:37.381 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:31:37.474 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:37.506 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:37.506 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:37.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.546+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.548+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.548+0000 7fa2e3414800 20 realm 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.548+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.549+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.549+0000 7fa2e3414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.549+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.549+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.549+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.550+0000 7fa2e3414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.550+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.550+0000 7fa2e3414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:37.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.550+0000 7fa2e3414800 20 searching for the correct realm 2024-09-14T11:31:37.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.554+0000 7fa2df3e1640 0 -- 172.21.15.28:0/1230461843 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fa2d40697e0 msgr2=0x7fa2d4076100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.760+0000 7fa2debe0640 0 -- 172.21.15.28:0/1230461843 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x5629b8c5b750 msgr2=0x5629b8c5db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:37.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:31:37.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:37.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:37.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:37.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.763+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:37.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 zone default found 2024-09-14T11:31:37.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 4 Realm: () 2024-09-14T11:31:37.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:31:37.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 zonegroup default 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.764+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.765+0000 7fa2e3414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.765+0000 7fa2e3414800 20 started sync module instance, tier type = 2024-09-14T11:31:37.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.765+0000 7fa2e3414800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=0 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=1 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=2 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=3 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=4 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=5 2024-09-14T11:31:37.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.776+0000 7fa2e3414800 20 add_watcher() i=6 2024-09-14T11:31:37.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.777+0000 7fa2e3414800 20 add_watcher() i=7 2024-09-14T11:31:37.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.777+0000 7fa2e3414800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:37.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.778+0000 7fa1957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:37.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:37.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 5 note: GC not initialized 2024-09-14T11:31:37.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa10ffff640 20 reqs_thread_entry: start 2024-09-14T11:31:37.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 20 init_complete bucket index max shards: 1 2024-09-14T11:31:37.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 20 Filter name: none 2024-09-14T11:31:37.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa10dffb640 20 reqs_thread_entry: start 2024-09-14T11:31:37.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:31:37.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.779+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : miss 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 20 rados->read ofs=0 len=0 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:31:37.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.780+0000 7fa2e3414800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:31:37.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.781+0000 7fa2e3414800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to be held by another RGW process; skipping for now 2024-09-14T11:31:37.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.782+0000 7fa1957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:37.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.784+0000 7fa2e3414800 20 remove_watcher() i=0 2024-09-14T11:31:37.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.784+0000 7fa2e3414800 2 removed watcher, disabling cache 2024-09-14T11:31:37.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.785+0000 7fa2e3414800 20 remove_watcher() i=1 2024-09-14T11:31:37.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.786+0000 7fa2e3414800 20 remove_watcher() i=2 2024-09-14T11:31:37.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.787+0000 7fa2e3414800 20 remove_watcher() i=3 2024-09-14T11:31:37.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.788+0000 7fa2e3414800 20 remove_watcher() i=4 2024-09-14T11:31:37.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.790+0000 7fa2e3414800 20 remove_watcher() i=5 2024-09-14T11:31:37.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.792+0000 7fa2e3414800 20 remove_watcher() i=6 2024-09-14T11:31:37.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:31:37.793+0000 7fa2e3414800 20 remove_watcher() i=7 2024-09-14T11:31:37.803 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:32:07.835 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:07.872 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:07.872 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:07.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.918+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 realm 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:07.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.920+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.921+0000 7f0ae4525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:07.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.921+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:07.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.922+0000 7f0ae4525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:07.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.922+0000 7f0ae4525800 20 searching for the correct realm 2024-09-14T11:32:07.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.925+0000 7f0adf932640 0 -- 172.21.15.28:0/627559257 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f0ad00a73d0 msgr2=0x7f0ad007bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:07.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:07.929+0000 7f0ae0133640 0 -- 172.21.15.28:0/627559257 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f0ad404c910 msgr2=0x7f0ad404a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:08.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:08.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.136+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:08.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 zone default found 2024-09-14T11:32:08.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 4 Realm: () 2024-09-14T11:32:08.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:08.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:08.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 zonegroup default 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.137+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.138+0000 7f0ae4525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.138+0000 7f0ae4525800 20 started sync module instance, tier type = 2024-09-14T11:32:08.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.138+0000 7f0ae4525800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:08.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=0 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=1 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=2 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=3 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=4 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=5 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.149+0000 7f0ae4525800 20 add_watcher() i=6 2024-09-14T11:32:08.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.150+0000 7f0ae4525800 20 add_watcher() i=7 2024-09-14T11:32:08.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.150+0000 7f0ae4525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:08.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.151+0000 7f0996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:08.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:08.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 5 note: GC not initialized 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0995fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 20 Filter name: none 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f098f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:32:08.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.152+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.153+0000 7f0ae4525800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.153+0000 7f0ae4525800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.153+0000 7f0ae4525800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.153+0000 7f0ae4525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : miss 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.153+0000 7f0ae4525800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.154+0000 7f0ae4525800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.154+0000 7f0ae4525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.154+0000 7f0ae4525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.154+0000 7f0ae4525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.154+0000 7f0ae4525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.154+0000 7f0ae4525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:32:08.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.155+0000 7f0ae4525800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:32:08.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f0ae4525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f0ae4525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f0ae4525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f0ae4525800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27, ofs0, ns] 2024-09-14T11:32:08.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f09bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431604 cookie 94785960623568 notifier 6467 bl.length()=939 2024-09-14T11:32:08.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f09bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f09bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.159+0000 7f09bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.161+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_sources= new_sources= 2024-09-14T11:32:08.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.161+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential sources added=[] removed=[] 2024-09-14T11:32:08.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.161+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_dests= new_dests= 2024-09-14T11:32:08.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.161+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential dests added=[] removed=[] 2024-09-14T11:32:08.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.163+0000 7f0ae4525800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27.2.0 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.163+0000 7f0ae4525800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27.2.0 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.163+0000 7f0ae4525800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27.2.1 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.163+0000 7f0ae4525800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27.2.1 2024-09-14T11:32:08.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.163+0000 7f0ae4525800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27.0 2024-09-14T11:32:08.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.166+0000 7f0ae4525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:08.165 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.166+0000 7f0ae4525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.167+0000 7f0ae4525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.167+0000 7f0ae4525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.167+0000 7f0ae4525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.167+0000 7f0ae4525800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27, ofs0, ns] 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.168+0000 7f09bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431605 cookie 94785960623568 notifier 6467 bl.length()=939 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.168+0000 7f09bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.168+0000 7f09bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.168+0000 7f09bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.169+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_sources= new_sources= 2024-09-14T11:32:08.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.169+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential sources added=[] removed=[] 2024-09-14T11:32:08.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.169+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_dests= new_dests= 2024-09-14T11:32:08.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.169+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential dests added=[] removed=[] 2024-09-14T11:32:08.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.170+0000 7f0ae4525800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27.0 2024-09-14T11:32:08.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.171+0000 7f0ae4525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:08.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.171+0000 7f0ae4525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f0ae4525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f0ae4525800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f0ae4525800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f0ae4525800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27, ofs0, ns] 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f09bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94785960623568 notifier 6467 bl.length()=907 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f09bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 info.flags=0x17 2024-09-14T11:32:08.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f09bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 to cache LRU end 2024-09-14T11:32:08.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.172+0000 7f09bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:08.172 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.174+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_sources= new_sources= 2024-09-14T11:32:08.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.174+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential sources added=[] removed=[] 2024-09-14T11:32:08.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.174+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): orig_dests= new_dests= 2024-09-14T11:32:08.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.174+0000 7f0ae4525800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27]): potential dests added=[] removed=[] 2024-09-14T11:32:08.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.175+0000 7f0ae4525800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-14T11:32:08.176 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.177+0000 7f0996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.179+0000 7f0ae4525800 20 remove_watcher() i=0 2024-09-14T11:32:08.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.179+0000 7f0ae4525800 2 removed watcher, disabling cache 2024-09-14T11:32:08.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.181+0000 7f0ae4525800 20 remove_watcher() i=1 2024-09-14T11:32:08.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.182+0000 7f0ae4525800 20 remove_watcher() i=2 2024-09-14T11:32:08.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.183+0000 7f0ae4525800 20 remove_watcher() i=3 2024-09-14T11:32:08.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.184+0000 7f0ae4525800 20 remove_watcher() i=4 2024-09-14T11:32:08.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.185+0000 7f0ae4525800 20 remove_watcher() i=5 2024-09-14T11:32:08.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.186+0000 7f0ae4525800 20 remove_watcher() i=6 2024-09-14T11:32:08.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.187+0000 7f0ae4525800 20 remove_watcher() i=7 2024-09-14T11:32:08.199 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:32:08.229 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:08.229 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:08.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.268+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.270+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.270+0000 7f671f494800 20 realm 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.270+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.271+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.271+0000 7f671f494800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.271+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.271+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.271+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.272+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.272+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.272+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:08.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.272+0000 7f671f494800 20 searching for the correct realm 2024-09-14T11:32:08.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.276+0000 7f671c77d640 0 -- 172.21.15.28:0/3688083927 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f670c070070 msgr2=0x7f670c0253b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.278 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.279+0000 7f671cf7e640 0 -- 172.21.15.28:0/3688083927 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f67100a8400 msgr2=0x7f67100a8880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:08.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:08.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:08.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:08.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.486+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 zone default found 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 4 Realm: () 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 zonegroup default 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.487+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.488+0000 7f671f494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.488+0000 7f671f494800 20 started sync module instance, tier type = 2024-09-14T11:32:08.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.488+0000 7f671f494800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:08.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=0 2024-09-14T11:32:08.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=1 2024-09-14T11:32:08.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=2 2024-09-14T11:32:08.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=3 2024-09-14T11:32:08.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=4 2024-09-14T11:32:08.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=5 2024-09-14T11:32:08.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.497+0000 7f671f494800 20 add_watcher() i=6 2024-09-14T11:32:08.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.498+0000 7f671f494800 20 add_watcher() i=7 2024-09-14T11:32:08.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.498+0000 7f671f494800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:08.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.500+0000 7f65d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.500+0000 7f671f494800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:08.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.500+0000 7f671f494800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:08.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.500+0000 7f671f494800 5 note: GC not initialized 2024-09-14T11:32:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.500+0000 7f65d1fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.500+0000 7f671f494800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.501+0000 7f671f494800 20 Filter name: none 2024-09-14T11:32:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.501+0000 7f65437fe640 20 reqs_thread_entry: start 2024-09-14T11:32:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.501+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.501+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:32:08.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.501+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.502+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:32:08.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.502+0000 7f671f494800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:08.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.502+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.503+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:32:08.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.503+0000 7f671f494800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.503+0000 7f671f494800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:32:08.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.503+0000 7f671f494800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:08.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.504+0000 7f65d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.507+0000 7f671f494800 20 remove_watcher() i=0 2024-09-14T11:32:08.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.507+0000 7f671f494800 2 removed watcher, disabling cache 2024-09-14T11:32:08.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.508+0000 7f671f494800 20 remove_watcher() i=1 2024-09-14T11:32:08.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.509+0000 7f671f494800 20 remove_watcher() i=2 2024-09-14T11:32:08.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.510+0000 7f671f494800 20 remove_watcher() i=3 2024-09-14T11:32:08.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.511+0000 7f671f494800 20 remove_watcher() i=4 2024-09-14T11:32:08.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.512+0000 7f671f494800 20 remove_watcher() i=5 2024-09-14T11:32:08.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.513+0000 7f671f494800 20 remove_watcher() i=6 2024-09-14T11:32:08.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:08.514+0000 7f671f494800 20 remove_watcher() i=7 2024-09-14T11:32:08.525 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:08.525 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:08.525 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-trim-reshard-log-entries id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:32:08.525 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:08.841 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:32:08.841 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:09.693 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:32:09.722 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:09.722 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:09.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.762+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 realm 2024-09-14T11:32:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.764+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.765+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.765+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.765+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:09.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.766+0000 7f61ec52e800 20 searching for the correct realm 2024-09-14T11:32:09.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.767+0000 7f61e82dd640 0 -- 172.21.15.28:0/2116980820 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f61e001a070 msgr2=0x7f61e0025430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:09.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.972+0000 7f61e8ade640 0 -- 172.21.15.28:0/2116980820 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f61dc08f410 msgr2=0x7f61dc08f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:09.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.978+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 zone default found 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 4 Realm: () 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 zonegroup default 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.979+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.980+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.980+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.980+0000 7f61ec52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.980+0000 7f61ec52e800 20 started sync module instance, tier type = 2024-09-14T11:32:09.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.980+0000 7f61ec52e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=0 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=1 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=2 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=3 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=4 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=5 2024-09-14T11:32:09.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.990+0000 7f61ec52e800 20 add_watcher() i=6 2024-09-14T11:32:09.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.991+0000 7f61ec52e800 20 add_watcher() i=7 2024-09-14T11:32:09.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.991+0000 7f61ec52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:09.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.992+0000 7f609e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:09.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f61ec52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:09.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f61ec52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:09.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f61ec52e800 5 note: GC not initialized 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f609d7e2640 20 reqs_thread_entry: start 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f61ec52e800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f61ec52e800 20 Filter name: none 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f600effd640 20 reqs_thread_entry: start 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.993+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.994+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:09.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.994+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:09.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:09.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:09.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:09.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.995+0000 7f61ec52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:09.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.997+0000 7f609e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:09.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.999+0000 7f61ec52e800 20 remove_watcher() i=0 2024-09-14T11:32:09.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:09.999+0000 7f61ec52e800 2 removed watcher, disabling cache 2024-09-14T11:32:09.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.000+0000 7f61ec52e800 20 remove_watcher() i=1 2024-09-14T11:32:10.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.001+0000 7f61ec52e800 20 remove_watcher() i=2 2024-09-14T11:32:10.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.002+0000 7f61ec52e800 20 remove_watcher() i=3 2024-09-14T11:32:10.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.003+0000 7f61ec52e800 20 remove_watcher() i=4 2024-09-14T11:32:10.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.004+0000 7f61ec52e800 20 remove_watcher() i=5 2024-09-14T11:32:10.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.005+0000 7f61ec52e800 20 remove_watcher() i=6 2024-09-14T11:32:10.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.006+0000 7f61ec52e800 20 remove_watcher() i=7 2024-09-14T11:32:10.016 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:10.016 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:10.017 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-block-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:10.017 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:10.018 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:32:10.053 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:10.053 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:10.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.093+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 realm 2024-09-14T11:32:10.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:10.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.095+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.096+0000 7fbce4d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.096+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.096+0000 7fbce4d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:10.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.096+0000 7fbce4d75800 20 searching for the correct realm 2024-09-14T11:32:10.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.299+0000 7fbce285f640 0 -- 172.21.15.28:0/2140323505 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fbcdc021040 msgr2=0x7fbcdc015940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:10.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.705+0000 7fbce3060640 0 -- 172.21.15.28:0/2140323505 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fbcd804d7b0 msgr2=0x7fbcd804f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:10.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:10.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.712+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 20 zone default found 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 4 Realm: () 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:10.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 20 zonegroup default 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.713+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 started sync module instance, tier type = 2024-09-14T11:32:10.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.714+0000 7fbce4d75800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:10.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=0 2024-09-14T11:32:10.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=1 2024-09-14T11:32:10.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=2 2024-09-14T11:32:10.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=3 2024-09-14T11:32:10.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=4 2024-09-14T11:32:10.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=5 2024-09-14T11:32:10.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.725+0000 7fbce4d75800 20 add_watcher() i=6 2024-09-14T11:32:10.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.726+0000 7fbce4d75800 20 add_watcher() i=7 2024-09-14T11:32:10.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.726+0000 7fbce4d75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:10.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.728+0000 7fbb997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbce4d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:10.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbce4d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:10.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbce4d75800 5 note: GC not initialized 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbb13fff640 20 reqs_thread_entry: start 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbce4d75800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbce4d75800 20 Filter name: none 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.729+0000 7fbb11ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:10.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:32:10.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:32:10.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 : miss 2024-09-14T11:32:10.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.730+0000 7fbce4d75800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:10.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.731+0000 7fbce4d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.731+0000 7fbce4d75800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.731+0000 7fbce4d75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:10.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.731+0000 7fbce4d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.731+0000 7fbce4d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 2024-09-14T11:32:10.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbce4d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbce4d75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbce4d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbce4d75800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28, ofs0, ns] 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbbc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94289056282560 notifier 6930 bl.length()=915 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbbc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbbc67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.735+0000 7fbbc67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.737+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_sources= new_sources= 2024-09-14T11:32:10.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.737+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential sources added=[] removed=[] 2024-09-14T11:32:10.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.737+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_dests= new_dests= 2024-09-14T11:32:10.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.737+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential dests added=[] removed=[] 2024-09-14T11:32:10.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.740+0000 7fbce4d75800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.0 2024-09-14T11:32:10.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.740+0000 7fbce4d75800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.0 2024-09-14T11:32:10.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.740+0000 7fbce4d75800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.1 2024-09-14T11:32:10.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.740+0000 7fbce4d75800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.1 2024-09-14T11:32:10.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.740+0000 7fbce4d75800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.0 2024-09-14T11:32:10.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.742+0000 7fbce4d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:10.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.742+0000 7fbce4d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 2024-09-14T11:32:10.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbce4d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbce4d75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbce4d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbce4d75800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28, ofs0, ns] 2024-09-14T11:32:10.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbbc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431610 cookie 94289056282560 notifier 6930 bl.length()=915 2024-09-14T11:32:10.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbbc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbbc67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.744+0000 7fbbc67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.746+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_sources= new_sources= 2024-09-14T11:32:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.746+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential sources added=[] removed=[] 2024-09-14T11:32:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.746+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_dests= new_dests= 2024-09-14T11:32:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.746+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential dests added=[] removed=[] 2024-09-14T11:32:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.746+0000 7fbce4d75800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:32:10.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.746+0000 7fbce4d75800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:32:10.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.748+0000 7fbce4d75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:10.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.749+0000 7fbce4d75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 2024-09-14T11:32:10.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbce4d75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbce4d75800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbce4d75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbce4d75800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28, ofs0, ns] 2024-09-14T11:32:10.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbbc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431611 cookie 94289056282560 notifier 6930 bl.length()=883 2024-09-14T11:32:10.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbbc5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:10.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbbc5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:10.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.750+0000 7fbbc5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:10.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.752+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_sources= new_sources= 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.752+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential sources added=[] removed=[] 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.752+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_dests= new_dests= 2024-09-14T11:32:10.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.752+0000 7fbce4d75800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential dests added=[] removed=[] 2024-09-14T11:32:10.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.753+0000 7fbce4d75800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:32:10.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.755+0000 7fbb997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.758+0000 7fbce4d75800 20 remove_watcher() i=0 2024-09-14T11:32:10.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.758+0000 7fbce4d75800 2 removed watcher, disabling cache 2024-09-14T11:32:10.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.759+0000 7fbce4d75800 20 remove_watcher() i=1 2024-09-14T11:32:10.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.760+0000 7fbce4d75800 20 remove_watcher() i=2 2024-09-14T11:32:10.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.761+0000 7fbce4d75800 20 remove_watcher() i=3 2024-09-14T11:32:10.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.762+0000 7fbce4d75800 20 remove_watcher() i=4 2024-09-14T11:32:10.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.763+0000 7fbce4d75800 20 remove_watcher() i=5 2024-09-14T11:32:10.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.764+0000 7fbce4d75800 20 remove_watcher() i=6 2024-09-14T11:32:10.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.765+0000 7fbce4d75800 20 remove_watcher() i=7 2024-09-14T11:32:10.778 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:32:10.808 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:10.809 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:10.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.849+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.851+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.851+0000 7fa578126800 20 realm 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.851+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.852+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.852+0000 7fa578126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.852+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.852+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.852+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.853+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.853+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.853+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:10.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.853+0000 7fa578126800 20 searching for the correct realm 2024-09-14T11:32:10.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:10.857+0000 7fa57355c640 0 -- 172.21.15.28:0/3201923196 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55ded14dfcb0 msgr2=0x55ded14e20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.062+0000 7fa573d5d640 0 -- 172.21.15.28:0/3201923196 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fa5680e1120 msgr2=0x7fa568059a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.470+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 zone default found 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 4 Realm: () 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:11.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 zonegroup default 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.471+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.472+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.472+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.472+0000 7fa578126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.472+0000 7fa578126800 20 started sync module instance, tier type = 2024-09-14T11:32:11.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.472+0000 7fa578126800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:11.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=0 2024-09-14T11:32:11.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=1 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=2 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=3 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=4 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=5 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.483+0000 7fa578126800 20 add_watcher() i=6 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.484+0000 7fa578126800 20 add_watcher() i=7 2024-09-14T11:32:11.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.484+0000 7fa578126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.487+0000 7fa429fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.487+0000 7fa578126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.487+0000 7fa578126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.487+0000 7fa578126800 5 note: GC not initialized 2024-09-14T11:32:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.488+0000 7fa428fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:11.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.488+0000 7fa578126800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:11.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.488+0000 7fa578126800 20 Filter name: none 2024-09-14T11:32:11.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.488+0000 7fa3a27fc640 20 reqs_thread_entry: start 2024-09-14T11:32:11.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.488+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.489+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:11.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.489+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.490+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:11.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.490+0000 7fa578126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:11.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.490+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.490+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:11.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.490+0000 7fa578126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.491+0000 7fa578126800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:11.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.491+0000 7fa578126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:11.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.493+0000 7fa429fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.495+0000 7fa578126800 20 remove_watcher() i=0 2024-09-14T11:32:11.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.495+0000 7fa578126800 2 removed watcher, disabling cache 2024-09-14T11:32:11.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.497+0000 7fa578126800 20 remove_watcher() i=1 2024-09-14T11:32:11.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.498+0000 7fa578126800 20 remove_watcher() i=2 2024-09-14T11:32:11.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.499+0000 7fa578126800 20 remove_watcher() i=3 2024-09-14T11:32:11.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.501+0000 7fa578126800 20 remove_watcher() i=4 2024-09-14T11:32:11.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.502+0000 7fa578126800 20 remove_watcher() i=5 2024-09-14T11:32:11.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.503+0000 7fa578126800 20 remove_watcher() i=6 2024-09-14T11:32:11.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.504+0000 7fa578126800 20 remove_watcher() i=7 2024-09-14T11:32:11.516 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:11.516 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:11.516 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-block-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:11.516 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:11.612 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:11.645 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:11.645 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:11.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.687+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 realm 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.688 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.689+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.690+0000 7f9b8db2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.690+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.689 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.690+0000 7f9b8db2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:11.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.690+0000 7f9b8db2c800 20 searching for the correct realm 2024-09-14T11:32:11.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.695+0000 7f9b88f44640 0 -- 172.21.15.28:0/3280975873 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9b7c08a020 msgr2=0x7f9b7c08b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.697 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.698+0000 7f9b88f44640 0 -- 172.21.15.28:0/3280975873 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9a54087a40 msgr2=0x7f9a54089e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.702+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 zone default found 2024-09-14T11:32:11.703 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 4 Realm: () 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 zonegroup default 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.703+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.704 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 started sync module instance, tier type = 2024-09-14T11:32:11.705 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.704+0000 7f9b8db2c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=0 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=1 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=2 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=3 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=4 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=5 2024-09-14T11:32:11.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.714+0000 7f9b8db2c800 20 add_watcher() i=6 2024-09-14T11:32:11.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.715+0000 7f9b8db2c800 20 add_watcher() i=7 2024-09-14T11:32:11.714 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.715+0000 7f9b8db2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:11.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9a3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9b8db2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:11.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9b8db2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:11.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9b8db2c800 5 note: GC not initialized 2024-09-14T11:32:11.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9a3efe5640 20 reqs_thread_entry: start 2024-09-14T11:32:11.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9b8db2c800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:11.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9b8db2c800 20 Filter name: none 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.717+0000 7f9a3cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 : miss 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.718 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:11.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:11.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.718+0000 7f9b8db2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 2024-09-14T11:32:11.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9b8db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9b8db2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9b8db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9b8db2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28, ofs0, ns] 2024-09-14T11:32:11.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9a6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94322387944208 notifier 6548 bl.length()=915 2024-09-14T11:32:11.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9a6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9a6cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.723+0000 7f9a6cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.725+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_sources= new_sources= 2024-09-14T11:32:11.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.725+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential sources added=[] removed=[] 2024-09-14T11:32:11.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.725+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_dests= new_dests= 2024-09-14T11:32:11.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.725+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential dests added=[] removed=[] 2024-09-14T11:32:11.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.727+0000 7f9b8db2c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.0 2024-09-14T11:32:11.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.727+0000 7f9b8db2c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.0 2024-09-14T11:32:11.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.727+0000 7f9b8db2c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.1 2024-09-14T11:32:11.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.727+0000 7f9b8db2c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.1.1 2024-09-14T11:32:11.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.727+0000 7f9b8db2c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.0 2024-09-14T11:32:11.728 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.729+0000 7f9b8db2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:11.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.729+0000 7f9b8db2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9b8db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9b8db2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9b8db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9b8db2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28, ofs0, ns] 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9a5bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94322387944208 notifier 6548 bl.length()=915 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9a5bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9a5bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.731+0000 7f9a5bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.731 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.732+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_sources= new_sources= 2024-09-14T11:32:11.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.732+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential sources added=[] removed=[] 2024-09-14T11:32:11.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.732+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_dests= new_dests= 2024-09-14T11:32:11.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.732+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential dests added=[] removed=[] 2024-09-14T11:32:11.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.733+0000 7f9b8db2c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28.0 2024-09-14T11:32:11.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.734+0000 7f9b8db2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:11.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.734+0000 7f9b8db2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 2024-09-14T11:32:11.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.735+0000 7f9b8db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.735+0000 7f9b8db2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.735+0000 7f9b8db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.735+0000 7f9b8db2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28, ofs0, ns] 2024-09-14T11:32:11.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.736+0000 7f9a6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94322387944208 notifier 6548 bl.length()=883 2024-09-14T11:32:11.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.736+0000 7f9a6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 info.flags=0x17 2024-09-14T11:32:11.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.736+0000 7f9a6cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 to cache LRU end 2024-09-14T11:32:11.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.736+0000 7f9a6cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:11.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.737+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_sources= new_sources= 2024-09-14T11:32:11.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.737+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential sources added=[] removed=[] 2024-09-14T11:32:11.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.737+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): orig_dests= new_dests= 2024-09-14T11:32:11.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.737+0000 7f9b8db2c800 20 handle_bi_update(): bucket=:error-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28]): potential dests added=[] removed=[] 2024-09-14T11:32:11.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.738+0000 7f9b8db2c800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:32:11.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.740+0000 7f9a3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.742+0000 7f9b8db2c800 20 remove_watcher() i=0 2024-09-14T11:32:11.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.742+0000 7f9b8db2c800 2 removed watcher, disabling cache 2024-09-14T11:32:11.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.743+0000 7f9b8db2c800 20 remove_watcher() i=1 2024-09-14T11:32:11.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.744+0000 7f9b8db2c800 20 remove_watcher() i=2 2024-09-14T11:32:11.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.745+0000 7f9b8db2c800 20 remove_watcher() i=3 2024-09-14T11:32:11.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.746+0000 7f9b8db2c800 20 remove_watcher() i=4 2024-09-14T11:32:11.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.747+0000 7f9b8db2c800 20 remove_watcher() i=5 2024-09-14T11:32:11.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.748+0000 7f9b8db2c800 20 remove_watcher() i=6 2024-09-14T11:32:11.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.749+0000 7f9b8db2c800 20 remove_watcher() i=7 2024-09-14T11:32:11.760 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:32:11.790 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:11.790 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:11.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.829+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.831+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.831+0000 7f7bdd12c800 20 realm 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.831+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.831+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.831+0000 7f7bdd12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.831+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.832+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.832+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.833+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.833+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.833+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:11.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.833+0000 7f7bdd12c800 20 searching for the correct realm 2024-09-14T11:32:11.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.836+0000 7f7bd3fff640 0 -- 172.21.15.28:0/575584238 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x560bc415e2b0 msgr2=0x560bc41606a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:11.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.840+0000 7f7bd8e4f640 0 -- 172.21.15.28:0/575584238 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f7bc40afcb0 msgr2=0x7f7bc40dc1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:11.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:11.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:11.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:11.844 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:11.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:11.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.845+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 zone default found 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 4 Realm: () 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 zonegroup default 2024-09-14T11:32:11.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.846+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.847+0000 7f7bdd12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.847+0000 7f7bdd12c800 20 started sync module instance, tier type = 2024-09-14T11:32:11.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.847+0000 7f7bdd12c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:11.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=0 2024-09-14T11:32:11.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=1 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=2 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=3 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=4 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=5 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.855+0000 7f7bdd12c800 20 add_watcher() i=6 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.856+0000 7f7bdd12c800 20 add_watcher() i=7 2024-09-14T11:32:11.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.856+0000 7f7bdd12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:11.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.858+0000 7f7a8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.858+0000 7f7bdd12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:11.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.858+0000 7f7bdd12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:11.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.858+0000 7f7bdd12c800 5 note: GC not initialized 2024-09-14T11:32:11.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.859+0000 7f7a8e7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.859+0000 7f7bdd12c800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.859+0000 7f7bdd12c800 20 Filter name: none 2024-09-14T11:32:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.859+0000 7f7a87fff640 20 reqs_thread_entry: start 2024-09-14T11:32:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.859+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.860+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:11.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.860+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.861+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.861+0000 7f7bdd12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.861+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.862+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.862+0000 7f7bdd12c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.862+0000 7f7bdd12c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:11.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.862+0000 7f7bdd12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:11.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.864+0000 7f7a8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.866+0000 7f7bdd12c800 20 remove_watcher() i=0 2024-09-14T11:32:11.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.866+0000 7f7bdd12c800 2 removed watcher, disabling cache 2024-09-14T11:32:11.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.867+0000 7f7bdd12c800 20 remove_watcher() i=1 2024-09-14T11:32:11.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.868+0000 7f7bdd12c800 20 remove_watcher() i=2 2024-09-14T11:32:11.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.869+0000 7f7bdd12c800 20 remove_watcher() i=3 2024-09-14T11:32:11.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.870+0000 7f7bdd12c800 20 remove_watcher() i=4 2024-09-14T11:32:11.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.871+0000 7f7bdd12c800 20 remove_watcher() i=5 2024-09-14T11:32:11.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.872+0000 7f7bdd12c800 20 remove_watcher() i=6 2024-09-14T11:32:11.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:11.873+0000 7f7bdd12c800 20 remove_watcher() i=7 2024-09-14T11:32:11.883 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:11.883 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:11.883 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-block-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:32:11.883 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:12.186 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:32:12.187 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.041 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:32:13.070 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.070 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.312 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.313+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.314+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.314+0000 7f747b931800 20 realm 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.314+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.315+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.315+0000 7f747b931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.315+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.315+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.315+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.316+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.316+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.316+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.316+0000 7f747b931800 20 searching for the correct realm 2024-09-14T11:32:13.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.318+0000 7f7477676640 0 -- 172.21.15.28:0/2866788726 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x563ed294bb90 msgr2=0x7f74700a3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.523+0000 7f7477e77640 0 -- 172.21.15.28:0/2866788726 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f7460043070 msgr2=0x7f7460043750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:13.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.529+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 zone default found 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 4 Realm: () 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 zonegroup default 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.530+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.531+0000 7f747b931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.531+0000 7f747b931800 20 started sync module instance, tier type = 2024-09-14T11:32:13.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.531+0000 7f747b931800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=0 2024-09-14T11:32:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=1 2024-09-14T11:32:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=2 2024-09-14T11:32:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=3 2024-09-14T11:32:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=4 2024-09-14T11:32:13.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=5 2024-09-14T11:32:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.540+0000 7f747b931800 20 add_watcher() i=6 2024-09-14T11:32:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.541+0000 7f747b931800 20 add_watcher() i=7 2024-09-14T11:32:13.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.541+0000 7f747b931800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.543+0000 7f732dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.543+0000 7f747b931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.543+0000 7f747b931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.543+0000 7f747b931800 5 note: GC not initialized 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.543+0000 7f732cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.543+0000 7f747b931800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.544+0000 7f747b931800 20 Filter name: none 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.544+0000 7f72a67fc640 20 reqs_thread_entry: start 2024-09-14T11:32:13.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.544+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.544+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.544+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:13.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.545+0000 7f747b931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:13.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.547+0000 7f732dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.549+0000 7f747b931800 20 remove_watcher() i=0 2024-09-14T11:32:13.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.549+0000 7f747b931800 2 removed watcher, disabling cache 2024-09-14T11:32:13.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.550+0000 7f747b931800 20 remove_watcher() i=1 2024-09-14T11:32:13.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.551+0000 7f747b931800 20 remove_watcher() i=2 2024-09-14T11:32:13.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.552+0000 7f747b931800 20 remove_watcher() i=3 2024-09-14T11:32:13.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.553+0000 7f747b931800 20 remove_watcher() i=4 2024-09-14T11:32:13.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.554+0000 7f747b931800 20 remove_watcher() i=5 2024-09-14T11:32:13.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.555+0000 7f747b931800 20 remove_watcher() i=6 2024-09-14T11:32:13.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.556+0000 7f747b931800 20 remove_watcher() i=7 2024-09-14T11:32:13.566 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.566 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:13.566 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-block-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:13.566 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.568 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:32:13.604 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.604 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.644+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.646+0000 7f9cded25800 20 realm 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.646+0000 7f9cded25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.648+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.648+0000 7f9cded25800 20 searching for the correct realm 2024-09-14T11:32:13.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.651+0000 7f9cda1ad640 0 -- 172.21.15.28:0/1448611797 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9ccc0b9060 msgr2=0x7f9ccc0ccab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.654+0000 7f9cda9ae640 0 -- 172.21.15.28:0/1448611797 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9cd002d8f0 msgr2=0x7f9cd000d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:13.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.859 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 zone default found 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 4 Realm: () 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 zonegroup default 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.862+0000 7f9cded25800 20 started sync module instance, tier type = 2024-09-14T11:32:13.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.862+0000 7f9cded25800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=0 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=1 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=2 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=3 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=4 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=5 2024-09-14T11:32:13.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=6 2024-09-14T11:32:13.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.872+0000 7f9cded25800 20 add_watcher() i=7 2024-09-14T11:32:13.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.872+0000 7f9cded25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.873+0000 7f9b917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 5 note: GC not initialized 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9b0bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 20 Filter name: none 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9b09ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:32:13.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.874+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : miss 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:13.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:13.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.875+0000 7f9cded25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:13.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9cded25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9cded25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:13.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94172309500064 notifier 7032 bl.length()=915 2024-09-14T11:32:13.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:13.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:13.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:13.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:13.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.884+0000 7f9cded25800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.0 2024-09-14T11:32:13.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.0 2024-09-14T11:32:13.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.884+0000 7f9cded25800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.1 2024-09-14T11:32:13.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.1 2024-09-14T11:32:13.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.0 2024-09-14T11:32:13.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.886+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:13.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.886+0000 7f9cded25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.887+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.887+0000 7f9cded25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.887+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.887+0000 7f9cded25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94172309500064 notifier 7032 bl.length()=915 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:13.888 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cded25800 time 2024-09-14T11:32:13.891271+0000 2024-09-14T11:32:13.889 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:13.889 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:13.889 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9ce038c76a] 2024-09-14T11:32:13.889 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:32:13.890 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f9cded25800 thread_name:radosgw-admin 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.890+0000 7f9cded25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cded25800 time 2024-09-14T11:32:13.891271+0000 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9ce038c76a] 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:13.891 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:32:13.892 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cdf03e6f0] 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cdf08b99c] 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9ce038c7c4] 2024-09-14T11:32:13.911 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.891+0000 7f9cded25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f9cded25800 thread_name:radosgw-admin 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cdf03e6f0] 2024-09-14T11:32:13.912 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cdf08b99c] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9ce038c7c4] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:13.913 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:32:13.627+0000 7f9cded25800 5 AuthRegistry(0x55a632fec2c0) adding con mode: secure 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:32:13.627+0000 7f9cded25800 5 AuthRegistry(0x55a632fec2c0) adding con mode: crc 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:32:13.627+0000 7f9cded25800 5 AuthRegistry(0x55a632fec2c0) adding con mode: secure 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:32:13.628+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: starting msgr at 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: starting objecter 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command objecter_requests hook 0x55a633018630 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: setting wanted keys 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: calling monclient init 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding auth protocol: cephx 2024-09-14T11:32:13.914 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding auth protocol: cephx 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding auth protocol: cephx 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.915 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:32:13.628+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:32:13.628+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key hook 0x55a632fe67f8 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a632e6e170 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a632f298b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a632f2fee0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.916 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.270919s 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a632e6e170 auth_method 0 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a632f2fee0 auth_method 0 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.917 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a632f298b0 auth_method 0 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_done global_id 6590 payload 824 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 1 monclient: found mon.noname-c 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.918 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: dump: 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.919 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: dump: 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:32:13.629+0000 7f9cded25800 5 monclient: authenticate success, global_id 6590 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:32:13.629+0000 7f9bc8e09640 4 set_mon_vals no callback set 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:32:13.629+0000 7f9cded25800 1 librados: init done 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:32:13.631+0000 7f9bc7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:32:13.631+0000 7f9bc7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:32:13.631+0000 7f9bc7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.921 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:32:13.632+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9bc0077230 auth_method 0 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:32:13.632+0000 7f9cdb1af640 10 monclient: get_auth_request con 0x55a63302f290 auth_method 0 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:32:13.633+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x55a633032470 auth_method 0 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:32:13.634+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x55a633037500 auth_method 0 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:32:13.635+0000 7f9cded25800 10 monclient: build_initial_monmap 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:32:13.635+0000 7f9cded25800 1 build_initial for_mkfs: 0 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:32:13.635+0000 7f9cded25800 10 monclient: monmap: 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding auth protocol: cephx 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding auth protocol: cephx 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding auth protocol: cephx 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.923 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:32:13.635+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command objecter_requests cmddesc objecter_requests hook 0x55a63303eee0 EEXIST 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:32:13.635+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding auth protocol: cephx 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding auth protocol: cephx 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding auth protocol: cephx 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.924 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:32:13.636+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:32:13.636+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:32:13.636+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key cmddesc rotate-key hook 0x55a63303a5b0 EEXIST 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.925 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a633062bd0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a633064ea0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a6330613a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.278388s 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a633064ea0 auth_method 0 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.926 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a633062bd0 auth_method 0 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a6330613a0 auth_method 0 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.927 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_done global_id 7026 payload 824 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 1 monclient: found mon.noname-a 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: dump: 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.928 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:32:13.637+0000 7f9cded25800 5 monclient: authenticate success, global_id 7026 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: dump: 2024-09-14T11:32:13.929 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:32:13.637+0000 7f9cdb9b0640 4 set_mon_vals no callback set 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:32:13.638+0000 7f9bc4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:13.930 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:32:13.638+0000 7f9bc4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:32:13.638+0000 7f9bc4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:32:13.639+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9bb4077140 auth_method 0 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: get_monmap_and_config 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: build_initial_monmap 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:32:13.639+0000 7f9cded25800 1 build_initial for_mkfs: 0 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: monmap: 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:13.931 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding auth protocol: cephx 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding auth protocol: cephx 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding auth protocol: cephx 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.932 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:32:13.639+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding auth protocol: cephx 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding auth protocol: cephx 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding auth protocol: cephx 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.933 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:32:13.639+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:32:13.640+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:32:13.640+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key cmddesc rotate-key hook 0x7ffda988b078 EEXIST 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a6330b6e90 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a633087cb0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.934 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a6330b22c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.282217s 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a6330b6e90 auth_method 0 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a633087cb0 auth_method 0 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.935 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a6330b22c0 auth_method 0 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.936 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_done global_id 6596 payload 274 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 1 monclient: found mon.noname-c 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: dump: 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:32:13.640+0000 7f9cded25800 5 monclient: authenticate success, global_id 6596 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:32:13.640+0000 7f9cded25800 4 set_mon_vals no callback set 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.938 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: dump: 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: shutdown 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: build_initial_monmap 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 build_initial for_mkfs: 0 2024-09-14T11:32:13.939 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: monmap: 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding auth protocol: cephx 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding auth protocol: cephx 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding auth protocol: cephx 2024-09-14T11:32:13.940 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:32:13.641+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.941 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: starting msgr at 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: starting objecter 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command objecter_requests cmddesc objecter_requests hook 0x55a6330a9d90 EEXIST 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: setting wanted keys 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: calling monclient init 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding auth protocol: cephx 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding auth protocol: cephx 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding auth protocol: cephx 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.942 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:32:13.642+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:32:13.642+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:32:13.642+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key cmddesc rotate-key hook 0x55a63307aac8 EEXIST 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a633087cb0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.943 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a6330b22c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a6330b6e90 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.284417s 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a633087cb0 auth_method 0 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a6330b6e90 auth_method 0 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.944 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a6330b22c0 auth_method 0 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_done global_id 7032 payload 824 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 1 monclient: found mon.noname-a 2024-09-14T11:32:13.945 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: dump: 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.946 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: dump: 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:32:13.643+0000 7f9cded25800 5 monclient: authenticate success, global_id 7032 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:32:13.643+0000 7f9bbe7fc640 4 set_mon_vals no callback set 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:32:13.643+0000 7f9cded25800 1 librados: init done 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:32:13.643+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cr dump hook 0x55a6330a4928 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:32:13.644+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:32:13.645+0000 7f9bbcff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:32:13.645+0000 7f9bbcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:32:13.645+0000 7f9bbcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:32:13.646+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9ba4077230 auth_method 0 2024-09-14T11:32:13.948 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:32:13.646+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x55a6330d0f00 auth_method 0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 realm 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:32:13.646+0000 7f9cded25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:32:13.647+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x55a6330d5280 auth_method 0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:32:13.648+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:32:13.648+0000 7f9cded25800 20 searching for the correct realm 2024-09-14T11:32:13.949 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:32:13.648+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x55a6330da350 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:32:13.649+0000 7f9cdb1af640 10 monclient: get_auth_request con 0x7f9cd003a410 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:32:13.649+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9cd4064dd0 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:32:13.650+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9ccc0b9060 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:32:13.651+0000 7f9cda1ad640 0 -- 172.21.15.28:0/1448611797 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9ccc0b9060 msgr2=0x7f9ccc0ccab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:32:13.651+0000 7f9bbcff9640 1 client.7032.objecter ms_handle_reset 0x7f9ccc0b9060 session 0x7f9ccc099070 osd.4 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:32:13.651+0000 7f9bbcff9640 10 monclient: _renew_subs 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:32:13.651+0000 7f9bbcff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:32:13.651+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9ba40879e0 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:32:13.652+0000 7f9cdb1af640 10 monclient: get_auth_request con 0x7f9cd0027400 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:32:13.654+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9cd002d8f0 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:32:13.654+0000 7f9cda9ae640 0 -- 172.21.15.28:0/1448611797 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9cd002d8f0 msgr2=0x7f9cd000d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:32:13.855+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9cd002d8f0 auth_method 0 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.950 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 zone default found 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:32:13.861+0000 7f9cded25800 4 Realm: () 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:32:13.861+0000 7f9cded25800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:13.951 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:32:13.861+0000 7f9cded25800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:32:13.861+0000 7f9cded25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 zonegroup default 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 started sync module instance, tier type = 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=0 2024-09-14T11:32:13.952 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=1 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=2 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=3 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=4 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=5 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=6 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:32:13.872+0000 7f9cded25800 20 add_watcher() i=7 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:32:13.872+0000 7f9cded25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding auth protocol: cephx 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding auth protocol: cephx 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding auth protocol: cephx 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:13.953 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:32:13.873+0000 7f9b917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:32:13.874+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.954 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache list hook 0x55a6330a85a0 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache inspect hook 0x55a6330a85a0 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache erase hook 0x55a6330a85a0 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache zap hook 0x55a6330a85a0 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 note: GC not initialized 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:32:13.874+0000 7f9b0bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace show hook 0x7f9ccc0c3070 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace history hook 0x7f9ccc0c3070 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace active hook 0x7f9ccc0c3070 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace active_short hook 0x7f9ccc0c3070 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 Filter name: none 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:32:13.874+0000 7f9b09ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:13.955 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:32:13.874+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : miss 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.956 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94172309500064 notifier 7032 bl.length()=915 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:32:13.884+0000 7f9cded25800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.0 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.0 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:32:13.884+0000 7f9cded25800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.1 2024-09-14T11:32:13.957 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.1 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.0 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:32:13.886+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:32:13.886+0000 7f9cded25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94172309500064 notifier 7032 bl.length()=915 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:13.958 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:32:13.890+0000 7f9cded25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cded25800 time 2024-09-14T11:32:13.891271+0000 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9ce038c76a] 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:32:13.959 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:32:13.891+0000 7f9cded25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f9cded25800 thread_name:radosgw-admin 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cdf03e6f0] 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cdf08b99c] 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9ce038c7c4] 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:13.960 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:32:13.961 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:32:13.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:32:13.963 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:13.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:32:13.965 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:13.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:32:13.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9b09ffb640 / http_manager 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9b0bfff640 / http_manager 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9b917e2640 / rgw_dt_lg_renew 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bbcff9640 / ms_dispatch 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bbe7fc640 / io_context_pool 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bc4e01640 / ms_dispatch 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bc7606640 / ms_dispatch 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bc8e09640 / io_context_pool 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cda1ad640 / msgr-worker-2 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cda9ae640 / msgr-worker-1 2024-09-14T11:32:13.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cdb1af640 / msgr-worker-0 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cdb9b0640 / io_context_pool 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cded25800 / radosgw-admin 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.112015.log 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:32:13.627+0000 7f9cded25800 5 AuthRegistry(0x55a632fec2c0) adding con mode: secure 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:32:13.627+0000 7f9cded25800 5 AuthRegistry(0x55a632fec2c0) adding con mode: crc 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:32:13.627+0000 7f9cded25800 5 AuthRegistry(0x55a632fec2c0) adding con mode: secure 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:32:13.628+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: starting msgr at 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: starting objecter 2024-09-14T11:32:13.969 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command objecter_requests hook 0x55a633018630 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: setting wanted keys 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:32:13.628+0000 7f9cded25800 1 librados: calling monclient init 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding auth protocol: cephx 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding auth protocol: cephx 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding auth protocol: cephx 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.970 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: crc 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 AuthRegistry(0x55a632fe66b0) adding con mode: secure 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:32:13.628+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:32:13.628+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:32:13.628+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key hook 0x55a632fe67f8 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a632e6e170 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a632f298b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.971 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a632f2fee0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:32:13.628+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.270919s 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a632e6e170 auth_method 0 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a632f2fee0 auth_method 0 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.972 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:32:13.629+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a632f298b0 auth_method 0 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:32:13.629+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_done global_id 6590 payload 824 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 1 monclient: found mon.noname-c 2024-09-14T11:32:13.973 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:32:13.629+0000 7f9cda9ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: dump: 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.974 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:32:13.629+0000 7f9bc7606640 10 monclient: dump: 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.975 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:32:13.629+0000 7f9cded25800 5 monclient: authenticate success, global_id 6590 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:32:13.629+0000 7f9bc8e09640 4 set_mon_vals no callback set 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:32:13.629+0000 7f9cded25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:32:13.629+0000 7f9cded25800 1 librados: init done 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:32:13.631+0000 7f9bc7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:32:13.631+0000 7f9bc7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:32:13.631+0000 7f9bc7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:32:13.632+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9bc0077230 auth_method 0 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:32:13.632+0000 7f9cdb1af640 10 monclient: get_auth_request con 0x55a63302f290 auth_method 0 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:32:13.633+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x55a633032470 auth_method 0 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:32:13.634+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x55a633037500 auth_method 0 2024-09-14T11:32:13.976 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:32:13.635+0000 7f9cded25800 10 monclient: build_initial_monmap 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:32:13.635+0000 7f9cded25800 1 build_initial for_mkfs: 0 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:32:13.635+0000 7f9cded25800 10 monclient: monmap: 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding auth protocol: cephx 2024-09-14T11:32:13.977 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding auth protocol: cephx 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding auth protocol: cephx 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: crc 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303b4d0) adding con mode: secure 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:32:13.635+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.978 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command objecter_requests cmddesc objecter_requests hook 0x55a63303eee0 EEXIST 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:32:13.635+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding auth protocol: cephx 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding auth protocol: cephx 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding auth protocol: cephx 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.979 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: crc 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:32:13.635+0000 7f9cded25800 5 AuthRegistry(0x55a63303a468) adding con mode: secure 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:32:13.636+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:32:13.636+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:32:13.636+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key cmddesc rotate-key hook 0x55a63303a5b0 EEXIST 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a633062bd0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a633064ea0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a6330613a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.980 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:32:13.636+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.278388s 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a633064ea0 auth_method 0 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a633062bd0 auth_method 0 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a6330613a0 auth_method 0 2024-09-14T11:32:13.981 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:32:13.636+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:32:13.636+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_done global_id 7026 payload 824 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 1 monclient: found mon.noname-a 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:32:13.636+0000 7f9cda9ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.982 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: dump: 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.983 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:32:13.637+0000 7f9cded25800 5 monclient: authenticate success, global_id 7026 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:32:13.637+0000 7f9bc4e01640 10 monclient: dump: 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.984 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:32:13.637+0000 7f9cdb9b0640 4 set_mon_vals no callback set 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:32:13.637+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:13.985 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:32:13.638+0000 7f9bc4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:32:13.638+0000 7f9bc4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:32:13.638+0000 7f9bc4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:32:13.639+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9bb4077140 auth_method 0 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: get_monmap_and_config 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: build_initial_monmap 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:32:13.639+0000 7f9cded25800 1 build_initial for_mkfs: 0 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: monmap: 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding auth protocol: cephx 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding auth protocol: cephx 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding auth protocol: cephx 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.987 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: crc 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x55a633082980) adding con mode: secure 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:32:13.639+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:32:13.639+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding auth protocol: cephx 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding auth protocol: cephx 2024-09-14T11:32:13.988 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding auth protocol: cephx 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: crc 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:32:13.639+0000 7f9cded25800 5 AuthRegistry(0x7ffda988af30) adding con mode: secure 2024-09-14T11:32:13.989 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:32:13.639+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:32:13.640+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:32:13.640+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key cmddesc rotate-key hook 0x7ffda988b078 EEXIST 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a6330b6e90 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a633087cb0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a6330b22c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.282217s 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a6330b6e90 auth_method 0 2024-09-14T11:32:13.990 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a633087cb0 auth_method 0 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a6330b22c0 auth_method 0 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.991 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:32:13.640+0000 7f9cda1ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:32:13.640+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_done global_id 6596 payload 274 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient: _finish_hunting 0 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 1 monclient: found mon.noname-c 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:32:13.640+0000 7f9cda9ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: dump: 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.992 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:32:13.640+0000 7f9cded25800 5 monclient: authenticate success, global_id 6596 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:32:13.640+0000 7f9cded25800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:13.993 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:32:13.640+0000 7f9cded25800 4 set_mon_vals no callback set 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:32:13.640+0000 7f9bbe7fc640 10 monclient: dump: 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.994 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: shutdown 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: build_initial_monmap 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 build_initial for_mkfs: 0 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: monmap: 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:13.995 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding auth protocol: cephx 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding auth protocol: cephx 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding auth protocol: cephx 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.996 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: crc 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a6330b30c0) adding con mode: secure 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:32:13.641+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: starting msgr at 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: starting objecter 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command objecter_requests cmddesc objecter_requests hook 0x55a6330a9d90 EEXIST 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: setting wanted keys 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:32:13.641+0000 7f9cded25800 1 librados: calling monclient init 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:32:13.641+0000 7f9cded25800 10 monclient: init 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding auth protocol: cephx 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding auth protocol: cephx 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding auth protocol: cephx 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.997 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: crc 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:32:13.641+0000 7f9cded25800 5 AuthRegistry(0x55a63307a980) adding con mode: secure 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:32:13.642+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:32:13.642+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:32:13.642+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command rotate-key cmddesc rotate-key hook 0x55a63307aac8 EEXIST 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:13.998 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-c con 0x55a633087cb0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-b con 0x55a6330b22c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): picked mon.noname-a con 0x55a6330b6e90 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:32:13.642+0000 7f9cded25800 10 monclient(hunting): authenticate will time out at 2071.284417s 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request con 0x55a633087cb0 auth_method 0 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request con 0x55a6330b6e90 auth_method 0 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:13.999 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:32:13.642+0000 7f9cda9ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request con 0x55a6330b22c0 auth_method 0 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:32:13.642+0000 7f9cda1ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient(hunting): handle_auth_done global_id 7032 payload 824 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient: _finish_hunting 0 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 1 monclient: found mon.noname-a 2024-09-14T11:32:14.000 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:32:13.642+0000 7f9cdb1af640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: dump: 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:14.001 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: _finish_auth 0 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: _check_auth_tickets 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:32:13.643+0000 7f9bbcff9640 10 monclient: dump: 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:14.002 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:32:13.643+0000 7f9cded25800 5 monclient: authenticate success, global_id 7032 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:32:13.643+0000 7f9bbe7fc640 4 set_mon_vals no callback set 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _renew_subs 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:32:13.643+0000 7f9cded25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:32:13.643+0000 7f9cded25800 1 librados: init done 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:32:13.643+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cr dump hook 0x55a6330a4928 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:32:13.644+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:32:13.645+0000 7f9bbcff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:32:13.645+0000 7f9bbcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:32:13.645+0000 7f9bbcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:32:13.646+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9ba4077230 auth_method 0 2024-09-14T11:32:14.003 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:32:13.646+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x55a6330d0f00 auth_method 0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 realm 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:32:13.646+0000 7f9cded25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:32:13.646+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:32:13.647+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x55a6330d5280 auth_method 0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:32:13.647+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:32:13.648+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:32:13.648+0000 7f9cded25800 20 searching for the correct realm 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:32:13.648+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x55a6330da350 auth_method 0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:32:13.649+0000 7f9cdb1af640 10 monclient: get_auth_request con 0x7f9cd003a410 auth_method 0 2024-09-14T11:32:14.004 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:32:13.649+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9cd4064dd0 auth_method 0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:32:13.650+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9ccc0b9060 auth_method 0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:32:13.651+0000 7f9cda1ad640 0 -- 172.21.15.28:0/1448611797 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9ccc0b9060 msgr2=0x7f9ccc0ccab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:32:13.651+0000 7f9bbcff9640 1 client.7032.objecter ms_handle_reset 0x7f9ccc0b9060 session 0x7f9ccc099070 osd.4 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:32:13.651+0000 7f9bbcff9640 10 monclient: _renew_subs 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:32:13.651+0000 7f9bbcff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:32:13.651+0000 7f9cda1ad640 10 monclient: get_auth_request con 0x7f9ba40879e0 auth_method 0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:32:13.652+0000 7f9cdb1af640 10 monclient: get_auth_request con 0x7f9cd0027400 auth_method 0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:32:13.654+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9cd002d8f0 auth_method 0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:32:13.654+0000 7f9cda9ae640 0 -- 172.21.15.28:0/1448611797 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9cd002d8f0 msgr2=0x7f9cd000d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:32:13.855+0000 7f9cda9ae640 10 monclient: get_auth_request con 0x7f9cd002d8f0 auth_method 0 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.005 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:32:13.860+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 zone default found 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:32:13.861+0000 7f9cded25800 4 Realm: () 2024-09-14T11:32:14.006 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:32:13.861+0000 7f9cded25800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:32:13.861+0000 7f9cded25800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:32:13.861+0000 7f9cded25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 zonegroup default 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:32:13.861+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 started sync module instance, tier type = 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:32:13.862+0000 7f9cded25800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=0 2024-09-14T11:32:14.007 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=1 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=2 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=3 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=4 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=5 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:32:13.871+0000 7f9cded25800 20 add_watcher() i=6 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:32:13.872+0000 7f9cded25800 20 add_watcher() i=7 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:32:13.872+0000 7f9cded25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding auth protocol: cephx 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding auth protocol: cephx 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding auth protocol: cephx 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:14.008 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:32:13.873+0000 7f9b917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: crc 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:32:13.873+0000 7f9cded25800 5 AuthRegistry(0x7ffda988b410) adding con mode: secure 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:32:13.874+0000 7f9cded25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache list hook 0x55a6330a85a0 2024-09-14T11:32:14.009 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache inspect hook 0x55a6330a85a0 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache erase hook 0x55a6330a85a0 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command cache zap hook 0x55a6330a85a0 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 note: GC not initialized 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:32:13.874+0000 7f9b0bfff640 20 reqs_thread_entry: start 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace show hook 0x7f9ccc0c3070 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace history hook 0x7f9ccc0c3070 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace active hook 0x7f9ccc0c3070 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:32:13.874+0000 7f9cded25800 5 asok(0x55a632dc4270) register_command sync trace active_short hook 0x7f9ccc0c3070 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 Filter name: none 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:32:13.874+0000 7f9b09ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:32:13.874+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:32:13.874+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.010 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : miss 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:32:13.875+0000 7f9cded25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:32:13.875+0000 7f9cded25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:14.011 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:32:13.879+0000 7f9cded25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94172309500064 notifier 7032 bl.length()=915 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:32:13.879+0000 7f9bbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:32:13.881+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:32:13.884+0000 7f9cded25800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.0 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.0 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:32:13.884+0000 7f9cded25800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.1 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.1.1 2024-09-14T11:32:14.012 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:32:13.884+0000 7f9cded25800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.0 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:32:13.886+0000 7f9cded25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:32:13.886+0000 7f9cded25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:32:13.887+0000 7f9cded25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94172309500064 notifier 7032 bl.length()=915 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:32:13.888+0000 7f9bbe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:32:13.889+0000 7f9cded25800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:14.013 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:32:13.890+0000 7f9cded25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cded25800 time 2024-09-14T11:32:13.891271+0000 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9ce038c76a] 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:32:13.891+0000 7f9cded25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f9cded25800 thread_name:radosgw-admin 2024-09-14T11:32:14.014 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cdf03e6f0] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cdf08b99c] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9ce038c7c4] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9ce038c928] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a630aae0b1] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55a630abd18e] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a630abdfc4] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cdf029590] 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:32:14.015 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:32:14.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:32:14.017 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:32:14.018 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:32:14.019 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:14.020 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:14.021 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9b09ffb640 / http_manager 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9b0bfff640 / http_manager 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9b917e2640 / rgw_dt_lg_renew 2024-09-14T11:32:14.022 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bbcff9640 / ms_dispatch 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bbe7fc640 / io_context_pool 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bc4e01640 / ms_dispatch 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bc7606640 / ms_dispatch 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9bc8e09640 / io_context_pool 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cda1ad640 / msgr-worker-2 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cda9ae640 / msgr-worker-1 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cdb1af640 / msgr-worker-0 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cdb9b0640 / io_context_pool 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: 7f9cded25800 / radosgw-admin 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:13.892901Z_33cb26e8-f16a-4daa-ac6e-bfe758f3d573/log 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:32:14.023 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.970+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.971+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.971+0000 7f214f33e800 20 realm 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.971+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.972+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.972+0000 7f214f33e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.972+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.972+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.972+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.973+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.973+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.973+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.973+0000 7f214f33e800 20 searching for the correct realm 2024-09-14T11:32:14.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:13.975+0000 7f214b0ed640 0 -- 172.21.15.28:0/1446698002 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f214409bc20 msgr2=0x7f2144063e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:14.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.180+0000 7f214b8ee640 0 -- 172.21.15.28:0/1446698002 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f213406d020 msgr2=0x7f21340afaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.186+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 zone default found 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 4 Realm: () 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 zonegroup default 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.187+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.188+0000 7f214f33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.188+0000 7f214f33e800 20 started sync module instance, tier type = 2024-09-14T11:32:14.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.188+0000 7f214f33e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:14.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=0 2024-09-14T11:32:14.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=1 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=2 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=3 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=4 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=5 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.197+0000 7f214f33e800 20 add_watcher() i=6 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.198+0000 7f214f33e800 20 add_watcher() i=7 2024-09-14T11:32:14.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.198+0000 7f214f33e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.200+0000 7f2001fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.200+0000 7f214f33e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.200+0000 7f214f33e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.200+0000 7f214f33e800 5 note: GC not initialized 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f2000fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f214f33e800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f214f33e800 20 Filter name: none 2024-09-14T11:32:14.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f1f7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:14.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.201+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:14.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.202+0000 7f214f33e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:14.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.204+0000 7f2001fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.206+0000 7f214f33e800 20 remove_watcher() i=0 2024-09-14T11:32:14.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.206+0000 7f214f33e800 2 removed watcher, disabling cache 2024-09-14T11:32:14.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.207+0000 7f214f33e800 20 remove_watcher() i=1 2024-09-14T11:32:14.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.208+0000 7f214f33e800 20 remove_watcher() i=2 2024-09-14T11:32:14.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.209+0000 7f214f33e800 20 remove_watcher() i=3 2024-09-14T11:32:14.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.210+0000 7f214f33e800 20 remove_watcher() i=4 2024-09-14T11:32:14.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.211+0000 7f214f33e800 20 remove_watcher() i=5 2024-09-14T11:32:14.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.212+0000 7f214f33e800 20 remove_watcher() i=6 2024-09-14T11:32:14.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.213+0000 7f214f33e800 20 remove_watcher() i=7 2024-09-14T11:32:14.223 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.223 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:14.223 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-block-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:14.223 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:14.316 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:14.348 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:14.348 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:14.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.389+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.390+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.390+0000 7f2f34d3e800 20 realm 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.390+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.391+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.391+0000 7f2f34d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.391+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.391+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.391+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.392+0000 7f2f34d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.392+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.392+0000 7f2f34d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.392+0000 7f2f34d3e800 20 searching for the correct realm 2024-09-14T11:32:14.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.394+0000 7f2f30ac0640 0 -- 172.21.15.28:0/915596432 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f2f18003ab0 msgr2=0x7f2f2801a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.600+0000 7f2f312c1640 0 -- 172.21.15.28:0/915596432 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f2f240a4870 msgr2=0x7f2f240ac770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.806+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 zone default found 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 4 Realm: () 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 zonegroup default 2024-09-14T11:32:14.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.807+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 started sync module instance, tier type = 2024-09-14T11:32:14.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.808+0000 7f2f34d3e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=0 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=1 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=2 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=3 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=4 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=5 2024-09-14T11:32:14.818 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.819+0000 7f2f34d3e800 20 add_watcher() i=6 2024-09-14T11:32:14.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.820+0000 7f2f34d3e800 20 add_watcher() i=7 2024-09-14T11:32:14.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.820+0000 7f2f34d3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.821+0000 7f2de6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.821 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 5 note: GC not initialized 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2de5fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 20 Filter name: none 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2d577fe640 20 reqs_thread_entry: start 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:32:14.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.822+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : miss 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:14.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.823+0000 7f2f34d3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:14.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.824+0000 7f2f34d3e800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to be held by another RGW process; skipping for now 2024-09-14T11:32:14.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.825+0000 7f2de6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.829+0000 7f2f34d3e800 20 remove_watcher() i=0 2024-09-14T11:32:14.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.829+0000 7f2f34d3e800 2 removed watcher, disabling cache 2024-09-14T11:32:14.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.829+0000 7f2f34d3e800 20 remove_watcher() i=1 2024-09-14T11:32:14.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.830+0000 7f2f34d3e800 20 remove_watcher() i=2 2024-09-14T11:32:14.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.831+0000 7f2f34d3e800 20 remove_watcher() i=3 2024-09-14T11:32:14.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.832+0000 7f2f34d3e800 20 remove_watcher() i=4 2024-09-14T11:32:14.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.833+0000 7f2f34d3e800 20 remove_watcher() i=5 2024-09-14T11:32:14.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.834+0000 7f2f34d3e800 20 remove_watcher() i=6 2024-09-14T11:32:14.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:14.835+0000 7f2f34d3e800 20 remove_watcher() i=7 2024-09-14T11:32:14.845 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:32:44.878 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:44.915 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:44.915 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:44.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.961+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 realm 2024-09-14T11:32:44.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:44.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:44.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.963+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.964+0000 7f5726f33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:44.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.964+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:44.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.964+0000 7f5726f33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:44.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.964+0000 7f5726f33800 20 searching for the correct realm 2024-09-14T11:32:44.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:44.966+0000 7f5722b99640 0 -- 172.21.15.28:0/171303381 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x557063e1e1b0 msgr2=0x7f571c007580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.172+0000 7f572339a640 0 -- 172.21.15.28:0/171303381 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f5718060070 msgr2=0x7f57180ab620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:45.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.179+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 zone default found 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 4 Realm: () 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:45.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 zonegroup default 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.180+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.181+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.181+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.181+0000 7f5726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.181+0000 7f5726f33800 20 started sync module instance, tier type = 2024-09-14T11:32:45.183 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.181+0000 7f5726f33800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:45.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=0 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=1 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=2 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=3 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=4 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=5 2024-09-14T11:32:45.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.192+0000 7f5726f33800 20 add_watcher() i=6 2024-09-14T11:32:45.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.194+0000 7f5726f33800 20 add_watcher() i=7 2024-09-14T11:32:45.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.194+0000 7f5726f33800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.195+0000 7f55d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5726f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5726f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5726f33800 5 note: GC not initialized 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5553fff640 20 reqs_thread_entry: start 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5726f33800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5726f33800 20 Filter name: none 2024-09-14T11:32:45.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.196+0000 7f5551ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : miss 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:45.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.197+0000 7f5726f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:45.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.199+0000 7f5726f33800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:32:45.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.203+0000 7f5726f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.203+0000 7f5726f33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.203+0000 7f5726f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.203+0000 7f5726f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:45.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.204+0000 7f56067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 93941202862256 notifier 6644 bl.length()=915 2024-09-14T11:32:45.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.204+0000 7f56067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.204+0000 7f56067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.204+0000 7f56067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.205+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:45.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.205+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:45.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.205+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:45.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.205+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:45.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.210+0000 7f5726f33800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.2.0 2024-09-14T11:32:45.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.210+0000 7f5726f33800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.2.0 2024-09-14T11:32:45.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.210+0000 7f5726f33800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.2.1 2024-09-14T11:32:45.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.210+0000 7f5726f33800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.2.1 2024-09-14T11:32:45.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.210+0000 7f5726f33800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.0 2024-09-14T11:32:45.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.213+0000 7f5726f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:45.212 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.213+0000 7f5726f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:45.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5726f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.213 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5726f33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5726f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5726f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5605ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 93941202862256 notifier 6644 bl.length()=915 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5605ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5605ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.214+0000 7f5605ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.216+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.216+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.216+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:45.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.216+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:45.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.217+0000 7f5726f33800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29.0 2024-09-14T11:32:45.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.217+0000 7f5726f33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:45.217 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.217+0000 7f5726f33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 2024-09-14T11:32:45.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f5726f33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f5726f33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f5726f33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f5726f33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29, ofs0, ns] 2024-09-14T11:32:45.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f56067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 93941202862256 notifier 6644 bl.length()=883 2024-09-14T11:32:45.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f56067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 info.flags=0x17 2024-09-14T11:32:45.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f56067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 to cache LRU end 2024-09-14T11:32:45.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.219+0000 7f56067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:45.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.221+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_sources= new_sources= 2024-09-14T11:32:45.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.221+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential sources added=[] removed=[] 2024-09-14T11:32:45.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.221+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): orig_dests= new_dests= 2024-09-14T11:32:45.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.221+0000 7f5726f33800 20 handle_bi_update(): bucket=:abort-at-block-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29]): potential dests added=[] removed=[] 2024-09-14T11:32:45.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.222+0000 7f5726f33800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:32:45.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.224+0000 7f55d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.227+0000 7f5726f33800 20 remove_watcher() i=0 2024-09-14T11:32:45.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.227+0000 7f5726f33800 2 removed watcher, disabling cache 2024-09-14T11:32:45.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.228+0000 7f5726f33800 20 remove_watcher() i=1 2024-09-14T11:32:45.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.229+0000 7f5726f33800 20 remove_watcher() i=2 2024-09-14T11:32:45.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.230+0000 7f5726f33800 20 remove_watcher() i=3 2024-09-14T11:32:45.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.231+0000 7f5726f33800 20 remove_watcher() i=4 2024-09-14T11:32:45.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.233+0000 7f5726f33800 20 remove_watcher() i=5 2024-09-14T11:32:45.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.234+0000 7f5726f33800 20 remove_watcher() i=6 2024-09-14T11:32:45.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.235+0000 7f5726f33800 20 remove_watcher() i=7 2024-09-14T11:32:45.247 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:32:45.278 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:45.278 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:45.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.320+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 realm 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.322+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.323+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.323+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.323+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:45.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.323+0000 7f709d326800 20 searching for the correct realm 2024-09-14T11:32:45.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.325+0000 7f7099870640 0 -- 172.21.15.28:0/3716924498 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f70840030f0 msgr2=0x7f7090060170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.327 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.328+0000 7f7099870640 0 -- 172.21.15.28:0/3716924498 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f709006a2c0 msgr2=0x7f70900849d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:45.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.538+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 zone default found 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 4 Realm: () 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 zonegroup default 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.539+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.540+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.540+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.540+0000 7f709d326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.540+0000 7f709d326800 20 started sync module instance, tier type = 2024-09-14T11:32:45.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.540+0000 7f709d326800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=0 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=1 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=2 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=3 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=4 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=5 2024-09-14T11:32:45.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.550+0000 7f709d326800 20 add_watcher() i=6 2024-09-14T11:32:45.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.551+0000 7f709d326800 20 add_watcher() i=7 2024-09-14T11:32:45.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.551+0000 7f709d326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:45.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.552+0000 7f6f4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f709d326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:45.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f709d326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f709d326800 5 note: GC not initialized 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f6f4e7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f709d326800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f709d326800 20 Filter name: none 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f6ebffff640 20 reqs_thread_entry: start 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.553+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:45.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:45.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.554+0000 7f709d326800 20 rados->read ofs=0 len=0 2024-09-14T11:32:45.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.555+0000 7f709d326800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:32:45.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.555+0000 7f709d326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:45.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.556+0000 7f6f4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:45.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.558+0000 7f709d326800 20 remove_watcher() i=0 2024-09-14T11:32:45.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.558+0000 7f709d326800 2 removed watcher, disabling cache 2024-09-14T11:32:45.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.560+0000 7f709d326800 20 remove_watcher() i=1 2024-09-14T11:32:45.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.561+0000 7f709d326800 20 remove_watcher() i=2 2024-09-14T11:32:45.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.562+0000 7f709d326800 20 remove_watcher() i=3 2024-09-14T11:32:45.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.563+0000 7f709d326800 20 remove_watcher() i=4 2024-09-14T11:32:45.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.564+0000 7f709d326800 20 remove_watcher() i=5 2024-09-14T11:32:45.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.565+0000 7f709d326800 20 remove_watcher() i=6 2024-09-14T11:32:45.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:45.566+0000 7f709d326800 20 remove_watcher() i=7 2024-09-14T11:32:45.576 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:45.576 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:45.576 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-block-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:32:45.576 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:45.880 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:32:45.880 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:46.917 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:32:46.946 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:46.946 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:47.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.187+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 realm 2024-09-14T11:32:47.188 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.189+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.190+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.190+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.191+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.191+0000 7f3c08923800 20 searching for the correct realm 2024-09-14T11:32:47.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.194+0000 7f3c03d32640 0 -- 172.21.15.28:0/1259811969 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f3bf4047040 msgr2=0x7f3bf402c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.198+0000 7f3c04533640 0 -- 172.21.15.28:0/1259811969 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f3bf80cd040 msgr2=0x7f3bf80e3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:47.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.405+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 zone default found 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 4 Realm: () 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 zonegroup default 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.406+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.407+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.407+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.407+0000 7f3c08923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.407+0000 7f3c08923800 20 started sync module instance, tier type = 2024-09-14T11:32:47.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.407+0000 7f3c08923800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=0 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=1 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=2 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=3 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=4 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=5 2024-09-14T11:32:47.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.417+0000 7f3c08923800 20 add_watcher() i=6 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.418+0000 7f3c08923800 20 add_watcher() i=7 2024-09-14T11:32:47.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.418+0000 7f3c08923800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:47.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.420+0000 7f3abafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3c08923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3c08923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3c08923800 5 note: GC not initialized 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3ab9fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3c08923800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3c08923800 20 Filter name: none 2024-09-14T11:32:47.420 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3a2b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.421+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.422+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:47.421 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.422+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.423+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.423+0000 7f3c08923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.423+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.423+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:47.422 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.423+0000 7f3c08923800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.424+0000 7f3c08923800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:47.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.424+0000 7f3c08923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:47.424 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.425+0000 7f3abafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:47.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.428+0000 7f3c08923800 20 remove_watcher() i=0 2024-09-14T11:32:47.427 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.428+0000 7f3c08923800 2 removed watcher, disabling cache 2024-09-14T11:32:47.428 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.429+0000 7f3c08923800 20 remove_watcher() i=1 2024-09-14T11:32:47.429 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.430+0000 7f3c08923800 20 remove_watcher() i=2 2024-09-14T11:32:47.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.431+0000 7f3c08923800 20 remove_watcher() i=3 2024-09-14T11:32:47.431 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.432+0000 7f3c08923800 20 remove_watcher() i=4 2024-09-14T11:32:47.432 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.433+0000 7f3c08923800 20 remove_watcher() i=5 2024-09-14T11:32:47.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.434+0000 7f3c08923800 20 remove_watcher() i=6 2024-09-14T11:32:47.434 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.435+0000 7f3c08923800 20 remove_watcher() i=7 2024-09-14T11:32:47.445 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:47.446 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:47.447 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:32:47.482 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:47.482 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:47.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.522+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 realm 2024-09-14T11:32:47.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:47.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:47.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.524+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.727+0000 7fbed6e2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:47.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.727+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:47.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.727+0000 7fbed6e2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:47.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.727+0000 7fbed6e2b800 20 searching for the correct realm 2024-09-14T11:32:47.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.730+0000 7fbed4114640 0 -- 172.21.15.28:0/3174826393 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fbec40b6950 msgr2=0x7fbec40ac120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:47.936+0000 7fbed4915640 0 -- 172.21.15.28:0/3174826393 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fbec8038ba0 msgr2=0x7fbec8023410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.144+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 zone default found 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 4 Realm: () 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 zonegroup default 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.145+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.146+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.146+0000 7fbed6e2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.146+0000 7fbed6e2b800 20 started sync module instance, tier type = 2024-09-14T11:32:48.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.146+0000 7fbed6e2b800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=0 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=1 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=2 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=3 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=4 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=5 2024-09-14T11:32:48.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.157+0000 7fbed6e2b800 20 add_watcher() i=6 2024-09-14T11:32:48.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.158+0000 7fbed6e2b800 20 add_watcher() i=7 2024-09-14T11:32:48.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.158+0000 7fbed6e2b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:48.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.160+0000 7fbd8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:48.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.160+0000 7fbed6e2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:48.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.160+0000 7fbed6e2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:48.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.160+0000 7fbed6e2b800 5 note: GC not initialized 2024-09-14T11:32:48.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.161+0000 7fbd8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:48.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.161+0000 7fbed6e2b800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:48.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.161+0000 7fbed6e2b800 20 Filter name: none 2024-09-14T11:32:48.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.161+0000 7fbd83fff640 20 reqs_thread_entry: start 2024-09-14T11:32:48.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.161+0000 7fbed6e2b800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:32:48.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.161+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.161 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 : miss 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.162 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.162+0000 7fbed6e2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.166+0000 7fbed6e2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.166+0000 7fbed6e2b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.166+0000 7fbed6e2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.166+0000 7fbed6e2b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30, ofs0, ns] 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.167+0000 7fbdab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94445105182656 notifier 7146 bl.length()=931 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.167+0000 7fbdab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.167+0000 7fbdab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.167+0000 7fbdab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.169+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_sources= new_sources= 2024-09-14T11:32:48.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.169+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential sources added=[] removed=[] 2024-09-14T11:32:48.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.169+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_dests= new_dests= 2024-09-14T11:32:48.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.169+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential dests added=[] removed=[] 2024-09-14T11:32:48.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.171+0000 7fbed6e2b800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.1.0 2024-09-14T11:32:48.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.171+0000 7fbed6e2b800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.1.0 2024-09-14T11:32:48.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.171+0000 7fbed6e2b800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.1.1 2024-09-14T11:32:48.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.171+0000 7fbed6e2b800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.1.1 2024-09-14T11:32:48.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.171+0000 7fbed6e2b800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.0 2024-09-14T11:32:48.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.174+0000 7fbed6e2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:48.173 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.174+0000 7fbed6e2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 2024-09-14T11:32:48.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.175+0000 7fbed6e2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.174 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.175+0000 7fbed6e2b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.175+0000 7fbed6e2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.175+0000 7fbed6e2b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30, ofs0, ns] 2024-09-14T11:32:48.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.176+0000 7fbdab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94445105182656 notifier 7146 bl.length()=931 2024-09-14T11:32:48.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.176+0000 7fbdab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.176+0000 7fbdab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.175 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.176+0000 7fbdab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.178+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_sources= new_sources= 2024-09-14T11:32:48.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.178+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential sources added=[] removed=[] 2024-09-14T11:32:48.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.178+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_dests= new_dests= 2024-09-14T11:32:48.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.178+0000 7fbed6e2b800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential dests added=[] removed=[] 2024-09-14T11:32:48.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.179+0000 7fbed6e2b800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.0 2024-09-14T11:32:48.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.179+0000 7fbed6e2b800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:32:48.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.179+0000 7fbed6e2b800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:32:48.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.183+0000 7fbd8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:48.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.186+0000 7fbed6e2b800 20 remove_watcher() i=0 2024-09-14T11:32:48.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.186+0000 7fbed6e2b800 2 removed watcher, disabling cache 2024-09-14T11:32:48.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.187+0000 7fbed6e2b800 20 remove_watcher() i=1 2024-09-14T11:32:48.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.188+0000 7fbed6e2b800 20 remove_watcher() i=2 2024-09-14T11:32:48.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.190+0000 7fbed6e2b800 20 remove_watcher() i=3 2024-09-14T11:32:48.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.191+0000 7fbed6e2b800 20 remove_watcher() i=4 2024-09-14T11:32:48.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.192+0000 7fbed6e2b800 20 remove_watcher() i=5 2024-09-14T11:32:48.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.193+0000 7fbed6e2b800 20 remove_watcher() i=6 2024-09-14T11:32:48.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.194+0000 7fbed6e2b800 20 remove_watcher() i=7 2024-09-14T11:32:48.207 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:32:48.238 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:48.239 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:48.281 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.282+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 realm 2024-09-14T11:32:48.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.283 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:48.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.284+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.285+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:48.284 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.285+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.286+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:48.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.286+0000 7fa499baf800 20 searching for the correct realm 2024-09-14T11:32:48.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.289+0000 7fa497e9a640 0 -- 172.21.15.28:0/3780025717 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fa48c0e7400 msgr2=0x7fa48c0dba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:48.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.293+0000 7fa497699640 0 -- 172.21.15.28:0/3780025717 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fa48c0adff0 msgr2=0x7fa48c0c7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:48.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.499+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:48.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 zone default found 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 4 Realm: () 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 zonegroup default 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.500+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 started sync module instance, tier type = 2024-09-14T11:32:48.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.501+0000 7fa499baf800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:48.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=0 2024-09-14T11:32:48.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=1 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=2 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=3 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=4 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=5 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.511+0000 7fa499baf800 20 add_watcher() i=6 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.512+0000 7fa499baf800 20 add_watcher() i=7 2024-09-14T11:32:48.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.512+0000 7fa499baf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:48.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.514+0000 7fa34dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:48.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.514+0000 7fa499baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:48.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.514+0000 7fa499baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:48.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.515+0000 7fa499baf800 5 note: GC not initialized 2024-09-14T11:32:48.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.515+0000 7fa34cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:48.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.515+0000 7fa499baf800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:48.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.515+0000 7fa499baf800 20 Filter name: none 2024-09-14T11:32:48.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.515+0000 7fa2c67fc640 20 reqs_thread_entry: start 2024-09-14T11:32:48.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.515+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.516+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:48.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.516+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.516+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.516+0000 7fa499baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.516+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.517+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.517+0000 7fa499baf800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.517+0000 7fa499baf800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:32:48.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.517+0000 7fa499baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:48.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.519+0000 7fa34dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:48.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.521+0000 7fa499baf800 20 remove_watcher() i=0 2024-09-14T11:32:48.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.521+0000 7fa499baf800 2 removed watcher, disabling cache 2024-09-14T11:32:48.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.522+0000 7fa499baf800 20 remove_watcher() i=1 2024-09-14T11:32:48.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.524+0000 7fa499baf800 20 remove_watcher() i=2 2024-09-14T11:32:48.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.525+0000 7fa499baf800 20 remove_watcher() i=3 2024-09-14T11:32:48.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.526+0000 7fa499baf800 20 remove_watcher() i=4 2024-09-14T11:32:48.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.527+0000 7fa499baf800 20 remove_watcher() i=5 2024-09-14T11:32:48.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.528+0000 7fa499baf800 20 remove_watcher() i=6 2024-09-14T11:32:48.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.529+0000 7fa499baf800 20 remove_watcher() i=7 2024-09-14T11:32:48.539 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:48.539 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:48.539 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:48.539 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:48.633 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:48.666 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:48.666 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:48.706 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.707+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.708+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.708+0000 7f9b9db39800 20 realm 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.708+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.708+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.708+0000 7f9b9db39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.708+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.709+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.709+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.710+0000 7f9b9db39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:48.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.710+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.710+0000 7f9b9db39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:48.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.710+0000 7f9b9db39800 20 searching for the correct realm 2024-09-14T11:32:48.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.714+0000 7f9b9a026640 0 -- 172.21.15.28:0/4108714816 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x559a23605a30 msgr2=0x559a23607ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:48.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.718+0000 7f9b99024640 0 -- 172.21.15.28:0/4108714816 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9b8c074070 msgr2=0x7f9b8c03a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:48.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.722+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 zone default found 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 4 Realm: () 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:48.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 zonegroup default 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.723+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.724+0000 7f9b9db39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.724+0000 7f9b9db39800 20 started sync module instance, tier type = 2024-09-14T11:32:48.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.724+0000 7f9b9db39800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:48.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=0 2024-09-14T11:32:48.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=1 2024-09-14T11:32:48.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=2 2024-09-14T11:32:48.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=3 2024-09-14T11:32:48.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=4 2024-09-14T11:32:48.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=5 2024-09-14T11:32:48.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.733+0000 7f9b9db39800 20 add_watcher() i=6 2024-09-14T11:32:48.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.734+0000 7f9b9db39800 20 add_watcher() i=7 2024-09-14T11:32:48.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.734+0000 7f9b9db39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:48.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9a4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:48.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9b9db39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9b9db39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9b9db39800 5 note: GC not initialized 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9a4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9b9db39800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.736+0000 7f9b9db39800 20 Filter name: none 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f99bbfff640 20 reqs_thread_entry: start 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:32:48.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 : miss 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.737+0000 7f9b9db39800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.738+0000 7f9b9db39800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.738+0000 7f9b9db39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.738+0000 7f9b9db39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.738+0000 7f9b9db39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:48.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.738+0000 7f9b9db39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.738+0000 7f9b9db39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 2024-09-14T11:32:48.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.739+0000 7f9b9db39800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9b9db39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9b9db39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9b9db39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9b9db39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30, ofs0, ns] 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9a7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94120506892880 notifier 7179 bl.length()=931 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9a7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9a7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.743+0000 7f9a7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.745+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_sources= new_sources= 2024-09-14T11:32:48.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.745+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential sources added=[] removed=[] 2024-09-14T11:32:48.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.745+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_dests= new_dests= 2024-09-14T11:32:48.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.745+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential dests added=[] removed=[] 2024-09-14T11:32:48.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.747+0000 7f9b9db39800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.2.0 2024-09-14T11:32:48.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.747+0000 7f9b9db39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.2.0 2024-09-14T11:32:48.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.747+0000 7f9b9db39800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.2.1 2024-09-14T11:32:48.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.747+0000 7f9b9db39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.2.1 2024-09-14T11:32:48.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.747+0000 7f9b9db39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.0 2024-09-14T11:32:48.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.749+0000 7f9b9db39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:48.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.750+0000 7f9b9db39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 2024-09-14T11:32:48.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9b9db39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9b9db39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9b9db39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9b9db39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30, ofs0, ns] 2024-09-14T11:32:48.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9a7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94120506892880 notifier 7179 bl.length()=931 2024-09-14T11:32:48.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9a7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9a7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.751+0000 7f9a7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.753+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_sources= new_sources= 2024-09-14T11:32:48.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.753+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential sources added=[] removed=[] 2024-09-14T11:32:48.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.753+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_dests= new_dests= 2024-09-14T11:32:48.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.753+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential dests added=[] removed=[] 2024-09-14T11:32:48.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.754+0000 7f9b9db39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30.0 2024-09-14T11:32:48.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.754+0000 7f9b9db39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:48.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.754+0000 7f9b9db39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.755+0000 7f9b9db39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.755+0000 7f9b9db39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.755+0000 7f9b9db39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.755+0000 7f9b9db39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30, ofs0, ns] 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.756+0000 7f9a7cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 94120506892880 notifier 7179 bl.length()=899 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.756+0000 7f9a7cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 info.flags=0x17 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.756+0000 7f9a7cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 to cache LRU end 2024-09-14T11:32:48.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.756+0000 7f9a7cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:48.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.757+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_sources= new_sources= 2024-09-14T11:32:48.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.757+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential sources added=[] removed=[] 2024-09-14T11:32:48.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.757+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): orig_dests= new_dests= 2024-09-14T11:32:48.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.757+0000 7f9b9db39800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30]): potential dests added=[] removed=[] 2024-09-14T11:32:48.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.758+0000 7f9b9db39800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:32:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.760+0000 7f9a4b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:48.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.762+0000 7f9b9db39800 20 remove_watcher() i=0 2024-09-14T11:32:48.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.762+0000 7f9b9db39800 2 removed watcher, disabling cache 2024-09-14T11:32:48.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.764+0000 7f9b9db39800 20 remove_watcher() i=1 2024-09-14T11:32:48.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.765+0000 7f9b9db39800 20 remove_watcher() i=2 2024-09-14T11:32:48.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.766+0000 7f9b9db39800 20 remove_watcher() i=3 2024-09-14T11:32:48.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.767+0000 7f9b9db39800 20 remove_watcher() i=4 2024-09-14T11:32:48.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.768+0000 7f9b9db39800 20 remove_watcher() i=5 2024-09-14T11:32:48.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.769+0000 7f9b9db39800 20 remove_watcher() i=6 2024-09-14T11:32:48.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.770+0000 7f9b9db39800 20 remove_watcher() i=7 2024-09-14T11:32:48.781 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:32:48.810 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:48.810 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:48.849 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.850+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.852+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.852+0000 7f65fc126800 20 realm 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.852+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.852+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.852+0000 7f65fc126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.852+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.853+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:48.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.853+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.853+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:48.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.853+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:48.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.854+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:48.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.854+0000 7f65fc126800 20 searching for the correct realm 2024-09-14T11:32:48.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.856+0000 7f65f75d8640 0 -- 172.21.15.28:0/3359329478 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f65e8070070 msgr2=0x7f65e8062440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:48.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:48.861+0000 7f65f7dd9640 0 -- 172.21.15.28:0/3359329478 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f65ec072eb0 msgr2=0x7f65ec071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:49.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:49.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:49.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:49.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:49.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:49.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:49.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.066+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:49.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:49.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:49.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 zone default found 2024-09-14T11:32:49.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 4 Realm: () 2024-09-14T11:32:49.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 zonegroup default 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.067+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.068+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.068+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.068+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.068+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.069+0000 7f65fc126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.069+0000 7f65fc126800 20 started sync module instance, tier type = 2024-09-14T11:32:49.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.069+0000 7f65fc126800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:49.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=0 2024-09-14T11:32:49.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=1 2024-09-14T11:32:49.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=2 2024-09-14T11:32:49.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=3 2024-09-14T11:32:49.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=4 2024-09-14T11:32:49.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=5 2024-09-14T11:32:49.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.078+0000 7f65fc126800 20 add_watcher() i=6 2024-09-14T11:32:49.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.079+0000 7f65fc126800 20 add_watcher() i=7 2024-09-14T11:32:49.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.079+0000 7f65fc126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:49.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.080+0000 7f64adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:49.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f65fc126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:49.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f65fc126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:49.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f65fc126800 5 note: GC not initialized 2024-09-14T11:32:49.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f64acfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:49.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f65fc126800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:49.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f65fc126800 20 Filter name: none 2024-09-14T11:32:49.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f64267fc640 20 reqs_thread_entry: start 2024-09-14T11:32:49.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.081+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.082+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.082+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.082+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.082+0000 7f65fc126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.082+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.083+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:49.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.083+0000 7f65fc126800 20 rados->read ofs=0 len=0 2024-09-14T11:32:49.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.083+0000 7f65fc126800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:49.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.083+0000 7f65fc126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:49.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.085+0000 7f64adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:49.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.088+0000 7f65fc126800 20 remove_watcher() i=0 2024-09-14T11:32:49.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.088+0000 7f65fc126800 2 removed watcher, disabling cache 2024-09-14T11:32:49.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.088+0000 7f65fc126800 20 remove_watcher() i=1 2024-09-14T11:32:49.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.090+0000 7f65fc126800 20 remove_watcher() i=2 2024-09-14T11:32:49.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.090+0000 7f65fc126800 20 remove_watcher() i=3 2024-09-14T11:32:49.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.091+0000 7f65fc126800 20 remove_watcher() i=4 2024-09-14T11:32:49.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.092+0000 7f65fc126800 20 remove_watcher() i=5 2024-09-14T11:32:49.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.093+0000 7f65fc126800 20 remove_watcher() i=6 2024-09-14T11:32:49.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:49.094+0000 7f65fc126800 20 remove_watcher() i=7 2024-09-14T11:32:49.104 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:49.104 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:49.104 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:32:49.104 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:32:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:50.262 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:32:50.291 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:50.292 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:50.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.332+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.334+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.334+0000 7f92e8924800 20 realm 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.334+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.334+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.334+0000 7f92e8924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.334+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.335+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.335+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.335+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:50.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.335+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.336+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:50.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.336+0000 7f92e8924800 20 searching for the correct realm 2024-09-14T11:32:50.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.339+0000 7f92e4e69640 0 -- 172.21.15.28:0/2680917792 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f92d8020070 msgr2=0x7f92d805f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:50.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.342+0000 7f92e4668640 0 -- 172.21.15.28:0/2680917792 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f92d805fd20 msgr2=0x7f92d806f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:50.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.549+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:50.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 zone default found 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 4 Realm: () 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 zonegroup default 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.550+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.551+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.551+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.551+0000 7f92e8924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.551+0000 7f92e8924800 20 started sync module instance, tier type = 2024-09-14T11:32:50.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.551+0000 7f92e8924800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=0 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=1 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=2 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=3 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=4 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=5 2024-09-14T11:32:50.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.560+0000 7f92e8924800 20 add_watcher() i=6 2024-09-14T11:32:50.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.561+0000 7f92e8924800 20 add_watcher() i=7 2024-09-14T11:32:50.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.561+0000 7f92e8924800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:50.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.562+0000 7f919afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:50.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f92e8924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:50.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f92e8924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:50.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f92e8924800 5 note: GC not initialized 2024-09-14T11:32:50.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f9199fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:50.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f92e8924800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:50.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f92e8924800 20 Filter name: none 2024-09-14T11:32:50.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f910b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:50.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.563+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.564+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.564+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.564+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.564+0000 7f92e8924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.564+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.565+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:50.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.565+0000 7f92e8924800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.565+0000 7f92e8924800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:50.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.565+0000 7f92e8924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:50.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.566+0000 7f919afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:50.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.568+0000 7f92e8924800 20 remove_watcher() i=0 2024-09-14T11:32:50.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.568+0000 7f92e8924800 2 removed watcher, disabling cache 2024-09-14T11:32:50.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.569+0000 7f92e8924800 20 remove_watcher() i=1 2024-09-14T11:32:50.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.570+0000 7f92e8924800 20 remove_watcher() i=2 2024-09-14T11:32:50.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.572+0000 7f92e8924800 20 remove_watcher() i=3 2024-09-14T11:32:50.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.573+0000 7f92e8924800 20 remove_watcher() i=4 2024-09-14T11:32:50.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.574+0000 7f92e8924800 20 remove_watcher() i=5 2024-09-14T11:32:50.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.574+0000 7f92e8924800 20 remove_watcher() i=6 2024-09-14T11:32:50.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.575+0000 7f92e8924800 20 remove_watcher() i=7 2024-09-14T11:32:50.584 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:50.584 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:50.585 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:50.585 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:50.586 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:32:50.624 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:50.624 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:50.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.666+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.667+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.667+0000 7f159931f800 20 realm 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.667+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.667+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.667+0000 7f159931f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.667+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.668+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.668+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.668+0000 7f159931f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:50.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.668+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.669+0000 7f159931f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:50.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.669+0000 7f159931f800 20 searching for the correct realm 2024-09-14T11:32:50.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.672+0000 7f158ffff640 0 -- 172.21.15.28:0/3958031407 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f158801a940 msgr2=0x7f15880476f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:50.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.675+0000 7f1594f92640 0 -- 172.21.15.28:0/3958031407 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f1580098910 msgr2=0x7f15800893b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:50.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:50.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:50.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:50.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:50.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:50.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:50.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.881+0000 7f159931f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:50.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:50.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 zone default found 2024-09-14T11:32:50.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 4 Realm: () 2024-09-14T11:32:50.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 zonegroup default 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.882+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.883+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.883+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.883+0000 7f159931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.883+0000 7f159931f800 20 started sync module instance, tier type = 2024-09-14T11:32:50.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.883+0000 7f159931f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=0 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=1 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=2 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=3 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=4 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=5 2024-09-14T11:32:50.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=6 2024-09-14T11:32:50.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 20 add_watcher() i=7 2024-09-14T11:32:50.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.893+0000 7f159931f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.895+0000 7f144afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.895+0000 7f159931f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.895+0000 7f159931f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.895+0000 7f159931f800 5 note: GC not initialized 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.896+0000 7f1449fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.896+0000 7f159931f800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.896+0000 7f159931f800 20 Filter name: none 2024-09-14T11:32:50.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.896+0000 7f13bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:50.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.896+0000 7f159931f800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:32:50.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.896+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:50.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:50.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:32:50.895 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 : miss 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.897+0000 7f159931f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f159931f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f159931f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f159931f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f159931f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31, ofs0, ns] 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f146bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 93826268850832 notifier 6776 bl.length()=931 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f146bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f146bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.901+0000 7f146bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.903+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): orig_sources= new_sources= 2024-09-14T11:32:50.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.903+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): potential sources added=[] removed=[] 2024-09-14T11:32:50.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.903+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): orig_dests= new_dests= 2024-09-14T11:32:50.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.903+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): potential dests added=[] removed=[] 2024-09-14T11:32:50.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.906+0000 7f159931f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31.1.0 2024-09-14T11:32:50.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.906+0000 7f159931f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31.1.0 2024-09-14T11:32:50.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.906+0000 7f159931f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31.1.1 2024-09-14T11:32:50.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.906+0000 7f159931f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31.1.1 2024-09-14T11:32:50.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.906+0000 7f159931f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31.0 2024-09-14T11:32:50.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.908+0000 7f159931f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:50.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.908+0000 7f159931f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 2024-09-14T11:32:50.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f159931f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f159931f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f159931f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f159931f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31, ofs0, ns] 2024-09-14T11:32:50.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f146bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 93826268850832 notifier 6776 bl.length()=931 2024-09-14T11:32:50.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f146bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f146bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.910+0000 7f146bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.911+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): orig_sources= new_sources= 2024-09-14T11:32:50.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.911+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): potential sources added=[] removed=[] 2024-09-14T11:32:50.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.911+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): orig_dests= new_dests= 2024-09-14T11:32:50.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.911+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): potential dests added=[] removed=[] 2024-09-14T11:32:50.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.912+0000 7f159931f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31.0 2024-09-14T11:32:50.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.913+0000 7f159931f800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:32:50.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.913+0000 7f159931f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:50.911 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.913+0000 7f159931f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 2024-09-14T11:32:50.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f159931f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f159931f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.912 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f159931f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f159931f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31, ofs0, ns] 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f146b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 93826268850832 notifier 6776 bl.length()=899 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f146b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 info.flags=0x17 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f146b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 to cache LRU end 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.914+0000 7f146b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.916+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): orig_sources= new_sources= 2024-09-14T11:32:50.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.916+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): potential sources added=[] removed=[] 2024-09-14T11:32:50.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.916+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): orig_dests= new_dests= 2024-09-14T11:32:50.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.916+0000 7f159931f800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31]): potential dests added=[] removed=[] 2024-09-14T11:32:50.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.917+0000 7f159931f800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:32:50.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.919+0000 7f144afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:50.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.921+0000 7f159931f800 20 remove_watcher() i=0 2024-09-14T11:32:50.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.921+0000 7f159931f800 2 removed watcher, disabling cache 2024-09-14T11:32:50.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.922+0000 7f159931f800 20 remove_watcher() i=1 2024-09-14T11:32:50.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.923+0000 7f159931f800 20 remove_watcher() i=2 2024-09-14T11:32:50.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.924+0000 7f159931f800 20 remove_watcher() i=3 2024-09-14T11:32:50.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.925+0000 7f159931f800 20 remove_watcher() i=4 2024-09-14T11:32:50.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.926+0000 7f159931f800 20 remove_watcher() i=5 2024-09-14T11:32:50.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.927+0000 7f159931f800 20 remove_watcher() i=6 2024-09-14T11:32:50.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:50.927+0000 7f159931f800 20 remove_watcher() i=7 2024-09-14T11:32:50.938 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:32:50.967 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:50.967 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:51.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.008+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.010+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.010+0000 7fe4e1b26800 20 realm 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.010+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.010+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.010+0000 7fe4e1b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.010+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.011+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.011+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.011+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:51.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.011+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.012+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:51.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.012+0000 7fe4e1b26800 20 searching for the correct realm 2024-09-14T11:32:51.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.015+0000 7fe4dd04a640 0 -- 172.21.15.28:0/1870424390 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fe4d0075020 msgr2=0x7fe4d00c7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:51.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.019+0000 7fe4de04c640 0 -- 172.21.15.28:0/1870424390 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fe4d4072b40 msgr2=0x7fe4d406a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.022+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 zone default found 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 4 Realm: () 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 zonegroup default 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.023+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.024+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.024+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.024+0000 7fe4e1b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:51.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.024+0000 7fe4e1b26800 20 started sync module instance, tier type = 2024-09-14T11:32:51.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.024+0000 7fe4e1b26800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=0 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=1 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=2 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=3 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=4 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=5 2024-09-14T11:32:51.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.033+0000 7fe4e1b26800 20 add_watcher() i=6 2024-09-14T11:32:51.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.034+0000 7fe4e1b26800 20 add_watcher() i=7 2024-09-14T11:32:51.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.034+0000 7fe4e1b26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:51.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.035+0000 7fe38f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:51.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe4e1b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe4e1b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe4e1b26800 5 note: GC not initialized 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe38e7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe4e1b26800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe4e1b26800 20 Filter name: none 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe2fffff640 20 reqs_thread_entry: start 2024-09-14T11:32:51.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.036+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.037+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:51.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.037+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.037+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.037+0000 7fe4e1b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.037+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.038+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.038+0000 7fe4e1b26800 20 rados->read ofs=0 len=0 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.038+0000 7fe4e1b26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.038+0000 7fe4e1b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:51.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.039+0000 7fe38f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:51.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.041+0000 7fe4e1b26800 20 remove_watcher() i=0 2024-09-14T11:32:51.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.041+0000 7fe4e1b26800 2 removed watcher, disabling cache 2024-09-14T11:32:51.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.043+0000 7fe4e1b26800 20 remove_watcher() i=1 2024-09-14T11:32:51.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.043+0000 7fe4e1b26800 20 remove_watcher() i=2 2024-09-14T11:32:51.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.044+0000 7fe4e1b26800 20 remove_watcher() i=3 2024-09-14T11:32:51.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.045+0000 7fe4e1b26800 20 remove_watcher() i=4 2024-09-14T11:32:51.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.046+0000 7fe4e1b26800 20 remove_watcher() i=5 2024-09-14T11:32:51.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.047+0000 7fe4e1b26800 20 remove_watcher() i=6 2024-09-14T11:32:51.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:51.048+0000 7fe4e1b26800 20 remove_watcher() i=7 2024-09-14T11:32:51.057 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:51.058 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:51.058 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:32:51.058 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:51.382 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:32:51.382 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.232 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:32:52.262 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:52.262 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:52.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.303+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.305+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.305+0000 7f1d7ce98800 20 realm 2024-09-14T11:32:52.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.305+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.306+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.306+0000 7f1d7ce98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:52.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.306+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.306+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.306+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.307+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.307+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.307+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:52.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.307+0000 7f1d7ce98800 20 searching for the correct realm 2024-09-14T11:32:52.307 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.310+0000 7f1d7a181640 0 -- 172.21.15.28:0/1705062909 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f1d6c03f050 msgr2=0x7f1d6c063400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:52.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.516+0000 7f1d7a982640 0 -- 172.21.15.28:0/1705062909 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f1d700e8360 msgr2=0x7f1d700ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:52.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:52.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:52.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:52.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:52.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:52.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.723+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 zone default found 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 4 Realm: () 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:52.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 zonegroup default 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.724+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.725+0000 7f1d7ce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.725+0000 7f1d7ce98800 20 started sync module instance, tier type = 2024-09-14T11:32:52.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.725+0000 7f1d7ce98800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=0 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=1 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=2 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=3 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=4 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=5 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.735+0000 7f1d7ce98800 20 add_watcher() i=6 2024-09-14T11:32:52.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.736+0000 7f1d7ce98800 20 add_watcher() i=7 2024-09-14T11:32:52.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.736+0000 7f1d7ce98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:52.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.738+0000 7f1c317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:52.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.738+0000 7f1d7ce98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.738+0000 7f1d7ce98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.738+0000 7f1d7ce98800 5 note: GC not initialized 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.738+0000 7f1babfff640 20 reqs_thread_entry: start 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.738+0000 7f1d7ce98800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.739+0000 7f1d7ce98800 20 Filter name: none 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.739+0000 7f1ba9ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:52.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.739+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.739+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.739+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:52.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:52.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.740+0000 7f1d7ce98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:52.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.742+0000 7f1c317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:52.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.744+0000 7f1d7ce98800 20 remove_watcher() i=0 2024-09-14T11:32:52.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.744+0000 7f1d7ce98800 2 removed watcher, disabling cache 2024-09-14T11:32:52.743 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.745+0000 7f1d7ce98800 20 remove_watcher() i=1 2024-09-14T11:32:52.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.746+0000 7f1d7ce98800 20 remove_watcher() i=2 2024-09-14T11:32:52.745 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.747+0000 7f1d7ce98800 20 remove_watcher() i=3 2024-09-14T11:32:52.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.748+0000 7f1d7ce98800 20 remove_watcher() i=4 2024-09-14T11:32:52.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.749+0000 7f1d7ce98800 20 remove_watcher() i=5 2024-09-14T11:32:52.748 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.750+0000 7f1d7ce98800 20 remove_watcher() i=6 2024-09-14T11:32:52.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.751+0000 7f1d7ce98800 20 remove_watcher() i=7 2024-09-14T11:32:52.761 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.761 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:52.761 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:52.761 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.763 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:32:52.798 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:52.798 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:52.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.840+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 realm 2024-09-14T11:32:52.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:52.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.841 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:52.842 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 searching for the correct realm 2024-09-14T11:32:52.845 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.847+0000 7f5a673f5640 0 -- 172.21.15.28:0/4155937925 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55e21e340230 msgr2=0x55e21e3426d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.850+0000 7f5a673f5640 0 -- 172.21.15.28:0/4155937925 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5a5800e070 msgr2=0x7f5a58089aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:52.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:52.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:52.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:52.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:52.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:52.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:52.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 zone default found 2024-09-14T11:32:52.854 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 Realm: () 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 zonegroup default 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 started sync module instance, tier type = 2024-09-14T11:32:52.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=0 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=1 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=2 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=3 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=4 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=5 2024-09-14T11:32:52.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=6 2024-09-14T11:32:52.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.866+0000 7f5a6a10c800 20 add_watcher() i=7 2024-09-14T11:32:52.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.866+0000 7f5a6a10c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:52.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.867+0000 7f591dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:52.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:52.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:52.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 note: GC not initialized 2024-09-14T11:32:52.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f591cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:52.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:52.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 Filter name: none 2024-09-14T11:32:52.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f58967fc640 20 reqs_thread_entry: start 2024-09-14T11:32:52.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:32:52.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : miss 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:32:52.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:32:52.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94429657700608 notifier 6827 bl.length()=931 2024-09-14T11:32:52.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:32:52.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:32:52.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:32:52.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:32:52.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.877+0000 7f5a6a10c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:32:52.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:32:52.875 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.877+0000 7f5a6a10c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:32:52.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:32:52.876 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:32:52.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.880+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:52.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.880+0000 7f5a6a10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:32:52.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:32:52.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94429657700608 notifier 6827 bl.length()=931 2024-09-14T11:32:52.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:32:52.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:32:52.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:32:52.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:32:52.882 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.884+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:32:52.882 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a6a10c800 time 2024-09-14T11:32:52.885283+0000 2024-09-14T11:32:52.882 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5a6d58c76a] 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:32:52.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.885+0000 7f5a6a10c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a6a10c800 time 2024-09-14T11:32:52.885283+0000 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5a6d58c76a] 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:52.884 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5a6a10c800 thread_name:radosgw-admin 2024-09-14T11:32:52.901 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5a6c23e6f0] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5a6c28b99c] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5a6d58c7c4] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:32:52.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.886+0000 7f5a6a10c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5a6a10c800 thread_name:radosgw-admin 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5a6c23e6f0] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5a6c28b99c] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5a6d58c7c4] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:52.903 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: crc 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: secure 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: crc 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: secure 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: starting msgr at 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: starting objecter 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command objecter_requests hook 0x55e21e25bb60 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: setting wanted keys 2024-09-14T11:32:52.904 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: calling monclient init 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding auth protocol: cephx 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding auth protocol: cephx 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding auth protocol: cephx 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.905 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key hook 0x55e21e256618 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e102fd0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e10b6f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e19c1c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.906 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.465441s 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e102fd0 auth_method 0 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): get_auth_request con 0x55e21e19c1c0 auth_method 0 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.907 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e10b6f0 auth_method 0 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_done global_id 6818 payload 824 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 1 monclient: found mon.noname-c 2024-09-14T11:32:52.908 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: dump: 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.909 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: dump: 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.910 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 6818 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:32:52.825+0000 7f5955e0b640 4 set_mon_vals no callback set 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 1 librados: init done 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:32:52.827+0000 7f594ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:32:52.827+0000 7f594ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:32:52.827+0000 7f594ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:32:52.827+0000 7f5a673f5640 10 monclient: get_auth_request con 0x7f5950077230 auth_method 0 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:32:52.827+0000 7f5a683f7640 10 monclient: get_auth_request con 0x55e21e27c490 auth_method 0 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:32:52.828+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x55e21e2a1de0 auth_method 0 2024-09-14T11:32:52.911 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:32:52.830+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e2a7360 auth_method 0 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 10 monclient: build_initial_monmap 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 1 build_initial for_mkfs: 0 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 10 monclient: monmap: 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:52.912 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding auth protocol: cephx 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding auth protocol: cephx 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding auth protocol: cephx 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.913 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command objecter_requests cmddesc objecter_requests hook 0x55e21e2ae700 EEXIST 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding auth protocol: cephx 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding auth protocol: cephx 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding auth protocol: cephx 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.914 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key cmddesc rotate-key hook 0x55e21e2aa2e0 EEXIST 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e2d2a20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e2d2e00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e2d1730 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.915 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.472860s 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): get_auth_request con 0x55e21e2d1730 auth_method 0 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e2d2a20 auth_method 0 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e2d2e00 auth_method 0 2024-09-14T11:32:52.916 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.917 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_done global_id 6821 payload 824 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:32:52.832+0000 7f5a683f7640 1 monclient: found mon.noname-c 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: dump: 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.918 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: dump: 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.919 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 6821 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:32:52.832+0000 7f5a68bf8640 4 set_mon_vals no callback set 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.920 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:32:52.834+0000 7f594d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:32:52.834+0000 7f594d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:32:52.834+0000 7f594d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:32:52.835+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5940077140 auth_method 0 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: get_monmap_and_config 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: build_initial_monmap 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 1 build_initial for_mkfs: 0 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: monmap: 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:52.921 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding auth protocol: cephx 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding auth protocol: cephx 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding auth protocol: cephx 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.922 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding auth protocol: cephx 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding auth protocol: cephx 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding auth protocol: cephx 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.923 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key cmddesc rotate-key hook 0x7fffec8c2d48 EEXIST 2024-09-14T11:32:52.924 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e325e20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e316770 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e321250 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.477138s 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e325e20 auth_method 0 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.925 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e316770 auth_method 0 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_done global_id 7278 payload 274 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 1 monclient: found mon.noname-a 2024-09-14T11:32:52.926 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:32:52.836+0000 7f5a683f7640 10 monclient: get_auth_request con 0x55e21e321250 auth_method 0 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: dump: 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.927 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 7278 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: dump: 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.928 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 4 set_mon_vals no callback set 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: shutdown 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: build_initial_monmap 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 build_initial for_mkfs: 0 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: monmap: 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:52.929 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding auth protocol: cephx 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding auth protocol: cephx 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding auth protocol: cephx 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.930 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: starting msgr at 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: starting objecter 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command objecter_requests cmddesc objecter_requests hook 0x55e21e318cb0 EEXIST 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: setting wanted keys 2024-09-14T11:32:52.931 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: calling monclient init 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding auth protocol: cephx 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding auth protocol: cephx 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding auth protocol: cephx 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.932 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key cmddesc rotate-key hook 0x55e21e2e7428 EEXIST 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e316770 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e321250 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e325e20 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.933 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.479381s 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e321250 auth_method 0 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): get_auth_request con 0x55e21e325e20 auth_method 0 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.934 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e316770 auth_method 0 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_done global_id 6827 payload 824 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:32:52.838+0000 7f5a683f7640 1 monclient: found mon.noname-c 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: dump: 2024-09-14T11:32:52.935 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.936 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: dump: 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.937 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 6827 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:32:52.839+0000 7f5946ffd640 4 set_mon_vals no callback set 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 1 librados: init done 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cr dump hook 0x55e21e314ab8 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:32:52.840+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:32:52.841+0000 7f59457fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:32:52.841+0000 7f59457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:32:52.841+0000 7f59457fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.938 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:32:52.841+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5930077230 auth_method 0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:32:52.841+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e340230 auth_method 0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 realm 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:32:52.842+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x55e21e344480 auth_method 0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 searching for the correct realm 2024-09-14T11:32:52.939 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:32:52.844+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e3496b0 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:32:52.844+0000 7f5a683f7640 10 monclient: get_auth_request con 0x7f5a5c028040 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:32:52.845+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5a600bbbb0 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:32:52.846+0000 7f5a673f5640 10 monclient: get_auth_request con 0x7f5a5800e070 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:32:52.847+0000 7f5a673f5640 0 -- 172.21.15.28:0/4155937925 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55e21e340230 msgr2=0x55e21e3426d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:32:52.847+0000 7f59457fa640 1 client.6827.objecter ms_handle_reset 0x55e21e340230 session 0x55e21e2f5ad0 osd.1 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:32:52.847+0000 7f59457fa640 10 monclient: _renew_subs 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:32:52.847+0000 7f59457fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:32:52.847+0000 7f5a673f5640 10 monclient: get_auth_request con 0x7f5930087960 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:32:52.847+0000 7f5a683f7640 10 monclient: get_auth_request con 0x7f5a5c044040 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:32:52.850+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5a5c027410 auth_method 0 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:32:52.850+0000 7f5a673f5640 0 -- 172.21.15.28:0/4155937925 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5a5800e070 msgr2=0x7f5a58089aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:32:52.850+0000 7f59457fa640 1 client.6827.objecter ms_handle_reset 0x7f5a5800e070 session 0x7f5a5804d040 osd.4 2024-09-14T11:32:52.940 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:32:52.851+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e340230 auth_method 0 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:52.941 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 zone default found 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 Realm: () 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 zonegroup default 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 started sync module instance, tier type = 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:52.942 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=0 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=1 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=2 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=3 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=4 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=5 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=6 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:32:52.866+0000 7f5a6a10c800 20 add_watcher() i=7 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:32:52.866+0000 7f5a6a10c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding auth protocol: cephx 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding auth protocol: cephx 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding auth protocol: cephx 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.943 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:32:52.867+0000 7f591dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache list hook 0x55e21e31f980 2024-09-14T11:32:52.944 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache inspect hook 0x55e21e31f980 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache erase hook 0x55e21e31f980 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache zap hook 0x55e21e31f980 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 note: GC not initialized 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:32:52.868+0000 7f591cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace show hook 0x7f5a58067070 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace history hook 0x7f5a58067070 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace active hook 0x7f5a58067070 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace active_short hook 0x7f5a58067070 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 Filter name: none 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:32:52.868+0000 7f58967fc640 20 reqs_thread_entry: start 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:32:52.945 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : miss 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.946 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94429657700608 notifier 6827 bl.length()=931 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:32:52.947 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:32:52.880+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:32:52.880+0000 7f5a6a10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94429657700608 notifier 6827 bl.length()=931 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:32:52.948 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:32:52.884+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:32:52.885+0000 7f5a6a10c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a6a10c800 time 2024-09-14T11:32:52.885283+0000 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5a6d58c76a] 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:32:52.949 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:32:52.886+0000 7f5a6a10c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5a6a10c800 thread_name:radosgw-admin 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5a6c23e6f0] 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5a6c28b99c] 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5a6d58c7c4] 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:52.950 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:52.951 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:32:52.952 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:32:52.953 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:52.954 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:32:52.955 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:32:52.956 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:32:52.957 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f58967fc640 / http_manager 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f591cfe1640 / http_manager 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f591dfe3640 / rgw_dt_lg_renew 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f59457fa640 / ms_dispatch 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5946ffd640 / io_context_pool 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f594d7fa640 / ms_dispatch 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f594ffff640 / ms_dispatch 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5955e0b640 / io_context_pool 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a673f5640 / msgr-worker-2 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a67bf6640 / msgr-worker-1 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a683f7640 / msgr-worker-0 2024-09-14T11:32:52.958 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a68bf8640 / io_context_pool 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a6a10c800 / radosgw-admin 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.120261.log 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: crc 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: secure 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: crc 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e25c250) adding con mode: secure 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: starting msgr at 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: starting objecter 2024-09-14T11:32:52.959 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command objecter_requests hook 0x55e21e25bb60 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: setting wanted keys 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 1 librados: calling monclient init 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding auth protocol: cephx 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding auth protocol: cephx 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding auth protocol: cephx 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.960 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: crc 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:32:52.823+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2564d0) adding con mode: secure 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key hook 0x55e21e256618 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e102fd0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e10b6f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e19c1c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.961 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:32:52.824+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.465441s 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e102fd0 auth_method 0 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): get_auth_request con 0x55e21e19c1c0 auth_method 0 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.962 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:32:52.824+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e10b6f0 auth_method 0 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:32:52.824+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_done global_id 6818 payload 824 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 1 monclient: found mon.noname-c 2024-09-14T11:32:52.963 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:32:52.824+0000 7f5a67bf6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: dump: 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.964 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:32:52.825+0000 7f594ffff640 10 monclient: dump: 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.965 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 6818 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:32:52.825+0000 7f5955e0b640 4 set_mon_vals no callback set 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:32:52.825+0000 7f5a6a10c800 1 librados: init done 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:32:52.827+0000 7f594ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:32:52.827+0000 7f594ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:32:52.827+0000 7f594ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:32:52.827+0000 7f5a673f5640 10 monclient: get_auth_request con 0x7f5950077230 auth_method 0 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:32:52.827+0000 7f5a683f7640 10 monclient: get_auth_request con 0x55e21e27c490 auth_method 0 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:32:52.828+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x55e21e2a1de0 auth_method 0 2024-09-14T11:32:52.966 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:32:52.830+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e2a7360 auth_method 0 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 10 monclient: build_initial_monmap 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 1 build_initial for_mkfs: 0 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 10 monclient: monmap: 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.967 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding auth protocol: cephx 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding auth protocol: cephx 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding auth protocol: cephx 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.968 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: crc 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:32:52.830+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2ab2a0) adding con mode: secure 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command objecter_requests cmddesc objecter_requests hook 0x55e21e2ae700 EEXIST 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding auth protocol: cephx 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding auth protocol: cephx 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding auth protocol: cephx 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.969 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: crc 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2aa198) adding con mode: secure 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key cmddesc rotate-key hook 0x55e21e2aa2e0 EEXIST 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e2d2a20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e2d2e00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e2d1730 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.970 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:32:52.831+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.472860s 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): get_auth_request con 0x55e21e2d1730 auth_method 0 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:32:52.831+0000 7f5a683f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e2d2a20 auth_method 0 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e2d2e00 auth_method 0 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.971 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:32:52.832+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:32:52.832+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient(hunting): handle_auth_done global_id 6821 payload 824 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:32:52.832+0000 7f5a683f7640 1 monclient: found mon.noname-c 2024-09-14T11:32:52.972 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:32:52.832+0000 7f5a683f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: dump: 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.973 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:32:52.832+0000 7f594d7fa640 10 monclient: dump: 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.974 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 6821 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:32:52.832+0000 7f5a68bf8640 4 set_mon_vals no callback set 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:32:52.832+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:32:52.834+0000 7f594d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:32:52.834+0000 7f594d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:32:52.834+0000 7f594d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:32:52.835+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5940077140 auth_method 0 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: get_monmap_and_config 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: build_initial_monmap 2024-09-14T11:32:52.975 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 1 build_initial for_mkfs: 0 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: monmap: 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding auth protocol: cephx 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding auth protocol: cephx 2024-09-14T11:32:52.976 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding auth protocol: cephx 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: crc 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f1b80) adding con mode: secure 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.977 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding auth protocol: cephx 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding auth protocol: cephx 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding auth protocol: cephx 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.978 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: crc 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c2c00) adding con mode: secure 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:32:52.835+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key cmddesc rotate-key hook 0x7fffec8c2d48 EEXIST 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e325e20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e316770 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e321250 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.979 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.477138s 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e325e20 auth_method 0 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e316770 auth_method 0 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.980 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:32:52.836+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient(hunting): handle_auth_done global_id 7278 payload 274 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 1 monclient: found mon.noname-a 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:32:52.836+0000 7f5a67bf6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:32:52.836+0000 7f5a683f7640 10 monclient: get_auth_request con 0x55e21e321250 auth_method 0 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: dump: 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.981 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 7278 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:32:52.836+0000 7f5946ffd640 10 monclient: dump: 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.982 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:32:52.836+0000 7f5a6a10c800 4 set_mon_vals no callback set 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: shutdown 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: build_initial_monmap 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 build_initial for_mkfs: 0 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: monmap: 2024-09-14T11:32:52.983 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding auth protocol: cephx 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding auth protocol: cephx 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding auth protocol: cephx 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.984 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: crc 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2f5380) adding con mode: secure 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: starting msgr at 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: starting objecter 2024-09-14T11:32:52.985 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command objecter_requests cmddesc objecter_requests hook 0x55e21e318cb0 EEXIST 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: setting wanted keys 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 1 librados: calling monclient init 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 10 monclient: init 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding auth protocol: cephx 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding auth protocol: cephx 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding auth protocol: cephx 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.986 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: crc 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:32:52.837+0000 7f5a6a10c800 5 AuthRegistry(0x55e21e2e72e0) adding con mode: secure 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command rotate-key cmddesc rotate-key hook 0x55e21e2e7428 EEXIST 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-b con 0x55e21e316770 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-a con 0x55e21e321250 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): picked mon.noname-c con 0x55e21e325e20 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:52.987 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:32:52.838+0000 7f5a6a10c800 10 monclient(hunting): authenticate will time out at 2110.479381s 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): get_auth_request con 0x55e21e321250 auth_method 0 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): get_auth_request con 0x55e21e325e20 auth_method 0 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:52.988 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:32:52.838+0000 7f5a673f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request con 0x55e21e316770 auth_method 0 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:32:52.838+0000 7f5a67bf6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient(hunting): handle_auth_done global_id 6827 payload 824 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient: _finish_hunting 0 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:32:52.838+0000 7f5a683f7640 1 monclient: found mon.noname-c 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:32:52.838+0000 7f5a683f7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: dump: 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.989 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: _finish_auth 0 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:32:52.838+0000 7f59457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:52.990 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:32:52.839+0000 7f59457fa640 10 monclient: dump: 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 5 monclient: authenticate success, global_id 6827 2024-09-14T11:32:52.991 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:32:52.839+0000 7f5946ffd640 4 set_mon_vals no callback set 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _renew_subs 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 1 librados: init done 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:32:52.839+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cr dump hook 0x55e21e314ab8 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:32:52.840+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:32:52.841+0000 7f59457fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:32:52.841+0000 7f59457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:32:52.841+0000 7f59457fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:32:52.841+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5930077230 auth_method 0 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:32:52.841+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e340230 auth_method 0 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.992 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 realm 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:32:52.842+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:32:52.842+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x55e21e344480 auth_method 0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:32:52.843+0000 7f5a6a10c800 20 searching for the correct realm 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:32:52.844+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e3496b0 auth_method 0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:32:52.844+0000 7f5a683f7640 10 monclient: get_auth_request con 0x7f5a5c028040 auth_method 0 2024-09-14T11:32:52.993 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:32:52.845+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5a600bbbb0 auth_method 0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:32:52.846+0000 7f5a673f5640 10 monclient: get_auth_request con 0x7f5a5800e070 auth_method 0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:32:52.847+0000 7f5a673f5640 0 -- 172.21.15.28:0/4155937925 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55e21e340230 msgr2=0x55e21e3426d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:32:52.847+0000 7f59457fa640 1 client.6827.objecter ms_handle_reset 0x55e21e340230 session 0x55e21e2f5ad0 osd.1 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:32:52.847+0000 7f59457fa640 10 monclient: _renew_subs 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:32:52.847+0000 7f59457fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:32:52.847+0000 7f5a673f5640 10 monclient: get_auth_request con 0x7f5930087960 auth_method 0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:32:52.847+0000 7f5a683f7640 10 monclient: get_auth_request con 0x7f5a5c044040 auth_method 0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:32:52.850+0000 7f5a67bf6640 10 monclient: get_auth_request con 0x7f5a5c027410 auth_method 0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:32:52.850+0000 7f5a673f5640 0 -- 172.21.15.28:0/4155937925 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5a5800e070 msgr2=0x7f5a58089aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:32:52.850+0000 7f59457fa640 1 client.6827.objecter ms_handle_reset 0x7f5a5800e070 session 0x7f5a5804d040 osd.4 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:32:52.851+0000 7f5a673f5640 10 monclient: get_auth_request con 0x55e21e340230 auth_method 0 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:52.994 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:32:52.854+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 zone default found 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 Realm: () 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:52.995 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 zonegroup default 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:32:52.855+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 started sync module instance, tier type = 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:32:52.856+0000 7f5a6a10c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=0 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=1 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=2 2024-09-14T11:32:52.996 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=3 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=4 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=5 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:32:52.865+0000 7f5a6a10c800 20 add_watcher() i=6 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:32:52.866+0000 7f5a6a10c800 20 add_watcher() i=7 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:32:52.866+0000 7f5a6a10c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding auth protocol: cephx 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding auth protocol: cephx 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding auth protocol: cephx 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.997 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: crc 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:32:52.867+0000 7f5a6a10c800 5 AuthRegistry(0x7fffec8c30e0) adding con mode: secure 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:32:52.867+0000 7f591dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache list hook 0x55e21e31f980 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache inspect hook 0x55e21e31f980 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache erase hook 0x55e21e31f980 2024-09-14T11:32:52.998 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command cache zap hook 0x55e21e31f980 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 note: GC not initialized 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:32:52.868+0000 7f591cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace show hook 0x7f5a58067070 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace history hook 0x7f5a58067070 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace active hook 0x7f5a58067070 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 5 asok(0x55e21e037270) register_command sync trace active_short hook 0x7f5a58067070 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 Filter name: none 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:32:52.868+0000 7f58967fc640 20 reqs_thread_entry: start 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:32:52.868+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:52.999 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : miss 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:32:52.869+0000 7f5a6a10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:32:52.873+0000 7f5a6a10c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:32:53.000 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431614 cookie 94429657700608 notifier 6827 bl.length()=931 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:32:52.873+0000 7f5946ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:32:52.875+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:32:52.877+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:32:52.880+0000 7f5a6a10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:53.001 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:32:52.880+0000 7f5a6a10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:32:52.881+0000 7f5a6a10c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 94429657700608 notifier 6827 bl.length()=931 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:32:52.881+0000 7f5946ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:32:52.883+0000 7f5a6a10c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:32:53.002 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:32:52.884+0000 7f5a6a10c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:32:52.885+0000 7f5a6a10c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5a6a10c800 time 2024-09-14T11:32:52.885283+0000 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5a6d58c76a] 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:53.003 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:32:52.886+0000 7f5a6a10c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5a6a10c800 thread_name:radosgw-admin 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5a6c23e6f0] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5a6c28b99c] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5a6d58c7c4] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5a6d58c928] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e21cd000b1] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55e21cd10217] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5a6c229590] 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:32:53.004 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:53.005 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:53.006 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:32:53.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:32:53.008 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:53.009 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:32:53.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 7f58967fc640 / http_manager 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 7f591cfe1640 / http_manager 2024-09-14T11:32:53.011 INFO:tasks.workunit.client.0.smithi028.stderr: 7f591dfe3640 / rgw_dt_lg_renew 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f59457fa640 / ms_dispatch 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5946ffd640 / io_context_pool 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f594d7fa640 / ms_dispatch 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f594ffff640 / ms_dispatch 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5955e0b640 / io_context_pool 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a673f5640 / msgr-worker-2 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a67bf6640 / msgr-worker-1 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a683f7640 / msgr-worker-0 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a68bf8640 / io_context_pool 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5a6a10c800 / radosgw-admin 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:52.886677Z_e19b143f-7b0d-4456-9d2e-bd4f0f9ee1d4/log 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:32:53.012 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.964+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.965+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.965+0000 7fc5b2526800 20 realm 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.965+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.966+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.966+0000 7fc5b2526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.966+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.966+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.966+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.967+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.967+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.967+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.967+0000 7fc5b2526800 20 searching for the correct realm 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.970+0000 7fc5ae9da640 0 -- 172.21.15.28:0/142372816 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fc5a4091030 msgr2=0x7fc5a407d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:53.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:52.973+0000 7fc5ae1d9640 0 -- 172.21.15.28:0/142372816 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fc5a40ba770 msgr2=0x7fc5a407cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:53.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:53.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.180+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 zone default found 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 4 Realm: () 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 zonegroup default 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.181+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.182+0000 7fc5b2526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:53.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.182+0000 7fc5b2526800 20 started sync module instance, tier type = 2024-09-14T11:32:53.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.182+0000 7fc5b2526800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=0 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=1 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=2 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=3 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=4 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=5 2024-09-14T11:32:53.189 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.191+0000 7fc5b2526800 20 add_watcher() i=6 2024-09-14T11:32:53.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.192+0000 7fc5b2526800 20 add_watcher() i=7 2024-09-14T11:32:53.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.192+0000 7fc5b2526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:53.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc464fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:53.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc5b2526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:53.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc5b2526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:53.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc5b2526800 5 note: GC not initialized 2024-09-14T11:32:53.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc3df7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:53.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc5b2526800 20 init_complete bucket index max shards: 1 2024-09-14T11:32:53.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc5b2526800 20 Filter name: none 2024-09-14T11:32:53.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc3dd7fa640 20 reqs_thread_entry: start 2024-09-14T11:32:53.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.194+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.195+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.195+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.195+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.195+0000 7fc5b2526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.195+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.196+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.196+0000 7fc5b2526800 20 rados->read ofs=0 len=0 2024-09-14T11:32:53.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.196+0000 7fc5b2526800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:32:53.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.196+0000 7fc5b2526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:53.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.197+0000 7fc464fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:53.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.200+0000 7fc5b2526800 20 remove_watcher() i=0 2024-09-14T11:32:53.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.200+0000 7fc5b2526800 2 removed watcher, disabling cache 2024-09-14T11:32:53.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.201+0000 7fc5b2526800 20 remove_watcher() i=1 2024-09-14T11:32:53.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.202+0000 7fc5b2526800 20 remove_watcher() i=2 2024-09-14T11:32:53.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.203+0000 7fc5b2526800 20 remove_watcher() i=3 2024-09-14T11:32:53.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.204+0000 7fc5b2526800 20 remove_watcher() i=4 2024-09-14T11:32:53.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.205+0000 7fc5b2526800 20 remove_watcher() i=5 2024-09-14T11:32:53.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.206+0000 7fc5b2526800 20 remove_watcher() i=6 2024-09-14T11:32:53.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:32:53.207+0000 7fc5b2526800 20 remove_watcher() i=7 2024-09-14T11:32:53.216 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:32:53.216 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:32:53.216 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:32:53.216 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:23.416 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:23.446 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:23.446 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:23.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.489+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.490+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.490+0000 7ff4e6c40800 20 realm 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.490+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.491+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.491+0000 7ff4e6c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.491+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.491+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.491+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.492+0000 7ff4e6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.492+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.492+0000 7ff4e6c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:23.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.492+0000 7ff4e6c40800 20 searching for the correct realm 2024-09-14T11:33:23.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.496+0000 7ff4e4f2b640 0 -- 172.21.15.28:0/1479479942 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55f7693f7700 msgr2=0x55f7693f9b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:23.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.500+0000 7ff4e3f29640 0 -- 172.21.15.28:0/1479479942 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7ff4d4082040 msgr2=0x7ff4d40b76e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:23.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.504+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:23.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 zone default found 2024-09-14T11:33:23.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 4 Realm: () 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 zonegroup default 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 started sync module instance, tier type = 2024-09-14T11:33:23.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.505+0000 7ff4e6c40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=0 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=1 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=2 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=3 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=4 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=5 2024-09-14T11:33:23.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.515+0000 7ff4e6c40800 20 add_watcher() i=6 2024-09-14T11:33:23.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.516+0000 7ff4e6c40800 20 add_watcher() i=7 2024-09-14T11:33:23.515 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.516+0000 7ff4e6c40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:23.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.517+0000 7ff39afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:23.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:23.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:23.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 5 note: GC not initialized 2024-09-14T11:33:23.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff399fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:23.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:23.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 20 Filter name: none 2024-09-14T11:33:23.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff30b7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:23.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:33:23.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.518+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : miss 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.519+0000 7ff4e6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:33:23.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.523+0000 7ff4e6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.523+0000 7ff4e6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.523+0000 7ff4e6c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.523+0000 7ff4e6c40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.524+0000 7ff3bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 94521111055872 notifier 6857 bl.length()=931 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.524+0000 7ff3bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.524+0000 7ff3bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.524+0000 7ff3bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.525+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:33:23.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.525+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:33:23.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.525+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:33:23.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.525+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:33:23.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.527+0000 7ff4e6c40800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:33:23.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.527+0000 7ff4e6c40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.0 2024-09-14T11:33:23.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.527+0000 7ff4e6c40800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:33:23.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.527+0000 7ff4e6c40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.1.1 2024-09-14T11:33:23.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.527+0000 7ff4e6c40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:33:23.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.530+0000 7ff4e6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:23.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.530+0000 7ff4e6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:33:23.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff4e6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff4e6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff4e6c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff4e6c40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:33:23.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff3bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94521111055872 notifier 6857 bl.length()=931 2024-09-14T11:33:23.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff3bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff3bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.531+0000 7ff3bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.533+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:33:23.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.533+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:33:23.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.533+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:33:23.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.533+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:33:23.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.534+0000 7ff4e6c40800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32.0 2024-09-14T11:33:23.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.534+0000 7ff4e6c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:23.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.534+0000 7ff4e6c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 2024-09-14T11:33:23.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff4e6c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff4e6c40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff4e6c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff4e6c40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32, ofs0, ns] 2024-09-14T11:33:23.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff3baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94521111055872 notifier 6857 bl.length()=899 2024-09-14T11:33:23.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff3baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 info.flags=0x17 2024-09-14T11:33:23.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff3baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 to cache LRU end 2024-09-14T11:33:23.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.535+0000 7ff3baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:23.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.537+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_sources= new_sources= 2024-09-14T11:33:23.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.537+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential sources added=[] removed=[] 2024-09-14T11:33:23.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.537+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): orig_dests= new_dests= 2024-09-14T11:33:23.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.537+0000 7ff4e6c40800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32]): potential dests added=[] removed=[] 2024-09-14T11:33:23.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.538+0000 7ff4e6c40800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:33:23.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.540+0000 7ff39afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:23.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.543+0000 7ff4e6c40800 20 remove_watcher() i=0 2024-09-14T11:33:23.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.543+0000 7ff4e6c40800 2 removed watcher, disabling cache 2024-09-14T11:33:23.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.544+0000 7ff4e6c40800 20 remove_watcher() i=1 2024-09-14T11:33:23.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.545+0000 7ff4e6c40800 20 remove_watcher() i=2 2024-09-14T11:33:23.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.546+0000 7ff4e6c40800 20 remove_watcher() i=3 2024-09-14T11:33:23.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.547+0000 7ff4e6c40800 20 remove_watcher() i=4 2024-09-14T11:33:23.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.548+0000 7ff4e6c40800 20 remove_watcher() i=5 2024-09-14T11:33:23.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.549+0000 7ff4e6c40800 20 remove_watcher() i=6 2024-09-14T11:33:23.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.550+0000 7ff4e6c40800 20 remove_watcher() i=7 2024-09-14T11:33:23.561 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:33:23.590 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:23.591 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:23.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.632+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.634+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.634+0000 7f9a2bd2c800 20 realm 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.634+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.634+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.634+0000 7f9a2bd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.634+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.635+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.635+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.635+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.635+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.636+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:23.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.636+0000 7f9a2bd2c800 20 searching for the correct realm 2024-09-14T11:33:23.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.639+0000 7f9a28146640 0 -- 172.21.15.28:0/1606037563 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x5580ff0c4850 msgr2=0x5580ff0c6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:23.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.643+0000 7f9a27144640 0 -- 172.21.15.28:0/1606037563 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9a1806b020 msgr2=0x7f9a180a43d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:23.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:23.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.647+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:23.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 zone default found 2024-09-14T11:33:23.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 4 Realm: () 2024-09-14T11:33:23.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:23.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 zonegroup default 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 started sync module instance, tier type = 2024-09-14T11:33:23.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.648+0000 7f9a2bd2c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:23.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=0 2024-09-14T11:33:23.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=1 2024-09-14T11:33:23.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=2 2024-09-14T11:33:23.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=3 2024-09-14T11:33:23.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=4 2024-09-14T11:33:23.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=5 2024-09-14T11:33:23.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.658+0000 7f9a2bd2c800 20 add_watcher() i=6 2024-09-14T11:33:23.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.659+0000 7f9a2bd2c800 20 add_watcher() i=7 2024-09-14T11:33:23.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.659+0000 7f9a2bd2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:23.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.661+0000 7f98ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.661+0000 7f9a2bd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.661+0000 7f9a2bd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.661+0000 7f9a2bd2c800 5 note: GC not initialized 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.661+0000 7f98dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.662+0000 7f9a2bd2c800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.662+0000 7f9a2bd2c800 20 Filter name: none 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.662+0000 7f98567fc640 20 reqs_thread_entry: start 2024-09-14T11:33:23.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.662+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.662+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:33:23.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.662+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:33:23.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:23.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:33:23.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:23.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:33:23.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.663+0000 7f9a2bd2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:23.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.665+0000 7f98ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:23.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.667+0000 7f9a2bd2c800 20 remove_watcher() i=0 2024-09-14T11:33:23.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.667+0000 7f9a2bd2c800 2 removed watcher, disabling cache 2024-09-14T11:33:23.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.668+0000 7f9a2bd2c800 20 remove_watcher() i=1 2024-09-14T11:33:23.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.669+0000 7f9a2bd2c800 20 remove_watcher() i=2 2024-09-14T11:33:23.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.670+0000 7f9a2bd2c800 20 remove_watcher() i=3 2024-09-14T11:33:23.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.671+0000 7f9a2bd2c800 20 remove_watcher() i=4 2024-09-14T11:33:23.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.672+0000 7f9a2bd2c800 20 remove_watcher() i=5 2024-09-14T11:33:23.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.673+0000 7f9a2bd2c800 20 remove_watcher() i=6 2024-09-14T11:33:23.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:23.674+0000 7f9a2bd2c800 20 remove_watcher() i=7 2024-09-14T11:33:23.683 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:23.683 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:33:23.683 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-commit-target-layout id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:33:23.683 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:24.015 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:33:24.016 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:24.872 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:33:24.900 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:24.901 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:24.939 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.941+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 realm 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:24.942 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.944+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.945+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:24.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.945+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:24.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.945+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:24.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.945+0000 7f806173d800 20 searching for the correct realm 2024-09-14T11:33:24.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:24.947+0000 7f805cc29640 0 -- 172.21.15.28:0/3461968996 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f80500a3190 msgr2=0x7f80500693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:25.152 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.154+0000 7f805d42a640 0 -- 172.21.15.28:0/3461968996 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f805407b880 msgr2=0x7f8054083250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:25.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.362+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 zone default found 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 4 Realm: () 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 zonegroup default 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.363+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.364+0000 7f806173d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.364+0000 7f806173d800 20 started sync module instance, tier type = 2024-09-14T11:33:25.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.364+0000 7f806173d800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:25.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=0 2024-09-14T11:33:25.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=1 2024-09-14T11:33:25.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=2 2024-09-14T11:33:25.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=3 2024-09-14T11:33:25.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=4 2024-09-14T11:33:25.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=5 2024-09-14T11:33:25.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.375+0000 7f806173d800 20 add_watcher() i=6 2024-09-14T11:33:25.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.376+0000 7f806173d800 20 add_watcher() i=7 2024-09-14T11:33:25.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.376+0000 7f806173d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:25.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.378+0000 7f7f137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:25.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.378+0000 7f806173d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:25.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.378+0000 7f806173d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:25.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.378+0000 7f806173d800 5 note: GC not initialized 2024-09-14T11:33:25.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.378+0000 7f7f127e4640 20 reqs_thread_entry: start 2024-09-14T11:33:25.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.378+0000 7f806173d800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:25.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.379+0000 7f806173d800 20 Filter name: none 2024-09-14T11:33:25.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.379+0000 7f7e83fff640 20 reqs_thread_entry: start 2024-09-14T11:33:25.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.379+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.379+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:25.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.379+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.380+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:25.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.380+0000 7f806173d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:25.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.380+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.381+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:25.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.381+0000 7f806173d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.381+0000 7f806173d800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:25.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.381+0000 7f806173d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:25.380 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.383+0000 7f7f137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:25.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.385+0000 7f806173d800 20 remove_watcher() i=0 2024-09-14T11:33:25.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.385+0000 7f806173d800 2 removed watcher, disabling cache 2024-09-14T11:33:25.384 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.386+0000 7f806173d800 20 remove_watcher() i=1 2024-09-14T11:33:25.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.387+0000 7f806173d800 20 remove_watcher() i=2 2024-09-14T11:33:25.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.389+0000 7f806173d800 20 remove_watcher() i=3 2024-09-14T11:33:25.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.390+0000 7f806173d800 20 remove_watcher() i=4 2024-09-14T11:33:25.389 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.391+0000 7f806173d800 20 remove_watcher() i=5 2024-09-14T11:33:25.390 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.392+0000 7f806173d800 20 remove_watcher() i=6 2024-09-14T11:33:25.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.393+0000 7f806173d800 20 remove_watcher() i=7 2024-09-14T11:33:25.403 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:25.403 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:33:25.403 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-do-reshard id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:33:25.403 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:25.405 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:33:25.441 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:25.441 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:25.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.484+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 realm 2024-09-14T11:33:25.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:25.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.486+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.487+0000 7f7d08135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:25.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.487+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.487+0000 7f7d08135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:25.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.488+0000 7f7d08135800 20 searching for the correct realm 2024-09-14T11:33:25.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.491+0000 7f7d04622640 0 -- 172.21.15.28:0/808383577 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f7cf8048060 msgr2=0x7f7cf8075350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:25.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.494+0000 7f7d03e21640 0 -- 172.21.15.28:0/808383577 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f7cf806c790 msgr2=0x7f7cf80867a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.699 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.700 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.701+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 zone default found 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 4 Realm: () 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 zonegroup default 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.702+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.703+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.701 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.703+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.703+0000 7f7d08135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.703+0000 7f7d08135800 20 started sync module instance, tier type = 2024-09-14T11:33:25.702 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.703+0000 7f7d08135800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=0 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=1 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=2 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=3 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=4 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=5 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.712+0000 7f7d08135800 20 add_watcher() i=6 2024-09-14T11:33:25.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.713+0000 7f7d08135800 20 add_watcher() i=7 2024-09-14T11:33:25.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.713+0000 7f7d08135800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:25.713 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.715+0000 7f7bb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 5 note: GC not initialized 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7bb8fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 20 Filter name: none 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7b327fc640 20 reqs_thread_entry: start 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.716+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:25.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:33:25.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:33:25.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 : miss 2024-09-14T11:33:25.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:25.716 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:25.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:25.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:25.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:25.717 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.717+0000 7f7d08135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 2024-09-14T11:33:25.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7d08135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:25.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7d08135800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:25.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7d08135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:25.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7d08135800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33, ofs0, ns] 2024-09-14T11:33:25.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7be2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94696055719696 notifier 7374 bl.length()=911 2024-09-14T11:33:25.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7be2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:25.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7be2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:25.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.721+0000 7f7be2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:25.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.723+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_sources= new_sources= 2024-09-14T11:33:25.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.723+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential sources added=[] removed=[] 2024-09-14T11:33:25.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.723+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_dests= new_dests= 2024-09-14T11:33:25.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.723+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential dests added=[] removed=[] 2024-09-14T11:33:25.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.726+0000 7f7d08135800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:33:25.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.729+0000 7f7d08135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:25.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.729+0000 7f7d08135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7d08135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7d08135800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7d08135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7d08135800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33, ofs0, ns] 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7be2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94696055719696 notifier 7374 bl.length()=879 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7be2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7be2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:25.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.731+0000 7f7be2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:25.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.732+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_sources= new_sources= 2024-09-14T11:33:25.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.732+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential sources added=[] removed=[] 2024-09-14T11:33:25.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.732+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_dests= new_dests= 2024-09-14T11:33:25.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.732+0000 7f7d08135800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential dests added=[] removed=[] 2024-09-14T11:33:25.730 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.732+0000 7f7d08135800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:33:25.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.734+0000 7f7bb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:25.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.737+0000 7f7d08135800 20 remove_watcher() i=0 2024-09-14T11:33:25.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.737+0000 7f7d08135800 2 removed watcher, disabling cache 2024-09-14T11:33:25.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.738+0000 7f7d08135800 20 remove_watcher() i=1 2024-09-14T11:33:25.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.739+0000 7f7d08135800 20 remove_watcher() i=2 2024-09-14T11:33:25.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.740+0000 7f7d08135800 20 remove_watcher() i=3 2024-09-14T11:33:25.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.741+0000 7f7d08135800 20 remove_watcher() i=4 2024-09-14T11:33:25.740 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.742+0000 7f7d08135800 20 remove_watcher() i=5 2024-09-14T11:33:25.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.743+0000 7f7d08135800 20 remove_watcher() i=6 2024-09-14T11:33:25.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.744+0000 7f7d08135800 20 remove_watcher() i=7 2024-09-14T11:33:25.754 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:33:25.783 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:25.783 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:25.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.825+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 realm 2024-09-14T11:33:25.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:25.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:25.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.827+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.828+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:25.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.828+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:25.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.828+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:25.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.828+0000 7f0949725800 20 searching for the correct realm 2024-09-14T11:33:25.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:25.830+0000 7f09454a2640 0 -- 172.21.15.28:0/481374482 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f094002e030 msgr2=0x7f0940064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:26.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.036+0000 7f0945ca3640 0 -- 172.21.15.28:0/481374482 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f093c07a040 msgr2=0x7f093c06d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:26.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.042+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 zone default found 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 4 Realm: () 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 zonegroup default 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.043+0000 7f0949725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.044+0000 7f0949725800 20 started sync module instance, tier type = 2024-09-14T11:33:26.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.044+0000 7f0949725800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=0 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=1 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=2 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=3 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=4 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=5 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.053+0000 7f0949725800 20 add_watcher() i=6 2024-09-14T11:33:26.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.054+0000 7f0949725800 20 add_watcher() i=7 2024-09-14T11:33:26.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.054+0000 7f0949725800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:26.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f07fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:26.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f0949725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:26.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f0949725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f0949725800 5 note: GC not initialized 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f07fa7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f0949725800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.056+0000 7f0949725800 20 Filter name: none 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.057+0000 7f076bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.057+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.057+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:26.055 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.057+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.058+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:26.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.058+0000 7f0949725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:26.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.058+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.058+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:26.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.058+0000 7f0949725800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.059+0000 7f0949725800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:26.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.059+0000 7f0949725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:26.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.060+0000 7f07fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:26.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.062+0000 7f0949725800 20 remove_watcher() i=0 2024-09-14T11:33:26.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.062+0000 7f0949725800 2 removed watcher, disabling cache 2024-09-14T11:33:26.062 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.064+0000 7f0949725800 20 remove_watcher() i=1 2024-09-14T11:33:26.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.065+0000 7f0949725800 20 remove_watcher() i=2 2024-09-14T11:33:26.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.066+0000 7f0949725800 20 remove_watcher() i=3 2024-09-14T11:33:26.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.067+0000 7f0949725800 20 remove_watcher() i=4 2024-09-14T11:33:26.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.068+0000 7f0949725800 20 remove_watcher() i=5 2024-09-14T11:33:26.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.069+0000 7f0949725800 20 remove_watcher() i=6 2024-09-14T11:33:26.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.070+0000 7f0949725800 20 remove_watcher() i=7 2024-09-14T11:33:26.079 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:26.079 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:33:26.079 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-do-reshard id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:33:26.079 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:26.173 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:26.206 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:26.206 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:26.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.247+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 realm 2024-09-14T11:33:26.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:26.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.249+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.250+0000 7f0175b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:26.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.250+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.250+0000 7f0175b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:26.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.251+0000 7f0175b46800 20 searching for the correct realm 2024-09-14T11:33:26.251 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.254+0000 7f0173e38640 0 -- 172.21.15.28:0/3793918184 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f016807c070 msgr2=0x7f01680620b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:26.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.257+0000 7f0173637640 0 -- 172.21.15.28:0/3793918184 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f01680990f0 msgr2=0x7f0168085900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:26.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:26.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:26.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:26.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:26.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:26.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:26.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.464+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.465+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.465+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.465+0000 7f0175b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:26.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.465+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.465+0000 7f0175b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:26.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 zone default found 2024-09-14T11:33:26.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 4 Realm: () 2024-09-14T11:33:26.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:26.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 zonegroup default 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 started sync module instance, tier type = 2024-09-14T11:33:26.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.466+0000 7f0175b46800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:26.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=0 2024-09-14T11:33:26.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=1 2024-09-14T11:33:26.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=2 2024-09-14T11:33:26.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=3 2024-09-14T11:33:26.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=4 2024-09-14T11:33:26.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=5 2024-09-14T11:33:26.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.476+0000 7f0175b46800 20 add_watcher() i=6 2024-09-14T11:33:26.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.477+0000 7f0175b46800 20 add_watcher() i=7 2024-09-14T11:33:26.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.477+0000 7f0175b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.479+0000 7f0029fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.479+0000 7f0175b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.479+0000 7f0175b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.479+0000 7f0175b46800 5 note: GC not initialized 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0028fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 20 Filter name: none 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7effa27fc640 20 reqs_thread_entry: start 2024-09-14T11:33:26.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:33:26.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:26.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:33:26.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:33:26.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 : miss 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.480+0000 7f0175b46800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.481+0000 7f0175b46800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.481+0000 7f0175b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.481+0000 7f0175b46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.481+0000 7f0175b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.481+0000 7f0175b46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.481+0000 7f0175b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0175b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0175b46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0175b46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0175b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33, ofs0, ns] 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94756854672032 notifier 7413 bl.length()=911 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0056ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.485+0000 7f0056ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.487+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_sources= new_sources= 2024-09-14T11:33:26.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.487+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential sources added=[] removed=[] 2024-09-14T11:33:26.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.487+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_dests= new_dests= 2024-09-14T11:33:26.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.487+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential dests added=[] removed=[] 2024-09-14T11:33:26.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.489+0000 7f0175b46800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33.1.0 2024-09-14T11:33:26.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.489+0000 7f0175b46800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33.1.0 2024-09-14T11:33:26.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.489+0000 7f0175b46800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33.1.1 2024-09-14T11:33:26.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.489+0000 7f0175b46800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33.1.1 2024-09-14T11:33:26.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.489+0000 7f0175b46800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33.0 2024-09-14T11:33:26.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.492+0000 7f0175b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:26.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.492+0000 7f0175b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 2024-09-14T11:33:26.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0175b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0175b46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0175b46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0175b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33, ofs0, ns] 2024-09-14T11:33:26.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94756854672032 notifier 7413 bl.length()=911 2024-09-14T11:33:26.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0056ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.492 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.493+0000 7f0056ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.495+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_sources= new_sources= 2024-09-14T11:33:26.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.495+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential sources added=[] removed=[] 2024-09-14T11:33:26.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.495+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_dests= new_dests= 2024-09-14T11:33:26.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.495+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential dests added=[] removed=[] 2024-09-14T11:33:26.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.496+0000 7f0175b46800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33.0 2024-09-14T11:33:26.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.496+0000 7f0175b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:26.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.496+0000 7f0175b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 2024-09-14T11:33:26.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f0175b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f0175b46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f0175b46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f0175b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33, ofs0, ns] 2024-09-14T11:33:26.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f00567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94756854672032 notifier 7413 bl.length()=879 2024-09-14T11:33:26.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f00567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 info.flags=0x17 2024-09-14T11:33:26.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f00567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 to cache LRU end 2024-09-14T11:33:26.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.498+0000 7f00567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:26.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.499+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_sources= new_sources= 2024-09-14T11:33:26.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.499+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential sources added=[] removed=[] 2024-09-14T11:33:26.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.499+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): orig_dests= new_dests= 2024-09-14T11:33:26.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.499+0000 7f0175b46800 20 handle_bi_update(): bucket=:error-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33]): potential dests added=[] removed=[] 2024-09-14T11:33:26.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.501+0000 7f0175b46800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-14T11:33:26.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.503+0000 7f0029fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:26.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.505+0000 7f0175b46800 20 remove_watcher() i=0 2024-09-14T11:33:26.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.505+0000 7f0175b46800 2 removed watcher, disabling cache 2024-09-14T11:33:26.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.506+0000 7f0175b46800 20 remove_watcher() i=1 2024-09-14T11:33:26.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.507+0000 7f0175b46800 20 remove_watcher() i=2 2024-09-14T11:33:26.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.508+0000 7f0175b46800 20 remove_watcher() i=3 2024-09-14T11:33:26.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.509+0000 7f0175b46800 20 remove_watcher() i=4 2024-09-14T11:33:26.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.510+0000 7f0175b46800 20 remove_watcher() i=5 2024-09-14T11:33:26.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.511+0000 7f0175b46800 20 remove_watcher() i=6 2024-09-14T11:33:26.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.512+0000 7f0175b46800 20 remove_watcher() i=7 2024-09-14T11:33:26.523 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:33:26.552 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:26.552 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:26.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.593+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 realm 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.595+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.596+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:26.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.596+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.596+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:26.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.596+0000 7f5da2125800 20 searching for the correct realm 2024-09-14T11:33:26.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.599+0000 7f5d9d5ad640 0 -- 172.21.15.28:0/2229303588 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5d9000e070 msgr2=0x7f5d9006a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:26.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.603+0000 7f5d9ddae640 0 -- 172.21.15.28:0/2229303588 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5d94007390 msgr2=0x7f5d940e58f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:26.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:26.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:26.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:26.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:26.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:26.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:26.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.810+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 zone default found 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 4 Realm: () 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 zonegroup default 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.810 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.811+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.812+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.812+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.812+0000 7f5da2125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:26.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.812+0000 7f5da2125800 20 started sync module instance, tier type = 2024-09-14T11:33:26.811 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.812+0000 7f5da2125800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:26.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=0 2024-09-14T11:33:26.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=1 2024-09-14T11:33:26.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=2 2024-09-14T11:33:26.819 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=3 2024-09-14T11:33:26.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=4 2024-09-14T11:33:26.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=5 2024-09-14T11:33:26.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.821+0000 7f5da2125800 20 add_watcher() i=6 2024-09-14T11:33:26.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.822+0000 7f5da2125800 20 add_watcher() i=7 2024-09-14T11:33:26.820 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.822+0000 7f5da2125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:26.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.824+0000 7f5c4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:26.822 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.824+0000 7f5da2125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.824+0000 7f5da2125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.824+0000 7f5da2125800 5 note: GC not initialized 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.824+0000 7f5c4e7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.824+0000 7f5da2125800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.825+0000 7f5da2125800 20 Filter name: none 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.825+0000 7f5bc3fff640 20 reqs_thread_entry: start 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.825+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.825+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:26.823 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.825+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.826+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:26.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.826+0000 7f5da2125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:26.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.826+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.827+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:26.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.827+0000 7f5da2125800 20 rados->read ofs=0 len=0 2024-09-14T11:33:26.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.827+0000 7f5da2125800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:26.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.827+0000 7f5da2125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:26.826 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.828+0000 7f5c4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:26.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.831+0000 7f5da2125800 20 remove_watcher() i=0 2024-09-14T11:33:26.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.831+0000 7f5da2125800 2 removed watcher, disabling cache 2024-09-14T11:33:26.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.832+0000 7f5da2125800 20 remove_watcher() i=1 2024-09-14T11:33:26.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.833+0000 7f5da2125800 20 remove_watcher() i=2 2024-09-14T11:33:26.832 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.834+0000 7f5da2125800 20 remove_watcher() i=3 2024-09-14T11:33:26.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.835+0000 7f5da2125800 20 remove_watcher() i=4 2024-09-14T11:33:26.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.836+0000 7f5da2125800 20 remove_watcher() i=5 2024-09-14T11:33:26.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.837+0000 7f5da2125800 20 remove_watcher() i=6 2024-09-14T11:33:26.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:26.838+0000 7f5da2125800 20 remove_watcher() i=7 2024-09-14T11:33:26.847 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:26.847 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:33:26.847 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-do-reshard id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:33:26.847 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:27.151 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:33:27.151 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.042 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:33:28.071 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:28.071 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:28.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.111+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 realm 2024-09-14T11:33:28.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:28.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.113+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.114+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.114+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.115+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:28.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.115+0000 7f217b939800 20 searching for the correct realm 2024-09-14T11:33:28.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.118+0000 7f2177dc8640 0 -- 172.21.15.28:0/1181745155 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x555e46cbfc90 msgr2=0x555e46cc2110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.122+0000 7f2176dc6640 0 -- 172.21.15.28:0/1181745155 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f2168017070 msgr2=0x7f2168003710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.126+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 zone default found 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 4 Realm: () 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:28.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 zonegroup default 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.127+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.128+0000 7f217b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.128+0000 7f217b939800 20 started sync module instance, tier type = 2024-09-14T11:33:28.127 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.128+0000 7f217b939800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:28.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=0 2024-09-14T11:33:28.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=1 2024-09-14T11:33:28.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=2 2024-09-14T11:33:28.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=3 2024-09-14T11:33:28.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=4 2024-09-14T11:33:28.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=5 2024-09-14T11:33:28.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.137+0000 7f217b939800 20 add_watcher() i=6 2024-09-14T11:33:28.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.138+0000 7f217b939800 20 add_watcher() i=7 2024-09-14T11:33:28.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.138+0000 7f217b939800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:28.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.139+0000 7f202dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:28.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f217b939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:28.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f217b939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:28.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f217b939800 5 note: GC not initialized 2024-09-14T11:33:28.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f202cfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:28.138 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f217b939800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:28.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f217b939800 20 Filter name: none 2024-09-14T11:33:28.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f1fa67fc640 20 reqs_thread_entry: start 2024-09-14T11:33:28.139 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.140+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.141+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.141+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.141+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.141+0000 7f217b939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.141+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.142+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.142+0000 7f217b939800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.142+0000 7f217b939800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:28.140 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.142+0000 7f217b939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:28.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.143+0000 7f202dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:28.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.145+0000 7f217b939800 20 remove_watcher() i=0 2024-09-14T11:33:28.143 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.145+0000 7f217b939800 2 removed watcher, disabling cache 2024-09-14T11:33:28.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.146+0000 7f217b939800 20 remove_watcher() i=1 2024-09-14T11:33:28.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.147+0000 7f217b939800 20 remove_watcher() i=2 2024-09-14T11:33:28.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.148+0000 7f217b939800 20 remove_watcher() i=3 2024-09-14T11:33:28.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.150+0000 7f217b939800 20 remove_watcher() i=4 2024-09-14T11:33:28.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.151+0000 7f217b939800 20 remove_watcher() i=5 2024-09-14T11:33:28.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.152+0000 7f217b939800 20 remove_watcher() i=6 2024-09-14T11:33:28.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.153+0000 7f217b939800 20 remove_watcher() i=7 2024-09-14T11:33:28.162 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.162 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:33:28.162 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-do-reshard id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:33:28.162 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.163 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:33:28.197 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:28.198 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:28.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.239+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 realm 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:28.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.242+0000 7fe8d112c800 20 searching for the correct realm 2024-09-14T11:33:28.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.246+0000 7fe8cd546640 0 -- 172.21.15.28:0/3826146416 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fe8b40698f0 msgr2=0x7fe8b4073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.453+0000 7fe8ccd45640 0 -- 172.21.15.28:0/3826146416 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x5619fce04890 msgr2=0x5619fce06c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:28.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:28.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:28.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:28.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:28.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:28.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.455 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:28.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 zone default found 2024-09-14T11:33:28.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 4 Realm: () 2024-09-14T11:33:28.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:28.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 zonegroup default 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.458+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.458+0000 7fe8d112c800 20 started sync module instance, tier type = 2024-09-14T11:33:28.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.458+0000 7fe8d112c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:28.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=0 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=1 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=2 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=3 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=4 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=5 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.469+0000 7fe8d112c800 20 add_watcher() i=6 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.469+0000 7fe8d112c800 20 add_watcher() i=7 2024-09-14T11:33:28.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.469+0000 7fe8d112c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:28.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.471+0000 7fe7837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:28.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.471+0000 7fe8d112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:28.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.471+0000 7fe8d112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:28.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe8d112c800 5 note: GC not initialized 2024-09-14T11:33:28.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe7827e4640 20 reqs_thread_entry: start 2024-09-14T11:33:28.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe8d112c800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:28.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe8d112c800 20 Filter name: none 2024-09-14T11:33:28.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe77bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:28.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe8d112c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:33:28.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.472+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : miss 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.473+0000 7fe8d112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe8d112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe8d112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe8d112c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34, ofs0, ns] 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94669616771728 notifier 7464 bl.length()=911 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_sources= new_sources= 2024-09-14T11:33:28.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential sources added=[] removed=[] 2024-09-14T11:33:28.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_dests= new_dests= 2024-09-14T11:33:28.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential dests added=[] removed=[] 2024-09-14T11:33:28.479 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8d112c800 time 2024-09-14T11:33:28.482516+0000 2024-09-14T11:33:28.479 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe8d278c76a] 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:33:28.480 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.482+0000 7fe8d112c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8d112c800 time 2024-09-14T11:33:28.482516+0000 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe8d278c76a] 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.481 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:28.482 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fe8d112c800 thread_name:radosgw-admin 2024-09-14T11:33:28.499 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.499 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe8d143e6f0] 2024-09-14T11:33:28.499 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe8d148b99c] 2024-09-14T11:33:28.499 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe8d278c7c4] 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.483+0000 7fe8d112c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:28.500 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fe8d112c800 thread_name:radosgw-admin 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe8d143e6f0] 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe8d148b99c] 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe8d278c7c4] 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.501 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: dump: 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.502 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: dump: 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.503 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:33:28.221+0000 7fe8d112c800 5 monclient: authenticate success, global_id 6977 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:33:28.221+0000 7fe8d112c800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:33:28.221+0000 7fe8d112c800 4 set_mon_vals no callback set 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: shutdown 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 asok(0x5619fcaf5270) unregister_commands rotate-key 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.504 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding auth protocol: cephx 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding auth protocol: cephx 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding auth protocol: cephx 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.505 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:33:28.222+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: starting msgr at 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: starting objecter 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command objecter_requests hook 0x5619fcd3fb50 2024-09-14T11:33:28.506 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: setting wanted keys 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: calling monclient init 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding auth protocol: cephx 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding auth protocol: cephx 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding auth protocol: cephx 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.507 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:33:28.223+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:33:28.223+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:33:28.223+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key hook 0x5619fcd156f8 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcbc17e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcc57760 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcc5d750 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.508 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.864463s 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcbc17e0 auth_method 0 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcc5d750 auth_method 0 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.509 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): get_auth_request con 0x5619fcc57760 auth_method 0 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_done global_id 6980 payload 824 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 1 monclient: found mon.noname-c 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: dump: 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.510 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: dump: 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.511 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:33:28.224+0000 7fe8d112c800 5 monclient: authenticate success, global_id 6980 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:33:28.224+0000 7fe7bae0d640 4 set_mon_vals no callback set 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:33:28.512 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:33:28.224+0000 7fe8d112c800 1 librados: init done 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:33:28.226+0000 7fe7b960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:33:28.226+0000 7fe7b960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:33:28.226+0000 7fe7b960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:33:28.226+0000 7fe8cc544640 10 monclient: get_auth_request con 0x7fe7b4077230 auth_method 0 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:33:28.226+0000 7fe8cd546640 10 monclient: get_auth_request con 0x5619fcd48390 auth_method 0 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:33:28.227+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x5619fcd60ff0 auth_method 0 2024-09-14T11:33:28.513 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:33:28.228+0000 7fe8cc544640 10 monclient: get_auth_request con 0x5619fcd662a0 auth_method 0 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:33:28.229+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:33:28.229+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:33:28.229+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.516 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding auth protocol: cephx 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding auth protocol: cephx 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding auth protocol: cephx 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.517 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:33:28.229+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command objecter_requests cmddesc objecter_requests hook 0x5619fcd6d7e0 EEXIST 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding auth protocol: cephx 2024-09-14T11:33:28.518 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding auth protocol: cephx 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding auth protocol: cephx 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.519 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:33:28.230+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:33:28.230+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key cmddesc rotate-key hook 0x5619fcd693f0 EEXIST 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcd91b00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcd91ee0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcd90810 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.520 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.871575s 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): get_auth_request con 0x5619fcd91ee0 auth_method 0 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcd90810 auth_method 0 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.521 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcd91b00 auth_method 0 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_done global_id 7458 payload 824 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:33:28.231+0000 7fe8cc544640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:33:28.231+0000 7fe8cc544640 1 monclient: found mon.noname-a 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:33:28.231+0000 7fe8cc544640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.522 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: dump: 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.523 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: dump: 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.524 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:33:28.231+0000 7fe8d112c800 5 monclient: authenticate success, global_id 7458 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:33:28.231+0000 7fe8cdd47640 4 set_mon_vals no callback set 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:33:28.233+0000 7fe7b27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:28.525 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:33:28.233+0000 7fe7b27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:33:28.233+0000 7fe7b27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:33:28.233+0000 7fe8d112c800 10 monclient: get_monmap_and_config 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:33:28.233+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:33:28.233+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:33:28.233+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.526 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding auth protocol: cephx 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding auth protocol: cephx 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding auth protocol: cephx 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.527 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:33:28.233+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe7a4077140 auth_method 0 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:33:28.234+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding auth protocol: cephx 2024-09-14T11:33:28.528 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding auth protocol: cephx 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding auth protocol: cephx 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.529 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:33:28.234+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:33:28.234+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key cmddesc rotate-key hook 0x7fff56efa9e8 EEXIST 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcde6100 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcdb5f30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcde14e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.530 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.875835s 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcde6100 auth_method 0 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcde14e0 auth_method 0 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:33:28.235+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:33:28.235+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.531 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:33:28.235+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_done global_id 7461 payload 274 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:33:28.235+0000 7fe8cd546640 1 monclient: found mon.noname-a 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:33:28.235+0000 7fe8cc544640 10 monclient: get_auth_request con 0x5619fcdb5f30 auth_method 0 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: dump: 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.532 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: dump: 2024-09-14T11:33:28.533 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:33:28.235+0000 7fe8d112c800 5 monclient: authenticate success, global_id 7461 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:33:28.235+0000 7fe8d112c800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:33:28.235+0000 7fe8d112c800 4 set_mon_vals no callback set 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: shutdown 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.534 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding auth protocol: cephx 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding auth protocol: cephx 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding auth protocol: cephx 2024-09-14T11:33:28.535 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:33:28.236+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: starting msgr at 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: starting objecter 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command objecter_requests cmddesc objecter_requests hook 0x5619fcdb2930 EEXIST 2024-09-14T11:33:28.536 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: setting wanted keys 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: calling monclient init 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding auth protocol: cephx 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding auth protocol: cephx 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding auth protocol: cephx 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.537 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:33:28.236+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:33:28.237+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:33:28.237+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key cmddesc rotate-key hook 0x5619fcda6508 EEXIST 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcdb5f30 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcde14e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcde6100 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.538 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.878266s 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcdb5f30 auth_method 0 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcde6100 auth_method 0 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.539 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): get_auth_request con 0x5619fcde14e0 auth_method 0 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_done global_id 7464 payload 824 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 1 monclient: found mon.noname-a 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: dump: 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.540 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:28.541 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: dump: 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:33:28.237+0000 7fe8d112c800 5 monclient: authenticate success, global_id 7464 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.542 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:33:28.237+0000 7fe7a3fff640 4 set_mon_vals no callback set 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:33:28.237+0000 7fe8d112c800 1 librados: init done 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:33:28.238+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cr dump hook 0x5619fcdd8548 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:33:28.239+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:33:28.240+0000 7fe7a27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:33:28.240+0000 7fe7a27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:33:28.240+0000 7fe7a27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:33:28.240+0000 7fe8cc544640 10 monclient: get_auth_request con 0x7fe798077230 auth_method 0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:33:28.240+0000 7fe8cd546640 10 monclient: get_auth_request con 0x5619fce005a0 auth_method 0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 realm 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.543 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:33:28.241+0000 7fe8d112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:33:28.241+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x5619fce04890 auth_method 0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 searching for the correct realm 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:33:28.242+0000 7fe8cc544640 10 monclient: get_auth_request con 0x5619fce09960 auth_method 0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:33:28.243+0000 7fe8cd546640 10 monclient: get_auth_request con 0x7fe8b4073b90 auth_method 0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:33:28.244+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe8c4061040 auth_method 0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:33:28.244+0000 7fe8cc544640 10 monclient: get_auth_request con 0x7fe8bc08c070 auth_method 0 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:33:28.246+0000 7fe8cd546640 0 -- 172.21.15.28:0/3826146416 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fe8b40698f0 msgr2=0x7fe8b4073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.544 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:33:28.246+0000 7fe8cd546640 10 monclient: get_auth_request con 0x7fe8b40698f0 auth_method 0 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:33:28.448+0000 7fe8cd546640 10 monclient: get_auth_request con 0x7fe8b40698f0 auth_method 0 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:33:28.451+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe8b40800c0 auth_method 0 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:33:28.453+0000 7fe8ccd45640 0 -- 172.21.15.28:0/3826146416 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x5619fce04890 msgr2=0x5619fce06c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:33:28.453+0000 7fe7a27fc640 1 client.7464.objecter ms_handle_reset 0x5619fce04890 session 0x5619fce036d0 osd.5 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:33:28.453+0000 7fe7a27fc640 10 monclient: _renew_subs 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:33:28.453+0000 7fe7a27fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:33:28.453+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe798087a40 auth_method 0 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:28.545 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 zone default found 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:33:28.457+0000 7fe8d112c800 4 Realm: () 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:33:28.457+0000 7fe8d112c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:33:28.457+0000 7fe8d112c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:33:28.457+0000 7fe8d112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 zonegroup default 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.546 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:33:28.458+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:33:28.458+0000 7fe8d112c800 20 started sync module instance, tier type = 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:33:28.458+0000 7fe8d112c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=0 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=1 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=2 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=3 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=4 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=5 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:33:28.469+0000 7fe8d112c800 20 add_watcher() i=6 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:33:28.469+0000 7fe8d112c800 20 add_watcher() i=7 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:33:28.469+0000 7fe8d112c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:28.547 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding auth protocol: cephx 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding auth protocol: cephx 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding auth protocol: cephx 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:33:28.471+0000 7fe7837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.548 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:33:28.471+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:33:28.471+0000 7fe8d112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:33:28.471+0000 7fe8d112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache list hook 0x5619fcddc140 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache inspect hook 0x5619fcddc140 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache erase hook 0x5619fcddc140 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache zap hook 0x5619fcddc140 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 note: GC not initialized 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:33:28.472+0000 7fe7827e4640 20 reqs_thread_entry: start 2024-09-14T11:33:28.549 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace show hook 0x7fe8c4061420 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace history hook 0x7fe8c4061420 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace active hook 0x7fe8c4061420 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace active_short hook 0x7fe8c4061420 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:33:28.472+0000 7fe8d112c800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:33:28.472+0000 7fe8d112c800 20 Filter name: none 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:33:28.472+0000 7fe77bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:33:28.472+0000 7fe8d112c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:33:28.472+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:33:28.550 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : miss 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34, ofs0, ns] 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94669616771728 notifier 7464 bl.length()=911 2024-09-14T11:33:28.551 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_sources= new_sources= 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential sources added=[] removed=[] 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_dests= new_dests= 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential dests added=[] removed=[] 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:33:28.482+0000 7fe8d112c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8d112c800 time 2024-09-14T11:33:28.482516+0000 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe8d278c76a] 2024-09-14T11:33:28.552 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:33:28.483+0000 7fe8d112c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fe8d112c800 thread_name:radosgw-admin 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.553 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe8d143e6f0] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe8d148b99c] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe8d278c7c4] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:28.554 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:28.555 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:33:28.556 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:33:28.557 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:28.558 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:33:28.559 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:28.560 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:33:28.561 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe77bfff640 / http_manager 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7827e4640 / http_manager 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7837e6640 / rgw_dt_lg_renew 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7a27fc640 / ms_dispatch 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7a3fff640 / io_context_pool 2024-09-14T11:33:28.562 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7b27fc640 / ms_dispatch 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7b960a640 / ms_dispatch 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7bae0d640 / io_context_pool 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8cc544640 / msgr-worker-2 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8ccd45640 / msgr-worker-1 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8cd546640 / msgr-worker-0 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8cdd47640 / io_context_pool 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8d112c800 / radosgw-admin 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.126153.log 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:28.563 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: dump: 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.564 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:33:28.221+0000 7fe7bae0d640 10 monclient: dump: 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:33:28.221+0000 7fe8d112c800 5 monclient: authenticate success, global_id 6977 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:33:28.221+0000 7fe8d112c800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:33:28.221+0000 7fe8d112c800 4 set_mon_vals no callback set 2024-09-14T11:33:28.565 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: shutdown 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 asok(0x5619fcaf5270) unregister_commands rotate-key 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.566 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding auth protocol: cephx 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding auth protocol: cephx 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding auth protocol: cephx 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: crc 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd1b260) adding con mode: secure 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:33:28.222+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.567 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: starting msgr at 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: starting objecter 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command objecter_requests hook 0x5619fcd3fb50 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: setting wanted keys 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:33:28.222+0000 7fe8d112c800 1 librados: calling monclient init 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:33:28.222+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding auth protocol: cephx 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding auth protocol: cephx 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding auth protocol: cephx 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.568 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: crc 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:33:28.222+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd155b0) adding con mode: secure 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:33:28.223+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:33:28.223+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:33:28.223+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key hook 0x5619fcd156f8 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcbc17e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcc57760 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcc5d750 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.569 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:33:28.223+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.864463s 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcbc17e0 auth_method 0 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcc5d750 auth_method 0 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.570 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:33:28.223+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): get_auth_request con 0x5619fcc57760 auth_method 0 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:33:28.223+0000 7fe8cc544640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_done global_id 6980 payload 824 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 1 monclient: found mon.noname-c 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:33:28.223+0000 7fe8ccd45640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: dump: 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.571 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:33:28.224+0000 7fe7b960a640 10 monclient: dump: 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.572 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:33:28.224+0000 7fe8d112c800 5 monclient: authenticate success, global_id 6980 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:33:28.224+0000 7fe7bae0d640 4 set_mon_vals no callback set 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.573 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:33:28.224+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:33:28.224+0000 7fe8d112c800 1 librados: init done 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:33:28.226+0000 7fe7b960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:33:28.226+0000 7fe7b960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:33:28.226+0000 7fe7b960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:33:28.226+0000 7fe8cc544640 10 monclient: get_auth_request con 0x7fe7b4077230 auth_method 0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:33:28.226+0000 7fe8cd546640 10 monclient: get_auth_request con 0x5619fcd48390 auth_method 0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:33:28.227+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x5619fcd60ff0 auth_method 0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:33:28.228+0000 7fe8cc544640 10 monclient: get_auth_request con 0x5619fcd662a0 auth_method 0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:33:28.229+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:33:28.229+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:33:28.229+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.574 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding auth protocol: cephx 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding auth protocol: cephx 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding auth protocol: cephx 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.575 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: crc 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd6a2f0) adding con mode: secure 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:33:28.229+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.576 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:33:28.229+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command objecter_requests cmddesc objecter_requests hook 0x5619fcd6d7e0 EEXIST 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding auth protocol: cephx 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding auth protocol: cephx 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding auth protocol: cephx 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.577 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: crc 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 AuthRegistry(0x5619fcd692a8) adding con mode: secure 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:33:28.230+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:33:28.230+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:33:28.230+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key cmddesc rotate-key hook 0x5619fcd693f0 EEXIST 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcd91b00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcd91ee0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcd90810 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:33:28.230+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.871575s 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): get_auth_request con 0x5619fcd91ee0 auth_method 0 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcd90810 auth_method 0 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.579 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:33:28.230+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcd91b00 auth_method 0 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:33:28.230+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:33:28.230+0000 7fe8cc544640 10 monclient(hunting): handle_auth_done global_id 7458 payload 824 2024-09-14T11:33:28.580 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:33:28.231+0000 7fe8cc544640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:33:28.231+0000 7fe8cc544640 1 monclient: found mon.noname-a 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:33:28.231+0000 7fe8cc544640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: dump: 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.581 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:33:28.231+0000 7fe7b27fc640 10 monclient: dump: 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.582 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:33:28.231+0000 7fe8d112c800 5 monclient: authenticate success, global_id 7458 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.583 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:33:28.231+0000 7fe8cdd47640 4 set_mon_vals no callback set 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:33:28.231+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:33:28.233+0000 7fe7b27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:33:28.233+0000 7fe7b27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:33:28.233+0000 7fe7b27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:33:28.233+0000 7fe8d112c800 10 monclient: get_monmap_and_config 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:33:28.233+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:33:28.233+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:33:28.233+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.584 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding auth protocol: cephx 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding auth protocol: cephx 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding auth protocol: cephx 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.585 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: crc 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:33:28.233+0000 7fe8d112c800 5 AuthRegistry(0x5619fcdb1a80) adding con mode: secure 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:33:28.233+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe7a4077140 auth_method 0 2024-09-14T11:33:28.586 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:33:28.234+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding auth protocol: cephx 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding auth protocol: cephx 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding auth protocol: cephx 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.587 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: crc 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efa8a0) adding con mode: secure 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:33:28.234+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:33:28.234+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:33:28.234+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key cmddesc rotate-key hook 0x7fff56efa9e8 EEXIST 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcde6100 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcdb5f30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcde14e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.588 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:33:28.234+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.875835s 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcde6100 auth_method 0 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:33:28.234+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcde14e0 auth_method 0 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.589 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:33:28.234+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:33:28.235+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:33:28.235+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:33:28.235+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient(hunting): handle_auth_done global_id 7461 payload 274 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:33:28.235+0000 7fe8cd546640 1 monclient: found mon.noname-a 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:33:28.235+0000 7fe8cd546640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:33:28.235+0000 7fe8cc544640 10 monclient: get_auth_request con 0x5619fcdb5f30 auth_method 0 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: dump: 2024-09-14T11:33:28.590 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:28.591 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:33:28.235+0000 7fe7a3fff640 10 monclient: dump: 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:33:28.235+0000 7fe8d112c800 5 monclient: authenticate success, global_id 7461 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:33:28.235+0000 7fe8d112c800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:33:28.235+0000 7fe8d112c800 4 set_mon_vals no callback set 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: shutdown 2024-09-14T11:33:28.592 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: build_initial_monmap 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 build_initial for_mkfs: 0 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: monmap: 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding auth protocol: cephx 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding auth protocol: cephx 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding auth protocol: cephx 2024-09-14T11:33:28.593 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: crc 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcde1990) adding con mode: secure 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:33:28.236+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: starting msgr at 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: starting objecter 2024-09-14T11:33:28.594 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command objecter_requests cmddesc objecter_requests hook 0x5619fcdb2930 EEXIST 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: setting wanted keys 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:33:28.236+0000 7fe8d112c800 1 librados: calling monclient init 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:33:28.236+0000 7fe8d112c800 10 monclient: init 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding auth protocol: cephx 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding auth protocol: cephx 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding auth protocol: cephx 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.595 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: crc 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:33:28.236+0000 7fe8d112c800 5 AuthRegistry(0x5619fcda63c0) adding con mode: secure 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:33:28.236+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:33:28.237+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:33:28.237+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command rotate-key cmddesc rotate-key hook 0x5619fcda6508 EEXIST 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-a con 0x5619fcdb5f30 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-b con 0x5619fcde14e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): picked mon.noname-c con 0x5619fcde6100 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:28.596 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient(hunting): authenticate will time out at 2145.878266s 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request con 0x5619fcdb5f30 auth_method 0 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): get_auth_request con 0x5619fcde6100 auth_method 0 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:28.597 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:33:28.237+0000 7fe8cd546640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): get_auth_request con 0x5619fcde14e0 auth_method 0 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:33:28.237+0000 7fe8cc544640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient(hunting): handle_auth_done global_id 7464 payload 824 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient: _finish_hunting 0 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 1 monclient: found mon.noname-a 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:33:28.237+0000 7fe8ccd45640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: dump: 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.598 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:33:28.237+0000 7fe7a27fc640 10 monclient: dump: 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:33:28.599 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:33:28.237+0000 7fe8d112c800 5 monclient: authenticate success, global_id 7464 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:33:28.237+0000 7fe7a3fff640 4 set_mon_vals no callback set 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _renew_subs 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:33:28.237+0000 7fe8d112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:33:28.237+0000 7fe8d112c800 1 librados: init done 2024-09-14T11:33:28.600 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:33:28.238+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cr dump hook 0x5619fcdd8548 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:33:28.239+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:33:28.240+0000 7fe7a27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:33:28.240+0000 7fe7a27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:33:28.240+0000 7fe7a27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:33:28.240+0000 7fe8cc544640 10 monclient: get_auth_request con 0x7fe798077230 auth_method 0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:33:28.240+0000 7fe8cd546640 10 monclient: get_auth_request con 0x5619fce005a0 auth_method 0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 realm 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:33:28.241+0000 7fe8d112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.601 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:33:28.241+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:33:28.241+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x5619fce04890 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:33:28.242+0000 7fe8d112c800 20 searching for the correct realm 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:33:28.242+0000 7fe8cc544640 10 monclient: get_auth_request con 0x5619fce09960 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:33:28.243+0000 7fe8cd546640 10 monclient: get_auth_request con 0x7fe8b4073b90 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:33:28.244+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe8c4061040 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:33:28.244+0000 7fe8cc544640 10 monclient: get_auth_request con 0x7fe8bc08c070 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:33:28.246+0000 7fe8cd546640 0 -- 172.21.15.28:0/3826146416 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fe8b40698f0 msgr2=0x7fe8b4073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:33:28.246+0000 7fe8cd546640 10 monclient: get_auth_request con 0x7fe8b40698f0 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:33:28.448+0000 7fe8cd546640 10 monclient: get_auth_request con 0x7fe8b40698f0 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:33:28.451+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe8b40800c0 auth_method 0 2024-09-14T11:33:28.602 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:33:28.453+0000 7fe8ccd45640 0 -- 172.21.15.28:0/3826146416 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x5619fce04890 msgr2=0x5619fce06c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:33:28.453+0000 7fe7a27fc640 1 client.7464.objecter ms_handle_reset 0x5619fce04890 session 0x5619fce036d0 osd.5 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:33:28.453+0000 7fe7a27fc640 10 monclient: _renew_subs 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:33:28.453+0000 7fe7a27fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:33:28.453+0000 7fe8ccd45640 10 monclient: get_auth_request con 0x7fe798087a40 auth_method 0 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:28.603 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:33:28.456+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 zone default found 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:33:28.457+0000 7fe8d112c800 4 Realm: () 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:33:28.457+0000 7fe8d112c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:33:28.457+0000 7fe8d112c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:33:28.457+0000 7fe8d112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 zonegroup default 2024-09-14T11:33:28.604 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:33:28.457+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:33:28.458+0000 7fe8d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:33:28.458+0000 7fe8d112c800 20 started sync module instance, tier type = 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:33:28.458+0000 7fe8d112c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=0 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=1 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=2 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=3 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=4 2024-09-14T11:33:28.605 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:33:28.468+0000 7fe8d112c800 20 add_watcher() i=5 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:33:28.469+0000 7fe8d112c800 20 add_watcher() i=6 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:33:28.469+0000 7fe8d112c800 20 add_watcher() i=7 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:33:28.469+0000 7fe8d112c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding auth protocol: cephx 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding auth protocol: cephx 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding auth protocol: cephx 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:33:28.471+0000 7fe7837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.606 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: crc 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 AuthRegistry(0x7fff56efad80) adding con mode: secure 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:33:28.471+0000 7fe8d112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:33:28.471+0000 7fe8d112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:33:28.471+0000 7fe8d112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache list hook 0x5619fcddc140 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache inspect hook 0x5619fcddc140 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache erase hook 0x5619fcddc140 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:33:28.471+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command cache zap hook 0x5619fcddc140 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 note: GC not initialized 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:33:28.472+0000 7fe7827e4640 20 reqs_thread_entry: start 2024-09-14T11:33:28.607 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace show hook 0x7fe8c4061420 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace history hook 0x7fe8c4061420 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace active hook 0x7fe8c4061420 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:33:28.472+0000 7fe8d112c800 5 asok(0x5619fcaf5270) register_command sync trace active_short hook 0x7fe8c4061420 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:33:28.472+0000 7fe8d112c800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:33:28.472+0000 7fe8d112c800 20 Filter name: none 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:33:28.472+0000 7fe77bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:33:28.472+0000 7fe8d112c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:33:28.472+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : miss 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:33:28.473+0000 7fe8d112c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:28.608 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:33:28.473+0000 7fe8d112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:33:28.477+0000 7fe8d112c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34, ofs0, ns] 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 94669616771728 notifier 7464 bl.length()=911 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:33:28.477+0000 7fe7a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_sources= new_sources= 2024-09-14T11:33:28.609 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential sources added=[] removed=[] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_dests= new_dests= 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:33:28.479+0000 7fe8d112c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential dests added=[] removed=[] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:33:28.482+0000 7fe8d112c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8d112c800 time 2024-09-14T11:33:28.482516+0000 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe8d278c76a] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.610 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:33:28.483+0000 7fe8d112c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fe8d112c800 thread_name:radosgw-admin 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe8d143e6f0] 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe8d148b99c] 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe8d278c7c4] 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe8d278c928] 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5619fbbd10b1] 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5619fbbe0f6a] 2024-09-14T11:33:28.611 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fe8d1429590] 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:28.612 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:33:28.613 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:33:28.614 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:28.615 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:33:28.616 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:33:28.617 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:33:28.618 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe77bfff640 / http_manager 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7827e4640 / http_manager 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7837e6640 / rgw_dt_lg_renew 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7a27fc640 / ms_dispatch 2024-09-14T11:33:28.619 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7a3fff640 / io_context_pool 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7b27fc640 / ms_dispatch 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7b960a640 / ms_dispatch 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe7bae0d640 / io_context_pool 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8cc544640 / msgr-worker-2 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8ccd45640 / msgr-worker-1 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8cd546640 / msgr-worker-0 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8cdd47640 / io_context_pool 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: 7fe8d112c800 / radosgw-admin 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:28.483933Z_64f5a72f-1508-4114-805a-25c2027f82c8/log 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:33:28.620 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:33:28.621 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:28.621 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:28.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.561+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.763+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.763+0000 7f98dc60e800 20 realm 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.763+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.764+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.764+0000 7f98dc60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.764+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.764+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:28.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.764+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.765+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:28.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.765+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:28.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.765+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:28.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.765+0000 7f98dc60e800 20 searching for the correct realm 2024-09-14T11:33:28.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.768+0000 7f98d74ca640 0 -- 172.21.15.28:0/3042779411 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f98c8050020 msgr2=0x7f98c808aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:28.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:28.974+0000 7f98d7ccb640 0 -- 172.21.15.28:0/3042779411 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f98cc0adb20 msgr2=0x7f98cc0c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.180+0000 7f98dc60e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.181+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 zone default found 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 4 Realm: () 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 zonegroup default 2024-09-14T11:33:29.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.182+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.183+0000 7f98dc60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.183+0000 7f98dc60e800 20 started sync module instance, tier type = 2024-09-14T11:33:29.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.183+0000 7f98dc60e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=0 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=1 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=2 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=3 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=4 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=5 2024-09-14T11:33:29.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.195+0000 7f98dc60e800 20 add_watcher() i=6 2024-09-14T11:33:29.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.196+0000 7f98dc60e800 20 add_watcher() i=7 2024-09-14T11:33:29.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.196+0000 7f98dc60e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:29.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.197+0000 7f978dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:29.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f98dc60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:29.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f98dc60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:29.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f98dc60e800 5 note: GC not initialized 2024-09-14T11:33:29.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f978cfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:29.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f98dc60e800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:29.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f98dc60e800 20 Filter name: none 2024-09-14T11:33:29.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f97067fc640 20 reqs_thread_entry: start 2024-09-14T11:33:29.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.198+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.199+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.199+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:29.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:33:29.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.200+0000 7f98dc60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:29.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.202+0000 7f978dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:29.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.205+0000 7f98dc60e800 20 remove_watcher() i=0 2024-09-14T11:33:29.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.205+0000 7f98dc60e800 2 removed watcher, disabling cache 2024-09-14T11:33:29.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.206+0000 7f98dc60e800 20 remove_watcher() i=1 2024-09-14T11:33:29.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.207+0000 7f98dc60e800 20 remove_watcher() i=2 2024-09-14T11:33:29.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.208+0000 7f98dc60e800 20 remove_watcher() i=3 2024-09-14T11:33:29.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.209+0000 7f98dc60e800 20 remove_watcher() i=4 2024-09-14T11:33:29.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.210+0000 7f98dc60e800 20 remove_watcher() i=5 2024-09-14T11:33:29.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.211+0000 7f98dc60e800 20 remove_watcher() i=6 2024-09-14T11:33:29.211 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.213+0000 7f98dc60e800 20 remove_watcher() i=7 2024-09-14T11:33:29.222 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:29.222 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:33:29.222 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-do-reshard id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:33:29.223 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:33:29.318 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:29.351 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:29.351 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:29.391 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.393+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 realm 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.395+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.396+0000 7fd84fb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:29.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.396+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.397+0000 7fd84fb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:29.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.397+0000 7fd84fb25800 20 searching for the correct realm 2024-09-14T11:33:29.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.399+0000 7fd84b7ae640 0 -- 172.21.15.28:0/3926822573 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x563ae9f447c0 msgr2=0x7fd8440b05e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:29.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.605+0000 7fd84bfaf640 0 -- 172.21.15.28:0/3926822573 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fd840032040 msgr2=0x7fd840072ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:29.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:29.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:29.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:29.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:29.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:29.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:29.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.611+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 zone default found 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 4 Realm: () 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:29.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 zonegroup default 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.612+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.613+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.613+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.613+0000 7fd84fb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.613+0000 7fd84fb25800 20 started sync module instance, tier type = 2024-09-14T11:33:29.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.613+0000 7fd84fb25800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=0 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=1 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=2 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=3 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=4 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=5 2024-09-14T11:33:29.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.623+0000 7fd84fb25800 20 add_watcher() i=6 2024-09-14T11:33:29.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.624+0000 7fd84fb25800 20 add_watcher() i=7 2024-09-14T11:33:29.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.624+0000 7fd84fb25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:29.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.626+0000 7fd701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.626+0000 7fd84fb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.626+0000 7fd84fb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.626+0000 7fd84fb25800 5 note: GC not initialized 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.626+0000 7fd700fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.626+0000 7fd84fb25800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.627+0000 7fd84fb25800 20 Filter name: none 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.627+0000 7fd67a7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.627+0000 7fd84fb25800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:33:29.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.627+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:29.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:33:29.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:33:29.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : miss 2024-09-14T11:33:29.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:29.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:33:29.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:29.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:29.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:29.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:29.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.628+0000 7fd84fb25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:33:29.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.629+0000 7fd84fb25800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to be held by another RGW process; skipping for now 2024-09-14T11:33:29.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.630+0000 7fd701fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:29.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.633+0000 7fd84fb25800 20 remove_watcher() i=0 2024-09-14T11:33:29.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.633+0000 7fd84fb25800 2 removed watcher, disabling cache 2024-09-14T11:33:29.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.635+0000 7fd84fb25800 20 remove_watcher() i=1 2024-09-14T11:33:29.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.636+0000 7fd84fb25800 20 remove_watcher() i=2 2024-09-14T11:33:29.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.637+0000 7fd84fb25800 20 remove_watcher() i=3 2024-09-14T11:33:29.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.638+0000 7fd84fb25800 20 remove_watcher() i=4 2024-09-14T11:33:29.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.639+0000 7fd84fb25800 20 remove_watcher() i=5 2024-09-14T11:33:29.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.640+0000 7fd84fb25800 20 remove_watcher() i=6 2024-09-14T11:33:29.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:29.641+0000 7fd84fb25800 20 remove_watcher() i=7 2024-09-14T11:33:29.650 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:33:59.679 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:59.715 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:59.715 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:59.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.764+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.765+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.765+0000 7f02b1532800 20 realm 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.765+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.765+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.765+0000 7f02b1532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.765+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.766+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.766+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.767+0000 7f02b1532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:59.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.767+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.767+0000 7f02b1532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:59.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.767+0000 7f02b1532800 20 searching for the correct realm 2024-09-14T11:33:59.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.771+0000 7f02adab1640 0 -- 172.21.15.28:0/715250802 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f02a40bbd80 msgr2=0x7f02a40b52f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:59.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.775+0000 7f02ad2b0640 0 -- 172.21.15.28:0/715250802 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f02a40e9050 msgr2=0x7f02a40c6120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:33:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:33:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:59.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:59.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.983+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:59.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:59.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 zone default found 2024-09-14T11:33:59.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 4 Realm: () 2024-09-14T11:33:59.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 zonegroup default 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.984+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.985+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.985+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.985+0000 7f02b1532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.985+0000 7f02b1532800 20 started sync module instance, tier type = 2024-09-14T11:33:59.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.985+0000 7f02b1532800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:33:59.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=0 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=1 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=2 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=3 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=4 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=5 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.995+0000 7f02b1532800 20 add_watcher() i=6 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.997+0000 7f02b1532800 20 add_watcher() i=7 2024-09-14T11:33:59.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.997+0000 7f02b1532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:59.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f0163fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:59.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f02b1532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f02b1532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f02b1532800 5 note: GC not initialized 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f0162fe5640 20 reqs_thread_entry: start 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f02b1532800 20 init_complete bucket index max shards: 1 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:33:59.999+0000 7f02b1532800 20 Filter name: none 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f0160fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:33:59.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : miss 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 20 rados->read ofs=0 len=0 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.000+0000 7f02b1532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:59.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.001+0000 7f02b1532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:34:00.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.002+0000 7f02b1532800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:00.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.006+0000 7f02b1532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:34:00.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.006+0000 7f02b1532800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:34:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.006+0000 7f02b1532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.006+0000 7f02b1532800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34, ofs0, ns] 2024-09-14T11:34:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.007+0000 7f0190ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94024221714384 notifier 7037 bl.length()=911 2024-09-14T11:34:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.007+0000 7f0190ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:34:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.007+0000 7f0190ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:34:00.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.007+0000 7f0190ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:00.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.008+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_sources= new_sources= 2024-09-14T11:34:00.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.008+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential sources added=[] removed=[] 2024-09-14T11:34:00.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.008+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_dests= new_dests= 2024-09-14T11:34:00.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.008+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential dests added=[] removed=[] 2024-09-14T11:34:00.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.012+0000 7f02b1532800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34.2.0 2024-09-14T11:34:00.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.012+0000 7f02b1532800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34.2.0 2024-09-14T11:34:00.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.012+0000 7f02b1532800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34.2.1 2024-09-14T11:34:00.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.012+0000 7f02b1532800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34.2.1 2024-09-14T11:34:00.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.012+0000 7f02b1532800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34.0 2024-09-14T11:34:00.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.015+0000 7f02b1532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:00.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.015+0000 7f02b1532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:34:00.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.016+0000 7f02b1532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:34:00.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.016+0000 7f02b1532800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:34:00.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.016+0000 7f02b1532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:00.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.016+0000 7f02b1532800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34, ofs0, ns] 2024-09-14T11:34:00.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.017+0000 7f017ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94024221714384 notifier 7037 bl.length()=911 2024-09-14T11:34:00.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.017+0000 7f017ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:34:00.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.017+0000 7f017ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:34:00.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.017+0000 7f017ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:00.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.018+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_sources= new_sources= 2024-09-14T11:34:00.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.018+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential sources added=[] removed=[] 2024-09-14T11:34:00.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.018+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_dests= new_dests= 2024-09-14T11:34:00.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.018+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential dests added=[] removed=[] 2024-09-14T11:34:00.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.020+0000 7f02b1532800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34.0 2024-09-14T11:34:00.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.020+0000 7f02b1532800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:00.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.020+0000 7f02b1532800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f02b1532800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f02b1532800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f02b1532800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f02b1532800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34, ofs0, ns] 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f0190ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94024221714384 notifier 7037 bl.length()=879 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f0190ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 info.flags=0x17 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f0190ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 to cache LRU end 2024-09-14T11:34:00.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.022+0000 7f0190ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:00.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.023+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_sources= new_sources= 2024-09-14T11:34:00.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.023+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential sources added=[] removed=[] 2024-09-14T11:34:00.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.023+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): orig_dests= new_dests= 2024-09-14T11:34:00.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.023+0000 7f02b1532800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34]): potential dests added=[] removed=[] 2024-09-14T11:34:00.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.025+0000 7f02b1532800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-14T11:34:00.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.027+0000 7f0163fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:00.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.030+0000 7f02b1532800 20 remove_watcher() i=0 2024-09-14T11:34:00.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.030+0000 7f02b1532800 2 removed watcher, disabling cache 2024-09-14T11:34:00.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.031+0000 7f02b1532800 20 remove_watcher() i=1 2024-09-14T11:34:00.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.032+0000 7f02b1532800 20 remove_watcher() i=2 2024-09-14T11:34:00.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.033+0000 7f02b1532800 20 remove_watcher() i=3 2024-09-14T11:34:00.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.034+0000 7f02b1532800 20 remove_watcher() i=4 2024-09-14T11:34:00.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.035+0000 7f02b1532800 20 remove_watcher() i=5 2024-09-14T11:34:00.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.036+0000 7f02b1532800 20 remove_watcher() i=6 2024-09-14T11:34:00.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.038+0000 7f02b1532800 20 remove_watcher() i=7 2024-09-14T11:34:00.049 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:34:00.079 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:00.079 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:00.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.121+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 realm 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.123+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.124+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:00.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.124+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.125+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:00.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.125+0000 7fc5bf810800 20 searching for the correct realm 2024-09-14T11:34:00.126 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.128+0000 7fc5ba819640 0 -- 172.21.15.28:0/1408062292 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x56022dd0bf40 msgr2=0x56022dd0e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:00.130 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.132+0000 7fc5ba819640 0 -- 172.21.15.28:0/1408062292 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fc5ac045030 msgr2=0x7fc5ac045920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:00.134 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:00.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.136+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 zone default found 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 4 Realm: () 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 zonegroup default 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:00.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 started sync module instance, tier type = 2024-09-14T11:34:00.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.137+0000 7fc5bf810800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:00.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=0 2024-09-14T11:34:00.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=1 2024-09-14T11:34:00.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=2 2024-09-14T11:34:00.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=3 2024-09-14T11:34:00.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=4 2024-09-14T11:34:00.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=5 2024-09-14T11:34:00.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.146+0000 7fc5bf810800 20 add_watcher() i=6 2024-09-14T11:34:00.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.147+0000 7fc5bf810800 20 add_watcher() i=7 2024-09-14T11:34:00.145 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.147+0000 7fc5bf810800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:00.146 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:00.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc5bf810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:00.147 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc5bf810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc5bf810800 5 note: GC not initialized 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc470fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc5bf810800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.149+0000 7fc5bf810800 20 Filter name: none 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.150+0000 7fc3ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.150+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.150+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:34:00.148 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.150+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.151+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:34:00.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.151+0000 7fc5bf810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:00.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.151+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.151+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:34:00.149 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.151+0000 7fc5bf810800 20 rados->read ofs=0 len=0 2024-09-14T11:34:00.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.152+0000 7fc5bf810800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:34:00.150 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.152+0000 7fc5bf810800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:00.151 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.153+0000 7fc471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:00.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.155+0000 7fc5bf810800 20 remove_watcher() i=0 2024-09-14T11:34:00.153 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.155+0000 7fc5bf810800 2 removed watcher, disabling cache 2024-09-14T11:34:00.154 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.156+0000 7fc5bf810800 20 remove_watcher() i=1 2024-09-14T11:34:00.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.157+0000 7fc5bf810800 20 remove_watcher() i=2 2024-09-14T11:34:00.156 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.158+0000 7fc5bf810800 20 remove_watcher() i=3 2024-09-14T11:34:00.157 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.160+0000 7fc5bf810800 20 remove_watcher() i=4 2024-09-14T11:34:00.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.161+0000 7fc5bf810800 20 remove_watcher() i=5 2024-09-14T11:34:00.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.162+0000 7fc5bf810800 20 remove_watcher() i=6 2024-09-14T11:34:00.160 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:00.162+0000 7fc5bf810800 20 remove_watcher() i=7 2024-09-14T11:34:00.171 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:00.172 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:00.172 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-do-reshard id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:34:00.172 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:00.481 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:34:00.482 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:01.332 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:34:01.361 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:01.361 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:01.401 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.403+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.405+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.405+0000 7f8ec0e87800 20 realm 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.405+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.405+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.405+0000 7f8ec0e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.405+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.406+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.406+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.404 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.406+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:01.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.406+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.407+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:01.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.407+0000 7f8ec0e87800 20 searching for the correct realm 2024-09-14T11:34:01.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.409+0000 7f8eb6170640 0 -- 172.21.15.28:0/1449899087 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f8eb0033030 msgr2=0x7f8eb0068790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:01.411 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.413+0000 7f8ebe971640 0 -- 172.21.15.28:0/1449899087 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f8ea80c8230 msgr2=0x7f8ea80af970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:01.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:01.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.620+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 zone default found 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 4 Realm: () 2024-09-14T11:34:01.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 zonegroup default 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.621+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.622+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.622+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.622+0000 7f8ec0e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.622+0000 7f8ec0e87800 20 started sync module instance, tier type = 2024-09-14T11:34:01.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.622+0000 7f8ec0e87800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:01.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=0 2024-09-14T11:34:01.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=1 2024-09-14T11:34:01.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=2 2024-09-14T11:34:01.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=3 2024-09-14T11:34:01.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=4 2024-09-14T11:34:01.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=5 2024-09-14T11:34:01.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.631+0000 7f8ec0e87800 20 add_watcher() i=6 2024-09-14T11:34:01.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.632+0000 7f8ec0e87800 20 add_watcher() i=7 2024-09-14T11:34:01.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.632+0000 7f8ec0e87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.634+0000 7f8d757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.634+0000 7f8ec0e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.634+0000 7f8ec0e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.634+0000 7f8ec0e87800 5 note: GC not initialized 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.634+0000 7f8ceffff640 20 reqs_thread_entry: start 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.634+0000 7f8ec0e87800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.635+0000 7f8ec0e87800 20 Filter name: none 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.635+0000 7f8cedffb640 20 reqs_thread_entry: start 2024-09-14T11:34:01.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.635+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.635+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:01.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.636+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.636+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:01.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.636+0000 7f8ec0e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:01.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.636+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.637+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:01.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.637+0000 7f8ec0e87800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.637+0000 7f8ec0e87800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:01.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.637+0000 7f8ec0e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:01.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.639+0000 7f8d757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:01.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.641+0000 7f8ec0e87800 20 remove_watcher() i=0 2024-09-14T11:34:01.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.641+0000 7f8ec0e87800 2 removed watcher, disabling cache 2024-09-14T11:34:01.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.642+0000 7f8ec0e87800 20 remove_watcher() i=1 2024-09-14T11:34:01.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.642+0000 7f8ec0e87800 20 remove_watcher() i=2 2024-09-14T11:34:01.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.643+0000 7f8ec0e87800 20 remove_watcher() i=3 2024-09-14T11:34:01.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.645+0000 7f8ec0e87800 20 remove_watcher() i=4 2024-09-14T11:34:01.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.645+0000 7f8ec0e87800 20 remove_watcher() i=5 2024-09-14T11:34:01.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.646+0000 7f8ec0e87800 20 remove_watcher() i=6 2024-09-14T11:34:01.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.648+0000 7f8ec0e87800 20 remove_watcher() i=7 2024-09-14T11:34:01.656 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:01.657 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:01.657 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-logrecord-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:01.657 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:01.658 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:34:01.693 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:01.693 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:01.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.734+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 realm 2024-09-14T11:34:01.733 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:01.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.735+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.736+0000 7fc1599af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:01.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.736+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.736+0000 7fc1599af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:01.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.736+0000 7fc1599af800 20 searching for the correct realm 2024-09-14T11:34:01.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.740+0000 7fc157c9a640 0 -- 172.21.15.28:0/28238879 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fc14c01e020 msgr2=0x7fc14c017460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:01.741 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.743+0000 7fc157499640 0 -- 172.21.15.28:0/28238879 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fc14c06cb50 msgr2=0x7fc14c06ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.950+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 zone default found 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 4 Realm: () 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 zonegroup default 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.951+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:01.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 started sync module instance, tier type = 2024-09-14T11:34:01.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.952+0000 7fc1599af800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:01.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=0 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=1 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=2 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=3 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=4 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=5 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.961+0000 7fc1599af800 20 add_watcher() i=6 2024-09-14T11:34:01.960 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.962+0000 7fc1599af800 20 add_watcher() i=7 2024-09-14T11:34:01.961 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.962+0000 7fc1599af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:01.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.964+0000 7fc00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:01.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:01.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:01.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 5 note: GC not initialized 2024-09-14T11:34:01.963 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc00cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:01.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:01.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 20 Filter name: none 2024-09-14T11:34:01.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fbf867fc640 20 reqs_thread_entry: start 2024-09-14T11:34:01.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:34:01.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.965+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 : miss 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:01.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:01.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.966+0000 7fc1599af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 2024-09-14T11:34:01.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc1599af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc1599af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc1599af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc1599af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35, ofs0, ns] 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc03affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94004430790384 notifier 7575 bl.length()=923 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc03affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc03affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:01.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.970+0000 7fc03affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:01.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.972+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_sources= new_sources= 2024-09-14T11:34:01.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.972+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential sources added=[] removed=[] 2024-09-14T11:34:01.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.972+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_dests= new_dests= 2024-09-14T11:34:01.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.972+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential dests added=[] removed=[] 2024-09-14T11:34:01.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.973+0000 7fc1599af800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:34:01.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.973+0000 7fc1599af800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:34:01.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.976+0000 7fc1599af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:01.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.976+0000 7fc1599af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 2024-09-14T11:34:01.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc1599af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:01.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc1599af800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc1599af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc1599af800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35, ofs0, ns] 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94004430790384 notifier 7575 bl.length()=891 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc03a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc03a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:01.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.977+0000 7fc03a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:01.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.979+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_sources= new_sources= 2024-09-14T11:34:01.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.979+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential sources added=[] removed=[] 2024-09-14T11:34:01.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.979+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_dests= new_dests= 2024-09-14T11:34:01.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.979+0000 7fc1599af800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential dests added=[] removed=[] 2024-09-14T11:34:01.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.981+0000 7fc00dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:01.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.984+0000 7fc1599af800 20 remove_watcher() i=0 2024-09-14T11:34:01.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.984+0000 7fc1599af800 2 removed watcher, disabling cache 2024-09-14T11:34:01.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.985+0000 7fc1599af800 20 remove_watcher() i=1 2024-09-14T11:34:01.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.986+0000 7fc1599af800 20 remove_watcher() i=2 2024-09-14T11:34:01.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.987+0000 7fc1599af800 20 remove_watcher() i=3 2024-09-14T11:34:01.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.988+0000 7fc1599af800 20 remove_watcher() i=4 2024-09-14T11:34:01.987 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.989+0000 7fc1599af800 20 remove_watcher() i=5 2024-09-14T11:34:01.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.990+0000 7fc1599af800 20 remove_watcher() i=6 2024-09-14T11:34:01.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:01.991+0000 7fc1599af800 20 remove_watcher() i=7 2024-09-14T11:34:02.001 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:34:02.030 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:02.030 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:02.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.071+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 realm 2024-09-14T11:34:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.073+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.074+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.074+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.074+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:02.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.074+0000 7fcad0932800 20 searching for the correct realm 2024-09-14T11:34:02.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.078+0000 7fcacbeaf640 0 -- 172.21.15.28:0/1229016245 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55bd3a90c1e0 msgr2=0x55bd3a90e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.081+0000 7fcacc6b0640 0 -- 172.21.15.28:0/1229016245 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fcac008fc50 msgr2=0x7fcac0092040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.085+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 zone default found 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 4 Realm: () 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 zonegroup default 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.086+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.087+0000 7fcad0932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.087+0000 7fcad0932800 20 started sync module instance, tier type = 2024-09-14T11:34:02.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.087+0000 7fcad0932800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=0 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=1 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=2 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=3 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=4 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=5 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.095+0000 7fcad0932800 20 add_watcher() i=6 2024-09-14T11:34:02.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.096+0000 7fcad0932800 20 add_watcher() i=7 2024-09-14T11:34:02.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.096+0000 7fcad0932800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.098+0000 7fc982fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.098+0000 7fcad0932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.098+0000 7fcad0932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.098+0000 7fcad0932800 5 note: GC not initialized 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.098+0000 7fc981fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.098+0000 7fcad0932800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.099+0000 7fcad0932800 20 Filter name: none 2024-09-14T11:34:02.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.099+0000 7fc8f37fe640 20 reqs_thread_entry: start 2024-09-14T11:34:02.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.099+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.099+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.099+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.100+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.100+0000 7fcad0932800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.100+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.100+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.100+0000 7fcad0932800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.101+0000 7fcad0932800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:02.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.101+0000 7fcad0932800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:02.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.102+0000 7fc982fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.104+0000 7fcad0932800 20 remove_watcher() i=0 2024-09-14T11:34:02.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.104+0000 7fcad0932800 2 removed watcher, disabling cache 2024-09-14T11:34:02.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.105+0000 7fcad0932800 20 remove_watcher() i=1 2024-09-14T11:34:02.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.106+0000 7fcad0932800 20 remove_watcher() i=2 2024-09-14T11:34:02.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.107+0000 7fcad0932800 20 remove_watcher() i=3 2024-09-14T11:34:02.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.108+0000 7fcad0932800 20 remove_watcher() i=4 2024-09-14T11:34:02.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.109+0000 7fcad0932800 20 remove_watcher() i=5 2024-09-14T11:34:02.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.110+0000 7fcad0932800 20 remove_watcher() i=6 2024-09-14T11:34:02.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.111+0000 7fcad0932800 20 remove_watcher() i=7 2024-09-14T11:34:02.120 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:02.120 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:02.120 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-logrecord-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:02.120 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:02.214 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:02.246 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:02.246 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:02.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.287+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 realm 2024-09-14T11:34:02.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.289+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.290+0000 7fe43e519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.290+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.290+0000 7fe43e519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:02.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.290+0000 7fe43e519800 20 searching for the correct realm 2024-09-14T11:34:02.291 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.293+0000 7fe43b809640 0 -- 172.21.15.28:0/3174671194 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fe42c09e070 msgr2=0x7fe42c0aa960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.297+0000 7fe43c00a640 0 -- 172.21.15.28:0/3174671194 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fe430001c20 msgr2=0x7fe43001f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.504+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 zone default found 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 4 Realm: () 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 zonegroup default 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.505+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.506+0000 7fe43e519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.506+0000 7fe43e519800 20 started sync module instance, tier type = 2024-09-14T11:34:02.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.506+0000 7fe43e519800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=0 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=1 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=2 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=3 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=4 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=5 2024-09-14T11:34:02.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.515+0000 7fe43e519800 20 add_watcher() i=6 2024-09-14T11:34:02.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.516+0000 7fe43e519800 20 add_watcher() i=7 2024-09-14T11:34:02.514 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.516+0000 7fe43e519800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:02.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.517+0000 7fe2f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 5 note: GC not initialized 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe2f1fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 20 Filter name: none 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe2637fe640 20 reqs_thread_entry: start 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:34:02.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.518+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 : miss 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.518 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:02.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.519+0000 7fe43e519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.523+0000 7fe43e519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.523+0000 7fe43e519800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.523+0000 7fe43e519800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.523+0000 7fe43e519800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35, ofs0, ns] 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.524+0000 7fe3137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 94028291881920 notifier 7124 bl.length()=923 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.524+0000 7fe3137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.524+0000 7fe3137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.524+0000 7fe3137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.525+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_sources= new_sources= 2024-09-14T11:34:02.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.525+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential sources added=[] removed=[] 2024-09-14T11:34:02.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.525+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_dests= new_dests= 2024-09-14T11:34:02.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.525+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential dests added=[] removed=[] 2024-09-14T11:34:02.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.527+0000 7fe43e519800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35.1.0 2024-09-14T11:34:02.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.527+0000 7fe43e519800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35.1.0 2024-09-14T11:34:02.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.527+0000 7fe43e519800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35.1.1 2024-09-14T11:34:02.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.527+0000 7fe43e519800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35.1.1 2024-09-14T11:34:02.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.527+0000 7fe43e519800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35.0 2024-09-14T11:34:02.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.529+0000 7fe43e519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:02.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.529+0000 7fe43e519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 2024-09-14T11:34:02.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe43e519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe43e519800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe43e519800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe43e519800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35, ofs0, ns] 2024-09-14T11:34:02.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe3137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94028291881920 notifier 7124 bl.length()=923 2024-09-14T11:34:02.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe3137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe3137fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.531+0000 7fe3137fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.532+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_sources= new_sources= 2024-09-14T11:34:02.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.532+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential sources added=[] removed=[] 2024-09-14T11:34:02.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.532+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_dests= new_dests= 2024-09-14T11:34:02.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.532+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential dests added=[] removed=[] 2024-09-14T11:34:02.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.533+0000 7fe43e519800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35.0 2024-09-14T11:34:02.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.534+0000 7fe43e519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:02.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.534+0000 7fe43e519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 2024-09-14T11:34:02.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.535+0000 7fe43e519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.535+0000 7fe43e519800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.535+0000 7fe43e519800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.535+0000 7fe43e519800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35, ofs0, ns] 2024-09-14T11:34:02.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.536+0000 7fe312ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94028291881920 notifier 7124 bl.length()=891 2024-09-14T11:34:02.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.536+0000 7fe312ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 info.flags=0x17 2024-09-14T11:34:02.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.536+0000 7fe312ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 to cache LRU end 2024-09-14T11:34:02.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.536+0000 7fe312ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:02.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.537+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_sources= new_sources= 2024-09-14T11:34:02.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.537+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential sources added=[] removed=[] 2024-09-14T11:34:02.535 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.537+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): orig_dests= new_dests= 2024-09-14T11:34:02.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.537+0000 7fe43e519800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35]): potential dests added=[] removed=[] 2024-09-14T11:34:02.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.538+0000 7fe43e519800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:34:02.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.540+0000 7fe2f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:02.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.542+0000 7fe43e519800 20 remove_watcher() i=0 2024-09-14T11:34:02.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.542+0000 7fe43e519800 2 removed watcher, disabling cache 2024-09-14T11:34:02.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.543+0000 7fe43e519800 20 remove_watcher() i=1 2024-09-14T11:34:02.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.544+0000 7fe43e519800 20 remove_watcher() i=2 2024-09-14T11:34:02.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.545+0000 7fe43e519800 20 remove_watcher() i=3 2024-09-14T11:34:02.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.546+0000 7fe43e519800 20 remove_watcher() i=4 2024-09-14T11:34:02.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.547+0000 7fe43e519800 20 remove_watcher() i=5 2024-09-14T11:34:02.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.548+0000 7fe43e519800 20 remove_watcher() i=6 2024-09-14T11:34:02.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.549+0000 7fe43e519800 20 remove_watcher() i=7 2024-09-14T11:34:02.559 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:34:02.589 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:02.589 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:02.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.630+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.632+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.632+0000 7f1405133800 20 realm 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.632+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.632+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.632+0000 7f1405133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.632+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.633+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:02.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.633+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.633+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:02.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.633+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:02.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.634+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:02.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.634+0000 7f1405133800 20 searching for the correct realm 2024-09-14T11:34:02.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.636+0000 7f1400675640 0 -- 172.21.15.28:0/3000087095 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f13f003c050 msgr2=0x7f13f0016430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:02.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:02.841+0000 7f1400e76640 0 -- 172.21.15.28:0/3000087095 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f13f40ae450 msgr2=0x7f13f40818a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:03.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.048+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 zone default found 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 4 Realm: () 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:03.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 zonegroup default 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.049+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.050+0000 7f1405133800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.050+0000 7f1405133800 20 started sync module instance, tier type = 2024-09-14T11:34:03.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.050+0000 7f1405133800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=0 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=1 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=2 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=3 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=4 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=5 2024-09-14T11:34:03.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.058+0000 7f1405133800 20 add_watcher() i=6 2024-09-14T11:34:03.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.059+0000 7f1405133800 20 add_watcher() i=7 2024-09-14T11:34:03.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.059+0000 7f1405133800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:03.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.061+0000 7f12b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:03.060 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f1405133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f1405133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f1405133800 5 note: GC not initialized 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f12b5fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f1405133800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f1405133800 20 Filter name: none 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f12277fe640 20 reqs_thread_entry: start 2024-09-14T11:34:03.061 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.062+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.063+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.063+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.063+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.064+0000 7f1405133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.064+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.064+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.064+0000 7f1405133800 20 rados->read ofs=0 len=0 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.064+0000 7f1405133800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:03.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.064+0000 7f1405133800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:03.064 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.066+0000 7f12b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:03.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.068+0000 7f1405133800 20 remove_watcher() i=0 2024-09-14T11:34:03.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.068+0000 7f1405133800 2 removed watcher, disabling cache 2024-09-14T11:34:03.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.069+0000 7f1405133800 20 remove_watcher() i=1 2024-09-14T11:34:03.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.070+0000 7f1405133800 20 remove_watcher() i=2 2024-09-14T11:34:03.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.071+0000 7f1405133800 20 remove_watcher() i=3 2024-09-14T11:34:03.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.072+0000 7f1405133800 20 remove_watcher() i=4 2024-09-14T11:34:03.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.073+0000 7f1405133800 20 remove_watcher() i=5 2024-09-14T11:34:03.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.074+0000 7f1405133800 20 remove_watcher() i=6 2024-09-14T11:34:03.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:03.075+0000 7f1405133800 20 remove_watcher() i=7 2024-09-14T11:34:03.084 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:03.084 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-logrecord-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:34:03.085 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:03.398 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:34:03.398 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.258 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:34:04.287 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:04.287 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:04.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.328+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 realm 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.330+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.331+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:04.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.331+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.331+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:04.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.331+0000 7f5909f75800 20 searching for the correct realm 2024-09-14T11:34:04.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.334+0000 7f590725e640 0 -- 172.21.15.28:0/830044500 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f58f808d070 msgr2=0x7f58f80671f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:04.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.337+0000 7f5907a5f640 0 -- 172.21.15.28:0/830044500 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f58fc051040 msgr2=0x7f58fc02ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:04.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.543+0000 7f5909f75800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:04.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.543+0000 7f5909f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:04.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.543+0000 7f5909f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:04.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.543+0000 7f5909f75800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:04.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.543+0000 7f5909f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:04.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.543+0000 7f5909f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:04.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.544+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.544+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.544+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.544+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:04.543 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.544+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.544+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 zone default found 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 4 Realm: () 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:04.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 zonegroup default 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 started sync module instance, tier type = 2024-09-14T11:34:04.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.545+0000 7f5909f75800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:04.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=0 2024-09-14T11:34:04.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=1 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=2 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=3 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=4 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=5 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.554+0000 7f5909f75800 20 add_watcher() i=6 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.555+0000 7f5909f75800 20 add_watcher() i=7 2024-09-14T11:34:04.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.555+0000 7f5909f75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:04.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.557+0000 7f57bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.557+0000 7f5909f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.557+0000 7f5909f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.557+0000 7f5909f75800 5 note: GC not initialized 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.557+0000 7f57bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.558+0000 7f5909f75800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.558+0000 7f5909f75800 20 Filter name: none 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.558+0000 7f57367fc640 20 reqs_thread_entry: start 2024-09-14T11:34:04.556 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.558+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.558+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.558+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.559+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.559+0000 7f5909f75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.559+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.559+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.559+0000 7f5909f75800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.560+0000 7f5909f75800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.560+0000 7f5909f75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:04.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.561+0000 7f57bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:04.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.563+0000 7f5909f75800 20 remove_watcher() i=0 2024-09-14T11:34:04.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.563+0000 7f5909f75800 2 removed watcher, disabling cache 2024-09-14T11:34:04.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.564+0000 7f5909f75800 20 remove_watcher() i=1 2024-09-14T11:34:04.563 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.565+0000 7f5909f75800 20 remove_watcher() i=2 2024-09-14T11:34:04.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.566+0000 7f5909f75800 20 remove_watcher() i=3 2024-09-14T11:34:04.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.567+0000 7f5909f75800 20 remove_watcher() i=4 2024-09-14T11:34:04.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.568+0000 7f5909f75800 20 remove_watcher() i=5 2024-09-14T11:34:04.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.569+0000 7f5909f75800 20 remove_watcher() i=6 2024-09-14T11:34:04.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.570+0000 7f5909f75800 20 remove_watcher() i=7 2024-09-14T11:34:04.578 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.579 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:04.579 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-logrecord-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:04.579 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.580 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:34:04.615 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:04.615 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:04.654 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.656+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.657+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.657+0000 7f12dbc10800 20 realm 2024-09-14T11:34:04.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.657+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.658+0000 7f12dbc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:04.656 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:04.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:04.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.659+0000 7f12dbc10800 20 searching for the correct realm 2024-09-14T11:34:04.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.662+0000 7f12d7bbd640 0 -- 172.21.15.28:0/1082552743 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f12cc059930 msgr2=0x7f12cc0aaff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:04.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.665+0000 7f12d73bc640 0 -- 172.21.15.28:0/1082552743 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f12cc0e9a40 msgr2=0x7f12cc09fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:04.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:04.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:04.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:04.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:04.869 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:04.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:04.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:04.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.871 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 zone default found 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 4 Realm: () 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 zonegroup default 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.872 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.873+0000 7f12dbc10800 20 started sync module instance, tier type = 2024-09-14T11:34:04.873 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.873+0000 7f12dbc10800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:04.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=0 2024-09-14T11:34:04.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=1 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=2 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=3 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=4 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=5 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=6 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.883+0000 7f12dbc10800 20 add_watcher() i=7 2024-09-14T11:34:04.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.883+0000 7f12dbc10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.885+0000 7f118dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.885+0000 7f12dbc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.885+0000 7f12dbc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.885+0000 7f12dbc10800 5 note: GC not initialized 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.885+0000 7f118cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.885+0000 7f12dbc10800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 20 Filter name: none 2024-09-14T11:34:04.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f11067fc640 20 reqs_thread_entry: start 2024-09-14T11:34:04.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:34:04.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:04.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : miss 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.887+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.887+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.887+0000 7f12dbc10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.887+0000 7f12dbc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.887+0000 7f12dbc10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:04.886 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.887+0000 7f12dbc10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.890+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.890+0000 7f12dbc10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.890+0000 7f12dbc10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.890+0000 7f12dbc10800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36, ofs0, ns] 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 94687971083328 notifier 7665 bl.length()=923 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:04.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_sources= new_sources= 2024-09-14T11:34:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential sources added=[] removed=[] 2024-09-14T11:34:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_dests= new_dests= 2024-09-14T11:34:04.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential dests added=[] removed=[] 2024-09-14T11:34:04.892 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12dbc10800 time 2024-09-14T11:34:04.894839+0000 2024-09-14T11:34:04.892 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:04.892 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f12dcd8c76a] 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.894+0000 7f12dbc10800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12dbc10800 time 2024-09-14T11:34:04.894839+0000 2024-09-14T11:34:04.893 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f12dcd8c76a] 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:04.894 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.895 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:04.895 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f12dbc10800 thread_name:radosgw-admin 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f12dba3e6f0] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f12dba8b99c] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f12dcd8c7c4] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:04.915 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.895+0000 7f12dbc10800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f12dbc10800 thread_name:radosgw-admin 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f12dba3e6f0] 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f12dba8b99c] 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f12dcd8c7c4] 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:04.916 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 asok(0x561e42afa270) unregister_commands rotate-key 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:34:04.639+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:34:04.639+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.917 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding auth protocol: cephx 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding auth protocol: cephx 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding auth protocol: cephx 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.918 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:34:04.639+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: starting msgr at 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: starting objecter 2024-09-14T11:34:04.919 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command objecter_requests hook 0x561e42d4b6a0 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: setting wanted keys 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: calling monclient init 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:34:04.639+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding auth protocol: cephx 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding auth protocol: cephx 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding auth protocol: cephx 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.920 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:34:04.640+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:34:04.640+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:34:04.640+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key hook 0x561e42d196e8 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42bc67e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42c5c760 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42c62750 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.921 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.281493s 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42bc67e0 auth_method 0 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42c62750 auth_method 0 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.922 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42c5c760 auth_method 0 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_done global_id 7166 payload 824 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:34:04.640+0000 7f12d73bc640 1 monclient: found mon.noname-c 2024-09-14T11:34:04.923 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: dump: 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.924 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: dump: 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.925 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:34:04.641+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7166 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:34:04.641+0000 7f11c560a640 4 set_mon_vals no callback set 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:34:04.641+0000 7f12dbc10800 1 librados: init done 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:34:04.643+0000 7f11c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:34:04.643+0000 7f11c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:34:04.643+0000 7f11c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:34:04.643+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x7f11bc077230 auth_method 0 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:34:04.643+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x561e42d5b530 auth_method 0 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:34:04.644+0000 7f12d73bc640 10 monclient: get_auth_request con 0x561e42d64d00 auth_method 0 2024-09-14T11:34:04.926 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:34:04.646+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x561e42d685d0 auth_method 0 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:34:04.646+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:34:04.646+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:34:04.646+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.927 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding auth protocol: cephx 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding auth protocol: cephx 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding auth protocol: cephx 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.928 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:34:04.647+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command objecter_requests cmddesc objecter_requests hook 0x561e42d71470 EEXIST 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:34:04.647+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding auth protocol: cephx 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding auth protocol: cephx 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding auth protocol: cephx 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.929 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:34:04.647+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:34:04.647+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:34:04.648+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key cmddesc rotate-key hook 0x561e42d6d020 EEXIST 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42d9b600 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42d96080 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42d96c50 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.930 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.289093s 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42d96080 auth_method 0 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42d96c50 auth_method 0 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.931 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42d9b600 auth_method 0 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_done global_id 7659 payload 824 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 1 monclient: found mon.noname-a 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: dump: 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.932 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: dump: 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.933 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:34:04.648+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7659 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:34:04.648+0000 7f12d83be640 4 set_mon_vals no callback set 2024-09-14T11:34:04.934 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:34:04.650+0000 7f11c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:34:04.650+0000 7f11c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:34:04.650+0000 7f11c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:34:04.651+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f11b0077170 auth_method 0 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: get_monmap_and_config 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:34:04.651+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.935 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding auth protocol: cephx 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding auth protocol: cephx 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding auth protocol: cephx 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.936 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:34:04.651+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding auth protocol: cephx 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding auth protocol: cephx 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding auth protocol: cephx 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.937 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:34:04.651+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:34:04.651+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:34:04.652+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key cmddesc rotate-key hook 0x7ffd513f7f08 EEXIST 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42deabc0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42deafa0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42df06d0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.938 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.293107s 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42deabc0 auth_method 0 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42df06d0 auth_method 0 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.939 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42deafa0 auth_method 0 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_done global_id 7172 payload 274 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:34:04.652+0000 7f12d73bc640 1 monclient: found mon.noname-c 2024-09-14T11:34:04.940 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: dump: 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.941 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:34:04.652+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7172 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:34:04.652+0000 7f12dbc10800 4 set_mon_vals no callback set 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: dump: 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.942 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: shutdown 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.943 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding auth protocol: cephx 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding auth protocol: cephx 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding auth protocol: cephx 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.944 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:34:04.653+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: starting msgr at 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: starting objecter 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command objecter_requests cmddesc objecter_requests hook 0x561e42dbab00 EEXIST 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: setting wanted keys 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: calling monclient init 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding auth protocol: cephx 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding auth protocol: cephx 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding auth protocol: cephx 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.945 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:34:04.653+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:34:04.654+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:34:04.654+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key cmddesc rotate-key hook 0x561e42ba40f8 EEXIST 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42deabc0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.946 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42df06d0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42de1980 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.295299s 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42df06d0 auth_method 0 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42deabc0 auth_method 0 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.947 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42de1980 auth_method 0 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_done global_id 7665 payload 824 2024-09-14T11:34:04.948 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 1 monclient: found mon.noname-a 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: dump: 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.949 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:34:04.654+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7665 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: dump: 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.950 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:34:04.655+0000 7f11baffd640 4 set_mon_vals no callback set 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:34:04.655+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:34:04.655+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:34:04.655+0000 7f12dbc10800 1 librados: init done 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:34:04.655+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cr dump hook 0x561e42db7168 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:34:04.656+0000 7f11b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:34:04.656+0000 7f11b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:34:04.656+0000 7f11b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:34:04.656+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:34:04.657+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f11a0077260 auth_method 0 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:34:04.657+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x561e42e04f10 auth_method 0 2024-09-14T11:34:04.951 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:34:04.657+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:34:04.657+0000 7f12dbc10800 20 realm 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:34:04.657+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:34:04.658+0000 7f12dbc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:34:04.658+0000 7f12d73bc640 10 monclient: get_auth_request con 0x561e42e09210 auth_method 0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 searching for the correct realm 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:34:04.659+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x561e42e0e370 auth_method 0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:34:04.660+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x7f12cc059930 auth_method 0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:34:04.660+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f12d0026040 auth_method 0 2024-09-14T11:34:04.952 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:34:04.661+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x7f12c8024070 auth_method 0 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:34:04.662+0000 7f12d7bbd640 0 -- 172.21.15.28:0/1082552743 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f12cc059930 msgr2=0x7f12cc0aaff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:34:04.662+0000 7f11b97fa640 1 client.7665.objecter ms_handle_reset 0x7f12cc059930 session 0x7f12cc005040 osd.7 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:34:04.662+0000 7f11b97fa640 10 monclient: _renew_subs 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:34:04.662+0000 7f11b97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:34:04.662+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x7f11a0087990 auth_method 0 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:34:04.663+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x7f12cc0a0130 auth_method 0 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:34:04.665+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f12cc0e9a40 auth_method 0 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:34:04.665+0000 7f12d73bc640 0 -- 172.21.15.28:0/1082552743 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f12cc0e9a40 msgr2=0x7f12cc09fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:34:04.866+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f12cc0e9a40 auth_method 0 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:04.953 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 zone default found 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:34:04.872+0000 7f12dbc10800 4 Realm: () 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:34:04.872+0000 7f12dbc10800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:34:04.872+0000 7f12dbc10800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:34:04.872+0000 7f12dbc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 zonegroup default 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.954 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 started sync module instance, tier type = 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=0 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=1 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=2 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=3 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=4 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=5 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=6 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:34:04.883+0000 7f12dbc10800 20 add_watcher() i=7 2024-09-14T11:34:04.955 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:34:04.883+0000 7f12dbc10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding auth protocol: cephx 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding auth protocol: cephx 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding auth protocol: cephx 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:04.956 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:34:04.885+0000 7f118dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:34:04.885+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:34:04.885+0000 7f12dbc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:34:04.885+0000 7f12dbc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache list hook 0x561e42db96f0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache inspect hook 0x561e42db96f0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache erase hook 0x561e42db96f0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache zap hook 0x561e42db96f0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 note: GC not initialized 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:34:04.885+0000 7f118cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace show hook 0x7f12d00048c0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace history hook 0x7f12d00048c0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace active hook 0x7f12d00048c0 2024-09-14T11:34:04.957 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace active_short hook 0x7f12d00048c0 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:34:04.885+0000 7f12dbc10800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 Filter name: none 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:34:04.886+0000 7f11067fc640 20 reqs_thread_entry: start 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : miss 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:34:04.887+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:04.958 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36, ofs0, ns] 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 94687971083328 notifier 7665 bl.length()=923 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_sources= new_sources= 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential sources added=[] removed=[] 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_dests= new_dests= 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential dests added=[] removed=[] 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:34:04.894+0000 7f12dbc10800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12dbc10800 time 2024-09-14T11:34:04.894839+0000 2024-09-14T11:34:04.959 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f12dcd8c76a] 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:34:04.895+0000 7f12dbc10800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f12dbc10800 thread_name:radosgw-admin 2024-09-14T11:34:04.960 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f12dba3e6f0] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f12dba8b99c] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f12dcd8c7c4] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:04.961 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:34:04.962 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:34:04.963 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:34:04.964 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:34:04.965 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:04.966 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:04.967 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11067fc640 / http_manager 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f118cfe1640 / http_manager 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f118dfe3640 / rgw_dt_lg_renew 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11b97fa640 / ms_dispatch 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11baffd640 / io_context_pool 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11c1602640 / ms_dispatch 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11c3e07640 / ms_dispatch 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11c560a640 / io_context_pool 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d6bbb640 / msgr-worker-2 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d73bc640 / msgr-worker-1 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d7bbd640 / msgr-worker-0 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d83be640 / io_context_pool 2024-09-14T11:34:04.968 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12dbc10800 / radosgw-admin 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.132632.log 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 asok(0x561e42afa270) unregister_commands rotate-key 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:34:04.639+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:34:04.639+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.969 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding auth protocol: cephx 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding auth protocol: cephx 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding auth protocol: cephx 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.970 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: crc 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d1f170) adding con mode: secure 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:34:04.639+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: starting msgr at 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: starting objecter 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command objecter_requests hook 0x561e42d4b6a0 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: setting wanted keys 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:34:04.639+0000 7f12dbc10800 1 librados: calling monclient init 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:34:04.639+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding auth protocol: cephx 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding auth protocol: cephx 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding auth protocol: cephx 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.971 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: crc 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:34:04.639+0000 7f12dbc10800 5 AuthRegistry(0x561e42d195a0) adding con mode: secure 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:34:04.640+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:34:04.640+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:34:04.640+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key hook 0x561e42d196e8 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.972 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42bc67e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42c5c760 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42c62750 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:34:04.640+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.281493s 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42bc67e0 auth_method 0 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42c62750 auth_method 0 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.973 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42c5c760 auth_method 0 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:34:04.640+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:34:04.640+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient(hunting): handle_auth_done global_id 7166 payload 824 2024-09-14T11:34:04.974 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:34:04.640+0000 7f12d73bc640 1 monclient: found mon.noname-c 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:34:04.640+0000 7f12d73bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: dump: 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.975 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:34:04.641+0000 7f11c3e07640 10 monclient: dump: 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.976 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:34:04.641+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7166 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:34:04.641+0000 7f11c560a640 4 set_mon_vals no callback set 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:34:04.641+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:34:04.641+0000 7f12dbc10800 1 librados: init done 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:34:04.643+0000 7f11c3e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:34:04.643+0000 7f11c3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:34:04.643+0000 7f11c3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:34:04.643+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x7f11bc077230 auth_method 0 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:34:04.643+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x561e42d5b530 auth_method 0 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:34:04.644+0000 7f12d73bc640 10 monclient: get_auth_request con 0x561e42d64d00 auth_method 0 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:34:04.646+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x561e42d685d0 auth_method 0 2024-09-14T11:34:04.977 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:34:04.646+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:34:04.646+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:34:04.646+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding auth protocol: cephx 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding auth protocol: cephx 2024-09-14T11:34:04.978 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding auth protocol: cephx 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: crc 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6df20) adding con mode: secure 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:34:04.647+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command objecter_requests cmddesc objecter_requests hook 0x561e42d71470 EEXIST 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:34:04.647+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.979 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding auth protocol: cephx 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding auth protocol: cephx 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding auth protocol: cephx 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: crc 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:34:04.647+0000 7f12dbc10800 5 AuthRegistry(0x561e42d6ced8) adding con mode: secure 2024-09-14T11:34:04.980 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:34:04.647+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:34:04.647+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:34:04.648+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key cmddesc rotate-key hook 0x561e42d6d020 EEXIST 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42d9b600 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42d96080 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42d96c50 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.289093s 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42d96080 auth_method 0 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.981 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42d96c50 auth_method 0 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:34:04.648+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42d9b600 auth_method 0 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:34:04.648+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_done global_id 7659 payload 824 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.982 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 1 monclient: found mon.noname-a 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:34:04.648+0000 7f12d6bbb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: dump: 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.983 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:34:04.648+0000 7f11c1602640 10 monclient: dump: 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:34:04.648+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7659 2024-09-14T11:34:04.984 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:34:04.648+0000 7f12d83be640 4 set_mon_vals no callback set 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:34:04.648+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:34:04.650+0000 7f11c1602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:34:04.650+0000 7f11c1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:34:04.650+0000 7f11c1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:34:04.651+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f11b0077170 auth_method 0 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: get_monmap_and_config 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:34:04.651+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.985 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding auth protocol: cephx 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding auth protocol: cephx 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding auth protocol: cephx 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.986 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: crc 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x561e42db68d0) adding con mode: secure 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:34:04.651+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:34:04.651+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding auth protocol: cephx 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding auth protocol: cephx 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding auth protocol: cephx 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.987 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: crc 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:34:04.651+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f7dc0) adding con mode: secure 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:34:04.651+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:34:04.651+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:34:04.652+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key cmddesc rotate-key hook 0x7ffd513f7f08 EEXIST 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42deabc0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42deafa0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42df06d0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.988 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.293107s 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42deabc0 auth_method 0 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42df06d0 auth_method 0 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.989 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42deafa0 auth_method 0 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:34:04.652+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:34:04.652+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient(hunting): handle_auth_done global_id 7172 payload 274 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:34:04.652+0000 7f12d73bc640 1 monclient: found mon.noname-c 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:34:04.652+0000 7f12d73bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:04.990 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: dump: 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:34:04.652+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7172 2024-09-14T11:34:04.991 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:34:04.652+0000 7f12dbc10800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:34:04.652+0000 7f12dbc10800 4 set_mon_vals no callback set 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:34:04.652+0000 7f11baffd640 10 monclient: dump: 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.992 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: shutdown 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: build_initial_monmap 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 build_initial for_mkfs: 0 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: monmap: 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding auth protocol: cephx 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding auth protocol: cephx 2024-09-14T11:34:04.993 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding auth protocol: cephx 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: crc 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42dba350) adding con mode: secure 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:34:04.653+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: starting msgr at 2024-09-14T11:34:04.994 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: starting objecter 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command objecter_requests cmddesc objecter_requests hook 0x561e42dbab00 EEXIST 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: setting wanted keys 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:34:04.653+0000 7f12dbc10800 1 librados: calling monclient init 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:34:04.653+0000 7f12dbc10800 10 monclient: init 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding auth protocol: cephx 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding auth protocol: cephx 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding auth protocol: cephx 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.995 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: crc 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:34:04.653+0000 7f12dbc10800 5 AuthRegistry(0x561e42ba3fb0) adding con mode: secure 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:34:04.653+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:34:04.654+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:34:04.654+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command rotate-key cmddesc rotate-key hook 0x561e42ba40f8 EEXIST 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-c con 0x561e42deabc0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-a con 0x561e42df06d0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): picked mon.noname-b con 0x561e42de1980 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:04.996 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient(hunting): authenticate will time out at 2182.295299s 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request con 0x561e42df06d0 auth_method 0 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): get_auth_request con 0x561e42deabc0 auth_method 0 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request con 0x561e42de1980 auth_method 0 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.997 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:34:04.654+0000 7f12d73bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:34:04.654+0000 7f12d7bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient(hunting): handle_auth_done global_id 7665 payload 824 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 1 monclient: found mon.noname-a 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:34:04.654+0000 7f12d6bbb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: dump: 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:04.998 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:34:04.654+0000 7f11b97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:34:04.654+0000 7f12dbc10800 5 monclient: authenticate success, global_id 7665 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:34:04.654+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:04.999 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:34:04.655+0000 7f11b97fa640 10 monclient: dump: 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:34:04.655+0000 7f11baffd640 4 set_mon_vals no callback set 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:34:04.655+0000 7f12dbc10800 10 monclient: _renew_subs 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:34:04.655+0000 7f12dbc10800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:34:04.655+0000 7f12dbc10800 1 librados: init done 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:34:04.655+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cr dump hook 0x561e42db7168 2024-09-14T11:34:05.000 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:34:04.656+0000 7f11b97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:34:04.656+0000 7f11b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:34:04.656+0000 7f11b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:34:04.656+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:34:04.657+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f11a0077260 auth_method 0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:34:04.657+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x561e42e04f10 auth_method 0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:34:04.657+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:34:04.657+0000 7f12dbc10800 20 realm 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:34:04.657+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:34:04.658+0000 7f12dbc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:34:04.658+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:34:04.658+0000 7f12d73bc640 10 monclient: get_auth_request con 0x561e42e09210 auth_method 0 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.001 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:34:04.659+0000 7f12dbc10800 20 searching for the correct realm 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:34:04.659+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x561e42e0e370 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:34:04.660+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x7f12cc059930 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:34:04.660+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f12d0026040 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:34:04.661+0000 7f12d6bbb640 10 monclient: get_auth_request con 0x7f12c8024070 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:34:04.662+0000 7f12d7bbd640 0 -- 172.21.15.28:0/1082552743 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f12cc059930 msgr2=0x7f12cc0aaff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:34:04.662+0000 7f11b97fa640 1 client.7665.objecter ms_handle_reset 0x7f12cc059930 session 0x7f12cc005040 osd.7 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:34:04.662+0000 7f11b97fa640 10 monclient: _renew_subs 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:34:04.662+0000 7f11b97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:34:04.662+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x7f11a0087990 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:34:04.663+0000 7f12d7bbd640 10 monclient: get_auth_request con 0x7f12cc0a0130 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:34:04.665+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f12cc0e9a40 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:34:04.665+0000 7f12d73bc640 0 -- 172.21.15.28:0/1082552743 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f12cc0e9a40 msgr2=0x7f12cc09fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:34:04.866+0000 7f12d73bc640 10 monclient: get_auth_request con 0x7f12cc0e9a40 auth_method 0 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:05.002 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:34:04.871+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 zone default found 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:34:04.872+0000 7f12dbc10800 4 Realm: () 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:34:04.872+0000 7f12dbc10800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:34:04.872+0000 7f12dbc10800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:05.003 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:34:04.872+0000 7f12dbc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 zonegroup default 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:34:04.872+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 started sync module instance, tier type = 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:34:04.873+0000 7f12dbc10800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=0 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=1 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=2 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=3 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=4 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=5 2024-09-14T11:34:05.004 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:34:04.882+0000 7f12dbc10800 20 add_watcher() i=6 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:34:04.883+0000 7f12dbc10800 20 add_watcher() i=7 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:34:04.883+0000 7f12dbc10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding auth protocol: cephx 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding auth protocol: cephx 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding auth protocol: cephx 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: crc 2024-09-14T11:34:05.005 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 AuthRegistry(0x7ffd513f82a0) adding con mode: secure 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:34:04.885+0000 7f118dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:34:04.885+0000 7f12dbc10800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:34:04.885+0000 7f12dbc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:34:04.885+0000 7f12dbc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache list hook 0x561e42db96f0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache inspect hook 0x561e42db96f0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache erase hook 0x561e42db96f0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command cache zap hook 0x561e42db96f0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 note: GC not initialized 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:34:04.885+0000 7f118cfe1640 20 reqs_thread_entry: start 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace show hook 0x7f12d00048c0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace history hook 0x7f12d00048c0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace active hook 0x7f12d00048c0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:34:04.885+0000 7f12dbc10800 5 asok(0x561e42afa270) register_command sync trace active_short hook 0x7f12d00048c0 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:34:04.885+0000 7f12dbc10800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:05.006 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 Filter name: none 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:34:04.886+0000 7f11067fc640 20 reqs_thread_entry: start 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:34:04.886+0000 7f12dbc10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : miss 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:34:04.886+0000 7f12dbc10800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:34:04.887+0000 7f12dbc10800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:34:04.887+0000 7f12dbc10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:05.007 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:34:04.890+0000 7f12dbc10800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36, ofs0, ns] 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431564 cookie 94687971083328 notifier 7665 bl.length()=923 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:34:04.891+0000 7f11baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_sources= new_sources= 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential sources added=[] removed=[] 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_dests= new_dests= 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:34:04.892+0000 7f12dbc10800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential dests added=[] removed=[] 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:34:04.894+0000 7f12dbc10800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f12dbc10800 time 2024-09-14T11:34:04.894839+0000 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:05.008 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f12dcd8c76a] 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:34:04.895+0000 7f12dbc10800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f12dbc10800 thread_name:radosgw-admin 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:05.009 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f12dba3e6f0] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f12dba8b99c] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f12dcd8c7c4] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f12dcd8c928] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e41bcf0b1] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x561e420e307c] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561e41bdeefd] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f12dba29590] 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:34:05.010 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:34:05.011 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:34:05.012 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:05.013 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:34:05.014 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:05.015 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11067fc640 / http_manager 2024-09-14T11:34:05.016 INFO:tasks.workunit.client.0.smithi028.stderr: 7f118cfe1640 / http_manager 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f118dfe3640 / rgw_dt_lg_renew 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11b97fa640 / ms_dispatch 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11baffd640 / io_context_pool 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11c1602640 / ms_dispatch 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11c3e07640 / ms_dispatch 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f11c560a640 / io_context_pool 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d6bbb640 / msgr-worker-2 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d73bc640 / msgr-worker-1 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d7bbd640 / msgr-worker-0 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12d83be640 / io_context_pool 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: 7f12dbc10800 / radosgw-admin 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:04.896538Z_6898d1d7-8dd4-47ce-966b-2e0938def393/log 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:34:05.017 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.974+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.976+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.976+0000 7ff6cb3af800 20 realm 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.976+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.976+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.976+0000 7ff6cb3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.976+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.977+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.977+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.977+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.977+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.978+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:05.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:04.978+0000 7ff6cb3af800 20 searching for the correct realm 2024-09-14T11:34:05.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.183+0000 7ff6c96a1640 0 -- 172.21.15.28:0/746582595 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7ff6bc092be0 msgr2=0x7ff6bc08a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:05.184 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.187+0000 7ff6c8ea0640 0 -- 172.21.15.28:0/746582595 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ff6bc07b920 msgr2=0x7ff6bc062410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.393+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.394+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.394+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.394+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.394+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 zone default found 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 4 Realm: () 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 zonegroup default 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.395+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.396+0000 7ff6cb3af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.396+0000 7ff6cb3af800 20 started sync module instance, tier type = 2024-09-14T11:34:05.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.396+0000 7ff6cb3af800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.404+0000 7ff6cb3af800 20 add_watcher() i=0 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.404+0000 7ff6cb3af800 20 add_watcher() i=1 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.404+0000 7ff6cb3af800 20 add_watcher() i=2 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.405+0000 7ff6cb3af800 20 add_watcher() i=3 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.405+0000 7ff6cb3af800 20 add_watcher() i=4 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.405+0000 7ff6cb3af800 20 add_watcher() i=5 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.405+0000 7ff6cb3af800 20 add_watcher() i=6 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.406+0000 7ff6cb3af800 20 add_watcher() i=7 2024-09-14T11:34:05.403 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.406+0000 7ff6cb3af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:05.405 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff57f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:05.406 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff6cb3af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff6cb3af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff6cb3af800 5 note: GC not initialized 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff57e7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff6cb3af800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.408+0000 7ff6cb3af800 20 Filter name: none 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.409+0000 7ff5777fe640 20 reqs_thread_entry: start 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.409+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.407 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.409+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:05.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.409+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.410+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:34:05.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.410+0000 7ff6cb3af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:05.408 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.410+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.410+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:05.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.410+0000 7ff6cb3af800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.411+0000 7ff6cb3af800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:34:05.409 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.411+0000 7ff6cb3af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:05.410 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.412+0000 7ff57f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:05.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.414+0000 7ff6cb3af800 20 remove_watcher() i=0 2024-09-14T11:34:05.412 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.414+0000 7ff6cb3af800 2 removed watcher, disabling cache 2024-09-14T11:34:05.413 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.415+0000 7ff6cb3af800 20 remove_watcher() i=1 2024-09-14T11:34:05.414 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.416+0000 7ff6cb3af800 20 remove_watcher() i=2 2024-09-14T11:34:05.415 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.417+0000 7ff6cb3af800 20 remove_watcher() i=3 2024-09-14T11:34:05.416 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.418+0000 7ff6cb3af800 20 remove_watcher() i=4 2024-09-14T11:34:05.417 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.419+0000 7ff6cb3af800 20 remove_watcher() i=5 2024-09-14T11:34:05.418 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.421+0000 7ff6cb3af800 20 remove_watcher() i=6 2024-09-14T11:34:05.419 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.422+0000 7ff6cb3af800 20 remove_watcher() i=7 2024-09-14T11:34:05.431 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.431 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:05.431 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-logrecord-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:05.431 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:05.526 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:05.558 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:05.558 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:05.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.599+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.601+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.601+0000 7f9dd912c800 20 realm 2024-09-14T11:34:05.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.601+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.601+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.601+0000 7f9dd912c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:05.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.601+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.602+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:05.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.602+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.602+0000 7f9dd912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:05.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.602+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:05.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.603+0000 7f9dd912c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:05.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.603+0000 7f9dd912c800 20 searching for the correct realm 2024-09-14T11:34:05.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.606+0000 7f9dd453d640 0 -- 172.21.15.28:0/818150051 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9dc402b900 msgr2=0x7f9dc40453c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:05.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:05.811+0000 7f9dd4d3e640 0 -- 172.21.15.28:0/818150051 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9dc8003970 msgr2=0x7f9dc805aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:06.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.017+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 zone default found 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 4 Realm: () 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 zonegroup default 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.018+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 started sync module instance, tier type = 2024-09-14T11:34:06.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.019+0000 7f9dd912c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=0 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=1 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=2 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=3 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=4 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=5 2024-09-14T11:34:06.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.029+0000 7f9dd912c800 20 add_watcher() i=6 2024-09-14T11:34:06.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.030+0000 7f9dd912c800 20 add_watcher() i=7 2024-09-14T11:34:06.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.030+0000 7f9dd912c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:06.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9c8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9dd912c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9dd912c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9dd912c800 5 note: GC not initialized 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9c89fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9dd912c800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.032+0000 7f9dd912c800 20 Filter name: none 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9bfb7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:34:06.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:06.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:06.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:34:06.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : miss 2024-09-14T11:34:06.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.033+0000 7f9dd912c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.034+0000 7f9dd912c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:34:06.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.034+0000 7f9dd912c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:06.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.034+0000 7f9dd912c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:06.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.034+0000 7f9dd912c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:06.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.034+0000 7f9dd912c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:06.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.034+0000 7f9dd912c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:06.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.035+0000 7f9dd912c800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to be held by another RGW process; skipping for now 2024-09-14T11:34:06.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.036+0000 7f9c8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.038+0000 7f9dd912c800 20 remove_watcher() i=0 2024-09-14T11:34:06.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.038+0000 7f9dd912c800 2 removed watcher, disabling cache 2024-09-14T11:34:06.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.039+0000 7f9dd912c800 20 remove_watcher() i=1 2024-09-14T11:34:06.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.040+0000 7f9dd912c800 20 remove_watcher() i=2 2024-09-14T11:34:06.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.041+0000 7f9dd912c800 20 remove_watcher() i=3 2024-09-14T11:34:06.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.042+0000 7f9dd912c800 20 remove_watcher() i=4 2024-09-14T11:34:06.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.044+0000 7f9dd912c800 20 remove_watcher() i=5 2024-09-14T11:34:06.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.045+0000 7f9dd912c800 20 remove_watcher() i=6 2024-09-14T11:34:06.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:06.046+0000 7f9dd912c800 20 remove_watcher() i=7 2024-09-14T11:34:06.055 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:34:36.083 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:36.120 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:36.120 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:36.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.169+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 realm 2024-09-14T11:34:36.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:36.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.170 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.171+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.172+0000 7fe972f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:36.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.172+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.173+0000 7fe972f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:36.171 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.173+0000 7fe972f39800 20 searching for the correct realm 2024-09-14T11:34:36.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.376+0000 7fe96f426640 0 -- 172.21.15.28:0/2332684301 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fe964074040 msgr2=0x7fe964076040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:36.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.782+0000 7fe96f426640 0 -- 172.21.15.28:0/2332684301 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7fe964042020 msgr2=0x7fe96406ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:36.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:36.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:36.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:36.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:36.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:36.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:36.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.993+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 20 zone default found 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 4 Realm: () 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:36.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 20 zonegroup default 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.994+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 started sync module instance, tier type = 2024-09-14T11:34:36.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:36.995+0000 7fe972f39800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:37.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=0 2024-09-14T11:34:37.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=1 2024-09-14T11:34:37.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=2 2024-09-14T11:34:37.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=3 2024-09-14T11:34:37.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=4 2024-09-14T11:34:37.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=5 2024-09-14T11:34:37.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.006+0000 7fe972f39800 20 add_watcher() i=6 2024-09-14T11:34:37.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.007+0000 7fe972f39800 20 add_watcher() i=7 2024-09-14T11:34:37.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.007+0000 7fe972f39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:37.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.010+0000 7fe8257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:37.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.010+0000 7fe972f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:37.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.010+0000 7fe972f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:37.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.010+0000 7fe972f39800 5 note: GC not initialized 2024-09-14T11:34:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.010+0000 7fe79ffff640 20 reqs_thread_entry: start 2024-09-14T11:34:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.010+0000 7fe972f39800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 20 Filter name: none 2024-09-14T11:34:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe79dffb640 20 reqs_thread_entry: start 2024-09-14T11:34:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:34:37.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:37.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:34:37.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:34:37.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : miss 2024-09-14T11:34:37.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.011+0000 7fe972f39800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.012+0000 7fe972f39800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.012+0000 7fe972f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.012+0000 7fe972f39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.012+0000 7fe972f39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.012+0000 7fe972f39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.012+0000 7fe972f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.013+0000 7fe972f39800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:37.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe972f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe972f39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe972f39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe972f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36, ofs0, ns] 2024-09-14T11:34:37.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe8527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431565 cookie 94780775728336 notifier 7220 bl.length()=923 2024-09-14T11:34:37.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe8527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe8527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.016 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.018+0000 7fe8527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.020+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_sources= new_sources= 2024-09-14T11:34:37.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.020+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential sources added=[] removed=[] 2024-09-14T11:34:37.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.020+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_dests= new_dests= 2024-09-14T11:34:37.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.020+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential dests added=[] removed=[] 2024-09-14T11:34:37.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.023+0000 7fe972f39800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36.2.0 2024-09-14T11:34:37.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.023+0000 7fe972f39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36.2.0 2024-09-14T11:34:37.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.023+0000 7fe972f39800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36.2.1 2024-09-14T11:34:37.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.023+0000 7fe972f39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36.2.1 2024-09-14T11:34:37.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.023+0000 7fe972f39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36.0 2024-09-14T11:34:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.026+0000 7fe972f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:37.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.026+0000 7fe972f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.027+0000 7fe972f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.027+0000 7fe972f39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.027+0000 7fe972f39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.027+0000 7fe972f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36, ofs0, ns] 2024-09-14T11:34:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.028+0000 7fe8527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431566 cookie 94780775728336 notifier 7220 bl.length()=923 2024-09-14T11:34:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.028+0000 7fe8527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.028+0000 7fe8527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.028+0000 7fe8527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.029+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_sources= new_sources= 2024-09-14T11:34:37.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.029+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential sources added=[] removed=[] 2024-09-14T11:34:37.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.029+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_dests= new_dests= 2024-09-14T11:34:37.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.029+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential dests added=[] removed=[] 2024-09-14T11:34:37.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.031+0000 7fe972f39800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36.0 2024-09-14T11:34:37.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.031+0000 7fe972f39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:37.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.031+0000 7fe972f39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 2024-09-14T11:34:37.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe972f39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe972f39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe972f39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe972f39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36, ofs0, ns] 2024-09-14T11:34:37.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe8527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431567 cookie 94780775728336 notifier 7220 bl.length()=891 2024-09-14T11:34:37.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe8527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 info.flags=0x17 2024-09-14T11:34:37.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe8527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 to cache LRU end 2024-09-14T11:34:37.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.033+0000 7fe8527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:37.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.034+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_sources= new_sources= 2024-09-14T11:34:37.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.034+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential sources added=[] removed=[] 2024-09-14T11:34:37.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.034+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): orig_dests= new_dests= 2024-09-14T11:34:37.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.034+0000 7fe972f39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36]): potential dests added=[] removed=[] 2024-09-14T11:34:37.034 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.036+0000 7fe972f39800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:34:37.036 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.038+0000 7fe8257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.040+0000 7fe972f39800 20 remove_watcher() i=0 2024-09-14T11:34:37.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.040+0000 7fe972f39800 2 removed watcher, disabling cache 2024-09-14T11:34:37.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.042+0000 7fe972f39800 20 remove_watcher() i=1 2024-09-14T11:34:37.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.043+0000 7fe972f39800 20 remove_watcher() i=2 2024-09-14T11:34:37.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.044+0000 7fe972f39800 20 remove_watcher() i=3 2024-09-14T11:34:37.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.045+0000 7fe972f39800 20 remove_watcher() i=4 2024-09-14T11:34:37.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.046+0000 7fe972f39800 20 remove_watcher() i=5 2024-09-14T11:34:37.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.047+0000 7fe972f39800 20 remove_watcher() i=6 2024-09-14T11:34:37.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.049+0000 7fe972f39800 20 remove_watcher() i=7 2024-09-14T11:34:37.061 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:34:37.091 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:37.092 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:37.133 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.135+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.137+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.137+0000 7f42d9b1f800 20 realm 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.137+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.137+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.137+0000 7f42d9b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.137+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.138+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.138+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.139+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:37.136 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.139+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.139+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:37.137 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.139+0000 7f42d9b1f800 20 searching for the correct realm 2024-09-14T11:34:37.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.143+0000 7f42d60a3640 0 -- 172.21.15.28:0/2401843104 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f42cc066360 msgr2=0x7f42cc060a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:37.144 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.146+0000 7f42d58a2640 0 -- 172.21.15.28:0/2401843104 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f42cc06b8f0 msgr2=0x7f42cc073730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:37.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:37.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:37.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:37.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:37.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:37.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:37.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.352+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 zone default found 2024-09-14T11:34:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 4 Realm: () 2024-09-14T11:34:37.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 zonegroup default 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.353+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.354+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.354+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.354+0000 7f42d9b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.354+0000 7f42d9b1f800 20 started sync module instance, tier type = 2024-09-14T11:34:37.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.354+0000 7f42d9b1f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=0 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=1 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=2 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=3 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=4 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=5 2024-09-14T11:34:37.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.364+0000 7f42d9b1f800 20 add_watcher() i=6 2024-09-14T11:34:37.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.365+0000 7f42d9b1f800 20 add_watcher() i=7 2024-09-14T11:34:37.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.365+0000 7f42d9b1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:37.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.366+0000 7f41877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f42d9b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f42d9b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f42d9b1f800 5 note: GC not initialized 2024-09-14T11:34:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f41867fc640 20 reqs_thread_entry: start 2024-09-14T11:34:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f42d9b1f800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:37.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f42d9b1f800 20 Filter name: none 2024-09-14T11:34:37.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f40f7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:37.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.367+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.368+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:37.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.368+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.369+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:37.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.369+0000 7f42d9b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:37.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.369+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.369+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:34:37.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.369+0000 7f42d9b1f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:37.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.370+0000 7f42d9b1f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:34:37.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.370+0000 7f42d9b1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:37.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.371+0000 7f41877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:37.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.374+0000 7f42d9b1f800 20 remove_watcher() i=0 2024-09-14T11:34:37.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.374+0000 7f42d9b1f800 2 removed watcher, disabling cache 2024-09-14T11:34:37.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.375+0000 7f42d9b1f800 20 remove_watcher() i=1 2024-09-14T11:34:37.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.376+0000 7f42d9b1f800 20 remove_watcher() i=2 2024-09-14T11:34:37.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.377+0000 7f42d9b1f800 20 remove_watcher() i=3 2024-09-14T11:34:37.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.378+0000 7f42d9b1f800 20 remove_watcher() i=4 2024-09-14T11:34:37.377 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.379+0000 7f42d9b1f800 20 remove_watcher() i=5 2024-09-14T11:34:37.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.380+0000 7f42d9b1f800 20 remove_watcher() i=6 2024-09-14T11:34:37.379 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:37.381+0000 7f42d9b1f800 20 remove_watcher() i=7 2024-09-14T11:34:37.390 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:37.390 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:37.390 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-logrecord-writes id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:34:37.390 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:37.699 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:34:37.700 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:38.553 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:34:38.581 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:38.581 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:38.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.622+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 realm 2024-09-14T11:34:38.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:38.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.624+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.625+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.625+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.625+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:38.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.625+0000 7f4ba6687800 20 searching for the correct realm 2024-09-14T11:34:38.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.628+0000 7f4ba3970640 0 -- 172.21.15.28:0/4215863317 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f4b94082040 msgr2=0x7f4b940ba410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:38.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.632+0000 7f4ba4171640 0 -- 172.21.15.28:0/4215863317 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f4b9806c5c0 msgr2=0x7f4b98064a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:38.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:38.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:38.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:38.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:38.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:38.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:38.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.838+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 zone default found 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 4 Realm: () 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 zonegroup default 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.839+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.840+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.840+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.840+0000 7f4ba6687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.840+0000 7f4ba6687800 20 started sync module instance, tier type = 2024-09-14T11:34:38.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.840+0000 7f4ba6687800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=0 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=1 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=2 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=3 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=4 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=5 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.849+0000 7f4ba6687800 20 add_watcher() i=6 2024-09-14T11:34:38.847 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.850+0000 7f4ba6687800 20 add_watcher() i=7 2024-09-14T11:34:38.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.850+0000 7f4ba6687800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:38.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4a5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4ba6687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4ba6687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4ba6687800 5 note: GC not initialized 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4a59fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4ba6687800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.852+0000 7f4ba6687800 20 Filter name: none 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.853+0000 7f49cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:38.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.853+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.853+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:38.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.853+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:38.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:38.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:38.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:38.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.854+0000 7f4ba6687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:38.853 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.856+0000 7f4a5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:38.855 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.858+0000 7f4ba6687800 20 remove_watcher() i=0 2024-09-14T11:34:38.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.858+0000 7f4ba6687800 2 removed watcher, disabling cache 2024-09-14T11:34:38.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.859+0000 7f4ba6687800 20 remove_watcher() i=1 2024-09-14T11:34:38.857 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.860+0000 7f4ba6687800 20 remove_watcher() i=2 2024-09-14T11:34:38.858 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.861+0000 7f4ba6687800 20 remove_watcher() i=3 2024-09-14T11:34:38.860 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.862+0000 7f4ba6687800 20 remove_watcher() i=4 2024-09-14T11:34:38.861 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.863+0000 7f4ba6687800 20 remove_watcher() i=5 2024-09-14T11:34:38.862 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.864+0000 7f4ba6687800 20 remove_watcher() i=6 2024-09-14T11:34:38.863 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.865+0000 7f4ba6687800 20 remove_watcher() i=7 2024-09-14T11:34:38.874 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:38.874 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:38.874 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:38.874 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:38.875 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:34:38.910 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:38.939 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:38.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.951+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.953+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.953+0000 7f7a13919800 20 realm 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.953+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.953+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.953+0000 7f7a13919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.953+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.954+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.954+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.954+0000 7f7a13919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.954+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.955+0000 7f7a13919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:38.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.955+0000 7f7a13919800 20 searching for the correct realm 2024-09-14T11:34:38.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.958+0000 7f7a10c09640 0 -- 172.21.15.28:0/1733910397 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f7a040b9030 msgr2=0x7f7a04076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:38.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:38.961+0000 7f7a1140a640 0 -- 172.21.15.28:0/1733910397 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f7a08072c00 msgr2=0x7f7a0808f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:39.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.166 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:39.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.167 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.168+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 zone default found 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 4 Realm: () 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:39.168 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 zonegroup default 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.169+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.170+0000 7f7a13919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.170+0000 7f7a13919800 20 started sync module instance, tier type = 2024-09-14T11:34:39.169 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.170+0000 7f7a13919800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=0 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=1 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=2 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=3 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=4 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=5 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.179+0000 7f7a13919800 20 add_watcher() i=6 2024-09-14T11:34:39.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.180+0000 7f7a13919800 20 add_watcher() i=7 2024-09-14T11:34:39.178 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.180+0000 7f7a13919800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.181+0000 7f78c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f7a13919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f7a13919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f7a13919800 5 note: GC not initialized 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f78c67e4640 20 reqs_thread_entry: start 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f7a13919800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f7a13919800 20 Filter name: none 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.182+0000 7f7837fff640 20 reqs_thread_entry: start 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:39.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 : miss 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.183+0000 7f7a13919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 2024-09-14T11:34:39.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f7a13919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f7a13919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.185 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f7a13919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f7a13919800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37, ofs0, ns] 2024-09-14T11:34:39.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f78f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 94428870956832 notifier 7274 bl.length()=931 2024-09-14T11:34:39.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f78f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f78f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.186 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.187+0000 7f78f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.189+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_sources= new_sources= 2024-09-14T11:34:39.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.189+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential sources added=[] removed=[] 2024-09-14T11:34:39.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.189+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_dests= new_dests= 2024-09-14T11:34:39.187 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.189+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential dests added=[] removed=[] 2024-09-14T11:34:39.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.192+0000 7f7a13919800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.0 2024-09-14T11:34:39.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.192+0000 7f7a13919800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.0 2024-09-14T11:34:39.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.192+0000 7f7a13919800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.1 2024-09-14T11:34:39.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.192+0000 7f7a13919800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.1 2024-09-14T11:34:39.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.192+0000 7f7a13919800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.0 2024-09-14T11:34:39.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.194+0000 7f7a13919800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:34:39.192 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.194+0000 7f7a13919800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:34:39.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.198+0000 7f7a13919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:39.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.198+0000 7f7a13919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 2024-09-14T11:34:39.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.199+0000 7f7a13919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.199+0000 7f7a13919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.199+0000 7f7a13919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.199+0000 7f7a13919800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37, ofs0, ns] 2024-09-14T11:34:39.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.200+0000 7f78e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94428870956832 notifier 7274 bl.length()=899 2024-09-14T11:34:39.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.200+0000 7f78e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.200+0000 7f78e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.198 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.200+0000 7f78e3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.201+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_sources= new_sources= 2024-09-14T11:34:39.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.201+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential sources added=[] removed=[] 2024-09-14T11:34:39.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.201+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_dests= new_dests= 2024-09-14T11:34:39.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.201+0000 7f7a13919800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential dests added=[] removed=[] 2024-09-14T11:34:39.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.201+0000 7f7a13919800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:34:39.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.203+0000 7f78c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.205+0000 7f7a13919800 20 remove_watcher() i=0 2024-09-14T11:34:39.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.205+0000 7f7a13919800 2 removed watcher, disabling cache 2024-09-14T11:34:39.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.206+0000 7f7a13919800 20 remove_watcher() i=1 2024-09-14T11:34:39.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.207+0000 7f7a13919800 20 remove_watcher() i=2 2024-09-14T11:34:39.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.208+0000 7f7a13919800 20 remove_watcher() i=3 2024-09-14T11:34:39.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.209+0000 7f7a13919800 20 remove_watcher() i=4 2024-09-14T11:34:39.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.210+0000 7f7a13919800 20 remove_watcher() i=5 2024-09-14T11:34:39.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.211+0000 7f7a13919800 20 remove_watcher() i=6 2024-09-14T11:34:39.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.212+0000 7f7a13919800 20 remove_watcher() i=7 2024-09-14T11:34:39.223 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:34:39.252 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.252 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.292+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 realm 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.295+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.296+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.296+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.296+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.296+0000 7f3a18d28800 20 searching for the correct realm 2024-09-14T11:34:39.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.300+0000 7f3a1426e640 0 -- 172.21.15.28:0/2204526156 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55bc00710af0 msgr2=0x55bc00712ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.303+0000 7f3a14a6f640 0 -- 172.21.15.28:0/2204526156 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f3a0804b960 msgr2=0x7f3a0804a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:39.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:39.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.510+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 zone default found 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 4 Realm: () 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 zonegroup default 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.511+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.512+0000 7f3a18d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.512+0000 7f3a18d28800 20 started sync module instance, tier type = 2024-09-14T11:34:39.511 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.512+0000 7f3a18d28800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=0 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=1 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=2 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=3 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=4 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=5 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.521+0000 7f3a18d28800 20 add_watcher() i=6 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.522+0000 7f3a18d28800 20 add_watcher() i=7 2024-09-14T11:34:39.519 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.522+0000 7f3a18d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.523+0000 7f38cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f3a18d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f3a18d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f3a18d28800 5 note: GC not initialized 2024-09-14T11:34:39.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f38c9fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:39.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f3a18d28800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:39.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f3a18d28800 20 Filter name: none 2024-09-14T11:34:39.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f383b7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:39.523 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.524+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.525+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.525+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.525+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.525+0000 7f3a18d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.525+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.525+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.526+0000 7f3a18d28800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.526+0000 7f3a18d28800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:39.524 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.526+0000 7f3a18d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.527+0000 7f38cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.529+0000 7f3a18d28800 20 remove_watcher() i=0 2024-09-14T11:34:39.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.529+0000 7f3a18d28800 2 removed watcher, disabling cache 2024-09-14T11:34:39.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.530+0000 7f3a18d28800 20 remove_watcher() i=1 2024-09-14T11:34:39.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.531+0000 7f3a18d28800 20 remove_watcher() i=2 2024-09-14T11:34:39.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.532+0000 7f3a18d28800 20 remove_watcher() i=3 2024-09-14T11:34:39.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.534+0000 7f3a18d28800 20 remove_watcher() i=4 2024-09-14T11:34:39.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.535+0000 7f3a18d28800 20 remove_watcher() i=5 2024-09-14T11:34:39.533 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.535+0000 7f3a18d28800 20 remove_watcher() i=6 2024-09-14T11:34:39.534 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.536+0000 7f3a18d28800 20 remove_watcher() i=7 2024-09-14T11:34:39.545 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:39.545 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:39.545 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:39.545 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:39.637 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:39.670 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.670 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.708 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.710+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 realm 2024-09-14T11:34:39.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.712+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.713+0000 7fa0d0040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.713+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.714+0000 7fa0d0040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.712 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.714+0000 7fa0d0040800 20 searching for the correct realm 2024-09-14T11:34:39.715 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.717+0000 7fa0cd329640 0 -- 172.21.15.28:0/3681883921 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x555ff32bdbf0 msgr2=0x555ff32c0040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.721+0000 7fa0cdb2a640 0 -- 172.21.15.28:0/3681883921 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fa0c401d430 msgr2=0x7fa0c401d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.725+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 zone default found 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 4 Realm: () 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 zonegroup default 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.726+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.727+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.727+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.727+0000 7fa0d0040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.727+0000 7fa0d0040800 20 started sync module instance, tier type = 2024-09-14T11:34:39.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.727+0000 7fa0d0040800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=0 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=1 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=2 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=3 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=4 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=5 2024-09-14T11:34:39.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.736+0000 7fa0d0040800 20 add_watcher() i=6 2024-09-14T11:34:39.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.737+0000 7fa0d0040800 20 add_watcher() i=7 2024-09-14T11:34:39.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.737+0000 7fa0d0040800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.736 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.738+0000 7f9f7ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 5 note: GC not initialized 2024-09-14T11:34:39.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7f9f7effd640 20 reqs_thread_entry: start 2024-09-14T11:34:39.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:39.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 20 Filter name: none 2024-09-14T11:34:39.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7f9f7cff9640 20 reqs_thread_entry: start 2024-09-14T11:34:39.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:34:39.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.739+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 : miss 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.740+0000 7fa0d0040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7fa0d0040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7fa0d0040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7fa0d0040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7fa0d0040800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37, ofs0, ns] 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7f9fb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 93870589999840 notifier 7806 bl.length()=931 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7f9fb17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7f9fb17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.742 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.744+0000 7f9fb17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.746+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_sources= new_sources= 2024-09-14T11:34:39.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.746+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential sources added=[] removed=[] 2024-09-14T11:34:39.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.746+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_dests= new_dests= 2024-09-14T11:34:39.744 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.746+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential dests added=[] removed=[] 2024-09-14T11:34:39.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.748+0000 7fa0d0040800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.0 2024-09-14T11:34:39.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.748+0000 7fa0d0040800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.0 2024-09-14T11:34:39.746 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.748+0000 7fa0d0040800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.1 2024-09-14T11:34:39.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.748+0000 7fa0d0040800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.1.1 2024-09-14T11:34:39.747 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.748+0000 7fa0d0040800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.0 2024-09-14T11:34:39.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.751+0000 7fa0d0040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:39.749 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.751+0000 7fa0d0040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 2024-09-14T11:34:39.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7fa0d0040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7fa0d0040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7fa0d0040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.750 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7fa0d0040800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37, ofs0, ns] 2024-09-14T11:34:39.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7f9fb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431640 cookie 93870589999840 notifier 7806 bl.length()=931 2024-09-14T11:34:39.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7f9fb17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7f9fb17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.751 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.752+0000 7f9fb17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.754+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_sources= new_sources= 2024-09-14T11:34:39.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.754+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential sources added=[] removed=[] 2024-09-14T11:34:39.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.754+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_dests= new_dests= 2024-09-14T11:34:39.752 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.754+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential dests added=[] removed=[] 2024-09-14T11:34:39.753 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.755+0000 7fa0d0040800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37.0 2024-09-14T11:34:39.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.756+0000 7fa0d0040800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:39.754 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.756+0000 7fa0d0040800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7fa0d0040800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7fa0d0040800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7fa0d0040800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7fa0d0040800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37, ofs0, ns] 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7f9fb17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431641 cookie 93870589999840 notifier 7806 bl.length()=899 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7f9fb17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 info.flags=0x17 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7f9fb17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 to cache LRU end 2024-09-14T11:34:39.755 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.757+0000 7f9fb17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.756 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.759+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_sources= new_sources= 2024-09-14T11:34:39.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.759+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential sources added=[] removed=[] 2024-09-14T11:34:39.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.759+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): orig_dests= new_dests= 2024-09-14T11:34:39.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.759+0000 7fa0d0040800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37]): potential dests added=[] removed=[] 2024-09-14T11:34:39.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.760+0000 7fa0d0040800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-14T11:34:39.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.762+0000 7f9f7ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.764+0000 7fa0d0040800 20 remove_watcher() i=0 2024-09-14T11:34:39.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.764+0000 7fa0d0040800 2 removed watcher, disabling cache 2024-09-14T11:34:39.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.765+0000 7fa0d0040800 20 remove_watcher() i=1 2024-09-14T11:34:39.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.766+0000 7fa0d0040800 20 remove_watcher() i=2 2024-09-14T11:34:39.764 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.767+0000 7fa0d0040800 20 remove_watcher() i=3 2024-09-14T11:34:39.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.768+0000 7fa0d0040800 20 remove_watcher() i=4 2024-09-14T11:34:39.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.769+0000 7fa0d0040800 20 remove_watcher() i=5 2024-09-14T11:34:39.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.769+0000 7fa0d0040800 20 remove_watcher() i=6 2024-09-14T11:34:39.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.770+0000 7fa0d0040800 20 remove_watcher() i=7 2024-09-14T11:34:39.780 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:34:39.810 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.810 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.848 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.850+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.850 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 realm 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.852+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.851 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.853+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.853+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.853+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.852 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.854+0000 7f7928b42800 20 searching for the correct realm 2024-09-14T11:34:39.856 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:39.858+0000 7f7925087640 0 -- 172.21.15.28:0/415926385 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f791800b040 msgr2=0x7f7918055910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.063 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.065+0000 7f7924886640 0 -- 172.21.15.28:0/415926385 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x5597a9a15780 msgr2=0x5597a9a17bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:40.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:40.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.066 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.067+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 zone default found 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 4 Realm: () 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 zonegroup default 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.068+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.069+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.069+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.069+0000 7f7928b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.069+0000 7f7928b42800 20 started sync module instance, tier type = 2024-09-14T11:34:40.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.069+0000 7f7928b42800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=0 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=1 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=2 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=3 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=4 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=5 2024-09-14T11:34:40.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.078+0000 7f7928b42800 20 add_watcher() i=6 2024-09-14T11:34:40.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.079+0000 7f7928b42800 20 add_watcher() i=7 2024-09-14T11:34:40.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.079+0000 7f7928b42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.080+0000 7f77db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f7928b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f7928b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f7928b42800 5 note: GC not initialized 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f77da7e4640 20 reqs_thread_entry: start 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f7928b42800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f7928b42800 20 Filter name: none 2024-09-14T11:34:40.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f77d3fff640 20 reqs_thread_entry: start 2024-09-14T11:34:40.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.081+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.082+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:40.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.082+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.082+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.082+0000 7f7928b42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.082+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.083+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.083+0000 7f7928b42800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.083+0000 7f7928b42800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:40.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.083+0000 7f7928b42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.084+0000 7f77db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.086+0000 7f7928b42800 20 remove_watcher() i=0 2024-09-14T11:34:40.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.086+0000 7f7928b42800 2 removed watcher, disabling cache 2024-09-14T11:34:40.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.087+0000 7f7928b42800 20 remove_watcher() i=1 2024-09-14T11:34:40.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.088+0000 7f7928b42800 20 remove_watcher() i=2 2024-09-14T11:34:40.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.089+0000 7f7928b42800 20 remove_watcher() i=3 2024-09-14T11:34:40.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.090+0000 7f7928b42800 20 remove_watcher() i=4 2024-09-14T11:34:40.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.091+0000 7f7928b42800 20 remove_watcher() i=5 2024-09-14T11:34:40.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.092+0000 7f7928b42800 20 remove_watcher() i=6 2024-09-14T11:34:40.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:40.093+0000 7f7928b42800 20 remove_watcher() i=7 2024-09-14T11:34:40.102 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:40.102 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:40.102 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:34:40.102 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:40.408 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:34:40.408 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:41.253 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.283 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.321 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.323+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.325+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.325+0000 7fb66c32e800 20 realm 2024-09-14T11:34:41.323 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.325+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.325+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.325+0000 7fb66c32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.325+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.326+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.326+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.326+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.326+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.327+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.327+0000 7fb66c32e800 20 searching for the correct realm 2024-09-14T11:34:41.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.330+0000 7fb6678dc640 0 -- 172.21.15.28:0/3493856386 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x562b36c110a0 msgr2=0x562b36c13490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.333+0000 7fb6680dd640 0 -- 172.21.15.28:0/3493856386 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb65c0b2740 msgr2=0x7fb65c0aaf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:41.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:41.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.337+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 zone default found 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 4 Realm: () 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:41.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 zonegroup default 2024-09-14T11:34:41.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.338+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.339+0000 7fb66c32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.339+0000 7fb66c32e800 20 started sync module instance, tier type = 2024-09-14T11:34:41.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.339+0000 7fb66c32e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:41.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=0 2024-09-14T11:34:41.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=1 2024-09-14T11:34:41.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=2 2024-09-14T11:34:41.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=3 2024-09-14T11:34:41.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=4 2024-09-14T11:34:41.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=5 2024-09-14T11:34:41.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.347+0000 7fb66c32e800 20 add_watcher() i=6 2024-09-14T11:34:41.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.348+0000 7fb66c32e800 20 add_watcher() i=7 2024-09-14T11:34:41.346 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.348+0000 7fb66c32e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.350+0000 7fb51efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.348 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.350+0000 7fb66c32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.350+0000 7fb66c32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.350+0000 7fb66c32e800 5 note: GC not initialized 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.350+0000 7fb51dfdb640 20 reqs_thread_entry: start 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.350+0000 7fb66c32e800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.351+0000 7fb66c32e800 20 Filter name: none 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.351+0000 7fb48f7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.351+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.352+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:41.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.352+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.352+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:41.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.352+0000 7fb66c32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.350 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.352+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.353+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:41.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.353+0000 7fb66c32e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.353+0000 7fb66c32e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:41.351 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.353+0000 7fb66c32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.355+0000 7fb51efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.356+0000 7fb66c32e800 20 remove_watcher() i=0 2024-09-14T11:34:41.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.356+0000 7fb66c32e800 2 removed watcher, disabling cache 2024-09-14T11:34:41.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.358+0000 7fb66c32e800 20 remove_watcher() i=1 2024-09-14T11:34:41.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.359+0000 7fb66c32e800 20 remove_watcher() i=2 2024-09-14T11:34:41.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.360+0000 7fb66c32e800 20 remove_watcher() i=3 2024-09-14T11:34:41.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.360+0000 7fb66c32e800 20 remove_watcher() i=4 2024-09-14T11:34:41.359 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.361+0000 7fb66c32e800 20 remove_watcher() i=5 2024-09-14T11:34:41.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.362+0000 7fb66c32e800 20 remove_watcher() i=6 2024-09-14T11:34:41.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.363+0000 7fb66c32e800 20 remove_watcher() i=7 2024-09-14T11:34:41.372 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:41.373 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:41.373 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:41.373 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:41.374 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:34:41.411 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.411 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.450 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.452+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 realm 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.454+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.455+0000 7f7eb1e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.455+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.455+0000 7f7eb1e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.455+0000 7f7eb1e2f800 20 searching for the correct realm 2024-09-14T11:34:41.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.459+0000 7f7eaf11f640 0 -- 172.21.15.28:0/2553648809 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x563dd8800160 msgr2=0x563dd88025f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.462+0000 7f7eaf11f640 0 -- 172.21.15.28:0/2553648809 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f7ea0031040 msgr2=0x7f7ea0072750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.466+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 20 zone default found 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 4 Realm: () 2024-09-14T11:34:41.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 20 zonegroup default 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.467+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.468+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.468+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.468+0000 7f7eb1e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.468+0000 7f7eb1e2f800 20 started sync module instance, tier type = 2024-09-14T11:34:41.467 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.468+0000 7f7eb1e2f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:41.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=0 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=1 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=2 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=3 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=4 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=5 2024-09-14T11:34:41.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.476+0000 7f7eb1e2f800 20 add_watcher() i=6 2024-09-14T11:34:41.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.477+0000 7f7eb1e2f800 20 add_watcher() i=7 2024-09-14T11:34:41.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.477+0000 7f7eb1e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.479+0000 7f7d65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.479+0000 7f7eb1e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.479+0000 7f7eb1e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.479+0000 7f7eb1e2f800 5 note: GC not initialized 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7d64fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 20 Filter name: none 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7cde7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.480+0000 7f7eb1e2f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 : miss 2024-09-14T11:34:41.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:41.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:41.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.481 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.481+0000 7f7eb1e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7eb1e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7eb1e2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7eb1e2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7eb1e2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38, ofs0, ns] 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7d8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431644 cookie 94823625267504 notifier 7349 bl.length()=931 2024-09-14T11:34:41.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7d8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7d8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.485+0000 7f7d8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.487+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): orig_sources= new_sources= 2024-09-14T11:34:41.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.487+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): potential sources added=[] removed=[] 2024-09-14T11:34:41.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.487+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): orig_dests= new_dests= 2024-09-14T11:34:41.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.487+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): potential dests added=[] removed=[] 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.489+0000 7f7eb1e2f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38.1.0 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.489+0000 7f7eb1e2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38.1.0 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.489+0000 7f7eb1e2f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38.1.1 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.489+0000 7f7eb1e2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38.1.1 2024-09-14T11:34:41.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.489+0000 7f7eb1e2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38.0 2024-09-14T11:34:41.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.491+0000 7f7eb1e2f800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:34:41.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.491+0000 7f7eb1e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:41.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.491+0000 7f7eb1e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 2024-09-14T11:34:41.490 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7eb1e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7eb1e2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7eb1e2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7eb1e2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38, ofs0, ns] 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7d8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94823625267504 notifier 7349 bl.length()=931 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7d8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7d8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.491 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.493+0000 7f7d8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.495+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): orig_sources= new_sources= 2024-09-14T11:34:41.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.495+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): potential sources added=[] removed=[] 2024-09-14T11:34:41.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.495+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): orig_dests= new_dests= 2024-09-14T11:34:41.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.495+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): potential dests added=[] removed=[] 2024-09-14T11:34:41.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.496+0000 7f7eb1e2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38.0 2024-09-14T11:34:41.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.497+0000 7f7eb1e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:41.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.497+0000 7f7eb1e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7eb1e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7eb1e2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7eb1e2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7eb1e2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38, ofs0, ns] 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7d8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431646 cookie 94823625267504 notifier 7349 bl.length()=899 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7d8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 info.flags=0x17 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7d8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 to cache LRU end 2024-09-14T11:34:41.496 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.498+0000 7f7d8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:41.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.500+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): orig_sources= new_sources= 2024-09-14T11:34:41.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.500+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): potential sources added=[] removed=[] 2024-09-14T11:34:41.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.500+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): orig_dests= new_dests= 2024-09-14T11:34:41.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.500+0000 7f7eb1e2f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38]): potential dests added=[] removed=[] 2024-09-14T11:34:41.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.501+0000 7f7eb1e2f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-14T11:34:41.501 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.503+0000 7f7d65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.505+0000 7f7eb1e2f800 20 remove_watcher() i=0 2024-09-14T11:34:41.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.505+0000 7f7eb1e2f800 2 removed watcher, disabling cache 2024-09-14T11:34:41.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.506+0000 7f7eb1e2f800 20 remove_watcher() i=1 2024-09-14T11:34:41.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.507+0000 7f7eb1e2f800 20 remove_watcher() i=2 2024-09-14T11:34:41.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.509+0000 7f7eb1e2f800 20 remove_watcher() i=3 2024-09-14T11:34:41.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.510+0000 7f7eb1e2f800 20 remove_watcher() i=4 2024-09-14T11:34:41.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.510+0000 7f7eb1e2f800 20 remove_watcher() i=5 2024-09-14T11:34:41.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.511+0000 7f7eb1e2f800 20 remove_watcher() i=6 2024-09-14T11:34:41.510 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.512+0000 7f7eb1e2f800 20 remove_watcher() i=7 2024-09-14T11:34:41.523 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:34:41.552 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.552 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.593+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 realm 2024-09-14T11:34:41.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.595+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.596+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.596+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.597+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.597+0000 7f816012f800 20 searching for the correct realm 2024-09-14T11:34:41.597 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.600+0000 7f815c677640 0 -- 172.21.15.28:0/3649056031 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f8150084020 msgr2=0x7f81500777c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.603+0000 7f815be76640 0 -- 172.21.15.28:0/3649056031 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f8150085c30 msgr2=0x7f8150076150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.607+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.607 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 zone default found 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 4 Realm: () 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 zonegroup default 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.608+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.609+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.609+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.609+0000 7f816012f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.609+0000 7f816012f800 20 started sync module instance, tier type = 2024-09-14T11:34:41.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.609+0000 7f816012f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:41.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=0 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=1 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=2 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=3 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=4 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=5 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.617+0000 7f816012f800 20 add_watcher() i=6 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.618+0000 7f816012f800 20 add_watcher() i=7 2024-09-14T11:34:41.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.618+0000 7f816012f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.620+0000 7f8011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 5 note: GC not initialized 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f8010fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 20 Filter name: none 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f7f8a7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.621+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:41.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.622+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.622+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.622+0000 7f816012f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.622+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.622+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.622+0000 7f816012f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.623+0000 7f816012f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:41.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.623+0000 7f816012f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:41.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.624+0000 7f8011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.626+0000 7f816012f800 20 remove_watcher() i=0 2024-09-14T11:34:41.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.626+0000 7f816012f800 2 removed watcher, disabling cache 2024-09-14T11:34:41.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.627+0000 7f816012f800 20 remove_watcher() i=1 2024-09-14T11:34:41.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.628+0000 7f816012f800 20 remove_watcher() i=2 2024-09-14T11:34:41.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.629+0000 7f816012f800 20 remove_watcher() i=3 2024-09-14T11:34:41.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.630+0000 7f816012f800 20 remove_watcher() i=4 2024-09-14T11:34:41.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.631+0000 7f816012f800 20 remove_watcher() i=5 2024-09-14T11:34:41.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.632+0000 7f816012f800 20 remove_watcher() i=6 2024-09-14T11:34:41.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:41.633+0000 7f816012f800 20 remove_watcher() i=7 2024-09-14T11:34:41.642 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:41.642 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:41.642 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: error-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:34:41.642 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:41.967 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:34:41.967 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:42.821 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:34:42.852 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:42.852 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:42.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.892+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 realm 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.894+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.895+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:42.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.895+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.896+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:42.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.896+0000 7f583a52c800 20 searching for the correct realm 2024-09-14T11:34:42.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.899+0000 7f5835aac640 0 -- 172.21.15.28:0/2438948275 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x557926d1e6f0 msgr2=0x557926d20b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:42.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.902+0000 7f58362ad640 0 -- 172.21.15.28:0/2438948275 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f582c0941e0 msgr2=0x7f582c0962c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:42.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.905 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.906+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 20 zone default found 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 4 Realm: () 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 20 zonegroup default 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.907+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.907 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:42.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 started sync module instance, tier type = 2024-09-14T11:34:42.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.908+0000 7f583a52c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:42.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=0 2024-09-14T11:34:42.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=1 2024-09-14T11:34:42.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=2 2024-09-14T11:34:42.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=3 2024-09-14T11:34:42.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=4 2024-09-14T11:34:42.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=5 2024-09-14T11:34:42.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.917+0000 7f583a52c800 20 add_watcher() i=6 2024-09-14T11:34:42.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.918+0000 7f583a52c800 20 add_watcher() i=7 2024-09-14T11:34:42.916 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.918+0000 7f583a52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:42.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.919+0000 7f56ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:42.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f583a52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:42.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f583a52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:42.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f583a52c800 5 note: GC not initialized 2024-09-14T11:34:42.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f56677fe640 20 reqs_thread_entry: start 2024-09-14T11:34:42.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f583a52c800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:42.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f583a52c800 20 Filter name: none 2024-09-14T11:34:42.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f56657fa640 20 reqs_thread_entry: start 2024-09-14T11:34:42.919 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.920+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.921+0000 7f583a52c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.922+0000 7f583a52c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:42.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.922+0000 7f583a52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:42.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.923+0000 7f56ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:42.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.925+0000 7f583a52c800 20 remove_watcher() i=0 2024-09-14T11:34:42.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.926+0000 7f583a52c800 2 removed watcher, disabling cache 2024-09-14T11:34:42.925 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.927+0000 7f583a52c800 20 remove_watcher() i=1 2024-09-14T11:34:42.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.928+0000 7f583a52c800 20 remove_watcher() i=2 2024-09-14T11:34:42.927 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.929+0000 7f583a52c800 20 remove_watcher() i=3 2024-09-14T11:34:42.928 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.930+0000 7f583a52c800 20 remove_watcher() i=4 2024-09-14T11:34:42.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.931+0000 7f583a52c800 20 remove_watcher() i=5 2024-09-14T11:34:42.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.932+0000 7f583a52c800 20 remove_watcher() i=6 2024-09-14T11:34:42.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:42.933+0000 7f583a52c800 20 remove_watcher() i=7 2024-09-14T11:34:42.942 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:42.942 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:42.942 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:42.942 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:42.944 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:34:42.978 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:42.978 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:43.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.019+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 realm 2024-09-14T11:34:43.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.021+0000 7f5dd5b30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.023+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.021 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.023+0000 7f5dd5b30800 20 searching for the correct realm 2024-09-14T11:34:43.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.026+0000 7f5dd0fbb640 0 -- 172.21.15.28:0/2164303043 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x555e2dbe4ef0 msgr2=0x555e2dbe73b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.029+0000 7f5dd17bc640 0 -- 172.21.15.28:0/2164303043 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5dc8061270 msgr2=0x7f5dc80996a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 zone default found 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 Realm: () 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 zonegroup default 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.236 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 started sync module instance, tier type = 2024-09-14T11:34:43.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:43.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=0 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=1 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=2 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=3 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=4 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=5 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=6 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.247+0000 7f5dd5b30800 20 add_watcher() i=7 2024-09-14T11:34:43.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.247+0000 7f5dd5b30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.249+0000 7f5c877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 note: GC not initialized 2024-09-14T11:34:43.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5c867e4640 20 reqs_thread_entry: start 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 Filter name: none 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5bf7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:34:43.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : miss 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.250 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39, ofs0, ns] 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 93862982764032 notifier 7911 bl.length()=931 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.253 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_sources= new_sources= 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential sources added=[] removed=[] 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_dests= new_dests= 2024-09-14T11:34:43.255 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential dests added=[] removed=[] 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.259+0000 7f5dd5b30800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.0 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.0 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.259+0000 7f5dd5b30800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.1 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.1 2024-09-14T11:34:43.257 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.0 2024-09-14T11:34:43.259 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5dd5b30800 time 2024-09-14T11:34:43.262573+0000 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5dd718c76a] 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.260 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5dd5b30800 thread_name:radosgw-admin 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.262+0000 7f5dd5b30800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5dd5b30800 time 2024-09-14T11:34:43.262573+0000 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.261 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5dd718c76a] 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:43.262 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.278 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5dd5e3e6f0] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5dd5e8b99c] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5dd718c7c4] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:43.279 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.263+0000 7f5dd5b30800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5dd5b30800 thread_name:radosgw-admin 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5dd5e3e6f0] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5dd5e8b99c] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5dd718c7c4] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.280 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.281 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding auth protocol: cephx 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding auth protocol: cephx 2024-09-14T11:34:43.282 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding auth protocol: cephx 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: starting msgr at 2024-09-14T11:34:43.283 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: starting objecter 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command objecter_requests hook 0x555e2daf33f0 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: setting wanted keys 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: calling monclient init 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding auth protocol: cephx 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding auth protocol: cephx 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding auth protocol: cephx 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.284 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key hook 0x555e2daef4c8 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2d966d50 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.285 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2d99ca00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2d99ce20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.644716s 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2d99ca00 auth_method 0 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2d99ce20 auth_method 0 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.286 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_done global_id 7391 payload 824 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: dump: 2024-09-14T11:34:43.287 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.288 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: dump: 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7391 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:34:43.004+0000 7f5cbf606640 4 set_mon_vals no callback set 2024-09-14T11:34:43.289 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 1 librados: init done 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:34:43.006+0000 7f5cbde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:34:43.006+0000 7f5cbde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:34:43.006+0000 7f5cbde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:34:43.006+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5cb8077260 auth_method 0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:34:43.006+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x555e2db160c0 auth_method 0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:34:43.007+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x555e2db3ab20 auth_method 0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:34:43.009+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x555e2db400f0 auth_method 0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.290 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding auth protocol: cephx 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding auth protocol: cephx 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding auth protocol: cephx 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.291 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command objecter_requests cmddesc objecter_requests hook 0x555e2db475c0 EEXIST 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding auth protocol: cephx 2024-09-14T11:34:43.292 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding auth protocol: cephx 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding auth protocol: cephx 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.293 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key cmddesc rotate-key hook 0x555e2db43070 EEXIST 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2db6b8e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2db6bcc0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2db6a5f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.651919s 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request con 0x555e2db6b8e0 auth_method 0 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.294 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2db6a5f0 auth_method 0 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2db6bcc0 auth_method 0 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.295 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_done global_id 7394 payload 824 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: dump: 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.296 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: dump: 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.297 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7394 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:34:43.011+0000 7f5dd27be640 4 set_mon_vals no callback set 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:34:43.013+0000 7f5cb6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.298 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:34:43.013+0000 7f5cb6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:34:43.013+0000 7f5cb6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:34:43.013+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5cac077140 auth_method 0 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 10 monclient: get_monmap_and_config 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.299 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding auth protocol: cephx 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding auth protocol: cephx 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding auth protocol: cephx 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.300 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding auth protocol: cephx 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding auth protocol: cephx 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding auth protocol: cephx 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.301 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key cmddesc rotate-key hook 0x7ffeabc53fd8 EEXIST 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2dbbaed0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2db91f90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2dbbb2b0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.302 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.656010s 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request con 0x555e2dbbaed0 auth_method 0 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2dbbb2b0 auth_method 0 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.303 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2db91f90 auth_method 0 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.304 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_done global_id 7397 payload 274 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: dump: 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.305 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: dump: 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.306 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7397 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 4 set_mon_vals no callback set 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: shutdown 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.307 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding auth protocol: cephx 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding auth protocol: cephx 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding auth protocol: cephx 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.308 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: starting msgr at 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: starting objecter 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command objecter_requests cmddesc objecter_requests hook 0x555e2db92890 EEXIST 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: setting wanted keys 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: calling monclient init 2024-09-14T11:34:43.309 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding auth protocol: cephx 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding auth protocol: cephx 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding auth protocol: cephx 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.310 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key cmddesc rotate-key hook 0x555e2db802e8 EEXIST 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2db91f90 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2dbbaed0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2dbb7e30 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.658348s 2024-09-14T11:34:43.311 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request con 0x555e2db91f90 auth_method 0 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2dbb7e30 auth_method 0 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.312 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2dbbaed0 auth_method 0 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_done global_id 7911 payload 824 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 1 monclient: found mon.noname-a 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:34:43.017+0000 7f5ca2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: dump: 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.313 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: dump: 2024-09-14T11:34:43.314 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7911 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:34:43.018+0000 7f5cb4ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.315 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 1 librados: init done 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cr dump hook 0x555e2dbb6f48 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:34:43.019+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:34:43.020+0000 7f5ca2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:34:43.020+0000 7f5ca2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:34:43.020+0000 7f5ca2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:34:43.021+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x7f5c9c077230 auth_method 0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:34:43.021+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x555e2dbdba30 auth_method 0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 realm 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.316 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:34:43.022+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x555e2dbdfc30 auth_method 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:34:43.023+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:34:43.023+0000 7f5dd5b30800 20 searching for the correct realm 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:34:43.023+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x555e2dbe4ef0 auth_method 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:34:43.023+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x7f5dc8061b70 auth_method 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:34:43.024+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5dcc064ce0 auth_method 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:34:43.025+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x7f5dc4092070 auth_method 0 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:34:43.026+0000 7f5dd0fbb640 0 -- 172.21.15.28:0/2164303043 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x555e2dbe4ef0 msgr2=0x555e2dbe73b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.317 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:34:43.026+0000 7f5ca2ffd640 1 client.7911.objecter ms_handle_reset 0x555e2dbe4ef0 session 0x555e2dbe4870 osd.3 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:34:43.026+0000 7f5ca2ffd640 10 monclient: _renew_subs 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:34:43.026+0000 7f5ca2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:34:43.026+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x7f5c9c0879e0 auth_method 0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:34:43.027+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x7f5dc806be10 auth_method 0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:34:43.029+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5dc8061270 auth_method 0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:34:43.029+0000 7f5dd17bc640 0 -- 172.21.15.28:0/2164303043 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5dc8061270 msgr2=0x7f5dc80996a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:34:43.230+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5dc8061270 auth_method 0 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.318 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 zone default found 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 Realm: () 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 zonegroup default 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.319 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 started sync module instance, tier type = 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=0 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=1 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=2 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=3 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=4 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=5 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=6 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:34:43.247+0000 7f5dd5b30800 20 add_watcher() i=7 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:34:43.247+0000 7f5dd5b30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding auth protocol: cephx 2024-09-14T11:34:43.320 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding auth protocol: cephx 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding auth protocol: cephx 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:34:43.249+0000 7f5c877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.321 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache list hook 0x555e2dbb8210 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache inspect hook 0x555e2dbb8210 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache erase hook 0x555e2dbb8210 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache zap hook 0x555e2dbb8210 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 note: GC not initialized 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:34:43.250+0000 7f5c867e4640 20 reqs_thread_entry: start 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace show hook 0x7f5dc4057930 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace history hook 0x7f5dc4057930 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace active hook 0x7f5dc4057930 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace active_short hook 0x7f5dc4057930 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 Filter name: none 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:34:43.250+0000 7f5bf7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.322 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : miss 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.323 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39, ofs0, ns] 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 93862982764032 notifier 7911 bl.length()=931 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_sources= new_sources= 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential sources added=[] removed=[] 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_dests= new_dests= 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential dests added=[] removed=[] 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.0 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.0 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.1 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.1 2024-09-14T11:34:43.324 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.0 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:34:43.262+0000 7f5dd5b30800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5dd5b30800 time 2024-09-14T11:34:43.262573+0000 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5dd718c76a] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:43.325 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:34:43.263+0000 7f5dd5b30800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5dd5b30800 thread_name:radosgw-admin 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5dd5e3e6f0] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5dd5e8b99c] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5dd718c7c4] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.326 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:34:43.327 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:43.328 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:34:43.329 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:43.330 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:34:43.331 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:43.332 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:43.333 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5bf7fff640 / http_manager 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5c867e4640 / http_manager 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5c877e6640 / rgw_dt_lg_renew 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5ca2ffd640 / ms_dispatch 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cb4ff9640 / io_context_pool 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cb6ffd640 / ms_dispatch 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cbde03640 / ms_dispatch 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cbf606640 / io_context_pool 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd0fbb640 / msgr-worker-2 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd17bc640 / msgr-worker-1 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd1fbd640 / msgr-worker-0 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd27be640 / io_context_pool 2024-09-14T11:34:43.334 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd5b30800 / radosgw-admin 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.140878.log 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.335 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding auth protocol: cephx 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding auth protocol: cephx 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding auth protocol: cephx 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.336 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: crc 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daf50c0) adding con mode: secure 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:34:43.002+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: starting msgr at 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: starting objecter 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command objecter_requests hook 0x555e2daf33f0 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: setting wanted keys 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 1 librados: calling monclient init 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding auth protocol: cephx 2024-09-14T11:34:43.337 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding auth protocol: cephx 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding auth protocol: cephx 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: crc 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 AuthRegistry(0x555e2daef380) adding con mode: secure 2024-09-14T11:34:43.338 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key hook 0x555e2daef4c8 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2d966d50 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2d99ca00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2d99ce20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:34:43.003+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.644716s 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2d99ca00 auth_method 0 2024-09-14T11:34:43.339 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2d99ce20 auth_method 0 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:34:43.003+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:34:43.003+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_done global_id 7391 payload 824 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.340 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:34:43.004+0000 7f5dd0fbb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: dump: 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.341 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:34:43.004+0000 7f5cbde03640 10 monclient: dump: 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.342 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7391 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:34:43.004+0000 7f5cbf606640 4 set_mon_vals no callback set 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:34:43.004+0000 7f5dd5b30800 1 librados: init done 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:34:43.006+0000 7f5cbde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:34:43.006+0000 7f5cbde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:34:43.006+0000 7f5cbde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:34:43.006+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5cb8077260 auth_method 0 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:34:43.006+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x555e2db160c0 auth_method 0 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:34:43.007+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x555e2db3ab20 auth_method 0 2024-09-14T11:34:43.343 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:34:43.009+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x555e2db400f0 auth_method 0 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding auth protocol: cephx 2024-09-14T11:34:43.344 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding auth protocol: cephx 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding auth protocol: cephx 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: crc 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:34:43.009+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db440d0) adding con mode: secure 2024-09-14T11:34:43.345 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command objecter_requests cmddesc objecter_requests hook 0x555e2db475c0 EEXIST 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding auth protocol: cephx 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding auth protocol: cephx 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding auth protocol: cephx 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.346 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: crc 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db42f28) adding con mode: secure 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key cmddesc rotate-key hook 0x555e2db43070 EEXIST 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2db6b8e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2db6bcc0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2db6a5f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.347 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:34:43.010+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.651919s 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request con 0x555e2db6b8e0 auth_method 0 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2db6a5f0 auth_method 0 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2db6bcc0 auth_method 0 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.348 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:34:43.011+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:34:43.011+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_done global_id 7394 payload 824 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:34:43.011+0000 7f5dd1fbd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: dump: 2024-09-14T11:34:43.349 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:34:43.011+0000 7f5cb6ffd640 10 monclient: dump: 2024-09-14T11:34:43.350 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7394 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:34:43.011+0000 7f5dd27be640 4 set_mon_vals no callback set 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.351 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:34:43.011+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:34:43.013+0000 7f5cb6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:34:43.013+0000 7f5cb6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:34:43.013+0000 7f5cb6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:34:43.013+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5cac077140 auth_method 0 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 10 monclient: get_monmap_and_config 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.352 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding auth protocol: cephx 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding auth protocol: cephx 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding auth protocol: cephx 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.353 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: crc 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:34:43.013+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db8b740) adding con mode: secure 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding auth protocol: cephx 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding auth protocol: cephx 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding auth protocol: cephx 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.354 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: crc 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc53e90) adding con mode: secure 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key cmddesc rotate-key hook 0x7ffeabc53fd8 EEXIST 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2dbbaed0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2db91f90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2dbbb2b0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.355 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:34:43.014+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.656010s 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request con 0x555e2dbbaed0 auth_method 0 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2dbbb2b0 auth_method 0 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2db91f90 auth_method 0 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.356 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:34:43.015+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:34:43.015+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_done global_id 7397 payload 274 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 1 monclient: found mon.noname-c 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:34:43.015+0000 7f5dd17bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.357 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: dump: 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.358 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:34:43.015+0000 7f5cb4ff9640 10 monclient: dump: 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.359 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7397 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:34:43.015+0000 7f5dd5b30800 4 set_mon_vals no callback set 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: shutdown 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: build_initial_monmap 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 build_initial for_mkfs: 0 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: monmap: 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:34:43.360 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding auth protocol: cephx 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding auth protocol: cephx 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding auth protocol: cephx 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: crc 2024-09-14T11:34:43.361 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2d9a5970) adding con mode: secure 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: starting msgr at 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: starting objecter 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command objecter_requests cmddesc objecter_requests hook 0x555e2db92890 EEXIST 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: setting wanted keys 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 1 librados: calling monclient init 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 10 monclient: init 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding auth protocol: cephx 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding auth protocol: cephx 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding auth protocol: cephx 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.362 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: crc 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:34:43.016+0000 7f5dd5b30800 5 AuthRegistry(0x555e2db801a0) adding con mode: secure 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command rotate-key cmddesc rotate-key hook 0x555e2db802e8 EEXIST 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-a con 0x555e2db91f90 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-b con 0x555e2dbbaed0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): picked mon.noname-c con 0x555e2dbb7e30 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:34:43.363 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:34:43.017+0000 7f5dd5b30800 10 monclient(hunting): authenticate will time out at 2220.658348s 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request con 0x555e2db91f90 auth_method 0 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request con 0x555e2dbb7e30 auth_method 0 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.364 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:34:43.017+0000 7f5dd1fbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request con 0x555e2dbbaed0 auth_method 0 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:34:43.017+0000 7f5dd0fbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient(hunting): handle_auth_done global_id 7911 payload 824 2024-09-14T11:34:43.365 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient: _finish_hunting 0 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 1 monclient: found mon.noname-a 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:34:43.017+0000 7f5dd17bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:34:43.017+0000 7f5ca2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: dump: 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.366 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:34:43.018+0000 7f5ca2ffd640 10 monclient: dump: 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:34:43.367 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 5 monclient: authenticate success, global_id 7911 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:34:43.018+0000 7f5cb4ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _renew_subs 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 1 librados: init done 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:34:43.018+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cr dump hook 0x555e2dbb6f48 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:34:43.019+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.368 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:34:43.020+0000 7f5ca2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:34:43.020+0000 7f5ca2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:34:43.020+0000 7f5ca2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:34:43.021+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x7f5c9c077230 auth_method 0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:34:43.021+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x555e2dbdba30 auth_method 0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 realm 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:34:43.021+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:34:43.022+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x555e2dbdfc30 auth_method 0 2024-09-14T11:34:43.369 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:34:43.022+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:34:43.023+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:34:43.023+0000 7f5dd5b30800 20 searching for the correct realm 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:34:43.023+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x555e2dbe4ef0 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:34:43.023+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x7f5dc8061b70 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:34:43.024+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5dcc064ce0 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:34:43.025+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x7f5dc4092070 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:34:43.026+0000 7f5dd0fbb640 0 -- 172.21.15.28:0/2164303043 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x555e2dbe4ef0 msgr2=0x555e2dbe73b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:34:43.026+0000 7f5ca2ffd640 1 client.7911.objecter ms_handle_reset 0x555e2dbe4ef0 session 0x555e2dbe4870 osd.3 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:34:43.026+0000 7f5ca2ffd640 10 monclient: _renew_subs 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:34:43.026+0000 7f5ca2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:34:43.026+0000 7f5dd0fbb640 10 monclient: get_auth_request con 0x7f5c9c0879e0 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:34:43.027+0000 7f5dd1fbd640 10 monclient: get_auth_request con 0x7f5dc806be10 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:34:43.029+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5dc8061270 auth_method 0 2024-09-14T11:34:43.370 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:34:43.029+0000 7f5dd17bc640 0 -- 172.21.15.28:0/2164303043 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5dc8061270 msgr2=0x7f5dc80996a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:34:43.230+0000 7f5dd17bc640 10 monclient: get_auth_request con 0x7f5dc8061270 auth_method 0 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:34:43.235+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 zone default found 2024-09-14T11:34:43.371 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 Realm: () 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 zonegroup default 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:34:43.236+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 started sync module instance, tier type = 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:34:43.237+0000 7f5dd5b30800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=0 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=1 2024-09-14T11:34:43.372 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=2 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=3 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=4 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=5 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:34:43.246+0000 7f5dd5b30800 20 add_watcher() i=6 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:34:43.247+0000 7f5dd5b30800 20 add_watcher() i=7 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:34:43.247+0000 7f5dd5b30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding auth protocol: cephx 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding auth protocol: cephx 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding auth protocol: cephx 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.373 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:34:43.249+0000 7f5c877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: crc 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:34:43.249+0000 7f5dd5b30800 5 AuthRegistry(0x7ffeabc54370) adding con mode: secure 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache list hook 0x555e2dbb8210 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache inspect hook 0x555e2dbb8210 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache erase hook 0x555e2dbb8210 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command cache zap hook 0x555e2dbb8210 2024-09-14T11:34:43.374 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 note: GC not initialized 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:34:43.250+0000 7f5c867e4640 20 reqs_thread_entry: start 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace show hook 0x7f5dc4057930 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace history hook 0x7f5dc4057930 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace active hook 0x7f5dc4057930 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 5 asok(0x555e2d8d0270) register_command sync trace active_short hook 0x7f5dc4057930 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 Filter name: none 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:34:43.250+0000 7f5bf7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:34:43.250+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : miss 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.375 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:34:43.251+0000 7f5dd5b30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:34:43.255+0000 7f5dd5b30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39, ofs0, ns] 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 93862982764032 notifier 7911 bl.length()=931 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.376 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:34:43.255+0000 7f5cb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_sources= new_sources= 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential sources added=[] removed=[] 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_dests= new_dests= 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:34:43.257+0000 7f5dd5b30800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential dests added=[] removed=[] 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.0 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.0 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.1 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.1.1 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:34:43.259+0000 7f5dd5b30800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.0 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:34:43.262+0000 7f5dd5b30800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5dd5b30800 time 2024-09-14T11:34:43.262573+0000 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.377 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5dd718c76a] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:34:43.263+0000 7f5dd5b30800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f5dd5b30800 thread_name:radosgw-admin 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5dd5e3e6f0] 2024-09-14T11:34:43.378 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5dd5e8b99c] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5dd718c7c4] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5dd718c928] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555e2c5ba0b1] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x555e2c5c9124] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x555e2c5c9fc4] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5dd5e29590] 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.379 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:34:43.380 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:43.381 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:34:43.382 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:34:43.383 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:34:43.384 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:43.385 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5bf7fff640 / http_manager 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5c867e4640 / http_manager 2024-09-14T11:34:43.386 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5c877e6640 / rgw_dt_lg_renew 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5ca2ffd640 / ms_dispatch 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cb4ff9640 / io_context_pool 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cb6ffd640 / ms_dispatch 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cbde03640 / ms_dispatch 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5cbf606640 / io_context_pool 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd0fbb640 / msgr-worker-2 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd17bc640 / msgr-worker-1 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd1fbd640 / msgr-worker-0 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd27be640 / io_context_pool 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: 7f5dd5b30800 / radosgw-admin 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:43.264217Z_3c336e38-5395-4530-ae98-587f30bc8b4b/log 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:34:43.387 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:34:43.392 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:43.392 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:43.392 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.341+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 realm 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.343+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.344+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.344+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.344+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.344+0000 7f4c6602f800 20 searching for the correct realm 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.348+0000 7f4c63318640 0 -- 172.21.15.28:0/390726201 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55bd66602b70 msgr2=0x55bd66604f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.351+0000 7f4c63b19640 0 -- 172.21.15.28:0/390726201 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f4c5807cb00 msgr2=0x7f4c5806b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.393 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.355+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 20 zone default found 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 4 Realm: () 2024-09-14T11:34:43.394 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 20 zonegroup default 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.356+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.357+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.357+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.357+0000 7f4c6602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.357+0000 7f4c6602f800 20 started sync module instance, tier type = 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.357+0000 7f4c6602f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=0 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=1 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=2 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=3 2024-09-14T11:34:43.395 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=4 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=5 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.366+0000 7f4c6602f800 20 add_watcher() i=6 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.367+0000 7f4c6602f800 20 add_watcher() i=7 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.367+0000 7f4c6602f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4b19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4c6602f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4c6602f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4c6602f800 5 note: GC not initialized 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4b18fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4c6602f800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.369+0000 7f4c6602f800 20 Filter name: none 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4a927fc640 20 reqs_thread_entry: start 2024-09-14T11:34:43.396 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4c6602f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.370+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.371+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.371+0000 7f4c6602f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.371+0000 7f4c6602f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.371+0000 7f4c6602f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.372+0000 7f4b19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.374+0000 7f4c6602f800 20 remove_watcher() i=0 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.374+0000 7f4c6602f800 2 removed watcher, disabling cache 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.375+0000 7f4c6602f800 20 remove_watcher() i=1 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.376+0000 7f4c6602f800 20 remove_watcher() i=2 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.377+0000 7f4c6602f800 20 remove_watcher() i=3 2024-09-14T11:34:43.397 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.378+0000 7f4c6602f800 20 remove_watcher() i=4 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.379+0000 7f4c6602f800 20 remove_watcher() i=5 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.380+0000 7f4c6602f800 20 remove_watcher() i=6 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.381+0000 7f4c6602f800 20 remove_watcher() i=7 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:34:43.398 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:34:43.484 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:43.518 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:43.518 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:43.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.560+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 realm 2024-09-14T11:34:43.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.560 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:43.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.562+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.563+0000 7f0be1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.563+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.563+0000 7f0be1325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:43.562 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.563+0000 7f0be1325800 20 searching for the correct realm 2024-09-14T11:34:43.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.566+0000 7f0bdd734640 0 -- 172.21.15.28:0/1983241630 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f0bd001e040 msgr2=0x7f0bd00673b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:43.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.570+0000 7f0bdcf33640 0 -- 172.21.15.28:0/1983241630 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f0bd008ebb0 msgr2=0x7f0bd0069a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:43.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:34:43.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:43.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:43.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:34:43.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.776+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 zone default found 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 4 Realm: () 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 zonegroup default 2024-09-14T11:34:43.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.777+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.778+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.778+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.778+0000 7f0be1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.778+0000 7f0be1325800 20 started sync module instance, tier type = 2024-09-14T11:34:43.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.778+0000 7f0be1325800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:34:43.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=0 2024-09-14T11:34:43.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=1 2024-09-14T11:34:43.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=2 2024-09-14T11:34:43.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=3 2024-09-14T11:34:43.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=4 2024-09-14T11:34:43.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=5 2024-09-14T11:34:43.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.787+0000 7f0be1325800 20 add_watcher() i=6 2024-09-14T11:34:43.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.788+0000 7f0be1325800 20 add_watcher() i=7 2024-09-14T11:34:43.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.788+0000 7f0be1325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:43.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.790+0000 7f0a937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.790+0000 7f0be1325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:43.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.790+0000 7f0be1325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:43.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.790+0000 7f0be1325800 5 note: GC not initialized 2024-09-14T11:34:43.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0a927e4640 20 reqs_thread_entry: start 2024-09-14T11:34:43.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 20 init_complete bucket index max shards: 1 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 20 Filter name: none 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0a8b7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : miss 2024-09-14T11:34:43.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.791+0000 7f0be1325800 20 rados->read ofs=0 len=0 2024-09-14T11:34:43.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.792+0000 7f0be1325800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:34:43.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.792+0000 7f0be1325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:34:43.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.792+0000 7f0be1325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:34:43.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.792+0000 7f0be1325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:43.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.792+0000 7f0be1325800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:43.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.792+0000 7f0be1325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:34:43.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.793+0000 7f0be1325800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to be held by another RGW process; skipping for now 2024-09-14T11:34:43.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.794+0000 7f0a937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:43.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.796+0000 7f0be1325800 20 remove_watcher() i=0 2024-09-14T11:34:43.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.796+0000 7f0be1325800 2 removed watcher, disabling cache 2024-09-14T11:34:43.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.797+0000 7f0be1325800 20 remove_watcher() i=1 2024-09-14T11:34:43.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.798+0000 7f0be1325800 20 remove_watcher() i=2 2024-09-14T11:34:43.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.799+0000 7f0be1325800 20 remove_watcher() i=3 2024-09-14T11:34:43.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.800+0000 7f0be1325800 20 remove_watcher() i=4 2024-09-14T11:34:43.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.801+0000 7f0be1325800 20 remove_watcher() i=5 2024-09-14T11:34:43.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.802+0000 7f0be1325800 20 remove_watcher() i=6 2024-09-14T11:34:43.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:34:43.803+0000 7f0be1325800 20 remove_watcher() i=7 2024-09-14T11:34:43.813 INFO:tasks.workunit.client.0.smithi028.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:35:13.837 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:13.873 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:13.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.920+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 realm 2024-09-14T11:35:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.920 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.922+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.923+0000 7f84e69a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:13.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.923+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.924+0000 7f84e69a2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:13.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.924+0000 7f84e69a2800 20 searching for the correct realm 2024-09-14T11:35:13.926 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.928+0000 7f84e4c8d640 0 -- 172.21.15.28:0/2389863500 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x562c2c453ea0 msgr2=0x562c2c456360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:13.929 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.932+0000 7f84e448c640 0 -- 172.21.15.28:0/2389863500 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f84cc052f40 msgr2=0x7f84cc073930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:13.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.936+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 zone default found 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 4 Realm: () 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 zonegroup default 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.937+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 started sync module instance, tier type = 2024-09-14T11:35:13.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.938+0000 7f84e69a2800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=0 2024-09-14T11:35:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=1 2024-09-14T11:35:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=2 2024-09-14T11:35:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=3 2024-09-14T11:35:13.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=4 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=5 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.948+0000 7f84e69a2800 20 add_watcher() i=6 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.949+0000 7f84e69a2800 20 add_watcher() i=7 2024-09-14T11:35:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.949+0000 7f84e69a2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:13.949 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.951+0000 7f839afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:13.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:13.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:13.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 5 note: GC not initialized 2024-09-14T11:35:13.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f8399fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:13.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:13.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 20 Filter name: none 2024-09-14T11:35:13.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f830b7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:13.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:35:13.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.952+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : miss 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.953+0000 7f84e69a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:35:13.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.955+0000 7f84e69a2800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f84e69a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f84e69a2800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f84e69a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f84e69a2800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39, ofs0, ns] 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f83bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94747721336416 notifier 7448 bl.length()=931 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f83bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f83bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.959+0000 7f83bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.961+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_sources= new_sources= 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.961+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential sources added=[] removed=[] 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.961+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_dests= new_dests= 2024-09-14T11:35:13.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.961+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential dests added=[] removed=[] 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.964+0000 7f84e69a2800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.2.0 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.964+0000 7f84e69a2800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.2.0 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.964+0000 7f84e69a2800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.2.1 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.964+0000 7f84e69a2800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.2.1 2024-09-14T11:35:13.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.964+0000 7f84e69a2800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.0 2024-09-14T11:35:13.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.966+0000 7f84e69a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:13.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.966+0000 7f84e69a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f84e69a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f84e69a2800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f84e69a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f84e69a2800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39, ofs0, ns] 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f83baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 94747721336416 notifier 7448 bl.length()=931 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f83baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f83baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.967 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.969+0000 7f83baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.970+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_sources= new_sources= 2024-09-14T11:35:13.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.970+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential sources added=[] removed=[] 2024-09-14T11:35:13.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.970+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_dests= new_dests= 2024-09-14T11:35:13.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.970+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential dests added=[] removed=[] 2024-09-14T11:35:13.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.971+0000 7f84e69a2800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39.0 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.972+0000 7f84e69a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:13.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.972+0000 7f84e69a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.973+0000 7f84e69a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.973+0000 7f84e69a2800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.973+0000 7f84e69a2800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.973+0000 7f84e69a2800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39, ofs0, ns] 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.974+0000 7f83bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 94747721336416 notifier 7448 bl.length()=899 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.974+0000 7f83bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 info.flags=0x17 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.974+0000 7f83bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 to cache LRU end 2024-09-14T11:35:13.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.974+0000 7f83bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:13.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.975+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_sources= new_sources= 2024-09-14T11:35:13.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.975+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential sources added=[] removed=[] 2024-09-14T11:35:13.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.975+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): orig_dests= new_dests= 2024-09-14T11:35:13.973 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.975+0000 7f84e69a2800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39]): potential dests added=[] removed=[] 2024-09-14T11:35:13.974 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.976+0000 7f84e69a2800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-14T11:35:13.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.978+0000 7f839afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.981+0000 7f84e69a2800 20 remove_watcher() i=0 2024-09-14T11:35:13.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.981+0000 7f84e69a2800 2 removed watcher, disabling cache 2024-09-14T11:35:13.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.982+0000 7f84e69a2800 20 remove_watcher() i=1 2024-09-14T11:35:13.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.983+0000 7f84e69a2800 20 remove_watcher() i=2 2024-09-14T11:35:13.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.985+0000 7f84e69a2800 20 remove_watcher() i=3 2024-09-14T11:35:13.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.986+0000 7f84e69a2800 20 remove_watcher() i=4 2024-09-14T11:35:13.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.987+0000 7f84e69a2800 20 remove_watcher() i=5 2024-09-14T11:35:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.988+0000 7f84e69a2800 20 remove_watcher() i=6 2024-09-14T11:35:13.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:13.989+0000 7f84e69a2800 20 remove_watcher() i=7 2024-09-14T11:35:14.000 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:35:14.029 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.029 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.070+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.071+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.071+0000 7f77fd52c800 20 realm 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.071+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.072+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.072+0000 7f77fd52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.072+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.070 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.072+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.072+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.073+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.073+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.073+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.073+0000 7f77fd52c800 20 searching for the correct realm 2024-09-14T11:35:14.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.077+0000 7f77f893d640 0 -- 172.21.15.28:0/3916452164 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x555ed270faf0 msgr2=0x555ed2711ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.080+0000 7f77f913e640 0 -- 172.21.15.28:0/3916452164 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f77f00baab0 msgr2=0x7f77f00caa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 zone default found 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 4 Realm: () 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 zonegroup default 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.085+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.086+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.086+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.087+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.087+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.087+0000 7f77fd52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.087+0000 7f77fd52c800 20 started sync module instance, tier type = 2024-09-14T11:35:14.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.087+0000 7f77fd52c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=0 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=1 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=2 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=3 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=4 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=5 2024-09-14T11:35:14.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.096+0000 7f77fd52c800 20 add_watcher() i=6 2024-09-14T11:35:14.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.097+0000 7f77fd52c800 20 add_watcher() i=7 2024-09-14T11:35:14.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.097+0000 7f77fd52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f76affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f77fd52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f77fd52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f77fd52c800 5 note: GC not initialized 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f76aefe5640 20 reqs_thread_entry: start 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f77fd52c800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f77fd52c800 20 Filter name: none 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.099+0000 7f76acfe1640 20 reqs_thread_entry: start 2024-09-14T11:35:14.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.100+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.100+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.100+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.100+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.100+0000 7f77fd52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.100+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.101+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.101+0000 7f77fd52c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.101+0000 7f77fd52c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.101+0000 7f77fd52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.103+0000 7f76affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.105+0000 7f77fd52c800 20 remove_watcher() i=0 2024-09-14T11:35:14.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.105+0000 7f77fd52c800 2 removed watcher, disabling cache 2024-09-14T11:35:14.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.106+0000 7f77fd52c800 20 remove_watcher() i=1 2024-09-14T11:35:14.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.107+0000 7f77fd52c800 20 remove_watcher() i=2 2024-09-14T11:35:14.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.109+0000 7f77fd52c800 20 remove_watcher() i=3 2024-09-14T11:35:14.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.110+0000 7f77fd52c800 20 remove_watcher() i=4 2024-09-14T11:35:14.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.111+0000 7f77fd52c800 20 remove_watcher() i=5 2024-09-14T11:35:14.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.112+0000 7f77fd52c800 20 remove_watcher() i=6 2024-09-14T11:35:14.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.112+0000 7f77fd52c800 20 remove_watcher() i=7 2024-09-14T11:35:14.122 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:14.122 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:35:14.122 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: abort-at-change-reshard-state id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:35:14.122 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:14.439 INFO:tasks.workunit.client.0.smithi028.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:35:14.440 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:14.469 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.469 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.511+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.513+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.513+0000 7fbb98820800 20 realm 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.513+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.514+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.514+0000 7fbb98820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.514+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.514+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.512 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.514+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.515+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.515+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.515+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.513 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.515+0000 7fbb98820800 20 searching for the correct realm 2024-09-14T11:35:14.516 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.518+0000 7fbb95b09640 0 -- 172.21.15.28:0/4021059616 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x563bda1deec0 msgr2=0x563bda1e12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:14.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.522+0000 7fbb9630a640 0 -- 172.21.15.28:0/4021059616 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fbb8c067290 msgr2=0x7fbb8c0998e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.527+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 zone default found 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 4 Realm: () 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 zonegroup default 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.528+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.529+0000 7fbb98820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.529+0000 7fbb98820800 20 started sync module instance, tier type = 2024-09-14T11:35:14.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.529+0000 7fbb98820800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=0 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=1 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=2 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=3 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=4 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=5 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.538+0000 7fbb98820800 20 add_watcher() i=6 2024-09-14T11:35:14.536 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.539+0000 7fbb98820800 20 add_watcher() i=7 2024-09-14T11:35:14.537 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.539+0000 7fbb98820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.538 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.540+0000 7fba4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fbb98820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fbb98820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fbb98820800 5 note: GC not initialized 2024-09-14T11:35:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fb9c77fe640 20 reqs_thread_entry: start 2024-09-14T11:35:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fbb98820800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:14.539 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fbb98820800 20 Filter name: none 2024-09-14T11:35:14.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fb9c57fa640 20 reqs_thread_entry: start 2024-09-14T11:35:14.540 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.541+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:14.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:14.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.541 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:14.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.542+0000 7fbb98820800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.543+0000 7fbb98820800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:14.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.543+0000 7fbb98820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.542 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.544+0000 7fba4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.546+0000 7fbb98820800 20 remove_watcher() i=0 2024-09-14T11:35:14.544 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.546+0000 7fbb98820800 2 removed watcher, disabling cache 2024-09-14T11:35:14.545 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.547+0000 7fbb98820800 20 remove_watcher() i=1 2024-09-14T11:35:14.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.548+0000 7fbb98820800 20 remove_watcher() i=2 2024-09-14T11:35:14.547 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.549+0000 7fbb98820800 20 remove_watcher() i=3 2024-09-14T11:35:14.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.550+0000 7fbb98820800 20 remove_watcher() i=4 2024-09-14T11:35:14.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.551+0000 7fbb98820800 20 remove_watcher() i=5 2024-09-14T11:35:14.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.552+0000 7fbb98820800 20 remove_watcher() i=6 2024-09-14T11:35:14.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.553+0000 7fbb98820800 20 remove_watcher() i=7 2024-09-14T11:35:14.562 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:14.562 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:35:14.562 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-14T11:35:14.562 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:14.563 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:14.593 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.593 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.636+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 realm 2024-09-14T11:35:14.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.638+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.639+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.639+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.640+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.638 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.640+0000 7f8627d32800 20 searching for the correct realm 2024-09-14T11:35:14.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.643+0000 7f86231bb640 0 -- 172.21.15.28:0/395629714 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x562f1a7a2950 msgr2=0x562f1a7a4d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.647+0000 7f86239bc640 0 -- 172.21.15.28:0/395629714 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f86180633d0 msgr2=0x7f8618063850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.651+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 zone default found 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 4 Realm: () 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 zonegroup default 2024-09-14T11:35:14.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.652+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 started sync module instance, tier type = 2024-09-14T11:35:14.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.653+0000 7f8627d32800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=0 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=1 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=2 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=3 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=4 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=5 2024-09-14T11:35:14.660 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.662+0000 7f8627d32800 20 add_watcher() i=6 2024-09-14T11:35:14.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.663+0000 7f8627d32800 20 add_watcher() i=7 2024-09-14T11:35:14.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.663+0000 7f8627d32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f84d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f8627d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f8627d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f8627d32800 5 note: GC not initialized 2024-09-14T11:35:14.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f84d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:14.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f8627d32800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:14.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.665+0000 7f8627d32800 20 Filter name: none 2024-09-14T11:35:14.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f84527fc640 20 reqs_thread_entry: start 2024-09-14T11:35:14.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f8627d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.666+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.667+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:14.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.667+0000 7f8627d32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.667+0000 7f8627d32800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:14.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.667+0000 7f8627d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.669+0000 7f84d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.671+0000 7f8627d32800 20 remove_watcher() i=0 2024-09-14T11:35:14.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.671+0000 7f8627d32800 2 removed watcher, disabling cache 2024-09-14T11:35:14.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.672+0000 7f8627d32800 20 remove_watcher() i=1 2024-09-14T11:35:14.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.673+0000 7f8627d32800 20 remove_watcher() i=2 2024-09-14T11:35:14.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.674+0000 7f8627d32800 20 remove_watcher() i=3 2024-09-14T11:35:14.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.675+0000 7f8627d32800 20 remove_watcher() i=4 2024-09-14T11:35:14.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.676+0000 7f8627d32800 20 remove_watcher() i=5 2024-09-14T11:35:14.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.677+0000 7f8627d32800 20 remove_watcher() i=6 2024-09-14T11:35:14.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.678+0000 7f8627d32800 20 remove_watcher() i=7 2024-09-14T11:35:14.689 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:35:14.723 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.723 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.764+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 realm 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.767+0000 7fb25093d800 20 searching for the correct realm 2024-09-14T11:35:14.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.770+0000 7fb24be29640 0 -- 172.21.15.28:0/912889229 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fb23c026040 msgr2=0x7fb23c057930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.774+0000 7fb24c62a640 0 -- 172.21.15.28:0/912889229 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb2400cb960 msgr2=0x7fb2400bf9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.980+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 zone default found 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 4 Realm: () 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 zonegroup default 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.982+0000 7fb25093d800 20 started sync module instance, tier type = 2024-09-14T11:35:14.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.982+0000 7fb25093d800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=0 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=1 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=2 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=3 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=4 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=5 2024-09-14T11:35:14.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=6 2024-09-14T11:35:14.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.992+0000 7fb25093d800 20 add_watcher() i=7 2024-09-14T11:35:14.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.992+0000 7fb25093d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.993+0000 7fb102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb25093d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb25093d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb25093d800 5 note: GC not initialized 2024-09-14T11:35:14.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb101fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:14.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb25093d800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:14.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb25093d800 20 Filter name: none 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.994+0000 7fb0737fe640 20 reqs_thread_entry: start 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:14.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:14.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:14.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:14.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.995+0000 7fb25093d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:14.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.999+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:14.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.999+0000 7fb25093d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:14.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.999+0000 7fb25093d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:14.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:14.999+0000 7fb25093d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:35:14.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94715758975680 notifier 8031 bl.length()=827 2024-09-14T11:35:14.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:14.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:14.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:14.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:35:14.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:35:14.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:35:14.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:35:15.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:35:15.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:35:15.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.1 2024-09-14T11:35:15.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.1 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.2 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.2 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.3 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.3 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.005+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.005+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.005 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb25093d800 time 2024-09-14T11:35:15.008254+0000 2024-09-14T11:35:15.005 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb251f8c76a] 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:35:15.006 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.008+0000 7fb25093d800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb25093d800 time 2024-09-14T11:35:15.008254+0000 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb251f8c76a] 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.007 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:15.008 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fb25093d800 thread_name:radosgw-admin 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb250e3e6f0] 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb250e8b99c] 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb251f8c7c4] 2024-09-14T11:35:15.031 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.009+0000 7fb25093d800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fb25093d800 thread_name:radosgw-admin 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb250e3e6f0] 2024-09-14T11:35:15.032 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb250e8b99c] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb251f8c7c4] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.033 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: secure 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: crc 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: secure 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: crc 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: secure 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:35:14.748+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: starting msgr at 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: starting objecter 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 asok(0x5624baf98270) register_command objecter_requests hook 0x5624bb1e5660 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: setting wanted keys 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: calling monclient init 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding auth protocol: cephx 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding auth protocol: cephx 2024-09-14T11:35:15.034 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding auth protocol: cephx 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:35:14.748+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.035 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:35:14.748+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key hook 0x5624bb1b75f8 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb0fa760 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb100750 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb1eaf80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.389902s 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb0fa760 auth_method 0 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.036 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb100750 auth_method 0 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb1eaf80 auth_method 0 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.037 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_done global_id 7511 payload 824 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:35:14.749+0000 7fb24be29640 1 monclient: found mon.noname-c 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: dump: 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.038 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: dump: 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.039 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:35:14.749+0000 7fb25093d800 5 monclient: authenticate success, global_id 7511 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:35:14.749+0000 7fb13a60c640 4 set_mon_vals no callback set 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:35:14.749+0000 7fb25093d800 1 librados: init done 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:35:14.751+0000 7fb138e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:35:14.751+0000 7fb138e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.040 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:35:14.751+0000 7fb138e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:35:14.751+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb134077230 auth_method 0 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:35:14.752+0000 7fb24ce2b640 10 monclient: get_auth_request con 0x5624bb1e14b0 auth_method 0 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:35:14.752+0000 7fb24c62a640 10 monclient: get_auth_request con 0x5624bb204410 auth_method 0 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:35:14.754+0000 7fb24be29640 10 monclient: get_auth_request con 0x5624bb207cc0 auth_method 0 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:35:14.754+0000 7fb25093d800 10 monclient: build_initial_monmap 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:35:14.754+0000 7fb25093d800 1 build_initial for_mkfs: 0 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:35:14.754+0000 7fb25093d800 10 monclient: monmap: 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.041 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:35:14.754+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding auth protocol: cephx 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:35:14.754+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding auth protocol: cephx 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:35:14.754+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding auth protocol: cephx 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.042 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:35:14.755+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 asok(0x5624baf98270) register_command objecter_requests cmddesc objecter_requests hook 0x5624bb210c80 EEXIST 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:35:14.755+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding auth protocol: cephx 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding auth protocol: cephx 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding auth protocol: cephx 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.043 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:35:14.755+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:35:14.755+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key cmddesc rotate-key hook 0x5624bb20c880 EEXIST 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb234fa0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb235380 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.044 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb233cb0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.397071s 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb235380 auth_method 0 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb233cb0 auth_method 0 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.045 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb234fa0 auth_method 0 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.046 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_done global_id 8025 payload 824 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:35:14.756+0000 7fb24be29640 1 monclient: found mon.noname-a 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: dump: 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.047 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: dump: 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.048 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:35:14.756+0000 7fb25093d800 5 monclient: authenticate success, global_id 8025 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:35:14.756+0000 7fb24d62c640 4 set_mon_vals no callback set 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.049 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:35:14.758+0000 7fb131ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:35:14.758+0000 7fb131ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:35:14.758+0000 7fb131ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:35:14.758+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb124077140 auth_method 0 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:35:14.758+0000 7fb25093d800 10 monclient: get_monmap_and_config 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:35:14.758+0000 7fb25093d800 10 monclient: build_initial_monmap 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:35:14.758+0000 7fb25093d800 1 build_initial for_mkfs: 0 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:35:14.758+0000 7fb25093d800 10 monclient: monmap: 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:15.050 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding auth protocol: cephx 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding auth protocol: cephx 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding auth protocol: cephx 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.051 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:35:14.759+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding auth protocol: cephx 2024-09-14T11:35:15.052 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding auth protocol: cephx 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding auth protocol: cephx 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.053 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:35:14.759+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:35:14.759+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key cmddesc rotate-key hook 0x7fffe0ed7f08 EEXIST 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb258db0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb283820 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb284bd0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.400911s 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb258db0 auth_method 0 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.054 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb284bd0 auth_method 0 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb283820 auth_method 0 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.055 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_done global_id 8028 payload 274 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 1 monclient: found mon.noname-a 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:15.056 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: dump: 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.057 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:35:14.760+0000 7fb25093d800 5 monclient: authenticate success, global_id 8028 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:35:14.760+0000 7fb25093d800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:35:14.760+0000 7fb25093d800 4 set_mon_vals no callback set 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: dump: 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.058 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: shutdown 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: build_initial_monmap 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 build_initial for_mkfs: 0 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: monmap: 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.059 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding auth protocol: cephx 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding auth protocol: cephx 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding auth protocol: cephx 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.060 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:35:14.761+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: starting msgr at 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: starting objecter 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 asok(0x5624baf98270) register_command objecter_requests cmddesc objecter_requests hook 0x5624bb257760 EEXIST 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: setting wanted keys 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: calling monclient init 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding auth protocol: cephx 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding auth protocol: cephx 2024-09-14T11:35:15.061 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding auth protocol: cephx 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:35:14.761+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.062 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:35:14.762+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:35:14.762+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key cmddesc rotate-key hook 0x5624bb2499a8 EEXIST 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb258db0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb284bd0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb254d40 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.403265s 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb254d40 auth_method 0 2024-09-14T11:35:15.063 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb258db0 auth_method 0 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb284bd0 auth_method 0 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.064 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_done global_id 8031 payload 824 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 1 monclient: found mon.noname-a 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: dump: 2024-09-14T11:35:15.065 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:15.066 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: dump: 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:35:14.762+0000 7fb25093d800 5 monclient: authenticate success, global_id 8031 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:35:14.762+0000 7fb1237fe640 4 set_mon_vals no callback set 2024-09-14T11:35:15.067 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:35:14.763+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:35:14.763+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:35:14.763+0000 7fb25093d800 1 librados: init done 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:35:14.763+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cr dump hook 0x5624bb27ce18 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:35:14.764+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:35:14.765+0000 7fb121ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:35:14.765+0000 7fb121ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:35:14.765+0000 7fb121ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:35:14.765+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb114077260 auth_method 0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:35:14.765+0000 7fb24be29640 10 monclient: get_auth_request con 0x5624bb2a3c80 auth_method 0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 realm 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.068 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:35:14.766+0000 7fb25093d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:35:14.766+0000 7fb24c62a640 10 monclient: get_auth_request con 0x5624bb2a7fa0 auth_method 0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 searching for the correct realm 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:35:14.767+0000 7fb24be29640 10 monclient: get_auth_request con 0x5624bb2ad240 auth_method 0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:35:14.768+0000 7fb24ce2b640 10 monclient: get_auth_request con 0x7fb24006b020 auth_method 0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:35:14.769+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb244004040 auth_method 0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:35:14.770+0000 7fb24be29640 10 monclient: get_auth_request con 0x7fb23c026040 auth_method 0 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:35:14.770+0000 7fb24be29640 0 -- 172.21.15.28:0/912889229 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fb23c026040 msgr2=0x7fb23c057930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.069 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:35:14.770+0000 7fb121ffb640 1 client.8031.objecter ms_handle_reset 0x7fb23c026040 session 0x7fb23c01f040 osd.4 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:35:14.770+0000 7fb121ffb640 10 monclient: _renew_subs 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:35:14.770+0000 7fb121ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:35:14.771+0000 7fb24be29640 10 monclient: get_auth_request con 0x7fb114087a10 auth_method 0 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:35:14.772+0000 7fb24ce2b640 10 monclient: get_auth_request con 0x7fb240093140 auth_method 0 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:35:14.774+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb2400cb960 auth_method 0 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:35:14.774+0000 7fb24c62a640 0 -- 172.21.15.28:0/912889229 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb2400cb960 msgr2=0x7fb2400bf9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:35:14.975+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb2400cb960 auth_method 0 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.070 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 zone default found 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:35:14.981+0000 7fb25093d800 4 Realm: () 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:35:14.981+0000 7fb25093d800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:35:14.981+0000 7fb25093d800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:35:14.981+0000 7fb25093d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 zonegroup default 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.071 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 started sync module instance, tier type = 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=0 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=1 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=2 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=3 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=4 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=5 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=6 2024-09-14T11:35:15.072 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:35:14.992+0000 7fb25093d800 20 add_watcher() i=7 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:35:14.992+0000 7fb25093d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding auth protocol: cephx 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding auth protocol: cephx 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding auth protocol: cephx 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.073 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:35:14.993+0000 7fb102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:35:14.994+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache list hook 0x5624bb278fc0 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache inspect hook 0x5624bb278fc0 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache erase hook 0x5624bb278fc0 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache zap hook 0x5624bb278fc0 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 note: GC not initialized 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:35:14.994+0000 7fb101fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace show hook 0x7fb244004c80 2024-09-14T11:35:15.074 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace history hook 0x7fb244004c80 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace active hook 0x7fb244004c80 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace active_short hook 0x7fb244004c80 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 Filter name: none 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:35:14.994+0000 7fb0737fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.075 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94715758975680 notifier 8031 bl.length()=827 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:35:15.076 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.1 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.1 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.2 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.2 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.3 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.3 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:35:15.005+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:35:15.005+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:35:15.008+0000 7fb25093d800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb25093d800 time 2024-09-14T11:35:15.008254+0000 2024-09-14T11:35:15.077 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb251f8c76a] 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:35:15.009+0000 7fb25093d800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fb25093d800 thread_name:radosgw-admin 2024-09-14T11:35:15.078 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb250e3e6f0] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb250e8b99c] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb251f8c7c4] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:35:15.079 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:15.080 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:35:15.081 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:35:15.082 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:35:15.083 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:35:15.084 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:15.085 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:15.086 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb0737fe640 / http_manager 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb101fdb640 / http_manager 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb102fdd640 / rgw_dt_lg_renew 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb121ffb640 / ms_dispatch 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb1237fe640 / io_context_pool 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb131ffb640 / ms_dispatch 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb138e09640 / ms_dispatch 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb13a60c640 / io_context_pool 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24be29640 / msgr-worker-2 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24c62a640 / msgr-worker-1 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24ce2b640 / msgr-worker-0 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24d62c640 / io_context_pool 2024-09-14T11:35:15.087 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb25093d800 / radosgw-admin 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.145001.log 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: secure 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: crc 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: secure 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: crc 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:35:14.747+0000 7fb25093d800 5 AuthRegistry(0x5624bb1bd040) adding con mode: secure 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:35:14.748+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: starting msgr at 2024-09-14T11:35:15.088 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: starting objecter 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 asok(0x5624baf98270) register_command objecter_requests hook 0x5624bb1e5660 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: setting wanted keys 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:35:14.748+0000 7fb25093d800 1 librados: calling monclient init 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding auth protocol: cephx 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding auth protocol: cephx 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding auth protocol: cephx 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.089 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: crc 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 AuthRegistry(0x5624bb1b74b0) adding con mode: secure 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:35:14.748+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:35:14.748+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:35:14.748+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key hook 0x5624bb1b75f8 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb0fa760 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb100750 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb1eaf80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.090 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:35:14.748+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.389902s 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb0fa760 auth_method 0 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb100750 auth_method 0 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:35:14.749+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.091 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb1eaf80 auth_method 0 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:35:14.749+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient(hunting): handle_auth_done global_id 7511 payload 824 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:35:14.749+0000 7fb24be29640 1 monclient: found mon.noname-c 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:35:14.749+0000 7fb24be29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: dump: 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.092 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:35:14.749+0000 7fb138e09640 10 monclient: dump: 2024-09-14T11:35:15.093 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.094 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.094 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.094 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.094 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.094 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:35:14.749+0000 7fb25093d800 5 monclient: authenticate success, global_id 7511 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:35:14.749+0000 7fb13a60c640 4 set_mon_vals no callback set 2024-09-14T11:35:15.096 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:35:14.749+0000 7fb25093d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:35:14.749+0000 7fb25093d800 1 librados: init done 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:35:14.751+0000 7fb138e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:35:14.751+0000 7fb138e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:35:14.751+0000 7fb138e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:35:14.751+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb134077230 auth_method 0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:35:14.752+0000 7fb24ce2b640 10 monclient: get_auth_request con 0x5624bb1e14b0 auth_method 0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:35:14.752+0000 7fb24c62a640 10 monclient: get_auth_request con 0x5624bb204410 auth_method 0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:35:14.754+0000 7fb24be29640 10 monclient: get_auth_request con 0x5624bb207cc0 auth_method 0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:35:14.754+0000 7fb25093d800 10 monclient: build_initial_monmap 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:35:14.754+0000 7fb25093d800 1 build_initial for_mkfs: 0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:35:14.754+0000 7fb25093d800 10 monclient: monmap: 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:35:14.754+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding auth protocol: cephx 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:35:14.754+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding auth protocol: cephx 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:35:14.754+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding auth protocol: cephx 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: crc 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20d840) adding con mode: secure 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:35:14.755+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 asok(0x5624baf98270) register_command objecter_requests cmddesc objecter_requests hook 0x5624bb210c80 EEXIST 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:35:14.755+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding auth protocol: cephx 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding auth protocol: cephx 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding auth protocol: cephx 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: crc 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 AuthRegistry(0x5624bb20c738) adding con mode: secure 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:35:14.755+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:35:14.755+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.100 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:35:14.755+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key cmddesc rotate-key hook 0x5624bb20c880 EEXIST 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb234fa0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb235380 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb233cb0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.397071s 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb235380 auth_method 0 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb233cb0 auth_method 0 2024-09-14T11:35:15.101 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb234fa0 auth_method 0 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:35:14.756+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.102 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:35:14.756+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient(hunting): handle_auth_done global_id 8025 payload 824 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:35:14.756+0000 7fb24be29640 1 monclient: found mon.noname-a 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:35:14.756+0000 7fb24be29640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: dump: 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.103 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:35:14.756+0000 7fb131ffb640 10 monclient: dump: 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.104 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:35:14.756+0000 7fb25093d800 5 monclient: authenticate success, global_id 8025 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:35:14.756+0000 7fb24d62c640 4 set_mon_vals no callback set 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:35:14.756+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:35:14.758+0000 7fb131ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:35:14.758+0000 7fb131ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:35:14.758+0000 7fb131ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:35:14.758+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb124077140 auth_method 0 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:35:14.758+0000 7fb25093d800 10 monclient: get_monmap_and_config 2024-09-14T11:35:15.105 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:35:14.758+0000 7fb25093d800 10 monclient: build_initial_monmap 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:35:14.758+0000 7fb25093d800 1 build_initial for_mkfs: 0 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:35:14.758+0000 7fb25093d800 10 monclient: monmap: 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding auth protocol: cephx 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding auth protocol: cephx 2024-09-14T11:35:15.106 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding auth protocol: cephx 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: crc 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:35:14.758+0000 7fb25093d800 5 AuthRegistry(0x5624bb254c20) adding con mode: secure 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:35:14.759+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.107 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding auth protocol: cephx 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding auth protocol: cephx 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding auth protocol: cephx 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.108 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: crc 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed7dc0) adding con mode: secure 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:35:14.759+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:35:14.759+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:35:14.759+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key cmddesc rotate-key hook 0x7fffe0ed7f08 EEXIST 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb258db0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb283820 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb284bd0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:35:14.759+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.400911s 2024-09-14T11:35:15.109 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb258db0 auth_method 0 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb284bd0 auth_method 0 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb283820 auth_method 0 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.110 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:35:14.760+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:35:14.760+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_done global_id 8028 payload 274 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 1 monclient: found mon.noname-a 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:35:14.760+0000 7fb24ce2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: dump: 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.111 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:35:14.760+0000 7fb25093d800 5 monclient: authenticate success, global_id 8028 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:35:14.760+0000 7fb25093d800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:35:14.760+0000 7fb25093d800 4 set_mon_vals no callback set 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.112 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:35:14.760+0000 7fb1237fe640 10 monclient: dump: 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.113 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: shutdown 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: build_initial_monmap 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 build_initial for_mkfs: 0 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: monmap: 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding auth protocol: cephx 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding auth protocol: cephx 2024-09-14T11:35:15.114 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding auth protocol: cephx 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: crc 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb2799d0) adding con mode: secure 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:35:14.761+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: starting msgr at 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: starting objecter 2024-09-14T11:35:15.115 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 asok(0x5624baf98270) register_command objecter_requests cmddesc objecter_requests hook 0x5624bb257760 EEXIST 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: setting wanted keys 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:35:14.761+0000 7fb25093d800 1 librados: calling monclient init 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:35:14.761+0000 7fb25093d800 10 monclient: init 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding auth protocol: cephx 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding auth protocol: cephx 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding auth protocol: cephx 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.116 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: crc 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:35:14.761+0000 7fb25093d800 5 AuthRegistry(0x5624bb249860) adding con mode: secure 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:35:14.761+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:35:14.762+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:35:14.762+0000 7fb25093d800 5 asok(0x5624baf98270) register_command rotate-key cmddesc rotate-key hook 0x5624bb2499a8 EEXIST 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-c con 0x5624bb258db0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-b con 0x5624bb284bd0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): picked mon.noname-a con 0x5624bb254d40 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:15.117 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient(hunting): authenticate will time out at 2252.403265s 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request con 0x5624bb254d40 auth_method 0 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): get_auth_request con 0x5624bb258db0 auth_method 0 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): get_auth_request con 0x5624bb284bd0 auth_method 0 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.118 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:35:14.762+0000 7fb24c62a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:35:14.762+0000 7fb24be29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient(hunting): handle_auth_done global_id 8031 payload 824 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient: _finish_hunting 0 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 1 monclient: found mon.noname-a 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:35:14.762+0000 7fb24ce2b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: dump: 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.119 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:35:14.762+0000 7fb121ffb640 10 monclient: dump: 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:15.120 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:35:14.762+0000 7fb25093d800 5 monclient: authenticate success, global_id 8031 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:35:14.762+0000 7fb1237fe640 4 set_mon_vals no callback set 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:35:14.762+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:35:14.763+0000 7fb25093d800 10 monclient: _renew_subs 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:35:14.763+0000 7fb25093d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:35:14.763+0000 7fb25093d800 1 librados: init done 2024-09-14T11:35:15.121 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:35:14.763+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cr dump hook 0x5624bb27ce18 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:35:14.764+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:35:14.765+0000 7fb121ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:35:14.765+0000 7fb121ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:35:14.765+0000 7fb121ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:35:14.765+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb114077260 auth_method 0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:35:14.765+0000 7fb24be29640 10 monclient: get_auth_request con 0x5624bb2a3c80 auth_method 0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 realm 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:35:14.766+0000 7fb25093d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:35:14.766+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:35:14.766+0000 7fb24c62a640 10 monclient: get_auth_request con 0x5624bb2a7fa0 auth_method 0 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:35:14.767+0000 7fb25093d800 20 searching for the correct realm 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:35:14.767+0000 7fb24be29640 10 monclient: get_auth_request con 0x5624bb2ad240 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:35:14.768+0000 7fb24ce2b640 10 monclient: get_auth_request con 0x7fb24006b020 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:35:14.769+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb244004040 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:35:14.770+0000 7fb24be29640 10 monclient: get_auth_request con 0x7fb23c026040 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:35:14.770+0000 7fb24be29640 0 -- 172.21.15.28:0/912889229 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fb23c026040 msgr2=0x7fb23c057930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:35:14.770+0000 7fb121ffb640 1 client.8031.objecter ms_handle_reset 0x7fb23c026040 session 0x7fb23c01f040 osd.4 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:35:14.770+0000 7fb121ffb640 10 monclient: _renew_subs 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:35:14.770+0000 7fb121ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:35:14.771+0000 7fb24be29640 10 monclient: get_auth_request con 0x7fb114087a10 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:35:14.772+0000 7fb24ce2b640 10 monclient: get_auth_request con 0x7fb240093140 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:35:14.774+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb2400cb960 auth_method 0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:35:14.774+0000 7fb24c62a640 0 -- 172.21.15.28:0/912889229 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb2400cb960 msgr2=0x7fb2400bf9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:35:14.975+0000 7fb24c62a640 10 monclient: get_auth_request con 0x7fb2400cb960 auth_method 0 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:35:14.980+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 zone default found 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:35:14.981+0000 7fb25093d800 4 Realm: () 2024-09-14T11:35:15.124 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:35:14.981+0000 7fb25093d800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:35:14.981+0000 7fb25093d800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:35:14.981+0000 7fb25093d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 zonegroup default 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:35:14.981+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 started sync module instance, tier type = 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:35:14.982+0000 7fb25093d800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=0 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=1 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=2 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=3 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=4 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=5 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:35:14.991+0000 7fb25093d800 20 add_watcher() i=6 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:35:14.992+0000 7fb25093d800 20 add_watcher() i=7 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:35:14.992+0000 7fb25093d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding auth protocol: cephx 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding auth protocol: cephx 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding auth protocol: cephx 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:35:14.993+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.126 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: crc 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 AuthRegistry(0x7fffe0ed82a0) adding con mode: secure 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:35:14.993+0000 7fb102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:35:14.994+0000 7fb25093d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache list hook 0x5624bb278fc0 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache inspect hook 0x5624bb278fc0 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache erase hook 0x5624bb278fc0 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command cache zap hook 0x5624bb278fc0 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 note: GC not initialized 2024-09-14T11:35:15.127 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:35:14.994+0000 7fb101fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace show hook 0x7fb244004c80 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace history hook 0x7fb244004c80 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace active hook 0x7fb244004c80 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:35:14.994+0000 7fb25093d800 5 asok(0x5624baf98270) register_command sync trace active_short hook 0x7fb244004c80 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:35:14.994+0000 7fb25093d800 20 Filter name: none 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:35:14.994+0000 7fb0737fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:15.128 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:35:14.995+0000 7fb25093d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:35:14.995+0000 7fb25093d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:35:14.999+0000 7fb25093d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431648 cookie 94715758975680 notifier 8031 bl.length()=827 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:35:15.000+0000 7fb1237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:35:15.001+0000 7fb25093d800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.1 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.1 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.2 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.2 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.3 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.3 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:35:15.004+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:35:15.004+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:35:15.005+0000 7fb25093d800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:35:15.005+0000 7fb25093d800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:35:15.008+0000 7fb25093d800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb25093d800 time 2024-09-14T11:35:15.008254+0000 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb251f8c76a] 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:35:15.009+0000 7fb25093d800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fb25093d800 thread_name:radosgw-admin 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb250e3e6f0] 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb250e8b99c] 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb251f8c7c4] 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb251f8c928] 2024-09-14T11:35:15.132 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5624b88f60b1] 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x5624b8905124] 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5624b8905fc4] 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb250e29590] 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:15.137 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:35:15.138 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb0737fe640 / http_manager 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb101fdb640 / http_manager 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb102fdd640 / rgw_dt_lg_renew 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb121ffb640 / ms_dispatch 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb1237fe640 / io_context_pool 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb131ffb640 / ms_dispatch 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb138e09640 / ms_dispatch 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb13a60c640 / io_context_pool 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24be29640 / msgr-worker-2 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24c62a640 / msgr-worker-1 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24ce2b640 / msgr-worker-0 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb24d62c640 / io_context_pool 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: 7fb25093d800 / radosgw-admin 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:15.009910Z_d11ce5f6-153a-4c72-82dc-e7c05a50bcde/log 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:35:15.140 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:15.141 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.141 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.088+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.141 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 20 realm 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.089+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.090+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.090+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.090+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.091+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.142 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.091+0000 7f9f52d35800 20 searching for the correct realm 2024-09-14T11:35:15.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.295+0000 7f9f4e220640 0 -- 172.21.15.28:0/1372505935 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9f40023070 msgr2=0x7f9f4006bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.501+0000 7f9f4ea21640 0 -- 172.21.15.28:0/1372505935 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9f440833f0 msgr2=0x7f9f44083870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.709+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 20 zone default found 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 4 Realm: () 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 20 zonegroup default 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.710+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.711+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.711+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.711+0000 7f9f52d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.711+0000 7f9f52d35800 20 started sync module instance, tier type = 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.711+0000 7f9f52d35800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:15.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=0 2024-09-14T11:35:15.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=1 2024-09-14T11:35:15.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=2 2024-09-14T11:35:15.719 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=3 2024-09-14T11:35:15.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=4 2024-09-14T11:35:15.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=5 2024-09-14T11:35:15.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.721+0000 7f9f52d35800 20 add_watcher() i=6 2024-09-14T11:35:15.720 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.722+0000 7f9f52d35800 20 add_watcher() i=7 2024-09-14T11:35:15.721 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.722+0000 7f9f52d35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.722 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9e057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9f52d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.723 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9f52d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9f52d35800 5 note: GC not initialized 2024-09-14T11:35:15.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9d7ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:15.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9f52d35800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:15.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.725+0000 7f9f52d35800 20 Filter name: none 2024-09-14T11:35:15.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.726+0000 7f9d7dffb640 20 reqs_thread_entry: start 2024-09-14T11:35:15.724 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.726+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.726+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.726+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:15.725 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:15.726 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.727+0000 7f9f52d35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:15.727 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.729+0000 7f9e057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.731+0000 7f9f52d35800 20 remove_watcher() i=0 2024-09-14T11:35:15.729 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.731+0000 7f9f52d35800 2 removed watcher, disabling cache 2024-09-14T11:35:15.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.734+0000 7f9f52d35800 20 remove_watcher() i=1 2024-09-14T11:35:15.732 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.735+0000 7f9f52d35800 20 remove_watcher() i=2 2024-09-14T11:35:15.734 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.737+0000 7f9f52d35800 20 remove_watcher() i=3 2024-09-14T11:35:15.735 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.738+0000 7f9f52d35800 20 remove_watcher() i=4 2024-09-14T11:35:15.737 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.739+0000 7f9f52d35800 20 remove_watcher() i=5 2024-09-14T11:35:15.738 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.740+0000 7f9f52d35800 20 remove_watcher() i=6 2024-09-14T11:35:15.739 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.741+0000 7f9f52d35800 20 remove_watcher() i=7 2024-09-14T11:35:15.793 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:15.823 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.823 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.866+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 realm 2024-09-14T11:35:15.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.865 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.867+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.868+0000 7f543b346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.868+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.866 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.868+0000 7f543b346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.869+0000 7f543b346800 20 searching for the correct realm 2024-09-14T11:35:15.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.872+0000 7f5433fff640 0 -- 172.21.15.28:0/29929651 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f542c021070 msgr2=0x7f542c06e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.874 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.876+0000 7f5433fff640 0 -- 172.21.15.28:0/29929651 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f53040879e0 msgr2=0x7f5304089e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.877 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.879+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.878 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.879 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 zone default found 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 4 Realm: () 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 zonegroup default 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.880+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 started sync module instance, tier type = 2024-09-14T11:35:15.881 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.881+0000 7f543b346800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=0 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=1 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=2 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=3 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=4 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=5 2024-09-14T11:35:15.888 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.890+0000 7f543b346800 20 add_watcher() i=6 2024-09-14T11:35:15.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.891+0000 7f543b346800 20 add_watcher() i=7 2024-09-14T11:35:15.889 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.891+0000 7f543b346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.890 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.892+0000 7f52eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 5 note: GC not initialized 2024-09-14T11:35:15.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f52edfe3640 20 reqs_thread_entry: start 2024-09-14T11:35:15.891 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:15.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 20 Filter name: none 2024-09-14T11:35:15.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f525f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:15.892 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.893+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:15.893 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.894+0000 7f543b346800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.895+0000 7f543b346800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.895+0000 7f543b346800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:15.894 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.896+0000 7f52eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.898+0000 7f543b346800 20 remove_watcher() i=0 2024-09-14T11:35:15.896 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.898+0000 7f543b346800 2 removed watcher, disabling cache 2024-09-14T11:35:15.897 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.899+0000 7f543b346800 20 remove_watcher() i=1 2024-09-14T11:35:15.898 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.900+0000 7f543b346800 20 remove_watcher() i=2 2024-09-14T11:35:15.899 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.901+0000 7f543b346800 20 remove_watcher() i=3 2024-09-14T11:35:15.900 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.902+0000 7f543b346800 20 remove_watcher() i=4 2024-09-14T11:35:15.901 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.903+0000 7f543b346800 20 remove_watcher() i=5 2024-09-14T11:35:15.902 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.904+0000 7f543b346800 20 remove_watcher() i=6 2024-09-14T11:35:15.904 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:15.906+0000 7f543b346800 20 remove_watcher() i=7 2024-09-14T11:35:45.946 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:45.980 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:45.980 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:46.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.027+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 realm 2024-09-14T11:35:46.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:46.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.029+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.030+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.030+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.031+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:46.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.031+0000 7fd943012800 20 searching for the correct realm 2024-09-14T11:35:46.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.034+0000 7fd93dfdf640 0 -- 172.21.15.28:0/1051785383 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fd93006ebf0 msgr2=0x7fd930077860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:46.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.039+0000 7fd93e7e0640 0 -- 172.21.15.28:0/1051785383 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fd934069880 msgr2=0x7fd934073ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:46.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.247+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.248+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.248+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.248+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.248+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:46.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 zone default found 2024-09-14T11:35:46.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 4 Realm: () 2024-09-14T11:35:46.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 zonegroup default 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.249+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.248 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.250+0000 7fd943012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.250+0000 7fd943012800 20 started sync module instance, tier type = 2024-09-14T11:35:46.249 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.250+0000 7fd943012800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=0 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=1 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=2 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=3 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=4 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=5 2024-09-14T11:35:46.258 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.260+0000 7fd943012800 20 add_watcher() i=6 2024-09-14T11:35:46.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.261+0000 7fd943012800 20 add_watcher() i=7 2024-09-14T11:35:46.259 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.261+0000 7fd943012800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:46.261 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.263+0000 7fd7f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.263+0000 7fd943012800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.263+0000 7fd943012800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.263+0000 7fd943012800 5 note: GC not initialized 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.263+0000 7fd76f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.264+0000 7fd943012800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.264+0000 7fd943012800 20 Filter name: none 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.264+0000 7fd76d7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:46.262 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.264+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.264+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:46.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.264+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.265+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:46.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.265+0000 7fd943012800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:46.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.265+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.263 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.265+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:46.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.265+0000 7fd943012800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.266+0000 7fd943012800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:46.264 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.266+0000 7fd943012800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:46.265 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.267+0000 7fd7f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:46.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.270+0000 7fd943012800 20 remove_watcher() i=0 2024-09-14T11:35:46.267 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.270+0000 7fd943012800 2 removed watcher, disabling cache 2024-09-14T11:35:46.268 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.271+0000 7fd943012800 20 remove_watcher() i=1 2024-09-14T11:35:46.270 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.272+0000 7fd943012800 20 remove_watcher() i=2 2024-09-14T11:35:46.271 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.273+0000 7fd943012800 20 remove_watcher() i=3 2024-09-14T11:35:46.272 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.274+0000 7fd943012800 20 remove_watcher() i=4 2024-09-14T11:35:46.273 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.275+0000 7fd943012800 20 remove_watcher() i=5 2024-09-14T11:35:46.274 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.276+0000 7fd943012800 20 remove_watcher() i=6 2024-09-14T11:35:46.275 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.277+0000 7fd943012800 20 remove_watcher() i=7 2024-09-14T11:35:46.364 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:46.393 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:46.393 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:46.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.435+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 realm 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.435 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.437+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.436 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.438+0000 7ff20fd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.438+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.439+0000 7ff20fd75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:46.437 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.439+0000 7ff20fd75800 20 searching for the correct realm 2024-09-14T11:35:46.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.442+0000 7ff20e060640 0 -- 172.21.15.28:0/3058545481 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7ff204093040 msgr2=0x7ff204071aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:46.443 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.445+0000 7ff20d85f640 0 -- 172.21.15.28:0/3058545481 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ff204021020 msgr2=0x7ff20404d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.651+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.650 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.651 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 zone default found 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 4 Realm: () 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 zonegroup default 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.652+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.652 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 started sync module instance, tier type = 2024-09-14T11:35:46.653 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.653+0000 7ff20fd75800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=0 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=1 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=2 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=3 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=4 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=5 2024-09-14T11:35:46.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.663+0000 7ff20fd75800 20 add_watcher() i=6 2024-09-14T11:35:46.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.664+0000 7ff20fd75800 20 add_watcher() i=7 2024-09-14T11:35:46.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.664+0000 7ff20fd75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:46.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff0bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff20fd75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff20fd75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff20fd75800 5 note: GC not initialized 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff0be7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff20fd75800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.666+0000 7ff20fd75800 20 Filter name: none 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff02ffff640 20 reqs_thread_entry: start 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:46.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:46.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:46.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.667+0000 7ff20fd75800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:46.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.668+0000 7ff20fd75800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:46.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.669+0000 7ff20fd75800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:46.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.669+0000 7ff20fd75800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:46.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.670+0000 7ff0bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:46.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.672+0000 7ff20fd75800 20 remove_watcher() i=0 2024-09-14T11:35:46.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.672+0000 7ff20fd75800 2 removed watcher, disabling cache 2024-09-14T11:35:46.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.673+0000 7ff20fd75800 20 remove_watcher() i=1 2024-09-14T11:35:46.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.674+0000 7ff20fd75800 20 remove_watcher() i=2 2024-09-14T11:35:46.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.675+0000 7ff20fd75800 20 remove_watcher() i=3 2024-09-14T11:35:46.674 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.677+0000 7ff20fd75800 20 remove_watcher() i=4 2024-09-14T11:35:46.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.678+0000 7ff20fd75800 20 remove_watcher() i=5 2024-09-14T11:35:46.676 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.678+0000 7ff20fd75800 20 remove_watcher() i=6 2024-09-14T11:35:46.677 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.680+0000 7ff20fd75800 20 remove_watcher() i=7 2024-09-14T11:35:46.690 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:46.719 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:46.719 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:46.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.760+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.762+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.762+0000 7f351392e800 20 realm 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.762+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.762+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.762+0000 7f351392e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.762+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.763+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.763+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.764+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.764+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.764+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:46.762 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.764+0000 7f351392e800 20 searching for the correct realm 2024-09-14T11:35:46.765 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.767+0000 7f350fede640 0 -- 172.21.15.28:0/2961335813 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f3504082040 msgr2=0x7f3504084950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:46.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.771+0000 7f350f6dd640 0 -- 172.21.15.28:0/2961335813 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f350409a410 msgr2=0x7f350409a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:46.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.775+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:46.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 zone default found 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 4 Realm: () 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 zonegroup default 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.776+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.777+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.777+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.777+0000 7f351392e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.777+0000 7f351392e800 20 started sync module instance, tier type = 2024-09-14T11:35:46.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.777+0000 7f351392e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=0 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=1 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=2 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=3 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=4 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=5 2024-09-14T11:35:46.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.786+0000 7f351392e800 20 add_watcher() i=6 2024-09-14T11:35:46.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.787+0000 7f351392e800 20 add_watcher() i=7 2024-09-14T11:35:46.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.787+0000 7f351392e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:46.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.788+0000 7f33c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:46.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f351392e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:46.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f351392e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:46.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f351392e800 5 note: GC not initialized 2024-09-14T11:35:46.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f33c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:46.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f351392e800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:46.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f351392e800 20 Filter name: none 2024-09-14T11:35:46.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f333e7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:46.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.789+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.790+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:46.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.790+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.790+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.790+0000 7f351392e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.790+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.791+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.791+0000 7f351392e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.791+0000 7f351392e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:46.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.791+0000 7f351392e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:46.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.792+0000 7f33c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:46.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.795+0000 7f351392e800 20 remove_watcher() i=0 2024-09-14T11:35:46.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.795+0000 7f351392e800 2 removed watcher, disabling cache 2024-09-14T11:35:46.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.796+0000 7f351392e800 20 remove_watcher() i=1 2024-09-14T11:35:46.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.797+0000 7f351392e800 20 remove_watcher() i=2 2024-09-14T11:35:46.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.798+0000 7f351392e800 20 remove_watcher() i=3 2024-09-14T11:35:46.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.799+0000 7f351392e800 20 remove_watcher() i=4 2024-09-14T11:35:46.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.800+0000 7f351392e800 20 remove_watcher() i=5 2024-09-14T11:35:46.798 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.801+0000 7f351392e800 20 remove_watcher() i=6 2024-09-14T11:35:46.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.802+0000 7f351392e800 20 remove_watcher() i=7 2024-09-14T11:35:46.811 INFO:tasks.workunit.client.0.smithi028.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:35:46.812 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:46.842 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:46.842 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:46.880 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.882+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.884+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.884+0000 7f08e5e0e800 20 realm 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.884+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.885+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.885+0000 7f08e5e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.885+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.885+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:46.883 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.885+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.886+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:46.884 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.886+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:46.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.887+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:46.885 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.887+0000 7f08e5e0e800 20 searching for the correct realm 2024-09-14T11:35:46.887 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:46.889+0000 7f08e0d6a640 0 -- 172.21.15.28:0/2809976599 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f08d40c1040 msgr2=0x7f08d40ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:47.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.096+0000 7f08e156b640 0 -- 172.21.15.28:0/2809976599 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f08cc03aa10 msgr2=0x7f08cc00c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:47.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.303+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 zone default found 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 4 Realm: () 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:47.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 zonegroup default 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.304+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 started sync module instance, tier type = 2024-09-14T11:35:47.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.305+0000 7f08e5e0e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.315+0000 7f08e5e0e800 20 add_watcher() i=0 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.315+0000 7f08e5e0e800 20 add_watcher() i=1 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.315+0000 7f08e5e0e800 20 add_watcher() i=2 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.315+0000 7f08e5e0e800 20 add_watcher() i=3 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.315+0000 7f08e5e0e800 20 add_watcher() i=4 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.315+0000 7f08e5e0e800 20 add_watcher() i=5 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.316+0000 7f08e5e0e800 20 add_watcher() i=6 2024-09-14T11:35:47.314 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.317+0000 7f08e5e0e800 20 add_watcher() i=7 2024-09-14T11:35:47.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.317+0000 7f08e5e0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:47.316 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.318+0000 7f0797fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f08e5e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:47.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f08e5e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:47.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f08e5e0e800 5 note: GC not initialized 2024-09-14T11:35:47.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f0796fe5640 20 reqs_thread_entry: start 2024-09-14T11:35:47.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f08e5e0e800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:47.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f08e5e0e800 20 Filter name: none 2024-09-14T11:35:47.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f0794fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:47.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.319+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.320+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.320+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.321+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:47.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.321+0000 7f08e5e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:47.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.321+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.322+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.322+0000 7f08e5e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.322+0000 7f08e5e0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:47.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.322+0000 7f08e5e0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:47.322 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.324+0000 7f0797fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.326+0000 7f08e5e0e800 20 remove_watcher() i=0 2024-09-14T11:35:47.324 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.326+0000 7f08e5e0e800 2 removed watcher, disabling cache 2024-09-14T11:35:47.325 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.327+0000 7f08e5e0e800 20 remove_watcher() i=1 2024-09-14T11:35:47.326 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.328+0000 7f08e5e0e800 20 remove_watcher() i=2 2024-09-14T11:35:47.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.330+0000 7f08e5e0e800 20 remove_watcher() i=3 2024-09-14T11:35:47.329 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.331+0000 7f08e5e0e800 20 remove_watcher() i=4 2024-09-14T11:35:47.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.332+0000 7f08e5e0e800 20 remove_watcher() i=5 2024-09-14T11:35:47.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.333+0000 7f08e5e0e800 20 remove_watcher() i=6 2024-09-14T11:35:47.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.334+0000 7f08e5e0e800 20 remove_watcher() i=7 2024-09-14T11:35:47.344 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.344 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:35:47.344 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-14T11:35:47.344 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.346 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:35:47.382 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:47.382 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:47.423 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.425+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.426+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.426+0000 7fdd03f40800 20 realm 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.427+0000 7fdd03f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.425 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:47.426 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.428+0000 7fdd03f40800 20 searching for the correct realm 2024-09-14T11:35:47.430 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.432+0000 7fdcff485640 0 -- 172.21.15.28:0/3117147451 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5607a5cb0e00 msgr2=0x5607a5cb32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.433 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.435+0000 7fdcffc86640 0 -- 172.21.15.28:0/3117147451 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fdcf4063400 msgr2=0x7fdcf4063860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.439 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 zone default found 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 4 Realm: () 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 zonegroup default 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.440 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.442+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.442+0000 7fdd03f40800 20 started sync module instance, tier type = 2024-09-14T11:35:47.441 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.442+0000 7fdd03f40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:47.448 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=0 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=1 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=2 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=3 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=4 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=5 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=6 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.451+0000 7fdd03f40800 20 add_watcher() i=7 2024-09-14T11:35:47.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.451+0000 7fdd03f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:47.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.453+0000 7fdbb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.453+0000 7fdd03f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.453+0000 7fdd03f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.453+0000 7fdd03f40800 5 note: GC not initialized 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.454+0000 7fdbb4fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.454+0000 7fdd03f40800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.454+0000 7fdd03f40800 20 Filter name: none 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.454+0000 7fdb2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.454+0000 7fdd03f40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:47.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.454+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:47.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:47.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:47.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:47.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:47.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.454 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.455+0000 7fdd03f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdd03f40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdd03f40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdd03f40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94590846315664 notifier 8160 bl.length()=827 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.457 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.458 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:35:47.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:35:47.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:35:47.459 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:35:47.461 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd03f40800 time 2024-09-14T11:35:47.464659+0000 2024-09-14T11:35:47.461 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:47.462 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.462 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdd0578c76a] 2024-09-14T11:35:47.462 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.462 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.462 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.464+0000 7fdd03f40800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd03f40800 time 2024-09-14T11:35:47.464659+0000 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.463 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdd0578c76a] 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:35:47.464 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.465 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:47.465 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fdd03f40800 thread_name:radosgw-admin 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdd0443e6f0] 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdd0448b99c] 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdd0578c7c4] 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.483 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.465+0000 7fdd03f40800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fdd03f40800 thread_name:radosgw-admin 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdd0443e6f0] 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdd0448b99c] 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:47.484 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdd0578c7c4] 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:35:47.407+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.485 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:35:47.407+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:35:47.408+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding auth protocol: cephx 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding auth protocol: cephx 2024-09-14T11:35:47.486 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding auth protocol: cephx 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:35:47.408+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.487 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: starting msgr at 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: starting objecter 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command objecter_requests hook 0x5607a5bc3b00 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: setting wanted keys 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: calling monclient init 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:35:47.408+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding auth protocol: cephx 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding auth protocol: cephx 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding auth protocol: cephx 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.488 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:35:47.408+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:35:47.408+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key hook 0x5607a5bbe858 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5a34d50 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.489 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5a6b2c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5b00f40 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.050081s 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5a6b2c0 auth_method 0 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5b00f40 auth_method 0 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.490 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5a34d50 auth_method 0 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_done global_id 8151 payload 824 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.491 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:35:47.409+0000 7fdd00487640 1 monclient: found mon.noname-a 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: dump: 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.492 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: dump: 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.493 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:35:47.409+0000 7fdd03f40800 5 monclient: authenticate success, global_id 8151 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:35:47.409+0000 7fdbede0b640 4 set_mon_vals no callback set 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:35:47.409+0000 7fdd03f40800 1 librados: init done 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:35:47.411+0000 7fdbe7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:35:47.411+0000 7fdbe7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:35:47.411+0000 7fdbe7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.494 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:35:47.412+0000 7fdcffc86640 10 monclient: get_auth_request con 0x7fdbe8077230 auth_method 0 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:35:47.412+0000 7fdcff485640 10 monclient: get_auth_request con 0x5607a5be5750 auth_method 0 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:35:47.413+0000 7fdcffc86640 10 monclient: get_auth_request con 0x5607a5c0a210 auth_method 0 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:35:47.414+0000 7fdcff485640 10 monclient: get_auth_request con 0x5607a5c0f2a0 auth_method 0 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:35:47.415+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:35:47.415+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:35:47.415+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.495 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding auth protocol: cephx 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding auth protocol: cephx 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding auth protocol: cephx 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.496 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:35:47.415+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command objecter_requests cmddesc objecter_requests hook 0x5607a5c16860 EEXIST 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:35:47.415+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding auth protocol: cephx 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding auth protocol: cephx 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding auth protocol: cephx 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.497 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:35:47.416+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:35:47.416+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:35:47.416+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key cmddesc rotate-key hook 0x5607a5c12350 EEXIST 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:47.498 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5c3ab80 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5c3af60 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5c39890 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.057529s 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5c3ab80 auth_method 0 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5c3af60 auth_method 0 2024-09-14T11:35:47.499 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5c39890 auth_method 0 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.500 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_done global_id 8154 payload 824 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:35:47.416+0000 7fdcffc86640 1 monclient: found mon.noname-a 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: dump: 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.501 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: dump: 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.502 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:35:47.417+0000 7fdd03f40800 5 monclient: authenticate success, global_id 8154 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:35:47.417+0000 7fdd00c88640 4 set_mon_vals no callback set 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.503 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:35:47.419+0000 7fdbe57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:35:47.419+0000 7fdbe57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:35:47.419+0000 7fdbe57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:35:47.419+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdbd8077140 auth_method 0 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:35:47.419+0000 7fdd03f40800 10 monclient: get_monmap_and_config 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:35:47.419+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:35:47.419+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:35:47.419+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.504 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding auth protocol: cephx 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding auth protocol: cephx 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding auth protocol: cephx 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.505 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:35:47.420+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding auth protocol: cephx 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding auth protocol: cephx 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding auth protocol: cephx 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.506 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:35:47.420+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:35:47.420+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key cmddesc rotate-key hook 0x7fffacce25e8 EEXIST 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5c8ef00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5c5ff10 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.507 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5c8a3e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.061664s 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5c8a3e0 auth_method 0 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5c5ff10 auth_method 0 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.508 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5c8ef00 auth_method 0 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:35:47.421+0000 7fdd00487640 10 monclient(hunting): handle_auth_done global_id 7637 payload 274 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:35:47.421+0000 7fdd00487640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.509 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:35:47.421+0000 7fdd00487640 1 monclient: found mon.noname-c 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:35:47.421+0000 7fdd00487640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: dump: 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.510 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: dump: 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.511 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:35:47.421+0000 7fdd03f40800 5 monclient: authenticate success, global_id 7637 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:35:47.421+0000 7fdd03f40800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:35:47.421+0000 7fdd03f40800 4 set_mon_vals no callback set 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:35:47.421+0000 7fdd03f40800 10 monclient: shutdown 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.512 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding auth protocol: cephx 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding auth protocol: cephx 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding auth protocol: cephx 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.513 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:35:47.422+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: starting msgr at 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: starting objecter 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command objecter_requests cmddesc objecter_requests hook 0x5607a5c3b360 EEXIST 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: setting wanted keys 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: calling monclient init 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding auth protocol: cephx 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding auth protocol: cephx 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding auth protocol: cephx 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.514 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:35:47.422+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:35:47.422+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key cmddesc rotate-key hook 0x5607a5c4f588 EEXIST 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5c5ff10 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.515 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5c8a3e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5c8ef00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.064027s 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5c8a3e0 auth_method 0 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5c5ff10 auth_method 0 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.516 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5c8ef00 auth_method 0 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_done global_id 8160 payload 824 2024-09-14T11:35:47.517 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:35:47.423+0000 7fdcffc86640 1 monclient: found mon.noname-a 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: dump: 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.518 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: dump: 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.519 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:35:47.423+0000 7fdd03f40800 5 monclient: authenticate success, global_id 8160 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:35:47.423+0000 7fdbdeffd640 4 set_mon_vals no callback set 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:35:47.423+0000 7fdd03f40800 1 librados: init done 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:35:47.423+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cr dump hook 0x5607a5a699d8 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:35:47.425+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:35:47.426+0000 7fdbdd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:35:47.426+0000 7fdbdd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:35:47.426+0000 7fdbdd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:35:47.426+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdbc8077260 auth_method 0 2024-09-14T11:35:47.520 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:35:47.426+0000 7fdd00487640 10 monclient: get_auth_request con 0x5607a5ca7900 auth_method 0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:35:47.426+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:35:47.426+0000 7fdd03f40800 20 realm 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:35:47.427+0000 7fdd03f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.521 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:35:47.427+0000 7fdcffc86640 10 monclient: get_auth_request con 0x5607a5cabb60 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 searching for the correct realm 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:35:47.428+0000 7fdcff485640 10 monclient: get_auth_request con 0x5607a5cb0e00 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:35:47.429+0000 7fdd00487640 10 monclient: get_auth_request con 0x7fdcf407a070 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:35:47.430+0000 7fdcffc86640 10 monclient: get_auth_request con 0x7fdcf806bba0 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:35:47.431+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdcf001f070 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:35:47.432+0000 7fdcff485640 0 -- 172.21.15.28:0/3117147451 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5607a5cb0e00 msgr2=0x5607a5cb32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:35:47.432+0000 7fdbdd7fa640 1 client.8160.objecter ms_handle_reset 0x5607a5cb0e00 session 0x5607a5cb0780 osd.3 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:35:47.432+0000 7fdbdd7fa640 10 monclient: _renew_subs 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:35:47.432+0000 7fdbdd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:35:47.432+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdbc8087a10 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:35:47.433+0000 7fdd00487640 10 monclient: get_auth_request con 0x7fdcf40a1920 auth_method 0 2024-09-14T11:35:47.522 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:35:47.435+0000 7fdcffc86640 10 monclient: get_auth_request con 0x7fdcf4063400 auth_method 0 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:35:47.435+0000 7fdcffc86640 0 -- 172.21.15.28:0/3117147451 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fdcf4063400 msgr2=0x7fdcf4063860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:35:47.435+0000 7fdbdd7fa640 1 client.8160.objecter ms_handle_reset 0x7fdcf4063400 session 0x7fdcf40a9040 osd.0 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:35:47.435+0000 7fdcffc86640 10 monclient: get_auth_request con 0x5607a5cb0e00 auth_method 0 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.523 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 zone default found 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:35:47.441+0000 7fdd03f40800 4 Realm: () 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:35:47.441+0000 7fdd03f40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:35:47.441+0000 7fdd03f40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:35:47.441+0000 7fdd03f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 zonegroup default 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:35:47.442+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:35:47.442+0000 7fdd03f40800 20 started sync module instance, tier type = 2024-09-14T11:35:47.524 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:35:47.442+0000 7fdd03f40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=0 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=1 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=2 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=3 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=4 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=5 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=6 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:35:47.451+0000 7fdd03f40800 20 add_watcher() i=7 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:35:47.451+0000 7fdd03f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding auth protocol: cephx 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding auth protocol: cephx 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding auth protocol: cephx 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.525 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:35:47.453+0000 7fdbb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:35:47.453+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:35:47.453+0000 7fdd03f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:35:47.453+0000 7fdd03f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache list hook 0x5607a5c824d0 2024-09-14T11:35:47.526 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache inspect hook 0x5607a5c824d0 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache erase hook 0x5607a5c824d0 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache zap hook 0x5607a5c824d0 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 note: GC not initialized 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:35:47.454+0000 7fdbb4fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace show hook 0x7fdcf000e070 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace history hook 0x7fdcf000e070 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace active hook 0x7fdcf000e070 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace active_short hook 0x7fdcf000e070 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:35:47.454+0000 7fdd03f40800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:47.527 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:35:47.454+0000 7fdd03f40800 20 Filter name: none 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:35:47.454+0000 7fdb2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:35:47.454+0000 7fdd03f40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:35:47.454+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:47.528 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94590846315664 notifier 8160 bl.length()=827 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:35:47.464+0000 7fdd03f40800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd03f40800 time 2024-09-14T11:35:47.464659+0000 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:47.529 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdd0578c76a] 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:35:47.465+0000 7fdd03f40800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fdd03f40800 thread_name:radosgw-admin 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdd0443e6f0] 2024-09-14T11:35:47.530 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdd0448b99c] 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdd0578c7c4] 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:35:47.531 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:35:47.532 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:35:47.533 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:35:47.534 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:35:47.535 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:47.536 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:47.537 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdb2e7fc640 / http_manager 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbb4fe1640 / http_manager 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbb5fe3640 / rgw_dt_lg_renew 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbdd7fa640 / ms_dispatch 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbde7fc640 / io_context_pool 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbdeffd640 / io_context_pool 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbe57fa640 / ms_dispatch 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbe7fff640 / ms_dispatch 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbede0b640 / io_context_pool 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdcff485640 / msgr-worker-2 2024-09-14T11:35:47.538 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdcffc86640 / msgr-worker-1 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdd00487640 / msgr-worker-0 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdd00c88640 / io_context_pool 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdd03f40800 / radosgw-admin 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.149127.log 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:35:47.407+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:35:47.407+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:35:47.408+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.539 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding auth protocol: cephx 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding auth protocol: cephx 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding auth protocol: cephx 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.540 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: crc 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bc4390) adding con mode: secure 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:35:47.408+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: starting msgr at 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: starting objecter 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command objecter_requests hook 0x5607a5bc3b00 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: setting wanted keys 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:35:47.408+0000 7fdd03f40800 1 librados: calling monclient init 2024-09-14T11:35:47.541 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:35:47.408+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding auth protocol: cephx 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding auth protocol: cephx 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding auth protocol: cephx 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.542 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: crc 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 AuthRegistry(0x5607a5bbe710) adding con mode: secure 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:35:47.408+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:35:47.408+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:35:47.408+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key hook 0x5607a5bbe858 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5a34d50 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5a6b2c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5b00f40 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.543 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.050081s 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5a6b2c0 auth_method 0 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5b00f40 auth_method 0 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.544 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:35:47.409+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5a34d50 auth_method 0 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:35:47.409+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient(hunting): handle_auth_done global_id 8151 payload 824 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:35:47.409+0000 7fdd00487640 1 monclient: found mon.noname-a 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:35:47.409+0000 7fdd00487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: dump: 2024-09-14T11:35:47.545 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:35:47.409+0000 7fdbe7fff640 10 monclient: dump: 2024-09-14T11:35:47.546 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:35:47.409+0000 7fdd03f40800 5 monclient: authenticate success, global_id 8151 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:35:47.409+0000 7fdbede0b640 4 set_mon_vals no callback set 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.547 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:35:47.409+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:35:47.409+0000 7fdd03f40800 1 librados: init done 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:35:47.411+0000 7fdbe7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:35:47.411+0000 7fdbe7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:35:47.411+0000 7fdbe7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:35:47.412+0000 7fdcffc86640 10 monclient: get_auth_request con 0x7fdbe8077230 auth_method 0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:35:47.412+0000 7fdcff485640 10 monclient: get_auth_request con 0x5607a5be5750 auth_method 0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:35:47.413+0000 7fdcffc86640 10 monclient: get_auth_request con 0x5607a5c0a210 auth_method 0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:35:47.414+0000 7fdcff485640 10 monclient: get_auth_request con 0x5607a5c0f2a0 auth_method 0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:35:47.415+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:35:47.415+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:35:47.415+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.548 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding auth protocol: cephx 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding auth protocol: cephx 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding auth protocol: cephx 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.549 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: crc 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c13360) adding con mode: secure 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:35:47.415+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command objecter_requests cmddesc objecter_requests hook 0x5607a5c16860 EEXIST 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:35:47.415+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding auth protocol: cephx 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding auth protocol: cephx 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding auth protocol: cephx 2024-09-14T11:35:47.550 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: crc 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:35:47.415+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c12208) adding con mode: secure 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:35:47.416+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:35:47.416+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:35:47.416+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key cmddesc rotate-key hook 0x5607a5c12350 EEXIST 2024-09-14T11:35:47.551 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5c3ab80 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5c3af60 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5c39890 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:35:47.416+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.057529s 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5c3ab80 auth_method 0 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5c3af60 auth_method 0 2024-09-14T11:35:47.552 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5c39890 auth_method 0 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:35:47.416+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.553 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:35:47.416+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient(hunting): handle_auth_done global_id 8154 payload 824 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:35:47.416+0000 7fdcffc86640 1 monclient: found mon.noname-a 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:35:47.416+0000 7fdcffc86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: dump: 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.554 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:35:47.417+0000 7fdbe57fa640 10 monclient: dump: 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.555 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:35:47.417+0000 7fdd03f40800 5 monclient: authenticate success, global_id 8154 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:35:47.417+0000 7fdd00c88640 4 set_mon_vals no callback set 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:35:47.417+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:35:47.419+0000 7fdbe57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:35:47.419+0000 7fdbe57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:35:47.419+0000 7fdbe57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:35:47.419+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdbd8077140 auth_method 0 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:35:47.419+0000 7fdd03f40800 10 monclient: get_monmap_and_config 2024-09-14T11:35:47.556 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:35:47.419+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:35:47.419+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:35:47.419+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding auth protocol: cephx 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding auth protocol: cephx 2024-09-14T11:35:47.557 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding auth protocol: cephx 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: crc 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:35:47.419+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c5a900) adding con mode: secure 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:35:47.420+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.558 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding auth protocol: cephx 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding auth protocol: cephx 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding auth protocol: cephx 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: crc 2024-09-14T11:35:47.559 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce24a0) adding con mode: secure 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:35:47.420+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:35:47.420+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:35:47.420+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key cmddesc rotate-key hook 0x7fffacce25e8 EEXIST 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5c8ef00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5c5ff10 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5c8a3e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.560 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:35:47.420+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.061664s 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5c8a3e0 auth_method 0 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5c5ff10 auth_method 0 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:35:47.420+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.561 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5c8ef00 auth_method 0 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:35:47.420+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:35:47.420+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:35:47.421+0000 7fdd00487640 10 monclient(hunting): handle_auth_done global_id 7637 payload 274 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:35:47.421+0000 7fdd00487640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:35:47.421+0000 7fdd00487640 1 monclient: found mon.noname-c 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:35:47.421+0000 7fdd00487640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:35:47.562 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: dump: 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.563 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:35:47.421+0000 7fdbdeffd640 10 monclient: dump: 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:35:47.421+0000 7fdd03f40800 5 monclient: authenticate success, global_id 7637 2024-09-14T11:35:47.564 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:35:47.421+0000 7fdd03f40800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:35:47.421+0000 7fdd03f40800 4 set_mon_vals no callback set 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:35:47.421+0000 7fdd03f40800 10 monclient: shutdown 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: build_initial_monmap 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 build_initial for_mkfs: 0 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: monmap: 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:35:47.565 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding auth protocol: cephx 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding auth protocol: cephx 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding auth protocol: cephx 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.566 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: crc 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c7f6f0) adding con mode: secure 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:35:47.422+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: starting msgr at 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: starting objecter 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command objecter_requests cmddesc objecter_requests hook 0x5607a5c3b360 EEXIST 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: setting wanted keys 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:35:47.422+0000 7fdd03f40800 1 librados: calling monclient init 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: init 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding auth protocol: cephx 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding auth protocol: cephx 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding auth protocol: cephx 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.567 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: crc 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 AuthRegistry(0x5607a5c4f440) adding con mode: secure 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:35:47.422+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:35:47.422+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:35:47.422+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command rotate-key cmddesc rotate-key hook 0x5607a5c4f588 EEXIST 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:47.568 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-a con 0x5607a5c5ff10 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:35:47.422+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-c con 0x5607a5c8a3e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): picked mon.noname-b con 0x5607a5c8ef00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient(hunting): authenticate will time out at 2285.064027s 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): get_auth_request con 0x5607a5c8a3e0 auth_method 0 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): get_auth_request con 0x5607a5c5ff10 auth_method 0 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.569 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): get_auth_request con 0x5607a5c8ef00 auth_method 0 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:35:47.423+0000 7fdcff485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:35:47.423+0000 7fdd00487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient(hunting): handle_auth_done global_id 8160 payload 824 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient: _finish_hunting 0 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:35:47.423+0000 7fdcffc86640 1 monclient: found mon.noname-a 2024-09-14T11:35:47.570 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:35:47.423+0000 7fdcffc86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: dump: 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.571 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:35:47.423+0000 7fdbdd7fa640 10 monclient: dump: 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:35:47.572 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:35:47.423+0000 7fdd03f40800 5 monclient: authenticate success, global_id 8160 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:35:47.423+0000 7fdbdeffd640 4 set_mon_vals no callback set 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _renew_subs 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:35:47.423+0000 7fdd03f40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:35:47.423+0000 7fdd03f40800 1 librados: init done 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:35:47.423+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cr dump hook 0x5607a5a699d8 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:35:47.425+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:35:47.426+0000 7fdbdd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:35:47.426+0000 7fdbdd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:35:47.426+0000 7fdbdd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:35:47.426+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdbc8077260 auth_method 0 2024-09-14T11:35:47.573 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:35:47.426+0000 7fdd00487640 10 monclient: get_auth_request con 0x5607a5ca7900 auth_method 0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:35:47.426+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:35:47.426+0000 7fdd03f40800 20 realm 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:35:47.427+0000 7fdd03f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:35:47.427+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:35:47.427+0000 7fdcffc86640 10 monclient: get_auth_request con 0x5607a5cabb60 auth_method 0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:35:47.428+0000 7fdd03f40800 20 searching for the correct realm 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:35:47.428+0000 7fdcff485640 10 monclient: get_auth_request con 0x5607a5cb0e00 auth_method 0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:35:47.429+0000 7fdd00487640 10 monclient: get_auth_request con 0x7fdcf407a070 auth_method 0 2024-09-14T11:35:47.574 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:35:47.430+0000 7fdcffc86640 10 monclient: get_auth_request con 0x7fdcf806bba0 auth_method 0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:35:47.431+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdcf001f070 auth_method 0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:35:47.432+0000 7fdcff485640 0 -- 172.21.15.28:0/3117147451 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5607a5cb0e00 msgr2=0x5607a5cb32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:35:47.432+0000 7fdbdd7fa640 1 client.8160.objecter ms_handle_reset 0x5607a5cb0e00 session 0x5607a5cb0780 osd.3 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:35:47.432+0000 7fdbdd7fa640 10 monclient: _renew_subs 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:35:47.432+0000 7fdbdd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:35:47.432+0000 7fdcff485640 10 monclient: get_auth_request con 0x7fdbc8087a10 auth_method 0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:35:47.433+0000 7fdd00487640 10 monclient: get_auth_request con 0x7fdcf40a1920 auth_method 0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:35:47.435+0000 7fdcffc86640 10 monclient: get_auth_request con 0x7fdcf4063400 auth_method 0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:35:47.435+0000 7fdcffc86640 0 -- 172.21.15.28:0/3117147451 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fdcf4063400 msgr2=0x7fdcf4063860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:35:47.435+0000 7fdbdd7fa640 1 client.8160.objecter ms_handle_reset 0x7fdcf4063400 session 0x7fdcf40a9040 osd.0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:35:47.435+0000 7fdcffc86640 10 monclient: get_auth_request con 0x5607a5cb0e00 auth_method 0 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:47.575 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:35:47.440+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 zone default found 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:35:47.441+0000 7fdd03f40800 4 Realm: () 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:35:47.441+0000 7fdd03f40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:35:47.441+0000 7fdd03f40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:35:47.441+0000 7fdd03f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 zonegroup default 2024-09-14T11:35:47.576 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:35:47.441+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:35:47.442+0000 7fdd03f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:35:47.442+0000 7fdd03f40800 20 started sync module instance, tier type = 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:35:47.442+0000 7fdd03f40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=0 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=1 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=2 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=3 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=4 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=5 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:35:47.450+0000 7fdd03f40800 20 add_watcher() i=6 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:35:47.451+0000 7fdd03f40800 20 add_watcher() i=7 2024-09-14T11:35:47.577 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:35:47.451+0000 7fdd03f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding auth protocol: cephx 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding auth protocol: cephx 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding auth protocol: cephx 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.578 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: crc 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 AuthRegistry(0x7fffacce2980) adding con mode: secure 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:35:47.453+0000 7fdbb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:35:47.453+0000 7fdd03f40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:35:47.453+0000 7fdd03f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:35:47.453+0000 7fdd03f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache list hook 0x5607a5c824d0 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache inspect hook 0x5607a5c824d0 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache erase hook 0x5607a5c824d0 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command cache zap hook 0x5607a5c824d0 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:35:47.453+0000 7fdd03f40800 5 note: GC not initialized 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:35:47.454+0000 7fdbb4fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace show hook 0x7fdcf000e070 2024-09-14T11:35:47.579 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace history hook 0x7fdcf000e070 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace active hook 0x7fdcf000e070 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:35:47.454+0000 7fdd03f40800 5 asok(0x5607a599e270) register_command sync trace active_short hook 0x7fdcf000e070 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:35:47.454+0000 7fdd03f40800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:35:47.454+0000 7fdd03f40800 20 Filter name: none 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:35:47.454+0000 7fdb2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:35:47.454+0000 7fdd03f40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:35:47.454+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:35:47.455+0000 7fdd03f40800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.580 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:35:47.455+0000 7fdd03f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:35:47.459+0000 7fdd03f40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94590846315664 notifier 8160 bl.length()=827 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:35:47.459+0000 7fdbde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:35:47.581 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:35:47.461+0000 7fdd03f40800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:35:47.464+0000 7fdd03f40800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdd03f40800 time 2024-09-14T11:35:47.464659+0000 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdd0578c76a] 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:35:47.582 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:35:47.465+0000 7fdd03f40800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fdd03f40800 thread_name:radosgw-admin 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdd0443e6f0] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdd0448b99c] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdd0578c7c4] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdd0578c928] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607a3dfc0b1] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5607a3e0bf6a] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdd04429590] 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:35:47.583 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:47.584 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:35:47.585 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:35:47.586 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:35:47.587 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:47.588 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:35:47.589 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdb2e7fc640 / http_manager 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbb4fe1640 / http_manager 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbb5fe3640 / rgw_dt_lg_renew 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbdd7fa640 / ms_dispatch 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbde7fc640 / io_context_pool 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbdeffd640 / io_context_pool 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbe57fa640 / ms_dispatch 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbe7fff640 / ms_dispatch 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdbede0b640 / io_context_pool 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdcff485640 / msgr-worker-2 2024-09-14T11:35:47.590 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdcffc86640 / msgr-worker-1 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdd00487640 / msgr-worker-0 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdd00c88640 / io_context_pool 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr: 7fdd03f40800 / radosgw-admin 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:47.466069Z_a26e4931-f7f6-4564-8d6f-bbdcdf9440e1/log 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:35:47.591 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.543+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 realm 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.545+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.546+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.546+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.546+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:47.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.546+0000 7f1c34175800 20 searching for the correct realm 2024-09-14T11:35:47.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.549+0000 7f1c32460640 0 -- 172.21.15.28:0/2227300662 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f1c2807a070 msgr2=0x7f1c28094430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.553+0000 7f1c31c5f640 0 -- 172.21.15.28:0/2227300662 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f1c28063400 msgr2=0x7f1c28063880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:47.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:47.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:47.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:47.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:47.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:47.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:47.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.760+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 zone default found 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 4 Realm: () 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 zonegroup default 2024-09-14T11:35:47.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.761+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.762+0000 7f1c34175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.762+0000 7f1c34175800 20 started sync module instance, tier type = 2024-09-14T11:35:47.761 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.762+0000 7f1c34175800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=0 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=1 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=2 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=3 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=4 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=5 2024-09-14T11:35:47.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.771+0000 7f1c34175800 20 add_watcher() i=6 2024-09-14T11:35:47.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.772+0000 7f1c34175800 20 add_watcher() i=7 2024-09-14T11:35:47.770 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.772+0000 7f1c34175800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:47.771 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.773+0000 7f1ae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1c34175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:47.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1c34175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:47.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1c34175800 5 note: GC not initialized 2024-09-14T11:35:47.772 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1ae27fc640 20 reqs_thread_entry: start 2024-09-14T11:35:47.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1c34175800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:47.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1c34175800 20 Filter name: none 2024-09-14T11:35:47.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1a57fff640 20 reqs_thread_entry: start 2024-09-14T11:35:47.773 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.774+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.775+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.775+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.775+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.775+0000 7f1c34175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.775+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.776+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.776+0000 7f1c34175800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.776+0000 7f1c34175800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:47.774 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.776+0000 7f1c34175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:47.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.777+0000 7f1ae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.780+0000 7f1c34175800 20 remove_watcher() i=0 2024-09-14T11:35:47.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.780+0000 7f1c34175800 2 removed watcher, disabling cache 2024-09-14T11:35:47.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.781+0000 7f1c34175800 20 remove_watcher() i=1 2024-09-14T11:35:47.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.782+0000 7f1c34175800 20 remove_watcher() i=2 2024-09-14T11:35:47.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.783+0000 7f1c34175800 20 remove_watcher() i=3 2024-09-14T11:35:47.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.784+0000 7f1c34175800 20 remove_watcher() i=4 2024-09-14T11:35:47.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.785+0000 7f1c34175800 20 remove_watcher() i=5 2024-09-14T11:35:47.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.786+0000 7f1c34175800 20 remove_watcher() i=6 2024-09-14T11:35:47.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.787+0000 7f1c34175800 20 remove_watcher() i=7 2024-09-14T11:35:47.838 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:47.867 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:47.867 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:47.906 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.909+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.908 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.910+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.910+0000 7f334da3e800 20 realm 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.910+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.910+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.910+0000 7f334da3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.910+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.911+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.909 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.911+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.911+0000 7f334da3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.911+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.912+0000 7f334da3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:47.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.912+0000 7f334da3e800 20 searching for the correct realm 2024-09-14T11:35:47.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.915+0000 7f334bd29640 0 -- 172.21.15.28:0/2761444693 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x561bdc8d8fa0 msgr2=0x561bdc8db460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.917 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.919+0000 7f334ad27640 0 -- 172.21.15.28:0/2761444693 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f333c0aa040 msgr2=0x7f333c081450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.921 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:47.922 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.923+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 zone default found 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 4 Realm: () 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 zonegroup default 2024-09-14T11:35:47.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 started sync module instance, tier type = 2024-09-14T11:35:47.924 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.924+0000 7f334da3e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=0 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=1 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=2 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=3 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=4 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=5 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.934+0000 7f334da3e800 20 add_watcher() i=6 2024-09-14T11:35:47.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.935+0000 7f334da3e800 20 add_watcher() i=7 2024-09-14T11:35:47.933 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.935+0000 7f334da3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:47.934 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.936+0000 7f3201fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 5 note: GC not initialized 2024-09-14T11:35:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f3200fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 20 init_complete bucket index max shards: 1 2024-09-14T11:35:47.935 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 20 Filter name: none 2024-09-14T11:35:47.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f317a7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:47.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:47.936 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.937+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 20 rados->read ofs=0 len=0 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:35:47.937 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:47.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.938+0000 7f334da3e800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:35:47.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.939+0000 7f334da3e800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:47.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.939+0000 7f334da3e800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:35:47.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.939+0000 7f334da3e800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:47.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.939+0000 7f334da3e800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:35:47.938 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.941+0000 7f3201fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:47.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.943+0000 7f334da3e800 20 remove_watcher() i=0 2024-09-14T11:35:47.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.943+0000 7f334da3e800 2 removed watcher, disabling cache 2024-09-14T11:35:47.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.944+0000 7f334da3e800 20 remove_watcher() i=1 2024-09-14T11:35:47.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.945+0000 7f334da3e800 20 remove_watcher() i=2 2024-09-14T11:35:47.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.946+0000 7f334da3e800 20 remove_watcher() i=3 2024-09-14T11:35:47.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.947+0000 7f334da3e800 20 remove_watcher() i=4 2024-09-14T11:35:47.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.948+0000 7f334da3e800 20 remove_watcher() i=5 2024-09-14T11:35:47.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.949+0000 7f334da3e800 20 remove_watcher() i=6 2024-09-14T11:35:47.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:35:47.950+0000 7f334da3e800 20 remove_watcher() i=7 2024-09-14T11:36:17.979 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:36:18.021 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:18.021 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:18.065 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.068+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 realm 2024-09-14T11:36:18.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.067 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:18.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.070+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.070+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.071+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:18.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.071+0000 7fc61df28800 20 searching for the correct realm 2024-09-14T11:36:18.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.074+0000 7fc6194d5640 0 -- 172.21.15.28:0/3509638301 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fc60c07c050 msgr2=0x7fc60c04aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.079+0000 7fc619cd6640 0 -- 172.21.15.28:0/3509638301 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fc6040998c0 msgr2=0x7fc60407c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:18.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:18.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:18.285 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:18.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:18.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:18.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.286 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.287 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 zone default found 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 4 Realm: () 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 zonegroup default 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.288 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.289+0000 7fc61df28800 20 started sync module instance, tier type = 2024-09-14T11:36:18.289 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.289+0000 7fc61df28800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:18.297 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=0 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=1 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=2 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=3 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=4 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=5 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=6 2024-09-14T11:36:18.298 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.300+0000 7fc61df28800 20 add_watcher() i=7 2024-09-14T11:36:18.299 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.300+0000 7fc61df28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:18.300 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.302+0000 7fc4cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.301 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 5 note: GC not initialized 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc4caffd640 20 reqs_thread_entry: start 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 20 Filter name: none 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc4c8ff9640 20 reqs_thread_entry: start 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:18.302 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.303+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.304+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:18.303 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.304+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.304+0000 7fc61df28800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.304+0000 7fc61df28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.304+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.305+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.305+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.305+0000 7fc61df28800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.305+0000 7fc61df28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.305+0000 7fc61df28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.304 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.305+0000 7fc61df28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:18.305 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.306+0000 7fc61df28800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc61df28800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc61df28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc61df28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94358418436080 notifier 7688 bl.length()=827 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.309 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:36:18.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:36:18.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:36:18.311 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:36:18.314 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc61df28800 time 2024-09-14T11:36:18.316838+0000 2024-09-14T11:36:18.314 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:18.314 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.314 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc61f78c76a] 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fc61df28800 thread_name:radosgw-admin 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.316+0000 7fc61df28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc61df28800 time 2024-09-14T11:36:18.316838+0000 2024-09-14T11:36:18.315 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc61f78c76a] 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.316 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.317 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:36:18.317 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.317 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:36:18.317 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:36:18.317 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.337 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.337 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc61e43e6f0] 2024-09-14T11:36:18.337 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc61e48b99c] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc61f78c7c4] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:36:18.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.317+0000 7fc61df28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fc61df28800 thread_name:radosgw-admin 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc61e43e6f0] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc61e48b99c] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc61f78c7c4] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.339 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:36:18.049+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:36:18.049+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.340 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding auth protocol: cephx 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding auth protocol: cephx 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding auth protocol: cephx 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.341 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.342 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:36:18.049+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: starting msgr at 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: starting objecter 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command objecter_requests hook 0x55d187f418d0 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: setting wanted keys 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: calling monclient init 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:36:18.049+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding auth protocol: cephx 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding auth protocol: cephx 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding auth protocol: cephx 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.343 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:36:18.049+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.344 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:36:18.050+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:36:18.050+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key hook 0x55d187f3a628 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d187dc4170 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d187de7ec0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187e7d940 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.691321s 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187dc4170 auth_method 0 2024-09-14T11:36:18.345 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d187de7ec0 auth_method 0 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.346 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d187e7d940 auth_method 0 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_done global_id 7679 payload 824 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:36:18.050+0000 7fc619cd6640 1 monclient: found mon.noname-c 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: dump: 2024-09-14T11:36:18.347 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.348 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: dump: 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.349 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:36:18.051+0000 7fc61df28800 5 monclient: authenticate success, global_id 7679 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:36:18.051+0000 7fc507e07640 4 set_mon_vals no callback set 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:36:18.051+0000 7fc61df28800 1 librados: init done 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:36:18.053+0000 7fc506604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:36:18.053+0000 7fc506604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:36:18.053+0000 7fc506604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:36:18.053+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc500077260 auth_method 0 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:36:18.053+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x55d187f62d40 auth_method 0 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:36:18.054+0000 7fc619cd6640 10 monclient: get_auth_request con 0x55d187f85ea0 auth_method 0 2024-09-14T11:36:18.350 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:36:18.056+0000 7fc6194d5640 10 monclient: get_auth_request con 0x55d187f8af30 auth_method 0 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:36:18.057+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:36:18.057+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:36:18.057+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.351 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding auth protocol: cephx 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding auth protocol: cephx 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding auth protocol: cephx 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.352 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:36:18.057+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command objecter_requests cmddesc objecter_requests hook 0x55d187f925c0 EEXIST 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:36:18.057+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding auth protocol: cephx 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding auth protocol: cephx 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding auth protocol: cephx 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.353 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:36:18.058+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:36:18.058+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:36:18.058+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key cmddesc rotate-key hook 0x55d187f8e060 EEXIST 2024-09-14T11:36:18.354 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187fb68e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d187fb6cc0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d187fb55f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.699473s 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d187fb55f0 auth_method 0 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.355 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d187fb6cc0 auth_method 0 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187fb68e0 auth_method 0 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.356 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_done global_id 7682 payload 824 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 1 monclient: found mon.noname-c 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: dump: 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.357 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:18.358 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: dump: 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:36:18.059+0000 7fc61df28800 5 monclient: authenticate success, global_id 7682 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.359 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:36:18.059+0000 7fc61acd8640 4 set_mon_vals no callback set 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:36:18.061+0000 7fc4ff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:36:18.061+0000 7fc4ff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:36:18.061+0000 7fc4ff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:36:18.061+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc4f4077140 auth_method 0 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:36:18.061+0000 7fc61df28800 10 monclient: get_monmap_and_config 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:36:18.061+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:36:18.061+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:36:18.061+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.360 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding auth protocol: cephx 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding auth protocol: cephx 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding auth protocol: cephx 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.361 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:36:18.062+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding auth protocol: cephx 2024-09-14T11:36:18.362 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding auth protocol: cephx 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding auth protocol: cephx 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.363 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:36:18.062+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:36:18.062+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key cmddesc rotate-key hook 0x7ffc6f2f0f88 EEXIST 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187fda8f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d188005360 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d188006710 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.703828s 2024-09-14T11:36:18.364 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d188005360 auth_method 0 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d188006710 auth_method 0 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:36:18.063+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:36:18.063+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.365 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:36:18.063+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187fda8f0 auth_method 0 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_done global_id 8214 payload 274 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 1 monclient: found mon.noname-a 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: dump: 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.366 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:18.367 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: dump: 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:36:18.063+0000 7fc61df28800 5 monclient: authenticate success, global_id 8214 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:36:18.063+0000 7fc61df28800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:36:18.063+0000 7fc61df28800 4 set_mon_vals no callback set 2024-09-14T11:36:18.368 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: shutdown 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.369 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding auth protocol: cephx 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding auth protocol: cephx 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding auth protocol: cephx 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.370 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:36:18.064+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: starting msgr at 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: starting objecter 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command objecter_requests cmddesc objecter_requests hook 0x55d18800b050 EEXIST 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: setting wanted keys 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: calling monclient init 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding auth protocol: cephx 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding auth protocol: cephx 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding auth protocol: cephx 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.371 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:36:18.065+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:36:18.065+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:36:18.065+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key cmddesc rotate-key hook 0x55d187fcb2e8 EEXIST 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d187fda8f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.372 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d188006710 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187ff8950 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.706356s 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187fda8f0 auth_method 0 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d188006710 auth_method 0 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.373 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d187ff8950 auth_method 0 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.374 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_done global_id 7688 payload 824 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:36:18.065+0000 7fc619cd6640 1 monclient: found mon.noname-c 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: dump: 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.375 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:36:18.066+0000 7fc61df28800 5 monclient: authenticate success, global_id 7688 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.376 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:36:18.066+0000 7fc4fd7fa640 4 set_mon_vals no callback set 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: dump: 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.377 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:36:18.066+0000 7fc61df28800 1 librados: init done 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:36:18.066+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cr dump hook 0x55d18800e018 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:36:18.068+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:36:18.068+0000 7fc4eb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:36:18.068+0000 7fc4eb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:36:18.068+0000 7fc4eb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:36:18.068+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc4e4077230 auth_method 0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:36:18.068+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x55d188025540 auth_method 0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.378 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 realm 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:36:18.069+0000 7fc61df28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:36:18.069+0000 7fc619cd6640 10 monclient: get_auth_request con 0x55d1880297d0 auth_method 0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:36:18.070+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:36:18.070+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:36:18.071+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:36:18.071+0000 7fc61df28800 20 searching for the correct realm 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:36:18.071+0000 7fc6194d5640 10 monclient: get_auth_request con 0x55d18802ea50 auth_method 0 2024-09-14T11:36:18.379 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:36:18.072+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x7fc604089040 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:36:18.073+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc61408c190 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:36:18.073+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc60c07c050 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:36:18.074+0000 7fc6194d5640 0 -- 172.21.15.28:0/3509638301 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fc60c07c050 msgr2=0x7fc60c04aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:36:18.074+0000 7fc4eb7fe640 1 client.7688.objecter ms_handle_reset 0x7fc60c07c050 session 0x7fc60c081070 osd.4 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:36:18.074+0000 7fc4eb7fe640 10 monclient: _renew_subs 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:36:18.074+0000 7fc4eb7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:36:18.074+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc4e40879e0 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:36:18.076+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x7fc60409a040 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:36:18.079+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc6040998c0 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:36:18.079+0000 7fc619cd6640 0 -- 172.21.15.28:0/3509638301 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fc6040998c0 msgr2=0x7fc60407c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:36:18.280+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc6040998c0 auth_method 0 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:18.380 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 zone default found 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:36:18.288+0000 7fc61df28800 4 Realm: () 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:36:18.288+0000 7fc61df28800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:18.381 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:36:18.288+0000 7fc61df28800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:36:18.288+0000 7fc61df28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 zonegroup default 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 started sync module instance, tier type = 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=0 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=1 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=2 2024-09-14T11:36:18.382 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=3 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=4 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=5 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=6 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:36:18.300+0000 7fc61df28800 20 add_watcher() i=7 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:36:18.300+0000 7fc61df28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding auth protocol: cephx 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding auth protocol: cephx 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding auth protocol: cephx 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.383 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:36:18.302+0000 7fc4cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:36:18.303+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache list hook 0x55d1880109e0 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache inspect hook 0x55d1880109e0 2024-09-14T11:36:18.384 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache erase hook 0x55d1880109e0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache zap hook 0x55d1880109e0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 note: GC not initialized 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:36:18.303+0000 7fc4caffd640 20 reqs_thread_entry: start 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace show hook 0x7fc60404eab0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace history hook 0x7fc60404eab0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace active hook 0x7fc60404eab0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace active_short hook 0x7fc60404eab0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 Filter name: none 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:36:18.303+0000 7fc4c8ff9640 20 reqs_thread_entry: start 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:36:18.303+0000 7fc61df28800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:36:18.304+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:18.385 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:36:18.304+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:36:18.304+0000 7fc61df28800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:36:18.304+0000 7fc61df28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:36:18.304+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:36:18.305+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:36:18.306+0000 7fc61df28800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:36:18.386 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94358418436080 notifier 7688 bl.length()=827 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:36:18.316+0000 7fc61df28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc61df28800 time 2024-09-14T11:36:18.316838+0000 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc61f78c76a] 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.387 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:36:18.317+0000 7fc61df28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fc61df28800 thread_name:radosgw-admin 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc61e43e6f0] 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc61e48b99c] 2024-09-14T11:36:18.388 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc61f78c7c4] 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.389 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:36:18.390 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:18.391 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:36:18.392 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:18.393 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:36:18.394 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:18.395 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:18.396 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4c8ff9640 / http_manager 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4caffd640 / http_manager 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4cbfff640 / rgw_dt_lg_renew 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4eb7fe640 / ms_dispatch 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4fcff9640 / io_context_pool 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4fd7fa640 / io_context_pool 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4ff7fe640 / ms_dispatch 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc506604640 / ms_dispatch 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc507e07640 / io_context_pool 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc6194d5640 / msgr-worker-2 2024-09-14T11:36:18.397 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc619cd6640 / msgr-worker-1 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc61a4d7640 / msgr-worker-0 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc61acd8640 / io_context_pool 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc61df28800 / radosgw-admin 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.150894.log 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:36:18.049+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:36:18.049+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.398 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding auth protocol: cephx 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding auth protocol: cephx 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding auth protocol: cephx 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.399 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: crc 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f40160) adding con mode: secure 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:36:18.049+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: starting msgr at 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: starting objecter 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command objecter_requests hook 0x55d187f418d0 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: setting wanted keys 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:36:18.049+0000 7fc61df28800 1 librados: calling monclient init 2024-09-14T11:36:18.400 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:36:18.049+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding auth protocol: cephx 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding auth protocol: cephx 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding auth protocol: cephx 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.401 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: crc 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:36:18.049+0000 7fc61df28800 5 AuthRegistry(0x55d187f3a4e0) adding con mode: secure 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:36:18.049+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:36:18.050+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:36:18.050+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key hook 0x55d187f3a628 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d187dc4170 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d187de7ec0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187e7d940 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.402 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:36:18.050+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.691321s 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187dc4170 auth_method 0 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d187de7ec0 auth_method 0 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:36:18.050+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.403 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d187e7d940 auth_method 0 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:36:18.050+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient(hunting): handle_auth_done global_id 7679 payload 824 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:36:18.050+0000 7fc619cd6640 1 monclient: found mon.noname-c 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:36:18.050+0000 7fc619cd6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: dump: 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.404 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:18.405 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:36:18.051+0000 7fc506604640 10 monclient: dump: 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:36:18.051+0000 7fc61df28800 5 monclient: authenticate success, global_id 7679 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:36:18.051+0000 7fc507e07640 4 set_mon_vals no callback set 2024-09-14T11:36:18.406 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:36:18.051+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:36:18.051+0000 7fc61df28800 1 librados: init done 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:36:18.053+0000 7fc506604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:36:18.053+0000 7fc506604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:36:18.053+0000 7fc506604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:36:18.053+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc500077260 auth_method 0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:36:18.053+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x55d187f62d40 auth_method 0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:36:18.054+0000 7fc619cd6640 10 monclient: get_auth_request con 0x55d187f85ea0 auth_method 0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:36:18.056+0000 7fc6194d5640 10 monclient: get_auth_request con 0x55d187f8af30 auth_method 0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:36:18.057+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:36:18.057+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:36:18.057+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.407 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding auth protocol: cephx 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding auth protocol: cephx 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding auth protocol: cephx 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.408 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: crc 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8f070) adding con mode: secure 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:36:18.057+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command objecter_requests cmddesc objecter_requests hook 0x55d187f925c0 EEXIST 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:36:18.057+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding auth protocol: cephx 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding auth protocol: cephx 2024-09-14T11:36:18.409 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding auth protocol: cephx 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: crc 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:36:18.057+0000 7fc61df28800 5 AuthRegistry(0x55d187f8df18) adding con mode: secure 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:36:18.058+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:36:18.058+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.410 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:36:18.058+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key cmddesc rotate-key hook 0x55d187f8e060 EEXIST 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187fb68e0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d187fb6cc0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d187fb55f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:36:18.058+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.699473s 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d187fb55f0 auth_method 0 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.411 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d187fb6cc0 auth_method 0 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187fb68e0 auth_method 0 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:36:18.058+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.412 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:36:18.058+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_done global_id 7682 payload 824 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 1 monclient: found mon.noname-c 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:36:18.058+0000 7fc61a4d7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: dump: 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.413 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:36:18.059+0000 7fc4ff7fe640 10 monclient: dump: 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.414 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:36:18.059+0000 7fc61df28800 5 monclient: authenticate success, global_id 7682 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:36:18.059+0000 7fc61acd8640 4 set_mon_vals no callback set 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:36:18.059+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:36:18.061+0000 7fc4ff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:36:18.061+0000 7fc4ff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:36:18.061+0000 7fc4ff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:36:18.061+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc4f4077140 auth_method 0 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:36:18.061+0000 7fc61df28800 10 monclient: get_monmap_and_config 2024-09-14T11:36:18.415 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:36:18.061+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:36:18.061+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:36:18.061+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.416 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding auth protocol: cephx 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding auth protocol: cephx 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding auth protocol: cephx 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.417 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: crc 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:36:18.061+0000 7fc61df28800 5 AuthRegistry(0x55d187fd6760) adding con mode: secure 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:36:18.062+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding auth protocol: cephx 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding auth protocol: cephx 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding auth protocol: cephx 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.418 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: crc 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f0e40) adding con mode: secure 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:36:18.062+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:36:18.062+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:36:18.062+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key cmddesc rotate-key hook 0x7ffc6f2f0f88 EEXIST 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187fda8f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d188005360 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d188006710 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.419 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:36:18.062+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.703828s 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d188005360 auth_method 0 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:36:18.062+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d188006710 auth_method 0 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:36:18.062+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.420 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:36:18.063+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:36:18.063+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:36:18.063+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187fda8f0 auth_method 0 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:36:18.063+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_done global_id 8214 payload 274 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 1 monclient: found mon.noname-a 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:36:18.063+0000 7fc61a4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:18.421 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: dump: 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.422 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:36:18.063+0000 7fc4fd7fa640 10 monclient: dump: 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:36:18.063+0000 7fc61df28800 5 monclient: authenticate success, global_id 8214 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:36:18.063+0000 7fc61df28800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:36:18.063+0000 7fc61df28800 4 set_mon_vals no callback set 2024-09-14T11:36:18.423 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: shutdown 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: build_initial_monmap 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 build_initial for_mkfs: 0 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: monmap: 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding auth protocol: cephx 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding auth protocol: cephx 2024-09-14T11:36:18.424 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding auth protocol: cephx 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: crc 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187ffb510) adding con mode: secure 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:36:18.064+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.425 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: starting msgr at 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: starting objecter 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command objecter_requests cmddesc objecter_requests hook 0x55d18800b050 EEXIST 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: setting wanted keys 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:36:18.064+0000 7fc61df28800 1 librados: calling monclient init 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:36:18.064+0000 7fc61df28800 10 monclient: init 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding auth protocol: cephx 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding auth protocol: cephx 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding auth protocol: cephx 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.426 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.427 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.427 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.427 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.427 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: crc 2024-09-14T11:36:18.427 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:36:18.064+0000 7fc61df28800 5 AuthRegistry(0x55d187fcb1a0) adding con mode: secure 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:36:18.065+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:36:18.065+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:36:18.065+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command rotate-key cmddesc rotate-key hook 0x55d187fcb2e8 EEXIST 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-c con 0x55d187fda8f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-a con 0x55d188006710 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:18.428 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): picked mon.noname-b con 0x55d187ff8950 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:36:18.065+0000 7fc61df28800 10 monclient(hunting): authenticate will time out at 2315.706356s 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): get_auth_request con 0x55d187fda8f0 auth_method 0 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): get_auth_request con 0x55d188006710 auth_method 0 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.429 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:36:18.065+0000 7fc6194d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request con 0x55d187ff8950 auth_method 0 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:36:18.065+0000 7fc61a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient(hunting): handle_auth_done global_id 7688 payload 824 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient: _finish_hunting 0 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:36:18.065+0000 7fc619cd6640 1 monclient: found mon.noname-c 2024-09-14T11:36:18.430 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:36:18.065+0000 7fc619cd6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: dump: 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:18.431 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:36:18.066+0000 7fc61df28800 5 monclient: authenticate success, global_id 7688 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:36:18.066+0000 7fc4fd7fa640 4 set_mon_vals no callback set 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:36:18.066+0000 7fc4eb7fe640 10 monclient: dump: 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:18.432 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _renew_subs 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:36:18.066+0000 7fc61df28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:36:18.066+0000 7fc61df28800 1 librados: init done 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:36:18.066+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cr dump hook 0x55d18800e018 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:36:18.068+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:36:18.068+0000 7fc4eb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:36:18.068+0000 7fc4eb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:36:18.068+0000 7fc4eb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:36:18.068+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc4e4077230 auth_method 0 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:36:18.068+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x55d188025540 auth_method 0 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.433 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 realm 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:36:18.069+0000 7fc61df28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:36:18.069+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:36:18.069+0000 7fc619cd6640 10 monclient: get_auth_request con 0x55d1880297d0 auth_method 0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:36:18.070+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:36:18.070+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:36:18.071+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:36:18.071+0000 7fc61df28800 20 searching for the correct realm 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:36:18.071+0000 7fc6194d5640 10 monclient: get_auth_request con 0x55d18802ea50 auth_method 0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:36:18.072+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x7fc604089040 auth_method 0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:36:18.073+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc61408c190 auth_method 0 2024-09-14T11:36:18.434 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:36:18.073+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc60c07c050 auth_method 0 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:36:18.074+0000 7fc6194d5640 0 -- 172.21.15.28:0/3509638301 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fc60c07c050 msgr2=0x7fc60c04aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:36:18.074+0000 7fc4eb7fe640 1 client.7688.objecter ms_handle_reset 0x7fc60c07c050 session 0x7fc60c081070 osd.4 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:36:18.074+0000 7fc4eb7fe640 10 monclient: _renew_subs 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:36:18.074+0000 7fc4eb7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:36:18.074+0000 7fc6194d5640 10 monclient: get_auth_request con 0x7fc4e40879e0 auth_method 0 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:36:18.076+0000 7fc61a4d7640 10 monclient: get_auth_request con 0x7fc60409a040 auth_method 0 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:36:18.079+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc6040998c0 auth_method 0 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:36:18.079+0000 7fc619cd6640 0 -- 172.21.15.28:0/3509638301 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fc6040998c0 msgr2=0x7fc60407c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:36:18.280+0000 7fc619cd6640 10 monclient: get_auth_request con 0x7fc6040998c0 auth_method 0 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:18.435 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:36:18.287+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 zone default found 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:36:18.288+0000 7fc61df28800 4 Realm: () 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:36:18.288+0000 7fc61df28800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:36:18.288+0000 7fc61df28800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:36:18.288+0000 7fc61df28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:18.436 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 zonegroup default 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:36:18.288+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 started sync module instance, tier type = 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:36:18.289+0000 7fc61df28800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=0 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=1 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=2 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=3 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=4 2024-09-14T11:36:18.437 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=5 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:36:18.299+0000 7fc61df28800 20 add_watcher() i=6 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:36:18.300+0000 7fc61df28800 20 add_watcher() i=7 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:36:18.300+0000 7fc61df28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding auth protocol: cephx 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding auth protocol: cephx 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding auth protocol: cephx 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:36:18.302+0000 7fc4cbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.438 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: crc 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:36:18.302+0000 7fc61df28800 5 AuthRegistry(0x7ffc6f2f1320) adding con mode: secure 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:36:18.303+0000 7fc61df28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache list hook 0x55d1880109e0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache inspect hook 0x55d1880109e0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache erase hook 0x55d1880109e0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command cache zap hook 0x55d1880109e0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 note: GC not initialized 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:36:18.303+0000 7fc4caffd640 20 reqs_thread_entry: start 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace show hook 0x7fc60404eab0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace history hook 0x7fc60404eab0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace active hook 0x7fc60404eab0 2024-09-14T11:36:18.439 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:36:18.303+0000 7fc61df28800 5 asok(0x55d187d1a270) register_command sync trace active_short hook 0x7fc60404eab0 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 Filter name: none 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:36:18.303+0000 7fc4c8ff9640 20 reqs_thread_entry: start 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:36:18.303+0000 7fc61df28800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:36:18.303+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:36:18.304+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:36:18.304+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:36:18.304+0000 7fc61df28800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:36:18.304+0000 7fc61df28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:36:18.304+0000 7fc61df28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:36:18.305+0000 7fc61df28800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:18.440 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:36:18.305+0000 7fc61df28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:36:18.306+0000 7fc61df28800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:36:18.311+0000 7fc61df28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94358418436080 notifier 7688 bl.length()=827 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:36:18.311+0000 7fc4fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:36:18.313+0000 7fc61df28800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:36:18.441 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:36:18.316+0000 7fc61df28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc61df28800 time 2024-09-14T11:36:18.316838+0000 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc61f78c76a] 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 4: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 6: main() 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 8: __libc_start_main() 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 9: _start() 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:36:18.317+0000 7fc61df28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:18.442 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7fc61df28800 thread_name:radosgw-admin 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc61e43e6f0] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc61e48b99c] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc61f78c7c4] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc61f78c928] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d185fa20b1] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 8: radosgw-admin(+0xd8907c) [0x55d1864b607c] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55d185fb1efd] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 10: main() 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc61e429590] 2024-09-14T11:36:18.443 INFO:tasks.workunit.client.0.smithi028.stderr: 12: __libc_start_main() 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 13: _start() 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:18.444 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:36:18.445 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:36:18.446 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:36:18.447 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:36:18.448 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:18.449 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4c8ff9640 / http_manager 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4caffd640 / http_manager 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4cbfff640 / rgw_dt_lg_renew 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4eb7fe640 / ms_dispatch 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4fcff9640 / io_context_pool 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4fd7fa640 / io_context_pool 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc4ff7fe640 / ms_dispatch 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc506604640 / ms_dispatch 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc507e07640 / io_context_pool 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc6194d5640 / msgr-worker-2 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc619cd6640 / msgr-worker-1 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc61a4d7640 / msgr-worker-0 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc61acd8640 / io_context_pool 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: 7fc61df28800 / radosgw-admin 2024-09-14T11:36:18.450 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:36:18.451 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:36:18.451 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:18.318539Z_fd394362-7097-4b83-9554-bf659b4532cf/log 2024-09-14T11:36:18.451 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:36:18.451 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.400+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.401+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 20 realm 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.402+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.403+0000 7fea6ee2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.403+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.403+0000 7fea6ee2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.403+0000 7fea6ee2f800 20 searching for the correct realm 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.406+0000 7fea6c118640 0 -- 172.21.15.28:0/652367654 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fea5c0022b0 msgr2=0x7fea5c099400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.410+0000 7fea6c919640 0 -- 172.21.15.28:0/652367654 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fea6005f910 msgr2=0x7fea60025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:18.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:18.615 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.617+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 zone default found 2024-09-14T11:36:18.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 4 Realm: () 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 zonegroup default 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.618+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.619+0000 7fea6ee2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:18.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.619+0000 7fea6ee2f800 20 started sync module instance, tier type = 2024-09-14T11:36:18.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.619+0000 7fea6ee2f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:18.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=0 2024-09-14T11:36:18.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=1 2024-09-14T11:36:18.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=2 2024-09-14T11:36:18.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=3 2024-09-14T11:36:18.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=4 2024-09-14T11:36:18.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=5 2024-09-14T11:36:18.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.630+0000 7fea6ee2f800 20 add_watcher() i=6 2024-09-14T11:36:18.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.631+0000 7fea6ee2f800 20 add_watcher() i=7 2024-09-14T11:36:18.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.631+0000 7fea6ee2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:18.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fe9237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fea6ee2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fea6ee2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fea6ee2f800 5 note: GC not initialized 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fe9227e4640 20 reqs_thread_entry: start 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fea6ee2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.634+0000 7fea6ee2f800 20 Filter name: none 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fe91b7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:18.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.635+0000 7fea6ee2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:18.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:18.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:18.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:36:18.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:36:18.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:36:18.635 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.636+0000 7fea6ee2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:36:18.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.637+0000 7fea6ee2f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:36:18.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.637+0000 7fea6ee2f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:36:18.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.638+0000 7fe9237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:18.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.641+0000 7fea6ee2f800 20 remove_watcher() i=0 2024-09-14T11:36:18.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.641+0000 7fea6ee2f800 2 removed watcher, disabling cache 2024-09-14T11:36:18.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.642+0000 7fea6ee2f800 20 remove_watcher() i=1 2024-09-14T11:36:18.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.643+0000 7fea6ee2f800 20 remove_watcher() i=2 2024-09-14T11:36:18.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.645+0000 7fea6ee2f800 20 remove_watcher() i=3 2024-09-14T11:36:18.644 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.646+0000 7fea6ee2f800 20 remove_watcher() i=4 2024-09-14T11:36:18.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.647+0000 7fea6ee2f800 20 remove_watcher() i=5 2024-09-14T11:36:18.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.648+0000 7fea6ee2f800 20 remove_watcher() i=6 2024-09-14T11:36:18.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:18.649+0000 7fea6ee2f800 20 remove_watcher() i=7 2024-09-14T11:36:18.658 INFO:tasks.workunit.client.0.smithi028.stderr: test: duplicated entries can be purged manually 2024-09-14T11:36:48.677 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:48.711 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:48.711 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:48.757 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.758+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.758 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 realm 2024-09-14T11:36:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.759 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.760+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.761+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.761+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.761+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:48.760 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.761+0000 7f6399613800 20 searching for the correct realm 2024-09-14T11:36:48.763 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.766+0000 7f638ffff640 0 -- 172.21.15.28:0/3435500267 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f638808d040 msgr2=0x7f6388030420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.769+0000 7f6394d48640 0 -- 172.21.15.28:0/3435500267 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f63800970c0 msgr2=0x7f638004c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.976 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:48.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 zone default found 2024-09-14T11:36:48.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 4 Realm: () 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 zonegroup default 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.977+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.978+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.978+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.978+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.978+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.979+0000 7f6399613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.979+0000 7f6399613800 20 started sync module instance, tier type = 2024-09-14T11:36:48.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.979+0000 7f6399613800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:48.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=0 2024-09-14T11:36:48.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=1 2024-09-14T11:36:48.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=2 2024-09-14T11:36:48.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=3 2024-09-14T11:36:48.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=4 2024-09-14T11:36:48.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=5 2024-09-14T11:36:48.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.989+0000 7f6399613800 20 add_watcher() i=6 2024-09-14T11:36:48.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.990+0000 7f6399613800 20 add_watcher() i=7 2024-09-14T11:36:48.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.990+0000 7f6399613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:48.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.993+0000 7f624afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.993+0000 7f6399613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:48.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.993+0000 7f6399613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:48.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.993+0000 7f6399613800 5 note: GC not initialized 2024-09-14T11:36:48.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.993+0000 7f6249fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:48.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.994+0000 7f6399613800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:48.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.994+0000 7f6399613800 20 Filter name: none 2024-09-14T11:36:48.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.994+0000 7f61bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:48.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.994+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.994+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.994+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.995+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.995+0000 7f6399613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.995+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.995+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:48.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.995+0000 7f6399613800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.996+0000 7f6399613800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:48.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.996+0000 7f6399613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:48.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:48.997+0000 7f624afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.000+0000 7f6399613800 20 remove_watcher() i=0 2024-09-14T11:36:48.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.000+0000 7f6399613800 2 removed watcher, disabling cache 2024-09-14T11:36:49.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.001+0000 7f6399613800 20 remove_watcher() i=1 2024-09-14T11:36:49.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.002+0000 7f6399613800 20 remove_watcher() i=2 2024-09-14T11:36:49.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.004+0000 7f6399613800 20 remove_watcher() i=3 2024-09-14T11:36:49.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.006+0000 7f6399613800 20 remove_watcher() i=4 2024-09-14T11:36:49.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.006+0000 7f6399613800 20 remove_watcher() i=5 2024-09-14T11:36:49.006 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.008+0000 7f6399613800 20 remove_watcher() i=6 2024-09-14T11:36:49.008 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.010+0000 7f6399613800 20 remove_watcher() i=7 2024-09-14T11:36:49.020 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.020 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:36:49.020 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-14T11:36:49.020 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.022 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:36:49.058 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:49.058 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:49.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.102+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.101 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 realm 2024-09-14T11:36:49.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:49.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.104+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.104+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.105+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:49.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.105+0000 7f8487e98800 20 searching for the correct realm 2024-09-14T11:36:49.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.108+0000 7f8486183640 0 -- 172.21.15.28:0/3368927803 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f847c074070 msgr2=0x7f847c05d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.112+0000 7f8485982640 0 -- 172.21.15.28:0/3368927803 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f847c0a8270 msgr2=0x7f847c06b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:49.317 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.318 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:49.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 zone default found 2024-09-14T11:36:49.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 4 Realm: () 2024-09-14T11:36:49.319 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 zonegroup default 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.321+0000 7f8487e98800 20 started sync module instance, tier type = 2024-09-14T11:36:49.320 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.321+0000 7f8487e98800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=0 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=1 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=2 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=3 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=4 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=5 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=6 2024-09-14T11:36:49.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.334+0000 7f8487e98800 20 add_watcher() i=7 2024-09-14T11:36:49.332 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.334+0000 7f8487e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:49.333 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.336+0000 7f83377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.336+0000 7f8487e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.336+0000 7f8487e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.336+0000 7f8487e98800 5 note: GC not initialized 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.336+0000 7f83367fc640 20 reqs_thread_entry: start 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.336+0000 7f8487e98800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f8487e98800 20 Filter name: none 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f82a7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f8487e98800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:49.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.337+0000 7f8487e98800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.336 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:49.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.338+0000 7f8487e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:49.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.339+0000 7f8487e98800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:49.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8487e98800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8487e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8487e98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:36:49.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94738697548320 notifier 7742 bl.length()=827 2024-09-14T11:36:49.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:36:49.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:36:49.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:36:49.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:36:49.347 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8487e98800 time 2024-09-14T11:36:49.350382+0000 2024-09-14T11:36:49.347 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f848b38c76a] 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:36:49.348 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f8487e98800 thread_name:radosgw-admin 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.350+0000 7f8487e98800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8487e98800 time 2024-09-14T11:36:49.350382+0000 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f848b38c76a] 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.349 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.350 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:36:49.350 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.350 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:36:49.350 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:36:49.350 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f848a03e6f0] 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f848a08b99c] 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f848b38c7c4] 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.366 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.351+0000 7f8487e98800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f8487e98800 thread_name:radosgw-admin 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f848a03e6f0] 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f848a08b99c] 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f848b38c7c4] 2024-09-14T11:36:49.367 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: dump: 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.368 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:36:49.083+0000 7f8487e98800 5 monclient: authenticate success, global_id 8262 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:36:49.083+0000 7f8487e98800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:36:49.083+0000 7f8487e98800 4 set_mon_vals no callback set 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: shutdown 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 asok(0x562a12386270) unregister_commands rotate-key 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.369 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding auth protocol: cephx 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding auth protocol: cephx 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding auth protocol: cephx 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.370 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:36:49.084+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: starting msgr at 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: starting objecter 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 asok(0x562a12386270) register_command objecter_requests hook 0x562a125d81a0 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: setting wanted keys 2024-09-14T11:36:49.371 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: calling monclient init 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding auth protocol: cephx 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding auth protocol: cephx 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding auth protocol: cephx 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.372 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:36:49.085+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:36:49.085+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:36:49.085+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key hook 0x562a125a6608 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a12430170 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a12453ec0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a124e9940 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.726458s 2024-09-14T11:36:49.373 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a12430170 auth_method 0 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12453ec0 auth_method 0 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): get_auth_request con 0x562a124e9940 auth_method 0 2024-09-14T11:36:49.374 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_done global_id 7733 payload 824 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:36:49.085+0000 7f8485181640 1 monclient: found mon.noname-c 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: dump: 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.375 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: dump: 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.376 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:36:49.086+0000 7f8487e98800 5 monclient: authenticate success, global_id 7733 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:36:49.086+0000 7f8373e07640 4 set_mon_vals no callback set 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.377 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:36:49.086+0000 7f8487e98800 1 librados: init done 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:36:49.088+0000 7f8372604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:36:49.088+0000 7f8372604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:36:49.088+0000 7f8372604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:36:49.088+0000 7f8485982640 10 monclient: get_auth_request con 0x7f836c077230 auth_method 0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:36:49.088+0000 7f8486183640 10 monclient: get_auth_request con 0x562a125ceca0 auth_method 0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:36:49.089+0000 7f8485982640 10 monclient: get_auth_request con 0x562a125f1d20 auth_method 0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:36:49.091+0000 7f8485181640 10 monclient: get_auth_request con 0x562a125f6e20 auth_method 0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:36:49.092+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:36:49.092+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:36:49.092+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.378 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding auth protocol: cephx 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding auth protocol: cephx 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding auth protocol: cephx 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.379 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:36:49.092+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 asok(0x562a12386270) register_command objecter_requests cmddesc objecter_requests hook 0x562a125fe490 EEXIST 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:36:49.092+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding auth protocol: cephx 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding auth protocol: cephx 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding auth protocol: cephx 2024-09-14T11:36:49.380 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:36:49.092+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:36:49.093+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:36:49.093+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key cmddesc rotate-key hook 0x562a125f9f50 EEXIST 2024-09-14T11:36:49.381 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a126227b0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a12622b90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a126214c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.734172s 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a126227b0 auth_method 0 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): get_auth_request con 0x562a126214c0 auth_method 0 2024-09-14T11:36:49.382 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12622b90 auth_method 0 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.383 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:36:49.093+0000 7f8485982640 1 monclient: found mon.noname-a 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: dump: 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.384 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: dump: 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.385 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:36:49.093+0000 7f8487e98800 5 monclient: authenticate success, global_id 8268 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:36:49.093+0000 7f8486984640 4 set_mon_vals no callback set 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:36:49.094+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:36:49.094+0000 7f8487e98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:36:49.096+0000 7f836b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:36:49.096+0000 7f836b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:36:49.096+0000 7f836b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:36:49.096+0000 7f8485181640 10 monclient: get_auth_request con 0x7f8360077140 auth_method 0 2024-09-14T11:36:49.386 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: get_monmap_and_config 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:36:49.096+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding auth protocol: cephx 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding auth protocol: cephx 2024-09-14T11:36:49.387 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding auth protocol: cephx 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:36:49.096+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.388 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding auth protocol: cephx 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding auth protocol: cephx 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding auth protocol: cephx 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.389 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:36:49.097+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:36:49.097+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:36:49.097+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key cmddesc rotate-key hook 0x7ffc33500e68 EEXIST 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a12676bf0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a12667540 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a12672020 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.738379s 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a12676bf0 auth_method 0 2024-09-14T11:36:49.390 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12667540 auth_method 0 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_done global_id 7739 payload 274 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.391 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:36:49.097+0000 7f8485982640 1 monclient: found mon.noname-c 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:36:49.097+0000 7f8486183640 10 monclient: get_auth_request con 0x562a12672020 auth_method 0 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: dump: 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.392 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:36:49.097+0000 7f8487e98800 5 monclient: authenticate success, global_id 7739 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:36:49.098+0000 7f83697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:36:49.098+0000 7f83697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:36:49.098+0000 7f83697fa640 10 monclient: dump: 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.393 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:36:49.098+0000 7f8487e98800 4 set_mon_vals no callback set 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: shutdown 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:36:49.098+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.394 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding auth protocol: cephx 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding auth protocol: cephx 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding auth protocol: cephx 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.395 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:36:49.098+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:36:49.098+0000 7f8487e98800 1 librados: starting msgr at 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:36:49.098+0000 7f8487e98800 1 librados: starting objecter 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 asok(0x562a12386270) register_command objecter_requests cmddesc objecter_requests hook 0x562a12620bf0 EEXIST 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:36:49.099+0000 7f8487e98800 1 librados: setting wanted keys 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:36:49.099+0000 7f8487e98800 1 librados: calling monclient init 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding auth protocol: cephx 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding auth protocol: cephx 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding auth protocol: cephx 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.396 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:36:49.099+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:36:49.099+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key cmddesc rotate-key hook 0x562a126371b8 EEXIST 2024-09-14T11:36:49.397 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a12667540 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a12672020 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a12676bf0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.740713s 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a12667540 auth_method 0 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12672020 auth_method 0 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.398 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:36:49.100+0000 7f8485181640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:36:49.100+0000 7f8485181640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:36:49.100+0000 7f8485181640 1 monclient: found mon.noname-c 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:36:49.100+0000 7f8485181640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:36:49.100+0000 7f8486183640 10 monclient: get_auth_request con 0x562a12676bf0 auth_method 0 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: dump: 2024-09-14T11:36:49.399 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: dump: 2024-09-14T11:36:49.400 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:36:49.100+0000 7f8487e98800 5 monclient: authenticate success, global_id 7742 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:36:49.100+0000 7f83697fa640 4 set_mon_vals no callback set 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.401 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:36:49.100+0000 7f8487e98800 1 librados: init done 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:36:49.100+0000 7f8487e98800 5 asok(0x562a12386270) register_command cr dump hook 0x562a1266ca18 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:36:49.102+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:36:49.102+0000 7f83577fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:36:49.102+0000 7f83577fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:36:49.102+0000 7f83577fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:36:49.102+0000 7f8485982640 10 monclient: get_auth_request con 0x7f8350077230 auth_method 0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:36:49.103+0000 7f8486183640 10 monclient: get_auth_request con 0x562a12691260 auth_method 0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 realm 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:36:49.103+0000 7f8487e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.402 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:36:49.104+0000 7f8485982640 10 monclient: get_auth_request con 0x562a126954a0 auth_method 0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:36:49.104+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:36:49.104+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:36:49.105+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:36:49.105+0000 7f8487e98800 20 searching for the correct realm 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:36:49.105+0000 7f8485181640 10 monclient: get_auth_request con 0x562a1269a6d0 auth_method 0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:36:49.106+0000 7f8486183640 10 monclient: get_auth_request con 0x7f847c074070 auth_method 0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:36:49.107+0000 7f8485982640 10 monclient: get_auth_request con 0x7f8480078400 auth_method 0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:36:49.107+0000 7f8485181640 10 monclient: get_auth_request con 0x7f8478034060 auth_method 0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:36:49.108+0000 7f8486183640 0 -- 172.21.15.28:0/3368927803 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f847c074070 msgr2=0x7f847c05d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:36:49.108+0000 7f83577fe640 1 client.7742.objecter ms_handle_reset 0x7f847c074070 session 0x7f847c08f650 osd.7 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:36:49.108+0000 7f83577fe640 10 monclient: _renew_subs 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:36:49.108+0000 7f83577fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.403 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:36:49.109+0000 7f8486183640 10 monclient: get_auth_request con 0x7f83500879e0 auth_method 0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:36:49.109+0000 7f8486183640 10 monclient: get_auth_request con 0x7f847c069c20 auth_method 0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:36:49.112+0000 7f8485982640 10 monclient: get_auth_request con 0x7f847c0a8270 auth_method 0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:36:49.112+0000 7f8485982640 0 -- 172.21.15.28:0/3368927803 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f847c0a8270 msgr2=0x7f847c06b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:36:49.313+0000 7f8485982640 10 monclient: get_auth_request con 0x7f847c0a8270 auth_method 0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.404 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 zone default found 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:36:49.320+0000 7f8487e98800 4 Realm: () 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:36:49.320+0000 7f8487e98800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:36:49.320+0000 7f8487e98800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:36:49.320+0000 7f8487e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 zonegroup default 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 started sync module instance, tier type = 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:49.405 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=0 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=1 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=2 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=3 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=4 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=5 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=6 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:36:49.334+0000 7f8487e98800 20 add_watcher() i=7 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:36:49.334+0000 7f8487e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding auth protocol: cephx 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding auth protocol: cephx 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding auth protocol: cephx 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.406 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:36:49.336+0000 7f83377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:36:49.336+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:36:49.336+0000 7f8487e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:36:49.336+0000 7f8487e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache list hook 0x562a1266b360 2024-09-14T11:36:49.407 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache inspect hook 0x562a1266b360 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache erase hook 0x562a1266b360 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache zap hook 0x562a1266b360 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 note: GC not initialized 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:36:49.336+0000 7f83367fc640 20 reqs_thread_entry: start 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace show hook 0x7f8478022030 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace history hook 0x7f8478022030 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace active hook 0x7f8478022030 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace active_short hook 0x7f8478022030 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:36:49.336+0000 7f8487e98800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:36:49.337+0000 7f8487e98800 20 Filter name: none 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:36:49.337+0000 7f82a7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:36:49.337+0000 7f8487e98800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:49.408 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:36:49.337+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:36:49.337+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:36:49.337+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:36:49.337+0000 7f8487e98800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:36:49.338+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:36:49.338+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:36:49.339+0000 7f8487e98800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.409 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94738697548320 notifier 7742 bl.length()=827 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:36:49.350+0000 7f8487e98800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8487e98800 time 2024-09-14T11:36:49.350382+0000 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.410 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f848b38c76a] 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:36:49.351+0000 7f8487e98800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f8487e98800 thread_name:radosgw-admin 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f848a03e6f0] 2024-09-14T11:36:49.411 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f848a08b99c] 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f848b38c7c4] 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:36:49.412 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:36:49.413 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:36:49.414 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:49.415 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:36:49.416 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:49.417 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:49.418 INFO:tasks.workunit.client.0.smithi028.stderr: 7f82a7fff640 / http_manager 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83367fc640 / http_manager 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83377fe640 / rgw_dt_lg_renew 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83577fe640 / ms_dispatch 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8368ff9640 / io_context_pool 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83697fa640 / io_context_pool 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f836b7fe640 / ms_dispatch 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8372604640 / ms_dispatch 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8373e07640 / io_context_pool 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8485181640 / msgr-worker-2 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8485982640 / msgr-worker-1 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8486183640 / msgr-worker-0 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8486984640 / io_context_pool 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8487e98800 / radosgw-admin 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:36:49.419 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/log/ceph/ceph-client.admin.152661.log 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:--- begin dump of recent events --- 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr: -499> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr: -498> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr: -497> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr: -496> 2024-09-14T11:36:49.083+0000 7f8373e07640 10 monclient: dump: 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.420 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -495> 2024-09-14T11:36:49.083+0000 7f8487e98800 5 monclient: authenticate success, global_id 8262 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -494> 2024-09-14T11:36:49.083+0000 7f8487e98800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -493> 2024-09-14T11:36:49.083+0000 7f8487e98800 4 set_mon_vals no callback set 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -492> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: shutdown 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -491> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 asok(0x562a12386270) unregister_commands rotate-key 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -490> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -489> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr: -488> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.421 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -487> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding auth protocol: cephx 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -486> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding auth protocol: cephx 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -485> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding auth protocol: cephx 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -484> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -483> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -482> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -481> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -480> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -479> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -478> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.422 INFO:tasks.workunit.client.0.smithi028.stderr: -477> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -476> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -475> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -474> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: crc 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -473> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125ac150) adding con mode: secure 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -472> 2024-09-14T11:36:49.084+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -471> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: starting msgr at 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -470> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: starting objecter 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -469> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 asok(0x562a12386270) register_command objecter_requests hook 0x562a125d81a0 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -468> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: setting wanted keys 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -467> 2024-09-14T11:36:49.084+0000 7f8487e98800 1 librados: calling monclient init 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -466> 2024-09-14T11:36:49.084+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -465> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding auth protocol: cephx 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -464> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding auth protocol: cephx 2024-09-14T11:36:49.423 INFO:tasks.workunit.client.0.smithi028.stderr: -463> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding auth protocol: cephx 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -462> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -461> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -460> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -459> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -458> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -457> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -456> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -455> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -454> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -453> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -452> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: crc 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -451> 2024-09-14T11:36:49.084+0000 7f8487e98800 5 AuthRegistry(0x562a125a64c0) adding con mode: secure 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -450> 2024-09-14T11:36:49.085+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -449> 2024-09-14T11:36:49.085+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.424 INFO:tasks.workunit.client.0.smithi028.stderr: -448> 2024-09-14T11:36:49.085+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key hook 0x562a125a6608 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -447> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -446> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -445> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a12430170 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -444> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a12453ec0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -443> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a124e9940 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -442> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -441> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -440> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -439> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -438> 2024-09-14T11:36:49.085+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.726458s 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -437> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a12430170 auth_method 0 2024-09-14T11:36:49.425 INFO:tasks.workunit.client.0.smithi028.stderr: -436> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -435> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -434> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -433> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12453ec0 auth_method 0 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -432> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -431> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -430> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -429> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -428> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -427> 2024-09-14T11:36:49.085+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -426> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -425> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -424> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.426 INFO:tasks.workunit.client.0.smithi028.stderr: -423> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): get_auth_request con 0x562a124e9940 auth_method 0 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -422> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -421> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -420> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -419> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -418> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -417> 2024-09-14T11:36:49.085+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -416> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient(hunting): handle_auth_done global_id 7733 payload 824 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -415> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -414> 2024-09-14T11:36:49.085+0000 7f8485181640 1 monclient: found mon.noname-c 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -413> 2024-09-14T11:36:49.085+0000 7f8485181640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -412> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.427 INFO:tasks.workunit.client.0.smithi028.stderr: -411> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr: -410> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: dump: 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr: -409> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr: -408> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr: -407> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.428 INFO:tasks.workunit.client.0.smithi028.stderr: -406> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr: -405> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr: -404> 2024-09-14T11:36:49.086+0000 7f8372604640 10 monclient: dump: 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr: -403> 2024-09-14T11:36:49.086+0000 7f8487e98800 5 monclient: authenticate success, global_id 7733 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr: -402> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.429 INFO:tasks.workunit.client.0.smithi028.stderr: -401> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -400> 2024-09-14T11:36:49.086+0000 7f8373e07640 4 set_mon_vals no callback set 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -399> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -398> 2024-09-14T11:36:49.086+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -397> 2024-09-14T11:36:49.086+0000 7f8487e98800 1 librados: init done 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -396> 2024-09-14T11:36:49.088+0000 7f8372604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -395> 2024-09-14T11:36:49.088+0000 7f8372604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -394> 2024-09-14T11:36:49.088+0000 7f8372604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -393> 2024-09-14T11:36:49.088+0000 7f8485982640 10 monclient: get_auth_request con 0x7f836c077230 auth_method 0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -392> 2024-09-14T11:36:49.088+0000 7f8486183640 10 monclient: get_auth_request con 0x562a125ceca0 auth_method 0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -391> 2024-09-14T11:36:49.089+0000 7f8485982640 10 monclient: get_auth_request con 0x562a125f1d20 auth_method 0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -390> 2024-09-14T11:36:49.091+0000 7f8485181640 10 monclient: get_auth_request con 0x562a125f6e20 auth_method 0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -389> 2024-09-14T11:36:49.092+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -388> 2024-09-14T11:36:49.092+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.430 INFO:tasks.workunit.client.0.smithi028.stderr: -387> 2024-09-14T11:36:49.092+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: -386> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding auth protocol: cephx 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: -385> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding auth protocol: cephx 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: -384> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding auth protocol: cephx 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: -383> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: -382> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.431 INFO:tasks.workunit.client.0.smithi028.stderr: -381> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -380> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -379> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -378> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -377> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -376> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -375> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -374> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -373> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: crc 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -372> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125faf60) adding con mode: secure 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -371> 2024-09-14T11:36:49.092+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -370> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 asok(0x562a12386270) register_command objecter_requests cmddesc objecter_requests hook 0x562a125fe490 EEXIST 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -369> 2024-09-14T11:36:49.092+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -368> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding auth protocol: cephx 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -367> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding auth protocol: cephx 2024-09-14T11:36:49.432 INFO:tasks.workunit.client.0.smithi028.stderr: -366> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding auth protocol: cephx 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -365> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -364> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -363> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -362> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -361> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -360> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -359> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -358> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -357> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -356> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -355> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: crc 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -354> 2024-09-14T11:36:49.092+0000 7f8487e98800 5 AuthRegistry(0x562a125f9e08) adding con mode: secure 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -353> 2024-09-14T11:36:49.092+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -352> 2024-09-14T11:36:49.093+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -351> 2024-09-14T11:36:49.093+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key cmddesc rotate-key hook 0x562a125f9f50 EEXIST 2024-09-14T11:36:49.433 INFO:tasks.workunit.client.0.smithi028.stderr: -350> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -349> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -348> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a126227b0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -347> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a12622b90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -346> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a126214c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -345> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -344> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -343> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -342> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -341> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.734172s 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -340> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a126227b0 auth_method 0 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -339> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -338> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -337> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -336> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): get_auth_request con 0x562a126214c0 auth_method 0 2024-09-14T11:36:49.434 INFO:tasks.workunit.client.0.smithi028.stderr: -335> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -334> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -333> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -332> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -331> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -330> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -329> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -328> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -327> 2024-09-14T11:36:49.093+0000 7f8486183640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -326> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12622b90 auth_method 0 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -325> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -324> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -323> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -322> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.435 INFO:tasks.workunit.client.0.smithi028.stderr: -321> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -320> 2024-09-14T11:36:49.093+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -319> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -318> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -317> 2024-09-14T11:36:49.093+0000 7f8485982640 1 monclient: found mon.noname-a 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -316> 2024-09-14T11:36:49.093+0000 7f8485982640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -315> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -314> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr: -313> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: dump: 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.436 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: -312> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: -311> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: -310> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: -309> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: -308> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr: -307> 2024-09-14T11:36:49.093+0000 7f836b7fe640 10 monclient: dump: 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.437 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -306> 2024-09-14T11:36:49.093+0000 7f8487e98800 5 monclient: authenticate success, global_id 8268 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -305> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -304> 2024-09-14T11:36:49.093+0000 7f8487e98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -303> 2024-09-14T11:36:49.093+0000 7f8486984640 4 set_mon_vals no callback set 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -302> 2024-09-14T11:36:49.094+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -301> 2024-09-14T11:36:49.094+0000 7f8487e98800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -300> 2024-09-14T11:36:49.096+0000 7f836b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -299> 2024-09-14T11:36:49.096+0000 7f836b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.438 INFO:tasks.workunit.client.0.smithi028.stderr: -298> 2024-09-14T11:36:49.096+0000 7f836b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: -297> 2024-09-14T11:36:49.096+0000 7f8485181640 10 monclient: get_auth_request con 0x7f8360077140 auth_method 0 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: -296> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: get_monmap_and_config 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: -295> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: -294> 2024-09-14T11:36:49.096+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: -293> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.439 INFO:tasks.workunit.client.0.smithi028.stderr: -292> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding auth protocol: cephx 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -291> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding auth protocol: cephx 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -290> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding auth protocol: cephx 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -289> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -288> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -287> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -286> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -285> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -284> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -283> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -282> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -281> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -280> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -279> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: crc 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -278> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x562a12642600) adding con mode: secure 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -277> 2024-09-14T11:36:49.096+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.440 INFO:tasks.workunit.client.0.smithi028.stderr: -276> 2024-09-14T11:36:49.096+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -275> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding auth protocol: cephx 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -274> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding auth protocol: cephx 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -273> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding auth protocol: cephx 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -272> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -271> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -270> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -269> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -268> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -267> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -266> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -265> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -264> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -263> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -262> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: crc 2024-09-14T11:36:49.441 INFO:tasks.workunit.client.0.smithi028.stderr: -261> 2024-09-14T11:36:49.096+0000 7f8487e98800 5 AuthRegistry(0x7ffc33500d20) adding con mode: secure 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -260> 2024-09-14T11:36:49.097+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -259> 2024-09-14T11:36:49.097+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -258> 2024-09-14T11:36:49.097+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key cmddesc rotate-key hook 0x7ffc33500e68 EEXIST 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -257> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -256> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -255> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a12676bf0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -254> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a12667540 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -253> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a12672020 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -252> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -251> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -250> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -249> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -248> 2024-09-14T11:36:49.097+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.738379s 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -247> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a12676bf0 auth_method 0 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -246> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.442 INFO:tasks.workunit.client.0.smithi028.stderr: -245> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -244> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -243> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12667540 auth_method 0 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -242> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -241> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -240> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -239> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -238> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -237> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -236> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -235> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -234> 2024-09-14T11:36:49.097+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -233> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient(hunting): handle_auth_done global_id 7739 payload 274 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -232> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -231> 2024-09-14T11:36:49.097+0000 7f8485982640 1 monclient: found mon.noname-c 2024-09-14T11:36:49.443 INFO:tasks.workunit.client.0.smithi028.stderr: -230> 2024-09-14T11:36:49.097+0000 7f8485982640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr: -229> 2024-09-14T11:36:49.097+0000 7f8486183640 10 monclient: get_auth_request con 0x562a12672020 auth_method 0 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr: -228> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr: -227> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr: -226> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: dump: 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.444 INFO:tasks.workunit.client.0.smithi028.stderr: -225> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr: -224> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr: -223> 2024-09-14T11:36:49.097+0000 7f83697fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr: -222> 2024-09-14T11:36:49.097+0000 7f8487e98800 5 monclient: authenticate success, global_id 7739 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr: -221> 2024-09-14T11:36:49.098+0000 7f83697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr: -220> 2024-09-14T11:36:49.098+0000 7f83697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr: -219> 2024-09-14T11:36:49.098+0000 7f83697fa640 10 monclient: dump: 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.445 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: -218> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: get_monmap_and_config success 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: -217> 2024-09-14T11:36:49.098+0000 7f8487e98800 4 set_mon_vals no callback set 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: -216> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: shutdown 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: -215> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: build_initial_monmap 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: -214> 2024-09-14T11:36:49.098+0000 7f8487e98800 1 build_initial for_mkfs: 0 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr: -213> 2024-09-14T11:36:49.098+0000 7f8487e98800 10 monclient: monmap: 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 0 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 0.000000 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:created 0.000000 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-09-14T11:36:49.446 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-c 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -212> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding auth protocol: cephx 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -211> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding auth protocol: cephx 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -210> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding auth protocol: cephx 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -209> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -208> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -207> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -206> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -205> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -204> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -203> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -202> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -201> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -200> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.447 INFO:tasks.workunit.client.0.smithi028.stderr: -199> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: crc 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -198> 2024-09-14T11:36:49.098+0000 7f8487e98800 5 AuthRegistry(0x562a12646150) adding con mode: secure 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -197> 2024-09-14T11:36:49.098+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -196> 2024-09-14T11:36:49.098+0000 7f8487e98800 1 librados: starting msgr at 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -195> 2024-09-14T11:36:49.098+0000 7f8487e98800 1 librados: starting objecter 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -194> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 asok(0x562a12386270) register_command objecter_requests cmddesc objecter_requests hook 0x562a12620bf0 EEXIST 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -193> 2024-09-14T11:36:49.099+0000 7f8487e98800 1 librados: setting wanted keys 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -192> 2024-09-14T11:36:49.099+0000 7f8487e98800 1 librados: calling monclient init 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -191> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient: init 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -190> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding auth protocol: cephx 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -189> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding auth protocol: cephx 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -188> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding auth protocol: cephx 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -187> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -186> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -185> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.448 INFO:tasks.workunit.client.0.smithi028.stderr: -184> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -183> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -182> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -181> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -180> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -179> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -178> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -177> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: crc 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -176> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 AuthRegistry(0x562a12637070) adding con mode: secure 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -175> 2024-09-14T11:36:49.099+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -174> 2024-09-14T11:36:49.099+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -173> 2024-09-14T11:36:49.099+0000 7f8487e98800 5 asok(0x562a12386270) register_command rotate-key cmddesc rotate-key hook 0x562a126371b8 EEXIST 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -172> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient: _reopen_session rank -1 2024-09-14T11:36:49.449 INFO:tasks.workunit.client.0.smithi028.stderr: -171> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -170> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-a con 0x562a12667540 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -169> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-c con 0x562a12672020 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -168> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): picked mon.noname-b con 0x562a12676bf0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -167> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -166> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -165> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -164> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): _renew_subs 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -163> 2024-09-14T11:36:49.099+0000 7f8487e98800 10 monclient(hunting): authenticate will time out at 2346.740713s 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -162> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): get_auth_request con 0x562a12667540 auth_method 0 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -161> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -160> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -159> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -158> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): get_auth_request con 0x562a12672020 auth_method 0 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -157> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -156> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:49.450 INFO:tasks.workunit.client.0.smithi028.stderr: -155> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -154> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -153> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -152> 2024-09-14T11:36:49.099+0000 7f8485982640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -151> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -150> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -149> 2024-09-14T11:36:49.099+0000 7f8485181640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -148> 2024-09-14T11:36:49.100+0000 7f8485181640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -147> 2024-09-14T11:36:49.100+0000 7f8485181640 10 monclient: _finish_hunting 0 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -146> 2024-09-14T11:36:49.100+0000 7f8485181640 1 monclient: found mon.noname-c 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -145> 2024-09-14T11:36:49.100+0000 7f8485181640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -144> 2024-09-14T11:36:49.100+0000 7f8486183640 10 monclient: get_auth_request con 0x562a12676bf0 auth_method 0 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -143> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -142> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr: -141> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: dump: 2024-09-14T11:36:49.451 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: -140> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: _finish_auth 0 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: -139> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: _check_auth_tickets 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: -138> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: -137> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: -136> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr: -135> 2024-09-14T11:36:49.100+0000 7f83577fe640 10 monclient: dump: 2024-09-14T11:36:49.452 INFO:tasks.workunit.client.0.smithi028.stderr:epoch 1 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:fsid 7fcb1d8c-c737-420b-b643-4fde3e2bec1a 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:last_changed 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:created 2024-09-14T11:09:53.228891+0000 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:election_strategy: 1 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.c 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr: -134> 2024-09-14T11:36:49.100+0000 7f8487e98800 5 monclient: authenticate success, global_id 7742 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr: -133> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr: -132> 2024-09-14T11:36:49.100+0000 7f83697fa640 4 set_mon_vals no callback set 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr: -131> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.453 INFO:tasks.workunit.client.0.smithi028.stderr: -130> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _renew_subs 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -129> 2024-09-14T11:36:49.100+0000 7f8487e98800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -128> 2024-09-14T11:36:49.100+0000 7f8487e98800 1 librados: init done 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -127> 2024-09-14T11:36:49.100+0000 7f8487e98800 5 asok(0x562a12386270) register_command cr dump hook 0x562a1266ca18 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -126> 2024-09-14T11:36:49.102+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -125> 2024-09-14T11:36:49.102+0000 7f83577fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -124> 2024-09-14T11:36:49.102+0000 7f83577fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -123> 2024-09-14T11:36:49.102+0000 7f83577fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/3733252066,v1:172.21.15.204:6833/3733252066] 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -122> 2024-09-14T11:36:49.102+0000 7f8485982640 10 monclient: get_auth_request con 0x7f8350077230 auth_method 0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -121> 2024-09-14T11:36:49.103+0000 7f8486183640 10 monclient: get_auth_request con 0x562a12691260 auth_method 0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -120> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -119> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 realm 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -118> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -117> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.454 INFO:tasks.workunit.client.0.smithi028.stderr: -116> 2024-09-14T11:36:49.103+0000 7f8487e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -115> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -114> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -113> 2024-09-14T11:36:49.103+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -112> 2024-09-14T11:36:49.104+0000 7f8485982640 10 monclient: get_auth_request con 0x562a126954a0 auth_method 0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -111> 2024-09-14T11:36:49.104+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -110> 2024-09-14T11:36:49.104+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -109> 2024-09-14T11:36:49.105+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -108> 2024-09-14T11:36:49.105+0000 7f8487e98800 20 searching for the correct realm 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -107> 2024-09-14T11:36:49.105+0000 7f8485181640 10 monclient: get_auth_request con 0x562a1269a6d0 auth_method 0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -106> 2024-09-14T11:36:49.106+0000 7f8486183640 10 monclient: get_auth_request con 0x7f847c074070 auth_method 0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -105> 2024-09-14T11:36:49.107+0000 7f8485982640 10 monclient: get_auth_request con 0x7f8480078400 auth_method 0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -104> 2024-09-14T11:36:49.107+0000 7f8485181640 10 monclient: get_auth_request con 0x7f8478034060 auth_method 0 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -103> 2024-09-14T11:36:49.108+0000 7f8486183640 0 -- 172.21.15.28:0/3368927803 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f847c074070 msgr2=0x7f847c05d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -102> 2024-09-14T11:36:49.108+0000 7f83577fe640 1 client.7742.objecter ms_handle_reset 0x7f847c074070 session 0x7f847c08f650 osd.7 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -101> 2024-09-14T11:36:49.108+0000 7f83577fe640 10 monclient: _renew_subs 2024-09-14T11:36:49.455 INFO:tasks.workunit.client.0.smithi028.stderr: -100> 2024-09-14T11:36:49.108+0000 7f83577fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3301/0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -99> 2024-09-14T11:36:49.109+0000 7f8486183640 10 monclient: get_auth_request con 0x7f83500879e0 auth_method 0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -98> 2024-09-14T11:36:49.109+0000 7f8486183640 10 monclient: get_auth_request con 0x7f847c069c20 auth_method 0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -97> 2024-09-14T11:36:49.112+0000 7f8485982640 10 monclient: get_auth_request con 0x7f847c0a8270 auth_method 0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -96> 2024-09-14T11:36:49.112+0000 7f8485982640 0 -- 172.21.15.28:0/3368927803 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f847c0a8270 msgr2=0x7f847c06b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -95> 2024-09-14T11:36:49.313+0000 7f8485982640 10 monclient: get_auth_request con 0x7f847c0a8270 auth_method 0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -94> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -93> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -92> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -91> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -90> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -89> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -88> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -87> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -86> 2024-09-14T11:36:49.319+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.456 INFO:tasks.workunit.client.0.smithi028.stderr: -85> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -84> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -83> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -82> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 zone default found 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -81> 2024-09-14T11:36:49.320+0000 7f8487e98800 4 Realm: () 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -80> 2024-09-14T11:36:49.320+0000 7f8487e98800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -79> 2024-09-14T11:36:49.320+0000 7f8487e98800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -78> 2024-09-14T11:36:49.320+0000 7f8487e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -77> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 zonegroup default 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -76> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -75> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -74> 2024-09-14T11:36:49.320+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -73> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -72> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -71> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -70> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 started sync module instance, tier type = 2024-09-14T11:36:49.457 INFO:tasks.workunit.client.0.smithi028.stderr: -69> 2024-09-14T11:36:49.321+0000 7f8487e98800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -68> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=0 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -67> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=1 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -66> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=2 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -65> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=3 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -64> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=4 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -63> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=5 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -62> 2024-09-14T11:36:49.333+0000 7f8487e98800 20 add_watcher() i=6 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -61> 2024-09-14T11:36:49.334+0000 7f8487e98800 20 add_watcher() i=7 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -60> 2024-09-14T11:36:49.334+0000 7f8487e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -59> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding auth protocol: cephx 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -58> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding auth protocol: cephx 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -57> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding auth protocol: cephx 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -56> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -55> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -54> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.458 INFO:tasks.workunit.client.0.smithi028.stderr: -53> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -52> 2024-09-14T11:36:49.336+0000 7f83377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -51> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -50> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -49> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -48> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -47> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -46> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -45> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: crc 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -44> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 AuthRegistry(0x7ffc33501200) adding con mode: secure 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -43> 2024-09-14T11:36:49.336+0000 7f8487e98800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -42> 2024-09-14T11:36:49.336+0000 7f8487e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -41> 2024-09-14T11:36:49.336+0000 7f8487e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -40> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache list hook 0x562a1266b360 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -39> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache inspect hook 0x562a1266b360 2024-09-14T11:36:49.459 INFO:tasks.workunit.client.0.smithi028.stderr: -38> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache erase hook 0x562a1266b360 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -37> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command cache zap hook 0x562a1266b360 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -36> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 note: GC not initialized 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -35> 2024-09-14T11:36:49.336+0000 7f83367fc640 20 reqs_thread_entry: start 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -34> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace show hook 0x7f8478022030 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -33> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace history hook 0x7f8478022030 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -32> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace active hook 0x7f8478022030 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -31> 2024-09-14T11:36:49.336+0000 7f8487e98800 5 asok(0x562a12386270) register_command sync trace active_short hook 0x7f8478022030 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -30> 2024-09-14T11:36:49.336+0000 7f8487e98800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -29> 2024-09-14T11:36:49.337+0000 7f8487e98800 20 Filter name: none 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -28> 2024-09-14T11:36:49.337+0000 7f82a7fff640 20 reqs_thread_entry: start 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -27> 2024-09-14T11:36:49.337+0000 7f8487e98800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -26> 2024-09-14T11:36:49.337+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -25> 2024-09-14T11:36:49.337+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -24> 2024-09-14T11:36:49.337+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:49.460 INFO:tasks.workunit.client.0.smithi028.stderr: -23> 2024-09-14T11:36:49.337+0000 7f8487e98800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -22> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -21> 2024-09-14T11:36:49.338+0000 7f8487e98800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -20> 2024-09-14T11:36:49.338+0000 7f8487e98800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -19> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -18> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -17> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -16> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -15> 2024-09-14T11:36:49.338+0000 7f8487e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -14> 2024-09-14T11:36:49.339+0000 7f8487e98800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -13> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -12> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -11> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -10> 2024-09-14T11:36:49.344+0000 7f8487e98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -9> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94738697548320 notifier 7742 bl.length()=827 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -8> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.461 INFO:tasks.workunit.client.0.smithi028.stderr: -7> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: -6> 2024-09-14T11:36:49.344+0000 7f8368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: -5> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: -4> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: -3> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: -2> 2024-09-14T11:36:49.346+0000 7f8487e98800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: -1> 2024-09-14T11:36:49.350+0000 7f8487e98800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8487e98800 time 2024-09-14T11:36:49.350382+0000 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f848b38c76a] 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 5: main() 2024-09-14T11:36:49.462 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 7: __libc_start_main() 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 8: _start() 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 0> 2024-09-14T11:36:49.351+0000 7f8487e98800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: in thread 7f8487e98800 thread_name:radosgw-admin 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f848a03e6f0] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f848a08b99c] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 3: raise() 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 4: abort() 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f848b38c7c4] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f848b38c928] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a103d00b1] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562a103dff6a] 2024-09-14T11:36:49.463 INFO:tasks.workunit.client.0.smithi028.stderr: 9: main() 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f848a029590] 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 11: __libc_start_main() 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 12: _start() 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr:--- logging levels --- 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 none 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 lockdep 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 context 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 crush 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_locker 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log 2024-09-14T11:36:49.464 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 buffer 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 timer 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 filer 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 striper 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 1 objecter 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rados 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 journaler 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objectcacher 2024-09-14T11:36:49.465 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 client 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 osd 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 optracker 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 objclass 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 filestore 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 journal 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 ms 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mon 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 0/10 monc 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 paxos 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 tp 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 auth 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 crypto 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 finisher 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 reserver 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:49.466 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 perfcounter 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_access 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 20/20 rgw_notification 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 javaclient 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 asok 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 1 throttle 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 0 refs 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 compressor 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluestore 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 bluefs 2024-09-14T11:36:49.467 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 3 bdev 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 kstore 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 4/ 5 rocksdb 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 fuse 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 2/ 5 mgr 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mgrc 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 dpdk 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 eventtrace 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 prioritycache 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 test 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:49.468 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_t 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_device 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 alienstore 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 mclock 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 cyanstore 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 memstore 2024-09-14T11:36:49.469 INFO:tasks.workunit.client.0.smithi028.stderr: 1/ 5 trace 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f82a7fff640 / http_manager 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83367fc640 / http_manager 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83377fe640 / rgw_dt_lg_renew 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83577fe640 / ms_dispatch 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8368ff9640 / io_context_pool 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f83697fa640 / io_context_pool 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f836b7fe640 / ms_dispatch 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8372604640 / ms_dispatch 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8373e07640 / io_context_pool 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8485181640 / msgr-worker-2 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8485982640 / msgr-worker-1 2024-09-14T11:36:49.470 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8486183640 / msgr-worker-0 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8486984640 / io_context_pool 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr: 7f8487e98800 / radosgw-admin 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr: max_recent 500 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr: max_new 1000 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:49.351790Z_ed08ba29-4d1e-4bbe-aaca-2af3900bcd3c/log 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr:--- end dump of recent events --- 2024-09-14T11:36:49.471 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:49.472 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:49.472 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:49.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.429+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.431+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.431+0000 7f65b8746800 20 realm 2024-09-14T11:36:49.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.431+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.431+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.431+0000 7f65b8746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.431+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.432+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.432+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.433+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.433+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.433+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.433+0000 7f65b8746800 20 searching for the correct realm 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.436+0000 7f65b5a36640 0 -- 172.21.15.28:0/4060802433 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f65a8074020 msgr2=0x7f65a80a58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.440+0000 7f65b6237640 0 -- 172.21.15.28:0/4060802433 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f65ac00d8f0 msgr2=0x7f65ac04d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:49.646 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.648+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.647 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:49.648 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 zone default found 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 4 Realm: () 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 zonegroup default 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.649+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 started sync module instance, tier type = 2024-09-14T11:36:49.649 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.650+0000 7f65b8746800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:49.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=0 2024-09-14T11:36:49.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=1 2024-09-14T11:36:49.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=2 2024-09-14T11:36:49.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=3 2024-09-14T11:36:49.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=4 2024-09-14T11:36:49.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=5 2024-09-14T11:36:49.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.660+0000 7f65b8746800 20 add_watcher() i=6 2024-09-14T11:36:49.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.661+0000 7f65b8746800 20 add_watcher() i=7 2024-09-14T11:36:49.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.661+0000 7f65b8746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:49.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f646cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.661 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f65b8746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f65b8746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f65b8746800 5 note: GC not initialized 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f63e77fe640 20 reqs_thread_entry: start 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f65b8746800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.663+0000 7f65b8746800 20 Filter name: none 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.664+0000 7f63e57fa640 20 reqs_thread_entry: start 2024-09-14T11:36:49.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.664+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.664+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:49.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.664+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.665+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:49.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.665+0000 7f65b8746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:49.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.665+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.663 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.665+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:49.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.665+0000 7f65b8746800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.666+0000 7f65b8746800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:49.664 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.666+0000 7f65b8746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:49.665 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.667+0000 7f646cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.669+0000 7f65b8746800 20 remove_watcher() i=0 2024-09-14T11:36:49.667 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.669+0000 7f65b8746800 2 removed watcher, disabling cache 2024-09-14T11:36:49.668 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.670+0000 7f65b8746800 20 remove_watcher() i=1 2024-09-14T11:36:49.669 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.671+0000 7f65b8746800 20 remove_watcher() i=2 2024-09-14T11:36:49.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.673+0000 7f65b8746800 20 remove_watcher() i=3 2024-09-14T11:36:49.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.674+0000 7f65b8746800 20 remove_watcher() i=4 2024-09-14T11:36:49.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.675+0000 7f65b8746800 20 remove_watcher() i=5 2024-09-14T11:36:49.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.676+0000 7f65b8746800 20 remove_watcher() i=6 2024-09-14T11:36:49.675 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.677+0000 7f65b8746800 20 remove_watcher() i=7 2024-09-14T11:36:49.730 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:36:49.759 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:49.759 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:49.799 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.801+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 realm 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.803+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.804+0000 7f899d325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.804+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.804+0000 7f899d325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:49.802 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.804+0000 7f899d325800 20 searching for the correct realm 2024-09-14T11:36:49.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.806+0000 7f8998fae640 0 -- 172.21.15.28:0/155070234 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f8980003bb0 msgr2=0x7f89900213e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.810+0000 7f8998fae640 0 -- 172.21.15.28:0/155070234 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f88640879c0 msgr2=0x7f8864089df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.815+0000 7f899d325800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.815+0000 7f899d325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.815+0000 7f899d325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.815+0000 7f899d325800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.815+0000 7f899d325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.814 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.815 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 zone default found 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 4 Realm: () 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 zonegroup default 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.816+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.817+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.817+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.816 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.817+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.817+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.818+0000 7f899d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:49.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.818+0000 7f899d325800 20 started sync module instance, tier type = 2024-09-14T11:36:49.817 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.818+0000 7f899d325800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:36:49.824 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=0 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=1 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=2 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=3 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=4 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=5 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.827+0000 7f899d325800 20 add_watcher() i=6 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.828+0000 7f899d325800 20 add_watcher() i=7 2024-09-14T11:36:49.825 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.828+0000 7f899d325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:49.827 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.829+0000 7f884efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.829+0000 7f899d325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.829+0000 7f899d325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.829+0000 7f899d325800 5 note: GC not initialized 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.830+0000 7f884dfe3640 20 reqs_thread_entry: start 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.830+0000 7f899d325800 20 init_complete bucket index max shards: 1 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.830+0000 7f899d325800 20 Filter name: none 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.830+0000 7f87bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.830+0000 7f899d325800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:49.828 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.830+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:36:49.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:49.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:49.829 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:36:49.830 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.831+0000 7f899d325800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:36:49.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.832+0000 7f899d325800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:36:49.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.832+0000 7f899d325800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:36:49.831 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.833+0000 7f884efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:49.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.835+0000 7f899d325800 20 remove_watcher() i=0 2024-09-14T11:36:49.833 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.835+0000 7f899d325800 2 removed watcher, disabling cache 2024-09-14T11:36:49.834 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.836+0000 7f899d325800 20 remove_watcher() i=1 2024-09-14T11:36:49.835 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.837+0000 7f899d325800 20 remove_watcher() i=2 2024-09-14T11:36:49.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.838+0000 7f899d325800 20 remove_watcher() i=3 2024-09-14T11:36:49.837 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.839+0000 7f899d325800 20 remove_watcher() i=4 2024-09-14T11:36:49.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.840+0000 7f899d325800 20 remove_watcher() i=5 2024-09-14T11:36:49.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.841+0000 7f899d325800 20 remove_watcher() i=6 2024-09-14T11:36:49.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:36:49.842+0000 7f899d325800 20 remove_watcher() i=7 2024-09-14T11:37:19.872 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:19.905 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:19.951 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.952+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.954+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.954+0000 7f9a9f319800 20 realm 2024-09-14T11:37:19.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.954+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.954+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.954+0000 7f9a9f319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.954+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.955+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.955+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.956+0000 7f9a9f319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.956+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.956+0000 7f9a9f319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:19.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.956+0000 7f9a9f319800 20 searching for the correct realm 2024-09-14T11:37:19.959 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.960+0000 7f9a9c602640 0 -- 172.21.15.28:0/2247193743 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55d96a624850 msgr2=0x55d96a626d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:19.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.964+0000 7f9a9ce03640 0 -- 172.21.15.28:0/2247193743 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f9a8406dd50 msgr2=0x7f9a8408e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.969 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.969+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 zone default found 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 4 Realm: () 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 zonegroup default 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.970 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.970+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.971+0000 7f9a9f319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.971+0000 7f9a9f319800 20 started sync module instance, tier type = 2024-09-14T11:37:19.971 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.971+0000 7f9a9f319800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:19.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=0 2024-09-14T11:37:19.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=1 2024-09-14T11:37:19.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=2 2024-09-14T11:37:19.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=3 2024-09-14T11:37:19.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=4 2024-09-14T11:37:19.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=5 2024-09-14T11:37:19.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.980+0000 7f9a9f319800 20 add_watcher() i=6 2024-09-14T11:37:19.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.981+0000 7f9a9f319800 20 add_watcher() i=7 2024-09-14T11:37:19.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.981+0000 7f9a9f319800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:19.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.983+0000 7f99537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.983+0000 7f9a9f319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:19.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.983+0000 7f9a9f319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:19.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f9a9f319800 5 note: GC not initialized 2024-09-14T11:37:19.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f99527e4640 20 reqs_thread_entry: start 2024-09-14T11:37:19.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f9a9f319800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:19.983 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f9a9f319800 20 Filter name: none 2024-09-14T11:37:19.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f994bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:19.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f9a9f319800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:19.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.984+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:19.984 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 20 rados->read ofs=0 len=0 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:19.985 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.985+0000 7f9a9f319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:37:19.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.989+0000 7f99537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:19.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.991+0000 7f9a9f319800 20 remove_watcher() i=0 2024-09-14T11:37:19.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.991+0000 7f9a9f319800 2 removed watcher, disabling cache 2024-09-14T11:37:19.991 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.992+0000 7f9a9f319800 20 remove_watcher() i=1 2024-09-14T11:37:19.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.993+0000 7f9a9f319800 20 remove_watcher() i=2 2024-09-14T11:37:19.993 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.994+0000 7f9a9f319800 20 remove_watcher() i=3 2024-09-14T11:37:19.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.995+0000 7f9a9f319800 20 remove_watcher() i=4 2024-09-14T11:37:19.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.996+0000 7f9a9f319800 20 remove_watcher() i=5 2024-09-14T11:37:19.996 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.997+0000 7f9a9f319800 20 remove_watcher() i=6 2024-09-14T11:37:19.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:19.998+0000 7f9a9f319800 20 remove_watcher() i=7 2024-09-14T11:37:20.011 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:37:20.040 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.041 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.081 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.082+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 realm 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.084+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.085+0000 7f40af70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.085+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.086+0000 7f40af70c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.086+0000 7f40af70c800 20 searching for the correct realm 2024-09-14T11:37:20.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.089+0000 7f40ad9fe640 0 -- 172.21.15.28:0/3919752277 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f40a4035060 msgr2=0x7f40a4067920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.092 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.093+0000 7f40ad1fd640 0 -- 172.21.15.28:0/3919752277 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f40a406d1d0 msgr2=0x7f40a406e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:20.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.097+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:20.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 zone default found 2024-09-14T11:37:20.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 4 Realm: () 2024-09-14T11:37:20.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 zonegroup default 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.098+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.099+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.099+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.099+0000 7f40af70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.099+0000 7f40af70c800 20 started sync module instance, tier type = 2024-09-14T11:37:20.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.099+0000 7f40af70c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=0 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=1 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=2 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=3 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=4 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=5 2024-09-14T11:37:20.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.108+0000 7f40af70c800 20 add_watcher() i=6 2024-09-14T11:37:20.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.109+0000 7f40af70c800 20 add_watcher() i=7 2024-09-14T11:37:20.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.109+0000 7f40af70c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:20.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f3f63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f40af70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:20.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f40af70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:20.110 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f40af70c800 5 note: GC not initialized 2024-09-14T11:37:20.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f3f62fe5640 20 reqs_thread_entry: start 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f40af70c800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f40af70c800 20 Filter name: none 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.111+0000 7f3f60fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:20.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.112+0000 7f40af70c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.113+0000 7f40af70c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.113+0000 7f40af70c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.113+0000 7f40af70c800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:20.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.113+0000 7f40af70c800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:20.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.114+0000 7f3f63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.116+0000 7f40af70c800 20 remove_watcher() i=0 2024-09-14T11:37:20.115 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.116+0000 7f40af70c800 2 removed watcher, disabling cache 2024-09-14T11:37:20.116 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.117+0000 7f40af70c800 20 remove_watcher() i=1 2024-09-14T11:37:20.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.119+0000 7f40af70c800 20 remove_watcher() i=2 2024-09-14T11:37:20.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.120+0000 7f40af70c800 20 remove_watcher() i=3 2024-09-14T11:37:20.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.120+0000 7f40af70c800 20 remove_watcher() i=4 2024-09-14T11:37:20.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.121+0000 7f40af70c800 20 remove_watcher() i=5 2024-09-14T11:37:20.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.122+0000 7f40af70c800 20 remove_watcher() i=6 2024-09-14T11:37:20.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.123+0000 7f40af70c800 20 remove_watcher() i=7 2024-09-14T11:37:20.134 INFO:tasks.workunit.client.0.smithi028.stderr:check reshard logrecord successfully 2024-09-14T11:37:20.134 INFO:tasks.workunit.client.0.smithi028.stderr: test: reshard versioned bucket 2024-09-14T11:37:20.135 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:37:20.165 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.165 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.204+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.206+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.206+0000 7f3c06e10800 20 realm 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.206+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.207+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.207+0000 7f3c06e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.207+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.207+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.207+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.208+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.208+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.208+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.208+0000 7f3c06e10800 20 searching for the correct realm 2024-09-14T11:37:20.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.212+0000 7f3c01ddf640 0 -- 172.21.15.28:0/1389282830 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f3bf4042040 msgr2=0x7f3bf403f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:20.214 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.216+0000 7f3c01ddf640 0 -- 172.21.15.28:0/1389282830 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f3acc0879e0 msgr2=0x7f3acc089e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:20.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:20.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:20.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:20.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:20.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:20.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.219 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.219+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 zone default found 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 4 Realm: () 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 zonegroup default 2024-09-14T11:37:20.220 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.220+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.221+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.221+0000 7f3c06e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.221+0000 7f3c06e10800 20 started sync module instance, tier type = 2024-09-14T11:37:20.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.221+0000 7f3c06e10800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=0 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=1 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=2 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=3 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=4 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=5 2024-09-14T11:37:20.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.229+0000 7f3c06e10800 20 add_watcher() i=6 2024-09-14T11:37:20.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.230+0000 7f3c06e10800 20 add_watcher() i=7 2024-09-14T11:37:20.229 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.230+0000 7f3c06e10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:20.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3ab8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3c06e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:20.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3c06e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3c06e10800 5 note: GC not initialized 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3a337fe640 20 reqs_thread_entry: start 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3c06e10800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.232+0000 7f3c06e10800 20 Filter name: none 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.233+0000 7f3a317fa640 20 reqs_thread_entry: start 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.233+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.233+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:20.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.233+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.234+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:20.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.234+0000 7f3c06e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.234+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.234+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:20.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.234+0000 7f3c06e10800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.235+0000 7f3c06e10800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:20.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.235+0000 7f3c06e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.236+0000 7f3ab8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.238+0000 7f3c06e10800 20 remove_watcher() i=0 2024-09-14T11:37:20.237 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.238+0000 7f3c06e10800 2 removed watcher, disabling cache 2024-09-14T11:37:20.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.239+0000 7f3c06e10800 20 remove_watcher() i=1 2024-09-14T11:37:20.239 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.240+0000 7f3c06e10800 20 remove_watcher() i=2 2024-09-14T11:37:20.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.241+0000 7f3c06e10800 20 remove_watcher() i=3 2024-09-14T11:37:20.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.242+0000 7f3c06e10800 20 remove_watcher() i=4 2024-09-14T11:37:20.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.243+0000 7f3c06e10800 20 remove_watcher() i=5 2024-09-14T11:37:20.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.244+0000 7f3c06e10800 20 remove_watcher() i=6 2024-09-14T11:37:20.244 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.245+0000 7f3c06e10800 20 remove_watcher() i=7 2024-09-14T11:37:20.255 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:20.255 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:37:20.255 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: myver id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-14T11:37:20.255 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:20.256 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-14T11:37:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.288 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.328 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.329+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.330+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.330+0000 7fb844523800 20 realm 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.330+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.331+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.331+0000 7fb844523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.331+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.331+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.330 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.331+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.332+0000 7fb844523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.332+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.332+0000 7fb844523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.331 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.332+0000 7fb844523800 20 searching for the correct realm 2024-09-14T11:37:20.334 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.336+0000 7fb83fa0b640 0 -- 172.21.15.28:0/1132301131 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55bbdde2b3c0 msgr2=0x55bbdde2d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.339+0000 7fb84020c640 0 -- 172.21.15.28:0/1132301131 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb834079900 msgr2=0x7fb83409f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:20.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:20.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:20.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:20.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:20.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:20.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.343+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 zone default found 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 4 Realm: () 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:20.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 zonegroup default 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.344+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.345+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.345+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.345+0000 7fb844523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.345+0000 7fb844523800 20 started sync module instance, tier type = 2024-09-14T11:37:20.345 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.345+0000 7fb844523800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=0 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=1 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=2 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=3 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=4 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=5 2024-09-14T11:37:20.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.354+0000 7fb844523800 20 add_watcher() i=6 2024-09-14T11:37:20.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.355+0000 7fb844523800 20 add_watcher() i=7 2024-09-14T11:37:20.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.355+0000 7fb844523800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:20.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.356+0000 7fb6f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:20.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:20.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 5 note: GC not initialized 2024-09-14T11:37:20.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb6f5fdb640 20 reqs_thread_entry: start 2024-09-14T11:37:20.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:20.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 20 Filter name: none 2024-09-14T11:37:20.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb6677fe640 20 reqs_thread_entry: start 2024-09-14T11:37:20.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:37:20.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.357+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : miss 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 adding default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.358+0000 7fb844523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:20.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb844523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb844523800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb844523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb844523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:20.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb716ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94265369879840 notifier 8385 bl.length()=821 2024-09-14T11:37:20.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb716ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb716ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.363+0000 7fb716ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.365+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:20.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.365+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:20.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.365+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:20.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.365+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:20.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.367+0000 7fb844523800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.0 2024-09-14T11:37:20.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.367+0000 7fb844523800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.0 2024-09-14T11:37:20.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.367+0000 7fb844523800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.1 2024-09-14T11:37:20.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.367+0000 7fb844523800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.1 2024-09-14T11:37:20.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.367+0000 7fb844523800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.0 2024-09-14T11:37:20.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.368+0000 7fb844523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:20.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.368+0000 7fb844523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:20.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.369+0000 7fb844523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.369+0000 7fb844523800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.369+0000 7fb844523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.369+0000 7fb844523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:20.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.369+0000 7fb716ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 94265369879840 notifier 8385 bl.length()=821 2024-09-14T11:37:20.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.369+0000 7fb716ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.370+0000 7fb716ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.369 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.370+0000 7fb716ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.371+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:20.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.371+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:20.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.371+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:20.370 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.371+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:20.371 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.372+0000 7fb844523800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.0 2024-09-14T11:37:20.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.373+0000 7fb844523800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:20.372 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.373+0000 7fb844523800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:20.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.374+0000 7fb844523800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.374+0000 7fb844523800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.374+0000 7fb844523800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.373 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.374+0000 7fb844523800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:20.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.375+0000 7fb7177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94265369879840 notifier 8385 bl.length()=789 2024-09-14T11:37:20.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.375+0000 7fb7177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:20.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.375+0000 7fb7177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:20.374 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.375+0000 7fb7177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:20.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.376+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:20.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.376+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:20.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.376+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:20.375 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.376+0000 7fb844523800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:20.376 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.377+0000 7fb844523800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-14T11:37:20.378 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.379+0000 7fb6f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.382+0000 7fb844523800 20 remove_watcher() i=0 2024-09-14T11:37:20.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.382+0000 7fb844523800 2 removed watcher, disabling cache 2024-09-14T11:37:20.381 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.383+0000 7fb844523800 20 remove_watcher() i=1 2024-09-14T11:37:20.382 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.384+0000 7fb844523800 20 remove_watcher() i=2 2024-09-14T11:37:20.383 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.385+0000 7fb844523800 20 remove_watcher() i=3 2024-09-14T11:37:20.385 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.386+0000 7fb844523800 20 remove_watcher() i=4 2024-09-14T11:37:20.386 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.387+0000 7fb844523800 20 remove_watcher() i=5 2024-09-14T11:37:20.387 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.388+0000 7fb844523800 20 remove_watcher() i=6 2024-09-14T11:37:20.388 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.389+0000 7fb844523800 20 remove_watcher() i=7 2024-09-14T11:37:20.400 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:37:20.430 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.430 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.469 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.470+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.470 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.471+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.471+0000 7ff724c3e800 20 realm 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.471+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.472+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.472+0000 7ff724c3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.472+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.472+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.471 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.472+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.473+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.473+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.473+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.472 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.473+0000 7ff724c3e800 20 searching for the correct realm 2024-09-14T11:37:20.475 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.476+0000 7ff721f27640 0 -- 172.21.15.28:0/3674693610 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55fdf2ab3020 msgr2=0x55fdf2ab5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.479+0000 7ff722728640 0 -- 172.21.15.28:0/3674693610 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ff71801e950 msgr2=0x7ff7180583f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 20 zone default found 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.484+0000 7ff724c3e800 4 Realm: () 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 zonegroup default 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 started sync module instance, tier type = 2024-09-14T11:37:20.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.485+0000 7ff724c3e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=0 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=1 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=2 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=3 2024-09-14T11:37:20.493 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=4 2024-09-14T11:37:20.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=5 2024-09-14T11:37:20.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.494+0000 7ff724c3e800 20 add_watcher() i=6 2024-09-14T11:37:20.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.495+0000 7ff724c3e800 20 add_watcher() i=7 2024-09-14T11:37:20.494 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.495+0000 7ff724c3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:20.495 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff5d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff724c3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff724c3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff724c3e800 5 note: GC not initialized 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff5537fe640 20 reqs_thread_entry: start 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff724c3e800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff724c3e800 20 Filter name: none 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.497+0000 7ff5517fa640 20 reqs_thread_entry: start 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.498+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.498+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:20.497 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.498+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:20.498 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.499+0000 7ff724c3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:20.499 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.501+0000 7ff5d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:20.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.503+0000 7ff724c3e800 20 remove_watcher() i=0 2024-09-14T11:37:20.502 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.503+0000 7ff724c3e800 2 removed watcher, disabling cache 2024-09-14T11:37:20.503 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.504+0000 7ff724c3e800 20 remove_watcher() i=1 2024-09-14T11:37:20.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.505+0000 7ff724c3e800 20 remove_watcher() i=2 2024-09-14T11:37:20.504 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.506+0000 7ff724c3e800 20 remove_watcher() i=3 2024-09-14T11:37:20.505 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.507+0000 7ff724c3e800 20 remove_watcher() i=4 2024-09-14T11:37:20.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.508+0000 7ff724c3e800 20 remove_watcher() i=5 2024-09-14T11:37:20.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.508+0000 7ff724c3e800 20 remove_watcher() i=6 2024-09-14T11:37:20.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.509+0000 7ff724c3e800 20 remove_watcher() i=7 2024-09-14T11:37:20.519 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:20.519 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:37:20.519 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: myver id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-14T11:37:20.519 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:20.597 INFO:tasks.workunit.client.0.smithi028.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:37:20.895 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:37:20.923 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:20.923 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:20.962 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.964+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.965+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.964 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.965+0000 7f1edf939800 20 realm 2024-09-14T11:37:20.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.965+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.965+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.965+0000 7f1edf939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:20.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.965+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.966+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:20.965 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.966+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.966+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:20.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.966+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:20.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.967+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:20.966 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.967+0000 7f1edf939800 20 searching for the correct realm 2024-09-14T11:37:20.968 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.969+0000 7f1edae24640 0 -- 172.21.15.28:0/2803182160 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f1ecc073070 msgr2=0x7f1ecc095140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:20.972 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:20.973+0000 7f1edb625640 0 -- 172.21.15.28:0/2803182160 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f1ed006b3e0 msgr2=0x7f1ed006b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:21.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:21.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.179 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.180 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.180+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 zone default found 2024-09-14T11:37:21.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 4 Realm: () 2024-09-14T11:37:21.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:21.181 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 zonegroup default 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.181+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.182+0000 7f1edf939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.182+0000 7f1edf939800 20 started sync module instance, tier type = 2024-09-14T11:37:21.182 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.182+0000 7f1edf939800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=0 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=1 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=2 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=3 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=4 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=5 2024-09-14T11:37:21.190 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.191+0000 7f1edf939800 20 add_watcher() i=6 2024-09-14T11:37:21.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.192+0000 7f1edf939800 20 add_watcher() i=7 2024-09-14T11:37:21.191 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.192+0000 7f1edf939800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.194+0000 7f1d91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.194+0000 7f1edf939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.194+0000 7f1edf939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.194+0000 7f1edf939800 5 note: GC not initialized 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.194+0000 7f1d90fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.194+0000 7f1edf939800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.195+0000 7f1edf939800 20 Filter name: none 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.195+0000 7f1d0a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.195+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.195+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:21.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.195+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.196+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:37:21.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.196+0000 7f1edf939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.196+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.196+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:21.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.196+0000 7f1edf939800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.197+0000 7f1edf939800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:37:21.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.197+0000 7f1edf939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.197 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.199+0000 7f1d91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.199 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.201+0000 7f1edf939800 20 remove_watcher() i=0 2024-09-14T11:37:21.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.201+0000 7f1edf939800 2 removed watcher, disabling cache 2024-09-14T11:37:21.200 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.202+0000 7f1edf939800 20 remove_watcher() i=1 2024-09-14T11:37:21.201 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.203+0000 7f1edf939800 20 remove_watcher() i=2 2024-09-14T11:37:21.202 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.204+0000 7f1edf939800 20 remove_watcher() i=3 2024-09-14T11:37:21.203 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.205+0000 7f1edf939800 20 remove_watcher() i=4 2024-09-14T11:37:21.204 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.206+0000 7f1edf939800 20 remove_watcher() i=5 2024-09-14T11:37:21.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.207+0000 7f1edf939800 20 remove_watcher() i=6 2024-09-14T11:37:21.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.208+0000 7f1edf939800 20 remove_watcher() i=7 2024-09-14T11:37:21.218 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:21.218 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:37:21.218 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: a-bucket id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-14T11:37:21.218 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:21.220 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:37:21.250 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.250 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.290 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.291+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.292 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.293+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.293+0000 7f724e613800 20 realm 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.293+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.293+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.293+0000 7f724e613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.293+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.294+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.293 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.294+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.294+0000 7f724e613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.294+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.295+0000 7f724e613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.294 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.295+0000 7f724e613800 20 searching for the correct realm 2024-09-14T11:37:21.295 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.296+0000 7f7249d92640 0 -- 172.21.15.28:0/44261992 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f7244072040 msgr2=0x7f7244062940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.500 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.501+0000 7f724a593640 0 -- 172.21.15.28:0/44261992 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f7234074020 msgr2=0x7f723407e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:21.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:21.506 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.507 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.507+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 zone default found 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 4 Realm: () 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 zonegroup default 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.508 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.508+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.509+0000 7f724e613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.509+0000 7f724e613800 20 started sync module instance, tier type = 2024-09-14T11:37:21.509 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.509+0000 7f724e613800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=0 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=1 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=2 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=3 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=4 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=5 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.518+0000 7f724e613800 20 add_watcher() i=6 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.519+0000 7f724e613800 20 add_watcher() i=7 2024-09-14T11:37:21.517 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.519+0000 7f724e613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.520+0000 7f70f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f724e613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f724e613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f724e613800 5 note: GC not initialized 2024-09-14T11:37:21.520 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f70f67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f724e613800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:21.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f724e613800 20 Filter name: none 2024-09-14T11:37:21.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f7067fff640 20 reqs_thread_entry: start 2024-09-14T11:37:21.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.521+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.522+0000 7f724e613800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:21.521 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.522+0000 7f724e613800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.523+0000 7f724e613800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:37:21.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.523+0000 7f724e613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.522 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.524+0000 7f70f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.526+0000 7f724e613800 20 remove_watcher() i=0 2024-09-14T11:37:21.525 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.526+0000 7f724e613800 2 removed watcher, disabling cache 2024-09-14T11:37:21.526 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.527+0000 7f724e613800 20 remove_watcher() i=1 2024-09-14T11:37:21.527 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.528+0000 7f724e613800 20 remove_watcher() i=2 2024-09-14T11:37:21.528 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.529+0000 7f724e613800 20 remove_watcher() i=3 2024-09-14T11:37:21.529 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.530+0000 7f724e613800 20 remove_watcher() i=4 2024-09-14T11:37:21.530 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.531+0000 7f724e613800 20 remove_watcher() i=5 2024-09-14T11:37:21.531 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.532+0000 7f724e613800 20 remove_watcher() i=6 2024-09-14T11:37:21.532 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.533+0000 7f724e613800 20 remove_watcher() i=7 2024-09-14T11:37:21.545 INFO:tasks.workunit.client.0.smithi028.stderr:rados -p default.rgw.buckets.index setomapval .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:37:21.571 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.571 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.587 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:37:21.616 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.617 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.655 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.656+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 realm 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.657 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.658+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.659+0000 7fced5c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.658 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.659+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.660+0000 7fced5c63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.659 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.660+0000 7fced5c63800 20 searching for the correct realm 2024-09-14T11:37:21.662 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.663+0000 7fced3f55640 0 -- 172.21.15.28:0/2082594930 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x5616fecb9f30 msgr2=0x5616fecbc380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.666 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.667+0000 7fced2f53640 0 -- 172.21.15.28:0/2082594930 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fcec4045070 msgr2=0x7fcec4055930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.670 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.671 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 zone default found 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 4 Realm: () 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 zonegroup default 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.671+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.672 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 started sync module instance, tier type = 2024-09-14T11:37:21.673 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.672+0000 7fced5c63800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=0 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=1 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=2 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=3 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=4 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=5 2024-09-14T11:37:21.680 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.681+0000 7fced5c63800 20 add_watcher() i=6 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.682+0000 7fced5c63800 20 add_watcher() i=7 2024-09-14T11:37:21.681 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.682+0000 7fced5c63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:21.682 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.683+0000 7fcd89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fced5c63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fced5c63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fced5c63800 5 note: GC not initialized 2024-09-14T11:37:21.683 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fcd88fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fced5c63800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fced5c63800 20 Filter name: none 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fcd027fc640 20 reqs_thread_entry: start 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.684+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.685+0000 7fced5c63800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:21.684 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.685+0000 7fced5c63800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.685+0000 7fced5c63800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.685+0000 7fced5c63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.685+0000 7fced5c63800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.685+0000 7fced5c63800 20 INFO: main: starting shard=0 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.686+0000 7fced5c63800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.686+0000 7fced5c63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:21.685 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.686+0000 7fced5c63800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.686+0000 7fced5c63800 20 INFO: main: starting shard=1 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.686+0000 7fced5c63800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.686+0000 7fced5c63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.687+0000 7fced5c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.687+0000 7fced5c63800 20 INFO: main: starting shard=2 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.687+0000 7fced5c63800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:21.686 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.687+0000 7fced5c63800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.687+0000 7fced5c63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.687+0000 7fced5c63800 20 INFO: main: done 2024-09-14T11:37:21.687 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.688+0000 7fcd89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.691+0000 7fced5c63800 20 remove_watcher() i=0 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.691+0000 7fced5c63800 2 removed watcher, disabling cache 2024-09-14T11:37:21.690 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.692+0000 7fced5c63800 20 remove_watcher() i=1 2024-09-14T11:37:21.691 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.693+0000 7fced5c63800 20 remove_watcher() i=2 2024-09-14T11:37:21.692 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.694+0000 7fced5c63800 20 remove_watcher() i=3 2024-09-14T11:37:21.693 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.695+0000 7fced5c63800 20 remove_watcher() i=4 2024-09-14T11:37:21.694 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.695+0000 7fced5c63800 20 remove_watcher() i=5 2024-09-14T11:37:21.695 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.696+0000 7fced5c63800 20 remove_watcher() i=6 2024-09-14T11:37:21.696 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.697+0000 7fced5c63800 20 remove_watcher() i=7 2024-09-14T11:37:21.709 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:21.741 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:21.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.782+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.783+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.782 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.783+0000 7f7a9de20800 20 realm 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.783+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.784+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.784+0000 7f7a9de20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.784+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.784+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.784+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.785+0000 7f7a9de20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.785+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.785+0000 7f7a9de20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:21.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.785+0000 7f7a9de20800 20 searching for the correct realm 2024-09-14T11:37:21.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.788+0000 7f7a9b109640 0 -- 172.21.15.28:0/1439017344 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f7a8c08c440 msgr2=0x7f7a8c08c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.791+0000 7f7a9b90a640 0 -- 172.21.15.28:0/1439017344 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f7a900a53c0 msgr2=0x7f7a9004a9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:21.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:21.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:21.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.998+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:21.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:21.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:21.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 zone default found 2024-09-14T11:37:21.999 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 4 Realm: () 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 zonegroup default 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:21.999+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.000+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.000+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.000+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.000+0000 7f7a9de20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.000+0000 7f7a9de20800 20 started sync module instance, tier type = 2024-09-14T11:37:22.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.000+0000 7f7a9de20800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=0 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=1 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=2 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=3 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=4 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=5 2024-09-14T11:37:22.009 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.010+0000 7f7a9de20800 20 add_watcher() i=6 2024-09-14T11:37:22.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.011+0000 7f7a9de20800 20 add_watcher() i=7 2024-09-14T11:37:22.010 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.011+0000 7f7a9de20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:22.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.013+0000 7f7951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.012 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.013+0000 7f7a9de20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.013+0000 7f7a9de20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.013+0000 7f7a9de20800 5 note: GC not initialized 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.013+0000 7f7950fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.013+0000 7f7a9de20800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 20 Filter name: none 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f78ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:37:22.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : miss 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.014+0000 7f7a9de20800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.015+0000 7f7a9de20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.015+0000 7f7a9de20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.015+0000 7f7a9de20800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.015+0000 7f7a9de20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:22.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.015+0000 7f7a9de20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.015 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.015+0000 7f7a9de20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:37:22.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.018+0000 7f7a9de20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.018+0000 7f7a9de20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.018+0000 7f7a9de20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.017 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.018+0000 7f7a9de20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:37:22.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.019+0000 7f797a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94794795084352 notifier 8487 bl.length()=827 2024-09-14T11:37:22.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.019+0000 7f797a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.019+0000 7f797a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.019+0000 7f797a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.021+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:37:22.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.021+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:37:22.019 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.021+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:37:22.020 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.021+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:37:22.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.023+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:37:22.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.023+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:37:22.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.023+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:22.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.023+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:22.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.024+0000 7f7a9de20800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:37:22.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.024+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:22.023 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.024+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:22.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.024+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:22.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.024+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:22.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.025+0000 7f7a9de20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:22.024 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.025+0000 7f7a9de20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:37:22.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.026+0000 7f7a9de20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.026+0000 7f7a9de20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.026+0000 7f7a9de20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.025 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.026+0000 7f7a9de20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:37:22.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.027+0000 7f797affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94794795084352 notifier 8487 bl.length()=827 2024-09-14T11:37:22.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.027+0000 7f797affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.027+0000 7f797affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.027+0000 7f797affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.028+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:37:22.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.028+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:37:22.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.028+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:37:22.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.028+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:37:22.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.029+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:22.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.029+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.0 2024-09-14T11:37:22.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.030+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:22.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.030+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.1 2024-09-14T11:37:22.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.030+0000 7f7a9de20800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:22.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.030+0000 7f7a9de20800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.2.2 2024-09-14T11:37:22.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.030+0000 7f7a9de20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:22.030 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.030+0000 7f7a9de20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f7a9de20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f7a9de20800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f7a9de20800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f7a9de20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17, ofs0, ns] 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f797a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94794795084352 notifier 8487 bl.length()=795 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f797a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 info.flags=0x17 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f797a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17 to cache LRU end 2024-09-14T11:37:22.031 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.032+0000 7f797a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.033+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_sources= new_sources= 2024-09-14T11:37:22.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.033+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential sources added=[] removed=[] 2024-09-14T11:37:22.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.033+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): orig_dests= new_dests= 2024-09-14T11:37:22.032 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.033+0000 7f7a9de20800 20 handle_bi_update(): bucket=:a-bucket[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17]): potential dests added=[] removed=[] 2024-09-14T11:37:22.033 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.035+0000 7f7a9de20800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-14T11:37:22.035 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.037+0000 7f7951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.037 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.039+0000 7f7a9de20800 20 remove_watcher() i=0 2024-09-14T11:37:22.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.039+0000 7f7a9de20800 2 removed watcher, disabling cache 2024-09-14T11:37:22.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.040+0000 7f7a9de20800 20 remove_watcher() i=1 2024-09-14T11:37:22.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.041+0000 7f7a9de20800 20 remove_watcher() i=2 2024-09-14T11:37:22.040 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.042+0000 7f7a9de20800 20 remove_watcher() i=3 2024-09-14T11:37:22.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.043+0000 7f7a9de20800 20 remove_watcher() i=4 2024-09-14T11:37:22.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.044+0000 7f7a9de20800 20 remove_watcher() i=5 2024-09-14T11:37:22.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.045+0000 7f7a9de20800 20 remove_watcher() i=6 2024-09-14T11:37:22.045 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.046+0000 7f7a9de20800 20 remove_watcher() i=7 2024-09-14T11:37:22.057 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:37:22.087 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:22.087 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:22.125 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.127+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.128+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.128+0000 7f25eb146800 20 realm 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.128+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.129+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.129+0000 7f25eb146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.129+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.129+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.128 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.129+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.130+0000 7f25eb146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.130+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.130+0000 7f25eb146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:22.129 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.130+0000 7f25eb146800 20 searching for the correct realm 2024-09-14T11:37:22.132 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.133+0000 7f25e9438640 0 -- 172.21.15.28:0/493866776 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f25d4041420 msgr2=0x7f25d4041840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.135 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.136+0000 7f25e8c37640 0 -- 172.21.15.28:0/493866776 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f25d400d3e0 msgr2=0x7f25d400d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.341 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.342+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.342 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:22.343 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 zone default found 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 4 Realm: () 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 zonegroup default 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.343+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.344+0000 7f25eb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.344+0000 7f25eb146800 20 started sync module instance, tier type = 2024-09-14T11:37:22.344 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.344+0000 7f25eb146800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:22.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=0 2024-09-14T11:37:22.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=1 2024-09-14T11:37:22.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=2 2024-09-14T11:37:22.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=3 2024-09-14T11:37:22.352 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=4 2024-09-14T11:37:22.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=5 2024-09-14T11:37:22.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.353+0000 7f25eb146800 20 add_watcher() i=6 2024-09-14T11:37:22.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.354+0000 7f25eb146800 20 add_watcher() i=7 2024-09-14T11:37:22.353 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.354+0000 7f25eb146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:22.354 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.355+0000 7f249f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f25eb146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:22.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f25eb146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:22.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f25eb146800 5 note: GC not initialized 2024-09-14T11:37:22.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f249e7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:22.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f25eb146800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:22.355 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f25eb146800 20 Filter name: none 2024-09-14T11:37:22.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f24977fe640 20 reqs_thread_entry: start 2024-09-14T11:37:22.356 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.356+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 INFO: main: starting shard=0 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.357+0000 7f25eb146800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17.3.0 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.358+0000 7f25eb146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:22.357 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.358+0000 7f25eb146800 20 INFO: main: done 2024-09-14T11:37:22.358 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.359+0000 7f249f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.361+0000 7f25eb146800 20 remove_watcher() i=0 2024-09-14T11:37:22.360 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.361+0000 7f25eb146800 2 removed watcher, disabling cache 2024-09-14T11:37:22.361 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.362+0000 7f25eb146800 20 remove_watcher() i=1 2024-09-14T11:37:22.362 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.363+0000 7f25eb146800 20 remove_watcher() i=2 2024-09-14T11:37:22.363 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.365+0000 7f25eb146800 20 remove_watcher() i=3 2024-09-14T11:37:22.364 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.366+0000 7f25eb146800 20 remove_watcher() i=4 2024-09-14T11:37:22.365 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.367+0000 7f25eb146800 20 remove_watcher() i=5 2024-09-14T11:37:22.366 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.368+0000 7f25eb146800 20 remove_watcher() i=6 2024-09-14T11:37:22.368 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.369+0000 7f25eb146800 20 remove_watcher() i=7 2024-09-14T11:37:22.379 INFO:tasks.workunit.client.0.smithi028.stderr: test: PUT succeeds during reshard 2024-09-14T11:37:22.381 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:37:22.411 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:22.411 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:22.449 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.450+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.451 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.452+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.452+0000 7f3bfdb2c800 20 realm 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.452+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.453+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.453+0000 7f3bfdb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.453+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.453+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.453+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.454+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.452 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.454+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.454+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:22.453 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.454+0000 7f3bfdb2c800 20 searching for the correct realm 2024-09-14T11:37:22.456 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.458+0000 7f3bf8f3d640 0 -- 172.21.15.28:0/2727719685 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f3bec040040 msgr2=0x7f3bec03f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.460 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.461+0000 7f3bf9f3f640 0 -- 172.21.15.28:0/2727719685 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f3bf00036a0 msgr2=0x7f3bf00ad0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.463 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.464+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.464 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:22.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 zone default found 2024-09-14T11:37:22.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 4 Realm: () 2024-09-14T11:37:22.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:22.465 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 zonegroup default 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.465+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.466+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.466+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.466+0000 7f3bfdb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.466+0000 7f3bfdb2c800 20 started sync module instance, tier type = 2024-09-14T11:37:22.466 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.466+0000 7f3bfdb2c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:22.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=0 2024-09-14T11:37:22.473 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=1 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=2 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=3 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=4 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=5 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=6 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 20 add_watcher() i=7 2024-09-14T11:37:22.474 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.475+0000 7f3bfdb2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:22.476 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.477+0000 7f3aaffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3bfdb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:22.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3bfdb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:22.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3bfdb2c800 5 note: GC not initialized 2024-09-14T11:37:22.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3aaefe5640 20 reqs_thread_entry: start 2024-09-14T11:37:22.477 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3bfdb2c800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:22.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3bfdb2c800 20 Filter name: none 2024-09-14T11:37:22.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3aacfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:22.478 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.478+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.479+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.479+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.479+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.479+0000 7f3bfdb2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.479+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.480+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.480+0000 7f3bfdb2c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.480+0000 7f3bfdb2c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:22.479 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.480+0000 7f3bfdb2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:22.480 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.481+0000 7f3aaffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.483+0000 7f3bfdb2c800 20 remove_watcher() i=0 2024-09-14T11:37:22.482 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.483+0000 7f3bfdb2c800 2 removed watcher, disabling cache 2024-09-14T11:37:22.483 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.484+0000 7f3bfdb2c800 20 remove_watcher() i=1 2024-09-14T11:37:22.484 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.485+0000 7f3bfdb2c800 20 remove_watcher() i=2 2024-09-14T11:37:22.485 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.486+0000 7f3bfdb2c800 20 remove_watcher() i=3 2024-09-14T11:37:22.486 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.487+0000 7f3bfdb2c800 20 remove_watcher() i=4 2024-09-14T11:37:22.487 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.488+0000 7f3bfdb2c800 20 remove_watcher() i=5 2024-09-14T11:37:22.488 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.489+0000 7f3bfdb2c800 20 remove_watcher() i=6 2024-09-14T11:37:22.489 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.491+0000 7f3bfdb2c800 20 remove_watcher() i=7 2024-09-14T11:37:22.500 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:22.501 INFO:tasks.workunit.client.0.smithi028.stderr:BUCKET_STATS: 2024-09-14T11:37:22.501 INFO:tasks.workunit.client.0.smithi028.stderr:bucket: myver id: ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-14T11:37:22.501 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:22.502 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-14T11:37:22.535 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:22.536 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:22.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.576+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.578+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.578+0000 7f10b222f800 20 realm 2024-09-14T11:37:22.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.578+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.578+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.578+0000 7f10b222f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:22.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.578+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.579+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.579+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.579+0000 7f10b222f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.579+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.580+0000 7f10b222f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:22.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.580+0000 7f10b222f800 20 searching for the correct realm 2024-09-14T11:37:22.582 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.583+0000 7f10b051a640 0 -- 172.21.15.28:0/4000733412 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55c73362cf30 msgr2=0x55c73362f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.585 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.587+0000 7f10af518640 0 -- 172.21.15.28:0/4000733412 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f10a003f060 msgr2=0x7f10a0067ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.590+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.590 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:22.591 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 zone default found 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 4 Realm: () 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 zonegroup default 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.591+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.592+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.592+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.592+0000 7f10b222f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:22.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.592+0000 7f10b222f800 20 started sync module instance, tier type = 2024-09-14T11:37:22.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.592+0000 7f10b222f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=0 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=1 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=2 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=3 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=4 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=5 2024-09-14T11:37:22.600 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.601+0000 7f10b222f800 20 add_watcher() i=6 2024-09-14T11:37:22.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.602+0000 7f10b222f800 20 add_watcher() i=7 2024-09-14T11:37:22.601 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.602+0000 7f10b222f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:22.602 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.603+0000 7f0f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 5 note: GC not initialized 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f0f64fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 20 Filter name: none 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f0ede7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.604+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:37:22.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : miss 2024-09-14T11:37:22.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 20 rados->read ofs=0 len=0 2024-09-14T11:37:22.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:22.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:22.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 adding default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:22.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:22.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.605+0000 7f10b222f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f10b222f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f10b222f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f10b222f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f10b222f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f0f8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 94314048972352 notifier 8538 bl.length()=821 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f0f8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f0f8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:22.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.609+0000 7f0f8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:22.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.611+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:22.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.611+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:22.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.611+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:22.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.611+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:22.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:22.613+0000 7f10b222f800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:37:23.573 INFO:tasks.workunit.client.0.smithi028.stderr:put object successful 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.0 2024-09-14T11:37:27.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.615+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.0 2024-09-14T11:37:27.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.616+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.1 2024-09-14T11:37:27.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.616+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.1 2024-09-14T11:37:27.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.618+0000 7f10b222f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:27.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.618+0000 7f10b222f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f10b222f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f10b222f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f10b222f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f10b222f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f0f8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431635 cookie 94314048972352 notifier 8538 bl.length()=821 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f0f8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:27.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f0f8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:27.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.620+0000 7f0f8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:27.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.622+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:27.620 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.622+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:27.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.622+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:27.621 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.622+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:27.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.624+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.0 2024-09-14T11:37:27.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.624+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.0 2024-09-14T11:37:27.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.625+0000 7f10b222f800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.1 2024-09-14T11:37:27.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.625+0000 7f10b222f800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.1.1 2024-09-14T11:37:27.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.627+0000 7f10b222f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:27.625 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.627+0000 7f10b222f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f10b222f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f10b222f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f10b222f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f10b222f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f0f8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 94314048972352 notifier 8538 bl.length()=789 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f0f8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f0f8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:27.627 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.629+0000 7f0f8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:27.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.631+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:27.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.631+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:27.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.631+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:27.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.631+0000 7f10b222f800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:27.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.633+0000 7f10b222f800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-14T11:37:27.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.636+0000 7f0f65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.638+0000 7f10b222f800 20 remove_watcher() i=0 2024-09-14T11:37:27.636 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.638+0000 7f10b222f800 2 removed watcher, disabling cache 2024-09-14T11:37:27.637 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.639+0000 7f10b222f800 20 remove_watcher() i=1 2024-09-14T11:37:27.639 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.641+0000 7f10b222f800 20 remove_watcher() i=2 2024-09-14T11:37:27.640 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.642+0000 7f10b222f800 20 remove_watcher() i=3 2024-09-14T11:37:27.641 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.643+0000 7f10b222f800 20 remove_watcher() i=4 2024-09-14T11:37:27.642 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.644+0000 7f10b222f800 20 remove_watcher() i=5 2024-09-14T11:37:27.643 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.646+0000 7f10b222f800 20 remove_watcher() i=6 2024-09-14T11:37:27.645 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:27.647+0000 7f10b222f800 20 remove_watcher() i=7 2024-09-14T11:37:28.578 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:37:28.578 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T11:37:28.924 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:37:29.332 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:37:30.833 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:37:30.835 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:37:30.868 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:30.869 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:30.910 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.912+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.914+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.914+0000 7f02c95af800 20 realm 2024-09-14T11:37:30.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.914+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.914+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.914+0000 7f02c95af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:30.913 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.914+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.915+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.915+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.914 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.916+0000 7f02c95af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:30.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.916+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.916+0000 7f02c95af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:30.915 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.916+0000 7f02c95af800 20 searching for the correct realm 2024-09-14T11:37:30.918 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.921+0000 7f02c6898640 0 -- 172.21.15.28:0/717939959 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f02b802c070 msgr2=0x7f02b803c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:30.923 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.925+0000 7f02c6898640 0 -- 172.21.15.28:0/717939959 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f0190087960 msgr2=0x7f0190089d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.930 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.930+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 zone default found 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 4 Realm: () 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 zonegroup default 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.931 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.931+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.932+0000 7f02c95af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.932+0000 7f02c95af800 20 started sync module instance, tier type = 2024-09-14T11:37:30.932 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.932+0000 7f02c95af800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=0 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=1 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=2 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=3 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=4 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=5 2024-09-14T11:37:30.940 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.942+0000 7f02c95af800 20 add_watcher() i=6 2024-09-14T11:37:30.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.943+0000 7f02c95af800 20 add_watcher() i=7 2024-09-14T11:37:30.941 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.943+0000 7f02c95af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:30.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.944+0000 7f017dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:30.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f02c95af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:30.943 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f02c95af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:30.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f02c95af800 5 note: GC not initialized 2024-09-14T11:37:30.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f017cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:30.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f02c95af800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:30.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f02c95af800 20 Filter name: none 2024-09-14T11:37:30.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f00f67fc640 20 reqs_thread_entry: start 2024-09-14T11:37:30.944 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.945+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.946+0000 7f02c95af800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:30.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.946+0000 7f02c95af800 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.945 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 INFO: main: starting shard=0 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 INFO: main: starting shard=1 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:30.946 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.947+0000 7f02c95af800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:30.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.948+0000 7f02c95af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:30.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.948+0000 7f02c95af800 20 INFO: main: starting shard=2 2024-09-14T11:37:30.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.948+0000 7f02c95af800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:30.947 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.948+0000 7f02c95af800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:30.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.948+0000 7f02c95af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:30.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.948+0000 7f02c95af800 20 INFO: main: done 2024-09-14T11:37:30.948 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.949+0000 7f017dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:30.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.952+0000 7f02c95af800 20 remove_watcher() i=0 2024-09-14T11:37:30.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.952+0000 7f02c95af800 2 removed watcher, disabling cache 2024-09-14T11:37:30.950 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.953+0000 7f02c95af800 20 remove_watcher() i=1 2024-09-14T11:37:30.952 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.954+0000 7f02c95af800 20 remove_watcher() i=2 2024-09-14T11:37:30.953 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.955+0000 7f02c95af800 20 remove_watcher() i=3 2024-09-14T11:37:30.954 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.956+0000 7f02c95af800 20 remove_watcher() i=4 2024-09-14T11:37:30.955 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.958+0000 7f02c95af800 20 remove_watcher() i=5 2024-09-14T11:37:30.956 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.958+0000 7f02c95af800 20 remove_watcher() i=6 2024-09-14T11:37:30.957 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:30.959+0000 7f02c95af800 20 remove_watcher() i=7 2024-09-14T11:37:31.082 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:37:31.084 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:37:31.117 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:31.117 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:31.155 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.158+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 realm 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.158 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.160+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.161+0000 7f5406540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:31.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.161+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.161+0000 7f5406540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:31.159 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.161+0000 7f5406540800 20 searching for the correct realm 2024-09-14T11:37:31.163 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.165+0000 7f5402ac8640 0 -- 172.21.15.28:0/3189762924 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55d9d5a3e9a0 msgr2=0x55d9d5a40d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:31.367 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.369+0000 7f54022c7640 0 -- 172.21.15.28:0/3189762924 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f53f8048b00 msgr2=0x7f53f80701c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:31.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:31.775 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.777+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.778+0000 7f5406540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.778+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.778+0000 7f5406540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 zone default found 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 4 Realm: () 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:31.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 zonegroup default 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.779+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.780+0000 7f5406540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:31.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.780+0000 7f5406540800 20 started sync module instance, tier type = 2024-09-14T11:37:31.779 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.780+0000 7f5406540800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=0 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=1 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=2 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=3 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=4 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=5 2024-09-14T11:37:31.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.791+0000 7f5406540800 20 add_watcher() i=6 2024-09-14T11:37:31.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.792+0000 7f5406540800 20 add_watcher() i=7 2024-09-14T11:37:31.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.792+0000 7f5406540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:31.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.794+0000 7f52b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:31.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.794+0000 7f5406540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:31.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.794+0000 7f5406540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:31.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.794+0000 7f5406540800 5 note: GC not initialized 2024-09-14T11:37:31.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.794+0000 7f52337fe640 20 reqs_thread_entry: start 2024-09-14T11:37:31.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.795+0000 7f5406540800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:31.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.795+0000 7f5406540800 20 Filter name: none 2024-09-14T11:37:31.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.795+0000 7f52317fa640 20 reqs_thread_entry: start 2024-09-14T11:37:31.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.795+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.793 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.795+0000 7f5406540800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:31.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.795+0000 7f5406540800 20 rados->read ofs=0 len=0 2024-09-14T11:37:31.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.796+0000 7f5406540800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:31.794 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.796+0000 7f5406540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.796+0000 7f5406540800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.796+0000 7f5406540800 20 INFO: main: starting shard=0 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.796+0000 7f5406540800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.796+0000 7f5406540800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 20 INFO: main: starting shard=1 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:31.795 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:31.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 20 INFO: main: starting shard=2 2024-09-14T11:37:31.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:31.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.797+0000 7f5406540800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:31.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.798+0000 7f5406540800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:37:31.796 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.798+0000 7f5406540800 20 INFO: main: done 2024-09-14T11:37:31.797 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.799+0000 7f52b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:31.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.802+0000 7f5406540800 20 remove_watcher() i=0 2024-09-14T11:37:31.800 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.802+0000 7f5406540800 2 removed watcher, disabling cache 2024-09-14T11:37:31.801 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.803+0000 7f5406540800 20 remove_watcher() i=1 2024-09-14T11:37:31.803 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.805+0000 7f5406540800 20 remove_watcher() i=2 2024-09-14T11:37:31.804 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.806+0000 7f5406540800 20 remove_watcher() i=3 2024-09-14T11:37:31.805 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.807+0000 7f5406540800 20 remove_watcher() i=4 2024-09-14T11:37:31.806 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.808+0000 7f5406540800 20 remove_watcher() i=5 2024-09-14T11:37:31.808 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.810+0000 7f5406540800 20 remove_watcher() i=6 2024-09-14T11:37:31.809 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:31.811+0000 7f5406540800 20 remove_watcher() i=7 2024-09-14T11:37:31.937 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:37:31.938 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:37:31.972 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:31.972 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:32.011 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.013+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 realm 2024-09-14T11:37:32.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.013 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.015+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.016+0000 7f4da2e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.016+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.016+0000 7f4da2e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:32.014 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.016+0000 7f4da2e87800 20 searching for the correct realm 2024-09-14T11:37:32.018 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.021+0000 7f4d9bfff640 0 -- 172.21.15.28:0/1600102217 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f4d94030b10 msgr2=0x7f4d94069220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:32.022 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.024+0000 7f4da1172640 0 -- 172.21.15.28:0/1600102217 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f4d8c03d230 msgr2=0x7f4d8c075200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:32.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:32.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:32.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:32.026 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:32.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:32.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:32.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.027 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.028+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:32.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:32.028 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 zone default found 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 4 Realm: () 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 zonegroup default 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.029+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.030+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.030+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.030+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.030+0000 7f4da2e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.030+0000 7f4da2e87800 20 started sync module instance, tier type = 2024-09-14T11:37:32.029 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.030+0000 7f4da2e87800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.039+0000 7f4da2e87800 20 add_watcher() i=0 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.039+0000 7f4da2e87800 20 add_watcher() i=1 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.039+0000 7f4da2e87800 20 add_watcher() i=2 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.039+0000 7f4da2e87800 20 add_watcher() i=3 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.039+0000 7f4da2e87800 20 add_watcher() i=4 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.039+0000 7f4da2e87800 20 add_watcher() i=5 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.040+0000 7f4da2e87800 20 add_watcher() i=6 2024-09-14T11:37:32.038 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.040+0000 7f4da2e87800 20 add_watcher() i=7 2024-09-14T11:37:32.039 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.040+0000 7f4da2e87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.042+0000 7f4c55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.042+0000 7f4da2e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.042+0000 7f4da2e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.042+0000 7f4da2e87800 5 note: GC not initialized 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.042+0000 7f4c54fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.043+0000 7f4da2e87800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.043+0000 7f4da2e87800 20 Filter name: none 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.043+0000 7f4bce7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:32.041 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.043+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.043+0000 7f4da2e87800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:32.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.043+0000 7f4da2e87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:32.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:32.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:37:32.042 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 INFO: main: starting shard=0 2024-09-14T11:37:32.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:32.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:32.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:32.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 INFO: main: starting shard=1 2024-09-14T11:37:32.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:32.043 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.044+0000 7f4da2e87800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.045+0000 7f4da2e87800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.045+0000 7f4da2e87800 20 INFO: main: starting shard=2 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.045+0000 7f4da2e87800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.045+0000 7f4da2e87800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.045+0000 7f4da2e87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.045+0000 7f4da2e87800 20 INFO: main: done 2024-09-14T11:37:32.044 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.046+0000 7f4c55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:32.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.049+0000 7f4da2e87800 20 remove_watcher() i=0 2024-09-14T11:37:32.046 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.049+0000 7f4da2e87800 2 removed watcher, disabling cache 2024-09-14T11:37:32.048 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.050+0000 7f4da2e87800 20 remove_watcher() i=1 2024-09-14T11:37:32.049 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.051+0000 7f4da2e87800 20 remove_watcher() i=2 2024-09-14T11:37:32.050 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.052+0000 7f4da2e87800 20 remove_watcher() i=3 2024-09-14T11:37:32.051 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.053+0000 7f4da2e87800 20 remove_watcher() i=4 2024-09-14T11:37:32.052 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.054+0000 7f4da2e87800 20 remove_watcher() i=5 2024-09-14T11:37:32.053 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.055+0000 7f4da2e87800 20 remove_watcher() i=6 2024-09-14T11:37:32.054 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.056+0000 7f4da2e87800 20 remove_watcher() i=7 2024-09-14T11:37:32.092 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:37:32.498 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:37:32.904 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:37:32.936 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:32.936 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:32.975 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.977+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 realm 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:32.977 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.979+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.980+0000 7f6036724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:32.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.980+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:32.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.980+0000 7f6036724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:32.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.981+0000 7f6036724800 20 searching for the correct realm 2024-09-14T11:37:32.982 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.984+0000 7f6031b01640 0 -- 172.21.15.28:0/2489014957 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f602408b2a0 msgr2=0x7f60240419a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:32.986 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:32.988+0000 7f6032302640 0 -- 172.21.15.28:0/2489014957 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f60280a53e0 msgr2=0x7f60280a5860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:33.193 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.195+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.194 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:33.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 zone default found 2024-09-14T11:37:33.195 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 4 Realm: () 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 zonegroup default 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.196+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.197+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.197+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.197+0000 7f6036724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.197+0000 7f6036724800 20 started sync module instance, tier type = 2024-09-14T11:37:33.196 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.197+0000 7f6036724800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=0 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=1 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=2 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=3 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=4 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=5 2024-09-14T11:37:33.205 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.207+0000 7f6036724800 20 add_watcher() i=6 2024-09-14T11:37:33.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.208+0000 7f6036724800 20 add_watcher() i=7 2024-09-14T11:37:33.206 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.208+0000 7f6036724800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:33.207 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f5ee8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:33.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f6036724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:33.208 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f6036724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f6036724800 5 note: GC not initialized 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f5e637fe640 20 reqs_thread_entry: start 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f6036724800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f6036724800 20 Filter name: none 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.210+0000 7f5e617fa640 20 reqs_thread_entry: start 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:37:33.209 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : miss 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 adding default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.210 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.211+0000 7f6036724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:33.215 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f6036724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f6036724800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f6036724800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f6036724800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f5f157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 93892484622624 notifier 8640 bl.length()=821 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f5f157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f5f157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.216 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.218+0000 7f5f157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.220+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:33.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.220+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:33.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.220+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:33.218 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.220+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:33.221 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.0 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.0 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.1 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.1 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.2 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.2 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.3 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.3 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.4 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.4 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.5 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.5 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.6 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.6 2024-09-14T11:37:33.222 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.7 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.7 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.8 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.8 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.10 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.10 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.11 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.11 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.12 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.12 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.13 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.13 2024-09-14T11:37:33.223 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.14 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.14 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.15 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.15 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.16 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.16 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.223+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:33.224 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.224+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:33.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.224+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:33.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.227+0000 7f6036724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:33.225 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.227+0000 7f6036724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:33.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.228+0000 7f6036724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.226 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f6036724800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f6036724800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f6036724800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:33.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f5f15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 93892484622624 notifier 8640 bl.length()=821 2024-09-14T11:37:33.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f5f15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f5f15ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.227 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.229+0000 7f5f15ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.230+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:33.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.230+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:33.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.230+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:33.228 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.230+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:33.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.232+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:33.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.232+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.0 2024-09-14T11:37:33.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.232+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:33.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.232+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.1 2024-09-14T11:37:33.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.232+0000 7f6036724800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:33.230 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.232+0000 7f6036724800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.2.2 2024-09-14T11:37:33.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.233+0000 7f6036724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:33.231 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.233+0000 7f6036724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:33.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.234+0000 7f6036724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.234+0000 7f6036724800 10 moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.234+0000 7f6036724800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.232 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.234+0000 7f6036724800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18, ofs0, ns] 2024-09-14T11:37:33.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.235+0000 7f5f157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 93892484622624 notifier 8640 bl.length()=789 2024-09-14T11:37:33.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.235+0000 7f5f157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.235+0000 7f5f157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.233 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.235+0000 7f5f157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.236+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_sources= new_sources= 2024-09-14T11:37:33.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.236+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential sources added=[] removed=[] 2024-09-14T11:37:33.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.236+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): orig_dests= new_dests= 2024-09-14T11:37:33.234 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.236+0000 7f6036724800 20 handle_bi_update(): bucket=:myver[ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18]): potential dests added=[] removed=[] 2024-09-14T11:37:33.235 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.237+0000 7f6036724800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-14T11:37:33.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.240+0000 7f5ee8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:33.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.242+0000 7f6036724800 20 remove_watcher() i=0 2024-09-14T11:37:33.240 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.242+0000 7f6036724800 2 removed watcher, disabling cache 2024-09-14T11:37:33.241 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.244+0000 7f6036724800 20 remove_watcher() i=1 2024-09-14T11:37:33.242 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.245+0000 7f6036724800 20 remove_watcher() i=2 2024-09-14T11:37:33.243 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.246+0000 7f6036724800 20 remove_watcher() i=3 2024-09-14T11:37:33.245 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.247+0000 7f6036724800 20 remove_watcher() i=4 2024-09-14T11:37:33.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.248+0000 7f6036724800 20 remove_watcher() i=5 2024-09-14T11:37:33.246 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.249+0000 7f6036724800 20 remove_watcher() i=6 2024-09-14T11:37:33.247 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.250+0000 7f6036724800 20 remove_watcher() i=7 2024-09-14T11:37:33.260 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:37:33.296 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:33.296 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:33.335 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.337+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.339+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.339+0000 7f4c1a323800 20 realm 2024-09-14T11:37:33.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.339+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.339+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.339+0000 7f4c1a323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:33.337 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.339+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.340+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.340+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.338 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.340+0000 7f4c1a323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.340+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.341+0000 7f4c1a323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:33.339 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.341+0000 7f4c1a323800 20 searching for the correct realm 2024-09-14T11:37:33.340 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.342+0000 7f4c1600c640 0 -- 172.21.15.28:0/3940834231 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f4c04003cb0 msgr2=0x7f4c08065870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:33.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.548+0000 7f4c1680d640 0 -- 172.21.15.28:0/3940834231 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f4c00040ab0 msgr2=0x7f4c00041ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:33.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:33.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:33.552 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:33.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:33.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:33.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:33.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.554+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:33.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 zone default found 2024-09-14T11:37:33.554 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 4 Realm: () 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 zonegroup default 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.555+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 started sync module instance, tier type = 2024-09-14T11:37:33.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.556+0000 7f4c1a323800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=0 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=1 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=2 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=3 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=4 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=5 2024-09-14T11:37:33.564 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.566+0000 7f4c1a323800 20 add_watcher() i=6 2024-09-14T11:37:33.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.567+0000 7f4c1a323800 20 add_watcher() i=7 2024-09-14T11:37:33.565 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.567+0000 7f4c1a323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:33.566 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.569+0000 7f4accfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.569+0000 7f4c1a323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.569+0000 7f4c1a323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.569+0000 7f4c1a323800 5 note: GC not initialized 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.569+0000 7f4a477fe640 20 reqs_thread_entry: start 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.569+0000 7f4c1a323800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 20 Filter name: none 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4a457fa640 20 reqs_thread_entry: start 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:37:33.568 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 : miss 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.570+0000 7f4c1a323800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 info.flags=0x17 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 10 adding default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 to cache LRU end 2024-09-14T11:37:33.569 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:33.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:37:33.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18 2024-09-14T11:37:33.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.0 2024-09-14T11:37:33.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.571+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.0 2024-09-14T11:37:33.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.572+0000 7f4c1a323800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:37:33.570 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.572+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.1 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.572+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.1 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.572+0000 7f4c1a323800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.572+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.2 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.572+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.2 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.573+0000 7f4c1a323800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.573+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.3 2024-09-14T11:37:33.571 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.573+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.3 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.573+0000 7f4c1a323800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.573+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.4 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.573+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.4 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.5 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.5 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.6 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.6 2024-09-14T11:37:33.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:37:33.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.7 2024-09-14T11:37:33.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.574+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.7 2024-09-14T11:37:33.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.575+0000 7f4c1a323800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:37:33.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.575+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.8 2024-09-14T11:37:33.573 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.575+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.8 2024-09-14T11:37:33.574 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.576+0000 7f4c1a323800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:37:33.574 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.576+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.574 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.576+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.577+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.10 2024-09-14T11:37:33.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.577+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.10 2024-09-14T11:37:33.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.577+0000 7f4c1a323800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:37:33.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.577+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.11 2024-09-14T11:37:33.575 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.577+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.11 2024-09-14T11:37:33.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.578+0000 7f4c1a323800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:37:33.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.578+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.12 2024-09-14T11:37:33.576 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.578+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.12 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.579+0000 7f4c1a323800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.579+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.13 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.579+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.13 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.579+0000 7f4c1a323800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.579+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.14 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.579+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.14 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.580+0000 7f4c1a323800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.580+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.15 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.580+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.15 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.581+0000 7f4c1a323800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.581+0000 7f4c1a323800 10 bucket_obj is .dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.16 2024-09-14T11:37:33.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.581+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.16 2024-09-14T11:37:33.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.581+0000 7f4c1a323800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:37:33.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.581+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.579 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.582+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:x state=0x562d8eae7888 s->prefetch_data=0 2024-09-14T11:37:33.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.582+0000 7f4c1a323800 20 get_obj_state: setting s->obj_tag to 0xyh722lr7uk0d2n8q5hndsq6fbh7g4c 2024-09-14T11:37:33.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.582+0000 7f4c1a323800 20 get_obj_state_impl: setting s->olh_tag to 6mbodwb2n7z9yybzavp8rn8f57ha8noo 2024-09-14T11:37:33.580 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.582+0000 7f4c1a323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6mbodwb2n7z9yybzavp8rn8f57ha8noo 2024-09-14T11:37:33.581 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.583+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.585+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.585+0000 7f4c1a323800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:37:33.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.585+0000 7f4c1a323800 20 olh_log_entry: epoch=2 op=3 key=x[pQm68eTdvkm9xkUK-DJ3WGCeeShkXgA] 2024-09-14T11:37:33.583 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.585+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:_:pQm68eTdvkm9xkUK-DJ3WGCeeShkXgA_x state=0x562d8eb22f48 s->prefetch_data=0 2024-09-14T11:37:33.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.586+0000 7f4c1a323800 10 manifest: total_size = 9 2024-09-14T11:37:33.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.586+0000 7f4c1a323800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1664717792452381494 2024-09-14T11:37:33.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.586+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:_:pQm68eTdvkm9xkUK-DJ3WGCeeShkXgA_x state=0x562d8eb22f48 s->prefetch_data=0 2024-09-14T11:37:33.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.586+0000 7f4c1a323800 20 prepare_atomic_modification: state is not atomic. state=0x562d8eb22f48 2024-09-14T11:37:33.584 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.586+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.588+0000 7f4c1a323800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:37:33.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.588+0000 7f4c1a323800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:37:33.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.588+0000 7f4c1a323800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:37:33.586 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.588+0000 7f4c1a323800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:pQm68eTdvkm9xkUK-DJ3WGCeeShkXgA_.1HnOLDs-KNlgiawMFVOWj7QE7RbhiMG_0 2024-09-14T11:37:33.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.590+0000 7f4af9ffb640 20 handle_completion(): completion ok for obj=x[pQm68eTdvkm9xkUK-DJ3WGCeeShkXgA] 2024-09-14T11:37:33.588 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.590+0000 7f4c1a323800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:37:33.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.591+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:x state=0x562d8eae7888 s->prefetch_data=0 2024-09-14T11:37:33.589 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.591+0000 7f4c1a323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6mbodwb2n7z9yybzavp8rn8f57ha8noo 2024-09-14T11:37:33.592 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.594+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.593 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.596+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.596+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.594 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.597+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:y state=0x562d8eae7888 s->prefetch_data=0 2024-09-14T11:37:33.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.597+0000 7f4c1a323800 20 get_obj_state: setting s->obj_tag to vncka04lwbcnp7syyv7wbt79ha6jrazi 2024-09-14T11:37:33.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.597+0000 7f4c1a323800 20 get_obj_state_impl: setting s->olh_tag to jsfi6ip7c1xwvw3x6iflzn9snhbu7ci0 2024-09-14T11:37:33.595 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.597+0000 7f4c1a323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jsfi6ip7c1xwvw3x6iflzn9snhbu7ci0 2024-09-14T11:37:33.596 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.599+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.600+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.600+0000 7f4c1a323800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:37:33.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.600+0000 7f4c1a323800 20 olh_log_entry: epoch=2 op=3 key=y[r0R1bf.6D3skw66eLp9GN7kAR6j0uJa] 2024-09-14T11:37:33.598 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.600+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:_:r0R1bf.6D3skw66eLp9GN7kAR6j0uJa_y state=0x562d8eb22f48 s->prefetch_data=0 2024-09-14T11:37:33.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.601+0000 7f4c1a323800 10 manifest: total_size = 11 2024-09-14T11:37:33.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.601+0000 7f4c1a323800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16585923824198999303 2024-09-14T11:37:33.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.601+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:_:r0R1bf.6D3skw66eLp9GN7kAR6j0uJa_y state=0x562d8eb22f48 s->prefetch_data=0 2024-09-14T11:37:33.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.601+0000 7f4c1a323800 20 prepare_atomic_modification: state is not atomic. state=0x562d8eb22f48 2024-09-14T11:37:33.599 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.601+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.605+0000 7f4c1a323800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:37:33.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.605+0000 7f4c1a323800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:37:33.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.605+0000 7f4c1a323800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:37:33.603 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.605+0000 7f4c1a323800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:r0R1bf.6D3skw66eLp9GN7kAR6j0uJa_.zwTt0WYPIeJTUTG7-UClCt9Breq6P5T_0 2024-09-14T11:37:33.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.606+0000 7f4af9ffb640 20 handle_completion(): completion ok for obj=y[r0R1bf.6D3skw66eLp9GN7kAR6j0uJa] 2024-09-14T11:37:33.604 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.607+0000 7f4c1a323800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:37:33.605 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.608+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:y state=0x562d8eae7888 s->prefetch_data=0 2024-09-14T11:37:33.606 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.608+0000 7f4c1a323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jsfi6ip7c1xwvw3x6iflzn9snhbu7ci0 2024-09-14T11:37:33.608 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.610+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.609 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.612+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.612+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.612+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:z state=0x562d8eae7888 s->prefetch_data=0 2024-09-14T11:37:33.610 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.613+0000 7f4c1a323800 20 get_obj_state: setting s->obj_tag to 7p3wbzkbowifr87or6923sckc32ix4l4 2024-09-14T11:37:33.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.613+0000 7f4c1a323800 20 get_obj_state_impl: setting s->olh_tag to 5q6xrym3x5r5mazqq8sy6mse0poyjjco 2024-09-14T11:37:33.611 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.613+0000 7f4c1a323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5q6xrym3x5r5mazqq8sy6mse0poyjjco 2024-09-14T11:37:33.612 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.614+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.613 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.615+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 olh_log_entry: epoch=2 op=3 key=z[vNT0FkBz4qBkJ6v4dMEmzXyd9yW2PDE] 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:_:vNT0FkBz4qBkJ6v4dMEmzXyd9yW2PDE_z state=0x562d8eb1ff18 s->prefetch_data=0 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 10 manifest: total_size = 11 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 get_obj_state: setting s->obj_tag to ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13279612973001129889 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:_:vNT0FkBz4qBkJ6v4dMEmzXyd9yW2PDE_z state=0x562d8eb1ff18 s->prefetch_data=0 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 prepare_atomic_modification: state is not atomic. state=0x562d8eb1ff18 2024-09-14T11:37:33.614 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.616+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.619+0000 7f4c1a323800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:37:33.616 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.619+0000 7f4c1a323800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:37:33.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.619+0000 7f4c1a323800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:37:33.617 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.619+0000 7f4c1a323800 5 delete_objs_inline: removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:vNT0FkBz4qBkJ6v4dMEmzXyd9yW2PDE_.w5_MzHQbIbHrpHBhRvnrYZ2GePkpOs-_0 2024-09-14T11:37:33.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.620+0000 7f4c1a323800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:37:33.618 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.620+0000 7f4af97fa640 20 handle_completion(): completion ok for obj=z[vNT0FkBz4qBkJ6v4dMEmzXyd9yW2PDE] 2024-09-14T11:37:33.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.621+0000 7f4c1a323800 20 get_obj_state: octx=0x562d8e836ba0 obj=myver:z state=0x562d8eae7888 s->prefetch_data=0 2024-09-14T11:37:33.619 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.621+0000 7f4c1a323800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5q6xrym3x5r5mazqq8sy6mse0poyjjco 2024-09-14T11:37:33.622 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.624+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.625+0000 7f4c1a323800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18.3.9 2024-09-14T11:37:33.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.625+0000 7f4c1a323800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:37:33.623 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.625+0000 7f4c1a323800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:37:33.624 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.626+0000 7f4accfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:33.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.628+0000 7f4c1a323800 20 remove_watcher() i=0 2024-09-14T11:37:33.626 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.628+0000 7f4c1a323800 2 removed watcher, disabling cache 2024-09-14T11:37:33.628 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.630+0000 7f4c1a323800 20 remove_watcher() i=1 2024-09-14T11:37:33.629 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.631+0000 7f4c1a323800 20 remove_watcher() i=2 2024-09-14T11:37:33.630 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.632+0000 7f4c1a323800 20 remove_watcher() i=3 2024-09-14T11:37:33.631 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.633+0000 7f4c1a323800 20 remove_watcher() i=4 2024-09-14T11:37:33.632 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.634+0000 7f4c1a323800 20 remove_watcher() i=5 2024-09-14T11:37:33.633 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.635+0000 7f4c1a323800 20 remove_watcher() i=6 2024-09-14T11:37:33.634 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.636+0000 7f4c1a323800 20 remove_watcher() i=7 2024-09-14T11:37:33.796 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:37:33.825 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:33.825 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:33.864 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.866+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.868+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.868+0000 7f7af5125800 20 realm 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.868+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.869+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.869+0000 7f7af5125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.869+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.869+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.867 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.869+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.870+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.870+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.870+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:33.868 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.870+0000 7f7af5125800 20 searching for the correct realm 2024-09-14T11:37:33.870 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:33.872+0000 7f7af0d33640 0 -- 172.21.15.28:0/2339597576 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f7ae802f040 msgr2=0x7f7ae8015430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.078+0000 7f7af1534640 0 -- 172.21.15.28:0/2339597576 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f7ae4051070 msgr2=0x7f7ae4018450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:37:34.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:34.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:34.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:37:34.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:34.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:34.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.084+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 zone default found 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 4 Realm: () 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:37:34.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 zonegroup default 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.085+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.086+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.086+0000 7f7af5125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.086+0000 7f7af5125800 20 started sync module instance, tier type = 2024-09-14T11:37:34.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.086+0000 7f7af5125800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:37:34.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=0 2024-09-14T11:37:34.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=1 2024-09-14T11:37:34.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=2 2024-09-14T11:37:34.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=3 2024-09-14T11:37:34.093 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=4 2024-09-14T11:37:34.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=5 2024-09-14T11:37:34.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.095+0000 7f7af5125800 20 add_watcher() i=6 2024-09-14T11:37:34.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.096+0000 7f7af5125800 20 add_watcher() i=7 2024-09-14T11:37:34.094 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.096+0000 7f7af5125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:34.095 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.097+0000 7f79a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f7af5125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:34.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f7af5125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:34.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f7af5125800 5 note: GC not initialized 2024-09-14T11:37:34.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f79a5fe3640 20 reqs_thread_entry: start 2024-09-14T11:37:34.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f7af5125800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:34.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f7af5125800 20 Filter name: none 2024-09-14T11:37:34.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f79177fe640 20 reqs_thread_entry: start 2024-09-14T11:37:34.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.098+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.099+0000 7f7af5125800 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.100+0000 7f7af5125800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:37:34.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.100+0000 7f7af5125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:34.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.102+0000 7f79a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.104+0000 7f7af5125800 20 remove_watcher() i=0 2024-09-14T11:37:34.102 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.104+0000 7f7af5125800 2 removed watcher, disabling cache 2024-09-14T11:37:34.103 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.105+0000 7f7af5125800 20 remove_watcher() i=1 2024-09-14T11:37:34.104 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.106+0000 7f7af5125800 20 remove_watcher() i=2 2024-09-14T11:37:34.105 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.107+0000 7f7af5125800 20 remove_watcher() i=3 2024-09-14T11:37:34.106 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.108+0000 7f7af5125800 20 remove_watcher() i=4 2024-09-14T11:37:34.107 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.109+0000 7f7af5125800 20 remove_watcher() i=5 2024-09-14T11:37:34.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.110+0000 7f7af5125800 20 remove_watcher() i=6 2024-09-14T11:37:34.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T11:37:34.111+0000 7f7af5125800 20 remove_watcher() i=7 2024-09-14T11:37:34.120 INFO:tasks.workunit.client.0.smithi028.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:37:34.120 INFO:tasks.workunit.client.0.smithi028.stderr:Deleting bucket a-bucket 2024-09-14T11:37:34.202 INFO:tasks.workunit.client.0.smithi028.stderr:Deleting bucket myver 2024-09-14T11:37:34.455 INFO:tasks.workunit.client.0.smithi028.stderr:Completed resharding tests 2024-09-14T11:37:34.455 INFO:tasks.workunit.client.0.smithi028.stdout:connected to http://localhost:80 2024-09-14T11:37:34.532 INFO:tasks.workunit.client.0.smithi028.stderr:+ deactivate 2024-09-14T11:37:34.532 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:37:34.532 INFO:tasks.workunit.client.0.smithi028.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:37:34.532 INFO:tasks.workunit.client.0.smithi028.stderr:+ export PATH 2024-09-14T11:37:34.532 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n '' ']' 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ hash -r 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n '' ']' 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset -f deactivate 2024-09-14T11:37:34.533 INFO:tasks.workunit.client.0.smithi028.stderr:+ echo OK. 2024-09-14T11:37:34.534 INFO:tasks.workunit.client.0.smithi028.stdout:OK. 2024-09-14T11:37:34.534 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:37:34.535 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:37:34.614 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:37:34.614 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:37:35.048 DEBUG:teuthology.parallel:result is None 2024-09-14T11:37:35.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:37:35.088 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:37:35.088 DEBUG:teuthology.orchestra.run.smithi028:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:37:35.158 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:37:35.158 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:37:35.172 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:37:35.172 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:37:35.172 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:37:35.172 DEBUG:teuthology.orchestra.run.smithi028:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:37:35.226 INFO:teuthology.orchestra.run.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:37:42.408 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:37:42.408 DEBUG:teuthology.orchestra.run.smithi028:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:37:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:37:45.132 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:30:23 ago on Sat 14 Sep 2024 11:07:22 AM UTC. 2024-09-14T11:37:45.279 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout:Installing weak dependencies: 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:37:45.280 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:37:45.281 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-09-14T11:37:45.281 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-09-14T11:37:45.281 INFO:teuthology.orchestra.run.smithi028.stdout:Install 5 Packages 2024-09-14T11:37:45.281 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:37:45.281 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 46 M 2024-09-14T11:37:45.281 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 166 M 2024-09-14T11:37:45.282 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi028.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 508 kB/s | 426 kB 00:00 2024-09-14T11:37:46.442 INFO:teuthology.orchestra.run.smithi028.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 3.2 MB/s | 3.5 MB 00:01 2024-09-14T11:37:46.559 INFO:teuthology.orchestra.run.smithi028.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 222 kB/s | 26 kB 00:00 2024-09-14T11:37:52.126 INFO:teuthology.orchestra.run.smithi028.stdout:(4/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 5.4 MB/s | 32 MB 00:05 2024-09-14T11:37:52.226 INFO:teuthology.orchestra.run.smithi028.stdout:(5/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 1.4 MB/s | 9.3 MB 00:06 2024-09-14T11:37:52.227 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:37:52.227 INFO:teuthology.orchestra.run.smithi028.stdout:Total 6.6 MB/s | 46 MB 00:06 2024-09-14T11:37:52.667 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-09-14T11:37:52.690 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-09-14T11:37:52.690 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-09-14T11:37:53.193 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-09-14T11:37:53.193 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-09-14T11:37:53.735 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:37:53.891 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-09-14T11:37:54.235 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:37:54.862 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:37:54.903 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:37:55.160 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:37:55.188 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:37:55.428 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:37:55.467 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:37:55.474 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:37:55.484 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:37:55.535 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:37:58.178 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:37:58.178 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:37:58.178 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:37:58.178 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:37:58.179 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:37:58.572 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-09-14T11:37:58.986 INFO:teuthology.orchestra.run.smithi028.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:37:59.070 INFO:teuthology.orchestra.run.smithi028.stderr:--2024-09-14 11:37:59-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:37:59.427 INFO:teuthology.orchestra.run.smithi028.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-14T11:37:59.440 INFO:teuthology.orchestra.run.smithi028.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:37:59.511 INFO:teuthology.orchestra.run.smithi028.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:37:59.511 INFO:teuthology.orchestra.run.smithi028.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:37:59.511 INFO:teuthology.orchestra.run.smithi028.stderr:--2024-09-14 11:37:59-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:37:59.512 INFO:teuthology.orchestra.run.smithi028.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-09-14T11:37:59.521 INFO:teuthology.orchestra.run.smithi028.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-09-14T11:37:59.665 INFO:teuthology.orchestra.run.smithi028.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:37:59.666 INFO:teuthology.orchestra.run.smithi028.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113759Z&X-Amz-Expires=300&X-Amz-Signature=46377d7c1e65e20791439353babaa4ead0826a41a7b55f25e47e932c073694b3&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:37:59.666 INFO:teuthology.orchestra.run.smithi028.stderr:--2024-09-14 11:37:59-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113759Z&X-Amz-Expires=300&X-Amz-Signature=46377d7c1e65e20791439353babaa4ead0826a41a7b55f25e47e932c073694b3&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:37:59.666 INFO:teuthology.orchestra.run.smithi028.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.108.133, ... 2024-09-14T11:37:59.678 INFO:teuthology.orchestra.run.smithi028.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-14T11:37:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:37:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:37:59.753 INFO:teuthology.orchestra.run.smithi028.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:37:59.753 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T11:37:59.775 INFO:teuthology.orchestra.run.smithi028.stderr: 0K .......... .......... .......... .......... .......... 0% 2.13M 43s 2024-09-14T11:37:59.778 INFO:teuthology.orchestra.run.smithi028.stderr: 50K .......... .......... .......... .......... .......... 0% 13.3M 25s 2024-09-14T11:37:59.788 INFO:teuthology.orchestra.run.smithi028.stderr: 100K .......... .......... .......... .......... .......... 0% 5.33M 22s 2024-09-14T11:37:59.791 INFO:teuthology.orchestra.run.smithi028.stderr: 150K .......... .......... .......... .......... .......... 0% 18.2M 18s 2024-09-14T11:37:59.792 INFO:teuthology.orchestra.run.smithi028.stderr: 200K .......... .......... .......... .......... .......... 0% 23.8M 15s 2024-09-14T11:37:59.800 INFO:teuthology.orchestra.run.smithi028.stderr: 250K .......... .......... .......... .......... .......... 0% 7.48M 15s 2024-09-14T11:37:59.801 INFO:teuthology.orchestra.run.smithi028.stderr: 300K .......... .......... .......... .......... .......... 0% 32.3M 13s 2024-09-14T11:37:59.803 INFO:teuthology.orchestra.run.smithi028.stderr: 350K .......... .......... .......... .......... .......... 0% 23.0M 12s 2024-09-14T11:37:59.804 INFO:teuthology.orchestra.run.smithi028.stderr: 400K .......... .......... .......... .......... .......... 0% 36.3M 11s 2024-09-14T11:37:59.806 INFO:teuthology.orchestra.run.smithi028.stderr: 450K .......... .......... .......... .......... .......... 0% 31.7M 10s 2024-09-14T11:37:59.807 INFO:teuthology.orchestra.run.smithi028.stderr: 500K .......... .......... .......... .......... .......... 0% 96.5M 9s 2024-09-14T11:37:59.811 INFO:teuthology.orchestra.run.smithi028.stderr: 550K .......... .......... .......... .......... .......... 0% 9.90M 9s 2024-09-14T11:37:59.813 INFO:teuthology.orchestra.run.smithi028.stderr: 600K .......... .......... .......... .......... .......... 0% 42.2M 9s 2024-09-14T11:37:59.813 INFO:teuthology.orchestra.run.smithi028.stderr: 650K .......... .......... .......... .......... .......... 0% 308M 8s 2024-09-14T11:37:59.821 INFO:teuthology.orchestra.run.smithi028.stderr: 700K .......... .......... .......... .......... .......... 0% 23.6M 8s 2024-09-14T11:37:59.821 INFO:teuthology.orchestra.run.smithi028.stderr: 750K .......... .......... .......... .......... .......... 0% 179M 7s 2024-09-14T11:37:59.821 INFO:teuthology.orchestra.run.smithi028.stderr: 800K .......... .......... .......... .......... .......... 0% 53.8M 7s 2024-09-14T11:37:59.821 INFO:teuthology.orchestra.run.smithi028.stderr: 850K .......... .......... .......... .......... .......... 0% 75.6M 7s 2024-09-14T11:37:59.821 INFO:teuthology.orchestra.run.smithi028.stderr: 900K .......... .......... .......... .......... .......... 1% 193M 6s 2024-09-14T11:37:59.821 INFO:teuthology.orchestra.run.smithi028.stderr: 950K .......... .......... .......... .......... .......... 1% 80.4M 6s 2024-09-14T11:37:59.822 INFO:teuthology.orchestra.run.smithi028.stderr: 1000K .......... .......... .......... .......... .......... 1% 78.7M 6s 2024-09-14T11:37:59.822 INFO:teuthology.orchestra.run.smithi028.stderr: 1050K .......... .......... .......... .......... .......... 1% 76.5M 6s 2024-09-14T11:37:59.825 INFO:teuthology.orchestra.run.smithi028.stderr: 1100K .......... .......... .......... .......... .......... 1% 265M 5s 2024-09-14T11:37:59.826 INFO:teuthology.orchestra.run.smithi028.stderr: 1150K .......... .......... .......... .......... .......... 1% 12.1M 5s 2024-09-14T11:37:59.826 INFO:teuthology.orchestra.run.smithi028.stderr: 1200K .......... .......... .......... .......... .......... 1% 233M 5s 2024-09-14T11:37:59.826 INFO:teuthology.orchestra.run.smithi028.stderr: 1250K .......... .......... .......... .......... .......... 1% 43.8M 5s 2024-09-14T11:37:59.826 INFO:teuthology.orchestra.run.smithi028.stderr: 1300K .......... .......... .......... .......... .......... 1% 330M 5s 2024-09-14T11:37:59.826 INFO:teuthology.orchestra.run.smithi028.stderr: 1350K .......... .......... .......... .......... .......... 1% 330M 5s 2024-09-14T11:38:01.263 INFO:teuthology.orchestra.run.smithi028.stderr: 1400K .......... .......... .......... .......... .......... 1% 25.5M 5s 2024-09-14T11:38:01.263 INFO:teuthology.orchestra.run.smithi028.stderr: 1450K .......... .......... .......... .......... .......... 1% 295M 5s 2024-09-14T11:38:01.263 INFO:teuthology.orchestra.run.smithi028.stderr: 1500K .......... .......... .......... .......... .......... 1% 135M 4s 2024-09-14T11:38:01.263 INFO:teuthology.orchestra.run.smithi028.stderr: 1550K .......... .......... .......... .......... .......... 1% 314M 4s 2024-09-14T11:38:01.263 INFO:teuthology.orchestra.run.smithi028.stderr: 1600K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1650K .......... .......... .......... .......... .......... 1% 127M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1700K .......... .......... .......... .......... .......... 1% 141M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1750K .......... .......... .......... .......... .......... 1% 147M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1800K .......... .......... .......... .......... .......... 1% 128M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1850K .......... .......... .......... .......... .......... 2% 274M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1900K .......... .......... .......... .......... .......... 2% 150M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 1950K .......... .......... .......... .......... .......... 2% 168M 4s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2000K .......... .......... .......... .......... .......... 2% 266M 3s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2050K .......... .......... .......... .......... .......... 2% 220M 3s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2100K .......... .......... .......... .......... .......... 2% 145M 3s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2150K .......... .......... .......... .......... .......... 2% 166M 3s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2200K .......... .......... .......... .......... .......... 2% 169M 3s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2250K .......... .......... .......... .......... .......... 2% 311M 3s 2024-09-14T11:38:01.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2300K .......... .......... .......... .......... .......... 2% 17.4M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2350K .......... .......... .......... .......... .......... 2% 93.5M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2400K .......... .......... .......... .......... .......... 2% 303M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2450K .......... .......... .......... .......... .......... 2% 325M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2500K .......... .......... .......... .......... .......... 2% 316M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2550K .......... .......... .......... .......... .......... 2% 71.5M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2600K .......... .......... .......... .......... .......... 2% 345M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2650K .......... .......... .......... .......... .......... 2% 354M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2700K .......... .......... .......... .......... .......... 2% 227M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2750K .......... .......... .......... .......... .......... 3% 310M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2800K .......... .......... .......... .......... .......... 3% 32.5M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2850K .......... .......... .......... .......... .......... 3% 150M 3s 2024-09-14T11:38:01.265 INFO:teuthology.orchestra.run.smithi028.stderr: 2900K .......... .......... .......... .......... .......... 3% 274M 3s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 2950K .......... .......... .......... .......... .......... 3% 244M 3s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3000K .......... .......... .......... .......... .......... 3% 239M 3s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3050K .......... .......... .......... .......... .......... 3% 225M 3s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3100K .......... .......... .......... .......... .......... 3% 289M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3150K .......... .......... .......... .......... .......... 3% 238M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3200K .......... .......... .......... .......... .......... 3% 343M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3250K .......... .......... .......... .......... .......... 3% 235M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3300K .......... .......... .......... .......... .......... 3% 336M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3350K .......... .......... .......... .......... .......... 3% 358M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3400K .......... .......... .......... .......... .......... 3% 228M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3450K .......... .......... .......... .......... .......... 3% 354M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3500K .......... .......... .......... .......... .......... 3% 318M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3550K .......... .......... .......... .......... .......... 3% 259M 2s 2024-09-14T11:38:01.266 INFO:teuthology.orchestra.run.smithi028.stderr: 3600K .......... .......... .......... .......... .......... 3% 363M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3650K .......... .......... .......... .......... .......... 3% 331M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3700K .......... .......... .......... .......... .......... 4% 344M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3750K .......... .......... .......... .......... .......... 4% 252M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3800K .......... .......... .......... .......... .......... 4% 349M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3850K .......... .......... .......... .......... .......... 4% 311M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3900K .......... .......... .......... .......... .......... 4% 241M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 3950K .......... .......... .......... .......... .......... 4% 312M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4000K .......... .......... .......... .......... .......... 4% 278M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4050K .......... .......... .......... .......... .......... 4% 292M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4100K .......... .......... .......... .......... .......... 4% 234M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4150K .......... .......... .......... .......... .......... 4% 258M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4200K .......... .......... .......... .......... .......... 4% 280M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4250K .......... .......... .......... .......... .......... 4% 368M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4300K .......... .......... .......... .......... .......... 4% 327M 2s 2024-09-14T11:38:01.267 INFO:teuthology.orchestra.run.smithi028.stderr: 4350K .......... .......... .......... .......... .......... 4% 355M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4400K .......... .......... .......... .......... .......... 4% 369M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4450K .......... .......... .......... .......... .......... 4% 369M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4500K .......... .......... .......... .......... .......... 4% 291M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4550K .......... .......... .......... .......... .......... 4% 27.9M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4600K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4650K .......... .......... .......... .......... .......... 5% 356M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4700K .......... .......... .......... .......... .......... 5% 193M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4750K .......... .......... .......... .......... .......... 5% 140M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4800K .......... .......... .......... .......... .......... 5% 359M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4850K .......... .......... .......... .......... .......... 5% 352M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4900K .......... .......... .......... .......... .......... 5% 350M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 4950K .......... .......... .......... .......... .......... 5% 340M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 5000K .......... .......... .......... .......... .......... 5% 379M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 5050K .......... .......... .......... .......... .......... 5% 370M 2s 2024-09-14T11:38:01.268 INFO:teuthology.orchestra.run.smithi028.stderr: 5100K .......... .......... .......... .......... .......... 5% 328M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5150K .......... .......... .......... .......... .......... 5% 321M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5200K .......... .......... .......... .......... .......... 5% 268M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5250K .......... .......... .......... .......... .......... 5% 310M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5300K .......... .......... .......... .......... .......... 5% 364M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5350K .......... .......... .......... .......... .......... 5% 365M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5400K .......... .......... .......... .......... .......... 5% 353M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5450K .......... .......... .......... .......... .......... 5% 317M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5500K .......... .......... .......... .......... .......... 5% 389M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5550K .......... .......... .......... .......... .......... 6% 325M 2s 2024-09-14T11:38:01.269 INFO:teuthology.orchestra.run.smithi028.stderr: 5600K .......... .......... .......... .......... .......... 6% 66.9M 2s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5650K .......... .......... .......... .......... .......... 6% 302M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5700K .......... .......... .......... .......... .......... 6% 187M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5750K .......... .......... .......... .......... .......... 6% 329M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5800K .......... .......... .......... .......... .......... 6% 371M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5850K .......... .......... .......... .......... .......... 6% 362M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5900K .......... .......... .......... .......... .......... 6% 331M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 5950K .......... .......... .......... .......... .......... 6% 356M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6000K .......... .......... .......... .......... .......... 6% 341M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6050K .......... .......... .......... .......... .......... 6% 363M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6100K .......... .......... .......... .......... .......... 6% 304M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6150K .......... .......... .......... .......... .......... 6% 328M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6200K .......... .......... .......... .......... .......... 6% 353M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6250K .......... .......... .......... .......... .......... 6% 367M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6300K .......... .......... .......... .......... .......... 6% 317M 1s 2024-09-14T11:38:01.270 INFO:teuthology.orchestra.run.smithi028.stderr: 6350K .......... .......... .......... .......... .......... 6% 330M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6400K .......... .......... .......... .......... .......... 6% 344M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6450K .......... .......... .......... .......... .......... 6% 329M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6500K .......... .......... .......... .......... .......... 7% 378M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6550K .......... .......... .......... .......... .......... 7% 367M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6600K .......... .......... .......... .......... .......... 7% 323M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6650K .......... .......... .......... .......... .......... 7% 309M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6700K .......... .......... .......... .......... .......... 7% 248M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6750K .......... .......... .......... .......... .......... 7% 312M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6800K .......... .......... .......... .......... .......... 7% 253M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6850K .......... .......... .......... .......... .......... 7% 332M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6900K .......... .......... .......... .......... .......... 7% 326M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 6950K .......... .......... .......... .......... .......... 7% 378M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 7000K .......... .......... .......... .......... .......... 7% 158M 1s 2024-09-14T11:38:01.271 INFO:teuthology.orchestra.run.smithi028.stderr: 7050K .......... .......... .......... .......... .......... 7% 351M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7100K .......... .......... .......... .......... .......... 7% 302M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7150K .......... .......... .......... .......... .......... 7% 360M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7200K .......... .......... .......... .......... .......... 7% 261M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7250K .......... .......... .......... .......... .......... 7% 363M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7300K .......... .......... .......... .......... .......... 7% 311M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7350K .......... .......... .......... .......... .......... 7% 361M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7400K .......... .......... .......... .......... .......... 8% 360M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7450K .......... .......... .......... .......... .......... 8% 378M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7500K .......... .......... .......... .......... .......... 8% 302M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7550K .......... .......... .......... .......... .......... 8% 60.7M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7600K .......... .......... .......... .......... .......... 8% 45.6M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7650K .......... .......... .......... .......... .......... 8% 370M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7700K .......... .......... .......... .......... .......... 8% 355M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7750K .......... .......... .......... .......... .......... 8% 310M 1s 2024-09-14T11:38:01.272 INFO:teuthology.orchestra.run.smithi028.stderr: 7800K .......... .......... .......... .......... .......... 8% 89.1M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 7850K .......... .......... .......... .......... .......... 8% 340M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 7900K .......... .......... .......... .......... .......... 8% 379M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 7950K .......... .......... .......... .......... .......... 8% 331M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8000K .......... .......... .......... .......... .......... 8% 314M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8050K .......... .......... .......... .......... .......... 8% 358M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8100K .......... .......... .......... .......... .......... 8% 365M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8150K .......... .......... .......... .......... .......... 8% 324M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8200K .......... .......... .......... .......... .......... 8% 382M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8250K .......... .......... .......... .......... .......... 8% 72.5M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8300K .......... .......... .......... .......... .......... 8% 298M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8350K .......... .......... .......... .......... .......... 9% 365M 1s 2024-09-14T11:38:01.273 INFO:teuthology.orchestra.run.smithi028.stderr: 8400K .......... .......... .......... .......... .......... 9% 336M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8450K .......... .......... .......... .......... .......... 9% 380M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8500K .......... .......... .......... .......... .......... 9% 143M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8550K .......... .......... .......... .......... .......... 9% 299M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8600K .......... .......... .......... .......... .......... 9% 372M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8650K .......... .......... .......... .......... .......... 9% 363M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8700K .......... .......... .......... .......... .......... 9% 363M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8750K .......... .......... .......... .......... .......... 9% 342M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8800K .......... .......... .......... .......... .......... 9% 332M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8850K .......... .......... .......... .......... .......... 9% 377M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8900K .......... .......... .......... .......... .......... 9% 101M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 8950K .......... .......... .......... .......... .......... 9% 259M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 9000K .......... .......... .......... .......... .......... 9% 295M 1s 2024-09-14T11:38:01.274 INFO:teuthology.orchestra.run.smithi028.stderr: 9050K .......... .......... .......... .......... .......... 9% 361M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9100K .......... .......... .......... .......... .......... 9% 363M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9150K .......... .......... .......... .......... .......... 9% 364M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9200K .......... .......... .......... .......... .......... 9% 304M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9250K .......... .......... .......... .......... .......... 10% 364M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9300K .......... .......... .......... .......... .......... 10% 384M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9350K .......... .......... .......... .......... .......... 10% 342M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9400K .......... .......... .......... .......... .......... 10% 327M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9450K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9500K .......... .......... .......... .......... .......... 10% 313M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9550K .......... .......... .......... .......... .......... 10% 350M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9600K .......... .......... .......... .......... .......... 10% 378M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9650K .......... .......... .......... .......... .......... 10% 334M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9700K .......... .......... .......... .......... .......... 10% 316M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9750K .......... .......... .......... .......... .......... 10% 376M 1s 2024-09-14T11:38:01.275 INFO:teuthology.orchestra.run.smithi028.stderr: 9800K .......... .......... .......... .......... .......... 10% 381M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 9850K .......... .......... .......... .......... .......... 10% 376M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 9900K .......... .......... .......... .......... .......... 10% 318M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 9950K .......... .......... .......... .......... .......... 10% 377M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10000K .......... .......... .......... .......... .......... 10% 375M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10050K .......... .......... .......... .......... .......... 10% 361M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10100K .......... .......... .......... .......... .......... 10% 355M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10150K .......... .......... .......... .......... .......... 10% 323M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10200K .......... .......... .......... .......... .......... 11% 262M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10250K .......... .......... .......... .......... .......... 11% 377M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10300K .......... .......... .......... .......... .......... 11% 299M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10350K .......... .......... .......... .......... .......... 11% 360M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10400K .......... .......... .......... .......... .......... 11% 354M 1s 2024-09-14T11:38:01.276 INFO:teuthology.orchestra.run.smithi028.stderr: 10450K .......... .......... .......... .......... .......... 11% 366M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10500K .......... .......... .......... .......... .......... 11% 334M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10550K .......... .......... .......... .......... .......... 11% 55.9M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10600K .......... .......... .......... .......... .......... 11% 369M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10650K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10700K .......... .......... .......... .......... .......... 11% 49.2M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10750K .......... .......... .......... .......... .......... 11% 340M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10800K .......... .......... .......... .......... .......... 11% 366M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10850K .......... .......... .......... .......... .......... 11% 131M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10900K .......... .......... .......... .......... .......... 11% 307M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 10950K .......... .......... .......... .......... .......... 11% 151M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 11000K .......... .......... .......... .......... .......... 11% 331M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 11050K .......... .......... .......... .......... .......... 11% 354M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 11100K .......... .......... .......... .......... .......... 12% 274M 1s 2024-09-14T11:38:01.277 INFO:teuthology.orchestra.run.smithi028.stderr: 11150K .......... .......... .......... .......... .......... 12% 356M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11200K .......... .......... .......... .......... .......... 12% 376M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11250K .......... .......... .......... .......... .......... 12% 210M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11300K .......... .......... .......... .......... .......... 12% 93.1M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11350K .......... .......... .......... .......... .......... 12% 345M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11400K .......... .......... .......... .......... .......... 12% 272M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11450K .......... .......... .......... .......... .......... 12% 117M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11500K .......... .......... .......... .......... .......... 12% 201M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11550K .......... .......... .......... .......... .......... 12% 344M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11600K .......... .......... .......... .......... .......... 12% 369M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11650K .......... .......... .......... .......... .......... 12% 377M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11700K .......... .......... .......... .......... .......... 12% 334M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11750K .......... .......... .......... .......... .......... 12% 361M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11800K .......... .......... .......... .......... .......... 12% 382M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11850K .......... .......... .......... .......... .......... 12% 378M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11900K .......... .......... .......... .......... .......... 12% 116M 1s 2024-09-14T11:38:01.278 INFO:teuthology.orchestra.run.smithi028.stderr: 11950K .......... .......... .......... .......... .......... 12% 364M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12000K .......... .......... .......... .......... .......... 12% 148M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12050K .......... .......... .......... .......... .......... 13% 298M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12100K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12150K .......... .......... .......... .......... .......... 13% 356M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12200K .......... .......... .......... .......... .......... 13% 363M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12250K .......... .......... .......... .......... .......... 13% 383M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12300K .......... .......... .......... .......... .......... 13% 317M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12350K .......... .......... .......... .......... .......... 13% 362M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12400K .......... .......... .......... .......... .......... 13% 325M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12450K .......... .......... .......... .......... .......... 13% 370M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12500K .......... .......... .......... .......... .......... 13% 326M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12550K .......... .......... .......... .......... .......... 13% 361M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12600K .......... .......... .......... .......... .......... 13% 365M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12650K .......... .......... .......... .......... .......... 13% 366M 1s 2024-09-14T11:38:01.279 INFO:teuthology.orchestra.run.smithi028.stderr: 12700K .......... .......... .......... .......... .......... 13% 297M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 12750K .......... .......... .......... .......... .......... 13% 378M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 12800K .......... .......... .......... .......... .......... 13% 343M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 12850K .......... .......... .......... .......... .......... 13% 370M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 12900K .......... .......... .......... .......... .......... 13% 312M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 12950K .......... .......... .......... .......... .......... 13% 378M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13000K .......... .......... .......... .......... .......... 14% 328M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13050K .......... .......... .......... .......... .......... 14% 371M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13100K .......... .......... .......... .......... .......... 14% 332M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13150K .......... .......... .......... .......... .......... 14% 342M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13200K .......... .......... .......... .......... .......... 14% 378M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13250K .......... .......... .......... .......... .......... 14% 381M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13300K .......... .......... .......... .......... .......... 14% 308M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13350K .......... .......... .......... .......... .......... 14% 378M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13400K .......... .......... .......... .......... .......... 14% 375M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13450K .......... .......... .......... .......... .......... 14% 378M 1s 2024-09-14T11:38:01.280 INFO:teuthology.orchestra.run.smithi028.stderr: 13500K .......... .......... .......... .......... .......... 14% 325M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13550K .......... .......... .......... .......... .......... 14% 66.2M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13600K .......... .......... .......... .......... .......... 14% 334M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13650K .......... .......... .......... .......... .......... 14% 54.9M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13700K .......... .......... .......... .......... .......... 14% 274M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13750K .......... .......... .......... .......... .......... 14% 329M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13800K .......... .......... .......... .......... .......... 14% 343M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13850K .......... .......... .......... .......... .......... 14% 142M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13900K .......... .......... .......... .......... .......... 15% 259M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 13950K .......... .......... .......... .......... .......... 15% 380M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 14000K .......... .......... .......... .......... .......... 15% 189M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 14050K .......... .......... .......... .......... .......... 15% 260M 1s 2024-09-14T11:38:01.281 INFO:teuthology.orchestra.run.smithi028.stderr: 14100K .......... .......... .......... .......... .......... 15% 105M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14150K .......... .......... .......... .......... .......... 15% 340M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14200K .......... .......... .......... .......... .......... 15% 376M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14250K .......... .......... .......... .......... .......... 15% 383M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14300K .......... .......... .......... .......... .......... 15% 156M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14350K .......... .......... .......... .......... .......... 15% 367M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14400K .......... .......... .......... .......... .......... 15% 374M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14450K .......... .......... .......... .......... .......... 15% 362M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14500K .......... .......... .......... .......... .......... 15% 109M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14550K .......... .......... .......... .......... .......... 15% 185M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14600K .......... .......... .......... .......... .......... 15% 367M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14650K .......... .......... .......... .......... .......... 15% 386M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14700K .......... .......... .......... .......... .......... 15% 122M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14750K .......... .......... .......... .......... .......... 15% 370M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14800K .......... .......... .......... .......... .......... 15% 316M 1s 2024-09-14T11:38:01.282 INFO:teuthology.orchestra.run.smithi028.stderr: 14850K .......... .......... .......... .......... .......... 16% 337M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 14900K .......... .......... .......... .......... .......... 16% 330M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 14950K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15000K .......... .......... .......... .......... .......... 16% 115M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15050K .......... .......... .......... .......... .......... 16% 322M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15100K .......... .......... .......... .......... .......... 16% 277M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15150K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15200K .......... .......... .......... .......... .......... 16% 225M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15250K .......... .......... .......... .......... .......... 16% 353M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15300K .......... .......... .......... .......... .......... 16% 330M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15350K .......... .......... .......... .......... .......... 16% 370M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15400K .......... .......... .......... .......... .......... 16% 245M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15450K .......... .......... .......... .......... .......... 16% 375M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15500K .......... .......... .......... .......... .......... 16% 294M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15550K .......... .......... .......... .......... .......... 16% 381M 1s 2024-09-14T11:38:01.283 INFO:teuthology.orchestra.run.smithi028.stderr: 15600K .......... .......... .......... .......... .......... 16% 369M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15650K .......... .......... .......... .......... .......... 16% 369M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15700K .......... .......... .......... .......... .......... 16% 335M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15750K .......... .......... .......... .......... .......... 17% 375M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15800K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15850K .......... .......... .......... .......... .......... 17% 347M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15900K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 15950K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16000K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16050K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16100K .......... .......... .......... .......... .......... 17% 378M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16150K .......... .......... .......... .......... .......... 17% 387M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16200K .......... .......... .......... .......... .......... 17% 323M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16250K .......... .......... .......... .......... .......... 17% 365M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16300K .......... .......... .......... .......... .......... 17% 356M 1s 2024-09-14T11:38:01.284 INFO:teuthology.orchestra.run.smithi028.stderr: 16350K .......... .......... .......... .......... .......... 17% 385M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16400K .......... .......... .......... .......... .......... 17% 344M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16450K .......... .......... .......... .......... .......... 17% 358M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16500K .......... .......... .......... .......... .......... 17% 397M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16550K .......... .......... .......... .......... .......... 17% 103M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16600K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16650K .......... .......... .......... .......... .......... 17% 47.0M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16700K .......... .......... .......... .......... .......... 18% 308M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16750K .......... .......... .......... .......... .......... 18% 365M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16800K .......... .......... .......... .......... .......... 18% 372M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16850K .......... .......... .......... .......... .......... 18% 347M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16900K .......... .......... .......... .......... .......... 18% 142M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 16950K .......... .......... .......... .......... .......... 18% 354M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 17000K .......... .......... .......... .......... .......... 18% 264M 1s 2024-09-14T11:38:01.285 INFO:teuthology.orchestra.run.smithi028.stderr: 17050K .......... .......... .......... .......... .......... 18% 278M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17100K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17150K .......... .......... .......... .......... .......... 18% 103M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17200K .......... .......... .......... .......... .......... 18% 295M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17250K .......... .......... .......... .......... .......... 18% 355M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17300K .......... .......... .......... .......... .......... 18% 187M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17350K .......... .......... .......... .......... .......... 18% 315M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17400K .......... .......... .......... .......... .......... 18% 180M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17450K .......... .......... .......... .......... .......... 18% 364M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17500K .......... .......... .......... .......... .......... 18% 389M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17550K .......... .......... .......... .......... .......... 18% 153M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17600K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17650K .......... .......... .......... .......... .......... 19% 292M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17700K .......... .......... .......... .......... .......... 19% 381M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17750K .......... .......... .......... .......... .......... 19% 110M 1s 2024-09-14T11:38:01.286 INFO:teuthology.orchestra.run.smithi028.stderr: 17800K .......... .......... .......... .......... .......... 19% 234M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 17850K .......... .......... .......... .......... .......... 19% 326M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 17900K .......... .......... .......... .......... .......... 19% 297M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 17950K .......... .......... .......... .......... .......... 19% 392M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18000K .......... .......... .......... .......... .......... 19% 98.7M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18050K .......... .......... .......... .......... .......... 19% 362M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18100K .......... .......... .......... .......... .......... 19% 371M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18150K .......... .......... .......... .......... .......... 19% 381M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18200K .......... .......... .......... .......... .......... 19% 234M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18250K .......... .......... .......... .......... .......... 19% 379M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18300K .......... .......... .......... .......... .......... 19% 330M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18350K .......... .......... .......... .......... .......... 19% 226M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18400K .......... .......... .......... .......... .......... 19% 319M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18450K .......... .......... .......... .......... .......... 19% 360M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18500K .......... .......... .......... .......... .......... 19% 383M 1s 2024-09-14T11:38:01.287 INFO:teuthology.orchestra.run.smithi028.stderr: 18550K .......... .......... .......... .......... .......... 20% 205M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18600K .......... .......... .......... .......... .......... 20% 287M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18650K .......... .......... .......... .......... .......... 20% 373M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18700K .......... .......... .......... .......... .......... 20% 391M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18750K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18800K .......... .......... .......... .......... .......... 20% 344M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18850K .......... .......... .......... .......... .......... 20% 388M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18900K .......... .......... .......... .......... .......... 20% 369M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 18950K .......... .......... .......... .......... .......... 20% 364M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19000K .......... .......... .......... .......... .......... 20% 323M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19050K .......... .......... .......... .......... .......... 20% 377M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19100K .......... .......... .......... .......... .......... 20% 376M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19150K .......... .......... .......... .......... .......... 20% 389M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19200K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19250K .......... .......... .......... .......... .......... 20% 394M 1s 2024-09-14T11:38:01.288 INFO:teuthology.orchestra.run.smithi028.stderr: 19300K .......... .......... .......... .......... .......... 20% 183M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19350K .......... .......... .......... .......... .......... 20% 376M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19400K .......... .......... .......... .......... .......... 20% 379M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19450K .......... .......... .......... .......... .......... 20% 390M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19500K .......... .......... .......... .......... .......... 21% 158M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19550K .......... .......... .......... .......... .......... 21% 354M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19600K .......... .......... .......... .......... .......... 21% 341M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19650K .......... .......... .......... .......... .......... 21% 388M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19700K .......... .......... .......... .......... .......... 21% 57.2M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19750K .......... .......... .......... .......... .......... 21% 169M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19800K .......... .......... .......... .......... .......... 21% 220M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19850K .......... .......... .......... .......... .......... 21% 379M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19900K .......... .......... .......... .......... .......... 21% 219M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 19950K .......... .......... .......... .......... .......... 21% 233M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 20000K .......... .......... .......... .......... .......... 21% 235M 1s 2024-09-14T11:38:01.289 INFO:teuthology.orchestra.run.smithi028.stderr: 20050K .......... .......... .......... .......... .......... 21% 235M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20100K .......... .......... .......... .......... .......... 21% 386M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20150K .......... .......... .......... .......... .......... 21% 117M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20200K .......... .......... .......... .......... .......... 21% 380M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20250K .......... .......... .......... .......... .......... 21% 395M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20300K .......... .......... .......... .......... .......... 21% 291M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20350K .......... .......... .......... .......... .......... 21% 208M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20400K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20450K .......... .......... .......... .......... .......... 22% 126M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20500K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20550K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20600K .......... .......... .......... .......... .......... 22% 384M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20650K .......... .......... .......... .......... .......... 22% 392M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20700K .......... .......... .......... .......... .......... 22% 190M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20750K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20800K .......... .......... .......... .......... .......... 22% 140M 1s 2024-09-14T11:38:01.290 INFO:teuthology.orchestra.run.smithi028.stderr: 20850K .......... .......... .......... .......... .......... 22% 72.6M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 20900K .......... .......... .......... .......... .......... 22% 332M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 20950K .......... .......... .......... .......... .......... 22% 378M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21000K .......... .......... .......... .......... .......... 22% 146M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21050K .......... .......... .......... .......... .......... 22% 342M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21100K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21150K .......... .......... .......... .......... .......... 22% 385M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21200K .......... .......... .......... .......... .......... 22% 380M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21250K .......... .......... .......... .......... .......... 22% 370M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21300K .......... .......... .......... .......... .......... 22% 342M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21350K .......... .......... .......... .......... .......... 23% 167M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21400K .......... .......... .......... .......... .......... 23% 376M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21450K .......... .......... .......... .......... .......... 23% 383M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21500K .......... .......... .......... .......... .......... 23% 306M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21550K .......... .......... .......... .......... .......... 23% 338M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21600K .......... .......... .......... .......... .......... 23% 377M 1s 2024-09-14T11:38:01.291 INFO:teuthology.orchestra.run.smithi028.stderr: 21650K .......... .......... .......... .......... .......... 23% 302M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 21700K .......... .......... .......... .......... .......... 23% 244M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 21750K .......... .......... .......... .......... .......... 23% 293M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 21800K .......... .......... .......... .......... .......... 23% 328M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 21850K .......... .......... .......... .......... .......... 23% 395M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 21900K .......... .......... .......... .......... .......... 23% 264M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 21950K .......... .......... .......... .......... .......... 23% 285M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22000K .......... .......... .......... .......... .......... 23% 343M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22050K .......... .......... .......... .......... .......... 23% 367M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22100K .......... .......... .......... .......... .......... 23% 358M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22150K .......... .......... .......... .......... .......... 23% 395M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22200K .......... .......... .......... .......... .......... 23% 398M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22250K .......... .......... .......... .......... .......... 24% 383M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22300K .......... .......... .......... .......... .......... 24% 323M 1s 2024-09-14T11:38:01.292 INFO:teuthology.orchestra.run.smithi028.stderr: 22350K .......... .......... .......... .......... .......... 24% 391M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22400K .......... .......... .......... .......... .......... 24% 368M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22450K .......... .......... .......... .......... .......... 24% 137M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22500K .......... .......... .......... .......... .......... 24% 336M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22550K .......... .......... .......... .......... .......... 24% 388M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22600K .......... .......... .......... .......... .......... 24% 385M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22650K .......... .......... .......... .......... .......... 24% 387M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22700K .......... .......... .......... .......... .......... 24% 73.4M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22750K .......... .......... .......... .......... .......... 24% 230M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22800K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22850K .......... .......... .......... .......... .......... 24% 368M 0s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22900K .......... .......... .......... .......... .......... 24% 162M 0s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 22950K .......... .......... .......... .......... .......... 24% 368M 0s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 23000K .......... .......... .......... .......... .......... 24% 113M 0s 2024-09-14T11:38:01.293 INFO:teuthology.orchestra.run.smithi028.stderr: 23050K .......... .......... .......... .......... .......... 24% 323M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23100K .......... .......... .......... .......... .......... 24% 162M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23150K .......... .......... .......... .......... .......... 24% 150M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23200K .......... .......... .......... .......... .......... 25% 264M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23250K .......... .......... .......... .......... .......... 25% 353M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23300K .......... .......... .......... .......... .......... 25% 291M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23350K .......... .......... .......... .......... .......... 25% 377M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23400K .......... .......... .......... .......... .......... 25% 390M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23450K .......... .......... .......... .......... .......... 25% 378M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23500K .......... .......... .......... .......... .......... 25% 246M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23550K .......... .......... .......... .......... .......... 25% 254M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23600K .......... .......... .......... .......... .......... 25% 117M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23650K .......... .......... .......... .......... .......... 25% 364M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23700K .......... .......... .......... .......... .......... 25% 377M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23750K .......... .......... .......... .......... .......... 25% 339M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23800K .......... .......... .......... .......... .......... 25% 399M 0s 2024-09-14T11:38:01.294 INFO:teuthology.orchestra.run.smithi028.stderr: 23850K .......... .......... .......... .......... .......... 25% 191M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 23900K .......... .......... .......... .......... .......... 25% 74.4M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 23950K .......... .......... .......... .......... .......... 25% 226M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24000K .......... .......... .......... .......... .......... 25% 399M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24050K .......... .......... .......... .......... .......... 25% 125M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24100K .......... .......... .......... .......... .......... 25% 375M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24150K .......... .......... .......... .......... .......... 26% 385M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24200K .......... .......... .......... .......... .......... 26% 267M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24250K .......... .......... .......... .......... .......... 26% 320M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24300K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24350K .......... .......... .......... .......... .......... 26% 160M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24400K .......... .......... .......... .......... .......... 26% 362M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24450K .......... .......... .......... .......... .......... 26% 354M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24500K .......... .......... .......... .......... .......... 26% 99.3M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24550K .......... .......... .......... .......... .......... 26% 372M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24600K .......... .......... .......... .......... .......... 26% 326M 0s 2024-09-14T11:38:01.295 INFO:teuthology.orchestra.run.smithi028.stderr: 24650K .......... .......... .......... .......... .......... 26% 347M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 24700K .......... .......... .......... .......... .......... 26% 393M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 24750K .......... .......... .......... .......... .......... 26% 336M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 24800K .......... .......... .......... .......... .......... 26% 394M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 24850K .......... .......... .......... .......... .......... 26% 391M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 24900K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 24950K .......... .......... .......... .......... .......... 26% 329M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25000K .......... .......... .......... .......... .......... 26% 388M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25050K .......... .......... .......... .......... .......... 27% 399M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25100K .......... .......... .......... .......... .......... 27% 392M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25150K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25200K .......... .......... .......... .......... .......... 27% 415M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25250K .......... .......... .......... .......... .......... 27% 317M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25300K .......... .......... .......... .......... .......... 27% 386M 0s 2024-09-14T11:38:01.296 INFO:teuthology.orchestra.run.smithi028.stderr: 25350K .......... .......... .......... .......... .......... 27% 132M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25400K .......... .......... .......... .......... .......... 27% 338M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25450K .......... .......... .......... .......... .......... 27% 315M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25500K .......... .......... .......... .......... .......... 27% 381M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25550K .......... .......... .......... .......... .......... 27% 392M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25600K .......... .......... .......... .......... .......... 27% 377M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25650K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25700K .......... .......... .......... .......... .......... 27% 396M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25750K .......... .......... .......... .......... .......... 27% 170M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25800K .......... .......... .......... .......... .......... 27% 222M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25850K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25900K .......... .......... .......... .......... .......... 27% 156M 0s 2024-09-14T11:38:01.297 INFO:teuthology.orchestra.run.smithi028.stderr: 25950K .......... .......... .......... .......... .......... 27% 362M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26000K .......... .......... .......... .......... .......... 28% 178M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26050K .......... .......... .......... .......... .......... 28% 222M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26100K .......... .......... .......... .......... .......... 28% 327M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26150K .......... .......... .......... .......... .......... 28% 117M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26200K .......... .......... .......... .......... .......... 28% 131M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26250K .......... .......... .......... .......... .......... 28% 352M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26300K .......... .......... .......... .......... .......... 28% 266M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26350K .......... .......... .......... .......... .......... 28% 398M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26400K .......... .......... .......... .......... .......... 28% 99.8M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26450K .......... .......... .......... .......... .......... 28% 377M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26500K .......... .......... .......... .......... .......... 28% 374M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26550K .......... .......... .......... .......... .......... 28% 386M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26600K .......... .......... .......... .......... .......... 28% 322M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26650K .......... .......... .......... .......... .......... 28% 208M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26700K .......... .......... .......... .......... .......... 28% 362M 0s 2024-09-14T11:38:01.298 INFO:teuthology.orchestra.run.smithi028.stderr: 26750K .......... .......... .......... .......... .......... 28% 192M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 26800K .......... .......... .......... .......... .......... 28% 347M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 26850K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 26900K .......... .......... .......... .......... .......... 29% 374M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 26950K .......... .......... .......... .......... .......... 29% 85.4M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27000K .......... .......... .......... .......... .......... 29% 84.9M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27050K .......... .......... .......... .......... .......... 29% 219M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27100K .......... .......... .......... .......... .......... 29% 372M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27150K .......... .......... .......... .......... .......... 29% 372M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27200K .......... .......... .......... .......... .......... 29% 386M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27250K .......... .......... .......... .......... .......... 29% 325M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27300K .......... .......... .......... .......... .......... 29% 408M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27350K .......... .......... .......... .......... .......... 29% 125M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27400K .......... .......... .......... .......... .......... 29% 359M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27450K .......... .......... .......... .......... .......... 29% 100M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27500K .......... .......... .......... .......... .......... 29% 209M 0s 2024-09-14T11:38:01.299 INFO:teuthology.orchestra.run.smithi028.stderr: 27550K .......... .......... .......... .......... .......... 29% 371M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27600K .......... .......... .......... .......... .......... 29% 382M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27650K .......... .......... .......... .......... .......... 29% 340M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27700K .......... .......... .......... .......... .......... 29% 369M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27750K .......... .......... .......... .......... .......... 29% 346M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27800K .......... .......... .......... .......... .......... 29% 391M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27850K .......... .......... .......... .......... .......... 30% 356M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27900K .......... .......... .......... .......... .......... 30% 385M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 27950K .......... .......... .......... .......... .......... 30% 323M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28000K .......... .......... .......... .......... .......... 30% 385M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28050K .......... .......... .......... .......... .......... 30% 381M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28100K .......... .......... .......... .......... .......... 30% 382M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28150K .......... .......... .......... .......... .......... 30% 345M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28200K .......... .......... .......... .......... .......... 30% 374M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28250K .......... .......... .......... .......... .......... 30% 348M 0s 2024-09-14T11:38:01.300 INFO:teuthology.orchestra.run.smithi028.stderr: 28300K .......... .......... .......... .......... .......... 30% 394M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28350K .......... .......... .......... .......... .......... 30% 395M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28400K .......... .......... .......... .......... .......... 30% 343M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28450K .......... .......... .......... .......... .......... 30% 382M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28500K .......... .......... .......... .......... .......... 30% 384M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28550K .......... .......... .......... .......... .......... 30% 398M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28600K .......... .......... .......... .......... .......... 30% 304M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28650K .......... .......... .......... .......... .......... 30% 315M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28700K .......... .......... .......... .......... .......... 30% 386M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28750K .......... .......... .......... .......... .......... 31% 129M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28800K .......... .......... .......... .......... .......... 31% 335M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28850K .......... .......... .......... .......... .......... 31% 340M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28900K .......... .......... .......... .......... .......... 31% 387M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 28950K .......... .......... .......... .......... .......... 31% 301M 0s 2024-09-14T11:38:01.301 INFO:teuthology.orchestra.run.smithi028.stderr: 29000K .......... .......... .......... .......... .......... 31% 186M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29050K .......... .......... .......... .......... .......... 31% 153M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29100K .......... .......... .......... .......... .......... 31% 230M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29150K .......... .......... .......... .......... .......... 31% 391M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29200K .......... .......... .......... .......... .......... 31% 159M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29250K .......... .......... .......... .......... .......... 31% 135M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29300K .......... .......... .......... .......... .......... 31% 263M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29350K .......... .......... .......... .......... .......... 31% 373M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29400K .......... .......... .......... .......... .......... 31% 383M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29450K .......... .......... .......... .......... .......... 31% 94.6M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29500K .......... .......... .......... .......... .......... 31% 234M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29550K .......... .......... .......... .......... .......... 31% 137M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29600K .......... .......... .......... .......... .......... 31% 372M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29650K .......... .......... .......... .......... .......... 31% 337M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29700K .......... .......... .......... .......... .......... 32% 379M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29750K .......... .......... .......... .......... .......... 32% 346M 0s 2024-09-14T11:38:01.302 INFO:teuthology.orchestra.run.smithi028.stderr: 29800K .......... .......... .......... .......... .......... 32% 386M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 29850K .......... .......... .......... .......... .......... 32% 398M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 29900K .......... .......... .......... .......... .......... 32% 327M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 29950K .......... .......... .......... .......... .......... 32% 281M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30000K .......... .......... .......... .......... .......... 32% 112M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30050K .......... .......... .......... .......... .......... 32% 241M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30100K .......... .......... .......... .......... .......... 32% 88.4M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30150K .......... .......... .......... .......... .......... 32% 151M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30200K .......... .......... .......... .......... .......... 32% 372M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30250K .......... .......... .......... .......... .......... 32% 322M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30300K .......... .......... .......... .......... .......... 32% 400M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30350K .......... .......... .......... .......... .......... 32% 131M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30400K .......... .......... .......... .......... .......... 32% 361M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30450K .......... .......... .......... .......... .......... 32% 82.7M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30500K .......... .......... .......... .......... .......... 32% 349M 0s 2024-09-14T11:38:01.303 INFO:teuthology.orchestra.run.smithi028.stderr: 30550K .......... .......... .......... .......... .......... 32% 398M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30600K .......... .......... .......... .......... .......... 32% 197M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30650K .......... .......... .......... .......... .......... 33% 231M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30700K .......... .......... .......... .......... .......... 33% 357M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30750K .......... .......... .......... .......... .......... 33% 429M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30800K .......... .......... .......... .......... .......... 33% 346M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30850K .......... .......... .......... .......... .......... 33% 394M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30900K .......... .......... .......... .......... .......... 33% 385M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 30950K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 31000K .......... .......... .......... .......... .......... 33% 377M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 31050K .......... .......... .......... .......... .......... 33% 395M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 31100K .......... .......... .......... .......... .......... 33% 398M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 31150K .......... .......... .......... .......... .......... 33% 278M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 31200K .......... .......... .......... .......... .......... 33% 331M 0s 2024-09-14T11:38:01.304 INFO:teuthology.orchestra.run.smithi028.stderr: 31250K .......... .......... .......... .......... .......... 33% 391M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31300K .......... .......... .......... .......... .......... 33% 348M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31350K .......... .......... .......... .......... .......... 33% 352M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31400K .......... .......... .......... .......... .......... 33% 328M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31450K .......... .......... .......... .......... .......... 33% 404M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31500K .......... .......... .......... .......... .......... 33% 306M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31550K .......... .......... .......... .......... .......... 34% 382M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31600K .......... .......... .......... .......... .......... 34% 403M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31650K .......... .......... .......... .......... .......... 34% 308M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31700K .......... .......... .......... .......... .......... 34% 396M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31750K .......... .......... .......... .......... .......... 34% 408M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31800K .......... .......... .......... .......... .......... 34% 391M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31850K .......... .......... .......... .......... .......... 34% 219M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31900K .......... .......... .......... .......... .......... 34% 336M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 31950K .......... .......... .......... .......... .......... 34% 247M 0s 2024-09-14T11:38:01.305 INFO:teuthology.orchestra.run.smithi028.stderr: 32000K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32050K .......... .......... .......... .......... .......... 34% 281M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32100K .......... .......... .......... .......... .......... 34% 166M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32150K .......... .......... .......... .......... .......... 34% 290M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32200K .......... .......... .......... .......... .......... 34% 98.9M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32250K .......... .......... .......... .......... .......... 34% 349M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32300K .......... .......... .......... .......... .......... 34% 256M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32350K .......... .......... .......... .......... .......... 34% 238M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32400K .......... .......... .......... .......... .......... 34% 399M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32450K .......... .......... .......... .......... .......... 34% 333M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32500K .......... .......... .......... .......... .......... 35% 125M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32550K .......... .......... .......... .......... .......... 35% 211M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32600K .......... .......... .......... .......... .......... 35% 157M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32650K .......... .......... .......... .......... .......... 35% 194M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32700K .......... .......... .......... .......... .......... 35% 251M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32750K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-14T11:38:01.306 INFO:teuthology.orchestra.run.smithi028.stderr: 32800K .......... .......... .......... .......... .......... 35% 375M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 32850K .......... .......... .......... .......... .......... 35% 298M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 32900K .......... .......... .......... .......... .......... 35% 330M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 32950K .......... .......... .......... .......... .......... 35% 342M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33000K .......... .......... .......... .......... .......... 35% 99.0M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33050K .......... .......... .......... .......... .......... 35% 232M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33100K .......... .......... .......... .......... .......... 35% 353M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33150K .......... .......... .......... .......... .......... 35% 315M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33200K .......... .......... .......... .......... .......... 35% 98.9M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33250K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33300K .......... .......... .......... .......... .......... 35% 102M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33350K .......... .......... .......... .......... .......... 35% 305M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33400K .......... .......... .......... .......... .......... 36% 372M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33450K .......... .......... .......... .......... .......... 36% 87.1M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33500K .......... .......... .......... .......... .......... 36% 284M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33550K .......... .......... .......... .......... .......... 36% 154M 0s 2024-09-14T11:38:01.307 INFO:teuthology.orchestra.run.smithi028.stderr: 33600K .......... .......... .......... .......... .......... 36% 252M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33650K .......... .......... .......... .......... .......... 36% 284M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33700K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33750K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33800K .......... .......... .......... .......... .......... 36% 370M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33850K .......... .......... .......... .......... .......... 36% 306M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33900K .......... .......... .......... .......... .......... 36% 334M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 33950K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34000K .......... .......... .......... .......... .......... 36% 329M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34050K .......... .......... .......... .......... .......... 36% 347M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34100K .......... .......... .......... .......... .......... 36% 314M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34150K .......... .......... .......... .......... .......... 36% 267M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34200K .......... .......... .......... .......... .......... 36% 274M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34250K .......... .......... .......... .......... .......... 36% 319M 0s 2024-09-14T11:38:01.308 INFO:teuthology.orchestra.run.smithi028.stderr: 34300K .......... .......... .......... .......... .......... 36% 289M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34350K .......... .......... .......... .......... .......... 37% 282M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34400K .......... .......... .......... .......... .......... 37% 334M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34450K .......... .......... .......... .......... .......... 37% 292M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34500K .......... .......... .......... .......... .......... 37% 306M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34550K .......... .......... .......... .......... .......... 37% 302M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34600K .......... .......... .......... .......... .......... 37% 270M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34650K .......... .......... .......... .......... .......... 37% 300M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34700K .......... .......... .......... .......... .......... 37% 317M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34750K .......... .......... .......... .......... .......... 37% 249M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34800K .......... .......... .......... .......... .......... 37% 261M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34850K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34900K .......... .......... .......... .......... .......... 37% 311M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 34950K .......... .......... .......... .......... .......... 37% 321M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 35000K .......... .......... .......... .......... .......... 37% 300M 0s 2024-09-14T11:38:01.309 INFO:teuthology.orchestra.run.smithi028.stderr: 35050K .......... .......... .......... .......... .......... 37% 334M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35100K .......... .......... .......... .......... .......... 37% 330M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35150K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35200K .......... .......... .......... .......... .......... 37% 249M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35250K .......... .......... .......... .......... .......... 37% 328M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35300K .......... .......... .......... .......... .......... 38% 330M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35350K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35400K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35450K .......... .......... .......... .......... .......... 38% 306M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35500K .......... .......... .......... .......... .......... 38% 269M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35550K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35600K .......... .......... .......... .......... .......... 38% 312M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35650K .......... .......... .......... .......... .......... 38% 333M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35700K .......... .......... .......... .......... .......... 38% 136M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35750K .......... .......... .......... .......... .......... 38% 190M 0s 2024-09-14T11:38:01.310 INFO:teuthology.orchestra.run.smithi028.stderr: 35800K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 35850K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 35900K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 35950K .......... .......... .......... .......... .......... 38% 273M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36000K .......... .......... .......... .......... .......... 38% 308M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36050K .......... .......... .......... .......... .......... 38% 153M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36100K .......... .......... .......... .......... .......... 38% 272M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36150K .......... .......... .......... .......... .......... 38% 147M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36200K .......... .......... .......... .......... .......... 39% 247M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36250K .......... .......... .......... .......... .......... 39% 198M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36300K .......... .......... .......... .......... .......... 39% 184M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36350K .......... .......... .......... .......... .......... 39% 291M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36400K .......... .......... .......... .......... .......... 39% 103M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36450K .......... .......... .......... .......... .......... 39% 66.5M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36500K .......... .......... .......... .......... .......... 39% 158M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36550K .......... .......... .......... .......... .......... 39% 313M 0s 2024-09-14T11:38:01.311 INFO:teuthology.orchestra.run.smithi028.stderr: 36600K .......... .......... .......... .......... .......... 39% 263M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36650K .......... .......... .......... .......... .......... 39% 318M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36700K .......... .......... .......... .......... .......... 39% 303M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36750K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36800K .......... .......... .......... .......... .......... 39% 320M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36850K .......... .......... .......... .......... .......... 39% 260M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36900K .......... .......... .......... .......... .......... 39% 360M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 36950K .......... .......... .......... .......... .......... 39% 263M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37000K .......... .......... .......... .......... .......... 39% 322M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37050K .......... .......... .......... .......... .......... 39% 311M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37100K .......... .......... .......... .......... .......... 39% 316M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37150K .......... .......... .......... .......... .......... 40% 307M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37200K .......... .......... .......... .......... .......... 40% 269M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37250K .......... .......... .......... .......... .......... 40% 330M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37300K .......... .......... .......... .......... .......... 40% 345M 0s 2024-09-14T11:38:01.312 INFO:teuthology.orchestra.run.smithi028.stderr: 37350K .......... .......... .......... .......... .......... 40% 244M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37400K .......... .......... .......... .......... .......... 40% 286M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37450K .......... .......... .......... .......... .......... 40% 227M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37500K .......... .......... .......... .......... .......... 40% 307M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37550K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37600K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37650K .......... .......... .......... .......... .......... 40% 238M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37700K .......... .......... .......... .......... .......... 40% 245M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37750K .......... .......... .......... .......... .......... 40% 274M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37800K .......... .......... .......... .......... .......... 40% 336M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37850K .......... .......... .......... .......... .......... 40% 308M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37900K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 37950K .......... .......... .......... .......... .......... 40% 261M 0s 2024-09-14T11:38:01.313 INFO:teuthology.orchestra.run.smithi028.stderr: 38000K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38050K .......... .......... .......... .......... .......... 41% 298M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38100K .......... .......... .......... .......... .......... 41% 314M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38150K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38200K .......... .......... .......... .......... .......... 41% 271M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38250K .......... .......... .......... .......... .......... 41% 283M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38300K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38350K .......... .......... .......... .......... .......... 41% 347M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38400K .......... .......... .......... .......... .......... 41% 210M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38450K .......... .......... .......... .......... .......... 41% 217M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38500K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38550K .......... .......... .......... .......... .......... 41% 326M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38600K .......... .......... .......... .......... .......... 41% 306M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38650K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38700K .......... .......... .......... .......... .......... 41% 269M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38750K .......... .......... .......... .......... .......... 41% 321M 0s 2024-09-14T11:38:01.314 INFO:teuthology.orchestra.run.smithi028.stderr: 38800K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 38850K .......... .......... .......... .......... .......... 41% 224M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 38900K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 38950K .......... .......... .......... .......... .......... 41% 327M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39000K .......... .......... .......... .......... .......... 42% 290M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39050K .......... .......... .......... .......... .......... 42% 262M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39100K .......... .......... .......... .......... .......... 42% 246M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39150K .......... .......... .......... .......... .......... 42% 330M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39200K .......... .......... .......... .......... .......... 42% 246M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39250K .......... .......... .......... .......... .......... 42% 120M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39300K .......... .......... .......... .......... .......... 42% 234M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39350K .......... .......... .......... .......... .......... 42% 258M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39400K .......... .......... .......... .......... .......... 42% 203M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39450K .......... .......... .......... .......... .......... 42% 159M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39500K .......... .......... .......... .......... .......... 42% 85.9M 0s 2024-09-14T11:38:01.315 INFO:teuthology.orchestra.run.smithi028.stderr: 39550K .......... .......... .......... .......... .......... 42% 144M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39600K .......... .......... .......... .......... .......... 42% 148M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39650K .......... .......... .......... .......... .......... 42% 302M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39700K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39750K .......... .......... .......... .......... .......... 42% 161M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39800K .......... .......... .......... .......... .......... 42% 311M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39850K .......... .......... .......... .......... .......... 42% 316M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39900K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 39950K .......... .......... .......... .......... .......... 43% 282M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40000K .......... .......... .......... .......... .......... 43% 327M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40050K .......... .......... .......... .......... .......... 43% 263M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40100K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40150K .......... .......... .......... .......... .......... 43% 312M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40200K .......... .......... .......... .......... .......... 43% 314M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40250K .......... .......... .......... .......... .......... 43% 97.0M 0s 2024-09-14T11:38:01.316 INFO:teuthology.orchestra.run.smithi028.stderr: 40300K .......... .......... .......... .......... .......... 43% 246M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40350K .......... .......... .......... .......... .......... 43% 301M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40400K .......... .......... .......... .......... .......... 43% 297M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40450K .......... .......... .......... .......... .......... 43% 263M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40500K .......... .......... .......... .......... .......... 43% 341M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40550K .......... .......... .......... .......... .......... 43% 280M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40600K .......... .......... .......... .......... .......... 43% 299M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40650K .......... .......... .......... .......... .......... 43% 284M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40700K .......... .......... .......... .......... .......... 43% 241M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40750K .......... .......... .......... .......... .......... 43% 297M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40800K .......... .......... .......... .......... .......... 43% 268M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40850K .......... .......... .......... .......... .......... 44% 299M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40900K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 40950K .......... .......... .......... .......... .......... 44% 300M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 41000K .......... .......... .......... .......... .......... 44% 302M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 41050K .......... .......... .......... .......... .......... 44% 264M 0s 2024-09-14T11:38:01.317 INFO:teuthology.orchestra.run.smithi028.stderr: 41100K .......... .......... .......... .......... .......... 44% 352M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41150K .......... .......... .......... .......... .......... 44% 343M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41200K .......... .......... .......... .......... .......... 44% 292M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41250K .......... .......... .......... .......... .......... 44% 337M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41300K .......... .......... .......... .......... .......... 44% 354M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41350K .......... .......... .......... .......... .......... 44% 313M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41400K .......... .......... .......... .......... .......... 44% 283M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41450K .......... .......... .......... .......... .......... 44% 322M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41500K .......... .......... .......... .......... .......... 44% 331M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41550K .......... .......... .......... .......... .......... 44% 280M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41600K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41650K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41700K .......... .......... .......... .......... .......... 44% 322M 0s 2024-09-14T11:38:01.318 INFO:teuthology.orchestra.run.smithi028.stderr: 41750K .......... .......... .......... .......... .......... 44% 327M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 41800K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 41850K .......... .......... .......... .......... .......... 45% 236M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 41900K .......... .......... .......... .......... .......... 45% 276M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 41950K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42000K .......... .......... .......... .......... .......... 45% 347M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42050K .......... .......... .......... .......... .......... 45% 295M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42100K .......... .......... .......... .......... .......... 45% 315M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42150K .......... .......... .......... .......... .......... 45% 291M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42200K .......... .......... .......... .......... .......... 45% 237M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42250K .......... .......... .......... .......... .......... 45% 335M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42300K .......... .......... .......... .......... .......... 45% 137M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42350K .......... .......... .......... .......... .......... 45% 235M 0s 2024-09-14T11:38:01.319 INFO:teuthology.orchestra.run.smithi028.stderr: 42400K .......... .......... .......... .......... .......... 45% 253M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42450K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42500K .......... .......... .......... .......... .......... 45% 188M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42550K .......... .......... .......... .......... .......... 45% 96.3M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42600K .......... .......... .......... .......... .......... 45% 116M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42650K .......... .......... .......... .......... .......... 45% 108M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42700K .......... .......... .......... .......... .......... 46% 301M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42750K .......... .......... .......... .......... .......... 46% 304M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42800K .......... .......... .......... .......... .......... 46% 87.7M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42850K .......... .......... .......... .......... .......... 46% 314M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42900K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 42950K .......... .......... .......... .......... .......... 46% 275M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 43000K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 43050K .......... .......... .......... .......... .......... 46% 339M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 43100K .......... .......... .......... .......... .......... 46% 321M 0s 2024-09-14T11:38:01.320 INFO:teuthology.orchestra.run.smithi028.stderr: 43150K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43200K .......... .......... .......... .......... .......... 46% 243M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43250K .......... .......... .......... .......... .......... 46% 170M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43300K .......... .......... .......... .......... .......... 46% 301M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43350K .......... .......... .......... .......... .......... 46% 333M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43400K .......... .......... .......... .......... .......... 46% 275M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43450K .......... .......... .......... .......... .......... 46% 327M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43500K .......... .......... .......... .......... .......... 46% 150M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43550K .......... .......... .......... .......... .......... 46% 201M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43600K .......... .......... .......... .......... .......... 46% 173M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43650K .......... .......... .......... .......... .......... 47% 336M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43700K .......... .......... .......... .......... .......... 47% 286M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43750K .......... .......... .......... .......... .......... 47% 283M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43800K .......... .......... .......... .......... .......... 47% 322M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43850K .......... .......... .......... .......... .......... 47% 332M 0s 2024-09-14T11:38:01.321 INFO:teuthology.orchestra.run.smithi028.stderr: 43900K .......... .......... .......... .......... .......... 47% 326M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 43950K .......... .......... .......... .......... .......... 47% 277M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44000K .......... .......... .......... .......... .......... 47% 346M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44050K .......... .......... .......... .......... .......... 47% 263M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44100K .......... .......... .......... .......... .......... 47% 311M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44150K .......... .......... .......... .......... .......... 47% 313M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44200K .......... .......... .......... .......... .......... 47% 322M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44250K .......... .......... .......... .......... .......... 47% 288M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44300K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44350K .......... .......... .......... .......... .......... 47% 319M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44400K .......... .......... .......... .......... .......... 47% 314M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44450K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44500K .......... .......... .......... .......... .......... 47% 311M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44550K .......... .......... .......... .......... .......... 48% 327M 0s 2024-09-14T11:38:01.322 INFO:teuthology.orchestra.run.smithi028.stderr: 44600K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44650K .......... .......... .......... .......... .......... 48% 315M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44700K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44750K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44800K .......... .......... .......... .......... .......... 48% 312M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44850K .......... .......... .......... .......... .......... 48% 326M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44900K .......... .......... .......... .......... .......... 48% 268M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 44950K .......... .......... .......... .......... .......... 48% 305M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45000K .......... .......... .......... .......... .......... 48% 288M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45050K .......... .......... .......... .......... .......... 48% 167M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45100K .......... .......... .......... .......... .......... 48% 280M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45150K .......... .......... .......... .......... .......... 48% 339M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45200K .......... .......... .......... .......... .......... 48% 321M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45250K .......... .......... .......... .......... .......... 48% 271M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45300K .......... .......... .......... .......... .......... 48% 250M 0s 2024-09-14T11:38:01.323 INFO:teuthology.orchestra.run.smithi028.stderr: 45350K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45400K .......... .......... .......... .......... .......... 48% 258M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45450K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45500K .......... .......... .......... .......... .......... 49% 327M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45550K .......... .......... .......... .......... .......... 49% 321M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45600K .......... .......... .......... .......... .......... 49% 106M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45650K .......... .......... .......... .......... .......... 49% 128M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45700K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45750K .......... .......... .......... .......... .......... 49% 138M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45800K .......... .......... .......... .......... .......... 49% 274M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45850K .......... .......... .......... .......... .......... 49% 98.7M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45900K .......... .......... .......... .......... .......... 49% 89.1M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 45950K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 46000K .......... .......... .......... .......... .......... 49% 307M 0s 2024-09-14T11:38:01.324 INFO:teuthology.orchestra.run.smithi028.stderr: 46050K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46100K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46150K .......... .......... .......... .......... .......... 49% 323M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46200K .......... .......... .......... .......... .......... 49% 330M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46250K .......... .......... .......... .......... .......... 49% 326M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46300K .......... .......... .......... .......... .......... 49% 225M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46350K .......... .......... .......... .......... .......... 49% 287M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46400K .......... .......... .......... .......... .......... 49% 295M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46450K .......... .......... .......... .......... .......... 50% 282M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46500K .......... .......... .......... .......... .......... 50% 110M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46550K .......... .......... .......... .......... .......... 50% 216M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46600K .......... .......... .......... .......... .......... 50% 309M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46650K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46700K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46750K .......... .......... .......... .......... .......... 50% 169M 0s 2024-09-14T11:38:01.325 INFO:teuthology.orchestra.run.smithi028.stderr: 46800K .......... .......... .......... .......... .......... 50% 285M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 46850K .......... .......... .......... .......... .......... 50% 318M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 46900K .......... .......... .......... .......... .......... 50% 312M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 46950K .......... .......... .......... .......... .......... 50% 271M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47000K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47050K .......... .......... .......... .......... .......... 50% 323M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47100K .......... .......... .......... .......... .......... 50% 315M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47150K .......... .......... .......... .......... .......... 50% 317M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47200K .......... .......... .......... .......... .......... 50% 322M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47250K .......... .......... .......... .......... .......... 50% 275M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47300K .......... .......... .......... .......... .......... 50% 352M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47350K .......... .......... .......... .......... .......... 51% 256M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47400K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47450K .......... .......... .......... .......... .......... 51% 322M 0s 2024-09-14T11:38:01.326 INFO:teuthology.orchestra.run.smithi028.stderr: 47500K .......... .......... .......... .......... .......... 51% 303M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47550K .......... .......... .......... .......... .......... 51% 265M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47600K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47650K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47700K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47750K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47800K .......... .......... .......... .......... .......... 51% 279M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47850K .......... .......... .......... .......... .......... 51% 318M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47900K .......... .......... .......... .......... .......... 51% 323M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 47950K .......... .......... .......... .......... .......... 51% 318M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 48000K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 48050K .......... .......... .......... .......... .......... 51% 304M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 48100K .......... .......... .......... .......... .......... 51% 320M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 48150K .......... .......... .......... .......... .......... 51% 293M 0s 2024-09-14T11:38:01.327 INFO:teuthology.orchestra.run.smithi028.stderr: 48200K .......... .......... .......... .......... .......... 51% 239M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48250K .......... .......... .......... .......... .......... 51% 285M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48300K .......... .......... .......... .......... .......... 52% 328M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48350K .......... .......... .......... .......... .......... 52% 285M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48400K .......... .......... .......... .......... .......... 52% 266M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48450K .......... .......... .......... .......... .......... 52% 307M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48500K .......... .......... .......... .......... .......... 52% 262M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48550K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-14T11:38:01.328 INFO:teuthology.orchestra.run.smithi028.stderr: 48600K .......... .......... .......... .......... .......... 52% 129M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48650K .......... .......... .......... .......... .......... 52% 325M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48700K .......... .......... .......... .......... .......... 52% 221M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48750K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48800K .......... .......... .......... .......... .......... 52% 161M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48850K .......... .......... .......... .......... .......... 52% 170M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48900K .......... .......... .......... .......... .......... 52% 109M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 48950K .......... .......... .......... .......... .......... 52% 86.2M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49000K .......... .......... .......... .......... .......... 52% 324M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49050K .......... .......... .......... .......... .......... 52% 189M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49100K .......... .......... .......... .......... .......... 52% 240M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49150K .......... .......... .......... .......... .......... 52% 260M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49200K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49250K .......... .......... .......... .......... .......... 53% 322M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49300K .......... .......... .......... .......... .......... 53% 323M 0s 2024-09-14T11:38:01.329 INFO:teuthology.orchestra.run.smithi028.stderr: 49350K .......... .......... .......... .......... .......... 53% 273M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49400K .......... .......... .......... .......... .......... 53% 206M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49450K .......... .......... .......... .......... .......... 53% 285M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49500K .......... .......... .......... .......... .......... 53% 332M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49550K .......... .......... .......... .......... .......... 53% 275M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49600K .......... .......... .......... .......... .......... 53% 229M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49650K .......... .......... .......... .......... .......... 53% 252M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49700K .......... .......... .......... .......... .......... 53% 264M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49750K .......... .......... .......... .......... .......... 53% 92.4M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49800K .......... .......... .......... .......... .......... 53% 342M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49850K .......... .......... .......... .......... .......... 53% 111M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49900K .......... .......... .......... .......... .......... 53% 244M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 49950K .......... .......... .......... .......... .......... 53% 294M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 50000K .......... .......... .......... .......... .......... 53% 272M 0s 2024-09-14T11:38:01.330 INFO:teuthology.orchestra.run.smithi028.stderr: 50050K .......... .......... .......... .......... .......... 53% 248M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50100K .......... .......... .......... .......... .......... 53% 249M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50150K .......... .......... .......... .......... .......... 54% 301M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50200K .......... .......... .......... .......... .......... 54% 333M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50250K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50300K .......... .......... .......... .......... .......... 54% 297M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50350K .......... .......... .......... .......... .......... 54% 270M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50400K .......... .......... .......... .......... .......... 54% 300M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50450K .......... .......... .......... .......... .......... 54% 304M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50500K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50550K .......... .......... .......... .......... .......... 54% 322M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50600K .......... .......... .......... .......... .......... 54% 269M 0s 2024-09-14T11:38:01.331 INFO:teuthology.orchestra.run.smithi028.stderr: 50650K .......... .......... .......... .......... .......... 54% 330M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 50700K .......... .......... .......... .......... .......... 54% 299M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 50750K .......... .......... .......... .......... .......... 54% 305M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 50800K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 50850K .......... .......... .......... .......... .......... 54% 216M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 50900K .......... .......... .......... .......... .......... 54% 320M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 50950K .......... .......... .......... .......... .......... 54% 254M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51000K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51050K .......... .......... .......... .......... .......... 55% 255M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51100K .......... .......... .......... .......... .......... 55% 218M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51150K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51200K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51250K .......... .......... .......... .......... .......... 55% 251M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51300K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-14T11:38:01.332 INFO:teuthology.orchestra.run.smithi028.stderr: 51350K .......... .......... .......... .......... .......... 55% 320M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51400K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51450K .......... .......... .......... .......... .......... 55% 325M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51500K .......... .......... .......... .......... .......... 55% 262M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51550K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51600K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51650K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51700K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51750K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51800K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51850K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51900K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 51950K .......... .......... .......... .......... .......... 55% 228M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 52000K .......... .......... .......... .......... .......... 56% 270M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 52050K .......... .......... .......... .......... .......... 56% 107M 0s 2024-09-14T11:38:01.333 INFO:teuthology.orchestra.run.smithi028.stderr: 52100K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52150K .......... .......... .......... .......... .......... 56% 164M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52200K .......... .......... .......... .......... .......... 56% 220M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52250K .......... .......... .......... .......... .......... 56% 216M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52300K .......... .......... .......... .......... .......... 56% 244M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52350K .......... .......... .......... .......... .......... 56% 235M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52400K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52450K .......... .......... .......... .......... .......... 56% 250M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52500K .......... .......... .......... .......... .......... 56% 349M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52550K .......... .......... .......... .......... .......... 56% 215M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52600K .......... .......... .......... .......... .......... 56% 269M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52650K .......... .......... .......... .......... .......... 56% 313M 0s 2024-09-14T11:38:01.334 INFO:teuthology.orchestra.run.smithi028.stderr: 52700K .......... .......... .......... .......... .......... 56% 331M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 52750K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 52800K .......... .......... .......... .......... .......... 56% 100M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 52850K .......... .......... .......... .......... .......... 56% 79.4M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 52900K .......... .......... .......... .......... .......... 56% 160M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 52950K .......... .......... .......... .......... .......... 57% 320M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53000K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53050K .......... .......... .......... .......... .......... 57% 300M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53100K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53150K .......... .......... .......... .......... .......... 57% 211M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53200K .......... .......... .......... .......... .......... 57% 339M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53250K .......... .......... .......... .......... .......... 57% 260M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53300K .......... .......... .......... .......... .......... 57% 330M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53350K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53400K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53450K .......... .......... .......... .......... .......... 57% 238M 0s 2024-09-14T11:38:01.335 INFO:teuthology.orchestra.run.smithi028.stderr: 53500K .......... .......... .......... .......... .......... 57% 264M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53550K .......... .......... .......... .......... .......... 57% 287M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53600K .......... .......... .......... .......... .......... 57% 295M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53650K .......... .......... .......... .......... .......... 57% 258M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53700K .......... .......... .......... .......... .......... 57% 319M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53750K .......... .......... .......... .......... .......... 57% 285M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53800K .......... .......... .......... .......... .......... 57% 306M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53850K .......... .......... .......... .......... .......... 58% 234M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53900K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 53950K .......... .......... .......... .......... .......... 58% 345M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54000K .......... .......... .......... .......... .......... 58% 311M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54050K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54100K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54150K .......... .......... .......... .......... .......... 58% 313M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54200K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54250K .......... .......... .......... .......... .......... 58% 283M 0s 2024-09-14T11:38:01.336 INFO:teuthology.orchestra.run.smithi028.stderr: 54300K .......... .......... .......... .......... .......... 58% 329M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54350K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54400K .......... .......... .......... .......... .......... 58% 321M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54450K .......... .......... .......... .......... .......... 58% 159M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54500K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54550K .......... .......... .......... .......... .......... 58% 259M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54600K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54650K .......... .......... .......... .......... .......... 58% 302M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54700K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54750K .......... .......... .......... .......... .......... 58% 252M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54800K .......... .......... .......... .......... .......... 59% 327M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54850K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-14T11:38:01.337 INFO:teuthology.orchestra.run.smithi028.stderr: 54900K .......... .......... .......... .......... .......... 59% 274M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 54950K .......... .......... .......... .......... .......... 59% 286M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55000K .......... .......... .......... .......... .......... 59% 238M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55050K .......... .......... .......... .......... .......... 59% 341M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55100K .......... .......... .......... .......... .......... 59% 214M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55150K .......... .......... .......... .......... .......... 59% 217M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55200K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55250K .......... .......... .......... .......... .......... 59% 248M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55300K .......... .......... .......... .......... .......... 59% 313M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55350K .......... .......... .......... .......... .......... 59% 109M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55400K .......... .......... .......... .......... .......... 59% 162M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55450K .......... .......... .......... .......... .......... 59% 241M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55500K .......... .......... .......... .......... .......... 59% 342M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55550K .......... .......... .......... .......... .......... 59% 242M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55600K .......... .......... .......... .......... .......... 59% 319M 0s 2024-09-14T11:38:01.338 INFO:teuthology.orchestra.run.smithi028.stderr: 55650K .......... .......... .......... .......... .......... 59% 218M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 55700K .......... .......... .......... .......... .......... 60% 324M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 55750K .......... .......... .......... .......... .......... 60% 346M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 55800K .......... .......... .......... .......... .......... 60% 118M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 55850K .......... .......... .......... .......... .......... 60% 315M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 55900K .......... .......... .......... .......... .......... 60% 121M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 55950K .......... .......... .......... .......... .......... 60% 145M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56000K .......... .......... .......... .......... .......... 60% 258M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56050K .......... .......... .......... .......... .......... 60% 220M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56100K .......... .......... .......... .......... .......... 60% 208M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56150K .......... .......... .......... .......... .......... 60% 267M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56200K .......... .......... .......... .......... .......... 60% 245M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56250K .......... .......... .......... .......... .......... 60% 213M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56300K .......... .......... .......... .......... .......... 60% 277M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56350K .......... .......... .......... .......... .......... 60% 282M 0s 2024-09-14T11:38:01.339 INFO:teuthology.orchestra.run.smithi028.stderr: 56400K .......... .......... .......... .......... .......... 60% 337M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56450K .......... .......... .......... .......... .......... 60% 255M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56500K .......... .......... .......... .......... .......... 60% 330M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56550K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56600K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56650K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56700K .......... .......... .......... .......... .......... 61% 323M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56750K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56800K .......... .......... .......... .......... .......... 61% 316M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56850K .......... .......... .......... .......... .......... 61% 266M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56900K .......... .......... .......... .......... .......... 61% 319M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 56950K .......... .......... .......... .......... .......... 61% 278M 0s 2024-09-14T11:38:01.340 INFO:teuthology.orchestra.run.smithi028.stderr: 57000K .......... .......... .......... .......... .......... 61% 319M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57050K .......... .......... .......... .......... .......... 61% 327M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57100K .......... .......... .......... .......... .......... 61% 224M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57150K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57200K .......... .......... .......... .......... .......... 61% 310M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57250K .......... .......... .......... .......... .......... 61% 313M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57300K .......... .......... .......... .......... .......... 61% 280M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57350K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57400K .......... .......... .......... .......... .......... 61% 334M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57450K .......... .......... .......... .......... .......... 61% 156M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57500K .......... .......... .......... .......... .......... 61% 243M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57550K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57600K .......... .......... .......... .......... .......... 62% 323M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57650K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57700K .......... .......... .......... .......... .......... 62% 179M 0s 2024-09-14T11:38:01.341 INFO:teuthology.orchestra.run.smithi028.stderr: 57750K .......... .......... .......... .......... .......... 62% 295M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 57800K .......... .......... .......... .......... .......... 62% 266M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 57850K .......... .......... .......... .......... .......... 62% 327M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 57900K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 57950K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58000K .......... .......... .......... .......... .......... 62% 289M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58050K .......... .......... .......... .......... .......... 62% 306M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58100K .......... .......... .......... .......... .......... 62% 290M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58150K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58200K .......... .......... .......... .......... .......... 62% 266M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58250K .......... .......... .......... .......... .......... 62% 274M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58300K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58350K .......... .......... .......... .......... .......... 62% 181M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58400K .......... .......... .......... .......... .......... 62% 211M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58450K .......... .......... .......... .......... .......... 62% 88.1M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58500K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-14T11:38:01.342 INFO:teuthology.orchestra.run.smithi028.stderr: 58550K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58600K .......... .......... .......... .......... .......... 63% 317M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58650K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58700K .......... .......... .......... .......... .......... 63% 293M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58750K .......... .......... .......... .......... .......... 63% 328M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58800K .......... .......... .......... .......... .......... 63% 113M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58850K .......... .......... .......... .......... .......... 63% 292M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58900K .......... .......... .......... .......... .......... 63% 110M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 58950K .......... .......... .......... .......... .......... 63% 249M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59000K .......... .......... .......... .......... .......... 63% 279M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59050K .......... .......... .......... .......... .......... 63% 291M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59100K .......... .......... .......... .......... .......... 63% 260M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59150K .......... .......... .......... .......... .......... 63% 213M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59200K .......... .......... .......... .......... .......... 63% 164M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59250K .......... .......... .......... .......... .......... 63% 330M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59300K .......... .......... .......... .......... .......... 63% 330M 0s 2024-09-14T11:38:01.343 INFO:teuthology.orchestra.run.smithi028.stderr: 59350K .......... .......... .......... .......... .......... 63% 154M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59400K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59450K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59500K .......... .......... .......... .......... .......... 64% 319M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59550K .......... .......... .......... .......... .......... 64% 263M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59600K .......... .......... .......... .......... .......... 64% 307M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59650K .......... .......... .......... .......... .......... 64% 308M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59700K .......... .......... .......... .......... .......... 64% 347M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59750K .......... .......... .......... .......... .......... 64% 243M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59800K .......... .......... .......... .......... .......... 64% 310M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59850K .......... .......... .......... .......... .......... 64% 369M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59900K .......... .......... .......... .......... .......... 64% 365M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 59950K .......... .......... .......... .......... .......... 64% 375M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 60000K .......... .......... .......... .......... .......... 64% 342M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 60050K .......... .......... .......... .......... .......... 64% 67.8M 0s 2024-09-14T11:38:01.344 INFO:teuthology.orchestra.run.smithi028.stderr: 60100K .......... .......... .......... .......... .......... 64% 315M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60150K .......... .......... .......... .......... .......... 64% 315M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60200K .......... .......... .......... .......... .......... 64% 263M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60250K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60300K .......... .......... .......... .......... .......... 64% 298M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60350K .......... .......... .......... .......... .......... 65% 315M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60400K .......... .......... .......... .......... .......... 65% 249M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60450K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60500K .......... .......... .......... .......... .......... 65% 255M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60550K .......... .......... .......... .......... .......... 65% 315M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60600K .......... .......... .......... .......... .......... 65% 316M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60650K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60700K .......... .......... .......... .......... .......... 65% 290M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60750K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60800K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-14T11:38:01.345 INFO:teuthology.orchestra.run.smithi028.stderr: 60850K .......... .......... .......... .......... .......... 65% 333M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 60900K .......... .......... .......... .......... .......... 65% 333M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 60950K .......... .......... .......... .......... .......... 65% 295M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61000K .......... .......... .......... .......... .......... 65% 338M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61050K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61100K .......... .......... .......... .......... .......... 65% 327M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61150K .......... .......... .......... .......... .......... 65% 260M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61200K .......... .......... .......... .......... .......... 65% 215M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61250K .......... .......... .......... .......... .......... 65% 334M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61300K .......... .......... .......... .......... .......... 66% 348M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61350K .......... .......... .......... .......... .......... 66% 305M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61400K .......... .......... .......... .......... .......... 66% 269M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61450K .......... .......... .......... .......... .......... 66% 301M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61500K .......... .......... .......... .......... .......... 66% 129M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61550K .......... .......... .......... .......... .......... 66% 157M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61600K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-14T11:38:01.346 INFO:teuthology.orchestra.run.smithi028.stderr: 61650K .......... .......... .......... .......... .......... 66% 133M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 61700K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 61750K .......... .......... .......... .......... .......... 66% 343M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 61800K .......... .......... .......... .......... .......... 66% 347M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 61850K .......... .......... .......... .......... .......... 66% 198M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 61900K .......... .......... .......... .......... .......... 66% 80.1M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 61950K .......... .......... .......... .......... .......... 66% 268M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62000K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62050K .......... .......... .......... .......... .......... 66% 283M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62100K .......... .......... .......... .......... .......... 66% 337M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62150K .......... .......... .......... .......... .......... 66% 305M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62200K .......... .......... .......... .......... .......... 67% 290M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62250K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62300K .......... .......... .......... .......... .......... 67% 267M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62350K .......... .......... .......... .......... .......... 67% 99.9M 0s 2024-09-14T11:38:01.347 INFO:teuthology.orchestra.run.smithi028.stderr: 62400K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62450K .......... .......... .......... .......... .......... 67% 275M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62500K .......... .......... .......... .......... .......... 67% 323M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62550K .......... .......... .......... .......... .......... 67% 314M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62600K .......... .......... .......... .......... .......... 67% 322M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62650K .......... .......... .......... .......... .......... 67% 265M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62700K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62750K .......... .......... .......... .......... .......... 67% 317M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62800K .......... .......... .......... .......... .......... 67% 319M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62850K .......... .......... .......... .......... .......... 67% 290M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62900K .......... .......... .......... .......... .......... 67% 241M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 62950K .......... .......... .......... .......... .......... 67% 274M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 63000K .......... .......... .......... .......... .......... 67% 280M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 63050K .......... .......... .......... .......... .......... 67% 324M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 63100K .......... .......... .......... .......... .......... 67% 86.0M 0s 2024-09-14T11:38:01.348 INFO:teuthology.orchestra.run.smithi028.stderr: 63150K .......... .......... .......... .......... .......... 68% 259M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63200K .......... .......... .......... .......... .......... 68% 283M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63250K .......... .......... .......... .......... .......... 68% 257M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63300K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63350K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63400K .......... .......... .......... .......... .......... 68% 313M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63450K .......... .......... .......... .......... .......... 68% 320M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63500K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63550K .......... .......... .......... .......... .......... 68% 293M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63600K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63650K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63700K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63750K .......... .......... .......... .......... .......... 68% 271M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63800K .......... .......... .......... .......... .......... 68% 353M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63850K .......... .......... .......... .......... .......... 68% 253M 0s 2024-09-14T11:38:01.349 INFO:teuthology.orchestra.run.smithi028.stderr: 63900K .......... .......... .......... .......... .......... 68% 251M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 63950K .......... .......... .......... .......... .......... 68% 321M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64000K .......... .......... .......... .......... .......... 68% 330M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64050K .......... .......... .......... .......... .......... 68% 314M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64100K .......... .......... .......... .......... .......... 69% 284M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64150K .......... .......... .......... .......... .......... 69% 315M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64200K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64250K .......... .......... .......... .......... .......... 69% 310M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64300K .......... .......... .......... .......... .......... 69% 281M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64350K .......... .......... .......... .......... .......... 69% 333M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64400K .......... .......... .......... .......... .......... 69% 293M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64450K .......... .......... .......... .......... .......... 69% 226M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64500K .......... .......... .......... .......... .......... 69% 187M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64550K .......... .......... .......... .......... .......... 69% 239M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64600K .......... .......... .......... .......... .......... 69% 233M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64650K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-14T11:38:01.350 INFO:teuthology.orchestra.run.smithi028.stderr: 64700K .......... .......... .......... .......... .......... 69% 120M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 64750K .......... .......... .......... .......... .......... 69% 264M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 64800K .......... .......... .......... .......... .......... 69% 239M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 64850K .......... .......... .......... .......... .......... 69% 229M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 64900K .......... .......... .......... .......... .......... 69% 288M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 64950K .......... .......... .......... .......... .......... 69% 108M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65000K .......... .......... .......... .......... .......... 70% 203M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65050K .......... .......... .......... .......... .......... 70% 288M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65100K .......... .......... .......... .......... .......... 70% 332M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65150K .......... .......... .......... .......... .......... 70% 339M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65200K .......... .......... .......... .......... .......... 70% 294M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65250K .......... .......... .......... .......... .......... 70% 212M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65300K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65350K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65400K .......... .......... .......... .......... .......... 70% 111M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65450K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-14T11:38:01.351 INFO:teuthology.orchestra.run.smithi028.stderr: 65500K .......... .......... .......... .......... .......... 70% 178M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65550K .......... .......... .......... .......... .......... 70% 270M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65600K .......... .......... .......... .......... .......... 70% 320M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65650K .......... .......... .......... .......... .......... 70% 318M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65700K .......... .......... .......... .......... .......... 70% 288M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65750K .......... .......... .......... .......... .......... 70% 327M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65800K .......... .......... .......... .......... .......... 70% 308M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65850K .......... .......... .......... .......... .......... 70% 310M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65900K .......... .......... .......... .......... .......... 70% 158M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 65950K .......... .......... .......... .......... .......... 71% 253M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 66000K .......... .......... .......... .......... .......... 71% 337M 0s 2024-09-14T11:38:01.352 INFO:teuthology.orchestra.run.smithi028.stderr: 66050K .......... .......... .......... .......... .......... 71% 273M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66100K .......... .......... .......... .......... .......... 71% 110M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66150K .......... .......... .......... .......... .......... 71% 194M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66200K .......... .......... .......... .......... .......... 71% 276M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66250K .......... .......... .......... .......... .......... 71% 302M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66300K .......... .......... .......... .......... .......... 71% 255M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66350K .......... .......... .......... .......... .......... 71% 306M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66400K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66450K .......... .......... .......... .......... .......... 71% 260M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66500K .......... .......... .......... .......... .......... 71% 278M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66550K .......... .......... .......... .......... .......... 71% 313M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66600K .......... .......... .......... .......... .......... 71% 338M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66650K .......... .......... .......... .......... .......... 71% 325M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66700K .......... .......... .......... .......... .......... 71% 248M 0s 2024-09-14T11:38:01.353 INFO:teuthology.orchestra.run.smithi028.stderr: 66750K .......... .......... .......... .......... .......... 71% 320M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 66800K .......... .......... .......... .......... .......... 71% 327M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 66850K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 66900K .......... .......... .......... .......... .......... 72% 191M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 66950K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67000K .......... .......... .......... .......... .......... 72% 310M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67050K .......... .......... .......... .......... .......... 72% 316M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67100K .......... .......... .......... .......... .......... 72% 262M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67150K .......... .......... .......... .......... .......... 72% 324M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67200K .......... .......... .......... .......... .......... 72% 284M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67250K .......... .......... .......... .......... .......... 72% 304M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67300K .......... .......... .......... .......... .......... 72% 324M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67350K .......... .......... .......... .......... .......... 72% 321M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67400K .......... .......... .......... .......... .......... 72% 253M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67450K .......... .......... .......... .......... .......... 72% 303M 0s 2024-09-14T11:38:01.354 INFO:teuthology.orchestra.run.smithi028.stderr: 67500K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67550K .......... .......... .......... .......... .......... 72% 253M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67600K .......... .......... .......... .......... .......... 72% 255M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67650K .......... .......... .......... .......... .......... 72% 239M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67700K .......... .......... .......... .......... .......... 72% 292M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67750K .......... .......... .......... .......... .......... 72% 283M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67800K .......... .......... .......... .......... .......... 73% 115M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67850K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67900K .......... .......... .......... .......... .......... 73% 199M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 67950K .......... .......... .......... .......... .......... 73% 133M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 68000K .......... .......... .......... .......... .......... 73% 320M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 68050K .......... .......... .......... .......... .......... 73% 313M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 68100K .......... .......... .......... .......... .......... 73% 292M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 68150K .......... .......... .......... .......... .......... 73% 310M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 68200K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-14T11:38:01.355 INFO:teuthology.orchestra.run.smithi028.stderr: 68250K .......... .......... .......... .......... .......... 73% 288M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68300K .......... .......... .......... .......... .......... 73% 151M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68350K .......... .......... .......... .......... .......... 73% 318M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68400K .......... .......... .......... .......... .......... 73% 326M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68450K .......... .......... .......... .......... .......... 73% 124M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68500K .......... .......... .......... .......... .......... 73% 321M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68550K .......... .......... .......... .......... .......... 73% 306M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68600K .......... .......... .......... .......... .......... 73% 256M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68650K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68700K .......... .......... .......... .......... .......... 74% 118M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68750K .......... .......... .......... .......... .......... 74% 218M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68800K .......... .......... .......... .......... .......... 74% 265M 0s 2024-09-14T11:38:01.356 INFO:teuthology.orchestra.run.smithi028.stderr: 68850K .......... .......... .......... .......... .......... 74% 251M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 68900K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 68950K .......... .......... .......... .......... .......... 74% 335M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69000K .......... .......... .......... .......... .......... 74% 81.1M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69050K .......... .......... .......... .......... .......... 74% 206M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69100K .......... .......... .......... .......... .......... 74% 351M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69150K .......... .......... .......... .......... .......... 74% 332M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69200K .......... .......... .......... .......... .......... 74% 247M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69250K .......... .......... .......... .......... .......... 74% 172M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69300K .......... .......... .......... .......... .......... 74% 320M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69350K .......... .......... .......... .......... .......... 74% 331M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69400K .......... .......... .......... .......... .......... 74% 312M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69450K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-14T11:38:01.357 INFO:teuthology.orchestra.run.smithi028.stderr: 69500K .......... .......... .......... .......... .......... 74% 263M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69550K .......... .......... .......... .......... .......... 74% 291M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69600K .......... .......... .......... .......... .......... 74% 270M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69650K .......... .......... .......... .......... .......... 75% 353M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69700K .......... .......... .......... .......... .......... 75% 321M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69750K .......... .......... .......... .......... .......... 75% 238M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69800K .......... .......... .......... .......... .......... 75% 328M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69850K .......... .......... .......... .......... .......... 75% 284M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69900K .......... .......... .......... .......... .......... 75% 310M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 69950K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 70000K .......... .......... .......... .......... .......... 75% 304M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 70050K .......... .......... .......... .......... .......... 75% 211M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 70100K .......... .......... .......... .......... .......... 75% 274M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 70150K .......... .......... .......... .......... .......... 75% 291M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 70200K .......... .......... .......... .......... .......... 75% 271M 0s 2024-09-14T11:38:01.358 INFO:teuthology.orchestra.run.smithi028.stderr: 70250K .......... .......... .......... .......... .......... 75% 310M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70300K .......... .......... .......... .......... .......... 75% 195M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70350K .......... .......... .......... .......... .......... 75% 300M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70400K .......... .......... .......... .......... .......... 75% 258M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70450K .......... .......... .......... .......... .......... 75% 322M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70500K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70550K .......... .......... .......... .......... .......... 75% 327M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70600K .......... .......... .......... .......... .......... 76% 278M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70650K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70700K .......... .......... .......... .......... .......... 76% 324M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70750K .......... .......... .......... .......... .......... 76% 299M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70800K .......... .......... .......... .......... .......... 76% 334M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70850K .......... .......... .......... .......... .......... 76% 330M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70900K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 70950K .......... .......... .......... .......... .......... 76% 232M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 71000K .......... .......... .......... .......... .......... 76% 128M 0s 2024-09-14T11:38:01.359 INFO:teuthology.orchestra.run.smithi028.stderr: 71050K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71100K .......... .......... .......... .......... .......... 76% 326M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71150K .......... .......... .......... .......... .......... 76% 274M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71200K .......... .......... .......... .......... .......... 76% 326M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71250K .......... .......... .......... .......... .......... 76% 277M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71300K .......... .......... .......... .......... .......... 76% 145M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71350K .......... .......... .......... .......... .......... 76% 317M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71400K .......... .......... .......... .......... .......... 76% 326M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71450K .......... .......... .......... .......... .......... 76% 109M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71500K .......... .......... .......... .......... .......... 77% 316M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71550K .......... .......... .......... .......... .......... 77% 316M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71600K .......... .......... .......... .......... .......... 77% 336M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71650K .......... .......... .......... .......... .......... 77% 255M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71700K .......... .......... .......... .......... .......... 77% 341M 0s 2024-09-14T11:38:01.360 INFO:teuthology.orchestra.run.smithi028.stderr: 71750K .......... .......... .......... .......... .......... 77% 227M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 71800K .......... .......... .......... .......... .......... 77% 241M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 71850K .......... .......... .......... .......... .......... 77% 306M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 71900K .......... .......... .......... .......... .......... 77% 153M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 71950K .......... .......... .......... .......... .......... 77% 223M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72000K .......... .......... .......... .......... .......... 77% 57.6M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72050K .......... .......... .......... .......... .......... 77% 284M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72100K .......... .......... .......... .......... .......... 77% 327M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72150K .......... .......... .......... .......... .......... 77% 198M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72200K .......... .......... .......... .......... .......... 77% 278M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72250K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72300K .......... .......... .......... .......... .......... 77% 327M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72350K .......... .......... .......... .......... .......... 77% 239M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72400K .......... .......... .......... .......... .......... 77% 309M 0s 2024-09-14T11:38:01.361 INFO:teuthology.orchestra.run.smithi028.stderr: 72450K .......... .......... .......... .......... .......... 78% 321M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72500K .......... .......... .......... .......... .......... 78% 280M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72550K .......... .......... .......... .......... .......... 78% 311M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72600K .......... .......... .......... .......... .......... 78% 265M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72650K .......... .......... .......... .......... .......... 78% 319M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72700K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72750K .......... .......... .......... .......... .......... 78% 304M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72800K .......... .......... .......... .......... .......... 78% 318M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72850K .......... .......... .......... .......... .......... 78% 262M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72900K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 72950K .......... .......... .......... .......... .......... 78% 325M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 73000K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 73050K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 73100K .......... .......... .......... .......... .......... 78% 244M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 73150K .......... .......... .......... .......... .......... 78% 274M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 73200K .......... .......... .......... .......... .......... 78% 258M 0s 2024-09-14T11:38:01.362 INFO:teuthology.orchestra.run.smithi028.stderr: 73250K .......... .......... .......... .......... .......... 78% 270M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73300K .......... .......... .......... .......... .......... 78% 322M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73350K .......... .......... .......... .......... .......... 79% 265M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73400K .......... .......... .......... .......... .......... 79% 300M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73450K .......... .......... .......... .......... .......... 79% 311M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73500K .......... .......... .......... .......... .......... 79% 281M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73550K .......... .......... .......... .......... .......... 79% 306M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73600K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73650K .......... .......... .......... .......... .......... 79% 263M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73700K .......... .......... .......... .......... .......... 79% 309M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73750K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73800K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73850K .......... .......... .......... .......... .......... 79% 293M 0s 2024-09-14T11:38:01.363 INFO:teuthology.orchestra.run.smithi028.stderr: 73900K .......... .......... .......... .......... .......... 79% 278M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 73950K .......... .......... .......... .......... .......... 79% 271M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74000K .......... .......... .......... .......... .......... 79% 274M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74050K .......... .......... .......... .......... .......... 79% 245M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74100K .......... .......... .......... .......... .......... 79% 273M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74150K .......... .......... .......... .......... .......... 79% 181M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74200K .......... .......... .......... .......... .......... 79% 233M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74250K .......... .......... .......... .......... .......... 79% 327M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74300K .......... .......... .......... .......... .......... 80% 139M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74350K .......... .......... .......... .......... .......... 80% 292M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74400K .......... .......... .......... .......... .......... 80% 107M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74450K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74500K .......... .......... .......... .......... .......... 80% 231M 0s 2024-09-14T11:38:01.364 INFO:teuthology.orchestra.run.smithi028.stderr: 74550K .......... .......... .......... .......... .......... 80% 309M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74600K .......... .......... .......... .......... .......... 80% 293M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74650K .......... .......... .......... .......... .......... 80% 323M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74700K .......... .......... .......... .......... .......... 80% 256M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74750K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74800K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74850K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74900K .......... .......... .......... .......... .......... 80% 290M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 74950K .......... .......... .......... .......... .......... 80% 311M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 75000K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 75050K .......... .......... .......... .......... .......... 80% 48.8M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 75100K .......... .......... .......... .......... .......... 80% 225M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 75150K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-14T11:38:01.365 INFO:teuthology.orchestra.run.smithi028.stderr: 75200K .......... .......... .......... .......... .......... 81% 332M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75250K .......... .......... .......... .......... .......... 81% 211M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75300K .......... .......... .......... .......... .......... 81% 331M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75350K .......... .......... .......... .......... .......... 81% 268M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75400K .......... .......... .......... .......... .......... 81% 292M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75450K .......... .......... .......... .......... .......... 81% 336M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75500K .......... .......... .......... .......... .......... 81% 243M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75550K .......... .......... .......... .......... .......... 81% 192M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75600K .......... .......... .......... .......... .......... 81% 305M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75650K .......... .......... .......... .......... .......... 81% 284M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75700K .......... .......... .......... .......... .......... 81% 223M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75750K .......... .......... .......... .......... .......... 81% 222M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75800K .......... .......... .......... .......... .......... 81% 328M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75850K .......... .......... .......... .......... .......... 81% 292M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75900K .......... .......... .......... .......... .......... 81% 223M 0s 2024-09-14T11:38:01.366 INFO:teuthology.orchestra.run.smithi028.stderr: 75950K .......... .......... .......... .......... .......... 81% 272M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76000K .......... .......... .......... .......... .......... 81% 317M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76050K .......... .......... .......... .......... .......... 81% 271M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76100K .......... .......... .......... .......... .......... 81% 309M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76150K .......... .......... .......... .......... .......... 82% 245M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76200K .......... .......... .......... .......... .......... 82% 305M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76250K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76300K .......... .......... .......... .......... .......... 82% 339M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76350K .......... .......... .......... .......... .......... 82% 287M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76400K .......... .......... .......... .......... .......... 82% 237M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76450K .......... .......... .......... .......... .......... 82% 304M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76500K .......... .......... .......... .......... .......... 82% 291M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76550K .......... .......... .......... .......... .......... 82% 294M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76600K .......... .......... .......... .......... .......... 82% 328M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76650K .......... .......... .......... .......... .......... 82% 312M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76700K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-14T11:38:01.367 INFO:teuthology.orchestra.run.smithi028.stderr: 76750K .......... .......... .......... .......... .......... 82% 298M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 76800K .......... .......... .......... .......... .......... 82% 355M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 76850K .......... .......... .......... .......... .......... 82% 277M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 76900K .......... .......... .......... .......... .......... 82% 316M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 76950K .......... .......... .......... .......... .......... 82% 334M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77000K .......... .......... .......... .......... .......... 82% 334M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77050K .......... .......... .......... .......... .......... 82% 261M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77100K .......... .......... .......... .......... .......... 83% 340M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77150K .......... .......... .......... .......... .......... 83% 203M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77200K .......... .......... .......... .......... .......... 83% 314M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77250K .......... .......... .......... .......... .......... 83% 296M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77300K .......... .......... .......... .......... .......... 83% 89.9M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77350K .......... .......... .......... .......... .......... 83% 292M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77400K .......... .......... .......... .......... .......... 83% 212M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77450K .......... .......... .......... .......... .......... 83% 249M 0s 2024-09-14T11:38:01.368 INFO:teuthology.orchestra.run.smithi028.stderr: 77500K .......... .......... .......... .......... .......... 83% 247M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77550K .......... .......... .......... .......... .......... 83% 292M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77600K .......... .......... .......... .......... .......... 83% 263M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77650K .......... .......... .......... .......... .......... 83% 287M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77700K .......... .......... .......... .......... .......... 83% 276M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77750K .......... .......... .......... .......... .......... 83% 281M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77800K .......... .......... .......... .......... .......... 83% 297M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77850K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77900K .......... .......... .......... .......... .......... 83% 284M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 77950K .......... .......... .......... .......... .......... 83% 335M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 78000K .......... .......... .......... .......... .......... 84% 315M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 78050K .......... .......... .......... .......... .......... 84% 329M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 78100K .......... .......... .......... .......... .......... 84% 52.6M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 78150K .......... .......... .......... .......... .......... 84% 265M 0s 2024-09-14T11:38:01.369 INFO:teuthology.orchestra.run.smithi028.stderr: 78200K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78250K .......... .......... .......... .......... .......... 84% 296M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78300K .......... .......... .......... .......... .......... 84% 328M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78350K .......... .......... .......... .......... .......... 84% 326M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78400K .......... .......... .......... .......... .......... 84% 249M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78450K .......... .......... .......... .......... .......... 84% 291M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78500K .......... .......... .......... .......... .......... 84% 169M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78550K .......... .......... .......... .......... .......... 84% 300M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78600K .......... .......... .......... .......... .......... 84% 172M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78650K .......... .......... .......... .......... .......... 84% 325M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78700K .......... .......... .......... .......... .......... 84% 285M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78750K .......... .......... .......... .......... .......... 84% 314M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78800K .......... .......... .......... .......... .......... 84% 189M 0s 2024-09-14T11:38:01.370 INFO:teuthology.orchestra.run.smithi028.stderr: 78850K .......... .......... .......... .......... .......... 84% 282M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 78900K .......... .......... .......... .......... .......... 84% 258M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 78950K .......... .......... .......... .......... .......... 85% 240M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79000K .......... .......... .......... .......... .......... 85% 252M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79050K .......... .......... .......... .......... .......... 85% 270M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79100K .......... .......... .......... .......... .......... 85% 253M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79150K .......... .......... .......... .......... .......... 85% 287M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79200K .......... .......... .......... .......... .......... 85% 336M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79250K .......... .......... .......... .......... .......... 85% 299M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79300K .......... .......... .......... .......... .......... 85% 321M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79350K .......... .......... .......... .......... .......... 85% 273M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79400K .......... .......... .......... .......... .......... 85% 231M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79450K .......... .......... .......... .......... .......... 85% 309M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79500K .......... .......... .......... .......... .......... 85% 347M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79550K .......... .......... .......... .......... .......... 85% 315M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79600K .......... .......... .......... .......... .......... 85% 319M 0s 2024-09-14T11:38:01.371 INFO:teuthology.orchestra.run.smithi028.stderr: 79650K .......... .......... .......... .......... .......... 85% 307M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 79700K .......... .......... .......... .......... .......... 85% 330M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 79750K .......... .......... .......... .......... .......... 85% 202M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 79800K .......... .......... .......... .......... .......... 85% 294M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 79850K .......... .......... .......... .......... .......... 86% 295M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 79900K .......... .......... .......... .......... .......... 86% 312M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 79950K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80000K .......... .......... .......... .......... .......... 86% 313M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80050K .......... .......... .......... .......... .......... 86% 287M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80100K .......... .......... .......... .......... .......... 86% 350M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80150K .......... .......... .......... .......... .......... 86% 255M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80200K .......... .......... .......... .......... .......... 86% 247M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80250K .......... .......... .......... .......... .......... 86% 266M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80300K .......... .......... .......... .......... .......... 86% 300M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80350K .......... .......... .......... .......... .......... 86% 246M 0s 2024-09-14T11:38:01.372 INFO:teuthology.orchestra.run.smithi028.stderr: 80400K .......... .......... .......... .......... .......... 86% 85.9M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80450K .......... .......... .......... .......... .......... 86% 263M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80500K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80550K .......... .......... .......... .......... .......... 86% 302M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80600K .......... .......... .......... .......... .......... 86% 237M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80650K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80700K .......... .......... .......... .......... .......... 86% 299M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80750K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80800K .......... .......... .......... .......... .......... 87% 324M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80850K .......... .......... .......... .......... .......... 87% 270M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80900K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 80950K .......... .......... .......... .......... .......... 87% 344M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 81000K .......... .......... .......... .......... .......... 87% 300M 0s 2024-09-14T11:38:01.373 INFO:teuthology.orchestra.run.smithi028.stderr: 81050K .......... .......... .......... .......... .......... 87% 297M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81100K .......... .......... .......... .......... .......... 87% 62.7M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81150K .......... .......... .......... .......... .......... 87% 260M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81200K .......... .......... .......... .......... .......... 87% 305M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81250K .......... .......... .......... .......... .......... 87% 296M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81300K .......... .......... .......... .......... .......... 87% 241M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81350K .......... .......... .......... .......... .......... 87% 307M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81400K .......... .......... .......... .......... .......... 87% 281M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81450K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81500K .......... .......... .......... .......... .......... 87% 206M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81550K .......... .......... .......... .......... .......... 87% 270M 0s 2024-09-14T11:38:01.374 INFO:teuthology.orchestra.run.smithi028.stderr: 81600K .......... .......... .......... .......... .......... 87% 281M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81650K .......... .......... .......... .......... .......... 87% 146M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81700K .......... .......... .......... .......... .......... 87% 215M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81750K .......... .......... .......... .......... .......... 88% 232M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81800K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81850K .......... .......... .......... .......... .......... 88% 275M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81900K .......... .......... .......... .......... .......... 88% 274M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 81950K .......... .......... .......... .......... .......... 88% 184M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82000K .......... .......... .......... .......... .......... 88% 131M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82050K .......... .......... .......... .......... .......... 88% 282M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82100K .......... .......... .......... .......... .......... 88% 295M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82150K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82200K .......... .......... .......... .......... .......... 88% 316M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82250K .......... .......... .......... .......... .......... 88% 270M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82300K .......... .......... .......... .......... .......... 88% 335M 0s 2024-09-14T11:38:01.375 INFO:teuthology.orchestra.run.smithi028.stderr: 82350K .......... .......... .......... .......... .......... 88% 334M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82400K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82450K .......... .......... .......... .......... .......... 88% 168M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82500K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82550K .......... .......... .......... .......... .......... 88% 312M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82600K .......... .......... .......... .......... .......... 88% 328M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82650K .......... .......... .......... .......... .......... 89% 295M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82700K .......... .......... .......... .......... .......... 89% 309M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82750K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82800K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82850K .......... .......... .......... .......... .......... 89% 276M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82900K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 82950K .......... .......... .......... .......... .......... 89% 267M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 83000K .......... .......... .......... .......... .......... 89% 269M 0s 2024-09-14T11:38:01.376 INFO:teuthology.orchestra.run.smithi028.stderr: 83050K .......... .......... .......... .......... .......... 89% 282M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83100K .......... .......... .......... .......... .......... 89% 218M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83150K .......... .......... .......... .......... .......... 89% 320M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83200K .......... .......... .......... .......... .......... 89% 280M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83250K .......... .......... .......... .......... .......... 89% 292M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83300K .......... .......... .......... .......... .......... 89% 265M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83350K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83400K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83450K .......... .......... .......... .......... .......... 89% 208M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83500K .......... .......... .......... .......... .......... 89% 184M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83550K .......... .......... .......... .......... .......... 89% 293M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83600K .......... .......... .......... .......... .......... 90% 172M 0s 2024-09-14T11:38:01.377 INFO:teuthology.orchestra.run.smithi028.stderr: 83650K .......... .......... .......... .......... .......... 90% 323M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 83700K .......... .......... .......... .......... .......... 90% 334M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 83750K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 83800K .......... .......... .......... .......... .......... 90% 317M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 83850K .......... .......... .......... .......... .......... 90% 209M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 83900K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 83950K .......... .......... .......... .......... .......... 90% 117M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84000K .......... .......... .......... .......... .......... 90% 315M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84050K .......... .......... .......... .......... .......... 90% 321M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84100K .......... .......... .......... .......... .......... 90% 44.3M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84150K .......... .......... .......... .......... .......... 90% 307M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84200K .......... .......... .......... .......... .......... 90% 326M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84250K .......... .......... .......... .......... .......... 90% 287M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84300K .......... .......... .......... .......... .......... 90% 325M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84350K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-14T11:38:01.378 INFO:teuthology.orchestra.run.smithi028.stderr: 84400K .......... .......... .......... .......... .......... 90% 308M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84450K .......... .......... .......... .......... .......... 90% 266M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84500K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84550K .......... .......... .......... .......... .......... 91% 314M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84600K .......... .......... .......... .......... .......... 91% 319M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84650K .......... .......... .......... .......... .......... 91% 255M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84700K .......... .......... .......... .......... .......... 91% 250M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84750K .......... .......... .......... .......... .......... 91% 286M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84800K .......... .......... .......... .......... .......... 91% 284M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84850K .......... .......... .......... .......... .......... 91% 255M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84900K .......... .......... .......... .......... .......... 91% 252M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 84950K .......... .......... .......... .......... .......... 91% 313M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 85000K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 85050K .......... .......... .......... .......... .......... 91% 268M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 85100K .......... .......... .......... .......... .......... 91% 213M 0s 2024-09-14T11:38:01.379 INFO:teuthology.orchestra.run.smithi028.stderr: 85150K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85200K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85250K .......... .......... .......... .......... .......... 91% 274M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85300K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85350K .......... .......... .......... .......... .......... 91% 312M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85400K .......... .......... .......... .......... .......... 91% 248M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85450K .......... .......... .......... .......... .......... 92% 311M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85500K .......... .......... .......... .......... .......... 92% 340M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85550K .......... .......... .......... .......... .......... 92% 197M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85600K .......... .......... .......... .......... .......... 92% 270M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85650K .......... .......... .......... .......... .......... 92% 319M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85700K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85750K .......... .......... .......... .......... .......... 92% 313M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85800K .......... .......... .......... .......... .......... 92% 162M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85850K .......... .......... .......... .......... .......... 92% 251M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85900K .......... .......... .......... .......... .......... 92% 295M 0s 2024-09-14T11:38:01.380 INFO:teuthology.orchestra.run.smithi028.stderr: 85950K .......... .......... .......... .......... .......... 92% 297M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86000K .......... .......... .......... .......... .......... 92% 252M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86050K .......... .......... .......... .......... .......... 92% 284M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86100K .......... .......... .......... .......... .......... 92% 289M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86150K .......... .......... .......... .......... .......... 92% 214M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86200K .......... .......... .......... .......... .......... 92% 292M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86250K .......... .......... .......... .......... .......... 92% 330M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86300K .......... .......... .......... .......... .......... 92% 327M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86350K .......... .......... .......... .......... .......... 93% 326M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86400K .......... .......... .......... .......... .......... 93% 164M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86450K .......... .......... .......... .......... .......... 93% 315M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86500K .......... .......... .......... .......... .......... 93% 298M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86550K .......... .......... .......... .......... .......... 93% 332M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86600K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86650K .......... .......... .......... .......... .......... 93% 266M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86700K .......... .......... .......... .......... .......... 93% 330M 0s 2024-09-14T11:38:01.381 INFO:teuthology.orchestra.run.smithi028.stderr: 86750K .......... .......... .......... .......... .......... 93% 325M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 86800K .......... .......... .......... .......... .......... 93% 307M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 86850K .......... .......... .......... .......... .......... 93% 317M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 86900K .......... .......... .......... .......... .......... 93% 277M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 86950K .......... .......... .......... .......... .......... 93% 97.1M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87000K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87050K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87100K .......... .......... .......... .......... .......... 93% 45.5M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87150K .......... .......... .......... .......... .......... 93% 304M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87200K .......... .......... .......... .......... .......... 93% 227M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87250K .......... .......... .......... .......... .......... 93% 255M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87300K .......... .......... .......... .......... .......... 94% 335M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87350K .......... .......... .......... .......... .......... 94% 291M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87400K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87450K .......... .......... .......... .......... .......... 94% 304M 0s 2024-09-14T11:38:01.382 INFO:teuthology.orchestra.run.smithi028.stderr: 87500K .......... .......... .......... .......... .......... 94% 266M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87550K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87600K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87650K .......... .......... .......... .......... .......... 94% 319M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87700K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87750K .......... .......... .......... .......... .......... 94% 327M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87800K .......... .......... .......... .......... .......... 94% 273M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87850K .......... .......... .......... .......... .......... 94% 291M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87900K .......... .......... .......... .......... .......... 94% 260M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 87950K .......... .......... .......... .......... .......... 94% 149M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88000K .......... .......... .......... .......... .......... 94% 308M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88050K .......... .......... .......... .......... .......... 94% 293M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88100K .......... .......... .......... .......... .......... 94% 348M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88150K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88200K .......... .......... .......... .......... .......... 94% 332M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88250K .......... .......... .......... .......... .......... 95% 280M 0s 2024-09-14T11:38:01.383 INFO:teuthology.orchestra.run.smithi028.stderr: 88300K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88350K .......... .......... .......... .......... .......... 95% 317M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88400K .......... .......... .......... .......... .......... 95% 242M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88450K .......... .......... .......... .......... .......... 95% 338M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88500K .......... .......... .......... .......... .......... 95% 208M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88550K .......... .......... .......... .......... .......... 95% 314M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88600K .......... .......... .......... .......... .......... 95% 333M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88650K .......... .......... .......... .......... .......... 95% 299M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88700K .......... .......... .......... .......... .......... 95% 298M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88750K .......... .......... .......... .......... .......... 95% 262M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88800K .......... .......... .......... .......... .......... 95% 331M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88850K .......... .......... .......... .......... .......... 95% 329M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88900K .......... .......... .......... .......... .......... 95% 323M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 88950K .......... .......... .......... .......... .......... 95% 247M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 89000K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-14T11:38:01.384 INFO:teuthology.orchestra.run.smithi028.stderr: 89050K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89100K .......... .......... .......... .......... .......... 95% 172M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89150K .......... .......... .......... .......... .......... 96% 308M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89200K .......... .......... .......... .......... .......... 96% 273M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89250K .......... .......... .......... .......... .......... 96% 314M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89300K .......... .......... .......... .......... .......... 96% 84.8M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89350K .......... .......... .......... .......... .......... 96% 245M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89400K .......... .......... .......... .......... .......... 96% 231M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89450K .......... .......... .......... .......... .......... 96% 326M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89500K .......... .......... .......... .......... .......... 96% 325M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89550K .......... .......... .......... .......... .......... 96% 332M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89600K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89650K .......... .......... .......... .......... .......... 96% 268M 0s 2024-09-14T11:38:01.385 INFO:teuthology.orchestra.run.smithi028.stderr: 89700K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 89750K .......... .......... .......... .......... .......... 96% 302M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 89800K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 89850K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 89900K .......... .......... .......... .......... .......... 96% 348M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 89950K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90000K .......... .......... .......... .......... .......... 96% 145M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90050K .......... .......... .......... .......... .......... 96% 51.6M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90100K .......... .......... .......... .......... .......... 97% 305M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90150K .......... .......... .......... .......... .......... 97% 289M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90200K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90250K .......... .......... .......... .......... .......... 97% 280M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90300K .......... .......... .......... .......... .......... 97% 328M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90350K .......... .......... .......... .......... .......... 97% 197M 0s 2024-09-14T11:38:01.386 INFO:teuthology.orchestra.run.smithi028.stderr: 90400K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90450K .......... .......... .......... .......... .......... 97% 274M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90500K .......... .......... .......... .......... .......... 97% 247M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90550K .......... .......... .......... .......... .......... 97% 310M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90600K .......... .......... .......... .......... .......... 97% 133M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90650K .......... .......... .......... .......... .......... 97% 304M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90700K .......... .......... .......... .......... .......... 97% 221M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90750K .......... .......... .......... .......... .......... 97% 293M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90800K .......... .......... .......... .......... .......... 97% 270M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90850K .......... .......... .......... .......... .......... 97% 319M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90900K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 90950K .......... .......... .......... .......... .......... 97% 226M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 91000K .......... .......... .......... .......... .......... 98% 271M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 91050K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 91100K .......... .......... .......... .......... .......... 98% 267M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 91150K .......... .......... .......... .......... .......... 98% 299M 0s 2024-09-14T11:38:01.387 INFO:teuthology.orchestra.run.smithi028.stderr: 91200K .......... .......... .......... .......... .......... 98% 327M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91250K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91300K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91350K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91400K .......... .......... .......... .......... .......... 98% 323M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91450K .......... .......... .......... .......... .......... 98% 301M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91500K .......... .......... .......... .......... .......... 98% 335M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91550K .......... .......... .......... .......... .......... 98% 293M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91600K .......... .......... .......... .......... .......... 98% 347M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91650K .......... .......... .......... .......... .......... 98% 264M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91700K .......... .......... .......... .......... .......... 98% 310M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91750K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91800K .......... .......... .......... .......... .......... 98% 219M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91850K .......... .......... .......... .......... .......... 98% 239M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91900K .......... .......... .......... .......... .......... 98% 216M 0s 2024-09-14T11:38:01.388 INFO:teuthology.orchestra.run.smithi028.stderr: 91950K .......... .......... .......... .......... .......... 99% 283M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92000K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92050K .......... .......... .......... .......... .......... 99% 272M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92100K .......... .......... .......... .......... .......... 99% 315M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92150K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92200K .......... .......... .......... .......... .......... 99% 290M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92250K .......... .......... .......... .......... .......... 99% 267M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92300K .......... .......... .......... .......... .......... 99% 94.4M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92350K .......... .......... .......... .......... .......... 99% 205M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92400K .......... .......... .......... .......... .......... 99% 260M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92450K .......... .......... .......... .......... .......... 99% 197M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92500K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92550K .......... .......... .......... .......... .......... 99% 282M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92600K .......... .......... .......... .......... .......... 99% 318M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92650K .......... .......... .......... .......... .......... 99% 307M 0s 2024-09-14T11:38:01.389 INFO:teuthology.orchestra.run.smithi028.stderr: 92700K .......... .......... .......... .......... .......... 99% 282M 0s 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr: 92750K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr: 92800K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr: 92850K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr: 92900K 100% 134G=0.4s 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14 11:38:00 (208 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:38:01.390 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:38:01.431 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:38:01.432 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:38:01.433 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:38:01.434 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:38:01.435 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:38:01.436 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:38:01.437 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:38:01.438 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:38:01.439 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:38:01.440 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:38:01.441 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:38:01.442 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:38:01.443 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:38:01.444 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:38:01.445 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:38:01.446 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout:Here are the highlights of this release: 2024-09-14T11:38:01.447 INFO:teuthology.orchestra.run.smithi028.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Advanced control of transitive versions 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Support for optional features and dependencies 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Rules to tweak published metadata 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Support for Java 13 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - New Zinc compiler for Scala 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - VS2019 support 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout:------------------------------------------------------------ 2024-09-14T11:38:01.448 INFO:teuthology.orchestra.run.smithi028.stdout:Gradle 6.0.1 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:------------------------------------------------------------ 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:Kotlin: 1.3.50 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:Groovy: 2.5.8 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:38:01.449 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.450 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:38:01.450 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:38:01.450 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T11:38:01.450 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:38:01.450 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T11:38:01.450 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:38:01.713 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:38:01.713 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:38:01.713 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ZWVUZWTGMECHREEUDEMG', 'access_secret': 'VYmKLbXHT2h6/vklUHw6NnPdkww3/8+ZBn+R87H7mevx4ZVrWS5NUg==', 'region': 'mexico', 'endpoint': 'smithi028.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi028.front.sepia.ceph.com'} 2024-09-14T11:38:01.714 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:38:01.714 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ZWVUZWTGMECHREEUDEMG', '--secret', 'VYmKLbXHT2h6/vklUHw6NnPdkww3/8+ZBn+R87H7mevx4ZVrWS5NUg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:38:01.714 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ZWVUZWTGMECHREEUDEMG --secret VYmKLbXHT2h6/vklUHw6NnPdkww3/8+ZBn+R87H7mevx4ZVrWS5NUg== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:38:01.780 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:01.780 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:01.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.818+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 realm 2024-09-14T11:38:01.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.820+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.821+0000 7f0337732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.821+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.822+0000 7f0337732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:01.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.822+0000 7f0337732800 20 searching for the correct realm 2024-09-14T11:38:01.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.824+0000 7f03333bc640 0 -- 172.21.15.28:0/3413868368 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f032c069040 msgr2=0x7f032c05a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:01.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.828+0000 7f0333bbd640 0 -- 172.21.15.28:0/3413868368 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f031c07f020 msgr2=0x7f031c095400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:01.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:38:01.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:01.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:01.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:38:01.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:01.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.833+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 zone default found 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 4 Realm: () 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 zonegroup default 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.834+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.835+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.835+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.835+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.835+0000 7f0337732800 20 started sync module instance, tier type = 2024-09-14T11:38:01.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.835+0000 7f0337732800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=0 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=1 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=2 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=3 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=4 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=5 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.846+0000 7f0337732800 20 add_watcher() i=6 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.847+0000 7f0337732800 20 add_watcher() i=7 2024-09-14T11:38:01.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.847+0000 7f0337732800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.848+0000 7f01e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.848+0000 7f0337732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.848+0000 7f0337732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.848+0000 7f0337732800 5 note: GC not initialized 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.848+0000 7f01e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 init_complete bucket index max shards: 1 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 Filter name: none 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f01627fc640 20 reqs_thread_entry: start 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:38:01.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 10 cache get: name=default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG : miss 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.849+0000 7f0337732800 20 rados->read ofs=0 len=0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.850+0000 7f0337732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.850+0000 7f0337732800 10 cache put: name=default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG info.flags=0x0 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.850+0000 7f0337732800 10 adding default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG to cache LRU end 2024-09-14T11:38:01.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.850+0000 7f0337732800 10 cache get: name=default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG : hit (negative entry) 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.850+0000 7f0337732800 10 cache get: name=default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG : hit (negative entry) 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.851+0000 7f0337732800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.851+0000 7f0337732800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.851+0000 7f0337732800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.851+0000 7f0216ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431636 cookie 93961694352512 notifier 8694 bl.length()=670 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.851+0000 7f0216ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:38:01.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.851+0000 7f0216ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:38:01.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.854+0000 7f0337732800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:38:01.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.854+0000 7f0337732800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:38:01.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.854+0000 7f0337732800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:38:01.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.854+0000 7f0216ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 93961694348528 notifier 8694 bl.length()=200 2024-09-14T11:38:01.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.854+0000 7f0216ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:38:01.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.854+0000 7f0216ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:38:01.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.857+0000 7f0337732800 10 cache put: name=default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG info.flags=0x7 2024-09-14T11:38:01.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.857+0000 7f0337732800 10 moving default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG to cache LRU end 2024-09-14T11:38:01.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.857+0000 7f0337732800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ZWVUZWTGMECHREEUDEMG, ofs0, ns] 2024-09-14T11:38:01.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.857+0000 7f0216ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 93961694352512 notifier 8694 bl.length()=189 2024-09-14T11:38:01.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.857+0000 7f0216ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG info.flags=0x7 2024-09-14T11:38:01.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.857+0000 7f0216ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZWVUZWTGMECHREEUDEMG to cache LRU end 2024-09-14T11:38:01.856 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:38:01.856 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "tester.client.0", 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "tester.client.0", 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "ZWVUZWTGMECHREEUDEMG", 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "VYmKLbXHT2h6/vklUHw6NnPdkww3/8+ZBn+R87H7mevx4ZVrWS5NUg==", 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:38:01.850965Z" 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:38:01.857 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:38:01.858 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "rgw", 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "", 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:38:01.859 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:38:01.850954Z", 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.859+0000 7f01e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.862+0000 7f0337732800 20 remove_watcher() i=0 2024-09-14T11:38:01.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.862+0000 7f0337732800 2 removed watcher, disabling cache 2024-09-14T11:38:01.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.863+0000 7f0337732800 20 remove_watcher() i=1 2024-09-14T11:38:01.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.864+0000 7f0337732800 20 remove_watcher() i=2 2024-09-14T11:38:01.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.867+0000 7f0337732800 20 remove_watcher() i=3 2024-09-14T11:38:01.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.868+0000 7f0337732800 20 remove_watcher() i=4 2024-09-14T11:38:01.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.869+0000 7f0337732800 20 remove_watcher() i=5 2024-09-14T11:38:01.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.870+0000 7f0337732800 20 remove_watcher() i=6 2024-09-14T11:38:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:01.871+0000 7f0337732800 20 remove_watcher() i=7 2024-09-14T11:38:01.881 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:38:01.881 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:38:01.913 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:38:01.913 DEBUG:teuthology.orchestra.run.smithi028:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:38:01.980 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:38:02.074 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:02.074 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:02.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.118+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.119+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.119+0000 7fbf0932c800 20 realm 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.119+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.120+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.120+0000 7fbf0932c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.120+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.120+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.120+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.121+0000 7fbf0932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:02.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.121+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.121+0000 7fbf0932c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:02.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.121+0000 7fbf0932c800 20 searching for the correct realm 2024-09-14T11:38:02.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.123+0000 7fbf0504f640 0 -- 172.21.15.28:0/4257147482 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fbf00083350 msgr2=0x7fbf000735a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:02.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.127+0000 7fbf05850640 0 -- 172.21.15.28:0/4257147482 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fbefc083060 msgr2=0x7fbefc0aae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.133+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 zone default found 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 4 Realm: () 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 zonegroup default 2024-09-14T11:38:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.134+0000 7fbf0932c800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.135+0000 7fbf0932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.135+0000 7fbf0932c800 20 started sync module instance, tier type = 2024-09-14T11:38:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.135+0000 7fbf0932c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:38:02.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.144+0000 7fbf0932c800 20 add_watcher() i=0 2024-09-14T11:38:02.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.144+0000 7fbf0932c800 20 add_watcher() i=1 2024-09-14T11:38:02.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.144+0000 7fbf0932c800 20 add_watcher() i=2 2024-09-14T11:38:02.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.144+0000 7fbf0932c800 20 add_watcher() i=3 2024-09-14T11:38:02.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.144+0000 7fbf0932c800 20 add_watcher() i=4 2024-09-14T11:38:02.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.144+0000 7fbf0932c800 20 add_watcher() i=5 2024-09-14T11:38:02.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.145+0000 7fbf0932c800 20 add_watcher() i=6 2024-09-14T11:38:02.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.145+0000 7fbf0932c800 20 add_watcher() i=7 2024-09-14T11:38:02.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.145+0000 7fbf0932c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:02.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.147+0000 7fbdbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:02.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.147+0000 7fbf0932c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:02.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.147+0000 7fbf0932c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:02.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.184+0000 7fbdbafe5640 20 reqs_thread_entry: start 2024-09-14T11:38:02.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.184+0000 7fbf0932c800 20 init_complete bucket index max shards: 1 2024-09-14T11:38:02.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.184+0000 7fbf0932c800 20 Filter name: none 2024-09-14T11:38:02.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.184+0000 7fbdb8fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:02.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.184+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:38:02.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:38:02.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12615630125417983705', time=2024-09-14T13:28:59.670053+0000, chain.objs.size()=4 2024-09-14T11:38:02.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.1 2024-09-14T11:38:02.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.2 2024-09-14T11:38:02.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.186+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.3 2024-09-14T11:38:02.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10__multipart_foo.2~CWhfiH21CSGtfykXLow-BjoltbLTAWc.4 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7593415417622269435', time=2024-09-14T13:28:59.732703+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.jB9AMLxfvKhKMfPiRuBs2GMTIECQEhn_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5081604367554688969', time=2024-09-14T13:30:16.374651+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.yHW6gwKC-0W4sO-vtDA81dVP6DDXxCh_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15291297328384925076', time=2024-09-14T13:30:52.257301+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.X8bJS2VV7XDIrKsoHnqqdzZMbhp1d_Q_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2513702899181787076', time=2024-09-14T13:30:54.762975+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.8aOY_W44xtcV6XkHsgZOO4jCplpHkEg_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9062239936740353845', time=2024-09-14T13:30:56.966136+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.Ji8NsMVGdK2rmmdm7AY0GQnzesurbbt_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14330800322846051554', time=2024-09-14T13:31:30.058161+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.mFwc0xvL0ZZTnIt90BVNaip6o6rmdJb_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16794430026977177534', time=2024-09-14T13:31:32.907797+0000, chain.objs.size()=1 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.3zmdvcB1I_-wi1fSuQ8yGNJ4QLq4qh1_0 2024-09-14T11:38:02.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9519907437885118670', time=2024-09-14T13:31:35.675812+0000, chain.objs.size()=1 2024-09-14T11:38:02.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.187+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.yQoTD2rI_aZr6h_KktaHC47DPik1SeQ_0 2024-09-14T11:38:02.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17288732605942070762', time=2024-09-14T13:32:08.726515+0000, chain.objs.size()=1 2024-09-14T11:38:02.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.0h5XXCL0W-xOkuYH3br6ek73q8rS_PK_0 2024-09-14T11:38:02.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16005698019071433420', time=2024-09-14T13:32:51.245251+0000, chain.objs.size()=1 2024-09-14T11:38:02.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.fbJXCL658HduKYXLvmO3qBG71hJ6NW3_0 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8748107867604677428', time=2024-09-14T13:33:23.869535+0000, chain.objs.size()=1 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.bMwfd3HeXsq8_2x5xdBkB_nhIpQFZ7I_0 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.857130588833124674', time=2024-09-14T13:33:27.030330+0000, chain.objs.size()=1 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.YBIJwuxZ3gBtcZlxYuMEi-soJgQPflR_0 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13378774332562099646', time=2024-09-14T13:34:00.342008+0000, chain.objs.size()=1 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.bseU6EKsy7HzgZTXFS-P7zciKtZajpa_0 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17081554322954091829', time=2024-09-14T13:34:03.301903+0000, chain.objs.size()=1 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.VbG1g_ZsD2mwBJqGATHrKATH9cVcu0B_0 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10310942564864323877', time=2024-09-14T13:35:14.369907+0000, chain.objs.size()=1 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.Xv-VJ0aa7-VLNBl4DQZLbMBBvD3R65I_0 2024-09-14T11:38:02.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1133838650759686400', time=2024-09-14T13:37:20.859927+0000, chain.objs.size()=1 2024-09-14T11:38:02.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.191+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.juyC-oGC6lo8QZ4t6tC41tg1_zIUw-F_0 2024-09-14T11:38:02.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.196+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.199+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:38:02.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.200+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.200+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9249874322767009814', time=2024-09-14T13:28:59.741133+0000, chain.objs.size()=1 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.WUR5J-0PAoYkukXSLmSQeOwfK0s6Lm1_0 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15911631428240488331', time=2024-09-14T13:28:59.753250+0000, chain.objs.size()=1 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.WUR5J-0PAoYkukXSLmSQeOwfK0s6Lm1_0 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16548798276602859358', time=2024-09-14T13:30:18.365436+0000, chain.objs.size()=1 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.XgR8-9M9gobd9BTKVJevJuF30OcUJhl_0 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18404458247882320327', time=2024-09-14T13:30:56.932062+0000, chain.objs.size()=1 2024-09-14T11:38:02.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.gZzLU144xWX60UW_n3d-fnsT8h7K1t7_0 2024-09-14T11:38:02.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11964746418561315104', time=2024-09-14T13:31:32.947489+0000, chain.objs.size()=1 2024-09-14T11:38:02.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.USSxurzcrY8Y6L78k2fiv0clFF6So5s_0 2024-09-14T11:38:02.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13534133313650987783', time=2024-09-14T13:31:32.948026+0000, chain.objs.size()=1 2024-09-14T11:38:02.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.3SR_DT54919H9dsT_bB7q_mPovmhSdU_0 2024-09-14T11:38:02.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14785798953377652172', time=2024-09-14T13:31:35.645556+0000, chain.objs.size()=1 2024-09-14T11:38:02.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.201+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.tv4GQT2rN5i77dBDha9sjYPcRPZ9hZi_0 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13453620390607416345', time=2024-09-14T13:31:35.646163+0000, chain.objs.size()=1 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.TFwvh560LWjz2sBsZ8NdV0fL5hRe0Rp_0 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3891230302035795488', time=2024-09-14T13:32:08.722929+0000, chain.objs.size()=1 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.YUSkClHt-Dofe6bfBdJMdQRRDQ2xOqA_0 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8178591690186903845', time=2024-09-14T13:32:45.749219+0000, chain.objs.size()=1 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.8fYau7_WNruLBET9n_aheLsN_zRicSt_0 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7338081971023358992', time=2024-09-14T13:33:23.848836+0000, chain.objs.size()=1 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.z6Kx9AvdIXBoYB-8y0Wq9TXiJ3_4RXm_0 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15215180377423921688', time=2024-09-14T13:34:00.346031+0000, chain.objs.size()=1 2024-09-14T11:38:02.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.202+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.9FAP74dL_6bFRRMeBPleFtvqwofXuuE_0 2024-09-14T11:38:02.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.205+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17810032740258570738', time=2024-09-14T13:34:00.347357+0000, chain.objs.size()=1 2024-09-14T11:38:02.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.205+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.CPj8JBH4u5n6Yaa4WwHyps9nUPaFcXW_0 2024-09-14T11:38:02.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.205+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1398738653527182273', time=2024-09-14T13:34:37.581870+0000, chain.objs.size()=1 2024-09-14T11:38:02.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.205+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.6v0sB0DNpCPLzEDy_Jq780wqujzsYB3_0 2024-09-14T11:38:02.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.205+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9534877983521473497', time=2024-09-14T13:35:14.336060+0000, chain.objs.size()=1 2024-09-14T11:38:02.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.205+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.q72-9MCQZM2Ti0XEsM79d3fDvjWOWHa_0 2024-09-14T11:38:02.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.209+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.216+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:38:02.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.217+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:38:02.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15247205443938848791', time=2024-09-14T13:28:59.602170+0000, chain.objs.size()=1 2024-09-14T11:38:02.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.qW1ceOXICBkQh5Mj07Cu0Zvn0ZjgLKU_0 2024-09-14T11:38:02.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7971544733294127221', time=2024-09-14T13:30:15.672564+0000, chain.objs.size()=1 2024-09-14T11:38:02.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.uXSfvU6V0vT_5pVmz2JRCcqLZ919Mtq_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1239020744738540336', time=2024-09-14T13:30:16.420393+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.nrBieQZ2pq3Cu-pVa7lI4HPYLwvP1yy_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18044228301242316771', time=2024-09-14T13:30:16.443993+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.hSCBT_j6FtWDTkm4OdUmsxNhIP-8W6c_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14261831163933278000', time=2024-09-14T13:30:52.243437+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.mqgKCmFc-b16oCguohGlzoY_HtM0DP6_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1785549224748327180', time=2024-09-14T13:30:54.764233+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.2GLgYPcyQgtA_TC3t4u5rngWhzV0Bo__0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10598051862698074420', time=2024-09-14T13:30:56.934642+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.DghcyMd1sHblTjcvKlfZyvWhnmjNSfs_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4473017666412845257', time=2024-09-14T13:31:30.089752+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.7ykYtCBQp1Fx3OuA5rdJvy2KRgr1YJ0_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15107005507486078009', time=2024-09-14T13:31:35.605868+0000, chain.objs.size()=1 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.dM0BodFGPGOP2AP46tzPXW1wT77lNQT_0 2024-09-14T11:38:02.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10288614936080607548', time=2024-09-14T13:32:08.686027+0000, chain.objs.size()=1 2024-09-14T11:38:02.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.hVgngQrBt8JSum8r3gfqiJI24ufR8qA_0 2024-09-14T11:38:02.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9833220731670529812', time=2024-09-14T13:32:08.765876+0000, chain.objs.size()=1 2024-09-14T11:38:02.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.usZfSHIYAeBHHGcqMBSZ414VLybN2XM_0 2024-09-14T11:38:02.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5369717666947793749', time=2024-09-14T13:32:45.786191+0000, chain.objs.size()=1 2024-09-14T11:38:02.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.218+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.J0JVkDh4j4iSKzSD7j9Vj-iOkKyi9LI_0 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.221+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13798547075070880878', time=2024-09-14T13:32:49.333033+0000, chain.objs.size()=1 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.221+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.La3QuCKHZFzc6xEMi0Cw4PMF5K1QCuF_0 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.221+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9897396029616786670', time=2024-09-14T13:32:49.344959+0000, chain.objs.size()=1 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.221+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.GsRzuyZ-f5wOwnllEYHTn_pEgmHQm9L_0 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.222+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14332424696483802496', time=2024-09-14T13:33:23.949478+0000, chain.objs.size()=1 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.222+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.HehsUlqjwZAkucLZ8q8jlQKyx47dYbr_0 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.222+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11704242993471515027', time=2024-09-14T13:34:02.154587+0000, chain.objs.size()=1 2024-09-14T11:38:02.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.222+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.ob4ZZLZv6yij5v93BFOZy40XlQWLdTj_0 2024-09-14T11:38:02.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.223+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14833062698140511582', time=2024-09-14T13:37:20.865336+0000, chain.objs.size()=1 2024-09-14T11:38:02.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.223+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_._UsxJc_So02ZMFeH5Ei0oOuligar26E_0 2024-09-14T11:38:02.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.225+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.228+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:38:02.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.229+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.229+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6427946067330895270', time=2024-09-14T13:28:59.802477+0000, chain.objs.size()=3 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.1 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.2 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.3 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2418940898311599750', time=2024-09-14T13:28:59.859645+0000, chain.objs.size()=2 2024-09-14T11:38:02.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.0HAgipF-Cr5J8q3ZN_pnHe9UETc3L9c_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.0HAgipF-Cr5J8q3ZN_pnHe9UETc3L9c_1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17791078375121622139', time=2024-09-14T13:28:59.908951+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.00xarYAdMbWbodsn3vptITWsHYGhkcF_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2799308993943346749', time=2024-09-14T13:30:16.379785+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.pHM-uSD48cMfAs6lh20wNdNZCiK44SS_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11115360573214876551', time=2024-09-14T13:30:56.911484+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.ZPyBcWOYmocgkw9VcN94PVfETMb_nQz_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17392586080045594528', time=2024-09-14T13:31:32.969346+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.SlVi-NE62mq8_aledXwgWyQs90Gy8SN_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8975937532865196339', time=2024-09-14T13:31:35.610398+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.AxHpS5U4-AD6jC903pZ2IRsfqlcGzGK_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4811990813895100435', time=2024-09-14T13:32:51.241380+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.mbjsVUgu8n23ze7hmEF4QH8std6RBGb_0 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3518090832516812890', time=2024-09-14T13:32:51.241974+0000, chain.objs.size()=1 2024-09-14T11:38:02.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.230+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.XbhRS7HWNVrkF_SbaKSaYiN-0GayQZJ_0 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.233+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6617688669584865345', time=2024-09-14T13:32:51.242874+0000, chain.objs.size()=1 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.233+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.DwbhLlRME0n1mCFpnZTvcwJtzKM9acc_0 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.233+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15417399259372947614', time=2024-09-14T13:32:51.296485+0000, chain.objs.size()=1 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.233+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.LInDaX_jZqPaGQcFayZzmENHUrkuuFd_0 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.234+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8018016613034897899', time=2024-09-14T13:33:23.850663+0000, chain.objs.size()=1 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.234+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.RTxBqRcRwiR2YFVTwiuS2_W-AfgShtd_0 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.234+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9299011183997590703', time=2024-09-14T13:33:23.851473+0000, chain.objs.size()=1 2024-09-14T11:38:02.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.234+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.GLLT7-mWGq6hYq2Pjdl6GXbtEK_CwMw_0 2024-09-14T11:38:02.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.235+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13281930089482560442', time=2024-09-14T13:33:27.013199+0000, chain.objs.size()=1 2024-09-14T11:38:02.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.235+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.fzNbUBGwLIneXww1rGGTI4soiwhJnEJ_0 2024-09-14T11:38:02.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.235+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1978414503116205321', time=2024-09-14T13:33:27.065364+0000, chain.objs.size()=1 2024-09-14T11:38:02.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.235+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.nip3ERbzzfbl47DEo3URJAVHma-0A_h_0 2024-09-14T11:38:02.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.236+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7136757441408040770', time=2024-09-14T13:34:03.329208+0000, chain.objs.size()=1 2024-09-14T11:38:02.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.236+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.JzTYm2P7MpIO7Aqhv428vx6f06Itl8i_0 2024-09-14T11:38:02.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.236+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16689103406217819892', time=2024-09-14T13:34:43.424288+0000, chain.objs.size()=1 2024-09-14T11:38:02.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.236+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.zMkTzBwJbAtd4sm0JnhlUaIKG4oC3jL_0 2024-09-14T11:38:02.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.238+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.241+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:38:02.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.242+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.833054342772949088', time=2024-09-14T13:30:18.343377+0000, chain.objs.size()=1 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.QYyis3-2aZQpnUTmaYizurXq2QhdiK8_0 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3805896057937414843', time=2024-09-14T13:30:56.941185+0000, chain.objs.size()=1 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.XHGDH2XcfPzCzbFm3pJamCL5EJmFkGb_0 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11101734678544750345', time=2024-09-14T13:31:30.058123+0000, chain.objs.size()=1 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.1ycKAzYnyGj5kPuntosHt5CMzS0H3cH_0 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3563428965163343624', time=2024-09-14T13:31:30.086453+0000, chain.objs.size()=1 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.4k84OQYFCVny2sOodr5vo4FXAaSariH_0 2024-09-14T11:38:02.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3786310514499773237', time=2024-09-14T13:31:32.233626+0000, chain.objs.size()=1 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.OEPH0VHicrxHNE4wfr8AgyPrpgqgLMB_0 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6517773249599798274', time=2024-09-14T13:31:32.950319+0000, chain.objs.size()=1 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.x6ZVyJotOiMftrXrOUCej2wYP1byedH_0 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13782106211036805582', time=2024-09-14T13:31:35.632965+0000, chain.objs.size()=1 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.gJaPNSsQx0uPfXO7MpiKAU8MupdT7EL_0 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10973174181662959503', time=2024-09-14T13:32:49.279724+0000, chain.objs.size()=1 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.MuCUVPssr3L0rSwPw0r5R0_WAhjBBTq_0 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.679775022597868323', time=2024-09-14T13:32:49.281255+0000, chain.objs.size()=1 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.1r5R8yKj9X17jGakrBlpa1TacWqc5aU_0 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1886513228402152768', time=2024-09-14T13:32:49.316156+0000, chain.objs.size()=1 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.QksjzCMzxWo__kiDqsb2UTUWKIDty5x_0 2024-09-14T11:38:02.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11149162881039800948', time=2024-09-14T13:32:49.317517+0000, chain.objs.size()=1 2024-09-14T11:38:02.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.jQXUvGMs_GCnHYkVdS5QhPGZRfU0ZoP_0 2024-09-14T11:38:02.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4143779563689733790', time=2024-09-14T13:32:49.318936+0000, chain.objs.size()=1 2024-09-14T11:38:02.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.243+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.dH5WxrNSbrlJZSS7gQCS0PjJaeNubeK_0 2024-09-14T11:38:02.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16754375711820549964', time=2024-09-14T13:32:51.250885+0000, chain.objs.size()=1 2024-09-14T11:38:02.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.gqmDLI4pVv28aZXRqtBM5CnT2X8a8gN_0 2024-09-14T11:38:02.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5166080788302067440', time=2024-09-14T13:33:23.947762+0000, chain.objs.size()=1 2024-09-14T11:38:02.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.2ButhJkNzP-zh9_bepeOLiYxMCIUi7-_0 2024-09-14T11:38:02.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11721276911230741221', time=2024-09-14T13:33:27.079486+0000, chain.objs.size()=1 2024-09-14T11:38:02.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.kFvvI3rjt-Uf5455oQZMQVmpJyty3jq_0 2024-09-14T11:38:02.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13547056129557754089', time=2024-09-14T13:34:37.579069+0000, chain.objs.size()=1 2024-09-14T11:38:02.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.248+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.Qmzs-j_8XywRZjXl4XOzbNvTmjxxgTv_0 2024-09-14T11:38:02.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.250+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.253+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:38:02.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.254+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.254+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.410272632151745687', time=2024-09-14T13:28:59.578989+0000, chain.objs.size()=1 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.qBK5FqkUJrrw1hxmMHLt3Pa65zXkOd2_0 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9917622254044609002', time=2024-09-14T13:28:59.707068+0000, chain.objs.size()=1 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.p78kpdV52aYPpLZj2oybwt3xkkuGgRI_0 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2552178503002795843', time=2024-09-14T13:28:59.774131+0000, chain.objs.size()=3 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.1 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.2 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.3 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11078692438920241506', time=2024-09-14T13:28:59.794423+0000, chain.objs.size()=3 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.1 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.2 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.3 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16563361555220770482', time=2024-09-14T13:30:16.389417+0000, chain.objs.size()=1 2024-09-14T11:38:02.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.pjogHEUSdSwlqkwIJU7-WDuMq_rA9_n_0 2024-09-14T11:38:02.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9033325397929272187', time=2024-09-14T13:30:18.368736+0000, chain.objs.size()=1 2024-09-14T11:38:02.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.NokEEOQlpK_qiFPfdIOl08X700M_D7Q_0 2024-09-14T11:38:02.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7305173392757010929', time=2024-09-14T13:30:57.006415+0000, chain.objs.size()=1 2024-09-14T11:38:02.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.Py6IJO90tekx0BQjpiO4aYzPoVNFZDZ_0 2024-09-14T11:38:02.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6506425861500458134', time=2024-09-14T13:31:30.004223+0000, chain.objs.size()=1 2024-09-14T11:38:02.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.255+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.vt0jEnvB2FotRDyscIA2-CNn_PcTdDt_0 2024-09-14T11:38:02.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8697385721539607909', time=2024-09-14T13:31:30.057939+0000, chain.objs.size()=1 2024-09-14T11:38:02.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.1Jdzz6ulK6fsJiJ74KtoRzWEsf3-ISq_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6025044766992033546', time=2024-09-14T13:31:32.944901+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.MKeTtXcyK4nmeEx9m559PgUZVRDSu6G_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16385315084402222288', time=2024-09-14T13:31:35.585290+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.h75HXjFI6aEryTcc-iEQb6e-hrHoCjP_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12138808859424225132', time=2024-09-14T13:31:35.616080+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.QWi-chZq9ZT9R5_-3jtwyT5tJTvVx7Q_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10962059185325140758', time=2024-09-14T13:32:08.694956+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.dJ_ot-r1Zys2yabE5-Az2w1mFldlZ1z_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9009169836087348693', time=2024-09-14T13:32:12.055160+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.16fCVoZBE3LFr9EMHJGI1Hy9A_IDN4J_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.181782586879390681', time=2024-09-14T13:32:12.055892+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.vHGusrJWPm4Nhho8sZdmhcxjnXuB5jk_0 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6419985850091256488', time=2024-09-14T13:32:45.783045+0000, chain.objs.size()=1 2024-09-14T11:38:02.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.nhn4vZKymaSMVpRsGZEKT6viCRcvFEK_0 2024-09-14T11:38:02.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6554478318754724466', time=2024-09-14T13:32:49.283225+0000, chain.objs.size()=1 2024-09-14T11:38:02.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.CIp29a48dP2SdT_HMMCtVTGF4k8Ln2o_0 2024-09-14T11:38:02.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13076374335429443324', time=2024-09-14T13:33:26.998714+0000, chain.objs.size()=1 2024-09-14T11:38:02.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.nJ-JIO-RYeZHmV5hdRnTAZppZddKRXJ_0 2024-09-14T11:38:02.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14198385923798572081', time=2024-09-14T13:34:39.579136+0000, chain.objs.size()=1 2024-09-14T11:38:02.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.258+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.lPc-m5wV5cDU79dGQuJIEOl7POo6EvJ_0 2024-09-14T11:38:02.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16296048084069002499', time=2024-09-14T13:34:40.249810+0000, chain.objs.size()=1 2024-09-14T11:38:02.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.CRSkOWeGhEldMLfaPkora69nOy1MBy9_0 2024-09-14T11:38:02.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4834083439556744521', time=2024-09-14T13:34:40.286140+0000, chain.objs.size()=1 2024-09-14T11:38:02.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.nk5wg7fIZcA22qyFQ5tSFTcSAQDzrcm_0 2024-09-14T11:38:02.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16447806336115623887', time=2024-09-14T13:34:40.287560+0000, chain.objs.size()=1 2024-09-14T11:38:02.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.9VICCp1lJRLPlKRl1cHV8_z2fDXdqUf_0 2024-09-14T11:38:02.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16532989930909726129', time=2024-09-14T13:34:40.288447+0000, chain.objs.size()=1 2024-09-14T11:38:02.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.263+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.wydzltWkOeobck57R6vyw7aRZJiu_VK_0 2024-09-14T11:38:02.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.265+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.268+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:38:02.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.270+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.270+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:38:02.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12234275143805509685', time=2024-09-14T13:30:52.262038+0000, chain.objs.size()=1 2024-09-14T11:38:02.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.82SBsX2rMGeDB5tM8ayZuq6zMqoulb9_0 2024-09-14T11:38:02.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13270554238412199434', time=2024-09-14T13:30:54.765273+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.vyJD1AVKawrtAO9iYYBatgfRGOf5ZK2_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1566124594938811912', time=2024-09-14T13:31:32.911576+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.BsZVLa7VvvxJOGOgkTHP6B92AuO_idL_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12806468891360765771', time=2024-09-14T13:32:12.055148+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.MIptTBQcZs-9Xmb5Rrw8DtIs21B4WVK_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7851723040678762994', time=2024-09-14T13:32:12.112704+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.wqLw1yORtxptogYbx7xvs7eYmziyhEr_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7701834327364108387', time=2024-09-14T13:32:49.247260+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.vplpxhRZP79rroUksx_6spOmM-wMtRV_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15457675815056472054', time=2024-09-14T13:32:51.251281+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.zDZV5umJyi1Pg-zuIriuofinf7Iy2s8_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12032612621241377440', time=2024-09-14T13:33:23.353133+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.1N8zOTQ4qWkbnqUPJ0E4Z-AcZj2VLQY_0 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17044559695575568576', time=2024-09-14T13:34:41.779538+0000, chain.objs.size()=1 2024-09-14T11:38:02.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.dzwDZ_0JsTRN6L2C2TEDp5xiOFz7odD_0 2024-09-14T11:38:02.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15613287464606175618', time=2024-09-14T13:35:14.358979+0000, chain.objs.size()=1 2024-09-14T11:38:02.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.FYUelICkXIsbqJw2d4cPWbO9xcdUxGG_0 2024-09-14T11:38:02.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15846812481458424701', time=2024-09-14T13:37:33.774354+0000, chain.objs.size()=1 2024-09-14T11:38:02.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.271+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:hpwInUqHrrWiVz2LliJHIKL51pPe9gA_.OxYzGiuqf-0CPB8oSSbsSElQZbaKMML_0 2024-09-14T11:38:02.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.274+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.277+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:38:02.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.278+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15064651361079182889', time=2024-09-14T13:28:59.831300+0000, chain.objs.size()=3 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-FROZEN.2~S2nWRp-YWOGhDLcEohcEebBpnjNTPrg.1 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-FROZEN.2~S2nWRp-YWOGhDLcEohcEebBpnjNTPrg.2 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-FROZEN.2~S2nWRp-YWOGhDLcEohcEebBpnjNTPrg.3 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6807038064505874314', time=2024-09-14T13:30:18.340742+0000, chain.objs.size()=1 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.NlVjeQxGd9gkTlVMLOFjOL_Jl8rGRSH_0 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2696960462387380783', time=2024-09-14T13:30:52.297607+0000, chain.objs.size()=1 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.wUU54su0LCZ6WjOPpulSVhAmSKggrpF_0 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5664628608440233101', time=2024-09-14T13:30:57.014211+0000, chain.objs.size()=1 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.Lzkd2JsKAewjljfI_XHfdNF4Ld5ppuP_0 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11472007192008800823', time=2024-09-14T13:31:35.605828+0000, chain.objs.size()=1 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.5NPLo0xX1HuXzg2TulckEhEMWlKBowu_0 2024-09-14T11:38:02.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13253706493909761975', time=2024-09-14T13:32:08.764431+0000, chain.objs.size()=1 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.qnZHcbQunakdlGCV_qB9bP9qNdrjLXf_0 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12344147159728955117', time=2024-09-14T13:32:45.728545+0000, chain.objs.size()=1 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.sR67MM6eDRVJ_-qpOzQZtG4rQOeeQC6_0 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2735125112437779250', time=2024-09-14T13:34:37.554427+0000, chain.objs.size()=1 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.OJ8EaMLZhshZQqdR_WTUsrqVuRp9tr6_0 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9784560338512990098', time=2024-09-14T13:34:40.283118+0000, chain.objs.size()=1 2024-09-14T11:38:02.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.279+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.5bhRv8EfZZLnscF-07-9214N-i52ol-_0 2024-09-14T11:38:02.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.284+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.287+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:38:02.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.289+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.289+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11839809087806523955', time=2024-09-14T13:28:59.583677+0000, chain.objs.size()=1 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.S1iH5QtAfMWppSTenUJhXW1M5F31KG5_0 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17226315883231890528', time=2024-09-14T13:28:59.588090+0000, chain.objs.size()=1 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.ERdWmrcDDZLZ_lhwOVV8nGQbcGawog9_0 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_Z6Nnhkb-zJp2D-HS18JeFM9Px-W-MJ3', time=2024-09-14T13:28:59.736935+0000, chain.objs.size()=1 2024-09-14T11:38:02.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.d4zO0lnq6-C6XsWDfh6EWJFdsX--YB6_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13193054441041927173', time=2024-09-14T13:30:16.352421+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.AyFfWsByZgNnmYiNz75rKtGfHmoilt0_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6843965747852776198', time=2024-09-14T13:30:54.764146+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.Qfw8-eeuik6sJuCAfaEV7VPnGSiW1lr_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1727519957133901592', time=2024-09-14T13:31:30.004923+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_._ZjIM8IIRPwN2YQLSsKrBfsLTSH4BQt_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12920058428138631163', time=2024-09-14T13:31:32.955928+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.0pHltzaQzVJp2ybvM-F5G3i9hKxixax_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11538362793477594898', time=2024-09-14T13:31:32.992243+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.tWhdgItFg0g-o-xHWtaUSiWjijdbeha_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16437907825769498270', time=2024-09-14T13:31:35.632943+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.3GyhEwUd22q3iP1drij-KJ-to3ZGTB8_0 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13974125795136240094', time=2024-09-14T13:32:08.696250+0000, chain.objs.size()=1 2024-09-14T11:38:02.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.49briU0xpuxIKi_4TH6mWwHK-Fc7GLI_0 2024-09-14T11:38:02.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.606074329624208686', time=2024-09-14T13:32:12.026836+0000, chain.objs.size()=1 2024-09-14T11:38:02.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.45g733D2_3n9RPiFkAH1sLW97XLJP4X_0 2024-09-14T11:38:02.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8552172453868991125', time=2024-09-14T13:32:12.054885+0000, chain.objs.size()=1 2024-09-14T11:38:02.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.290+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.6RRe4hzVP1797AQPlyX5nxF39sLB8X-_0 2024-09-14T11:38:02.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.294+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10023005351918380091', time=2024-09-14T13:34:40.287573+0000, chain.objs.size()=1 2024-09-14T11:38:02.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.294+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.6BYfCOqedYUxGBGWaG8FqEfIeKTSylB_0 2024-09-14T11:38:02.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.294+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17987103803486296390', time=2024-09-14T13:35:14.325121+0000, chain.objs.size()=1 2024-09-14T11:38:02.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.294+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.SVrL9qXVHLfaqWOVxdQWs8LGRqF5GYv_0 2024-09-14T11:38:02.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.297+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.300+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:38:02.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.301+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6882594711123651860', time=2024-09-14T13:30:52.245683+0000, chain.objs.size()=1 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.z7famzKvCarYqyUsd0hg2XLx9uRWkbY_0 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4010671236378324650', time=2024-09-14T13:30:54.810804+0000, chain.objs.size()=1 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.fGSzE7SLoIR0oXp8UNxW6pK2o97V3kB_0 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16774051396589689439', time=2024-09-14T13:30:56.962228+0000, chain.objs.size()=1 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.5SUmyG7Tdh58t7W-GraxSs3miZxQp5l_0 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14382799200880539469', time=2024-09-14T13:31:30.004474+0000, chain.objs.size()=1 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.VGQuiNmYXNaPC9MSsFMG0o_r672OS7Z_0 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1313183152457112232', time=2024-09-14T13:31:37.414843+0000, chain.objs.size()=1 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.unxnBeph4oaP4i_2c12_JD5mFpPg75h_0 2024-09-14T11:38:02.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9618214773023370804', time=2024-09-14T13:32:14.257119+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.9R4mk3wjYMM8reZsjs48-4rdph02AHY_0 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14126571328932889114', time=2024-09-14T13:32:49.271058+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.g2Uth91pU9eyIc2h08PLEhvKfc0KrHi_0 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13259144630782234525', time=2024-09-14T13:32:51.244950+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.6H0f-e0Q3-LHWg8FW2hT6JFIP40pnbQ_0 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.191315680695917465', time=2024-09-14T13:33:26.113512+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.BibMSrrKGFU62g3_td0E1_2KQWGrSYO_0 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.588852746095395728', time=2024-09-14T13:33:27.029904+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.w32MTmKbKYZksvRkcC1GzqO7N1hNKmL_0 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16365779689395175944', time=2024-09-14T13:35:14.336069+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.uXWhxWWuVr2Yi1PydBstDUSwnGCKGy8_0 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3457689925531972338', time=2024-09-14T13:37:20.867001+0000, chain.objs.size()=1 2024-09-14T11:38:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.302+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.Ul4uZ9UZk377wzWJ0EBf2sK0imXDVa3_0 2024-09-14T11:38:02.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.311+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.313+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:38:02.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.314+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17723806025036879217', time=2024-09-14T13:28:59.610523+0000, chain.objs.size()=1 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_._x_qo4xCDMHaUxcdU-UrfeL__C7qpYO_0 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15655933806367240889', time=2024-09-14T13:28:59.934430+0000, chain.objs.size()=1 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.gSm_JCypaFhVp9Ylm8tBg9OHL2s9wx1_0 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17191356072662715101', time=2024-09-14T13:30:18.343274+0000, chain.objs.size()=1 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.mEvF_Yj1gzqFI0vxb-TkZhn9aNUHVKZ_0 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7202571095367498053', time=2024-09-14T13:30:18.416361+0000, chain.objs.size()=1 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.A2Bvht1TTFB6IoUwkmlW5D1V33M_aAw_0 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9128268430940146960', time=2024-09-14T13:30:54.834941+0000, chain.objs.size()=1 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.315+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.Zd-QzQ0c6jYMA8ylH9JkAL0NuxMq_li_0 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6564993112338384276', time=2024-09-14T13:30:56.907902+0000, chain.objs.size()=1 2024-09-14T11:38:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.WKo6DMTtuBKH-eEYCdH9Dn24Rmd9SwG_0 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16607045867703338738', time=2024-09-14T13:31:35.632194+0000, chain.objs.size()=1 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.e62GPLH_DHuPzLeJX2l_-KGUTcBri2e_0 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7314236695079404915', time=2024-09-14T13:32:08.696190+0000, chain.objs.size()=1 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.QQy4B5JPFwV0bNPNidnsh3jQBQzQKnB_0 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.876066476876175661', time=2024-09-14T13:32:45.729226+0000, chain.objs.size()=1 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.ELKWNPa570LyhE2lvbv-oFkx73iP6D2_0 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10351709656896357095', time=2024-09-14T13:33:23.832405+0000, chain.objs.size()=1 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.j62SDRNX2Dcrdh0D9E_l4ddwI905JD1_0 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11758268809136188711', time=2024-09-14T13:33:27.009315+0000, chain.objs.size()=1 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.WyzW_i2dkGWSkF0mqQC8yEdqDeI3eej_0 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15314619582741017844', time=2024-09-14T13:34:40.301791+0000, chain.objs.size()=1 2024-09-14T11:38:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.316+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.c8l6ndDQRrA2W4-9ZL4kHv_glkeXoIw_0 2024-09-14T11:38:02.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7167886068218803047', time=2024-09-14T13:34:41.788068+0000, chain.objs.size()=1 2024-09-14T11:38:02.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.98Jz3ck2EEJ5unoyEeg3rDqAuDkI5V0_0 2024-09-14T11:38:02.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8831024567362959781', time=2024-09-14T13:34:41.837475+0000, chain.objs.size()=1 2024-09-14T11:38:02.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.Y1CtIc9hMsPkry7vc9bTKV1HaAJ-YD9_0 2024-09-14T11:38:02.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2132316570505183809', time=2024-09-14T13:34:41.838203+0000, chain.objs.size()=1 2024-09-14T11:38:02.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_._N-9Y4BjxesvCKEnBvEpOWF_KJeWO8R_0 2024-09-14T11:38:02.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15426435271259584876', time=2024-09-14T13:37:33.774520+0000, chain.objs.size()=1 2024-09-14T11:38:02.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.319+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:XzYO1UFCZnEkIvY8tiSfo1VJ.MQJg0V_.1un3Okh4C8Dvapi8NvnZ2xg6t8TwdQv_0 2024-09-14T11:38:02.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.321+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.324+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:38:02.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.325+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_4Rbq9VHLLyMO2EdC0HWc0X1j-RSW3eF', time=2024-09-14T13:28:59.715287+0000, chain.objs.size()=1 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.UMRYugiQz5X3eHS4IX4TLX2dJEsthnN_0 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1027505410637922314', time=2024-09-14T13:30:16.354706+0000, chain.objs.size()=1 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.P0yM_Op8mOZfY3eLvuT4hbVVHwKBzHI_0 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1885157199978524153', time=2024-09-14T13:30:16.375045+0000, chain.objs.size()=1 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.BCBYfVEHKPhEHP0TvI7W7XaSZ6M6pr9_0 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2735506766218320022', time=2024-09-14T13:30:18.322291+0000, chain.objs.size()=1 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.GenuKyOyBuM0dY8ozSYE9s1VricfZOh_0 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6885164571228396889', time=2024-09-14T13:30:52.248509+0000, chain.objs.size()=1 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.wdCW-Nw_2afKakdTa8bGyHFBAfFSJR5_0 2024-09-14T11:38:02.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1635070640304209827', time=2024-09-14T13:30:54.779064+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.QNc25FDeLWwo-RLK8KHboOKJP-8MIBr_0 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6048821408821509743', time=2024-09-14T13:30:54.782887+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.utXw0DgXd1SV60etKgnO29w0Jmb9Txy_0 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8685280798360403889', time=2024-09-14T13:30:54.810447+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.21ucmU3OoVf2orAFu27yHTepK6CxCPc_0 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16435141804383357603', time=2024-09-14T13:30:54.831015+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.3fjtumS4ReYBDwmeDo6ImOghXleOOuE_0 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17284947529018400328', time=2024-09-14T13:30:56.934206+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.jWNVnAKL6DoOCVoXgzV0cQ9sCUzScmM_0 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15641382446376843915', time=2024-09-14T13:31:30.047373+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_._bH24HcK2B49NvPXDQIhMJH7RlhEGJA_0 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.43864530720600822', time=2024-09-14T13:31:30.083168+0000, chain.objs.size()=1 2024-09-14T11:38:02.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.326+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.-7dqwOwL1zB-SSXPReDZdk_taCgDygj_0 2024-09-14T11:38:02.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.330+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.46239172296665886', time=2024-09-14T13:31:32.915900+0000, chain.objs.size()=1 2024-09-14T11:38:02.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.330+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.X2-W0UGPEUWL66_1fmiFrAGniZaSsw3_0 2024-09-14T11:38:02.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.330+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16470908398660268753', time=2024-09-14T13:31:35.647193+0000, chain.objs.size()=1 2024-09-14T11:38:02.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.330+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.bupilkos7Va2L8c1oSCEipRM9HJtAdH_0 2024-09-14T11:38:02.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2397993764424173065', time=2024-09-14T13:31:35.674584+0000, chain.objs.size()=1 2024-09-14T11:38:02.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.KUdM_xHc2JbvAL8_81rs_D4evCqiTam_0 2024-09-14T11:38:02.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7813480833649487626', time=2024-09-14T13:32:08.721826+0000, chain.objs.size()=1 2024-09-14T11:38:02.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.MvIx_N9E2MXLGLra3gxGqPqmcJyi_YV_0 2024-09-14T11:38:02.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14972020077946089816', time=2024-09-14T13:32:12.065599+0000, chain.objs.size()=1 2024-09-14T11:38:02.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.Rwqu-woUW6KY-mFYG12tF_p7-L4nXgd_0 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17991356307506100869', time=2024-09-14T13:32:12.068447+0000, chain.objs.size()=1 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.jFfI8n7-r0X8thSRAdnVDfg-xG2mZHA_0 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14084195696783944923', time=2024-09-14T13:33:23.848996+0000, chain.objs.size()=1 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.jFivHw9feMEQ8oENolQfmXy23Crpric_0 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11759552703019584250', time=2024-09-14T13:33:23.941945+0000, chain.objs.size()=1 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.QEYa1sfMRZYlGnkcWahl3mvmgpIrjnu_0 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16048466970223362273', time=2024-09-14T13:33:27.086122+0000, chain.objs.size()=1 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.uIK19oeOomQnKVErlN3UWWwQjYWro-a_0 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12698462823548529704', time=2024-09-14T13:34:00.342546+0000, chain.objs.size()=1 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.PKrGsBve8c2XqYrstSWqxQFvR3Hdf7J_0 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10459859224983863528', time=2024-09-14T13:34:03.304038+0000, chain.objs.size()=1 2024-09-14T11:38:02.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.331+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.FQlEBAdtE9559mri-_HBJ9nnsg5wvQz_0 2024-09-14T11:38:02.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.334+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17705481115905243513', time=2024-09-14T13:34:37.618307+0000, chain.objs.size()=1 2024-09-14T11:38:02.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.334+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.1rQfsfD4ZSFOJcp8WQy385IxzVVrg4r_0 2024-09-14T11:38:02.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.334+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11169741774434533105', time=2024-09-14T13:37:20.861997+0000, chain.objs.size()=1 2024-09-14T11:38:02.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.334+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.VsZXSqQimoPNyr9Qz-SCtkry4XqRYaE_0 2024-09-14T11:38:02.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.337+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.339+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:38:02.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.340+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.341+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.341+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.341+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_o_Iyy_13bnhiY2UzkrOoMcb9jfCiWsK', time=2024-09-14T13:28:59.810532+0000, chain.objs.size()=1 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.341+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.y3ktAuHWSE2XaCejyjRCMAEg0j7kIIc_0 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.341+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15572564286810922603', time=2024-09-14T13:30:16.451989+0000, chain.objs.size()=1 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.341+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.PqTABPbd4oMKDLDIelly4VYyZlMmu8Z_0 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10357918965476536463', time=2024-09-14T13:30:18.343358+0000, chain.objs.size()=1 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.KvJREGXPRlMAzyPWd_MJRMLAWPdWaOG_0 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12752522144515271094', time=2024-09-14T13:30:52.258656+0000, chain.objs.size()=1 2024-09-14T11:38:02.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.ESZc_a-v-XN_1CKrfEQ5SMCeqmS0Uw-_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6477686264518779215', time=2024-09-14T13:30:56.965622+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.M7cAjog3JK2hEFAgnD2MqDPlKH536bN_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1878572248471571960', time=2024-09-14T13:31:32.963278+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.kiSx3CdoHqLAUCA9WI1YyWb-1pEpfLa_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8191948391380228789', time=2024-09-14T13:31:32.996656+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.ViYh24yGkzbtOS3KSAEuDXT5Dxq4Ybf_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7136148378067029563', time=2024-09-14T13:31:35.632707+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.T0KCffwCrVr6gSPHev8-HNDCz_6Bxg8_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11564917532088258981', time=2024-09-14T13:32:12.111974+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.zQ_T6-oHr2t74FWQphy_6B1AKLyaD_8_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7493532581661575733', time=2024-09-14T13:34:00.343309+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.ZpXS3k7Njc0m4YYWWxxc5hspoz-Lj2X_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10537373378394664094', time=2024-09-14T13:34:03.252139+0000, chain.objs.size()=1 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.zMwGC4X90jZDl_HQoOoJ1CXt1Ohen1G_0 2024-09-14T11:38:02.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14370849881289175729', time=2024-09-14T13:34:37.533004+0000, chain.objs.size()=1 2024-09-14T11:38:02.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.342+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.bZGwMYOYAlIF0_A5TPNzS67DivDL52h_0 2024-09-14T11:38:02.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.344+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11318800742966591707', time=2024-09-14T13:35:14.360430+0000, chain.objs.size()=1 2024-09-14T11:38:02.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.344+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.HthkDiVfKTJYc4FgI18Rj5HXUW7qOvf_0 2024-09-14T11:38:02.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.344+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9218608698312315242', time=2024-09-14T13:37:20.886280+0000, chain.objs.size()=1 2024-09-14T11:38:02.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.344+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.1w8qGres0Ik36o1GqocQC5GBGEIlBYn_0 2024-09-14T11:38:02.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.347+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.350+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:38:02.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.351+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:38:02.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9226941631435626217', time=2024-09-14T13:28:59.940080+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.49Xl2ZTq2SD4sMYp010NOfF8RslVVPT_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15692677824737866336', time=2024-09-14T13:30:18.364632+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.oOdmUToH_1Z6J6M-wSJFxLfXRUkCn8c_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9386319234417449444', time=2024-09-14T13:30:54.742155+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.UO-zPBLewwAa0-G1fBchVrd8rWZ2_2j_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5060900120263514296', time=2024-09-14T13:32:45.749241+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.MCczNjaceB4dYjlNyjD-5kI-EUT1rSf_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13624346743203900526', time=2024-09-14T13:32:45.788627+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.vMKALaonXF0IqUqZRkD3fpQU2KTFbu3_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2993751388054007114', time=2024-09-14T13:32:49.281487+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.cfv6RjHms6-Mh5G-16EUaY1eY0-ghuT_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8817505493660366701', time=2024-09-14T13:32:51.246371+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.-SjVQBL3WO0-SaHFAmEBvDVH5jzOm_J_0 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11847081804251088899', time=2024-09-14T13:34:00.414172+0000, chain.objs.size()=1 2024-09-14T11:38:02.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.ig4mkFwidfrxc8ovZ-2rZegHbOG-XGS_0 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6706086297309629920', time=2024-09-14T13:34:40.286280+0000, chain.objs.size()=1 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.wXyeaawlmZiD_d0hUu3CAcoT47C-bDx_0 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6180050050461294871', time=2024-09-14T13:34:41.815523+0000, chain.objs.size()=1 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.NI5zIvmETEPtlVXwKbnIiUbcEMN13H9_0 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12040605819792973396', time=2024-09-14T13:35:14.336175+0000, chain.objs.size()=1 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.HDqZCrRGz637ssz_0ZKCIpKFSgDbRE4_0 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1781331091473272966', time=2024-09-14T13:37:20.866821+0000, chain.objs.size()=1 2024-09-14T11:38:02.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.352+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.qxMYIb-oc1x4YpuJRZ76iCOEY6tOwEt_0 2024-09-14T11:38:02.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.356+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.360+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:38:02.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.361+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.361+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7482281633512578917', time=2024-09-14T13:30:54.782854+0000, chain.objs.size()=1 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.sxyBt8-ORTLKvKga9ZVdnj7TZH23kyP_0 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9868979305033232201', time=2024-09-14T13:30:54.810483+0000, chain.objs.size()=1 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.HRlwY2QkPqUTT_1u-RDSaCHAL0G3acO_0 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15230025410248783671', time=2024-09-14T13:30:57.018012+0000, chain.objs.size()=1 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.qTKW7ylAG3KPfmI-MYQkOmAbzuPJ_Dy_0 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9389690440758800006', time=2024-09-14T13:31:30.046010+0000, chain.objs.size()=1 2024-09-14T11:38:02.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.ZK2rL7UPWQOYn6gSGGIodxoizExDBk2_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1124551136504979690', time=2024-09-14T13:32:12.022056+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.SaUD2HJRXoUNy7WtXQb79KsVge8E0nM_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15391869761101117938', time=2024-09-14T13:32:49.254504+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.AP662_m-Bv9sfQ1hwSz7MBLj2P1gVHq_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10388778042325439086', time=2024-09-14T13:32:49.301749+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.ZZutGgC9D-9PBj3gnMA1Ih8Lb0c3xy2_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8466386581835325962', time=2024-09-14T13:33:23.849086+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_._b5YNqX52sN2iwMfq-y1-eHFBJ-Get9_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8155018631400388854', time=2024-09-14T13:33:27.048283+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.m8Eu39pOx1W4eJyNRkpFhtNBP8_trXM_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8512612720951725785', time=2024-09-14T13:34:37.581443+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.yLfajyCcQBzgR6ai9n358rgRpjexZQa_0 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6485825224663639352', time=2024-09-14T13:34:37.624186+0000, chain.objs.size()=1 2024-09-14T11:38:02.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.ILNyopnWknEtMPjio0vlzwcu5-qwFhE_0 2024-09-14T11:38:02.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11546251653572181396', time=2024-09-14T13:34:40.248778+0000, chain.objs.size()=1 2024-09-14T11:38:02.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.362+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.rAYUqVgN5QH9b61eBCYxLC7YBbv6GXf_0 2024-09-14T11:38:02.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.364+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3199081615904534272', time=2024-09-14T13:34:40.287645+0000, chain.objs.size()=1 2024-09-14T11:38:02.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.364+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.HAiOJabNOzT3Ae3c_48m5FYcw9w7P2R_0 2024-09-14T11:38:02.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.365+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17405071999870167090', time=2024-09-14T13:34:41.840092+0000, chain.objs.size()=1 2024-09-14T11:38:02.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.365+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.056SQ9Pyc4JPjB9MVudvdKfeeyCZ5HK_0 2024-09-14T11:38:02.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.365+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8873918928246342928', time=2024-09-14T13:34:41.890692+0000, chain.objs.size()=1 2024-09-14T11:38:02.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.365+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.tb4M80zhisr-fQOUk_6Prr0Ffct-XLP_0 2024-09-14T11:38:02.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.365+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9820941744989608330', time=2024-09-14T13:35:14.261497+0000, chain.objs.size()=1 2024-09-14T11:38:02.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.365+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.tcT1pD60thYfXz1McZNFcNrtjEm2tX3_0 2024-09-14T11:38:02.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.368+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.370+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:38:02.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18248190607811706600', time=2024-09-14T13:28:59.769956+0000, chain.objs.size()=3 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.1 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.2 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-FROZEN.2~9rIknfBRSPVIdbu0EsQ6vYNPY4aiY8b.3 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10030253520285266792', time=2024-09-14T13:30:16.379823+0000, chain.objs.size()=1 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.NUsnvP_Y2VEj17iThuJMXSV-iOl7U7h_0 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15613296640875611287', time=2024-09-14T13:30:52.237846+0000, chain.objs.size()=1 2024-09-14T11:38:02.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.GIHCqkzX4QHNtp5eKbKqAK_5cIbj0Kv_0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16081688452190731960', time=2024-09-14T13:30:54.053538+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.hV2ZnCxfk6803YeAP-vU01npU6LR_9w_0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17303680441761135114', time=2024-09-14T13:31:35.610398+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.372+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.NW6uWrX2bE2H9AukXJRkCwVGl-I0Xil_0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11369761422644511813', time=2024-09-14T13:31:35.684142+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.5MMvrxwdwL6Usl_8TbV8T63fTIXb_SC_0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17271958443395154895', time=2024-09-14T13:32:48.572349+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.j7OI5hnGa4tct4QFgxpD4pC8hU739___0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17504572488407690507', time=2024-09-14T13:32:51.205951+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.UCFMNDzleS9nlPK6KBtZCBNLjgnkT6L_0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3289251522065766064', time=2024-09-14T13:32:51.241433+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.sxG6cueHRB1uyk8Y1fsuXUAyDG6Xgzl_0 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6734825170583656178', time=2024-09-14T13:32:51.242355+0000, chain.objs.size()=1 2024-09-14T11:38:02.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.373+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.7bBiK2i97-flvCt7DZAlYUCD2eXZM_4_0 2024-09-14T11:38:02.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12592462033676927254', time=2024-09-14T13:33:27.009879+0000, chain.objs.size()=1 2024-09-14T11:38:02.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.F_n7vl6be15kBRS9hZePLQ4FFbae5CE_0 2024-09-14T11:38:02.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14878620560885909629', time=2024-09-14T13:34:03.263916+0000, chain.objs.size()=1 2024-09-14T11:38:02.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.OhdebY9p4GGs-RcAehz36GGqMwbbN3k_0 2024-09-14T11:38:02.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16808010143380130333', time=2024-09-14T13:34:03.301943+0000, chain.objs.size()=1 2024-09-14T11:38:02.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.6QqFvEgIqULqzTBtNcUUPHgDfiddjn0_0 2024-09-14T11:38:02.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11346734131770656307', time=2024-09-14T13:34:40.262597+0000, chain.objs.size()=1 2024-09-14T11:38:02.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.ogzUnVgGIZBEdBNb0sr9K9tcJ3IvFn4_0 2024-09-14T11:38:02.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16574783343473304807', time=2024-09-14T13:34:41.893365+0000, chain.objs.size()=1 2024-09-14T11:38:02.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.379+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.8bBpUGX8a93DREZ1zSvE1-QjInDI6O4_0 2024-09-14T11:38:02.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.382+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.385+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:38:02.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.387+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:38:02.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10747697034428838850', time=2024-09-14T13:28:59.724708+0000, chain.objs.size()=1 2024-09-14T11:38:02.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.jB9AMLxfvKhKMfPiRuBs2GMTIECQEhn_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7534313200798962398', time=2024-09-14T13:30:16.355335+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.hFVTAWOmnmXN3TUgqWXygjrLKHVXNEw_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9025143288057809921', time=2024-09-14T13:30:16.385865+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.93JPG0Bi9gbjyVpgNhwPu6u0d4D2sVb_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5526542211868433025', time=2024-09-14T13:30:18.370412+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.YESMT_42U5A1woGmAFtyhaY2DDpKsdn_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10194428834701935750', time=2024-09-14T13:30:52.305856+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.YGT2CKXHthujTIeh2hyODfGkHFfGGBz_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11646951538292776161', time=2024-09-14T13:31:35.679804+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.ty8Jq1eB2dZVUWlRNawTRiClAP0L0EU_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5081669353065897202', time=2024-09-14T13:32:12.061163+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.NdtX7Xw29ZoQ5Mj1yjnp34VvvwYBGgc_0 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4643520410524660814', time=2024-09-14T13:32:49.285268+0000, chain.objs.size()=1 2024-09-14T11:38:02.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.37CfKb2jrvPbfhttdcdtRL6BmuUUNZ6_0 2024-09-14T11:38:02.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6513548794083427234', time=2024-09-14T13:32:51.250198+0000, chain.objs.size()=1 2024-09-14T11:38:02.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.U0nc3iBw-QbQR9ZOe4gZEOr5PohIGUF_0 2024-09-14T11:38:02.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18156479670357821149', time=2024-09-14T13:34:37.543526+0000, chain.objs.size()=1 2024-09-14T11:38:02.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.t5Um9PSE8btKsMufwGWNPQlBJavpGUR_0 2024-09-14T11:38:02.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1178033926615072370', time=2024-09-14T13:35:14.290475+0000, chain.objs.size()=1 2024-09-14T11:38:02.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.389+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.xwQ1ouaGNlxIJVl_dCT4E0ObDwcmRcG_0 2024-09-14T11:38:02.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.394+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.396+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:38:02.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.397+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16674753374394908474', time=2024-09-14T13:28:59.786269+0000, chain.objs.size()=3 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.1 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.2 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-LUKEWARM.2~MQFn9ncV7hnHbZqRsHO6EPANYfBvj-N.3 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_P6a5fy0uXZORU5ejsagGmOsTetOxJXa', time=2024-09-14T13:28:59.790402+0000, chain.objs.size()=2 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.ynB2KonMRhDti7ByyY8Tm9Z_R7mk6zp_0 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.ynB2KonMRhDti7ByyY8Tm9Z_R7mk6zp_1 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12051460584173364442', time=2024-09-14T13:28:59.835484+0000, chain.objs.size()=3 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-LUKEWARM.2~O-gB3a95o6mSdABYAzBBkaMrjsKsygA.1 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-LUKEWARM.2~O-gB3a95o6mSdABYAzBBkaMrjsKsygA.2 2024-09-14T11:38:02.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-LUKEWARM.2~O-gB3a95o6mSdABYAzBBkaMrjsKsygA.3 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6010429430815641249', time=2024-09-14T13:28:59.913440+0000, chain.objs.size()=1 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.qJryRxoRqhXdSpntTC8GzOFLxKsaQ4s_0 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3664934504006435834', time=2024-09-14T13:30:16.446467+0000, chain.objs.size()=1 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.HGakQOGcwcyYQox2v2EVvIBWx6QFt5o_0 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11601728915400611391', time=2024-09-14T13:31:30.049280+0000, chain.objs.size()=1 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.ok6RZuyYEMmdWYZFyjcl-SHvBGyE3nZ_0 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11974115082563139778', time=2024-09-14T13:31:30.049969+0000, chain.objs.size()=1 2024-09-14T11:38:02.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.398+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.PE2i75_D_Q8mbrT-hm2DpAMbGXP1_tA_0 2024-09-14T11:38:02.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.199543321871984237', time=2024-09-14T13:32:08.691386+0000, chain.objs.size()=1 2024-09-14T11:38:02.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.Zvwo2cCxkVILow8zvknDl8neSpzgKKl_0 2024-09-14T11:38:02.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14870712538644781012', time=2024-09-14T13:32:49.350829+0000, chain.objs.size()=1 2024-09-14T11:38:02.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.gNJ4Pj98qPRoVFvoPxj_F7rpEV2AGp__0 2024-09-14T11:38:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2843336571488357949', time=2024-09-14T13:33:23.916043+0000, chain.objs.size()=1 2024-09-14T11:38:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.AIQLm8uP7nyErh1ClzIMgHVnf2Pf5Nv_0 2024-09-14T11:38:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5842268890285564998', time=2024-09-14T13:34:00.320428+0000, chain.objs.size()=1 2024-09-14T11:38:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.snPgs9zzw_mBfj38A_aIycaSLQq2acy_0 2024-09-14T11:38:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10506694174036221104', time=2024-09-14T13:34:00.342518+0000, chain.objs.size()=1 2024-09-14T11:38:02.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.402+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.NfgxODcY7K4MklJE5vksxMa2VEpQlFD_0 2024-09-14T11:38:02.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.405+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.407+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:38:02.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.408+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15937690006198957229', time=2024-09-14T13:30:16.427698+0000, chain.objs.size()=1 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.JtsPUC2g-yrr9ZWNJ5l2zgUXjXrOHob_0 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5994878052879230353', time=2024-09-14T13:30:18.335408+0000, chain.objs.size()=1 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.jm7XD30t_FLitFXlTTzaks3d5CutgzL_0 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14506302166690177469', time=2024-09-14T13:30:18.336297+0000, chain.objs.size()=1 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.I2gcqx3s999vwkqsPlEVT6O922u-Om7_0 2024-09-14T11:38:02.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.330265885702482226', time=2024-09-14T13:30:52.248105+0000, chain.objs.size()=1 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.80LVPSw7hYTnKdODG9uqNHd9VR-MGLf_0 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5347968774503691361', time=2024-09-14T13:30:54.749343+0000, chain.objs.size()=1 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.bd1-17bvgbO9bdlHA7W_FY1qVqZIyR2_0 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4727251569157281106', time=2024-09-14T13:33:23.874087+0000, chain.objs.size()=1 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.lscY_p5j9AQNeiy6xFbAhcTWmMfEJww_0 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3187254205618903242', time=2024-09-14T13:33:27.022464+0000, chain.objs.size()=1 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.sjfr-7OWgmtG61Q1vDXPTm9v0WwgeDD_0 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8258187267609400502', time=2024-09-14T13:34:00.351478+0000, chain.objs.size()=1 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.1_JaHGe3Ubzw10r2IHT6g-yJQBHAmDz_0 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6198672242375657077', time=2024-09-14T13:34:00.352283+0000, chain.objs.size()=1 2024-09-14T11:38:02.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.ULwCSOz6lZiK54uasZ31s5g-IWzSN8C_0 2024-09-14T11:38:02.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1887580682157391796', time=2024-09-14T13:34:00.353041+0000, chain.objs.size()=1 2024-09-14T11:38:02.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.gpr0SDFbLpNLPWcJe-SXDczsv1O20Yf_0 2024-09-14T11:38:02.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1184854061634151664', time=2024-09-14T13:34:00.354086+0000, chain.objs.size()=1 2024-09-14T11:38:02.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.Ps2iRMcDgYHEAinWAfRhsf73TxJnGt5_0 2024-09-14T11:38:02.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8738168258394882297', time=2024-09-14T13:34:03.226661+0000, chain.objs.size()=1 2024-09-14T11:38:02.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.409+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.PxKsVZqn1F7R1625YQNd__cx6uEJXZu_0 2024-09-14T11:38:02.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13737214962497058689', time=2024-09-14T13:34:03.257472+0000, chain.objs.size()=1 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.flN3cBN_ZL4KKMdL2lyn1wUqrx-m9gF_0 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5790874424106123898', time=2024-09-14T13:35:14.273955+0000, chain.objs.size()=1 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.5MBDm6fDpEHK1DoMnblgg9mZMejSot2_0 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2239004064449175228', time=2024-09-14T13:37:20.861813+0000, chain.objs.size()=1 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.4Co--LgnBQxuAiSCsoyus_9ObBAJKqL_0 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3793660109313071934', time=2024-09-14T13:37:33.775819+0000, chain.objs.size()=1 2024-09-14T11:38:02.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.414+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:lZj7QTU75hRjWkqTd-b0OgMHpUfWs1j_.xpYf1GCqVQJ9UFTv9iV1jYnC3TeZIO2_0 2024-09-14T11:38:02.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.416+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.418+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:38:02.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.419+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4379367918304863798', time=2024-09-14T13:28:59.606244+0000, chain.objs.size()=1 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.5NSo4vK8fuDAeDdG7oXp2nIVHfR0jwO_0 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5359005391369959706', time=2024-09-14T13:28:59.814384+0000, chain.objs.size()=3 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.1 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.2 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__multipart_foo-STANDARD.2~xxC47wut5wmmTiIbVZEvJlYAwsmyabh.3 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8243198575594217825', time=2024-09-14T13:28:59.863711+0000, chain.objs.size()=1 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.8oDZc4c53DcsCCf0Iq5QC3Px9-IGApT_0 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15091136563625162026', time=2024-09-14T13:30:16.374565+0000, chain.objs.size()=1 2024-09-14T11:38:02.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.WIxsRJrD48hjprOSvxdc_7CNQTmiRCt_0 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7708230056163645391', time=2024-09-14T13:30:52.262079+0000, chain.objs.size()=1 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.2Q-91f4YjeH9InAR5V2Tkw46xXF6p2O_0 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6039334462642217476', time=2024-09-14T13:30:58.934543+0000, chain.objs.size()=1 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.8ECFZjvva-9IE-27gqSlwzVYf4zrppj_0 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8290054011800913827', time=2024-09-14T13:32:08.726545+0000, chain.objs.size()=1 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.B4w9uZtafbmN_Vuy-tv5KbhSzaoRCIm_0 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10459753709696589020', time=2024-09-14T13:32:45.810984+0000, chain.objs.size()=1 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.p9CCGrmiujSJ2rtMf8whgV7nvJ8o1ML_0 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4526180502577929114', time=2024-09-14T13:34:03.258973+0000, chain.objs.size()=1 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.DHGfIttxpvIRrbnt9aEScL4VAcCZOhm_0 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17607685008282364812', time=2024-09-14T13:34:37.576350+0000, chain.objs.size()=1 2024-09-14T11:38:02.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.420+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.gEXbdAoqcuyscyz84F3y9-HBFliEHRX_0 2024-09-14T11:38:02.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.423+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17521178362081590223', time=2024-09-14T13:34:37.577892+0000, chain.objs.size()=1 2024-09-14T11:38:02.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.423+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_._dkbmSXtcR-pMVxBV3kVYt7UzAVJIze_0 2024-09-14T11:38:02.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.425+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.428+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:38:02.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.429+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:38:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12257585176736507624', time=2024-09-14T13:28:59.649962+0000, chain.objs.size()=4 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.1 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.2 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.3 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12__multipart_foo.2~CeGxxX2QhLjOh9n9QjPkdCJtMZScV3s.4 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9278974766397323582', time=2024-09-14T13:28:59.690142+0000, chain.objs.size()=4 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.1 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.2 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.3 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9__multipart_foo.2~sVTvBKnBs6cuLuqzYnB2MMGzqqqsudJ.4 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4389329906616879642', time=2024-09-14T13:30:54.757479+0000, chain.objs.size()=1 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.3v6VJhSKzx7UIRj37uFujpQFsbs7kmU_0 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7839858848005356174', time=2024-09-14T13:32:45.785414+0000, chain.objs.size()=1 2024-09-14T11:38:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.13sBfe8xAj9P19hhMOkhSagxQV97kdo_0 2024-09-14T11:38:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3193237406023886693', time=2024-09-14T13:33:23.874355+0000, chain.objs.size()=1 2024-09-14T11:38:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.aoeMVW5CKt27DAWSPp5ufqjkFJphlhM_0 2024-09-14T11:38:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3580632337888331948', time=2024-09-14T13:33:29.258809+0000, chain.objs.size()=1 2024-09-14T11:38:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.430+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.S7kCW8qrGdCBeSTZwQlUmkw2E4tA9fD_0 2024-09-14T11:38:02.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2928542865362231595', time=2024-09-14T13:34:05.466722+0000, chain.objs.size()=1 2024-09-14T11:38:02.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.ATBoVtcWbsI3bs3tE8kFA5yyO-JDfMv_0 2024-09-14T11:38:02.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4795122859265899793', time=2024-09-14T13:34:37.554487+0000, chain.objs.size()=1 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.f0BqRSP0MKIQ8tRzDpsq33IY-B91aUL_0 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17731295815122251113', time=2024-09-14T13:34:40.283039+0000, chain.objs.size()=1 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.zYom2RqEzqUghCxJsKhHnOdrLV13vW3_0 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11894960790713762797', time=2024-09-14T13:34:40.336512+0000, chain.objs.size()=1 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.j4yP4ZYAdXDSP7RAqk7zbLtJDhAsLjX_0 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5534355759122116007', time=2024-09-14T13:34:41.862447+0000, chain.objs.size()=1 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.IoxSRsr-ACPaDWddFdMxyam75wuhkp1_0 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6834327054996474045', time=2024-09-14T13:37:28.663913+0000, chain.objs.size()=1 2024-09-14T11:38:02.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.435+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18__shadow:fQWzZ6EJ0mUD8xtdYUXZB2S2iiLNlJF_.zcSkjmVXIpoGXl2bxB-5p8FsEUbvyBE_0 2024-09-14T11:38:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.438+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.441+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:38:02.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.442+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14588621262169849017', time=2024-09-14T13:28:59.614846+0000, chain.objs.size()=1 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.vvDDUBfsYKw7q6SOMRbmgnEtUhFRytD_0 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14530070020947783184', time=2024-09-14T13:28:59.710970+0000, chain.objs.size()=1 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.p78kpdV52aYPpLZj2oybwt3xkkuGgRI_0 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_g6TfvXZU4c4KdAN0lxaEJpsseDSMI-V', time=2024-09-14T13:28:59.778051+0000, chain.objs.size()=2 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.WhVz8o99WXwpOQc-sXE3HNBWlRrng-N_0 2024-09-14T11:38:02.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.WhVz8o99WXwpOQc-sXE3HNBWlRrng-N_1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17654703972353555858', time=2024-09-14T13:28:59.944092+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.1Rdjr4NNZEAyodsSyNkutEzSHu_LpOh_0 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4443978344940424775', time=2024-09-14T13:30:18.364565+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.SzKrJtZ1DcOQyx3-zPVIxwq-ucbEvqq_0 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5512144357357916944', time=2024-09-14T13:30:18.415612+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.5aJcmT9kiPVJWNaQ0w5Wl05qLaMAKvM_0 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9823081890253691253', time=2024-09-14T13:30:18.422611+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.-tmlD4wzi0_k9ZJG8pCqlBSCuDvEYcH_0 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6890237398946293256', time=2024-09-14T13:30:54.839876+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.hAZtDGnTSbPfc_zG4exk6Ok58dSMU23_0 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8902070704961491716', time=2024-09-14T13:31:30.004386+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.443+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.kpyfoDuw-GJGCknwjuS2rOC7CRXpxf7_0 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.444+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17077989412071880667', time=2024-09-14T13:31:30.004979+0000, chain.objs.size()=1 2024-09-14T11:38:02.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.444+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.dLwfsLz5uJ5m_tFHJs2z99ew0q3KGf8_0 2024-09-14T11:38:02.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.444+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13251226173836404781', time=2024-09-14T13:32:45.789681+0000, chain.objs.size()=1 2024-09-14T11:38:02.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.444+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.gZutd0w9OgVBd-7k8knlugoOpHfWqOK_0 2024-09-14T11:38:02.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.447+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17036119436822151633', time=2024-09-14T13:32:51.245622+0000, chain.objs.size()=1 2024-09-14T11:38:02.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.447+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.EDfC2Ae5rH1JS_-cjkzee7fm6bsmO0f_0 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5349560776719613781', time=2024-09-14T13:33:23.909814+0000, chain.objs.size()=1 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.ZfR5xe9lzS-3cqw2J-KjRHKwgNS_2j__0 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7773689739770901525', time=2024-09-14T13:33:23.910531+0000, chain.objs.size()=1 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.Xzs1GhPA2-5zW8biGUBQCV-xrpcAei2_0 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4107151690733608395', time=2024-09-14T13:34:00.346648+0000, chain.objs.size()=1 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.FaXrGE2ZczIBD13tw09-eIYS8-q7l1q_0 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7071562520984134553', time=2024-09-14T13:34:03.242646+0000, chain.objs.size()=1 2024-09-14T11:38:02.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.bxAe-CprLAi_thO-2rA-cg5IUGfQMYW_0 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.828401538226187244', time=2024-09-14T13:34:03.247522+0000, chain.objs.size()=1 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.sGW82VfIk8Dj1iF7gGyenuAIajaT10P_0 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4826745763370959974', time=2024-09-14T13:34:03.303768+0000, chain.objs.size()=1 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.LEM_HEjH_s1LLGlb8oj-QkoPiXa-lbu_0 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3366787803321251148', time=2024-09-14T13:34:03.319013+0000, chain.objs.size()=1 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_._sBMLCnhq52tx6XrQICgPkdNoMML6hI_0 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16884253949340392884', time=2024-09-14T13:34:03.325156+0000, chain.objs.size()=1 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.Mqguzh_GBa7eFcHU1WY7CUm8WxcnWc8_0 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17091003455945407672', time=2024-09-14T13:34:37.628131+0000, chain.objs.size()=1 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.DRuxmNljsJNE-7YEG0_x2K__s3YYTGQ_0 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13562566522448002674', time=2024-09-14T13:34:41.842687+0000, chain.objs.size()=1 2024-09-14T11:38:02.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.448+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.Dg_2mz9sG37x3UfKzehYJR3vxa_JAo5_0 2024-09-14T11:38:02.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.453+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.455+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:38:02.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_PpuFaM6NT6VyqBjvon2IMjiE5gQ13F_', time=2024-09-14T13:28:59.728716+0000, chain.objs.size()=1 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.CWapFkvG-VEDILbvfBlapQmA47-Gke3_0 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16979323654813005121', time=2024-09-14T13:28:59.839566+0000, chain.objs.size()=3 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-STANDARD.2~_yw8hA7SUBI5LYl6PBhcJJB6F6jPYf6.1 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-STANDARD.2~_yw8hA7SUBI5LYl6PBhcJJB6F6jPYf6.2 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14__multipart_foo-STANDARD.2~_yw8hA7SUBI5LYl6PBhcJJB6F6jPYf6.3 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17012918189821584509', time=2024-09-14T13:30:52.249851+0000, chain.objs.size()=1 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.rVJoEJugqxrmDpvszk7Dp4gGsIt5Gu3_0 2024-09-14T11:38:02.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1878857642691790654', time=2024-09-14T13:30:56.998356+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.AurGWSm1CNRxrU_n5ZMJqLatf5t6qba_0 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.946793021309774877', time=2024-09-14T13:31:35.579595+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.9rzcN5vBKMo5tcaxmZR0WlROu6fGJom_0 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9003426855083054628', time=2024-09-14T13:32:08.686084+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.tys2d2A0pMNQsX-YMANHtqLwz_qzp2y_0 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2257015142159593612', time=2024-09-14T13:32:49.261438+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.l9w6LWEmZjYLwWc4w8Ggknzp43OL079_0 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11258818574947614784', time=2024-09-14T13:32:51.239357+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.YLx0ARgnWQTQmLWPIg2SE1YrNILnqWr_0 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15699949765934784553', time=2024-09-14T13:34:03.283977+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.TpfqTlV1YF3MKCqh3OOcjPit9s9NDCE_0 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12460603104949137114', time=2024-09-14T13:34:40.283110+0000, chain.objs.size()=1 2024-09-14T11:38:02.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.457+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.uBjSDuZmOyVj6pHBc-7tFLRUfzRiB8I_0 2024-09-14T11:38:02.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.460+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10905971550180423226', time=2024-09-14T13:34:41.800722+0000, chain.objs.size()=1 2024-09-14T11:38:02.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.460+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.ua60NMhdpo6RJ7kqeLGiSyVhmj9duAR_0 2024-09-14T11:38:02.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.461+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14393864755315411989', time=2024-09-14T13:35:14.273962+0000, chain.objs.size()=1 2024-09-14T11:38:02.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.461+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.XT8bMj8ztZbIB0kZdHvHvN5-B3TQVZG_0 2024-09-14T11:38:02.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.463+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.466+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:38:02.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.467+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:38:02.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3103797265614144232', time=2024-09-14T13:28:59.904640+0000, chain.objs.size()=1 2024-09-14T11:38:02.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.BhaxkMMgQ5KwsZomQ4yQ9UE4PzPNa33_0 2024-09-14T11:38:02.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7726686259177976609', time=2024-09-14T13:28:59.917873+0000, chain.objs.size()=1 2024-09-14T11:38:02.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7__shadow_.wjgMv-5pGRqIIS7sxxF3mPOtdVQ7k7Y_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17644853218122504055', time=2024-09-14T13:30:16.420398+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.wMPc_4akc8XEMSXTX0-60QKq1Az7NXE_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2263370603178119607', time=2024-09-14T13:30:18.353929+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.FYr5KknUkBU-w_hTczt6PZcfP1VMOlU_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16371031217068267800', time=2024-09-14T13:30:56.932681+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.Sd0XpxDgaPSM3x6FLiKY72iP_ZLVgYA_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18190924791640876101', time=2024-09-14T13:30:56.933899+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.EFEnSfKhm7lY8b6WGXTz0OGMj0Bup3L_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2253715303700814405', time=2024-09-14T13:30:56.934642+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.IvMsL5mNFG4qbzqWkI0merRDoMsnHzf_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9306952992863346369', time=2024-09-14T13:31:32.935874+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.o7WG6crV3NHunzeFkJHdQTiVPbAr8CX_0 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7211282478200640311', time=2024-09-14T13:32:49.340145+0000, chain.objs.size()=1 2024-09-14T11:38:02.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.JpiqoyHQ0-RhXcD8yPyiCiGN-4gQbA-_0 2024-09-14T11:38:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12510091647296436254', time=2024-09-14T13:32:51.240423+0000, chain.objs.size()=1 2024-09-14T11:38:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.gfq5fveD9xIqe7e-MuKkJjELV66L_-F_0 2024-09-14T11:38:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9928772450062336064', time=2024-09-14T13:32:51.307912+0000, chain.objs.size()=1 2024-09-14T11:38:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.CMUgIwvwiALh0Zg_5pXQddu0MlWioxi_0 2024-09-14T11:38:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12002549006477822324', time=2024-09-14T13:33:23.908880+0000, chain.objs.size()=1 2024-09-14T11:38:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.468+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.1L_3gXzCa3SYJnVGfrZ6tM9NCmZl9Nu_0 2024-09-14T11:38:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12867705609816965247', time=2024-09-14T13:34:00.409606+0000, chain.objs.size()=1 2024-09-14T11:38:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.DW1Mer_vdjsfpaKqLBEHjgBriGpg5t5_0 2024-09-14T11:38:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16225241592488538999', time=2024-09-14T13:34:40.341760+0000, chain.objs.size()=1 2024-09-14T11:38:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.R6r3HWZN7oxQ8EtOClSvEL68tVlUtA4_0 2024-09-14T11:38:02.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4191534993713827527', time=2024-09-14T13:35:14.287531+0000, chain.objs.size()=1 2024-09-14T11:38:02.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.Hz1ubcbzbS7DoKHo-ZXgDrGTVIjoavE_0 2024-09-14T11:38:02.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10502297619981030291', time=2024-09-14T13:35:14.326417+0000, chain.objs.size()=1 2024-09-14T11:38:02.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.471+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.AXsE2WyeNnzbJdmozeWcXrPAArs_mMH_0 2024-09-14T11:38:02.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.474+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.477+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:38:02.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.478+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.478+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:38:02.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6711717539570353489', time=2024-09-14T13:30:16.407256+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.ZIsQhxWzFBnem5eYPEqxpJBIvM3p4AM_0 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16696583528256152382', time=2024-09-14T13:30:52.265913+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.i0vO3tQJ8EaqxajaLi1-Z3aWGzg6reE_0 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18312335379039024063', time=2024-09-14T13:31:32.968009+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.Nlq9D-MS0L4c1iv4rnNRRy5-zQQM9_-_0 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5616152520214071206', time=2024-09-14T13:31:32.968724+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.Ml0r11mccc71klOwn0lM_oFNbhwDQ6F_0 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5728023356544288084', time=2024-09-14T13:32:08.675677+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.5afzo6_-oQzngPOa13onv-m4qdIVprf_0 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3372668561512108334', time=2024-09-14T13:32:45.779233+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.K-dl0dbdkPKOlX5DFLVaHewMEcmiH1S_0 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5194264468283945996', time=2024-09-14T13:32:45.812602+0000, chain.objs.size()=1 2024-09-14T11:38:02.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.K76gO1g3VszRKmVNZA21FVvHtu1aOMQ_0 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3511320704193282154', time=2024-09-14T13:32:51.312982+0000, chain.objs.size()=1 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.grMf7yQDtYGohhKaHESqceyWNXSx9kp_0 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9905148811197651564', time=2024-09-14T13:33:23.868691+0000, chain.objs.size()=1 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.MpbINsGABdHBYlC2F46KDbKCvOxCuHs_0 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18158236078765923890', time=2024-09-14T13:33:27.064489+0000, chain.objs.size()=1 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.CW02bT61DnCVMuhHgoogMMHvMBl5Yrp_0 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15427732228388252820', time=2024-09-14T13:34:00.404671+0000, chain.objs.size()=1 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.MxIJlx59qgEgulJvoyEnI3Dxv4HqV6P_0 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6540511942182759210', time=2024-09-14T13:34:37.579794+0000, chain.objs.size()=1 2024-09-14T11:38:02.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.479+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.10zl02elejg9cVcg64LrqxHFbb2Xneo_0 2024-09-14T11:38:02.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.483+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14706975138225503714', time=2024-09-14T13:34:41.862171+0000, chain.objs.size()=1 2024-09-14T11:38:02.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.483+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.AdjI00mPtgFvzLM-gNBbci2UmYOqj_8_0 2024-09-14T11:38:02.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.485+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.487+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:38:02.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.488+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:38:02.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11442312043225487800', time=2024-09-14T13:28:59.597926+0000, chain.objs.size()=1 2024-09-14T11:38:02.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.w5Sse029EkV-FuW7GqRaSco7wGt5RB5_0 2024-09-14T11:38:02.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13114460131410691278', time=2024-09-14T13:28:59.855857+0000, chain.objs.size()=2 2024-09-14T11:38:02.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.qbfqqUar8xx6j0EVvv3c6qXP8vahmc2_0 2024-09-14T11:38:02.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13__shadow_.qbfqqUar8xx6j0EVvv3c6qXP8vahmc2_1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8201596054345923123', time=2024-09-14T13:30:20.344551+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.Lku_QqV5pF5O_qZsoDMXeOC1bXwBrMX_0 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9633951868946474399', time=2024-09-14T13:31:30.048729+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.jLER5abSZJfloiqpg23sMwfAOgpG_8C_0 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5850348562237918711', time=2024-09-14T13:32:08.721057+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.489+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.jl6YZ7cEP88xXWXbQ3lkmpIKpkChcuP_0 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3401641918213114015', time=2024-09-14T13:32:11.552067+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.6-y0RfV_u9WENGXxy83B7xWaDjGQEO-_0 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1921679755217433522', time=2024-09-14T13:32:12.101523+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.ZgG5otDyEnDaH5NnY3aI-bedeb9d1n__0 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6033240434033855601', time=2024-09-14T13:32:45.744078+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.8wztOLwCwqIefseZMdJukYgU-Vr9xo6_0 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3512516969320709834', time=2024-09-14T13:32:45.787021+0000, chain.objs.size()=1 2024-09-14T11:38:02.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.kkKMzu0uou1OGH4-lCQrnW3bDh49ZmE_0 2024-09-14T11:38:02.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7902494998016856654', time=2024-09-14T13:32:45.795104+0000, chain.objs.size()=1 2024-09-14T11:38:02.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.0tMk30dJjF9xctV4UPTpFXTLeL3DcMj_0 2024-09-14T11:38:02.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3558523623153293986', time=2024-09-14T13:33:27.082126+0000, chain.objs.size()=1 2024-09-14T11:38:02.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.490+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.1QlKftgcvYOq_JMr7da2iWPLlYWRduy_0 2024-09-14T11:38:02.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8298687560627637553', time=2024-09-14T13:34:37.579929+0000, chain.objs.size()=1 2024-09-14T11:38:02.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.F9M4EyqAPzSHknwel2uxKbKdJyZsgCb_0 2024-09-14T11:38:02.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6066031052247820827', time=2024-09-14T13:34:37.580784+0000, chain.objs.size()=1 2024-09-14T11:38:02.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.wz2oxTg9DZD1dWLQ2ADxT67khHy_h3B_0 2024-09-14T11:38:02.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17446271115305849389', time=2024-09-14T13:35:14.288414+0000, chain.objs.size()=1 2024-09-14T11:38:02.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.2-qrQ3F8Azunutl3Wy9DAzGjw3jpiVH_0 2024-09-14T11:38:02.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10438612330098170773', time=2024-09-14T13:37:20.892285+0000, chain.objs.size()=1 2024-09-14T11:38:02.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.493+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.VIPLwMm3tKze06PS4tINd5I66IDYtyX_0 2024-09-14T11:38:02.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.496+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.498+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:38:02.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.499+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1984925730932589218', time=2024-09-14T13:28:59.631958+0000, chain.objs.size()=4 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.1 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.2 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.3 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11__multipart_foo.2~7nPSubKMz7TCa_b8HO8R2gfqw5xaNhH.4 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17194021848727709728', time=2024-09-14T13:30:54.742155+0000, chain.objs.size()=1 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.no_M9GQpkk18d1KbcdnUKsChgnpY6Vq_0 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16185174667209251413', time=2024-09-14T13:31:32.908006+0000, chain.objs.size()=1 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.AZkxro1tz7lDnRQ07gAsgFTQCINyrrZ_0 2024-09-14T11:38:02.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13590994749043983411', time=2024-09-14T13:32:49.261025+0000, chain.objs.size()=1 2024-09-14T11:38:02.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.ETs5h9fmnfyj2jEzfNuu-50D6fqSjJ1_0 2024-09-14T11:38:02.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7818285277498253512', time=2024-09-14T13:33:23.832740+0000, chain.objs.size()=1 2024-09-14T11:38:02.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.2u0GlIBY6rfNxG0opHamVDfOTpwuVwt_0 2024-09-14T11:38:02.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14114248700747761766', time=2024-09-14T13:34:41.873821+0000, chain.objs.size()=1 2024-09-14T11:38:02.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.500+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.QohZ_M1d-H1SaraNvw5h2PoLmExGktp_0 2024-09-14T11:38:02.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.504+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.507+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:38:02.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.508+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.508+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:38:02.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10561234786362021107', time=2024-09-14T13:28:59.592428+0000, chain.objs.size()=1 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4__shadow_.GFmcwL5mrqmRMbadaTm5RP3j11Rp5ii_0 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_SV9IsREU-pRLWwm5zavz6iX-acFnJ0D', time=2024-09-14T13:28:59.806366+0000, chain.objs.size()=1 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.LHKhLl0Ah8XwP6-1mxIqxv3tSTw16w-_0 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12099461084801670892', time=2024-09-14T13:30:16.377223+0000, chain.objs.size()=1 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.FOexqS2aZ6wFFAj_WN-a3_euBBdQrwi_0 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14960828375039590364', time=2024-09-14T13:30:18.397234+0000, chain.objs.size()=1 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.uAWT4txjXPgtRt-1TkNRcEXzQlsFYxX_0 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14105267177390118473', time=2024-09-14T13:30:18.398120+0000, chain.objs.size()=1 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.BO4_y6T4q6Y5yMj3DXW7tqmiJfViMja_0 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1981225935546925126', time=2024-09-14T13:30:52.245982+0000, chain.objs.size()=1 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.A8PnZV5caRXKjkePUttRS5PIpNy90IT_0 2024-09-14T11:38:02.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2385691625540867790', time=2024-09-14T13:30:56.912627+0000, chain.objs.size()=1 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.Rv9TETGA8JQiZcvZFAXzCoVKeFTRqDj_0 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13186826240900245958', time=2024-09-14T13:30:56.960042+0000, chain.objs.size()=1 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.auCx3Yipy7kpD4A7boxxTHvy1p84-uX_0 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11275999551390361965', time=2024-09-14T13:30:56.960779+0000, chain.objs.size()=1 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.aqDR470N5GEsEKgpp63E8E4zrqQwoOP_0 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.781312209155136394', time=2024-09-14T13:31:30.057375+0000, chain.objs.size()=1 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.S5S2ma4UJDvY15QHbudURID2PgowwRC_0 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17493065425059651199', time=2024-09-14T13:32:08.703349+0000, chain.objs.size()=1 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.Hi18-jkNluaH3hq2BJDlxE6VCWqJJ7M_0 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6681650540346084445', time=2024-09-14T13:32:12.070402+0000, chain.objs.size()=1 2024-09-14T11:38:02.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.509+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.TECEwE7NARuJVRc1-8x1Z-6Xn4TKxh__0 2024-09-14T11:38:02.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10959583963417858986', time=2024-09-14T13:32:12.071096+0000, chain.objs.size()=1 2024-09-14T11:38:02.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.489OFw55nfKF-PpZ4WJYWENzwQIqNj8_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7121147885536857651', time=2024-09-14T13:32:45.740057+0000, chain.objs.size()=1 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.JhNh-5DzxzXnR71RsUy8wpySEHhYART_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4601587062536530137', time=2024-09-14T13:33:23.850482+0000, chain.objs.size()=1 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.32__shadow_.VMu57kuz2RT-f5zk-ObX9Vz-Ztqq-ip_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.279185394826788797', time=2024-09-14T13:34:03.262710+0000, chain.objs.size()=1 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.st92us9b6aUA1cRKzbuiF05ceYbAqrb_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14504459628481389451', time=2024-09-14T13:34:03.306690+0000, chain.objs.size()=1 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.P7dTQEA8wQ1ETtPditDvsQZCM6B-gbJ_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2393377076540029775', time=2024-09-14T13:34:37.582972+0000, chain.objs.size()=1 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.slUm7n_9uKgm6I0fjQHvnplRvkUvBmY_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4875782555375431969', time=2024-09-14T13:34:40.289970+0000, chain.objs.size()=1 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.m97UOjZqApbEFyuFkYq7pMnl3DVRHYM_0 2024-09-14T11:38:02.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5894444370167305821', time=2024-09-14T13:34:41.788971+0000, chain.objs.size()=1 2024-09-14T11:38:02.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.512+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.2v53ExfMeViD36Z_lMTyjA28mX_0k6y_0 2024-09-14T11:38:02.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.514+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3501358473213715121', time=2024-09-14T13:34:41.871972+0000, chain.objs.size()=1 2024-09-14T11:38:02.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.514+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.wyGl3JI4VoChwuvEU27jWpmM6nkFW8V_0 2024-09-14T11:38:02.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.514+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11562016183813572066', time=2024-09-14T13:35:14.348517+0000, chain.objs.size()=1 2024-09-14T11:38:02.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.514+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.cQpeO7T2YjEB1TgDHlILLrDSlRgbiMT_0 2024-09-14T11:38:02.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.514+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17073756697268767389', time=2024-09-14T13:37:20.868277+0000, chain.objs.size()=1 2024-09-14T11:38:02.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.514+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.xLMuxpS37I8V9Z7oIpg9Rvl4E-uX6Y0_0 2024-09-14T11:38:02.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.517+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.520+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:38:02.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.521+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10206100016477111483', time=2024-09-14T13:30:52.248502+0000, chain.objs.size()=1 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.yG4jRFDpnUGucyIBeXFnkRcjdFmT02w_0 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11755228489664670001', time=2024-09-14T13:30:54.810471+0000, chain.objs.size()=1 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.dLuikBJorBPfid-6G-RlimuAUrPtfqp_0 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6997694260697627779', time=2024-09-14T13:31:32.996090+0000, chain.objs.size()=1 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.IOX4cPlgwciUAGXMGISxfKuBv_ROEKK_0 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.532729468885642949', time=2024-09-14T13:31:35.594528+0000, chain.objs.size()=1 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.8q-1r4H1PlCMxBLHzAgdxLBKo2tfpo0_0 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1727698294161537330', time=2024-09-14T13:31:35.664782+0000, chain.objs.size()=1 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.26__shadow_.YC6jnqPqufTsYiVAlozbSnWBlzC51Bc_0 2024-09-14T11:38:02.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6300851892348498670', time=2024-09-14T13:32:08.720460+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.WwsReUVTpjiHSN74uYxeXnEP5R_R1m8_0 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11139951068323562941', time=2024-09-14T13:32:08.721222+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.CFgduatxo-v_rk6LvHgk96aRo-k9KSx_0 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4616193967626160763', time=2024-09-14T13:32:12.069221+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.522+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.zC0yuOi8EtViUjUJ7MKVwyiDenVuZCG_0 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12417178822558937169', time=2024-09-14T13:32:12.101472+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.GOqbI2c_jZvV9pTPbtESZFnRXBqNg1N_0 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16621733875295060555', time=2024-09-14T13:32:12.116262+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.e76XElhxg7H4auIxQXO6sRNki9RxvKr_0 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1046220883529461481', time=2024-09-14T13:32:45.787021+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.Xu0mE6IhLXsuErwDCh8DrnWEODw66kL_0 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15074617680899612434', time=2024-09-14T13:32:51.295846+0000, chain.objs.size()=1 2024-09-14T11:38:02.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.523+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.OQVm_DcTVd1grU2mzozPzGArp5ledTa_0 2024-09-14T11:38:02.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.526+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7576324361318490270', time=2024-09-14T13:34:00.358102+0000, chain.objs.size()=1 2024-09-14T11:38:02.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.526+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_._moJSU4eD8bU9NJOkmas-zS07MXjvpr_0 2024-09-14T11:38:02.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.526+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1762421147383211478', time=2024-09-14T13:34:37.543555+0000, chain.objs.size()=1 2024-09-14T11:38:02.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.526+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.h92n5DTnqsbzWT9mgdu3sskX6LksNGD_0 2024-09-14T11:38:02.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.526+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16585497319871497626', time=2024-09-14T13:34:37.578597+0000, chain.objs.size()=1 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.526+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.tQpRWmme9EF5v_jyIIzAeRZ_yFhgQyQ_0 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.527+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15883943032730636942', time=2024-09-14T13:34:41.840991+0000, chain.objs.size()=1 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.527+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.2b0JXzTAT6GZR8ZkVOuMzbQoejUnWCV_0 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.527+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7977651900310277356', time=2024-09-14T13:34:41.889073+0000, chain.objs.size()=1 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.527+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.6SROhevv-ItGUksvIv5sgqQ5JWLHev8_0 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.527+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1370472969093005459', time=2024-09-14T13:35:14.336842+0000, chain.objs.size()=1 2024-09-14T11:38:02.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.527+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.LmozUg_u9YXl6KMf5kritKvSAlkmf_V_0 2024-09-14T11:38:02.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.530+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.533+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:38:02.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.534+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_NmqZt8X3HMrwRYiQrPlpFH0tI7MncOX', time=2024-09-14T13:28:59.745589+0000, chain.objs.size()=1 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.3Y7TnbR6P8-gFgZNVUpYVENFEYFQ5eG_0 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_r4KIJz8rpzYaHMlA3H8THxSINdTD2b-', time=2024-09-14T13:28:59.749575+0000, chain.objs.size()=1 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.Wz0Bh_XMBA5BmMz8WJ7M9C9ksj3o_pk_0 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15015341572374607369', time=2024-09-14T13:30:16.394091+0000, chain.objs.size()=1 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19__shadow_.8N7hiEOqjuJ-PI8vrut5zd2gwCjMOww_0 2024-09-14T11:38:02.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2290904619175422538', time=2024-09-14T13:30:18.364709+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.2yxjHw0IEj1pLl4srVOYi1F9tVgtYTq_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.667501215688039477', time=2024-09-14T13:30:52.245680+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.MQKygMDIi53bnLbx0yuUMKY2Fwpl7VN_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5409953241880173590', time=2024-09-14T13:30:52.246499+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.riff5mptfjYLoQZARQaiOOGyElfrM3S_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16643935871007275478', time=2024-09-14T13:32:08.764701+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.1Jt0YwLJNV8inzbJEg6IkyImHJt9_tz_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4204395697464991714', time=2024-09-14T13:32:51.245560+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.31__shadow_.eGNUkxVWKES79nBUHSapyl3YVu8l17L_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3560629831467718150', time=2024-09-14T13:33:27.025994+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.xDY1V3NbJuqWJQIVcu6YHn-KTAZkf5w_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5931717272802046073', time=2024-09-14T13:33:27.026748+0000, chain.objs.size()=1 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.ii6nyWtHPjD5NYprLjuy6KhsH7Ir5Ng_0 2024-09-14T11:38:02.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4151719383970069978', time=2024-09-14T13:34:00.346052+0000, chain.objs.size()=1 2024-09-14T11:38:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.x7pM_JZ511--qGtA2ngzR8NDGzxUOgL_0 2024-09-14T11:38:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5973114512334538052', time=2024-09-14T13:34:03.303769+0000, chain.objs.size()=1 2024-09-14T11:38:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.535+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.d1xF_oRuCJ8SeIP67jvGJxNTb-X8uQ2_0 2024-09-14T11:38:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.537+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1225460576467295454', time=2024-09-14T13:34:40.333483+0000, chain.objs.size()=1 2024-09-14T11:38:02.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.537+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.Xj8ztTiSbfjdPzPud_KIj8OzKqmkniO_0 2024-09-14T11:38:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.539+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2177117508060863434', time=2024-09-14T13:37:20.851905+0000, chain.objs.size()=1 2024-09-14T11:38:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.539+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_._tWvp0UtvjpSMD8iPPRvweLQLVbhggZ_0 2024-09-14T11:38:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.539+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6834123963731116576', time=2024-09-14T13:37:20.866937+0000, chain.objs.size()=1 2024-09-14T11:38:02.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.539+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.JB5jG4niudvTFhINBozh8LMQMgAR8cZ_0 2024-09-14T11:38:02.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.542+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.545+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:38:02.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.546+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.546+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.546+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:38:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.546+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_HeHWscBBFl-YFzP8bHr_dvRrLpw-_LT', time=2024-09-14T13:28:59.720353+0000, chain.objs.size()=1 2024-09-14T11:38:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.546+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15__shadow_.GNHK22LzSiHmTOKffueWqwLrFtKIGDf_0 2024-09-14T11:38:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_OMYY34WCSxH40BxrC7HAMzQiL5j-rpb', time=2024-09-14T13:28:59.798253+0000, chain.objs.size()=2 2024-09-14T11:38:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.mihM9EZGqpM2wBs5CLGrS-TPn0nIiXB_0 2024-09-14T11:38:02.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.mihM9EZGqpM2wBs5CLGrS-TPn0nIiXB_1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6258538209145122170', time=2024-09-14T13:30:18.422803+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.20__shadow_.b4NNntLFQIAxR_sE17ROOrghhwZVJhu_0 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17414322890652148338', time=2024-09-14T13:30:52.217670+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.ATHxiwB7wVV2LTr2IKFVxypcP0FWJ9K_0 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16646749414430957388', time=2024-09-14T13:30:52.307008+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.21__shadow_.uZINU32ROSghTKHuO8qIlE2tT5oobAP_0 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9090305014567214117', time=2024-09-14T13:30:56.965980+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23__shadow_.rmgYM977QZ_718_oGPlGJRdsivf3NOj_0 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2263770963835106462', time=2024-09-14T13:31:30.045160+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.Ok3wAjuZJyPxslnLE0vLtmjNYS6YuF7_0 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11885502425617999507', time=2024-09-14T13:31:32.943771+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.S3XLfCZcF-fw4QNsevzXUbXuY3LVXmQ_0 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5188741371998551860', time=2024-09-14T13:32:12.059354+0000, chain.objs.size()=1 2024-09-14T11:38:02.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.5YTbIzscJ5m81965fAV0Tv6Awrzot07_0 2024-09-14T11:38:02.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11676916219857945214', time=2024-09-14T13:32:12.059945+0000, chain.objs.size()=1 2024-09-14T11:38:02.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28__shadow_.jbb8EkyTwqWP0p6XoLfF5jXx8jnl-xZ_0 2024-09-14T11:38:02.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1147141930731725710', time=2024-09-14T13:32:45.728553+0000, chain.objs.size()=1 2024-09-14T11:38:02.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.547+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.duyborh1UQYPh6bLgLOZ7hM1KOIYLJa_0 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.382886321235616902', time=2024-09-14T13:33:26.973798+0000, chain.objs.size()=1 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.HjSTY2_ugp6RhmvJyHnN18FhNmOCkyZ_0 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1976594835787241753', time=2024-09-14T13:34:03.241100+0000, chain.objs.size()=1 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.35__shadow_.sFBwPLyijxfiz1bawKm1tCRy-5wL2FJ_0 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16906272265043845005', time=2024-09-14T13:34:37.574285+0000, chain.objs.size()=1 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.36__shadow_.sOBvcmnnTsAaNwi5JntMRVMX1T2I64j_0 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8058208711820589949', time=2024-09-14T13:34:41.792852+0000, chain.objs.size()=1 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.LqvABaDdmcOqtx816LKxv-t7l8bviVo_0 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3464289215899449212', time=2024-09-14T13:37:20.861800+0000, chain.objs.size()=1 2024-09-14T11:38:02.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.550+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17__shadow_.TV0ky2l0VjYRCre_yMckNYN_yWCfGER_0 2024-09-14T11:38:02.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.553+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.556+0000 7fbf0932c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:38:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.557+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='_e6LPYuQSECwNqPXUDBGbXo7d2fsDsOt', time=2024-09-14T13:28:59.782213+0000, chain.objs.size()=2 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.zIl3asmJhpYG8dKPMiVBnD7Vw-PjzWp_0 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16__shadow_.zIl3asmJhpYG8dKPMiVBnD7Vw-PjzWp_1 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12529201841508755892', time=2024-09-14T13:28:59.948330+0000, chain.objs.size()=1 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8__shadow_.nEOujBPdwmGfNwiZMuPkoqGdSsCzHQT_0 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16228680234639114667', time=2024-09-14T13:30:54.786973+0000, chain.objs.size()=1 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.22__shadow_.cDWfFy-zFitHjf0lepWACtqQzvzghwS_0 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13229230741897779828', time=2024-09-14T13:31:30.013083+0000, chain.objs.size()=1 2024-09-14T11:38:02.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.24__shadow_.EhGDjBdmF-4RTLHTbjW1XBCz83k5taB_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5709822656691370253', time=2024-09-14T13:31:32.967945+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.25__shadow_.i6rhjnLhNJszCcCUHG3kXsGj0MJeJmJ_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3597672326631338773', time=2024-09-14T13:32:08.733657+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.27__shadow_.7KPUQ9OrmDnwDeLwds6NzuVYDG1bcBB_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16677496361691190263', time=2024-09-14T13:32:45.779222+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.29__shadow_.J9152Um_JAqi8XuNtP4yjiRZB8eORKH_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12884968133294431003', time=2024-09-14T13:32:49.284383+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30__shadow_.jHSy3pFrJkaep8W5qcgDFsLxZwMjL8Z_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14182704121717132330', time=2024-09-14T13:33:27.028222+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.XKICf2hv3bnOmJraChcp9yIXZzxxtDR_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3177019334424307882', time=2024-09-14T13:33:27.028977+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.1Ph8tJeo9nJG1yy8xJCH3fh9Ns04zBH_0 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6735751033191527557', time=2024-09-14T13:33:27.064489+0000, chain.objs.size()=1 2024-09-14T11:38:02.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.558+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.33__shadow_.oMEAYIBxCBoWcXskqGY38RDxHIQcx4z_0 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8304210126480419798', time=2024-09-14T13:34:00.352928+0000, chain.objs.size()=1 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.wT29-91xHkhoX1GQ81PIyrCWjOpE_HE_0 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6995007419800689675', time=2024-09-14T13:34:00.353827+0000, chain.objs.size()=1 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.34__shadow_.r9hoWsRDPYba1o2jxefTvmj2fnmGF8f_0 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7213330908015359704', time=2024-09-14T13:34:40.263496+0000, chain.objs.size()=1 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.TpHefUNZbNU0AasBXkDlqp0MO1gejLH_0 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.412383343774602986', time=2024-09-14T13:34:40.302516+0000, chain.objs.size()=1 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.37__shadow_.B1Fh2vqFzAJkjMQ2rl-LmoJxgJHeHmF_0 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4817708417886541399', time=2024-09-14T13:34:41.845515+0000, chain.objs.size()=1 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.CFE-eaMDgSUuJ9qR821PhJKWCjan0Nd_0 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12453768433499491463', time=2024-09-14T13:34:41.862237+0000, chain.objs.size()=1 2024-09-14T11:38:02.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.38__shadow_.SgYdoLTA4rllRQTTsgbaZmVQtHRyjK7_0 2024-09-14T11:38:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.57770446564812316', time=2024-09-14T13:35:14.282443+0000, chain.objs.size()=1 2024-09-14T11:38:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.QUbhPggVgHQ_HNP3Y1-y_QthMv3icok_0 2024-09-14T11:38:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4669953057292053682', time=2024-09-14T13:35:14.358086+0000, chain.objs.size()=1 2024-09-14T11:38:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.YUmgjbhfDr5XQSzCNu2l-xQ_5Bm6HOD_0 2024-09-14T11:38:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10675744924371648028', time=2024-09-14T13:35:14.363052+0000, chain.objs.size()=1 2024-09-14T11:38:02.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.562+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.39__shadow_.ccDluKr1FVy03sYYGQhlZK6cnTEOEvM_0 2024-09-14T11:38:02.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.567+0000 7fbf0932c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:02.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.570+0000 7fbdbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:02.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.572+0000 7fbf0932c800 20 remove_watcher() i=0 2024-09-14T11:38:02.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.572+0000 7fbf0932c800 2 removed watcher, disabling cache 2024-09-14T11:38:02.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.573+0000 7fbf0932c800 20 remove_watcher() i=1 2024-09-14T11:38:02.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.574+0000 7fbf0932c800 20 remove_watcher() i=2 2024-09-14T11:38:02.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.575+0000 7fbf0932c800 20 remove_watcher() i=3 2024-09-14T11:38:02.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.576+0000 7fbf0932c800 20 remove_watcher() i=4 2024-09-14T11:38:02.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.577+0000 7fbf0932c800 20 remove_watcher() i=5 2024-09-14T11:38:02.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.578+0000 7fbf0932c800 20 remove_watcher() i=6 2024-09-14T11:38:02.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.579+0000 7fbf0932c800 20 remove_watcher() i=7 2024-09-14T11:38:02.589 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:38:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:02.682 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:02.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.724+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.725+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.725+0000 7f902a51f800 20 realm 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.725+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.726+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.726+0000 7f902a51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.726+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.726+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.726+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.727+0000 7f902a51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.727+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.727+0000 7f902a51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.727+0000 7f902a51f800 20 searching for the correct realm 2024-09-14T11:38:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.730+0000 7f9025aa1640 0 -- 172.21.15.28:0/3217077926 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f9018008070 msgr2=0x7f9018008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:02.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.733+0000 7f90262a2640 0 -- 172.21.15.28:0/3217077926 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f901c07bc40 msgr2=0x7f901c065870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:02.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:02.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.941+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 zone default found 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 4 Realm: () 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 zonegroup default 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados->read ofs=0 len=0 2024-09-14T11:38:02.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:02.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 started sync module instance, tier type = 2024-09-14T11:38:02.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.942+0000 7f902a51f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:38:02.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=0 2024-09-14T11:38:02.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=1 2024-09-14T11:38:02.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=2 2024-09-14T11:38:02.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=3 2024-09-14T11:38:02.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=4 2024-09-14T11:38:02.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=5 2024-09-14T11:38:02.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.951+0000 7f902a51f800 20 add_watcher() i=6 2024-09-14T11:38:02.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.952+0000 7f902a51f800 20 add_watcher() i=7 2024-09-14T11:38:02.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.952+0000 7f902a51f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:02.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.954+0000 7f8edcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:02.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.954+0000 7f902a51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:02.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.954+0000 7f902a51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.989+0000 7f8e577fe640 20 reqs_thread_entry: start 2024-09-14T11:38:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.989+0000 7f902a51f800 20 init_complete bucket index max shards: 1 2024-09-14T11:38:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.989+0000 7f902a51f800 20 Filter name: none 2024-09-14T11:38:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.989+0000 7f8e557fa640 20 reqs_thread_entry: start 2024-09-14T11:38:02.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.989+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:38:02.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.991+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.991+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.991+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.992+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:38:02.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.993+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.994+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.994+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.995+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:38:02.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.997+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.997+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.997+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:02.998+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:38:02.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.001+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:02.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.001+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:02.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.002+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.003+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:38:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.004+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.005+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.005+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.006+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:38:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.007+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.008+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.008+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.009+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:38:03.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.010+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.010+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.011+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.012+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:38:03.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.013+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.014+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.015+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.016+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:38:03.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.017+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.017+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.018+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.019+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:38:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.020+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.020+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.021+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.022+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:38:03.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.023+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.023+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.024+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.025+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:38:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.026+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.027+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.027+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.028+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:38:03.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.029+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.029+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.030+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.031+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:38:03.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.032+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.033+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.033+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.034+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:38:03.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.035+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.036+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.036+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.037+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:38:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.038+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.038+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.038+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.039+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:38:03.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.041+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.041+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.041+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.043+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:38:03.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.044+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.045+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.045+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.046+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:38:03.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.047+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.048+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.048+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.049+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:38:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.050+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.051+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.051+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.052+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:38:03.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.053+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.053+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.054+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.054+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:38:03.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.056+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.056+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.057+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.057+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:38:03.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.059+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.059+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.059+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.061+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:38:03.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.062+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.062+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.063+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.064+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:38:03.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.065+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.065+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.065+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.067+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:38:03.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.068+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.068+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.069+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.070+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:38:03.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.071+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.071+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.072+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.073+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:38:03.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.074+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.074+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.074+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.075+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:38:03.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.077+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.077+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.077+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.078+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:38:03.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.080+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.080+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.081+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.082+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:38:03.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.083+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.084+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.084+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.085+0000 7f902a51f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:38:03.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.086+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.086+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:03.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.087+0000 7f902a51f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:03.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.089+0000 7f8edcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:03.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.091+0000 7f902a51f800 20 remove_watcher() i=0 2024-09-14T11:38:03.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.091+0000 7f902a51f800 2 removed watcher, disabling cache 2024-09-14T11:38:03.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.092+0000 7f902a51f800 20 remove_watcher() i=1 2024-09-14T11:38:03.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.093+0000 7f902a51f800 20 remove_watcher() i=2 2024-09-14T11:38:03.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.094+0000 7f902a51f800 20 remove_watcher() i=3 2024-09-14T11:38:03.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.095+0000 7f902a51f800 20 remove_watcher() i=4 2024-09-14T11:38:03.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.096+0000 7f902a51f800 20 remove_watcher() i=5 2024-09-14T11:38:03.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.097+0000 7f902a51f800 20 remove_watcher() i=6 2024-09-14T11:38:03.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:38:03.098+0000 7f902a51f800 20 remove_watcher() i=7 2024-09-14T11:38:03.108 DEBUG:teuthology.orchestra.run.smithi028:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:38:03.612 INFO:teuthology.orchestra.run.smithi028.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:38:07.212 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:38:25.410 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :compileJava 2024-09-14T11:38:25.411 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :processResources 2024-09-14T11:38:25.411 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :classes 2024-09-14T11:38:26.110 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:26.110 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :compileTestJava 2024-09-14T11:38:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:38:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:38:26.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:26.210 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:38:26.211 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :testClasses 2024-09-14T11:38:32.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:32.210 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :test 2024-09-14T11:38:32.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:32.211 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:38:45.310 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:45.310 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:38:45.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:45.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:38:45.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:45.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:38:46.010 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:46.010 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:38:51.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:51.210 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:38:51.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:51.510 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:38:51.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:51.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:38:51.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:51.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:38:51.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:51.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:38:52.110 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:52.110 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:38:56.010 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:56.010 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:38:56.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:56.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:38:56.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:38:56.910 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:38:56.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14 11:38:56,813 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:39:38.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:38.511 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:39:39.110 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:39.110 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:39:39.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:39.210 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:39:39.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:39.510 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:39:39.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:39.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:39:40.112 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:40.112 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:39:44.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:44.210 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:39:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:44.510 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:39:44.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:44.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:39:44.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:44.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:39:50.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:50.611 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:39:50.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:39:50.910 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:40:07.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:40:07.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:40:08.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:40:08.210 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:40:10.310 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:40:10.310 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:40:10.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:40:10.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:41:04.011 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:04.011 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:41:04.410 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:04.410 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:41:09.010 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:09.010 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:41:09.410 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:09.410 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:41:13.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:13.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:41:14.110 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:14.110 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:41:15.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:15.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:41:22.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:22.810 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:41:22.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:22.910 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:41:23.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:23.210 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:41:23.310 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:23.310 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:41:23.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:23.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:41:23.810 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:23.810 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:41:24.110 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:24.110 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:41:24.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:24.210 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:41:24.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:24.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:41:24.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:24.710 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:41:25.010 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:25.010 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:41:25.110 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:25.110 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:41:25.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:25.510 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:41:25.610 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:25.610 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:41:25.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:25.910 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:41:34.910 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:34.910 INFO:teuthology.orchestra.run.smithi028.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:41:35.311 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:35.311 INFO:teuthology.orchestra.run.smithi028.stdout:---------------------------------------------------------------------- 2024-09-14T11:41:35.311 INFO:teuthology.orchestra.run.smithi028.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:41:35.311 INFO:teuthology.orchestra.run.smithi028.stdout:---------------------------------------------------------------------- 2024-09-14T11:41:35.362 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:35.363 INFO:teuthology.orchestra.run.smithi028.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:41:35.363 INFO:teuthology.orchestra.run.smithi028.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:41:35.363 INFO:teuthology.orchestra.run.smithi028.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:41:35.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:35.363 INFO:teuthology.orchestra.run.smithi028.stdout:BUILD SUCCESSFUL in 3m 32s 2024-09-14T11:41:35.363 INFO:teuthology.orchestra.run.smithi028.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:41:35.680 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:35.734 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:35.734 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:35.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.776+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 realm 2024-09-14T11:41:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.778+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.779+0000 7f468d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.779+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:35.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.779+0000 7f468d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:35.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.779+0000 7f468d12c800 20 searching for the correct realm 2024-09-14T11:41:35.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.782+0000 7f468853d640 0 -- 172.21.15.28:0/837685026 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f4678074070 msgr2=0x7f4678003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:35.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:35.988+0000 7f4688d3e640 0 -- 172.21.15.28:0/837685026 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f467c02d8e0 msgr2=0x7f467c0393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:36.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.194+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:36.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 zone default found 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 4 Realm: () 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 zonegroup default 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.195+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.196+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.196+0000 7f468d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.196+0000 7f468d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.196+0000 7f468d12c800 20 started sync module instance, tier type = 2024-09-14T11:41:36.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.196+0000 7f468d12c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:36.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=0 2024-09-14T11:41:36.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=1 2024-09-14T11:41:36.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=2 2024-09-14T11:41:36.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=3 2024-09-14T11:41:36.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=4 2024-09-14T11:41:36.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=5 2024-09-14T11:41:36.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.205+0000 7f468d12c800 20 add_watcher() i=6 2024-09-14T11:41:36.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.206+0000 7f468d12c800 20 add_watcher() i=7 2024-09-14T11:41:36.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.206+0000 7f468d12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:36.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.208+0000 7f453efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.208+0000 7f468d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:36.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.208+0000 7f468d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:36.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.246+0000 7f453dfe3640 20 reqs_thread_entry: start 2024-09-14T11:41:36.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.246+0000 7f468d12c800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:36.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.246+0000 7f468d12c800 20 Filter name: none 2024-09-14T11:41:36.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.246+0000 7f44af7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:36.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.247+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:36.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.248+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12325898967903502385', time=2024-09-14T13:39:38.868069+0000, chain.objs.size()=5 2024-09-14T11:41:36.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~w8Y_uNxj7AojuCxjG7bZ8NmJiMFcBeL.1 2024-09-14T11:41:36.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__shadow_key1.2~w8Y_uNxj7AojuCxjG7bZ8NmJiMFcBeL.1_1 2024-09-14T11:41:36.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~w8Y_uNxj7AojuCxjG7bZ8NmJiMFcBeL.2 2024-09-14T11:41:36.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__shadow_key1.2~w8Y_uNxj7AojuCxjG7bZ8NmJiMFcBeL.2_1 2024-09-14T11:41:36.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.249+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~w8Y_uNxj7AojuCxjG7bZ8NmJiMFcBeL.3 2024-09-14T11:41:36.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.253+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.255+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:36.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.256+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.256+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4333618485634038627', time=2024-09-14T13:41:04.139860+0000, chain.objs.size()=11 2024-09-14T11:41:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.1 2024-09-14T11:41:36.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.1_1 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.2 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.2_1 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.3 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.3_1 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.4 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.4_1 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.5 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.5_1 2024-09-14T11:41:36.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.257+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~X8gwo68o68sersbeXQ-lWy43R267KH3.6 2024-09-14T11:41:36.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.262+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.265+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:36.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.266+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2525087366023948714', time=2024-09-14T13:39:20.241518+0000, chain.objs.size()=5 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~d7aHzSsxURK-uOPhzO63iya2SMykHW1.1 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~d7aHzSsxURK-uOPhzO63iya2SMykHW1.2 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~d7aHzSsxURK-uOPhzO63iya2SMykHW1.3 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~d7aHzSsxURK-uOPhzO63iya2SMykHW1.4 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~d7aHzSsxURK-uOPhzO63iya2SMykHW1.5 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17436992476670531734', time=2024-09-14T13:40:07.978740+0000, chain.objs.size()=1 2024-09-14T11:41:36.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.267+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__shadow_.lEv4KY6Xc9o3SHHEhAwEfiIWijSUH4M_0 2024-09-14T11:41:36.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.271+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.274+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:36.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.275+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.275+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.275+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.276+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:36.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.278+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.278+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18335816243483574505', time=2024-09-14T13:38:56.144712+0000, chain.objs.size()=5 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.1 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.2 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.3 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.4 2024-09-14T11:41:36.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.5 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:18.460499+0000, chain.objs.size()=40 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.1 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.2 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.3 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.4 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.5 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.6 2024-09-14T11:41:36.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.279+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.7 2024-09-14T11:41:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.8 2024-09-14T11:41:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.9 2024-09-14T11:41:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.10 2024-09-14T11:41:36.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.11 2024-09-14T11:41:36.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.12 2024-09-14T11:41:36.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.13 2024-09-14T11:41:36.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.282+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.14 2024-09-14T11:41:36.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.283+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.15 2024-09-14T11:41:36.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.283+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.16 2024-09-14T11:41:36.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.283+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.17 2024-09-14T11:41:36.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.284+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.18 2024-09-14T11:41:36.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.285+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.19 2024-09-14T11:41:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.286+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.20 2024-09-14T11:41:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.286+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.21 2024-09-14T11:41:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.286+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.22 2024-09-14T11:41:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.286+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.23 2024-09-14T11:41:36.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.286+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.24 2024-09-14T11:41:36.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.286+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.25 2024-09-14T11:41:36.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.288+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.26 2024-09-14T11:41:36.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.288+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.27 2024-09-14T11:41:36.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.288+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.28 2024-09-14T11:41:36.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.288+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.29 2024-09-14T11:41:36.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.289+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.30 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.31 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.32 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.33 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.34 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.35 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.36 2024-09-14T11:41:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.290+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.37 2024-09-14T11:41:36.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.292+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.38 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.39 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.40 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:18.787390+0000, chain.objs.size()=3 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.41 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.42 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.43 2024-09-14T11:41:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.295+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:19.455484+0000, chain.objs.size()=7 2024-09-14T11:41:36.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.296+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.44 2024-09-14T11:41:36.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.296+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.45 2024-09-14T11:41:36.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.296+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.46 2024-09-14T11:41:36.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.296+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.47 2024-09-14T11:41:36.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.297+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.48 2024-09-14T11:41:36.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.297+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.49 2024-09-14T11:41:36.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.298+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.50 2024-09-14T11:41:36.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:19.895707+0000, chain.objs.size()=6 2024-09-14T11:41:36.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.51 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.52 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.53 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.54 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.55 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.56 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:20.416114+0000, chain.objs.size()=5 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.57 2024-09-14T11:41:36.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.299+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.58 2024-09-14T11:41:36.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.301+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.59 2024-09-14T11:41:36.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.301+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.60 2024-09-14T11:41:36.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.301+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.61 2024-09-14T11:41:36.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.302+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:21.035181+0000, chain.objs.size()=6 2024-09-14T11:41:36.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.302+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.62 2024-09-14T11:41:36.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.303+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.63 2024-09-14T11:41:36.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.303+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.64 2024-09-14T11:41:36.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.303+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.65 2024-09-14T11:41:36.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.303+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.66 2024-09-14T11:41:36.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.67 2024-09-14T11:41:36.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:21.816536+0000, chain.objs.size()=10 2024-09-14T11:41:36.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.68 2024-09-14T11:41:36.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.69 2024-09-14T11:41:36.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.70 2024-09-14T11:41:36.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.71 2024-09-14T11:41:36.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.72 2024-09-14T11:41:36.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.73 2024-09-14T11:41:36.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.305+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.74 2024-09-14T11:41:36.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.307+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.75 2024-09-14T11:41:36.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.307+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.76 2024-09-14T11:41:36.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.307+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.77 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:22.296915+0000, chain.objs.size()=6 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.78 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.79 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.80 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.81 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.82 2024-09-14T11:41:36.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.83 2024-09-14T11:41:36.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:22.540507+0000, chain.objs.size()=4 2024-09-14T11:41:36.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.84 2024-09-14T11:41:36.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.310+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.85 2024-09-14T11:41:36.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.311+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.86 2024-09-14T11:41:36.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.311+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.87 2024-09-14T11:41:36.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.311+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk', time=2024-09-14T13:41:22.633935+0000, chain.objs.size()=5 2024-09-14T11:41:36.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.311+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.88 2024-09-14T11:41:36.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.315+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.89 2024-09-14T11:41:36.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.315+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.90 2024-09-14T11:41:36.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.315+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.91 2024-09-14T11:41:36.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.315+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.58__multipart_key1.2~6ld0FcozzmYFIPdaWaWc0JvjL1bXvvk.92 2024-09-14T11:41:36.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.318+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.320+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:36.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~mwsgXhRopRZmBNc-P2pzwB_4642Ig1X', time=2024-09-14T13:38:45.206556+0000, chain.objs.size()=5 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.40__multipart_key1.2~mwsgXhRopRZmBNc-P2pzwB_4642Ig1X.1 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.40__multipart_key1.2~mwsgXhRopRZmBNc-P2pzwB_4642Ig1X.2 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.322+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.40__multipart_key1.2~mwsgXhRopRZmBNc-P2pzwB_4642Ig1X.3 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.40__multipart_key1.2~mwsgXhRopRZmBNc-P2pzwB_4642Ig1X.4 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.40__multipart_key1.2~mwsgXhRopRZmBNc-P2pzwB_4642Ig1X.5 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15075476103403240995', time=2024-09-14T13:39:07.616960+0000, chain.objs.size()=5 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~dbogHflVqhi4qL8ctyfXSPAdwchegEU.1 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~dbogHflVqhi4qL8ctyfXSPAdwchegEU.2 2024-09-14T11:41:36.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~dbogHflVqhi4qL8ctyfXSPAdwchegEU.3 2024-09-14T11:41:36.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~dbogHflVqhi4qL8ctyfXSPAdwchegEU.4 2024-09-14T11:41:36.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~dbogHflVqhi4qL8ctyfXSPAdwchegEU.5 2024-09-14T11:41:36.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.270989167287348509', time=2024-09-14T13:41:23.006536+0000, chain.objs.size()=1 2024-09-14T11:41:36.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.323+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.59__shadow_.GdY-qmZsHiuMKOgJSJPIU06Gq2KW9bo_0 2024-09-14T11:41:36.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.328+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.330+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:36.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.331+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.332+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.332+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.333+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:36.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.334+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.335+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.335+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.335+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6373819568254966328', time=2024-09-14T13:41:24.334483+0000, chain.objs.size()=1 2024-09-14T11:41:36.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.335+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.62__shadow_.S7d9SPS7mJIc9FbIXLEs67toY-P_TWd_0 2024-09-14T11:41:36.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.336+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.338+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:36.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13470741932827643104', time=2024-09-14T13:41:13.824855+0000, chain.objs.size()=5 2024-09-14T11:41:36.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.57__multipart_key1.2~1REjhngGcGtDRiX2hEk8FNsP6C9oWiJ.1 2024-09-14T11:41:36.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.57__multipart_key1.2~1REjhngGcGtDRiX2hEk8FNsP6C9oWiJ.2 2024-09-14T11:41:36.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.57__multipart_key1.2~1REjhngGcGtDRiX2hEk8FNsP6C9oWiJ.3 2024-09-14T11:41:36.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.57__multipart_key1.2~1REjhngGcGtDRiX2hEk8FNsP6C9oWiJ.4 2024-09-14T11:41:36.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.340+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.57__multipart_key1.2~1REjhngGcGtDRiX2hEk8FNsP6C9oWiJ.5 2024-09-14T11:41:36.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.344+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.346+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:36.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.347+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15742651854660109251', time=2024-09-14T13:40:47.051039+0000, chain.objs.size()=10 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.1 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.2 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.3 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.4 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.5 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.6 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.7 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.8 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.9 2024-09-14T11:41:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.348+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~_UiKXTqzF5EM44tUhx-24wBOoW2Z6RY.10 2024-09-14T11:41:36.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.353+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.355+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.357+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.357+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.357+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.357+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13670313857258144042', time=2024-09-14T13:41:23.892558+0000, chain.objs.size()=1 2024-09-14T11:41:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.357+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.61__shadow_.g-KqWgmhoPfA5-i9_JRQwGujMz8v1sB_0 2024-09-14T11:41:36.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.358+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.361+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:36.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.362+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.363+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.363+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.364+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:36.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.365+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1813200290257820876', time=2024-09-14T13:38:51.299521+0000, chain.objs.size()=5 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.42__multipart_key1.2~010K5FfugRzjJvasYnikHCaCb9MHI7n.1 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.42__multipart_key1.2~010K5FfugRzjJvasYnikHCaCb9MHI7n.2 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.42__multipart_key1.2~010K5FfugRzjJvasYnikHCaCb9MHI7n.3 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.42__multipart_key1.2~010K5FfugRzjJvasYnikHCaCb9MHI7n.4 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.42__multipart_key1.2~010K5FfugRzjJvasYnikHCaCb9MHI7n.5 2024-09-14T11:41:36.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2955345090515118016', time=2024-09-14T13:39:35.558501+0000, chain.objs.size()=5 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~zPNW2KiWJW8Dp4FkbQaHL6q7iRA9nJA.1 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.366+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__shadow_key1.2~zPNW2KiWJW8Dp4FkbQaHL6q7iRA9nJA.1_1 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.367+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~zPNW2KiWJW8Dp4FkbQaHL6q7iRA9nJA.2 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.367+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__shadow_key1.2~zPNW2KiWJW8Dp4FkbQaHL6q7iRA9nJA.2_1 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.367+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~zPNW2KiWJW8Dp4FkbQaHL6q7iRA9nJA.3 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.367+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12913288475910137573', time=2024-09-14T13:39:50.651134+0000, chain.objs.size()=5 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.367+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.52__multipart_key1.2~rW-V9QbQUqh3z_DCZxxcSW3BVqZQi5o.1 2024-09-14T11:41:36.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.367+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.52__multipart_key1.2~rW-V9QbQUqh3z_DCZxxcSW3BVqZQi5o.2 2024-09-14T11:41:36.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.369+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.52__multipart_key1.2~rW-V9QbQUqh3z_DCZxxcSW3BVqZQi5o.3 2024-09-14T11:41:36.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.370+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.52__multipart_key1.2~rW-V9QbQUqh3z_DCZxxcSW3BVqZQi5o.4 2024-09-14T11:41:36.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.370+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.52__multipart_key1.2~rW-V9QbQUqh3z_DCZxxcSW3BVqZQi5o.5 2024-09-14T11:41:36.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.374+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.377+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:36.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.378+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.378+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.378+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.378+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17444812880893161145', time=2024-09-14T13:39:44.291181+0000, chain.objs.size()=5 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.51__multipart_key1.2~O3LADBG8DaXbKRGP2ZGYkch7P9IH4sv.1 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.51__multipart_key1.2~O3LADBG8DaXbKRGP2ZGYkch7P9IH4sv.2 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.51__multipart_key1.2~O3LADBG8DaXbKRGP2ZGYkch7P9IH4sv.3 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.51__multipart_key1.2~O3LADBG8DaXbKRGP2ZGYkch7P9IH4sv.4 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.51__multipart_key1.2~O3LADBG8DaXbKRGP2ZGYkch7P9IH4sv.5 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='2~XyjsOJNMggrhRk9hnHNpECGQMfsRGkK', time=2024-09-14T13:40:10.523740+0000, chain.objs.size()=3 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.54__multipart_key1.2~XyjsOJNMggrhRk9hnHNpECGQMfsRGkK.7 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.54__multipart_key1.2~XyjsOJNMggrhRk9hnHNpECGQMfsRGkK.10 2024-09-14T11:41:36.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.379+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.54__multipart_key1.2~XyjsOJNMggrhRk9hnHNpECGQMfsRGkK.13 2024-09-14T11:41:36.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.383+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.385+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:36.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.386+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.387+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.387+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.388+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:36.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.389+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7753547562068325060', time=2024-09-14T13:40:07.867331+0000, chain.objs.size()=5 2024-09-14T11:41:36.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file.mpg.2~FiWL8JRlm5naOD35TYBdaxBvpnSFTeb.1 2024-09-14T11:41:36.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file.mpg.2~FiWL8JRlm5naOD35TYBdaxBvpnSFTeb.2 2024-09-14T11:41:36.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file.mpg.2~FiWL8JRlm5naOD35TYBdaxBvpnSFTeb.3 2024-09-14T11:41:36.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file.mpg.2~FiWL8JRlm5naOD35TYBdaxBvpnSFTeb.4 2024-09-14T11:41:36.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.390+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file.mpg.2~FiWL8JRlm5naOD35TYBdaxBvpnSFTeb.5 2024-09-14T11:41:36.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.394+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.396+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:36.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.398+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.398+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17118036414989465772', time=2024-09-14T13:40:29.086965+0000, chain.objs.size()=11 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.1 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.2 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.3 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.4 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.5 2024-09-14T11:41:36.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.6 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.7 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.8 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.9 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.10 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~gfsK-Hjvj_qtQiXJt5MvKGu230sJoTc.11 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2884532472115862107', time=2024-09-14T13:40:55.452994+0000, chain.objs.size()=11 2024-09-14T11:41:36.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.399+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.1 2024-09-14T11:41:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.402+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.1_1 2024-09-14T11:41:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.402+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.2 2024-09-14T11:41:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.402+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.2_1 2024-09-14T11:41:36.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.402+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.3 2024-09-14T11:41:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.405+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.3_1 2024-09-14T11:41:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.405+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.4 2024-09-14T11:41:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.405+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.4_1 2024-09-14T11:41:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.405+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.5 2024-09-14T11:41:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.405+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.5_1 2024-09-14T11:41:36.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.405+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~4zgVFGW9Voa90b9IR8PUofCr0EWRENi.6 2024-09-14T11:41:36.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.409+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.412+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:36.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.413+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.413+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.333144590732409515', time=2024-09-14T13:39:38.419758+0000, chain.objs.size()=5 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~LFdp1769TTjaHbuHz3G_f6dF9LD1_u8.1 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__shadow_key1.2~LFdp1769TTjaHbuHz3G_f6dF9LD1_u8.1_1 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~LFdp1769TTjaHbuHz3G_f6dF9LD1_u8.2 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__shadow_key1.2~LFdp1769TTjaHbuHz3G_f6dF9LD1_u8.2_1 2024-09-14T11:41:36.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~LFdp1769TTjaHbuHz3G_f6dF9LD1_u8.3 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7567419692707058941', time=2024-09-14T13:41:03.918765+0000, chain.objs.size()=11 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.1 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.1_1 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.2 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.2_1 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.3 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.3_1 2024-09-14T11:41:36.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.414+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.4 2024-09-14T11:41:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.419+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.4_1 2024-09-14T11:41:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.419+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.5 2024-09-14T11:41:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.419+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__shadow_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.5_1 2024-09-14T11:41:36.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.419+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~2TSluHY9voDMQBabZpgE4s5rL85jWB4.6 2024-09-14T11:41:36.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.422+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.425+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:36.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.426+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17404641808284404418', time=2024-09-14T13:39:32.408504+0000, chain.objs.size()=5 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~YzS6Hg2fIC4dNvAVqGrZ7eDHQDLLdRc.1 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~YzS6Hg2fIC4dNvAVqGrZ7eDHQDLLdRc.2 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~YzS6Hg2fIC4dNvAVqGrZ7eDHQDLLdRc.3 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~YzS6Hg2fIC4dNvAVqGrZ7eDHQDLLdRc.4 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.47__multipart_key1.2~YzS6Hg2fIC4dNvAVqGrZ7eDHQDLLdRc.5 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5919278342434885604', time=2024-09-14T13:40:07.941575+0000, chain.objs.size()=5 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file2.mpg.2~T4kJuww5KmkD8doGAhYknZ6m_bJ21MY.1 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file2.mpg.2~T4kJuww5KmkD8doGAhYknZ6m_bJ21MY.2 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file2.mpg.2~T4kJuww5KmkD8doGAhYknZ6m_bJ21MY.3 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file2.mpg.2~T4kJuww5KmkD8doGAhYknZ6m_bJ21MY.4 2024-09-14T11:41:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.427+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__multipart_file2.mpg.2~T4kJuww5KmkD8doGAhYknZ6m_bJ21MY.5 2024-09-14T11:41:36.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.432+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.435+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.436+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.436+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.991438303737620156', time=2024-09-14T13:40:38.599797+0000, chain.objs.size()=11 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.1 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.2 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.3 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.4 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.5 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.6 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.7 2024-09-14T11:41:36.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.8 2024-09-14T11:41:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.9 2024-09-14T11:41:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.10 2024-09-14T11:41:36.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.437+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.55__multipart_key1.2~J6Bwd3O2RLvV4VH83BOq2evEXvbYbM6.11 2024-09-14T11:41:36.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.442+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.445+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.446+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.447+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.447+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.447+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3905263858864431943', time=2024-09-14T13:41:23.451814+0000, chain.objs.size()=1 2024-09-14T11:41:36.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.447+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.60__shadow_.p-69hlOUM7742GzYIw56S8pIeJQBHnV_0 2024-09-14T11:41:36.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.448+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.450+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:36.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.452+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.452+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.452+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.453+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:36.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.454+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2341804247562947501', time=2024-09-14T13:41:08.128563+0000, chain.objs.size()=1 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.56__shadow_.sgxvJ5rZt-w0SlFyYhymKNvOgAPvD2W_0 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10135314039968475492', time=2024-09-14T13:41:35.015164+0000, chain.objs.size()=11 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.1 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.2 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.3 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.4 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.5 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.6 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.7 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.8 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.9 2024-09-14T11:41:36.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.10 2024-09-14T11:41:36.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.455+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66__multipart_key1.2~JJEpzP7FvQNvhj7Jcxj-gYXGBgmWUfP.11 2024-09-14T11:41:36.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.461+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.464+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:36.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.465+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.465+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.466+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.466+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:36.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.468+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.468+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.468+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.469+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:36.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.471+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.471+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.472+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.473+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:36.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.474+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.474+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.475+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.476+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:36.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.477+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.477+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.975622269992865187', time=2024-09-14T13:39:38.637057+0000, chain.objs.size()=4 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.46__shadow_.PjUHAy8gXDEklmtH6fuZ2Cv7mZtnwG2_0 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.46__shadow_.PjUHAy8gXDEklmtH6fuZ2Cv7mZtnwG2_1 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.46__shadow_.PjUHAy8gXDEklmtH6fuZ2Cv7mZtnwG2_2 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.46__shadow_.PjUHAy8gXDEklmtH6fuZ2Cv7mZtnwG2_3 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15066738495294566701', time=2024-09-14T13:40:07.903906+0000, chain.objs.size()=1 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__shadow_.7SA1vR_vYFfookMS-rV5-8LkFbddbki_0 2024-09-14T11:41:36.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17373932856749686472', time=2024-09-14T13:41:25.226354+0000, chain.objs.size()=1 2024-09-14T11:41:36.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.478+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.64__shadow_.mp6Jer4ZWKS9XNB-IoyZpNkJ_WRxXer_0 2024-09-14T11:41:36.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.480+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.483+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:36.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.484+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.485+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.485+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.486+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:36.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.487+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.488+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.488+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.488+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2671865167232176789', time=2024-09-14T13:41:24.784627+0000, chain.objs.size()=1 2024-09-14T11:41:36.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.488+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.63__shadow_.Vvtc70DDuArnRNPRFW1Ju3xMufJgRqY_0 2024-09-14T11:41:36.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.490+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.492+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:36.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.493+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.493+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18218273089651486333', time=2024-09-14T13:38:56.379916+0000, chain.objs.size()=5 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.1 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.2 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.3 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.4 2024-09-14T11:41:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.494+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.44__multipart_key1.2~pAkApkpcMhBN5S-tfm3w1EjF8RRwobp.5 2024-09-14T11:41:36.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.496+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.499+0000 7f468d12c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:36.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:41:36.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17863684143514247972', time=2024-09-14T13:40:08.015157+0000, chain.objs.size()=1 2024-09-14T11:41:36.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.53__shadow_.IVLXYqROgWPjVue3GzOL_5ETxwOv77o_0 2024-09-14T11:41:36.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9159543678344354618', time=2024-09-14T13:41:09.118728+0000, chain.objs.size()=5 2024-09-14T11:41:36.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.56__multipart_key1.2~JckVkbiah-AsobM1k3k93OV4d0-SZGb.1 2024-09-14T11:41:36.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.56__multipart_key1.2~JckVkbiah-AsobM1k3k93OV4d0-SZGb.2 2024-09-14T11:41:36.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.56__multipart_key1.2~JckVkbiah-AsobM1k3k93OV4d0-SZGb.3 2024-09-14T11:41:36.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.56__multipart_key1.2~JckVkbiah-AsobM1k3k93OV4d0-SZGb.4 2024-09-14T11:41:36.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.500+0000 7f468d12c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.56__multipart_key1.2~JckVkbiah-AsobM1k3k93OV4d0-SZGb.5 2024-09-14T11:41:36.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.504+0000 7f468d12c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:36.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.507+0000 7f453efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.509+0000 7f468d12c800 20 remove_watcher() i=0 2024-09-14T11:41:36.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.509+0000 7f468d12c800 2 removed watcher, disabling cache 2024-09-14T11:41:36.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.511+0000 7f468d12c800 20 remove_watcher() i=1 2024-09-14T11:41:36.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.512+0000 7f468d12c800 20 remove_watcher() i=2 2024-09-14T11:41:36.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.513+0000 7f468d12c800 20 remove_watcher() i=3 2024-09-14T11:41:36.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.513+0000 7f468d12c800 20 remove_watcher() i=4 2024-09-14T11:41:36.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.514+0000 7f468d12c800 20 remove_watcher() i=5 2024-09-14T11:41:36.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.515+0000 7f468d12c800 20 remove_watcher() i=6 2024-09-14T11:41:36.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.516+0000 7f468d12c800 20 remove_watcher() i=7 2024-09-14T11:41:36.526 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:36.579 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:36.579 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:36.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.621+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.622+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.622+0000 7f5679944800 20 realm 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.622+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.623+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.624+0000 7f5679944800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:36.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.624+0000 7f5679944800 20 searching for the correct realm 2024-09-14T11:41:36.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.627+0000 7f5676c2d640 0 -- 172.21.15.28:0/3662292588 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f5668082040 msgr2=0x7f56680e7a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.630+0000 7f567742e640 0 -- 172.21.15.28:0/3662292588 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f5670049b60 msgr2=0x7f5670060ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:36.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.637+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 zone default found 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 4 Realm: () 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:36.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 zonegroup default 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.638+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.639+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.639+0000 7f5679944800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.639+0000 7f5679944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.639+0000 7f5679944800 20 started sync module instance, tier type = 2024-09-14T11:41:36.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.639+0000 7f5679944800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:36.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=0 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=1 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=2 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=3 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=4 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=5 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.647+0000 7f5679944800 20 add_watcher() i=6 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.648+0000 7f5679944800 20 add_watcher() i=7 2024-09-14T11:41:36.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.648+0000 7f5679944800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:36.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.650+0000 7f552dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.650+0000 7f5679944800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:36.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.650+0000 7f5679944800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:36.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.687+0000 7f552cfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:36.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.687+0000 7f5679944800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:36.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.687+0000 7f5679944800 20 Filter name: none 2024-09-14T11:41:36.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.687+0000 7f54a67fc640 20 reqs_thread_entry: start 2024-09-14T11:41:36.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.687+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:36.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.688+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.689+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.689+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.690+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:36.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.692+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.692+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.692+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.693+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:36.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.695+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.695+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.695+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.697+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:36.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.698+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.698+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.699+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.700+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:36.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.701+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.701+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.702+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.702+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:36.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.704+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.704+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.704+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.705+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:36.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.706+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.707+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.707+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.708+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:36.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.709+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.710+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.710+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.711+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:36.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.712+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.713+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.713+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.714+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:36.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.715+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.716+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.716+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.717+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:36.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.718+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.719+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.719+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.720+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:36.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.721+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.722+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.722+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.723+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:36.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.725+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.726+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.726+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.727+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:36.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.728+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.728+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.729+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.730+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:36.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.731+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.731+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.732+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.733+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:36.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.735+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.735+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.735+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.737+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:36.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.738+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.738+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.739+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.741+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:36.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.742+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.742+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.743+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.744+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:36.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.745+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.745+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.745+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.747+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:36.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.749+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.749+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.749+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.750+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:36.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.751+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.752+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.752+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.753+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:36.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.754+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.755+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.755+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.756+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:36.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.757+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.758+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.758+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.759+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:36.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.760+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.760+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.761+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.761+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:36.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.763+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.763+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.763+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.764+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:36.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.766+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.766+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.767+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.768+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:36.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.769+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.770+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.770+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.771+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:36.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.772+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.772+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.773+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.774+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:36.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.775+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.776+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.776+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.777+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:36.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.778+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.778+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.778+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.779+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:36.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.781+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.781+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.781+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.783+0000 7f5679944800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:36.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.784+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.784+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.784+0000 7f5679944800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.786+0000 7f552dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.788+0000 7f5679944800 20 remove_watcher() i=0 2024-09-14T11:41:36.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.788+0000 7f5679944800 2 removed watcher, disabling cache 2024-09-14T11:41:36.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.789+0000 7f5679944800 20 remove_watcher() i=1 2024-09-14T11:41:36.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.790+0000 7f5679944800 20 remove_watcher() i=2 2024-09-14T11:41:36.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.792+0000 7f5679944800 20 remove_watcher() i=3 2024-09-14T11:41:36.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.792+0000 7f5679944800 20 remove_watcher() i=4 2024-09-14T11:41:36.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.793+0000 7f5679944800 20 remove_watcher() i=5 2024-09-14T11:41:36.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.794+0000 7f5679944800 20 remove_watcher() i=6 2024-09-14T11:41:36.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.795+0000 7f5679944800 20 remove_watcher() i=7 2024-09-14T11:41:36.804 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:36.857 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:36.858 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:36.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.899+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.900+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.900+0000 7f5869b40800 20 realm 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.900+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.901+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.901+0000 7f5869b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.901+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.901+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.901+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.902+0000 7f5869b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.902+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.902+0000 7f5869b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:36.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.902+0000 7f5869b40800 20 searching for the correct realm 2024-09-14T11:41:36.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.905+0000 7f58650bf640 0 -- 172.21.15.28:0/126247453 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x560d31adf800 msgr2=0x560d31ae1bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.909+0000 7f58658c0640 0 -- 172.21.15.28:0/126247453 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f585c094300 msgr2=0x7f585c090a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.912+0000 7f5869b40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.912+0000 7f5869b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.912+0000 7f5869b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.912+0000 7f5869b40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.912+0000 7f5869b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.912+0000 7f5869b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:36.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 zone default found 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 4 Realm: () 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 zonegroup default 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.913+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.914+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.914+0000 7f5869b40800 20 rados->read ofs=0 len=0 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.914+0000 7f5869b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.914+0000 7f5869b40800 20 started sync module instance, tier type = 2024-09-14T11:41:36.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.914+0000 7f5869b40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:36.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=0 2024-09-14T11:41:36.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=1 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=2 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=3 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=4 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=5 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=6 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 20 add_watcher() i=7 2024-09-14T11:41:36.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.923+0000 7f5869b40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:36.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.925+0000 7f57177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:36.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.926+0000 7f5869b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:36.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.926+0000 7f5869b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:36.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.959+0000 7f57167fc640 20 reqs_thread_entry: start 2024-09-14T11:41:36.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.959+0000 7f5869b40800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:36.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.959+0000 7f5869b40800 20 Filter name: none 2024-09-14T11:41:36.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.959+0000 7f5687fff640 20 reqs_thread_entry: start 2024-09-14T11:41:36.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.959+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:36.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.961+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.961+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.961+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.962+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:36.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.964+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.964+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.964+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.965+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.967+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.967+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.968+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.969+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:36.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.970+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.971+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.971+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.972+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.974+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.974+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.975+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.976+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.977+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.978+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.978+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.979+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:36.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.980+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.981+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.981+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.982+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.983+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.983+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.984+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.984+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:36.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.986+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.986+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.986+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.987+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.989+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.989+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.990+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.991+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:36.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.992+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.993+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.993+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.994+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:36.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.995+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.995+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.996+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.997+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:36.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.998+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.998+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.998+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:36.999+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:36.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.000+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:36.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.001+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:36.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.001+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.002+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:37.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.004+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.004+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.004+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.006+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:37.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.007+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.007+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.008+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.009+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:37.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.010+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.011+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.011+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.012+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:37.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.013+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.013+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.014+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.015+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:37.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.016+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.016+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.017+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.018+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:37.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.019+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.020+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.020+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.021+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:37.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.023+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.023+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.023+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.025+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:37.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.026+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.027+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.027+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.028+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:37.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.030+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.030+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.030+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.031+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:37.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.033+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.033+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.033+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.034+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:37.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.035+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.036+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.036+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.037+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:37.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.038+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.039+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.039+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.040+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:37.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.041+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.042+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.042+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.043+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:37.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.045+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.045+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.046+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.047+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:37.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.048+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.048+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.049+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.050+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:37.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.051+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.051+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.052+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.053+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:37.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.054+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.054+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.055+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.056+0000 7f5869b40800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:37.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.057+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.057+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.058+0000 7f5869b40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.060+0000 7f57177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:37.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.062+0000 7f5869b40800 20 remove_watcher() i=0 2024-09-14T11:41:37.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.062+0000 7f5869b40800 2 removed watcher, disabling cache 2024-09-14T11:41:37.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.062+0000 7f5869b40800 20 remove_watcher() i=1 2024-09-14T11:41:37.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.063+0000 7f5869b40800 20 remove_watcher() i=2 2024-09-14T11:41:37.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.064+0000 7f5869b40800 20 remove_watcher() i=3 2024-09-14T11:41:37.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.066+0000 7f5869b40800 20 remove_watcher() i=4 2024-09-14T11:41:37.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.067+0000 7f5869b40800 20 remove_watcher() i=5 2024-09-14T11:41:37.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.068+0000 7f5869b40800 20 remove_watcher() i=6 2024-09-14T11:41:37.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.069+0000 7f5869b40800 20 remove_watcher() i=7 2024-09-14T11:41:37.079 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:37.132 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:37.132 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:37.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.377+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.580+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.580+0000 7fb467f2e800 20 realm 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.580+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.580+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.580+0000 7fb467f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.580+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.581+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.581+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.581+0000 7fb467f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.581+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.582+0000 7fb467f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:37.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.582+0000 7fb467f2e800 20 searching for the correct realm 2024-09-14T11:41:37.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.584+0000 7fb463b64640 0 -- 172.21.15.28:0/2595918641 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x562a3c352480 msgr2=0x7fb45c060220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:37.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.587+0000 7fb463b64640 0 -- 172.21.15.28:0/2595918641 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fb32c0879e0 msgr2=0x7fb32c089e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:37.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.592+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:37.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:37.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 zone default found 2024-09-14T11:41:37.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 4 Realm: () 2024-09-14T11:41:37.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 zonegroup default 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.593+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.594+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.594+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.594+0000 7fb467f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.594+0000 7fb467f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.594+0000 7fb467f2e800 20 started sync module instance, tier type = 2024-09-14T11:41:37.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.594+0000 7fb467f2e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=0 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=1 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=2 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=3 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=4 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=5 2024-09-14T11:41:37.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.603+0000 7fb467f2e800 20 add_watcher() i=6 2024-09-14T11:41:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.604+0000 7fb467f2e800 20 add_watcher() i=7 2024-09-14T11:41:37.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.604+0000 7fb467f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.605+0000 7fb319fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:37.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.606+0000 7fb467f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:37.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.606+0000 7fb467f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.639+0000 7fb318fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.639+0000 7fb467f2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.639+0000 7fb467f2e800 20 Filter name: none 2024-09-14T11:41:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.639+0000 7fb2927fc640 20 reqs_thread_entry: start 2024-09-14T11:41:37.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.639+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.640+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.641+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.641+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.642+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.643+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.644+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.644+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.645+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.646+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.647+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.647+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.648+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:37.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.650+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.650+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.650+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.651+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:37.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.653+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.654+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.654+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.655+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:37.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.656+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.657+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.657+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.658+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:37.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.659+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.660+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.660+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.661+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.662+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.663+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.663+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.664+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:37.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.666+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.666+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.666+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.667+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:37.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.670+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.670+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.670+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.671+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.673+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.673+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.673+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.674+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:37.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.675+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.676+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.676+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.677+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.678+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.679+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.679+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.680+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:37.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.681+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.682+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.682+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.683+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:37.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.684+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.684+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.685+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.686+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:37.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.687+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.688+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.688+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.689+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:37.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.690+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.691+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.691+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.692+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:37.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.693+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.693+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.694+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.695+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:37.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.696+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.696+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.696+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.697+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:37.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.699+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.699+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.699+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.700+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:37.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.702+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.702+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.702+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.703+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:37.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.705+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.705+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.705+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.706+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:37.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.707+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.708+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.708+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.709+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:37.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.711+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.711+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.711+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.712+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:37.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.714+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.714+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.714+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.716+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:37.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.717+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.718+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.718+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.719+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:37.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.720+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.720+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.721+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.722+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:37.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.723+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.723+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.723+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.724+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:37.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.725+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.726+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.726+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.727+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:37.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.728+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.729+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.729+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.730+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:37.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.731+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.731+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.732+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.733+0000 7fb467f2e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:37.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.734+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.734+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:37.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.735+0000 7fb467f2e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:37.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.737+0000 7fb319fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:37.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.739+0000 7fb467f2e800 20 remove_watcher() i=0 2024-09-14T11:41:37.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.739+0000 7fb467f2e800 2 removed watcher, disabling cache 2024-09-14T11:41:37.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.739+0000 7fb467f2e800 20 remove_watcher() i=1 2024-09-14T11:41:37.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.740+0000 7fb467f2e800 20 remove_watcher() i=2 2024-09-14T11:41:37.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.742+0000 7fb467f2e800 20 remove_watcher() i=3 2024-09-14T11:41:37.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.743+0000 7fb467f2e800 20 remove_watcher() i=4 2024-09-14T11:41:37.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.744+0000 7fb467f2e800 20 remove_watcher() i=5 2024-09-14T11:41:37.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.745+0000 7fb467f2e800 20 remove_watcher() i=6 2024-09-14T11:41:37.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:37.745+0000 7fb467f2e800 20 remove_watcher() i=7 2024-09-14T11:41:37.755 DEBUG:teuthology.orchestra.run.smithi028:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:41:38.273 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :clean 2024-09-14T11:41:39.069 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :compileJava 2024-09-14T11:41:39.070 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :processResources 2024-09-14T11:41:39.070 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :classes 2024-09-14T11:41:39.469 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:39.469 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :compileTestJava 2024-09-14T11:41:39.470 INFO:teuthology.orchestra.run.smithi028.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:41:39.470 INFO:teuthology.orchestra.run.smithi028.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:41:39.569 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:39.569 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:41:39.569 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :testClasses 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :test 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14 11:41:40,810 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.571 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:41:41.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.572 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:41:41.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.572 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:41:41.572 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.572 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:41:41.669 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.669 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:41:41.670 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.670 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:41:41.968 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:41.969 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:41:42.068 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.069 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:41:42.168 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.169 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:41:42.268 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.269 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:41:42.669 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.670 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:41:42.670 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.670 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:41:42.768 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.769 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:41:42.969 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:42.969 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:41:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.469 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:41:43.569 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.569 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:41:43.769 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.769 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:41:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.869 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:41:43.951 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.951 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------- 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------- 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:BUILD SUCCESSFUL in 6s 2024-09-14T11:41:43.952 INFO:teuthology.orchestra.run.smithi028.stdout:5 actionable tasks: 5 executed 2024-09-14T11:41:43.956 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:44.009 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:44.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.243+0000 7f2c49c4a640 0 --2- 172.21.15.28:0/4180867863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561bc1d918d0 0x561bc1d8fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:41:44.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.252+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.253+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.253+0000 7f2c4e728800 20 realm 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.253+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.253+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.253+0000 7f2c4e728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.253+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.254+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.254+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.255+0000 7f2c4e728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.255+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.255+0000 7f2c4e728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:44.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.255+0000 7f2c4e728800 20 searching for the correct realm 2024-09-14T11:41:44.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.257+0000 7f2c4a44b640 0 -- 172.21.15.28:0/3332690974 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f2c44071040 msgr2=0x7f2c44072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:44.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.261+0000 7f2c4ac4c640 0 -- 172.21.15.28:0/3332690974 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f2c40085070 msgr2=0x7f2c4001b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:44.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:44.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.267+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 zone default found 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 4 Realm: () 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 zonegroup default 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.268+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 started sync module instance, tier type = 2024-09-14T11:41:44.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.269+0000 7f2c4e728800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:44.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=0 2024-09-14T11:41:44.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=1 2024-09-14T11:41:44.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=2 2024-09-14T11:41:44.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=3 2024-09-14T11:41:44.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=4 2024-09-14T11:41:44.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=5 2024-09-14T11:41:44.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.279+0000 7f2c4e728800 20 add_watcher() i=6 2024-09-14T11:41:44.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.280+0000 7f2c4e728800 20 add_watcher() i=7 2024-09-14T11:41:44.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.280+0000 7f2c4e728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:44.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.282+0000 7f2b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:44.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.282+0000 7f2c4e728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:44.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.282+0000 7f2c4e728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.319+0000 7f2a7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.320+0000 7f2c4e728800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.320+0000 7f2c4e728800 20 Filter name: none 2024-09-14T11:41:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.320+0000 7f2a797fa640 20 reqs_thread_entry: start 2024-09-14T11:41:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.320+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.321+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.322+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.322+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.324+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.325+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.325+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.326+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.327+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.328+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.329+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.329+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.330+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.332+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.332+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.333+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.333+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.335+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.336+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.336+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.337+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.338+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.339+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.339+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.340+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.341+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.342+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.343+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.344+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:44.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.345+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.346+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.346+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.347+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:44.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.348+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.349+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.349+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.350+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:44.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.352+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.352+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.352+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.353+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:44.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.355+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.355+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.355+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.357+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:44.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.358+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.358+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.358+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.359+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:44.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.361+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.361+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.362+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:44.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.362+0000 7f2c4e728800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7152252282100008729', time=2024-09-14T13:41:43.040964+0000, chain.objs.size()=1 2024-09-14T11:41:44.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.362+0000 7f2c4e728800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.72__shadow_.klp46eIz1R_h34xrhlUx4v10nXdlNzA_0 2024-09-14T11:41:44.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.363+0000 7f2c4e728800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:44.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.365+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.366+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.366+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.366+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.367+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:44.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.368+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.369+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.369+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.370+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:44.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.371+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.372+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.372+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.374+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:44.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.375+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.375+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.376+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.377+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:44.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.378+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.379+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.379+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.380+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:44.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.381+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.382+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.382+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.383+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:44.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.384+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.385+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.385+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.386+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:44.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.388+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.388+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.388+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.389+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:44.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.390+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.391+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.391+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.392+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:44.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.394+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.394+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.394+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:41:44.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.394+0000 7f2c4e728800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16442985551935927930', time=2024-09-14T13:41:42.404268+0000, chain.objs.size()=1 2024-09-14T11:41:44.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.394+0000 7f2c4e728800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.71__shadow_.917-Kf1U43kxbtlOAnfZzs6QlFDf77y_0 2024-09-14T11:41:44.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.396+0000 7f2c4e728800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:41:44.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.398+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:44.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.400+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.400+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.400+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.401+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:44.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.402+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.403+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.403+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.404+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:44.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.406+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.406+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.406+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.407+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:44.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.409+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.409+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.409+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.410+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:44.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.412+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.412+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.413+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.414+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:44.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.415+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.415+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.416+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.417+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:44.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.418+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.419+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.419+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.420+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:44.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.421+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.422+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.422+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.424+0000 7f2c4e728800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:44.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.425+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.426+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.426+0000 7f2c4e728800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.428+0000 7f2b00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.430+0000 7f2c4e728800 20 remove_watcher() i=0 2024-09-14T11:41:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.430+0000 7f2c4e728800 2 removed watcher, disabling cache 2024-09-14T11:41:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.431+0000 7f2c4e728800 20 remove_watcher() i=1 2024-09-14T11:41:44.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.433+0000 7f2c4e728800 20 remove_watcher() i=2 2024-09-14T11:41:44.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.434+0000 7f2c4e728800 20 remove_watcher() i=3 2024-09-14T11:41:44.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.435+0000 7f2c4e728800 20 remove_watcher() i=4 2024-09-14T11:41:44.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.436+0000 7f2c4e728800 20 remove_watcher() i=5 2024-09-14T11:41:44.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.437+0000 7f2c4e728800 20 remove_watcher() i=6 2024-09-14T11:41:44.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.437+0000 7f2c4e728800 20 remove_watcher() i=7 2024-09-14T11:41:44.448 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.542+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.543+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.543+0000 7f747fb31800 20 realm 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.543+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.544+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.544+0000 7f747fb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.544+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.544+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.544+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.545+0000 7f747fb31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.545+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.545+0000 7f747fb31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.545+0000 7f747fb31800 20 searching for the correct realm 2024-09-14T11:41:44.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.549+0000 7f747b075640 0 -- 172.21.15.28:0/2569741629 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x56201b2afdf0 msgr2=0x56201b2b2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:44.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.552+0000 7f747b075640 0 -- 172.21.15.28:0/2569741629 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f746c013030 msgr2=0x7f746c039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:44.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.556+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 zone default found 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 4 Realm: () 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:44.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 zonegroup default 2024-09-14T11:41:44.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.557+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.558+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.558+0000 7f747fb31800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.558+0000 7f747fb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.558+0000 7f747fb31800 20 started sync module instance, tier type = 2024-09-14T11:41:44.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.558+0000 7f747fb31800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:44.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=0 2024-09-14T11:41:44.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=1 2024-09-14T11:41:44.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=2 2024-09-14T11:41:44.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=3 2024-09-14T11:41:44.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=4 2024-09-14T11:41:44.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=5 2024-09-14T11:41:44.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.566+0000 7f747fb31800 20 add_watcher() i=6 2024-09-14T11:41:44.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.567+0000 7f747fb31800 20 add_watcher() i=7 2024-09-14T11:41:44.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.567+0000 7f747fb31800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:44.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.569+0000 7f7331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:44.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.569+0000 7f747fb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:44.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.569+0000 7f747fb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.602+0000 7f7330fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.602+0000 7f747fb31800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.603+0000 7f747fb31800 20 Filter name: none 2024-09-14T11:41:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.603+0000 7f72aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:44.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.603+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:44.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.604+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.606+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.606+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.607+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.608+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.609+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.609+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.610+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:44.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.611+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.611+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.612+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.612+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:44.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.614+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.615+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.615+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.616+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:44.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.617+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.617+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.618+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.618+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:44.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.620+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.620+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.621+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.622+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:44.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.623+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.623+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.623+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.624+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:44.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.626+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.626+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.627+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.628+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:44.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.629+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.629+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.630+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.631+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:44.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.632+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.632+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.633+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.634+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:44.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.635+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.635+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.636+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.637+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:44.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.638+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.639+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.639+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.640+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:44.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.641+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.642+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.642+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.643+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:44.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.644+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.645+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.645+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.646+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:44.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.647+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.647+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.647+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.648+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:44.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.650+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.651+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.651+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.652+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:44.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.653+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.654+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.654+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.655+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:44.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.657+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.658+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.658+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.659+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:44.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.660+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.661+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.661+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.662+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:44.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.663+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.664+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.664+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.665+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:44.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.667+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.667+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.667+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.669+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:44.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.670+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.670+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.671+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.671+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:44.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.673+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.673+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.673+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.675+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:44.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.676+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.676+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.677+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.677+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:44.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.679+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.679+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.679+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.680+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:44.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.681+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.682+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.682+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.683+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:44.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.684+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.685+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.685+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.686+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:44.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.687+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.688+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.688+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.689+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:44.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.690+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.691+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.691+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.692+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:44.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.694+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.694+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.695+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.695+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:44.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.697+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.697+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.698+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.699+0000 7f747fb31800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:44.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.700+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.700+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:44.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.700+0000 7f747fb31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:44.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.703+0000 7f7331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:44.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.704+0000 7f747fb31800 20 remove_watcher() i=0 2024-09-14T11:41:44.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.704+0000 7f747fb31800 2 removed watcher, disabling cache 2024-09-14T11:41:44.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.705+0000 7f747fb31800 20 remove_watcher() i=1 2024-09-14T11:41:44.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.706+0000 7f747fb31800 20 remove_watcher() i=2 2024-09-14T11:41:44.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.708+0000 7f747fb31800 20 remove_watcher() i=3 2024-09-14T11:41:44.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.709+0000 7f747fb31800 20 remove_watcher() i=4 2024-09-14T11:41:44.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.710+0000 7f747fb31800 20 remove_watcher() i=5 2024-09-14T11:41:44.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.711+0000 7f747fb31800 20 remove_watcher() i=6 2024-09-14T11:41:44.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.712+0000 7f747fb31800 20 remove_watcher() i=7 2024-09-14T11:41:44.722 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:44.775 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:44.775 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:44.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.816+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.817+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.817+0000 7f4208326800 20 realm 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.817+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.817+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.817+0000 7f4208326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.817+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.818+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.818+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.818+0000 7f4208326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.818+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.819+0000 7f4208326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:44.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.819+0000 7f4208326800 20 searching for the correct realm 2024-09-14T11:41:44.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:44.821+0000 7f42038d5640 0 -- 172.21.15.28:0/1614107236 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f41f4095b30 msgr2=0x7f41f4064950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.027+0000 7f42040d6640 0 -- 172.21.15.28:0/1614107236 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f41f80a1390 msgr2=0x7f41f8066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.233+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 zone default found 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 4 Realm: () 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 zonegroup default 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.234+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 started sync module instance, tier type = 2024-09-14T11:41:45.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.235+0000 7f4208326800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:45.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=0 2024-09-14T11:41:45.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=1 2024-09-14T11:41:45.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=2 2024-09-14T11:41:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=3 2024-09-14T11:41:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=4 2024-09-14T11:41:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=5 2024-09-14T11:41:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.244+0000 7f4208326800 20 add_watcher() i=6 2024-09-14T11:41:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.246+0000 7f4208326800 20 add_watcher() i=7 2024-09-14T11:41:45.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.246+0000 7f4208326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:45.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.247+0000 7f40ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.247+0000 7f4208326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:45.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.247+0000 7f4208326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.284+0000 7f40b97e2640 20 reqs_thread_entry: start 2024-09-14T11:41:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.284+0000 7f4208326800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.284+0000 7f4208326800 20 Filter name: none 2024-09-14T11:41:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.284+0000 7f402affd640 20 reqs_thread_entry: start 2024-09-14T11:41:45.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.284+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:45.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.286+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.286+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.286+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.288+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:45.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.289+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.290+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.290+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.292+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.293+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.293+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.294+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.295+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:45.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.296+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.296+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.297+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.298+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:45.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.299+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.300+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.300+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.302+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:45.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.303+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.303+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.304+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.305+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:45.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.306+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.307+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.307+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.308+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:45.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.309+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.310+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.310+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.311+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:45.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.312+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.313+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.313+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.314+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:45.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.315+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.316+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.316+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.317+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:45.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.319+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.319+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.319+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.320+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:45.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.322+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.323+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.323+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.324+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:45.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.326+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.326+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.326+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.327+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:45.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.328+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.329+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.329+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.330+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:45.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.332+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.332+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.332+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.333+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:45.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.335+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.335+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.336+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.337+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:45.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.338+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.338+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.339+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.340+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:45.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.341+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.341+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.342+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.343+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:45.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.344+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.344+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.345+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.345+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:45.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.347+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.347+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.347+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.348+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:45.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.349+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.350+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.350+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.351+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:45.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.352+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.353+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.353+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.354+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:45.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.355+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.356+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.356+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.357+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:45.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.359+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.359+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.359+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.360+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:45.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.361+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.362+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.362+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.363+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:45.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.365+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.365+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.366+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.367+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:45.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.368+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.369+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.369+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.370+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:45.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.372+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.372+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.372+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.373+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:45.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.374+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.375+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.375+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.376+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:45.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.378+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.378+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.378+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.379+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:45.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.381+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.381+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.382+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.382+0000 7f4208326800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:45.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.384+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.384+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.385+0000 7f4208326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.386+0000 7f40ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.388+0000 7f4208326800 20 remove_watcher() i=0 2024-09-14T11:41:45.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.388+0000 7f4208326800 2 removed watcher, disabling cache 2024-09-14T11:41:45.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.390+0000 7f4208326800 20 remove_watcher() i=1 2024-09-14T11:41:45.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.391+0000 7f4208326800 20 remove_watcher() i=2 2024-09-14T11:41:45.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.392+0000 7f4208326800 20 remove_watcher() i=3 2024-09-14T11:41:45.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.393+0000 7f4208326800 20 remove_watcher() i=4 2024-09-14T11:41:45.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.394+0000 7f4208326800 20 remove_watcher() i=5 2024-09-14T11:41:45.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.395+0000 7f4208326800 20 remove_watcher() i=6 2024-09-14T11:41:45.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.396+0000 7f4208326800 20 remove_watcher() i=7 2024-09-14T11:41:45.408 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:41:45.461 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:45.461 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:45.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.501+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 realm 2024-09-14T11:41:45.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:45.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.503+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.504+0000 7f5c0c00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.504+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.504+0000 7f5c0c00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:45.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.504+0000 7f5c0c00e800 20 searching for the correct realm 2024-09-14T11:41:45.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.507+0000 7f5c06e58640 0 -- 172.21.15.28:0/1711236810 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x5631d68da310 msgr2=0x5631d68dc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:45.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.511+0000 7f5c07659640 0 -- 172.21.15.28:0/1711236810 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f5bfc06dad0 msgr2=0x7f5bfc06bc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.517+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 zone default found 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 4 Realm: () 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 zonegroup default 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.518+0000 7f5c0c00e800 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.519+0000 7f5c0c00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.519+0000 7f5c0c00e800 20 started sync module instance, tier type = 2024-09-14T11:41:45.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.519+0000 7f5c0c00e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=0 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=1 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=2 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=3 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=4 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=5 2024-09-14T11:41:45.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.527+0000 7f5c0c00e800 20 add_watcher() i=6 2024-09-14T11:41:45.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.528+0000 7f5c0c00e800 20 add_watcher() i=7 2024-09-14T11:41:45.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.528+0000 7f5c0c00e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:45.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.530+0000 7f5abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.530+0000 7f5c0c00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:45.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.530+0000 7f5c0c00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:45.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.564+0000 7f5abcfe1640 20 reqs_thread_entry: start 2024-09-14T11:41:45.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.564+0000 7f5c0c00e800 20 init_complete bucket index max shards: 1 2024-09-14T11:41:45.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.564+0000 7f5c0c00e800 20 Filter name: none 2024-09-14T11:41:45.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.564+0000 7f5a367fc640 20 reqs_thread_entry: start 2024-09-14T11:41:45.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.564+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:41:45.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.566+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.566+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.566+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.567+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:41:45.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.568+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.569+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.569+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.570+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:41:45.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.572+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.572+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.572+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.573+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:41:45.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.575+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.575+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.575+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.577+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:41:45.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.578+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.578+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.578+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.579+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:41:45.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.580+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.581+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.581+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.582+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:41:45.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.583+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.584+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.584+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.585+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:41:45.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.586+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.587+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.587+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.588+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:41:45.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.589+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.590+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.590+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.591+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:41:45.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.593+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.593+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.593+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.594+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:41:45.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.596+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.596+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.596+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.597+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:41:45.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.599+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.599+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.600+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.600+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:41:45.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.602+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.602+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.602+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.603+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:41:45.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.605+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.605+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.605+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.606+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:41:45.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.608+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.608+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.609+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.610+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:41:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.611+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.611+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.612+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.613+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:41:45.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.614+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.614+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.615+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.616+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:41:45.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.617+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.617+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.618+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.619+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:41:45.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.620+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.620+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.620+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.621+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:41:45.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.623+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.623+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.624+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.625+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:41:45.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.626+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.627+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.627+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.628+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:41:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.629+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.629+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.630+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.630+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:41:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.632+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.632+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.633+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.634+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:41:45.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.635+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.635+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.636+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.637+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:41:45.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.638+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.639+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.639+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.640+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:41:45.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.642+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.642+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.642+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.644+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:41:45.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.645+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.645+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.645+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.647+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:41:45.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.648+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.648+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.649+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.650+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:41:45.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.651+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.651+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.651+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.652+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:41:45.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.654+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.654+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.654+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.655+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:41:45.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.657+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.657+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.657+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.658+0000 7f5c0c00e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:41:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.660+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.660+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:41:45.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.660+0000 7f5c0c00e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:41:45.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.662+0000 7f5abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.665+0000 7f5c0c00e800 20 remove_watcher() i=0 2024-09-14T11:41:45.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.665+0000 7f5c0c00e800 2 removed watcher, disabling cache 2024-09-14T11:41:45.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.665+0000 7f5c0c00e800 20 remove_watcher() i=1 2024-09-14T11:41:45.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.667+0000 7f5c0c00e800 20 remove_watcher() i=2 2024-09-14T11:41:45.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.668+0000 7f5c0c00e800 20 remove_watcher() i=3 2024-09-14T11:41:45.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.669+0000 7f5c0c00e800 20 remove_watcher() i=4 2024-09-14T11:41:45.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.669+0000 7f5c0c00e800 20 remove_watcher() i=5 2024-09-14T11:41:45.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.670+0000 7f5c0c00e800 20 remove_watcher() i=6 2024-09-14T11:41:45.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:41:45.671+0000 7f5c0c00e800 20 remove_watcher() i=7 2024-09-14T11:41:45.682 DEBUG:teuthology.orchestra.run.smithi028:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:41:46.194 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :clean 2024-09-14T11:41:46.991 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :compileJava 2024-09-14T11:41:46.991 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :processResources 2024-09-14T11:41:46.991 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :classes 2024-09-14T11:41:47.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:47.392 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :compileTestJava 2024-09-14T11:41:47.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:47.392 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:41:47.392 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :testClasses 2024-09-14T11:41:47.393 INFO:teuthology.orchestra.run.smithi028.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:41:47.393 INFO:teuthology.orchestra.run.smithi028.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:41:49.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.392 INFO:teuthology.orchestra.run.smithi028.stdout:> Task :test 2024-09-14T11:41:49.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.392 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:41:49.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14 11:41:48,773 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:41:49.392 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.393 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:41:49.393 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.393 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:41:49.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:41:49.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:41:49.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:41:49.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:49.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:41:50.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:50.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:41:52.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:52.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:41:52.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:52.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:41:52.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:52.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:41:52.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:52.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:41:53.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:53.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:41:53.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:53.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:41:53.492 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:53.492 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:41:53.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:53.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:41:53.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:53.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:41:53.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:53.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:41:55.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:55.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:55.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:41:55.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:55.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:41:56.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:56.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:41:56.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:56.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:41:56.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:56.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:41:56.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:56.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:41:56.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:56.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:41:57.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:57.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:41:57.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:57.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:41:57.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:57.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:41:57.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:57.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:41:57.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:41:58.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:58.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:41:58.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:58.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:41:58.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:41:58.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:42:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:00.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:42:01.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:01.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:42:40.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:40.892 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:42:41.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:41.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:42:41.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:41.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:42:41.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:41.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:42:41.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:41.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:42:42.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:42.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:42:44.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:44.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:42:44.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:44.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:42:44.892 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:44.892 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:42:44.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:44.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:42:48.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:48.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:42:48.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:42:48.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:43:01.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:01.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:43:02.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:02.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:43:04.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:04.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:43:05.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:05.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:43:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:27.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:43:27.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:27.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:43:30.592 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:30.592 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:43:30.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:30.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:43:42.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:42.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:43:42.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:42.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:43:43.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:43.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:43:55.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:55.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:43:55.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:55.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:43:56.090 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:56.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:43:56.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:56.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:43:56.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:56.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:43:56.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:56.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:43:56.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:56.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:43:56.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:56.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:43:57.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:57.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:43:57.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:57.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:43:57.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:57.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:43:57.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:57.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:43:57.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:57.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:43:57.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:57.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:43:58.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:58.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:43:58.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:58.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:43:58.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:58.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:43:59.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:59.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:43:59.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:59.492 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:43:59.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:43:59.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:44:00.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:00.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:44:00.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:00.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:44:00.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:00.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:44:00.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:00.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:44:01.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:01.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:44:01.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:01.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:44:01.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:01.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:44:02.093 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:02.093 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:44:02.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:02.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:44:02.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:02.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:44:03.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:03.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:44:03.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:03.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:44:03.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:03.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:44:03.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:03.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:44:04.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:04.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:44:04.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:04.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:44:04.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:04.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:44:05.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:05.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:44:05.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:05.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:44:05.590 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:05.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:44:05.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:05.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:44:06.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:06.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:44:06.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:06.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:44:06.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:06.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:44:07.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:07.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:44:07.390 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:07.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:44:07.790 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:07.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:44:07.990 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:07.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:44:08.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:08.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:44:08.590 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:08.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:44:08.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:08.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:44:09.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:09.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:44:09.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:09.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:44:09.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:09.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:44:10.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:10.091 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:44:10.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:10.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:44:10.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:10.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:44:10.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:10.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:44:11.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:11.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:44:11.290 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:11.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:44:11.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:11.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:44:11.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:11.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:44:11.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:11.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:44:11.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:11.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:44:12.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:12.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:44:12.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:12.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:44:12.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:12.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:44:12.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:12.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:44:13.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:13.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:44:13.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:13.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:44:13.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:13.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:13.491 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:44:13.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:13.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:44:13.891 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:13.891 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:44:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:14.191 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:44:14.391 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:14.391 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:14.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:44:14.691 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:14.691 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:44:14.991 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:14.991 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:44:17.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:17.291 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:44:17.591 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:17.591 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:44:19.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:19.791 INFO:teuthology.orchestra.run.smithi028.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:44:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:20.091 INFO:teuthology.orchestra.run.smithi028.stdout:---------------------------------------------------------------------- 2024-09-14T11:44:20.091 INFO:teuthology.orchestra.run.smithi028.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:44:20.091 INFO:teuthology.orchestra.run.smithi028.stdout:---------------------------------------------------------------------- 2024-09-14T11:44:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:20.104 INFO:teuthology.orchestra.run.smithi028.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:44:20.104 INFO:teuthology.orchestra.run.smithi028.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:44:20.105 INFO:teuthology.orchestra.run.smithi028.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:44:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:20.105 INFO:teuthology.orchestra.run.smithi028.stdout:BUILD SUCCESSFUL in 2m 34s 2024-09-14T11:44:20.105 INFO:teuthology.orchestra.run.smithi028.stdout:5 actionable tasks: 5 executed 2024-09-14T11:44:20.121 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:44:20.178 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:20.178 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.222+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 realm 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.224+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.225+0000 7f382ab2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:20.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.225+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.225+0000 7f382ab2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:20.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.225+0000 7f382ab2c800 20 searching for the correct realm 2024-09-14T11:44:20.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.430+0000 7f382604e640 0 -- 172.21.15.28:0/3311360417 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f381808d040 msgr2=0x7f381808d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:20.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.435+0000 7f382684f640 0 -- 172.21.15.28:0/3311360417 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f381c069bb0 msgr2=0x7f381c083180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.642+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 20 zone default found 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 4 Realm: () 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 20 zonegroup default 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.643+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 started sync module instance, tier type = 2024-09-14T11:44:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.644+0000 7f382ab2c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=0 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=1 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=2 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=3 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=4 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=5 2024-09-14T11:44:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.654+0000 7f382ab2c800 20 add_watcher() i=6 2024-09-14T11:44:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.655+0000 7f382ab2c800 20 add_watcher() i=7 2024-09-14T11:44:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.655+0000 7f382ab2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.657+0000 7f36dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.657+0000 7f382ab2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.657+0000 7f382ab2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:20.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.695+0000 7f3657fff640 20 reqs_thread_entry: start 2024-09-14T11:44:20.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.695+0000 7f382ab2c800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:20.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.696+0000 7f382ab2c800 20 Filter name: none 2024-09-14T11:44:20.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.696+0000 7f3655ffb640 20 reqs_thread_entry: start 2024-09-14T11:44:20.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.696+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:44:20.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.697+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.697+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18108947286173277351', time=2024-09-14T13:43:58.665933+0000, chain.objs.size()=1 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.112__shadow_.xj2XMifeIjHpLT65mPYf6ID_WTw1pXW_0 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11418565749872430205', time=2024-09-14T13:44:06.933667+0000, chain.objs.size()=1 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.126__shadow_.RykHM_kqhYLey6TB7EpgFAUGl5vw2d2_0 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14744014753591016864', time=2024-09-14T13:44:12.721286+0000, chain.objs.size()=1 2024-09-14T11:44:20.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.698+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.138__shadow_.xhA-0ia6Uyn8ABFbZJdNcYaZN8FZrzX_0 2024-09-14T11:44:20.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.700+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.702+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:44:20.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.705+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.705+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:44:20.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17229729399627149290', time=2024-09-14T13:42:44.636685+0000, chain.objs.size()=5 2024-09-14T11:44:20.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.98__multipart_key1.2~mYghghInO1rURQAETF0pIBcgLtpeugY.1 2024-09-14T11:44:20.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.98__multipart_key1.2~mYghghInO1rURQAETF0pIBcgLtpeugY.2 2024-09-14T11:44:20.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.98__multipart_key1.2~mYghghInO1rURQAETF0pIBcgLtpeugY.3 2024-09-14T11:44:20.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.98__multipart_key1.2~mYghghInO1rURQAETF0pIBcgLtpeugY.4 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.98__multipart_key1.2~mYghghInO1rURQAETF0pIBcgLtpeugY.5 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7182057967026638568', time=2024-09-14T13:43:59.235419+0000, chain.objs.size()=1 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.113__shadow_.wZV7sSbEvhIq4JJR21ao26RJYhwa1k5_0 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10914640214934537602', time=2024-09-14T13:44:01.654911+0000, chain.objs.size()=1 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.117__shadow_.Gbdq4vbaL3eExu8AFU1pYJRuKKw2eyz_0 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.398875744166947091', time=2024-09-14T13:44:02.900463+0000, chain.objs.size()=1 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.119__shadow_.KwBr89GzXnzdexQPPmyBCoiNbAQeRZD_0 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7528873779721218954', time=2024-09-14T13:44:05.235118+0000, chain.objs.size()=1 2024-09-14T11:44:20.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.706+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.123__shadow_.agJJJSSRrdt2yU-qR39BVMRlgT3H5j5_0 2024-09-14T11:44:20.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.711+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.713+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:44:20.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.715+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.715+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:44:20.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~kHNtucJK6zMVv9ZyXUdIMAsx4KsZ_tF', time=2024-09-14T13:41:52.256455+0000, chain.objs.size()=5 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.79__multipart_key1.2~kHNtucJK6zMVv9ZyXUdIMAsx4KsZ_tF.1 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.79__multipart_key1.2~kHNtucJK6zMVv9ZyXUdIMAsx4KsZ_tF.2 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.79__multipart_key1.2~kHNtucJK6zMVv9ZyXUdIMAsx4KsZ_tF.3 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.79__multipart_key1.2~kHNtucJK6zMVv9ZyXUdIMAsx4KsZ_tF.4 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.79__multipart_key1.2~kHNtucJK6zMVv9ZyXUdIMAsx4KsZ_tF.5 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4654842889766246607', time=2024-09-14T13:42:10.507010+0000, chain.objs.size()=5 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~kOD9jlrARfASvPCCy5hLcKgsEwQjta0.1 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~kOD9jlrARfASvPCCy5hLcKgsEwQjta0.2 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~kOD9jlrARfASvPCCy5hLcKgsEwQjta0.3 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~kOD9jlrARfASvPCCy5hLcKgsEwQjta0.4 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~kOD9jlrARfASvPCCy5hLcKgsEwQjta0.5 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15193309124699008266', time=2024-09-14T13:44:04.609404+0000, chain.objs.size()=1 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.122__shadow_.l2Y0h1kKjX0wmw0O8nrjwYsS4a95TMj_0 2024-09-14T11:44:20.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15488239812458096147', time=2024-09-14T13:44:07.542175+0000, chain.objs.size()=1 2024-09-14T11:44:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.716+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.127__shadow_.RysCV3kxTUDSipJrRPmdZNFNhERCAVK_0 2024-09-14T11:44:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.720+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3366078073748988307', time=2024-09-14T13:44:09.883086+0000, chain.objs.size()=1 2024-09-14T11:44:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.720+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.131__shadow_.MG8hMvBZLG7e0boe0wBqLj0lKzbL6qX_0 2024-09-14T11:44:20.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5227578166068267956', time=2024-09-14T13:44:12.045918+0000, chain.objs.size()=1 2024-09-14T11:44:20.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.136__shadow_.ftsWZI_lMHvE8xdAuvy9AedEeeyHwlO_0 2024-09-14T11:44:20.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9741334012714547693', time=2024-09-14T13:44:19.851714+0000, chain.objs.size()=5 2024-09-14T11:44:20.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.144__multipart_key1/data/file.mpg.2~UO1W9H_3oexj1QhEtak7wmSbImLRW2d.1 2024-09-14T11:44:20.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.144__multipart_key1/data/file.mpg.2~UO1W9H_3oexj1QhEtak7wmSbImLRW2d.2 2024-09-14T11:44:20.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.144__multipart_key1/data/file.mpg.2~UO1W9H_3oexj1QhEtak7wmSbImLRW2d.3 2024-09-14T11:44:20.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.144__multipart_key1/data/file.mpg.2~UO1W9H_3oexj1QhEtak7wmSbImLRW2d.4 2024-09-14T11:44:20.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.722+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.144__multipart_key1/data/file.mpg.2~UO1W9H_3oexj1QhEtak7wmSbImLRW2d.5 2024-09-14T11:44:20.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.727+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.729+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:44:20.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.730+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.730+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6344217358996291851', time=2024-09-14T13:41:49.697833+0000, chain.objs.size()=1 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.77__shadow_.WCueXx77bOIoXXydN7YKOsa9d36RM4D_0 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16380286100053574369', time=2024-09-14T13:44:06.905511+0000, chain.objs.size()=1 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.126__shadow_.W7s7NmuOhgJmT7zCTxVg_2roQSpN9vL_0 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.584563281445294666', time=2024-09-14T13:44:07.607039+0000, chain.objs.size()=1 2024-09-14T11:44:20.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.731+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.127__shadow_.aet3bMJHcT5Tcg47lB5SbCVZRSY_WxT_0 2024-09-14T11:44:20.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.733+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.736+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:44:20.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.737+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10540357027476728587', time=2024-09-14T13:42:01.094864+0000, chain.objs.size()=5 2024-09-14T11:44:20.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.1 2024-09-14T11:44:20.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.2 2024-09-14T11:44:20.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.3 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.4 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.5 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1560045764191155918', time=2024-09-14T13:43:59.829282+0000, chain.objs.size()=1 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.114__shadow_.wxvgwC_JrfmvSKFSZ4dPkdLiSf2Am1C_0 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17433777909012239798', time=2024-09-14T13:44:00.450651+0000, chain.objs.size()=1 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.115__shadow_.wWe4bLSpnHwujf2Fpyi47PvJdnFmR3__0 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4876198365150660900', time=2024-09-14T13:44:08.800370+0000, chain.objs.size()=1 2024-09-14T11:44:20.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.738+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.129__shadow_.Xx06Ye92RVORpnaQwJzozYmAclidkZm_0 2024-09-14T11:44:20.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.741+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.744+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:44:20.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.745+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:44:20.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18346449768072296585', time=2024-09-14T13:42:41.159796+0000, chain.objs.size()=4 2024-09-14T11:44:20.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.93__shadow_.ANQkf793S8Ytr1t2h2kuFTN8w0YxGBe_0 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.93__shadow_.ANQkf793S8Ytr1t2h2kuFTN8w0YxGBe_1 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.93__shadow_.ANQkf793S8Ytr1t2h2kuFTN8w0YxGBe_2 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.93__shadow_.ANQkf793S8Ytr1t2h2kuFTN8w0YxGBe_3 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7700391239272115152', time=2024-09-14T13:43:02.081676+0000, chain.objs.size()=5 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file.mpg.2~EOk8K2AKAu4yAlrSjmODb7lYnFRD1LY.1 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file.mpg.2~EOk8K2AKAu4yAlrSjmODb7lYnFRD1LY.2 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file.mpg.2~EOk8K2AKAu4yAlrSjmODb7lYnFRD1LY.3 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file.mpg.2~EOk8K2AKAu4yAlrSjmODb7lYnFRD1LY.4 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file.mpg.2~EOk8K2AKAu4yAlrSjmODb7lYnFRD1LY.5 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8824123765784347642', time=2024-09-14T13:44:06.962057+0000, chain.objs.size()=1 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.126__shadow_.EiuQLcRi5iOlOkT7MdrGilKihGENngs_0 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7345144863788646312', time=2024-09-14T13:44:12.809517+0000, chain.objs.size()=1 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.138__shadow_.pHQrr-GAE48auH4MC7_rlggm0CHXekX_0 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3780682742599798522', time=2024-09-14T13:44:13.551451+0000, chain.objs.size()=1 2024-09-14T11:44:20.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.746+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.139__shadow_.z3c18bg0XvGYTosHq07cdnFvKqGZ1dP_0 2024-09-14T11:44:20.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.752+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.754+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:44:20.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.756+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.756+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7701537188463912236', time=2024-09-14T13:43:59.207285+0000, chain.objs.size()=1 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.113__shadow_.TEanLlxZ01laT3POC8qPHE0G1KG9vQB_0 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10732956902706105011', time=2024-09-14T13:44:09.854441+0000, chain.objs.size()=1 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.131__shadow_.or-blETgHfOWJqYHmUAXGs3kRCB32ro_0 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17108070960611718786', time=2024-09-14T13:44:19.880402+0000, chain.objs.size()=1 2024-09-14T11:44:20.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.757+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.144__shadow_.ym4DAcKMMg7hz27c_eeUjNUDh3sW8KO_0 2024-09-14T11:44:20.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.758+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.761+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:44:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.762+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16660468633028269615', time=2024-09-14T13:41:56.059985+0000, chain.objs.size()=1 2024-09-14T11:44:20.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.84__shadow_.KDd7qzH6Q9razpBmgrBhld2yo6VMxOs_0 2024-09-14T11:44:20.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~gh0a66cx64V_RdAY_fjOITeUIDCIWzi', time=2024-09-14T13:43:05.105368+0000, chain.objs.size()=5 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.101__multipart_key1.2~gh0a66cx64V_RdAY_fjOITeUIDCIWzi.7 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.101__multipart_key1.2~gh0a66cx64V_RdAY_fjOITeUIDCIWzi.8 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.101__multipart_key1.2~gh0a66cx64V_RdAY_fjOITeUIDCIWzi.9 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.101__multipart_key1.2~gh0a66cx64V_RdAY_fjOITeUIDCIWzi.10 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.101__multipart_key1.2~gh0a66cx64V_RdAY_fjOITeUIDCIWzi.11 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7960547862366243000', time=2024-09-14T13:43:59.802106+0000, chain.objs.size()=1 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.114__shadow_.ZEvW5OP9TIOw697ToqbLeWdxq9PuVTk_0 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4282710054642156817', time=2024-09-14T13:44:12.395209+0000, chain.objs.size()=1 2024-09-14T11:44:20.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.763+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.137__shadow_.5HuZQmqo0Wt8KQ9uoKNTSL5ISQJc77P_0 2024-09-14T11:44:20.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.766+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.769+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:44:20.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.770+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.770+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10179376694785885994', time=2024-09-14T13:44:01.626835+0000, chain.objs.size()=1 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.117__shadow_.BMIAw0RAMhbX167SNPGowfx_IR5PYHx_0 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15925819658789268917', time=2024-09-14T13:44:08.169827+0000, chain.objs.size()=1 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.128__shadow_.9lqO9wS2Mtwr4ZfBnUvyFC74k02kiK2_0 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10068326661046362023', time=2024-09-14T13:44:09.285137+0000, chain.objs.size()=1 2024-09-14T11:44:20.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.771+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.130__shadow_.zanpMxHClevcI7c5TLcjxLzjtD_GM1j_0 2024-09-14T11:44:20.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.772+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.775+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:44:20.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.776+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.777+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.777+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:44:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.777+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12002793789316974335', time=2024-09-14T13:44:04.097470+0000, chain.objs.size()=1 2024-09-14T11:44:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.777+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.121__shadow_.mdNZZUxeIQT-84KePdthKJLeOwVieFZ_0 2024-09-14T11:44:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.777+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14491100633757580703', time=2024-09-14T13:44:05.175532+0000, chain.objs.size()=1 2024-09-14T11:44:20.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.777+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.123__shadow_.Ijyt5bguDCf3aNET6NiKYlN0VIEADr4_0 2024-09-14T11:44:20.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.778+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.781+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:44:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.782+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:44:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5178525209827886230', time=2024-09-14T13:43:27.433647+0000, chain.objs.size()=5 2024-09-14T11:44:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~AULS2n7-7czC0pds5ySanGkRVoardGY.1 2024-09-14T11:44:20.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__shadow_key1.2~AULS2n7-7czC0pds5ySanGkRVoardGY.1_1 2024-09-14T11:44:20.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~AULS2n7-7czC0pds5ySanGkRVoardGY.2 2024-09-14T11:44:20.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__shadow_key1.2~AULS2n7-7czC0pds5ySanGkRVoardGY.2_1 2024-09-14T11:44:20.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.783+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~AULS2n7-7czC0pds5ySanGkRVoardGY.3 2024-09-14T11:44:20.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.787+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.789+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:44:20.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.790+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11433962752591259937', time=2024-09-14T13:43:42.206250+0000, chain.objs.size()=5 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.104__multipart_key1.2~oYXXuiTDj-zYHPAQIG2vgLQXYdhegCC.1 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.104__multipart_key1.2~oYXXuiTDj-zYHPAQIG2vgLQXYdhegCC.2 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.104__multipart_key1.2~oYXXuiTDj-zYHPAQIG2vgLQXYdhegCC.3 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.104__multipart_key1.2~oYXXuiTDj-zYHPAQIG2vgLQXYdhegCC.4 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.104__multipart_key1.2~oYXXuiTDj-zYHPAQIG2vgLQXYdhegCC.5 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8694122912431139781', time=2024-09-14T13:44:00.423327+0000, chain.objs.size()=1 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.115__shadow_.ZijaBbMg8_JDG0K7i_gtHiBjDniqRpQ_0 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9641925475851437636', time=2024-09-14T13:44:01.050677+0000, chain.objs.size()=1 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.116__shadow_.XrolH_6hB2rvZVYp7pO-YsWMhXZkBql_0 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6393664050854746121', time=2024-09-14T13:44:03.498233+0000, chain.objs.size()=1 2024-09-14T11:44:20.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.791+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.120__shadow_.FHSZjxgl0FBRyXGT0N4sCyAVE6i8d-O_0 2024-09-14T11:44:20.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.794+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.797+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:44:20.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.798+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.799+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.799+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:44:20.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.799+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2187102747360283909', time=2024-09-14T13:44:01.077955+0000, chain.objs.size()=1 2024-09-14T11:44:20.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.799+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.116__shadow_.wlOEdrqNyWXnkjA26z7wZU7RR1SYdu__0 2024-09-14T11:44:20.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.799+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8041193943322903156', time=2024-09-14T13:44:07.569971+0000, chain.objs.size()=1 2024-09-14T11:44:20.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.799+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.127__shadow_.H2THAHfHGeNPFoXOCgBSQrfTjTJVcQI_0 2024-09-14T11:44:20.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.801+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.803+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:44:20.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.804+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4648093096124505328', time=2024-09-14T13:43:56.233204+0000, chain.objs.size()=1 2024-09-14T11:44:20.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.106__shadow_.anbB5urRsSFLBrgcCGXFIHVjqasknnZ_0 2024-09-14T11:44:20.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16268675409780767070', time=2024-09-14T13:43:59.289998+0000, chain.objs.size()=1 2024-09-14T11:44:20.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.113__shadow_.xhYzqZcSdXXExnSuZKpSqk0SL90m155_0 2024-09-14T11:44:20.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13477012784475821352', time=2024-09-14T13:44:01.023494+0000, chain.objs.size()=1 2024-09-14T11:44:20.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.116__shadow_.le-w9cx48RTZv0hnPn78UQ6AB7bR9KE_0 2024-09-14T11:44:20.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9573360008368836734', time=2024-09-14T13:44:06.327691+0000, chain.objs.size()=1 2024-09-14T11:44:20.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.805+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.125__shadow_.qzlFqWJCUL9ZouKK9EC6xN_PFhflrhJ_0 2024-09-14T11:44:20.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.807+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.809+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:44:20.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.811+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.811+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.812+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:44:20.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.812+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13047477240764524579', time=2024-09-14T13:44:03.443426+0000, chain.objs.size()=1 2024-09-14T11:44:20.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.812+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.120__shadow_.OUyhkZ1hCZy-zlqJONw36FlWEX1Tq1k_0 2024-09-14T11:44:20.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.813+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.815+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:44:20.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.816+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:44:20.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18061235993726010929', time=2024-09-14T13:44:01.681488+0000, chain.objs.size()=1 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.117__shadow_.6t26r1Uyi2oeS7FSS-DB5_chDVjpAHt_0 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13030354661301595827', time=2024-09-14T13:44:02.242918+0000, chain.objs.size()=1 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.118__shadow_.qJ_7KlE9Omqd0KzWjrztAy4cMoqqLZ6_0 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11686976106273128775', time=2024-09-14T13:44:02.270851+0000, chain.objs.size()=1 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.118__shadow_.wlovHp8mxtKRiHXcJJkhkPI4nYenbTk_0 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11221301187976285488', time=2024-09-14T13:44:04.691877+0000, chain.objs.size()=1 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.122__shadow_.7_1VuvwjttGG60BV0YFYRfJj_n0vHea_0 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4038602741824491969', time=2024-09-14T13:44:10.914078+0000, chain.objs.size()=1 2024-09-14T11:44:20.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.817+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.133__shadow_.25hF8G0bDn_RX3_BNRippj3OUzga6Fx_0 2024-09-14T11:44:20.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.819+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.822+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:44:20.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.823+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13504354676492563479', time=2024-09-14T13:43:09.410850+0000, chain.objs.size()=5 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~_xQ6lWQKhDX3fuO9Mbew9VtgKbEPBMm.1 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~_xQ6lWQKhDX3fuO9Mbew9VtgKbEPBMm.2 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~_xQ6lWQKhDX3fuO9Mbew9VtgKbEPBMm.3 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~_xQ6lWQKhDX3fuO9Mbew9VtgKbEPBMm.4 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.824+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~_xQ6lWQKhDX3fuO9Mbew9VtgKbEPBMm.5 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.825+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6124859250160808711', time=2024-09-14T13:44:02.214756+0000, chain.objs.size()=1 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.825+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.118__shadow_.dR5C5e2PXyuJtRqCoHrrDyXuLdSmqkJ_0 2024-09-14T11:44:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.825+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17713816162168966627', time=2024-09-14T13:44:02.299087+0000, chain.objs.size()=1 2024-09-14T11:44:20.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.825+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.118__shadow_.pCMxkfacZFLnu28u9j-B2TdS8zSq7CB_0 2024-09-14T11:44:20.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.825+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17575350242137091961', time=2024-09-14T13:44:05.772269+0000, chain.objs.size()=1 2024-09-14T11:44:20.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.825+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.124__shadow_.lALTmieGyvjSdgs-CrnC0W9JHX44Eg__0 2024-09-14T11:44:20.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.828+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.831+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:44:20.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.832+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.832+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:44:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7088371503103412168', time=2024-09-14T13:42:48.369758+0000, chain.objs.size()=5 2024-09-14T11:44:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.99__multipart_key1.2~iuckODsrUQNdw7LzELqYLuFktGlfxqy.1 2024-09-14T11:44:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.99__multipart_key1.2~iuckODsrUQNdw7LzELqYLuFktGlfxqy.2 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.99__multipart_key1.2~iuckODsrUQNdw7LzELqYLuFktGlfxqy.3 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.99__multipart_key1.2~iuckODsrUQNdw7LzELqYLuFktGlfxqy.4 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.99__multipart_key1.2~iuckODsrUQNdw7LzELqYLuFktGlfxqy.5 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13919066048198415518', time=2024-09-14T13:43:02.110056+0000, chain.objs.size()=1 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__shadow_.45d_les-77XdrP_yCfs9td8bI8woIHk_0 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6959562418011649793', time=2024-09-14T13:43:13.703031+0000, chain.objs.size()=5 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~G6Z4sTM2KmtGt795LL1SZuTOXSSUjzs.1 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~G6Z4sTM2KmtGt795LL1SZuTOXSSUjzs.2 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~G6Z4sTM2KmtGt795LL1SZuTOXSSUjzs.3 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~G6Z4sTM2KmtGt795LL1SZuTOXSSUjzs.4 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~G6Z4sTM2KmtGt795LL1SZuTOXSSUjzs.5 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17232536113999373854', time=2024-09-14T13:44:03.471118+0000, chain.objs.size()=1 2024-09-14T11:44:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.833+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.120__shadow_.lhXO5MbvEFkoU4QSNztnh3yNxCaPYjV_0 2024-09-14T11:44:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.837+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7337126928179332249', time=2024-09-14T13:44:08.143324+0000, chain.objs.size()=1 2024-09-14T11:44:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.837+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.128__shadow_.bzuFgI5V5kE1ZKkALw9qxGA_uJrDSxP_0 2024-09-14T11:44:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.837+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2429322795977226108', time=2024-09-14T13:44:09.826400+0000, chain.objs.size()=1 2024-09-14T11:44:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.837+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.131__shadow_.gGc3V_F0lrgvndZF4l-ozx38yh0MEFw_0 2024-09-14T11:44:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.838+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5086089551101075545', time=2024-09-14T13:44:10.428104+0000, chain.objs.size()=1 2024-09-14T11:44:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.838+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.132__shadow_.muYnXFVoYNugrJInqvp36fh_ly6ghhH_0 2024-09-14T11:44:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.840+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.842+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:44:20.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.844+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.844+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3059071350986790162', time=2024-09-14T13:41:58.177812+0000, chain.objs.size()=1 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.90__shadow_.uYrmHwr5k_v07q17P8K8xnFRzzt1HV9_0 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17364164785581076075', time=2024-09-14T13:43:58.609954+0000, chain.objs.size()=1 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.112__shadow_.zWbhlV7CWJMeIv7UbdkB8M8jnPT5JRK_0 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5312970096323817087', time=2024-09-14T13:44:04.637289+0000, chain.objs.size()=1 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.122__shadow_.lBnV3dlnTVh23e0G1OcaloXR5BXeaJS_0 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13148775124903796695', time=2024-09-14T13:44:06.383080+0000, chain.objs.size()=1 2024-09-14T11:44:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.845+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.125__shadow_.txEU9pwr7bMVLPBjvCvuzA-2DcVwNB0_0 2024-09-14T11:44:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.846+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.849+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:44:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.850+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.850+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6219248966794931704', time=2024-09-14T13:41:56.439749+0000, chain.objs.size()=1 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.85__shadow_.MXQHP9d6Vv7uZyYu5xf3-ExQJCjTS_m_0 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16359311201132790847', time=2024-09-14T13:43:02.195712+0000, chain.objs.size()=1 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__shadow_.LUXJJ2n43ogUqYBWkRQ4vK_u14pvAOO_0 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.594416941244459378', time=2024-09-14T13:44:02.846022+0000, chain.objs.size()=1 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.119__shadow_._Ag7d3GCWRhzCx3k9cJzYODbbI1nUtB_0 2024-09-14T11:44:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14861179724003313118', time=2024-09-14T13:44:04.042254+0000, chain.objs.size()=1 2024-09-14T11:44:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.121__shadow_.ImAxvKwdm73DrokkS2BwVaIThQmVDRK_0 2024-09-14T11:44:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15238266995145291772', time=2024-09-14T13:44:06.298969+0000, chain.objs.size()=1 2024-09-14T11:44:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.851+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.125__shadow_.f2eyl-VhvWOC70RYvdT3_DHoPS5WmOc_0 2024-09-14T11:44:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.854+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.856+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:44:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.857+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.857+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11442795486380000319', time=2024-09-14T13:44:04.070527+0000, chain.objs.size()=1 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.121__shadow_.qtvh1i4kPYYsToVhOW_RL_Sfn17E4j4_0 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2057513028673818798', time=2024-09-14T13:44:08.716910+0000, chain.objs.size()=1 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.129__shadow_.h7E2VCVN_tg_5CTk9F65AJN7-Fs62oU_0 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8722417308946373205', time=2024-09-14T13:44:08.744602+0000, chain.objs.size()=1 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.129__shadow_.xl-gwAmz_JUA2EWLNS67iXTtPlF2whZ_0 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5463682305194732663', time=2024-09-14T13:44:09.341166+0000, chain.objs.size()=1 2024-09-14T11:44:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.858+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.130__shadow_.NdA4CdhFTJZOZkN0dpLBKFgE_ApuXw4_0 2024-09-14T11:44:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.860+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.863+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:44:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.864+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9496900681410594750', time=2024-09-14T13:41:53.239739+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.81__shadow_.wKktSI8RIGSaMTbE0MN4LrZQe6SIVue_0 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14083354211616389173', time=2024-09-14T13:43:58.692913+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.112__shadow_.NRvh1YiZ2fwt07NH0oHzLN90wAuY-yE_0 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11879038174374024985', time=2024-09-14T13:44:04.014469+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.121__shadow_.D2-2h94GlrX3E4vg0KVJcwfFAsibEl7_0 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4284140038686385846', time=2024-09-14T13:44:06.355285+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.125__shadow_.W4h3-eP_mlaTCe31OJNOTmUXzB2NZC2_0 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14056455819245716959', time=2024-09-14T13:44:06.996211+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.126__shadow_.PkYFHZH1tDkIc3wL5kCRjQMyj0xERZ1_0 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17066287166702669095', time=2024-09-14T13:44:07.514913+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.127__shadow_.KccJDjCiaDxOAswLTsIx-ikQgbZgWkp_0 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6773530284220595220', time=2024-09-14T13:44:10.941581+0000, chain.objs.size()=1 2024-09-14T11:44:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.865+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.133__shadow_.jKDWqYjeATbP40AxvM_zYHZRfR78EUP_0 2024-09-14T11:44:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.868+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.871+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:44:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.872+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.872+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17246914020378182018', time=2024-09-14T13:42:22.972548+0000, chain.objs.size()=5 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~tVLAJl2LWWbFLRxBzRGJ1bhQoAkCKoW.1 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~tVLAJl2LWWbFLRxBzRGJ1bhQoAkCKoW.2 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~tVLAJl2LWWbFLRxBzRGJ1bhQoAkCKoW.3 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~tVLAJl2LWWbFLRxBzRGJ1bhQoAkCKoW.4 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~tVLAJl2LWWbFLRxBzRGJ1bhQoAkCKoW.5 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3622245167138817856', time=2024-09-14T13:44:03.414534+0000, chain.objs.size()=1 2024-09-14T11:44:20.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.873+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.120__shadow_.ix6zU82GKXKw-bhlWKqMHtUAVhzv3Xq_0 2024-09-14T11:44:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.875+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.878+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:44:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.880+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.880+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8455744093579713060', time=2024-09-14T13:43:02.140788+0000, chain.objs.size()=5 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file2.mpg.2~jEsSL0gHoyWNgymo8mS0FT24_l-La6v.1 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file2.mpg.2~jEsSL0gHoyWNgymo8mS0FT24_l-La6v.2 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file2.mpg.2~jEsSL0gHoyWNgymo8mS0FT24_l-La6v.3 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file2.mpg.2~jEsSL0gHoyWNgymo8mS0FT24_l-La6v.4 2024-09-14T11:44:20.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.881+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__multipart_file2.mpg.2~jEsSL0gHoyWNgymo8mS0FT24_l-La6v.5 2024-09-14T11:44:20.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.883+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.886+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:44:20.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.887+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.887+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:20.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15570964860685934162', time=2024-09-14T13:44:08.116354+0000, chain.objs.size()=1 2024-09-14T11:44:20.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.128__shadow_.KRg78e031BLdYNGUBXmW9nC18toW8zX_0 2024-09-14T11:44:20.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5427890851452577585', time=2024-09-14T13:44:08.771659+0000, chain.objs.size()=1 2024-09-14T11:44:20.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.129__shadow_.PoMFj2Tui8cl7zK7rO1UD7Ytkc-DCAw_0 2024-09-14T11:44:20.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8018516110902780240', time=2024-09-14T13:44:10.401212+0000, chain.objs.size()=1 2024-09-14T11:44:20.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.888+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.132__shadow_.wHuT7bnIxY0yp8NEqPvsr8_3rJxLRFi_0 2024-09-14T11:44:20.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.889+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:20.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.891+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:44:20.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.892+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:20.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.893+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:20.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T11:44:20.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10437021367272484411', time=2024-09-14T13:42:37.838457+0000, chain.objs.size()=5 2024-09-14T11:44:20.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~GFuLarCJHzTKjTbkVYwqmLdHjWAGka2.1 2024-09-14T11:44:20.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__shadow_key1.2~GFuLarCJHzTKjTbkVYwqmLdHjWAGka2.1_1 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~GFuLarCJHzTKjTbkVYwqmLdHjWAGka2.2 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__shadow_key1.2~GFuLarCJHzTKjTbkVYwqmLdHjWAGka2.2_1 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~GFuLarCJHzTKjTbkVYwqmLdHjWAGka2.3 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14046429773142688578', time=2024-09-14T13:42:40.774278+0000, chain.objs.size()=5 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~DhbMhV6zzu1HXwUBFH6EoJ0eTHMuH0-.1 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__shadow_key1.2~DhbMhV6zzu1HXwUBFH6EoJ0eTHMuH0-.1_1 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~DhbMhV6zzu1HXwUBFH6EoJ0eTHMuH0-.2 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__shadow_key1.2~DhbMhV6zzu1HXwUBFH6EoJ0eTHMuH0-.2_1 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~DhbMhV6zzu1HXwUBFH6EoJ0eTHMuH0-.3 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7324793803011990637', time=2024-09-14T13:43:02.168522+0000, chain.objs.size()=1 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100__shadow_.A_OTtnRo76NWT2tR8URXK9cjsnl8j-H_0 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16339844886920316607', time=2024-09-14T13:43:11.576827+0000, chain.objs.size()=5 2024-09-14T11:44:20.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.894+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~CvcLOqeC_XN-FbLHuqQf7njnzxlONjl.1 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~CvcLOqeC_XN-FbLHuqQf7njnzxlONjl.2 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~CvcLOqeC_XN-FbLHuqQf7njnzxlONjl.3 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~CvcLOqeC_XN-FbLHuqQf7njnzxlONjl.4 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~CvcLOqeC_XN-FbLHuqQf7njnzxlONjl.5 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16228356022200707545', time=2024-09-14T13:43:30.643764+0000, chain.objs.size()=5 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103__multipart_key1.2~CXgwPuKBDF-fmd_Wjjq_YAdvTD9WREJ.1 2024-09-14T11:44:20.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.898+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103__multipart_key1.2~CXgwPuKBDF-fmd_Wjjq_YAdvTD9WREJ.2 2024-09-14T11:44:20.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.899+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103__multipart_key1.2~CXgwPuKBDF-fmd_Wjjq_YAdvTD9WREJ.3 2024-09-14T11:44:20.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.899+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103__multipart_key1.2~CXgwPuKBDF-fmd_Wjjq_YAdvTD9WREJ.4 2024-09-14T11:44:20.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.899+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103__multipart_key1.2~CXgwPuKBDF-fmd_Wjjq_YAdvTD9WREJ.5 2024-09-14T11:44:20.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.900+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:46.617635+0000, chain.objs.size()=1 2024-09-14T11:44:20.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.900+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.16 2024-09-14T11:44:20.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.900+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:46.695078+0000, chain.objs.size()=1 2024-09-14T11:44:20.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.900+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.17 2024-09-14T11:44:20.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.901+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:46.766698+0000, chain.objs.size()=1 2024-09-14T11:44:20.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.901+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.18 2024-09-14T11:44:20.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:46.836155+0000, chain.objs.size()=1 2024-09-14T11:44:20.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.19 2024-09-14T11:44:20.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:46.847985+0000, chain.objs.size()=1 2024-09-14T11:44:20.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.20 2024-09-14T11:44:20.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:46.916706+0000, chain.objs.size()=55 2024-09-14T11:44:20.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.1 2024-09-14T11:44:20.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.903+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.2 2024-09-14T11:44:20.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.905+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.3 2024-09-14T11:44:20.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.905+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.4 2024-09-14T11:44:20.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.905+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.5 2024-09-14T11:44:20.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.905+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.6 2024-09-14T11:44:20.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.906+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.7 2024-09-14T11:44:20.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.906+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.8 2024-09-14T11:44:20.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.906+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.9 2024-09-14T11:44:20.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.907+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.10 2024-09-14T11:44:20.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.907+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.11 2024-09-14T11:44:20.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.907+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.12 2024-09-14T11:44:20.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.908+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.13 2024-09-14T11:44:20.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.908+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.14 2024-09-14T11:44:20.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.910+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.15 2024-09-14T11:44:20.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.910+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.fiXpD4a-3C5Rfq1Ho5u9LSnTEQBetGBA.16 2024-09-14T11:44:20.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.6DOtp-wJVICVDMs-tyMSnO4-UhtUWMy_.17 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.GWy6xk-knoICg09Doce6F4m0-AaABAid.18 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.UnCSOuFv_2eUO8VEQAnkLoij-LPXieFk.19 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.3ZTTpBZPNkdpSB_VDzoCaesL75KLbF_k.20 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.21 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.22 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.23 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.24 2024-09-14T11:44:20.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.25 2024-09-14T11:44:20.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.26 2024-09-14T11:44:20.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.912+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.27 2024-09-14T11:44:20.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.916+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.28 2024-09-14T11:44:20.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.916+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.29 2024-09-14T11:44:20.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.916+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.30 2024-09-14T11:44:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.31 2024-09-14T11:44:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.32 2024-09-14T11:44:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.33 2024-09-14T11:44:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.34 2024-09-14T11:44:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.35 2024-09-14T11:44:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.36 2024-09-14T11:44:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.37 2024-09-14T11:44:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.918+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.38 2024-09-14T11:44:20.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.920+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.39 2024-09-14T11:44:20.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.921+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.40 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.41 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.42 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.43 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.44 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.45 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.46 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.47 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.48 2024-09-14T11:44:20.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.922+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.49 2024-09-14T11:44:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.924+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.50 2024-09-14T11:44:20.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.51 2024-09-14T11:44:20.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.52 2024-09-14T11:44:20.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.53 2024-09-14T11:44:20.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.54 2024-09-14T11:44:20.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.55 2024-09-14T11:44:20.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:47.310892+0000, chain.objs.size()=10 2024-09-14T11:44:20.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.56 2024-09-14T11:44:20.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.57 2024-09-14T11:44:20.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.58 2024-09-14T11:44:20.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.59 2024-09-14T11:44:20.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.926+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.60 2024-09-14T11:44:20.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.927+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.61 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.62 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.63 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.64 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.65 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:47.812143+0000, chain.objs.size()=10 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.66 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.67 2024-09-14T11:44:20.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.930+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.68 2024-09-14T11:44:20.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.931+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.69 2024-09-14T11:44:20.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.931+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.70 2024-09-14T11:44:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.932+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.71 2024-09-14T11:44:20.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.932+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.72 2024-09-14T11:44:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.73 2024-09-14T11:44:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.74 2024-09-14T11:44:20.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.75 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:48.169044+0000, chain.objs.size()=8 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.76 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.77 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.78 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.79 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.80 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.81 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.82 2024-09-14T11:44:20.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.935+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.83 2024-09-14T11:44:20.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.939+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:48.574388+0000, chain.objs.size()=9 2024-09-14T11:44:20.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.939+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.84 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.939+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.85 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.939+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.86 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.939+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.87 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.939+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.88 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.89 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.90 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.91 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.92 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:49.000064+0000, chain.objs.size()=5 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.93 2024-09-14T11:44:20.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.940+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.94 2024-09-14T11:44:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.95 2024-09-14T11:44:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.96 2024-09-14T11:44:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.97 2024-09-14T11:44:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:49.383133+0000, chain.objs.size()=7 2024-09-14T11:44:20.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.98 2024-09-14T11:44:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.99 2024-09-14T11:44:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.100 2024-09-14T11:44:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.101 2024-09-14T11:44:20.942 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.943+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.102 2024-09-14T11:44:20.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.946+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.103 2024-09-14T11:44:20.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.946+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.104 2024-09-14T11:44:20.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.946+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:49.994989+0000, chain.objs.size()=11 2024-09-14T11:44:20.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.946+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.105 2024-09-14T11:44:20.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.947+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.106 2024-09-14T11:44:20.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.947+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.107 2024-09-14T11:44:20.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.947+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.108 2024-09-14T11:44:20.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.948+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.109 2024-09-14T11:44:20.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.948+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.110 2024-09-14T11:44:20.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.948+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.111 2024-09-14T11:44:20.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.948+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.112 2024-09-14T11:44:20.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.948+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.113 2024-09-14T11:44:20.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.950+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.114 2024-09-14T11:44:20.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.950+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.115 2024-09-14T11:44:20.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.950+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:50.467505+0000, chain.objs.size()=8 2024-09-14T11:44:20.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.950+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.116 2024-09-14T11:44:20.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.951+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.117 2024-09-14T11:44:20.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.951+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.118 2024-09-14T11:44:20.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.951+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.119 2024-09-14T11:44:20.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.120 2024-09-14T11:44:20.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.121 2024-09-14T11:44:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.122 2024-09-14T11:44:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.124 2024-09-14T11:44:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:50.852665+0000, chain.objs.size()=5 2024-09-14T11:44:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.123 2024-09-14T11:44:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.125 2024-09-14T11:44:20.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.953+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.126 2024-09-14T11:44:20.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.955+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.127 2024-09-14T11:44:20.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.955+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.128 2024-09-14T11:44:20.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.955+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:51.335493+0000, chain.objs.size()=10 2024-09-14T11:44:20.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.955+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.129 2024-09-14T11:44:20.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.955+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.130 2024-09-14T11:44:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.131 2024-09-14T11:44:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.132 2024-09-14T11:44:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.133 2024-09-14T11:44:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.134 2024-09-14T11:44:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.135 2024-09-14T11:44:20.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.136 2024-09-14T11:44:20.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.957+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.137 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.138 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:51.781129+0000, chain.objs.size()=6 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.139 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.140 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.141 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.142 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.143 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.144 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:52.322561+0000, chain.objs.size()=9 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.145 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.146 2024-09-14T11:44:20.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.961+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.147 2024-09-14T11:44:20.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.962+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.148 2024-09-14T11:44:20.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.964+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.149 2024-09-14T11:44:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.965+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.151 2024-09-14T11:44:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.965+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.152 2024-09-14T11:44:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.965+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.153 2024-09-14T11:44:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.966+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.154 2024-09-14T11:44:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.966+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:52.744689+0000, chain.objs.size()=5 2024-09-14T11:44:20.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.966+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.150 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.155 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.156 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.157 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.158 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:53.128996+0000, chain.objs.size()=9 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.159 2024-09-14T11:44:20.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.967+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.160 2024-09-14T11:44:20.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.969+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.161 2024-09-14T11:44:20.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.969+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.162 2024-09-14T11:44:20.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.970+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.163 2024-09-14T11:44:20.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.970+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.164 2024-09-14T11:44:20.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.970+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.165 2024-09-14T11:44:20.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.166 2024-09-14T11:44:20.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.167 2024-09-14T11:44:20.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:55.555293+0000, chain.objs.size()=1 2024-09-14T11:44:20.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.16 2024-09-14T11:44:20.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:55.562153+0000, chain.objs.size()=1 2024-09-14T11:44:20.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.17 2024-09-14T11:44:20.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:55.568452+0000, chain.objs.size()=1 2024-09-14T11:44:20.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.18 2024-09-14T11:44:20.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:55.575289+0000, chain.objs.size()=1 2024-09-14T11:44:20.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.971+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.19 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:55.605818+0000, chain.objs.size()=1 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.20 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF', time=2024-09-14T13:43:55.776547+0000, chain.objs.size()=212 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.1 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.2 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.3 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.4 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.5 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.6 2024-09-14T11:44:20.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.975+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.7 2024-09-14T11:44:20.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.976+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.8 2024-09-14T11:44:20.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.976+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.9 2024-09-14T11:44:20.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.976+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.10 2024-09-14T11:44:20.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.977+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.11 2024-09-14T11:44:20.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.977+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.12 2024-09-14T11:44:20.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.977+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.13 2024-09-14T11:44:20.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.977+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.14 2024-09-14T11:44:20.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.977+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.15 2024-09-14T11:44:20.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.978+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.fiXpD4a-3C5Rfq1Ho5u9LSnTEQBetGBA.16 2024-09-14T11:44:20.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.978+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.6DOtp-wJVICVDMs-tyMSnO4-UhtUWMy_.17 2024-09-14T11:44:20.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.978+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.GWy6xk-knoICg09Doce6F4m0-AaABAid.18 2024-09-14T11:44:20.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.979+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.UnCSOuFv_2eUO8VEQAnkLoij-LPXieFk.19 2024-09-14T11:44:20.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.979+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.3ZTTpBZPNkdpSB_VDzoCaesL75KLbF_k.20 2024-09-14T11:44:20.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.979+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.21 2024-09-14T11:44:20.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.980+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.22 2024-09-14T11:44:20.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.981+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.23 2024-09-14T11:44:20.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.24 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.25 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.26 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.27 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.28 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.29 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.30 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.31 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.32 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.33 2024-09-14T11:44:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.982+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.34 2024-09-14T11:44:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.984+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.35 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.984+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.36 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.984+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.37 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.984+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.38 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.39 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.40 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.41 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.42 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.43 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.44 2024-09-14T11:44:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.985+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.45 2024-09-14T11:44:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.986+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.46 2024-09-14T11:44:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.987+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.47 2024-09-14T11:44:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.987+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.48 2024-09-14T11:44:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.987+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.49 2024-09-14T11:44:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.987+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.50 2024-09-14T11:44:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.987+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.51 2024-09-14T11:44:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.987+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.52 2024-09-14T11:44:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.988+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.53 2024-09-14T11:44:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.988+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.54 2024-09-14T11:44:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.988+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.55 2024-09-14T11:44:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.988+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.56 2024-09-14T11:44:20.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.989+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.57 2024-09-14T11:44:20.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.989+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.58 2024-09-14T11:44:20.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.989+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.59 2024-09-14T11:44:20.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.989+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.60 2024-09-14T11:44:20.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.989+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.61 2024-09-14T11:44:20.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.990+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.62 2024-09-14T11:44:20.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.990+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.63 2024-09-14T11:44:20.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.990+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.64 2024-09-14T11:44:20.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.990+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.65 2024-09-14T11:44:20.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.66 2024-09-14T11:44:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.67 2024-09-14T11:44:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.68 2024-09-14T11:44:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.69 2024-09-14T11:44:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.70 2024-09-14T11:44:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.71 2024-09-14T11:44:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.991+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.72 2024-09-14T11:44:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.992+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.73 2024-09-14T11:44:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.992+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.74 2024-09-14T11:44:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.992+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.75 2024-09-14T11:44:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.76 2024-09-14T11:44:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.77 2024-09-14T11:44:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.78 2024-09-14T11:44:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.79 2024-09-14T11:44:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.80 2024-09-14T11:44:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.81 2024-09-14T11:44:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.82 2024-09-14T11:44:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.993+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.83 2024-09-14T11:44:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.994+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.84 2024-09-14T11:44:20.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.995+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.85 2024-09-14T11:44:20.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.995+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.86 2024-09-14T11:44:20.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.995+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.87 2024-09-14T11:44:20.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.88 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.89 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.90 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.91 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.92 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.93 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.94 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.95 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.96 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.97 2024-09-14T11:44:20.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:20.997+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.98 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.99 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.100 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.101 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.102 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.103 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.104 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.105 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.106 2024-09-14T11:44:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.107 2024-09-14T11:44:20.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.108 2024-09-14T11:44:20.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.000+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.109 2024-09-14T11:44:21.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.002+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.110 2024-09-14T11:44:21.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.002+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.111 2024-09-14T11:44:21.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.112 2024-09-14T11:44:21.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.113 2024-09-14T11:44:21.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.114 2024-09-14T11:44:21.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.115 2024-09-14T11:44:21.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.116 2024-09-14T11:44:21.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.117 2024-09-14T11:44:21.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.118 2024-09-14T11:44:21.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.119 2024-09-14T11:44:21.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.003+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.120 2024-09-14T11:44:21.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.004+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.121 2024-09-14T11:44:21.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.004+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.122 2024-09-14T11:44:21.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.005+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.123 2024-09-14T11:44:21.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.005+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.124 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.005+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.125 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.126 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.127 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.128 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.129 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.130 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.131 2024-09-14T11:44:21.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.006+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.132 2024-09-14T11:44:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.007+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.133 2024-09-14T11:44:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.007+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.134 2024-09-14T11:44:21.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.007+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.135 2024-09-14T11:44:21.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.008+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.136 2024-09-14T11:44:21.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.008+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.137 2024-09-14T11:44:21.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.008+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.138 2024-09-14T11:44:21.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.008+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.139 2024-09-14T11:44:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.009+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.140 2024-09-14T11:44:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.009+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.141 2024-09-14T11:44:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.009+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.142 2024-09-14T11:44:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.009+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.143 2024-09-14T11:44:21.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.009+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.144 2024-09-14T11:44:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.010+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.145 2024-09-14T11:44:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.010+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.146 2024-09-14T11:44:21.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.010+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.147 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.011+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.148 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.011+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.149 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.011+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.150 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.011+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.151 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.011+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.152 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.011+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.153 2024-09-14T11:44:21.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.012+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.154 2024-09-14T11:44:21.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.012+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.155 2024-09-14T11:44:21.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.012+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.156 2024-09-14T11:44:21.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.013+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.157 2024-09-14T11:44:21.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.013+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.158 2024-09-14T11:44:21.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.013+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.159 2024-09-14T11:44:21.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.014+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.160 2024-09-14T11:44:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.014+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.161 2024-09-14T11:44:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.014+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.162 2024-09-14T11:44:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.014+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.163 2024-09-14T11:44:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.014+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.164 2024-09-14T11:44:21.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.014+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.165 2024-09-14T11:44:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.016+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.166 2024-09-14T11:44:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.016+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.167 2024-09-14T11:44:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.016+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.168 2024-09-14T11:44:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.016+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.169 2024-09-14T11:44:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.016+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.170 2024-09-14T11:44:21.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.016+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.171 2024-09-14T11:44:21.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.017+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.172 2024-09-14T11:44:21.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.017+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.173 2024-09-14T11:44:21.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.017+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.174 2024-09-14T11:44:21.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.017+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.175 2024-09-14T11:44:21.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.017+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.176 2024-09-14T11:44:21.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.018+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.177 2024-09-14T11:44:21.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.020+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.178 2024-09-14T11:44:21.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.021+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.179 2024-09-14T11:44:21.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.021+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.180 2024-09-14T11:44:21.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.021+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.181 2024-09-14T11:44:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.021+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.182 2024-09-14T11:44:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.021+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.183 2024-09-14T11:44:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.022+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.184 2024-09-14T11:44:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.022+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.185 2024-09-14T11:44:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.022+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.186 2024-09-14T11:44:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.022+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.187 2024-09-14T11:44:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.022+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.188 2024-09-14T11:44:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.023+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.189 2024-09-14T11:44:21.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.024+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.190 2024-09-14T11:44:21.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.025+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.191 2024-09-14T11:44:21.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.025+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.192 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.025+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.193 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.025+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.194 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.025+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.195 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.025+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.196 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.026+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.197 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.026+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.198 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.026+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.199 2024-09-14T11:44:21.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.026+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.200 2024-09-14T11:44:21.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.028+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.201 2024-09-14T11:44:21.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.029+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.202 2024-09-14T11:44:21.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.029+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.203 2024-09-14T11:44:21.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.029+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.204 2024-09-14T11:44:21.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.029+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.205 2024-09-14T11:44:21.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.029+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.206 2024-09-14T11:44:21.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.029+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.207 2024-09-14T11:44:21.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.030+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.208 2024-09-14T11:44:21.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.030+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.209 2024-09-14T11:44:21.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.030+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.210 2024-09-14T11:44:21.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.030+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.211 2024-09-14T11:44:21.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.032+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.105__multipart_key1.2~xxbtfFlp26LFsYa8NySHFJA1mZvJ0qF.212 2024-09-14T11:44:21.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.034+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3145216216376216041', time=2024-09-14T13:44:00.477880+0000, chain.objs.size()=1 2024-09-14T11:44:21.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.034+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.115__shadow_.QzVWs5b7WWr42dXexSPxgDnjAoqHkiJ_0 2024-09-14T11:44:21.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.034+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.184265170418225337', time=2024-09-14T13:44:05.208598+0000, chain.objs.size()=1 2024-09-14T11:44:21.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.034+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.123__shadow_.W-an8_BJXWC3ZzCT11vJY3zUdMSTpKF_0 2024-09-14T11:44:21.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.036+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.039+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:44:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.040+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16754981472305864457', time=2024-09-14T13:42:01.291524+0000, chain.objs.size()=5 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.1 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.2 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.3 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.4 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91__multipart_key1.2~3H2pY37vRNdQcAiLRiLiTy-vhXRzU8r.5 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8135019460047978565', time=2024-09-14T13:43:27.243305+0000, chain.objs.size()=5 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~EFJ4kDFUCxqTVNqy0edFABTu623oK8H.1 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__shadow_key1.2~EFJ4kDFUCxqTVNqy0edFABTu623oK8H.1_1 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~EFJ4kDFUCxqTVNqy0edFABTu623oK8H.2 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__shadow_key1.2~EFJ4kDFUCxqTVNqy0edFABTu623oK8H.2_1 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~EFJ4kDFUCxqTVNqy0edFABTu623oK8H.3 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11564653219879987388', time=2024-09-14T13:44:05.744238+0000, chain.objs.size()=1 2024-09-14T11:44:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.041+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.124__shadow_.A-nAhAbn33OolG92BTquPIjXM3SzdHc_0 2024-09-14T11:44:21.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.046+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.048+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:44:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.050+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.050+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.60126840829528239', time=2024-09-14T13:43:16.166503+0000, chain.objs.size()=5 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~pGEgXQTUMH0slJDsTkuOmJYCiQ_HhcG.1 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__shadow_key1.2~pGEgXQTUMH0slJDsTkuOmJYCiQ_HhcG.1_1 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~pGEgXQTUMH0slJDsTkuOmJYCiQ_HhcG.2 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__shadow_key1.2~pGEgXQTUMH0slJDsTkuOmJYCiQ_HhcG.2_1 2024-09-14T11:44:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.102__multipart_key1.2~pGEgXQTUMH0slJDsTkuOmJYCiQ_HhcG.3 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15058967350437328204', time=2024-09-14T13:44:05.716627+0000, chain.objs.size()=1 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.124__shadow_.LF8k3ke2FKSP75l3ijECf9Vli9Id7xU_0 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13525034272626054971', time=2024-09-14T13:44:17.376070+0000, chain.objs.size()=5 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.143__multipart_key1.2~JOzuMmtStShBCfHVU0ZhIaVnYrcnUEf.1 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.143__multipart_key1.2~JOzuMmtStShBCfHVU0ZhIaVnYrcnUEf.2 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.143__multipart_key1.2~JOzuMmtStShBCfHVU0ZhIaVnYrcnUEf.3 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.143__multipart_key1.2~JOzuMmtStShBCfHVU0ZhIaVnYrcnUEf.4 2024-09-14T11:44:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.051+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.143__multipart_key1.2~JOzuMmtStShBCfHVU0ZhIaVnYrcnUEf.5 2024-09-14T11:44:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.055+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.058+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:44:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.059+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.059+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5272652192666570585', time=2024-09-14T13:43:29.685792+0000, chain.objs.size()=1 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103__shadow_.jeOyjF5g37i42sgZ7_q6BmEyzKHHKcp_0 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11475877189690384689', time=2024-09-14T13:43:58.637550+0000, chain.objs.size()=1 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.112__shadow_.RYUB0Mhs_1NzjSgnI5QBesI13Zk8pnq_0 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1733324214916121559', time=2024-09-14T13:44:00.995513+0000, chain.objs.size()=1 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.116__shadow_.KU4doJsyDZueGFcaYUzt6HJjUq-QQRd_0 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7408226076826546489', time=2024-09-14T13:44:08.197427+0000, chain.objs.size()=1 2024-09-14T11:44:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.128__shadow_.rZWppnilzM1LU-C40aP6ZVaXkupN35P_0 2024-09-14T11:44:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14074888631685130907', time=2024-09-14T13:44:09.313130+0000, chain.objs.size()=1 2024-09-14T11:44:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.130__shadow_.mNBMcZuwznLGVLRJSfqNL1cqg3_5g6x_0 2024-09-14T11:44:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9978638632511812513', time=2024-09-14T13:44:13.977876+0000, chain.objs.size()=1 2024-09-14T11:44:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.060+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.140__shadow_.iTZ8HJRmDU0YjIU6CH4iMRXDHSBsVnK_0 2024-09-14T11:44:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.062+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.064+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:44:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.066+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.066+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9385268473183248391', time=2024-09-14T13:42:25.833352+0000, chain.objs.size()=5 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~w0wajMw16_TJkxqQqdsOFjNannjKpZL.1 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~w0wajMw16_TJkxqQqdsOFjNannjKpZL.2 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~w0wajMw16_TJkxqQqdsOFjNannjKpZL.3 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~w0wajMw16_TJkxqQqdsOFjNannjKpZL.4 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~w0wajMw16_TJkxqQqdsOFjNannjKpZL.5 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1783367862508049828', time=2024-09-14T13:43:59.262586+0000, chain.objs.size()=1 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.113__shadow_.h0zeOTwbuSysxsstPHzF69DjWdG7-dP_0 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12665146439241141041', time=2024-09-14T13:44:10.374128+0000, chain.objs.size()=1 2024-09-14T11:44:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.067+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.132__shadow_.i7SPT9JogGusXFP173LKtQdruuaBIqv_0 2024-09-14T11:44:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.070+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.072+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:44:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.073+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:44:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1760092715721894068', time=2024-09-14T13:43:59.884721+0000, chain.objs.size()=1 2024-09-14T11:44:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.114__shadow_.YFFUJrbbOSskPJNhKhgQ538xSm0kO1d_0 2024-09-14T11:44:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3625097842315737526', time=2024-09-14T13:44:00.395641+0000, chain.objs.size()=1 2024-09-14T11:44:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.115__shadow_.05RzliHpd2Z8KZqfBRA-1p7UrQLrizZ_0 2024-09-14T11:44:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16455890938729017688', time=2024-09-14T13:44:02.872897+0000, chain.objs.size()=1 2024-09-14T11:44:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.074+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.119__shadow_.yyUbTBsfMq8gcS7U8gsOHJMeNJhHti7_0 2024-09-14T11:44:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.076+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.078+0000 7f382ab2c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:44:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.079+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.427495617998354454', time=2024-09-14T13:41:55.674942+0000, chain.objs.size()=2 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.83__shadow_.wxsaT--9EaROHYpSrEeXffQuNNBjDyb_0 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.83__shadow_.wxsaT--9EaROHYpSrEeXffQuNNBjDyb_1 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9127669982693874932', time=2024-09-14T13:42:40.963941+0000, chain.objs.size()=5 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~ibMaqiuBDkx4xhiVdlAKZTORIyEvxjO.1 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__shadow_key1.2~ibMaqiuBDkx4xhiVdlAKZTORIyEvxjO.1_1 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~ibMaqiuBDkx4xhiVdlAKZTORIyEvxjO.2 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__shadow_key1.2~ibMaqiuBDkx4xhiVdlAKZTORIyEvxjO.2_1 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.94__multipart_key1.2~ibMaqiuBDkx4xhiVdlAKZTORIyEvxjO.3 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.080+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9786779593398760635', time=2024-09-14T13:43:59.857325+0000, chain.objs.size()=1 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.114__shadow_.J3UgyJjA7O3mSJl1LHNQQdYGXuXznUl_0 2024-09-14T11:44:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16078734923950021245', time=2024-09-14T13:44:01.599850+0000, chain.objs.size()=1 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.117__shadow_.-kaXBbB2PXJK_GdfL36sxjRUNrHtFYa_0 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2032493123669517822', time=2024-09-14T13:44:02.818960+0000, chain.objs.size()=1 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.119__shadow_.9Jg-Xdk0kLCugfV41Yd0He5tMS_NoV7_0 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15800048017665935491', time=2024-09-14T13:44:04.664497+0000, chain.objs.size()=1 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.122__shadow_.diNVfiI02nRfeLID6wJ1neGZYh43sXy_0 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3140364664957513147', time=2024-09-14T13:44:10.968813+0000, chain.objs.size()=1 2024-09-14T11:44:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.081+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.133__shadow_.VxH6gvFU2BlmNZVtZP3Ad8aGSdAq2qi_0 2024-09-14T11:44:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.086+0000 7f382ab2c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:44:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.089+0000 7f36dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:21.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.091+0000 7f382ab2c800 20 remove_watcher() i=0 2024-09-14T11:44:21.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.091+0000 7f382ab2c800 2 removed watcher, disabling cache 2024-09-14T11:44:21.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.093+0000 7f382ab2c800 20 remove_watcher() i=1 2024-09-14T11:44:21.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.094+0000 7f382ab2c800 20 remove_watcher() i=2 2024-09-14T11:44:21.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.095+0000 7f382ab2c800 20 remove_watcher() i=3 2024-09-14T11:44:21.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.096+0000 7f382ab2c800 20 remove_watcher() i=4 2024-09-14T11:44:21.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.097+0000 7f382ab2c800 20 remove_watcher() i=5 2024-09-14T11:44:21.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.098+0000 7f382ab2c800 20 remove_watcher() i=6 2024-09-14T11:44:21.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.099+0000 7f382ab2c800 20 remove_watcher() i=7 2024-09-14T11:44:21.108 DEBUG:teuthology.orchestra.run.smithi028:> radosgw-admin gc process --include-all 2024-09-14T11:44:21.161 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:21.161 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:21.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.203+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.205+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.205+0000 7f0fcfb2a800 20 realm 2024-09-14T11:44:21.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.205+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.205+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.205+0000 7f0fcfb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.205+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.206+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.206+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.206+0000 7f0fcfb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:21.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.206+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.207+0000 7f0fcfb2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:21.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.207+0000 7f0fcfb2a800 20 searching for the correct realm 2024-09-14T11:44:21.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.208+0000 7f0fcc018640 0 -- 172.21.15.28:0/1620723946 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f0fc0038030 msgr2=0x7f0fc003a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:21.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.211+0000 7f0fcc018640 0 -- 172.21.15.28:0/1620723946 >> [v2:172.21.15.204:6824/2343506808,v1:172.21.15.204:6825/2343506808] conn(0x7f0fc002a040 msgr2=0x7f0fc0038920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:21.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.218+0000 7f0fcfb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 zone default found 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 4 Realm: () 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 zonegroup default 2024-09-14T11:44:21.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.219+0000 7f0fcfb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.220+0000 7f0fcfb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.220+0000 7f0fcfb2a800 20 started sync module instance, tier type = 2024-09-14T11:44:21.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.220+0000 7f0fcfb2a800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=0 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=1 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=2 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=3 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=4 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=5 2024-09-14T11:44:21.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.228+0000 7f0fcfb2a800 20 add_watcher() i=6 2024-09-14T11:44:21.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.229+0000 7f0fcfb2a800 20 add_watcher() i=7 2024-09-14T11:44:21.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.229+0000 7f0fcfb2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:21.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.231+0000 7f0e827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:21.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.231+0000 7f0fcfb2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:21.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.231+0000 7f0fcfb2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.266+0000 7f0e817e2640 20 reqs_thread_entry: start 2024-09-14T11:44:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.266+0000 7f0fcfb2a800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.266+0000 7f0fcfb2a800 20 Filter name: none 2024-09-14T11:44:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.266+0000 7f0e7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.266+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:44:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.268+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.269+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.269+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.270+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:44:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.271+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.272+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.272+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.273+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:44:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.274+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.274+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.275+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.276+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:44:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.277+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.277+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.277+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.278+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:44:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.280+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.280+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.280+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.281+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:44:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.283+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.283+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.283+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.284+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:44:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.286+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.286+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.286+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.287+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:44:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.288+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.289+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.289+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.290+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:44:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.292+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.292+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.292+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.293+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:44:21.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.295+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.295+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.295+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.296+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:44:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.297+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.298+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.298+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.299+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:44:21.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.300+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.301+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.301+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.302+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:44:21.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.303+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.304+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.304+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.305+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:44:21.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.306+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.307+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.307+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.308+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:44:21.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.309+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.310+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.310+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.311+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:44:21.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.313+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.313+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.313+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.315+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:44:21.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.316+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.316+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.317+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.318+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:44:21.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.319+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.320+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.320+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.321+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:44:21.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.322+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.323+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.323+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.324+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:44:21.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.325+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.326+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.326+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.327+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:44:21.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.329+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.329+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.329+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.331+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:44:21.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.332+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.332+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.333+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.333+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:44:21.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.335+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.335+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.335+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.336+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:44:21.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.338+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.338+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.339+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.339+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:44:21.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.341+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.341+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.341+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.342+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:44:21.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.344+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.344+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.344+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.345+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:44:21.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.347+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.347+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.347+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.348+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:44:21.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.350+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.350+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.350+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.351+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:44:21.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.353+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.353+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.353+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.354+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:44:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.356+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.356+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.356+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.357+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:44:21.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.358+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.359+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.359+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.360+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:44:21.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.361+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.362+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:44:21.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.362+0000 7f0fcfb2a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:44:21.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.364+0000 7f0e827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:21.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.366+0000 7f0fcfb2a800 20 remove_watcher() i=0 2024-09-14T11:44:21.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.366+0000 7f0fcfb2a800 2 removed watcher, disabling cache 2024-09-14T11:44:21.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.367+0000 7f0fcfb2a800 20 remove_watcher() i=1 2024-09-14T11:44:21.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.368+0000 7f0fcfb2a800 20 remove_watcher() i=2 2024-09-14T11:44:21.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.369+0000 7f0fcfb2a800 20 remove_watcher() i=3 2024-09-14T11:44:21.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.370+0000 7f0fcfb2a800 20 remove_watcher() i=4 2024-09-14T11:44:21.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.371+0000 7f0fcfb2a800 20 remove_watcher() i=5 2024-09-14T11:44:21.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.372+0000 7f0fcfb2a800 20 remove_watcher() i=6 2024-09-14T11:44:21.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:21.373+0000 7f0fcfb2a800 20 remove_watcher() i=7 2024-09-14T11:44:21.383 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:44:21.402 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:44:21.402 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:44:21.402 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:44:21.402 DEBUG:teuthology.orchestra.run.smithi028:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:44:21.432 INFO:teuthology.orchestra.run.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:44:22.219 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:44:22.220 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:44:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:22.322 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:22.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.360+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.361+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.361+0000 7f4927346800 20 realm 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.361+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.362+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.362+0000 7f4927346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.362+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.362+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.362+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.363+0000 7f4927346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:22.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.363+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.363+0000 7f4927346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:22.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.363+0000 7f4927346800 20 searching for the correct realm 2024-09-14T11:44:22.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.367+0000 7f4925631640 0 -- 172.21.15.28:0/1000857026 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f4910057020 msgr2=0x7f491003ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:22.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.371+0000 7f4924e30640 0 -- 172.21.15.28:0/1000857026 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f491007ca50 msgr2=0x7f4910060370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.578+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 zone default found 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 4 Realm: () 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 zonegroup default 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.579+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.580+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.580+0000 7f4927346800 20 started sync module instance, tier type = 2024-09-14T11:44:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.580+0000 7f4927346800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.589+0000 7f4927346800 20 add_watcher() i=0 2024-09-14T11:44:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.589+0000 7f4927346800 20 add_watcher() i=1 2024-09-14T11:44:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.589+0000 7f4927346800 20 add_watcher() i=2 2024-09-14T11:44:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.589+0000 7f4927346800 20 add_watcher() i=3 2024-09-14T11:44:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.589+0000 7f4927346800 20 add_watcher() i=4 2024-09-14T11:44:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.589+0000 7f4927346800 20 add_watcher() i=5 2024-09-14T11:44:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.590+0000 7f4927346800 20 add_watcher() i=6 2024-09-14T11:44:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.591+0000 7f4927346800 20 add_watcher() i=7 2024-09-14T11:44:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.591+0000 7f4927346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.592+0000 7f47dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.592+0000 7f4927346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.592+0000 7f4927346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f4927346800 5 note: GC not initialized 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f47d9fe3640 20 reqs_thread_entry: start 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f4927346800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f4927346800 20 Filter name: none 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f474b7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f4927346800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.593+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:44:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.594+0000 7f4927346800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.595+0000 7f4927346800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.595+0000 7f4927346800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:44:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.595+0000 7f4927346800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:44:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.595+0000 7f47fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431691 cookie 94628127648160 notifier 8330 bl.length()=384 2024-09-14T11:44:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.595+0000 7f47fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:44:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.595+0000 7f47fbfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:44:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.599+0000 7f4927346800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:44:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.599+0000 7f4927346800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:44:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.599+0000 7f4927346800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:44:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.599+0000 7f47fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431777 cookie 94628127650496 notifier 8330 bl.length()=225 2024-09-14T11:44:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.599+0000 7f47fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:44:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.599+0000 7f47fbfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:44:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.602+0000 7f4927346800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:44:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.602+0000 7f4927346800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:44:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.602+0000 7f4927346800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:44:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.603+0000 7f47fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94628127640016 notifier 8330 bl.length()=234 2024-09-14T11:44:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.603+0000 7f47fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:44:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.603+0000 7f47fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:44:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.605+0000 7f47dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.608+0000 7f4927346800 20 remove_watcher() i=0 2024-09-14T11:44:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.608+0000 7f4927346800 2 removed watcher, disabling cache 2024-09-14T11:44:22.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.609+0000 7f4927346800 20 remove_watcher() i=1 2024-09-14T11:44:22.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.610+0000 7f4927346800 20 remove_watcher() i=2 2024-09-14T11:44:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.611+0000 7f4927346800 20 remove_watcher() i=3 2024-09-14T11:44:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.613+0000 7f4927346800 20 remove_watcher() i=4 2024-09-14T11:44:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.614+0000 7f4927346800 20 remove_watcher() i=5 2024-09-14T11:44:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.615+0000 7f4927346800 20 remove_watcher() i=6 2024-09-14T11:44:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.616+0000 7f4927346800 20 remove_watcher() i=7 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "id": "RGW11111111111111111", 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "tenant": "", 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "quota": { 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:22.623 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_users": 1000, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_roles": 1000, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_groups": 1000, 2024-09-14T11:44:22.624 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:22.625 INFO:teuthology.orchestra.run.smithi028.stdout: "max_access_keys": 4 2024-09-14T11:44:22.625 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:22.626 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:44:22.626 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key CGCGTCQVXFSHIWGUKEFQ --secret vSnxuwEaR+xD0/1iR0fPgqkzCHTxzu3G/D1Mlj94ShASuAKLAXfpkw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:44:22.695 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:22.695 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:22.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.733+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 realm 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:22.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.735+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.736+0000 7fde31d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:22.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.736+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:22.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.736+0000 7fde31d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:22.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.736+0000 7fde31d42800 20 searching for the correct realm 2024-09-14T11:44:22.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:22.940+0000 7fde2d285640 0 -- 172.21.15.28:0/3489296186 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fde200a6920 msgr2=0x7fde20055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:23.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.148+0000 7fde2da86640 0 -- 172.21.15.28:0/3489296186 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fde24017070 msgr2=0x7fde24076400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:23.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:23.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:23.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:23.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:23.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:23.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:23.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.356+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 zone default found 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 4 Realm: () 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 zonegroup default 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.357+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.358+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.358+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.358+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.358+0000 7fde31d42800 20 started sync module instance, tier type = 2024-09-14T11:44:23.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.358+0000 7fde31d42800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=0 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=1 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=2 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=3 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=4 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=5 2024-09-14T11:44:23.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.369+0000 7fde31d42800 20 add_watcher() i=6 2024-09-14T11:44:23.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.370+0000 7fde31d42800 20 add_watcher() i=7 2024-09-14T11:44:23.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.370+0000 7fde31d42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fdcdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fde31d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fde31d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:23.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fde31d42800 5 note: GC not initialized 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fdcdeffd640 20 reqs_thread_entry: start 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fde31d42800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.372+0000 7fde31d42800 20 Filter name: none 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fdcdcff9640 20 reqs_thread_entry: start 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:44:23.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 10 cache get: name=default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ : miss 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.373+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 cache put: name=default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ info.flags=0x0 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 adding default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ to cache LRU end 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 cache get: name=default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ : hit (negative entry) 2024-09-14T11:44:23.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.374+0000 7fde31d42800 10 cache get: name=default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ : hit (negative entry) 2024-09-14T11:44:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.376+0000 7fde31d42800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:44:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.376+0000 7fde31d42800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:44:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.376+0000 7fde31d42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:44:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.376+0000 7fdd117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431778 cookie 94397947478432 notifier 8949 bl.length()=673 2024-09-14T11:44:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.376+0000 7fdd117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:44:23.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.376+0000 7fdd117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:44:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.379+0000 7fde31d42800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:44:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.379+0000 7fde31d42800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:44:23.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.379+0000 7fde31d42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:44:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.380+0000 7fdd117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431779 cookie 94397947492848 notifier 8949 bl.length()=185 2024-09-14T11:44:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.380+0000 7fdd117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:44:23.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.380+0000 7fdd117fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:44:23.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.383+0000 7fde31d42800 10 cache put: name=default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ info.flags=0x7 2024-09-14T11:44:23.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.383+0000 7fde31d42800 10 moving default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ to cache LRU end 2024-09-14T11:44:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.383+0000 7fde31d42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:CGCGTCQVXFSHIWGUKEFQ, ofs0, ns] 2024-09-14T11:44:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.383+0000 7fdd117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431728 cookie 94397947483664 notifier 8949 bl.length()=186 2024-09-14T11:44:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.383+0000 7fdd117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ info.flags=0x7 2024-09-14T11:44:23.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.383+0000 7fdd117fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CGCGTCQVXFSHIWGUKEFQ to cache LRU end 2024-09-14T11:44:23.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.386+0000 7fde31d42800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:44:23.383 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "foo.client.0", 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "foo+test@test.test", 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "foo.client.0", 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "CGCGTCQVXFSHIWGUKEFQ", 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "vSnxuwEaR+xD0/1iR0fPgqkzCHTxzu3G/D1Mlj94ShASuAKLAXfpkw==", 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:23.384 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:23.375324Z" 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:23.385 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "root", 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:23.375309Z", 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:23.386 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:23.387 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:23.387 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.387+0000 7fdcdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.389+0000 7fde31d42800 20 remove_watcher() i=0 2024-09-14T11:44:23.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.389+0000 7fde31d42800 2 removed watcher, disabling cache 2024-09-14T11:44:23.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.391+0000 7fde31d42800 20 remove_watcher() i=1 2024-09-14T11:44:23.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.392+0000 7fde31d42800 20 remove_watcher() i=2 2024-09-14T11:44:23.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.393+0000 7fde31d42800 20 remove_watcher() i=3 2024-09-14T11:44:23.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.395+0000 7fde31d42800 20 remove_watcher() i=4 2024-09-14T11:44:23.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.396+0000 7fde31d42800 20 remove_watcher() i=5 2024-09-14T11:44:23.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.397+0000 7fde31d42800 20 remove_watcher() i=6 2024-09-14T11:44:23.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.398+0000 7fde31d42800 20 remove_watcher() i=7 2024-09-14T11:44:23.409 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 7370942925 --totp-seed WH52B6ZUJDFIW67A3W664VAUWTVFSIS4FNNQXCDKFKXSY6VNBCF5MOJ2LNNSUFFE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:44:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:23.479 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.518+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 realm 2024-09-14T11:44:23.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:23.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.520+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.521+0000 7f334bbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:23.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.521+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.522+0000 7f334bbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:23.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.522+0000 7f334bbaf800 20 searching for the correct realm 2024-09-14T11:44:23.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.523+0000 7f33496a0640 0 -- 172.21.15.28:0/1013671925 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7f334407b040 msgr2=0x7f3344064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:23.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.729+0000 7f3349ea1640 0 -- 172.21.15.28:0/1013671925 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f333404b990 msgr2=0x7f333403e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.735+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 zone default found 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 4 Realm: () 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:23.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 zonegroup default 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.736+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.737+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.737+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.737+0000 7f334bbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.737+0000 7f334bbaf800 20 started sync module instance, tier type = 2024-09-14T11:44:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.737+0000 7f334bbaf800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=0 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=1 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=2 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=3 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=4 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=5 2024-09-14T11:44:23.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.746+0000 7f334bbaf800 20 add_watcher() i=6 2024-09-14T11:44:23.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.747+0000 7f334bbaf800 20 add_watcher() i=7 2024-09-14T11:44:23.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.747+0000 7f334bbaf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f31ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:23.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f334bbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f334bbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f334bbaf800 5 note: GC not initialized 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f31fe7e4640 20 reqs_thread_entry: start 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f334bbaf800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.749+0000 7f334bbaf800 20 Filter name: none 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f316ffff640 20 reqs_thread_entry: start 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f334bbaf800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:44:23.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f334bbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:44:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f334bbaf800 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:44:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f334bbaf800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:44:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f334bbaf800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:44:23.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:23.750+0000 7f334bbaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:25.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.357+0000 7f334bbaf800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:44:25.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.357+0000 7f334bbaf800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:44:25.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.357+0000 7f334bbaf800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:44:25.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.357+0000 7f321ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366372 cookie 94516160105824 notifier 8366 bl.length()=687 2024-09-14T11:44:25.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.357+0000 7f321ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:44:25.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.357+0000 7f321ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:44:25.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.360+0000 7f31ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:25.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.363+0000 7f334bbaf800 20 remove_watcher() i=0 2024-09-14T11:44:25.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.363+0000 7f334bbaf800 2 removed watcher, disabling cache 2024-09-14T11:44:25.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.364+0000 7f334bbaf800 20 remove_watcher() i=1 2024-09-14T11:44:25.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.366+0000 7f334bbaf800 20 remove_watcher() i=2 2024-09-14T11:44:25.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.367+0000 7f334bbaf800 20 remove_watcher() i=3 2024-09-14T11:44:25.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.368+0000 7f334bbaf800 20 remove_watcher() i=4 2024-09-14T11:44:25.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.370+0000 7f334bbaf800 20 remove_watcher() i=5 2024-09-14T11:44:25.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.371+0000 7f334bbaf800 20 remove_watcher() i=6 2024-09-14T11:44:25.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.372+0000 7f334bbaf800 20 remove_watcher() i=7 2024-09-14T11:44:25.383 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:44:25.383 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key YAZKFLCXCKUXSTWTDOIB --secret 9sb07d5KK5DU+r7XIy7HXXMEtNFI5fklibuelrn3M/6KgpKdzo3Vhw== --cluster ceph 2024-09-14T11:44:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.490+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 realm 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.492+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.493+0000 7fec49f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.493+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.493+0000 7fec49f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.493+0000 7fec49f22800 20 searching for the correct realm 2024-09-14T11:44:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.496+0000 7fec453ad640 0 -- 172.21.15.28:0/3658949013 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fec3804d060 msgr2=0x7fec380722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.500+0000 7fec45bae640 0 -- 172.21.15.28:0/3658949013 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fec3c07bbb0 msgr2=0x7fec3c0c6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:25.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:25.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:25.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:25.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:25.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:25.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:25.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.707+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 zone default found 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 4 Realm: () 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:25.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 zonegroup default 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.708+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.709+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.709+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.709+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.709+0000 7fec49f22800 20 started sync module instance, tier type = 2024-09-14T11:44:25.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.709+0000 7fec49f22800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=0 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=1 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=2 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=3 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=4 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=5 2024-09-14T11:44:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.718+0000 7fec49f22800 20 add_watcher() i=6 2024-09-14T11:44:25.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.719+0000 7fec49f22800 20 add_watcher() i=7 2024-09-14T11:44:25.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.719+0000 7fec49f22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7feaf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7fec49f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7fec49f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7fec49f22800 5 note: GC not initialized 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7feaf67fc640 20 reqs_thread_entry: start 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7fec49f22800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7fec49f22800 20 Filter name: none 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.721+0000 7fea67fff640 20 reqs_thread_entry: start 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:44:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 10 cache get: name=default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB : miss 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.722+0000 7fec49f22800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.723+0000 7fec49f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.723+0000 7fec49f22800 10 cache put: name=default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB info.flags=0x0 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.723+0000 7fec49f22800 10 adding default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB to cache LRU end 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.723+0000 7fec49f22800 10 cache get: name=default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB : hit (negative entry) 2024-09-14T11:44:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.723+0000 7fec49f22800 10 cache get: name=default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB : hit (negative entry) 2024-09-14T11:44:25.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.724+0000 7fec49f22800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:44:25.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.724+0000 7fec49f22800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:44:25.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.724+0000 7fec49f22800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:44:25.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.724+0000 7feb297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366284 cookie 94298174157168 notifier 8982 bl.length()=645 2024-09-14T11:44:25.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.724+0000 7feb297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:44:25.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.724+0000 7feb297fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:44:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.727+0000 7fec49f22800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:44:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.727+0000 7fec49f22800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:44:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.727+0000 7fec49f22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:44:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.727+0000 7feb297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366321 cookie 94298174168400 notifier 8982 bl.length()=185 2024-09-14T11:44:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.727+0000 7feb297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:44:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.727+0000 7feb297fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:44:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.730+0000 7fec49f22800 10 cache put: name=default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB info.flags=0x7 2024-09-14T11:44:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.730+0000 7fec49f22800 10 moving default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB to cache LRU end 2024-09-14T11:44:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.730+0000 7fec49f22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:YAZKFLCXCKUXSTWTDOIB, ofs0, ns] 2024-09-14T11:44:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.730+0000 7feb28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366322 cookie 94298174172336 notifier 8982 bl.length()=186 2024-09-14T11:44:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.730+0000 7feb28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB info.flags=0x7 2024-09-14T11:44:25.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.730+0000 7feb28ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YAZKFLCXCKUXSTWTDOIB to cache LRU end 2024-09-14T11:44:25.729 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:25.729 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "bar.client.0", 2024-09-14T11:44:25.729 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:44:25.729 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "bar+test@test.test", 2024-09-14T11:44:25.729 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "bar.client.0", 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "YAZKFLCXCKUXSTWTDOIB", 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "9sb07d5KK5DU+r7XIy7HXXMEtNFI5fklibuelrn3M/6KgpKdzo3Vhw==", 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:25.723740Z" 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:44:25.730 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:25.731 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "rgw", 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "", 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:25.723727Z", 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:25.732 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:25.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.732+0000 7feaf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:25.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.735+0000 7fec49f22800 20 remove_watcher() i=0 2024-09-14T11:44:25.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.735+0000 7fec49f22800 2 removed watcher, disabling cache 2024-09-14T11:44:25.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.736+0000 7fec49f22800 20 remove_watcher() i=1 2024-09-14T11:44:25.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.738+0000 7fec49f22800 20 remove_watcher() i=2 2024-09-14T11:44:25.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.739+0000 7fec49f22800 20 remove_watcher() i=3 2024-09-14T11:44:25.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.740+0000 7fec49f22800 20 remove_watcher() i=4 2024-09-14T11:44:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.741+0000 7fec49f22800 20 remove_watcher() i=5 2024-09-14T11:44:25.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.742+0000 7fec49f22800 20 remove_watcher() i=6 2024-09-14T11:44:25.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.743+0000 7fec49f22800 20 remove_watcher() i=7 2024-09-14T11:44:25.752 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 3070618826 --totp-seed 2SKRRPJ2XJSOBMPHCXBEMAKNIREZ5XFMTFET5DTKBBJMMFKFGKSM2J4Y74G4YWH4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:44:25.821 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:25.821 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:25.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.859+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 realm 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.860+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.861+0000 7f179f00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:25.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.861+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.862+0000 7f179f00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:25.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.862+0000 7f179f00f800 20 searching for the correct realm 2024-09-14T11:44:25.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.866+0000 7f179d301640 0 -- 172.21.15.28:0/2445934603 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x55af54c934a0 msgr2=0x55af54c95930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:25.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.869+0000 7f179c2ff640 0 -- 172.21.15.28:0/2445934603 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f178c06b180 msgr2=0x7f178c01b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.873+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:25.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:25.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 zone default found 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 4 Realm: () 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 zonegroup default 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.874+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.875+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.875+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.875+0000 7f179f00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.875+0000 7f179f00f800 20 started sync module instance, tier type = 2024-09-14T11:44:25.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.875+0000 7f179f00f800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:25.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.884+0000 7f179f00f800 20 add_watcher() i=0 2024-09-14T11:44:25.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.884+0000 7f179f00f800 20 add_watcher() i=1 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.884+0000 7f179f00f800 20 add_watcher() i=2 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.885+0000 7f179f00f800 20 add_watcher() i=3 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.885+0000 7f179f00f800 20 add_watcher() i=4 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.885+0000 7f179f00f800 20 add_watcher() i=5 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.885+0000 7f179f00f800 20 add_watcher() i=6 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.885+0000 7f179f00f800 20 add_watcher() i=7 2024-09-14T11:44:25.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.885+0000 7f179f00f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:25.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.887+0000 7f16537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.887+0000 7f179f00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.887+0000 7f179f00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.887+0000 7f179f00f800 5 note: GC not initialized 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.887+0000 7f16527e4640 20 reqs_thread_entry: start 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.887+0000 7f179f00f800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 20 Filter name: none 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f164b7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:44:25.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 20 rados->read ofs=0 len=0 2024-09-14T11:44:25.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:44:25.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:44:25.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:44:25.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.888+0000 7f179f00f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:25.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.891+0000 7f179f00f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:44:25.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.891+0000 7f179f00f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:44:25.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.891+0000 7f179f00f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:44:25.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.891+0000 7f1673fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366285 cookie 94211530115936 notifier 9000 bl.length()=659 2024-09-14T11:44:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.891+0000 7f1673fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:44:25.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.891+0000 7f1673fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:44:25.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.894+0000 7f16537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:25.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.896+0000 7f179f00f800 20 remove_watcher() i=0 2024-09-14T11:44:25.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.896+0000 7f179f00f800 2 removed watcher, disabling cache 2024-09-14T11:44:25.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.897+0000 7f179f00f800 20 remove_watcher() i=1 2024-09-14T11:44:25.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.898+0000 7f179f00f800 20 remove_watcher() i=2 2024-09-14T11:44:25.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.899+0000 7f179f00f800 20 remove_watcher() i=3 2024-09-14T11:44:25.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.900+0000 7f179f00f800 20 remove_watcher() i=4 2024-09-14T11:44:25.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.901+0000 7f179f00f800 20 remove_watcher() i=5 2024-09-14T11:44:25.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.902+0000 7f179f00f800 20 remove_watcher() i=6 2024-09-14T11:44:25.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:25.904+0000 7f179f00f800 20 remove_watcher() i=7 2024-09-14T11:44:25.913 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:44:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:26.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.015+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 realm 2024-09-14T11:44:26.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:26.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.017+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.018+0000 7fb2d372c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.018+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.018+0000 7fb2d372c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:26.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.018+0000 7fb2d372c800 20 searching for the correct realm 2024-09-14T11:44:26.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.021+0000 7fb2cecd9640 0 -- 172.21.15.28:0/1769907873 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fb2c0017030 msgr2=0x7fb2c0061390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:26.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.025+0000 7fb2cf4da640 0 -- 172.21.15.28:0/1769907873 >> [v2:172.21.15.28:6800/1746144465,v1:172.21.15.28:6801/1746144465] conn(0x7fb2c8069040 msgr2=0x7fb2c80ac400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.030+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 zone default found 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 4 Realm: () 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:26.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 zonegroup default 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.031+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.032+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.032+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.032+0000 7fb2d372c800 20 started sync module instance, tier type = 2024-09-14T11:44:26.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.032+0000 7fb2d372c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:26.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=0 2024-09-14T11:44:26.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=1 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=2 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=3 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=4 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=5 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.040+0000 7fb2d372c800 20 add_watcher() i=6 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.041+0000 7fb2d372c800 20 add_watcher() i=7 2024-09-14T11:44:26.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.041+0000 7fb2d372c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:26.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb185fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:26.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:26.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 5 note: GC not initialized 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb184fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 20 Filter name: none 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb0fe7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.043+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:44:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:44:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.044+0000 7fb2d372c800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:44:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.046+0000 7fb2d372c800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:44:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.046+0000 7fb2d372c800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:44:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.046+0000 7fb2d372c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:44:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.046+0000 7fb1b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366286 cookie 94701732446176 notifier 8420 bl.length()=389 2024-09-14T11:44:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.046+0000 7fb1b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:44:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.046+0000 7fb1b2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:44:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.049+0000 7fb2d372c800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:44:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.049+0000 7fb2d372c800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:44:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.049+0000 7fb2d372c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:44:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.049+0000 7fb1b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366373 cookie 94701732459952 notifier 8420 bl.length()=230 2024-09-14T11:44:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.049+0000 7fb1b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:44:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.049+0000 7fb1b2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:44:26.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.052+0000 7fb2d372c800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:44:26.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.052+0000 7fb2d372c800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:44:26.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.052+0000 7fb2d372c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:44:26.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.052+0000 7fb1b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 94701732456256 notifier 8420 bl.length()=234 2024-09-14T11:44:26.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.052+0000 7fb1b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:44:26.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.052+0000 7fb1b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:44:26.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.055+0000 7fb185fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.057+0000 7fb2d372c800 20 remove_watcher() i=0 2024-09-14T11:44:26.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.057+0000 7fb2d372c800 2 removed watcher, disabling cache 2024-09-14T11:44:26.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.058+0000 7fb2d372c800 20 remove_watcher() i=1 2024-09-14T11:44:26.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.059+0000 7fb2d372c800 20 remove_watcher() i=2 2024-09-14T11:44:26.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.060+0000 7fb2d372c800 20 remove_watcher() i=3 2024-09-14T11:44:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.061+0000 7fb2d372c800 20 remove_watcher() i=4 2024-09-14T11:44:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.062+0000 7fb2d372c800 20 remove_watcher() i=5 2024-09-14T11:44:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.063+0000 7fb2d372c800 20 remove_watcher() i=6 2024-09-14T11:44:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.064+0000 7fb2d372c800 20 remove_watcher() i=7 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout: "id": "RGW33333333333333333", 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout: "tenant": "testx", 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout: "quota": { 2024-09-14T11:44:26.071 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_users": 1000, 2024-09-14T11:44:26.072 INFO:teuthology.orchestra.run.smithi028.stdout: "max_roles": 1000, 2024-09-14T11:44:26.073 INFO:teuthology.orchestra.run.smithi028.stdout: "max_groups": 1000, 2024-09-14T11:44:26.073 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:26.073 INFO:teuthology.orchestra.run.smithi028.stdout: "max_access_keys": 4 2024-09-14T11:44:26.073 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:26.074 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:44:26.074 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key CTSZKDXSUTBTWDLVNKRI --secret sY7TdfszPrb8Q7jO3fKxK+nN2HdiMQ6lPSMB+yAmVHMaunTtSuiIPA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:44:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:26.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.181+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.182+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.182+0000 7efebfb23800 20 realm 2024-09-14T11:44:26.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.182+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.183+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.183+0000 7efebfb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:26.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.183+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.183+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.183+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.184+0000 7efebfb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.184+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.184+0000 7efebfb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:26.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.184+0000 7efebfb23800 20 searching for the correct realm 2024-09-14T11:44:26.185 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.187+0000 7efebc00d640 0 -- 172.21.15.28:0/1812636219 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7efeb007d070 msgr2=0x7efeb008c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:26.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.191+0000 7efebb80c640 0 -- 172.21.15.28:0/1812636219 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7efeb007d960 msgr2=0x7efeb008b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.413+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 zone default found 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 4 Realm: () 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 zonegroup default 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 started sync module instance, tier type = 2024-09-14T11:44:26.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.414+0000 7efebfb23800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=0 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=1 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=2 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=3 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=4 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=5 2024-09-14T11:44:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.424+0000 7efebfb23800 20 add_watcher() i=6 2024-09-14T11:44:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.425+0000 7efebfb23800 20 add_watcher() i=7 2024-09-14T11:44:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.425+0000 7efebfb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.426+0000 7efd71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.426+0000 7efebfb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.426+0000 7efebfb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 5 note: GC not initialized 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efd70fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 20 Filter name: none 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efcea7fc640 20 reqs_thread_entry: start 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:44:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.427+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:44:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:44:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 10 cache get: name=default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI : miss 2024-09-14T11:44:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 10 cache put: name=default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI info.flags=0x0 2024-09-14T11:44:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 10 adding default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI to cache LRU end 2024-09-14T11:44:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:44:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.428+0000 7efebfb23800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.429+0000 7efebfb23800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.429+0000 7efebfb23800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.429+0000 7efebfb23800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.429+0000 7efebfb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.429+0000 7efebfb23800 10 cache get: name=default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI : hit (negative entry) 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.429+0000 7efebfb23800 10 cache get: name=default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI : hit (negative entry) 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.430+0000 7efebfb23800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.430+0000 7efebfb23800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.430+0000 7efebfb23800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.430+0000 7efd9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333619 cookie 93883281847824 notifier 8435 bl.length()=732 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.430+0000 7efd9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:44:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.430+0000 7efd9affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:44:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.433+0000 7efebfb23800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:44:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.433+0000 7efebfb23800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:44:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.433+0000 7efebfb23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:44:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.434+0000 7efd9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333540 cookie 93883281861040 notifier 8435 bl.length()=215 2024-09-14T11:44:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.434+0000 7efd9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:44:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.434+0000 7efd9affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:44:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.436+0000 7efebfb23800 10 cache put: name=default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI info.flags=0x7 2024-09-14T11:44:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.436+0000 7efebfb23800 10 moving default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI to cache LRU end 2024-09-14T11:44:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.436+0000 7efebfb23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:CTSZKDXSUTBTWDLVNKRI, ofs0, ns] 2024-09-14T11:44:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.436+0000 7efd9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333670 cookie 93883281852960 notifier 8435 bl.length()=201 2024-09-14T11:44:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.436+0000 7efd9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI info.flags=0x7 2024-09-14T11:44:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.436+0000 7efd9a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CTSZKDXSUTBTWDLVNKRI to cache LRU end 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.439+0000 7efebfb23800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:26.437 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "CTSZKDXSUTBTWDLVNKRI", 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "sY7TdfszPrb8Q7jO3fKxK+nN2HdiMQ6lPSMB+yAmVHMaunTtSuiIPA==", 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:26.429856Z" 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:26.438 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "root", 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:44:26.439 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:26.429842Z", 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.440+0000 7efd71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.442+0000 7efebfb23800 20 remove_watcher() i=0 2024-09-14T11:44:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.442+0000 7efebfb23800 2 removed watcher, disabling cache 2024-09-14T11:44:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.443+0000 7efebfb23800 20 remove_watcher() i=1 2024-09-14T11:44:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.444+0000 7efebfb23800 20 remove_watcher() i=2 2024-09-14T11:44:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.445+0000 7efebfb23800 20 remove_watcher() i=3 2024-09-14T11:44:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.446+0000 7efebfb23800 20 remove_watcher() i=4 2024-09-14T11:44:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.447+0000 7efebfb23800 20 remove_watcher() i=5 2024-09-14T11:44:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.448+0000 7efebfb23800 20 remove_watcher() i=6 2024-09-14T11:44:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.449+0000 7efebfb23800 20 remove_watcher() i=7 2024-09-14T11:44:26.458 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 2284265812 --totp-seed MICQXKDECFIJ3FZHZJBB7MUMARFB4SJ4XW2GNAQLXYKQJGMGRBNSTEPGJJ4KFBIM --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:44:26.529 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:26.529 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:26.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.564+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.565+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.565+0000 7f7749b32800 20 realm 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.565+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.565+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.565+0000 7f7749b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.565+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.566+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.566+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.567+0000 7f7749b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.567+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.567+0000 7f7749b32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.567+0000 7f7749b32800 20 searching for the correct realm 2024-09-14T11:44:26.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.570+0000 7f7744fbb640 0 -- 172.21.15.28:0/1633858422 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f7738015030 msgr2=0x7f7738020450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:26.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.574+0000 7f77457bc640 0 -- 172.21.15.28:0/1633858422 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f773c037960 msgr2=0x7f773c008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:26.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:26.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.780+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 zone default found 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 4 Realm: () 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 zonegroup default 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.781+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.782+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.782+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.782+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.782+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.782+0000 7f7749b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.782+0000 7f7749b32800 20 started sync module instance, tier type = 2024-09-14T11:44:26.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.783+0000 7f7749b32800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:26.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=0 2024-09-14T11:44:26.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=1 2024-09-14T11:44:26.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=2 2024-09-14T11:44:26.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=3 2024-09-14T11:44:26.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=4 2024-09-14T11:44:26.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=5 2024-09-14T11:44:26.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.791+0000 7f7749b32800 20 add_watcher() i=6 2024-09-14T11:44:26.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.792+0000 7f7749b32800 20 add_watcher() i=7 2024-09-14T11:44:26.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.792+0000 7f7749b32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:26.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f75fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:26.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:26.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 5 note: GC not initialized 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f75fa7e4640 20 reqs_thread_entry: start 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 20 Filter name: none 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f756bfff640 20 reqs_thread_entry: start 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.794+0000 7f7749b32800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.795+0000 7f7749b32800 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:44:26.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.795+0000 7f7749b32800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:44:26.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.795+0000 7f7749b32800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:44:26.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.795+0000 7f7749b32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:26.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.798+0000 7f7749b32800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:44:26.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.798+0000 7f7749b32800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:44:26.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.798+0000 7f7749b32800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:44:26.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.798+0000 7f7628ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333620 cookie 94197244517136 notifier 8173 bl.length()=746 2024-09-14T11:44:26.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.798+0000 7f7628ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:44:26.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.798+0000 7f7628ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:44:26.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.800+0000 7f75fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.803+0000 7f7749b32800 20 remove_watcher() i=0 2024-09-14T11:44:26.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.803+0000 7f7749b32800 2 removed watcher, disabling cache 2024-09-14T11:44:26.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.804+0000 7f7749b32800 20 remove_watcher() i=1 2024-09-14T11:44:26.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.805+0000 7f7749b32800 20 remove_watcher() i=2 2024-09-14T11:44:26.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.806+0000 7f7749b32800 20 remove_watcher() i=3 2024-09-14T11:44:26.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.807+0000 7f7749b32800 20 remove_watcher() i=4 2024-09-14T11:44:26.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.808+0000 7f7749b32800 20 remove_watcher() i=5 2024-09-14T11:44:26.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.809+0000 7f7749b32800 20 remove_watcher() i=6 2024-09-14T11:44:26.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.810+0000 7f7749b32800 20 remove_watcher() i=7 2024-09-14T11:44:26.820 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:44:26.820 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key URHAANACBLBUJNESBFGF --secret +++n35wTBSJ3+EeWq34EgpPw6ADnRzpPRGqIEJg+L2nrAubxW70y0Q== --cluster ceph 2024-09-14T11:44:26.886 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:26.886 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.923+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 realm 2024-09-14T11:44:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.925+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.926+0000 7f2729a1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.926+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.926+0000 7f2729a1b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.927+0000 7f2729a1b800 20 searching for the correct realm 2024-09-14T11:44:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.930+0000 7f27249ea640 0 -- 172.21.15.28:0/678744741 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f271808f040 msgr2=0x7f2718009d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:44:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.934+0000 7f27249ea640 0 -- 172.21.15.28:0/678744741 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f25f0088740 msgr2=0x7f25f008ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:26.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:26.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.938+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 zone default found 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 4 Realm: () 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 zonegroup default 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.939+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.940+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.940+0000 7f2729a1b800 20 started sync module instance, tier type = 2024-09-14T11:44:26.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.940+0000 7f2729a1b800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=0 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=1 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=2 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=3 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=4 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=5 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.948+0000 7f2729a1b800 20 add_watcher() i=6 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.949+0000 7f2729a1b800 20 add_watcher() i=7 2024-09-14T11:44:26.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.949+0000 7f2729a1b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:26.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.950+0000 7f25db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.950+0000 7f2729a1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:26.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.950+0000 7f2729a1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:26.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.950+0000 7f2729a1b800 5 note: GC not initialized 2024-09-14T11:44:26.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f25da7e4640 20 reqs_thread_entry: start 2024-09-14T11:44:26.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 20 Filter name: none 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f254bfff640 20 reqs_thread_entry: start 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:44:26.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.951+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 cache get: name=default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF : miss 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 20 rados->read ofs=0 len=0 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 cache put: name=default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF info.flags=0x0 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 adding default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF to cache LRU end 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 cache get: name=default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF : hit (negative entry) 2024-09-14T11:44:26.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.952+0000 7f2729a1b800 10 cache get: name=default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF : hit (negative entry) 2024-09-14T11:44:26.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.953+0000 7f2729a1b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:44:26.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.953+0000 7f2729a1b800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:26.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.953+0000 7f2729a1b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:44:26.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.954+0000 7f2608ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 93873244186096 notifier 8465 bl.length()=660 2024-09-14T11:44:26.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.954+0000 7f2608ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:44:26.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.954+0000 7f2608ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:26.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.956+0000 7f2729a1b800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:44:26.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.956+0000 7f2729a1b800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:44:26.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.956+0000 7f2729a1b800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:44:26.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.956+0000 7f2608ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333583 cookie 93873244168288 notifier 8465 bl.length()=191 2024-09-14T11:44:26.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.956+0000 7f2608ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:44:26.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.956+0000 7f2608ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:44:26.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.959+0000 7f2729a1b800 10 cache put: name=default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF info.flags=0x7 2024-09-14T11:44:26.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.959+0000 7f2729a1b800 10 moving default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF to cache LRU end 2024-09-14T11:44:26.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.959+0000 7f2729a1b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:URHAANACBLBUJNESBFGF, ofs0, ns] 2024-09-14T11:44:26.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.959+0000 7f2608ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333542 cookie 93873244186096 notifier 8465 bl.length()=189 2024-09-14T11:44:26.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.959+0000 7f2608ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF info.flags=0x7 2024-09-14T11:44:26.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.959+0000 7f2608ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+URHAANACBLBUJNESBFGF to cache LRU end 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "foobar.client.0", 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "foobar+test@test.test", 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:26.958 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "foobar.client.0", 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "URHAANACBLBUJNESBFGF", 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "+++n35wTBSJ3+EeWq34EgpPw6ADnRzpPRGqIEJg+L2nrAubxW70y0Q==", 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:26.953263Z" 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:26.959 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:26.960 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "rgw", 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "", 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:26.953252Z", 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:26.961 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:26.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.961+0000 7f25db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:26.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.963+0000 7f2729a1b800 20 remove_watcher() i=0 2024-09-14T11:44:26.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.963+0000 7f2729a1b800 2 removed watcher, disabling cache 2024-09-14T11:44:26.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.964+0000 7f2729a1b800 20 remove_watcher() i=1 2024-09-14T11:44:26.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.965+0000 7f2729a1b800 20 remove_watcher() i=2 2024-09-14T11:44:26.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.966+0000 7f2729a1b800 20 remove_watcher() i=3 2024-09-14T11:44:26.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.967+0000 7f2729a1b800 20 remove_watcher() i=4 2024-09-14T11:44:26.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.968+0000 7f2729a1b800 20 remove_watcher() i=5 2024-09-14T11:44:26.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.969+0000 7f2729a1b800 20 remove_watcher() i=6 2024-09-14T11:44:26.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:26.970+0000 7f2729a1b800 20 remove_watcher() i=7 2024-09-14T11:44:26.979 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 9529454363 --totp-seed XK4MGFUIE7RJNFTHCFQI4TXFMXTQW4WB2L7PS27RC3GYXXYBR3M5QNF5KMCBJNWA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:44:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:27.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.085+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.086+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.086+0000 7fbdb5f21800 20 realm 2024-09-14T11:44:27.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.086+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.086+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.086+0000 7fbdb5f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:27.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.086+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.087+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.087+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.087+0000 7fbdb5f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.087+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.088+0000 7fbdb5f21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:27.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.088+0000 7fbdb5f21800 20 searching for the correct realm 2024-09-14T11:44:27.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.091+0000 7fbdb1443640 0 -- 172.21.15.28:0/1697663982 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55d0eda07910 msgr2=0x55d0eda09db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.095+0000 7fbdb1c44640 0 -- 172.21.15.28:0/1697663982 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fbda8082bc0 msgr2=0x7fbda8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:27.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:27.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:27.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.099+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:27.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 20 zone default found 2024-09-14T11:44:27.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 4 Realm: () 2024-09-14T11:44:27.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:27.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:27.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 20 zonegroup default 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.100+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.101+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.101+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.101+0000 7fbdb5f21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.101+0000 7fbdb5f21800 20 started sync module instance, tier type = 2024-09-14T11:44:27.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.101+0000 7fbdb5f21800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:27.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.109+0000 7fbdb5f21800 20 add_watcher() i=0 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.109+0000 7fbdb5f21800 20 add_watcher() i=1 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.109+0000 7fbdb5f21800 20 add_watcher() i=2 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.109+0000 7fbdb5f21800 20 add_watcher() i=3 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.109+0000 7fbdb5f21800 20 add_watcher() i=4 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.110+0000 7fbdb5f21800 20 add_watcher() i=5 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.110+0000 7fbdb5f21800 20 add_watcher() i=6 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.110+0000 7fbdb5f21800 20 add_watcher() i=7 2024-09-14T11:44:27.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.111+0000 7fbdb5f21800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:27.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.112+0000 7fbc637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:27.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.112+0000 7fbdb5f21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:27.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.112+0000 7fbdb5f21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:27.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.112+0000 7fbdb5f21800 5 note: GC not initialized 2024-09-14T11:44:27.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.113+0000 7fbc627fc640 20 reqs_thread_entry: start 2024-09-14T11:44:27.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.113+0000 7fbdb5f21800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:27.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.113+0000 7fbdb5f21800 20 Filter name: none 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.113+0000 7fbbd3fff640 20 reqs_thread_entry: start 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.113+0000 7fbdb5f21800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.113+0000 7fbdb5f21800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.114+0000 7fbdb5f21800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.114+0000 7fbdb5f21800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.114+0000 7fbdb5f21800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:27.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.114+0000 7fbdb5f21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:27.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.116+0000 7fbdb5f21800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:44:27.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.116+0000 7fbdb5f21800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:27.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.116+0000 7fbdb5f21800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:44:27.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.117+0000 7fbc957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333543 cookie 94355828302320 notifier 9090 bl.length()=674 2024-09-14T11:44:27.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.117+0000 7fbc957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:44:27.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.117+0000 7fbc957fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:27.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.121+0000 7fbc637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:27.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.123+0000 7fbdb5f21800 20 remove_watcher() i=0 2024-09-14T11:44:27.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.123+0000 7fbdb5f21800 2 removed watcher, disabling cache 2024-09-14T11:44:27.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.124+0000 7fbdb5f21800 20 remove_watcher() i=1 2024-09-14T11:44:27.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.125+0000 7fbdb5f21800 20 remove_watcher() i=2 2024-09-14T11:44:27.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.126+0000 7fbdb5f21800 20 remove_watcher() i=3 2024-09-14T11:44:27.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.127+0000 7fbdb5f21800 20 remove_watcher() i=4 2024-09-14T11:44:27.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.128+0000 7fbdb5f21800 20 remove_watcher() i=5 2024-09-14T11:44:27.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.129+0000 7fbdb5f21800 20 remove_watcher() i=6 2024-09-14T11:44:27.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.130+0000 7fbdb5f21800 20 remove_watcher() i=7 2024-09-14T11:44:27.140 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:44:27.200 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:27.200 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:27.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.237+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.239+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.239+0000 7fe327f42800 20 realm 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.239+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.240+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.240+0000 7fe327f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.240+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.240+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.240+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.241+0000 7fe327f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.241+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.241+0000 7fe327f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:27.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.241+0000 7fe327f42800 20 searching for the correct realm 2024-09-14T11:44:27.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.244+0000 7fe3244ee640 0 -- 172.21.15.28:0/440946639 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fe31806b020 msgr2=0x7fe318058740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.248+0000 7fe323ced640 0 -- 172.21.15.28:0/440946639 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fe3180ce3c0 msgr2=0x7fe3180cdd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:27.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:27.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:27.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:27.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:27.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:27.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.455+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:27.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 zone default found 2024-09-14T11:44:27.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 4 Realm: () 2024-09-14T11:44:27.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 zonegroup default 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.456+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.457+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.457+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.457+0000 7fe327f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.457+0000 7fe327f42800 20 started sync module instance, tier type = 2024-09-14T11:44:27.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.457+0000 7fe327f42800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=0 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=1 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=2 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=3 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=4 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=5 2024-09-14T11:44:27.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.466+0000 7fe327f42800 20 add_watcher() i=6 2024-09-14T11:44:27.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.467+0000 7fe327f42800 20 add_watcher() i=7 2024-09-14T11:44:27.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.467+0000 7fe327f42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:27.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe1d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:27.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:27.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:27.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 5 note: GC not initialized 2024-09-14T11:44:27.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe1d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:27.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 20 Filter name: none 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe1527fc640 20 reqs_thread_entry: start 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.469+0000 7fe327f42800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.470+0000 7fe327f42800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.470+0000 7fe327f42800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.470+0000 7fe327f42800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:27.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.470+0000 7fe327f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:27.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.471+0000 7fe327f42800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:44:27.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.471+0000 7fe327f42800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:27.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.471+0000 7fe327f42800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:44:27.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.471+0000 7fe202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333544 cookie 94065259230640 notifier 8498 bl.length()=727 2024-09-14T11:44:27.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.471+0000 7fe202ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:44:27.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.471+0000 7fe202ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "foobar.client.0", 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "foobar+test@test.test", 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "foobar.client.0", 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "URHAANACBLBUJNESBFGF", 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "+++n35wTBSJ3+EeWq34EgpPw6ADnRzpPRGqIEJg+L2nrAubxW70y0Q==", 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:27.471 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:26.953263Z" 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [ 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "oidc-provider", 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "perm": "*" 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "roles", 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "perm": "*" 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "user-policy", 2024-09-14T11:44:27.472 INFO:teuthology.orchestra.run.smithi028.stdout: "perm": "*" 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:27.473 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "rgw", 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [ 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "9529454363" 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "", 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:26.953252Z", 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:27.474 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:27.475 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:27.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.474+0000 7fe1d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:27.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.476+0000 7fe327f42800 20 remove_watcher() i=0 2024-09-14T11:44:27.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.476+0000 7fe327f42800 2 removed watcher, disabling cache 2024-09-14T11:44:27.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.477+0000 7fe327f42800 20 remove_watcher() i=1 2024-09-14T11:44:27.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.478+0000 7fe327f42800 20 remove_watcher() i=2 2024-09-14T11:44:27.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.480+0000 7fe327f42800 20 remove_watcher() i=3 2024-09-14T11:44:27.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.481+0000 7fe327f42800 20 remove_watcher() i=4 2024-09-14T11:44:27.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.482+0000 7fe327f42800 20 remove_watcher() i=5 2024-09-14T11:44:27.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.483+0000 7fe327f42800 20 remove_watcher() i=6 2024-09-14T11:44:27.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.484+0000 7fe327f42800 20 remove_watcher() i=7 2024-09-14T11:44:27.493 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:44:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:27.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.592+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.594+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.594+0000 7fba48535800 20 realm 2024-09-14T11:44:27.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.594+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.594+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.594+0000 7fba48535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:27.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.594+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.595+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.595+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.595+0000 7fba48535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.595+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.595+0000 7fba48535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:27.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.596+0000 7fba48535800 20 searching for the correct realm 2024-09-14T11:44:27.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.598+0000 7fba43a7c640 0 -- 172.21.15.28:0/3146158729 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fba340b3b40 msgr2=0x7fba340b53d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.602+0000 7fba4427d640 0 -- 172.21.15.28:0/3146158729 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fba38022400 msgr2=0x7fba38022880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.808+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:27.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 zone default found 2024-09-14T11:44:27.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 4 Realm: () 2024-09-14T11:44:27.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:27.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:27.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 zonegroup default 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.809+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 started sync module instance, tier type = 2024-09-14T11:44:27.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.810+0000 7fba48535800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=0 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=1 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=2 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=3 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=4 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=5 2024-09-14T11:44:27.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.819+0000 7fba48535800 20 add_watcher() i=6 2024-09-14T11:44:27.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.820+0000 7fba48535800 20 add_watcher() i=7 2024-09-14T11:44:27.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.820+0000 7fba48535800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:27.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fb8fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:27.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fba48535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:27.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fba48535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:27.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fba48535800 5 note: GC not initialized 2024-09-14T11:44:27.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fb8f9fe3640 20 reqs_thread_entry: start 2024-09-14T11:44:27.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fba48535800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.822+0000 7fba48535800 20 Filter name: none 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fb8f2ffd640 20 reqs_thread_entry: start 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:44:27.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:44:27.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.823+0000 7fba48535800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:44:27.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.825+0000 7fba48535800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:44:27.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.825+0000 7fba48535800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:44:27.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.825+0000 7fba48535800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:44:27.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.825+0000 7fb9237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333584 cookie 94193493294768 notifier 9129 bl.length()=384 2024-09-14T11:44:27.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.825+0000 7fb9237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:44:27.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.825+0000 7fb9237fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:44:27.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.828+0000 7fba48535800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:44:27.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.828+0000 7fba48535800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:44:27.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.828+0000 7fba48535800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:44:27.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.829+0000 7fb9237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333671 cookie 94193493303904 notifier 9129 bl.length()=225 2024-09-14T11:44:27.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.829+0000 7fb9237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:44:27.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.829+0000 7fb9237fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:44:27.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.831+0000 7fba48535800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:44:27.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.831+0000 7fba48535800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:44:27.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.831+0000 7fba48535800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:44:27.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.831+0000 7fb922ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333558 cookie 94193493301600 notifier 9129 bl.length()=234 2024-09-14T11:44:27.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.831+0000 7fb922ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:44:27.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.831+0000 7fb922ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:44:27.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.834+0000 7fb8fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:27.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.836+0000 7fba48535800 20 remove_watcher() i=0 2024-09-14T11:44:27.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.836+0000 7fba48535800 2 removed watcher, disabling cache 2024-09-14T11:44:27.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.837+0000 7fba48535800 20 remove_watcher() i=1 2024-09-14T11:44:27.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.838+0000 7fba48535800 20 remove_watcher() i=2 2024-09-14T11:44:27.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.839+0000 7fba48535800 20 remove_watcher() i=3 2024-09-14T11:44:27.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.840+0000 7fba48535800 20 remove_watcher() i=4 2024-09-14T11:44:27.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.841+0000 7fba48535800 20 remove_watcher() i=5 2024-09-14T11:44:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.842+0000 7fba48535800 20 remove_watcher() i=6 2024-09-14T11:44:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.843+0000 7fba48535800 20 remove_watcher() i=7 2024-09-14T11:44:27.850 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:27.850 INFO:teuthology.orchestra.run.smithi028.stdout: "id": "RGW88888888888888888", 2024-09-14T11:44:27.850 INFO:teuthology.orchestra.run.smithi028.stdout: "tenant": "", 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "quota": { 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:27.851 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_users": 1000, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_roles": 1000, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_groups": 1000, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout: "max_access_keys": 4 2024-09-14T11:44:27.852 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:27.853 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:44:27.854 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key GZIHGMABPCAVZXSWVHUX --secret oouwV39QeHjwjxRXMhf9bFoh0vLtjp12/TLJqp1tyZhJa6dkTIcpgQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:44:27.923 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:27.923 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:27.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.962+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 realm 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:27.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.964+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.965+0000 7f9770a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:27.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.965+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:27.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.965+0000 7f9770a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:27.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.965+0000 7f9770a40800 20 searching for the correct realm 2024-09-14T11:44:27.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.968+0000 7f976dd29640 0 -- 172.21.15.28:0/108264043 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f976006eb10 msgr2=0x7f9760067c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:27.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:27.972+0000 7f976e52a640 0 -- 172.21.15.28:0/108264043 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f97580c0900 msgr2=0x7f97580c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.178+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 zone default found 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 4 Realm: () 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 zonegroup default 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.179+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.180+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.180+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.180+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.180+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.181+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.181+0000 7f9770a40800 20 started sync module instance, tier type = 2024-09-14T11:44:28.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.181+0000 7f9770a40800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=0 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=1 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=2 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=3 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=4 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=5 2024-09-14T11:44:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.190+0000 7f9770a40800 20 add_watcher() i=6 2024-09-14T11:44:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.191+0000 7f9770a40800 20 add_watcher() i=7 2024-09-14T11:44:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.191+0000 7f9770a40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9624fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 5 note: GC not initialized 2024-09-14T11:44:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f959f7fe640 20 reqs_thread_entry: start 2024-09-14T11:44:28.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 20 Filter name: none 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f959d7fa640 20 reqs_thread_entry: start 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.193+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 cache get: name=default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX : miss 2024-09-14T11:44:28.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 cache put: name=default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX info.flags=0x0 2024-09-14T11:44:28.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 adding default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX to cache LRU end 2024-09-14T11:44:28.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:44:28.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.194+0000 7f9770a40800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.195+0000 7f9770a40800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.195+0000 7f9770a40800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.195+0000 7f9770a40800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.195+0000 7f9770a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.195+0000 7f9770a40800 10 cache get: name=default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX : hit (negative entry) 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.195+0000 7f9770a40800 10 cache get: name=default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX : hit (negative entry) 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.197+0000 7f9770a40800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.197+0000 7f9770a40800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:44:28.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.197+0000 7f9770a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:44:28.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.197+0000 7f9651ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333585 cookie 94346116956368 notifier 8534 bl.length()=681 2024-09-14T11:44:28.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.197+0000 7f9651ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:44:28.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.197+0000 7f9651ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:44:28.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.200+0000 7f9770a40800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:44:28.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.200+0000 7f9770a40800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:44:28.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.200+0000 7f9770a40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:44:28.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.200+0000 7f9651ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333621 cookie 94346116973440 notifier 8534 bl.length()=189 2024-09-14T11:44:28.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.200+0000 7f9651ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:44:28.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.200+0000 7f9651ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:44:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.203+0000 7f9770a40800 10 cache put: name=default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX info.flags=0x7 2024-09-14T11:44:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.203+0000 7f9770a40800 10 moving default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX to cache LRU end 2024-09-14T11:44:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.203+0000 7f9770a40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:GZIHGMABPCAVZXSWVHUX, ofs0, ns] 2024-09-14T11:44:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.203+0000 7f96517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333586 cookie 94346116956368 notifier 8534 bl.length()=188 2024-09-14T11:44:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.203+0000 7f96517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX info.flags=0x7 2024-09-14T11:44:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.203+0000 7f96517fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GZIHGMABPCAVZXSWVHUX to cache LRU end 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.206+0000 7f9770a40800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "root1.client.0", 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "root1+test@test.test", 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:28.204 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "root1.client.0", 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "GZIHGMABPCAVZXSWVHUX", 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "oouwV39QeHjwjxRXMhf9bFoh0vLtjp12/TLJqp1tyZhJa6dkTIcpgQ==", 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:28.196027Z" 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:28.205 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "root", 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:44:28.206 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:28.196015Z", 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.207+0000 7f9624fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.210+0000 7f9770a40800 20 remove_watcher() i=0 2024-09-14T11:44:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.210+0000 7f9770a40800 2 removed watcher, disabling cache 2024-09-14T11:44:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.211+0000 7f9770a40800 20 remove_watcher() i=1 2024-09-14T11:44:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.212+0000 7f9770a40800 20 remove_watcher() i=2 2024-09-14T11:44:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.213+0000 7f9770a40800 20 remove_watcher() i=3 2024-09-14T11:44:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.214+0000 7f9770a40800 20 remove_watcher() i=4 2024-09-14T11:44:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.215+0000 7f9770a40800 20 remove_watcher() i=5 2024-09-14T11:44:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.216+0000 7f9770a40800 20 remove_watcher() i=6 2024-09-14T11:44:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.217+0000 7f9770a40800 20 remove_watcher() i=7 2024-09-14T11:44:28.226 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8606940020 --totp-seed VZ27YUJYFMBEEXDYYZFGMYWY3B3HE7ADKXWTQFRHZCWAYA2CB2VYFJFTH4Q6YIOA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:44:28.293 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:28.294 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:28.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.332+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.333+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.333+0000 7f1b0f175800 20 realm 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.333+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.334+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.334+0000 7f1b0f175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.334+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.334+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.334+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.335+0000 7f1b0f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:28.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.335+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.335+0000 7f1b0f175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:28.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.335+0000 7f1b0f175800 20 searching for the correct realm 2024-09-14T11:44:28.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.337+0000 7f1b0445e640 0 -- 172.21.15.28:0/1662660345 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f1afc0b0070 msgr2=0x7f1afc0de1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:28.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.342+0000 7f1b0cc5f640 0 -- 172.21.15.28:0/1662660345 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f1af4072d70 msgr2=0x7f1af4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.548+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 zone default found 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 4 Realm: () 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 zonegroup default 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.549+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 started sync module instance, tier type = 2024-09-14T11:44:28.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.550+0000 7f1b0f175800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=0 2024-09-14T11:44:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=1 2024-09-14T11:44:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=2 2024-09-14T11:44:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=3 2024-09-14T11:44:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=4 2024-09-14T11:44:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=5 2024-09-14T11:44:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.559+0000 7f1b0f175800 20 add_watcher() i=6 2024-09-14T11:44:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.560+0000 7f1b0f175800 20 add_watcher() i=7 2024-09-14T11:44:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.560+0000 7f1b0f175800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.562+0000 7f19c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.562+0000 7f1b0f175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.562+0000 7f1b0f175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.562+0000 7f1b0f175800 5 note: GC not initialized 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.562+0000 7f19c1fe3640 20 reqs_thread_entry: start 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 20 Filter name: none 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f19337fe640 20 reqs_thread_entry: start 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:44:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:44:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:44:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:44:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.563+0000 7f1b0f175800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.566+0000 7f1b0f175800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:44:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.566+0000 7f1b0f175800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:44:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.566+0000 7f1b0f175800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:44:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.566+0000 7f19e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333587 cookie 93877683763312 notifier 9168 bl.length()=695 2024-09-14T11:44:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.566+0000 7f19e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:44:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.566+0000 7f19e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:44:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.569+0000 7f19c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.571+0000 7f1b0f175800 20 remove_watcher() i=0 2024-09-14T11:44:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.571+0000 7f1b0f175800 2 removed watcher, disabling cache 2024-09-14T11:44:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.572+0000 7f1b0f175800 20 remove_watcher() i=1 2024-09-14T11:44:28.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.573+0000 7f1b0f175800 20 remove_watcher() i=2 2024-09-14T11:44:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.574+0000 7f1b0f175800 20 remove_watcher() i=3 2024-09-14T11:44:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.575+0000 7f1b0f175800 20 remove_watcher() i=4 2024-09-14T11:44:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.576+0000 7f1b0f175800 20 remove_watcher() i=5 2024-09-14T11:44:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.577+0000 7f1b0f175800 20 remove_watcher() i=6 2024-09-14T11:44:28.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.578+0000 7f1b0f175800 20 remove_watcher() i=7 2024-09-14T11:44:28.588 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:44:28.649 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:28.649 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:28.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.686+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 realm 2024-09-14T11:44:28.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:28.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.688+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.689+0000 7fb455f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:28.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.689+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.690+0000 7fb455f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:28.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.690+0000 7fb455f26800 20 searching for the correct realm 2024-09-14T11:44:28.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.693+0000 7fb4523da640 0 -- 172.21.15.28:0/3217851447 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fb44803a920 msgr2=0x7fb44801e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:28.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.696+0000 7fb451bd9640 0 -- 172.21.15.28:0/3217851447 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb44801e410 msgr2=0x7fb44801e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.901+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 zone default found 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 4 Realm: () 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 zonegroup default 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.902+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 started sync module instance, tier type = 2024-09-14T11:44:28.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.903+0000 7fb455f26800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:28.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=0 2024-09-14T11:44:28.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=1 2024-09-14T11:44:28.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=2 2024-09-14T11:44:28.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=3 2024-09-14T11:44:28.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=4 2024-09-14T11:44:28.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=5 2024-09-14T11:44:28.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.912+0000 7fb455f26800 20 add_watcher() i=6 2024-09-14T11:44:28.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.913+0000 7fb455f26800 20 add_watcher() i=7 2024-09-14T11:44:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.913+0000 7fb455f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:28.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.915+0000 7fb3037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.915+0000 7fb455f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.915+0000 7fb455f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.915+0000 7fb455f26800 5 note: GC not initialized 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.915+0000 7fb3027fc640 20 reqs_thread_entry: start 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 20 Filter name: none 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb273fff640 20 reqs_thread_entry: start 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:44:28.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.916+0000 7fb455f26800 20 rados->read ofs=0 len=0 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.917+0000 7fb455f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.917+0000 7fb455f26800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.917+0000 7fb455f26800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:44:28.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.917+0000 7fb455f26800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:44:28.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.918+0000 7fb455f26800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:44:28.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.918+0000 7fb455f26800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:44:28.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.918+0000 7fb455f26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:44:28.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.919+0000 7fb3357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333588 cookie 94690871889872 notifier 9189 bl.length()=384 2024-09-14T11:44:28.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.919+0000 7fb3357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:44:28.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.919+0000 7fb3357fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:44:28.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.922+0000 7fb455f26800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:44:28.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.922+0000 7fb455f26800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:44:28.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.922+0000 7fb455f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:44:28.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.922+0000 7fb3357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333672 cookie 94690871901520 notifier 9189 bl.length()=225 2024-09-14T11:44:28.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.922+0000 7fb3357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:44:28.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.922+0000 7fb3357fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:44:28.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.924+0000 7fb455f26800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:44:28.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.924+0000 7fb455f26800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:44:28.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.924+0000 7fb455f26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:44:28.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.925+0000 7fb3357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333559 cookie 94690871898928 notifier 9189 bl.length()=234 2024-09-14T11:44:28.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.925+0000 7fb3357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:44:28.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.925+0000 7fb3357fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:44:28.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.927+0000 7fb3037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:28.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.929+0000 7fb455f26800 20 remove_watcher() i=0 2024-09-14T11:44:28.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.929+0000 7fb455f26800 2 removed watcher, disabling cache 2024-09-14T11:44:28.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.930+0000 7fb455f26800 20 remove_watcher() i=1 2024-09-14T11:44:28.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.931+0000 7fb455f26800 20 remove_watcher() i=2 2024-09-14T11:44:28.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.932+0000 7fb455f26800 20 remove_watcher() i=3 2024-09-14T11:44:28.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.933+0000 7fb455f26800 20 remove_watcher() i=4 2024-09-14T11:44:28.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.934+0000 7fb455f26800 20 remove_watcher() i=5 2024-09-14T11:44:28.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.935+0000 7fb455f26800 20 remove_watcher() i=6 2024-09-14T11:44:28.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:28.936+0000 7fb455f26800 20 remove_watcher() i=7 2024-09-14T11:44:28.943 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "id": "RGW99999999999999999", 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "tenant": "", 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "quota": { 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:28.944 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max_users": 1000, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max_roles": 1000, 2024-09-14T11:44:28.945 INFO:teuthology.orchestra.run.smithi028.stdout: "max_groups": 1000, 2024-09-14T11:44:28.946 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:28.946 INFO:teuthology.orchestra.run.smithi028.stdout: "max_access_keys": 4 2024-09-14T11:44:28.946 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:28.947 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:44:28.947 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key EUBXFNWXEYBBSYJVOCOF --secret 9qTRGYZFoBnPFQtisxbxnFAlCTt1m14gzfROxA0mcoG3cF3YmOZK+w== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:44:29.017 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:29.018 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:29.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.258+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.259+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.259+0000 7fb3e0f2e800 20 realm 2024-09-14T11:44:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.259+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.260+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.260+0000 7fb3e0f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.260+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.260+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.260+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.261+0000 7fb3e0f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:29.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.261+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.261+0000 7fb3e0f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:29.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.261+0000 7fb3e0f2e800 20 searching for the correct realm 2024-09-14T11:44:29.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.264+0000 7fb3dc363640 0 -- 172.21.15.28:0/1692391576 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fb3cc027030 msgr2=0x7fb3cc061030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:29.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.267+0000 7fb3dcb64640 0 -- 172.21.15.28:0/1692391576 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fb3d0074350 msgr2=0x7fb3d006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:29.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.473+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.474+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.474+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.474+0000 7fb3e0f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.474+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 zone default found 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 4 Realm: () 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 zonegroup default 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.475+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.476+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.476+0000 7fb3e0f2e800 20 started sync module instance, tier type = 2024-09-14T11:44:29.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.476+0000 7fb3e0f2e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=0 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=1 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=2 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=3 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=4 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=5 2024-09-14T11:44:29.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.485+0000 7fb3e0f2e800 20 add_watcher() i=6 2024-09-14T11:44:29.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.486+0000 7fb3e0f2e800 20 add_watcher() i=7 2024-09-14T11:44:29.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.486+0000 7fb3e0f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:29.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb2937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:29.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:29.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:29.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 5 note: GC not initialized 2024-09-14T11:44:29.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb2927e4640 20 reqs_thread_entry: start 2024-09-14T11:44:29.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:29.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 20 Filter name: none 2024-09-14T11:44:29.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb28bfff640 20 reqs_thread_entry: start 2024-09-14T11:44:29.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:44:29.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.488+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 10 cache get: name=default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF : miss 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.489+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF info.flags=0x0 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 adding default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF to cache LRU end 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:44:29.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:29.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 cache get: name=default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF : hit (negative entry) 2024-09-14T11:44:29.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.490+0000 7fb3e0f2e800 10 cache get: name=default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF : hit (negative entry) 2024-09-14T11:44:29.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.492+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:44:29.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.492+0000 7fb3e0f2e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:44:29.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.492+0000 7fb3e0f2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:44:29.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.492+0000 7fb2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333589 cookie 94507294878976 notifier 8582 bl.length()=681 2024-09-14T11:44:29.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.492+0000 7fb2b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:44:29.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.492+0000 7fb2b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:44:29.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.496+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:44:29.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.496+0000 7fb3e0f2e800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:44:29.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.496+0000 7fb3e0f2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:44:29.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.496+0000 7fb2b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333622 cookie 94507294889296 notifier 8582 bl.length()=189 2024-09-14T11:44:29.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.496+0000 7fb2b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:44:29.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.496+0000 7fb2b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:44:29.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.499+0000 7fb3e0f2e800 10 cache put: name=default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF info.flags=0x7 2024-09-14T11:44:29.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.499+0000 7fb3e0f2e800 10 moving default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF to cache LRU end 2024-09-14T11:44:29.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.499+0000 7fb3e0f2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:EUBXFNWXEYBBSYJVOCOF, ofs0, ns] 2024-09-14T11:44:29.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.500+0000 7fb2b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333590 cookie 94507294878976 notifier 8582 bl.length()=188 2024-09-14T11:44:29.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.500+0000 7fb2b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF info.flags=0x7 2024-09-14T11:44:29.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.500+0000 7fb2b37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EUBXFNWXEYBBSYJVOCOF to cache LRU end 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.502+0000 7fb3e0f2e800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout: "user_id": "root2.client.0", 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout: "email": "root2+test@test.test", 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout: "suspended": 0, 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout: "max_buckets": 1000, 2024-09-14T11:44:29.500 INFO:teuthology.orchestra.run.smithi028.stdout: "subusers": [], 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "keys": [ 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "user": "root2.client.0", 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "access_key": "EUBXFNWXEYBBSYJVOCOF", 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "secret_key": "9qTRGYZFoBnPFQtisxbxnFAlCTt1m14gzfROxA0mcoG3cF3YmOZK+w==", 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "active": true, 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:29.491588Z" 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "swift_keys": [], 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": [], 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "op_mask": "read, write, delete", 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "default_placement": "", 2024-09-14T11:44:29.501 INFO:teuthology.orchestra.run.smithi028.stdout: "default_storage_class": "", 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "placement_tags": [], 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "bucket_quota": { 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "user_quota": { 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "enabled": false, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "check_on_raw": false, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size": -1, 2024-09-14T11:44:29.502 INFO:teuthology.orchestra.run.smithi028.stdout: "max_size_kb": 0, 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "max_objects": -1 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "temp_url_keys": [], 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "root", 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "mfa_ids": [], 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "path": "/", 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "create_date": "2024-09-14T11:44:29.491556Z", 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "tags": [], 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: "group_ids": [] 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T11:44:29.503 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:44:29.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.503+0000 7fb2937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:29.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.505+0000 7fb3e0f2e800 20 remove_watcher() i=0 2024-09-14T11:44:29.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.505+0000 7fb3e0f2e800 2 removed watcher, disabling cache 2024-09-14T11:44:29.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.506+0000 7fb3e0f2e800 20 remove_watcher() i=1 2024-09-14T11:44:29.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.507+0000 7fb3e0f2e800 20 remove_watcher() i=2 2024-09-14T11:44:29.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.508+0000 7fb3e0f2e800 20 remove_watcher() i=3 2024-09-14T11:44:29.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.509+0000 7fb3e0f2e800 20 remove_watcher() i=4 2024-09-14T11:44:29.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.510+0000 7fb3e0f2e800 20 remove_watcher() i=5 2024-09-14T11:44:29.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.512+0000 7fb3e0f2e800 20 remove_watcher() i=6 2024-09-14T11:44:29.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.513+0000 7fb3e0f2e800 20 remove_watcher() i=7 2024-09-14T11:44:29.522 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4820678185 --totp-seed TT6DHHTV4XEQ7PJQ24ULBMLON5OZQSTAFIQIXXMTLNSZKR7Y7WUIOREOGI47YAWH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:44:29.590 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:44:29.590 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:44:29.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.628+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 realm 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.630+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.631+0000 7fd85a010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.631+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.631+0000 7fd85a010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:44:29.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.631+0000 7fd85a010800 20 searching for the correct realm 2024-09-14T11:44:29.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.634+0000 7fd854fdf640 0 -- 172.21.15.28:0/380900323 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fd84806cbc0 msgr2=0x7fd848008b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:29.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.638+0000 7fd8557e0640 0 -- 172.21.15.28:0/380900323 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fd84c0a5410 msgr2=0x7fd84c0a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:44:29.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T11:44:29.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.845+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:44:29.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:44:29.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 zone default found 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 4 Realm: () 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 zonegroup default 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.846+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.847+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.847+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.847+0000 7fd85a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.847+0000 7fd85a010800 20 started sync module instance, tier type = 2024-09-14T11:44:29.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.847+0000 7fd85a010800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=0 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=1 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=2 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=3 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=4 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=5 2024-09-14T11:44:29.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.856+0000 7fd85a010800 20 add_watcher() i=6 2024-09-14T11:44:29.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.857+0000 7fd85a010800 20 add_watcher() i=7 2024-09-14T11:44:29.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.857+0000 7fd85a010800 2 all 8 watchers are set, enabling cache 2024-09-14T11:44:29.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd70bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:29.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd85a010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd85a010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd85a010800 5 note: GC not initialized 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd70afe5640 20 reqs_thread_entry: start 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd85a010800 20 init_complete bucket index max shards: 1 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd85a010800 20 Filter name: none 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.859+0000 7fd708fe1640 20 reqs_thread_entry: start 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.860+0000 7fd85a010800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.860+0000 7fd85a010800 20 rados->read ofs=0 len=0 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.860+0000 7fd85a010800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:44:29.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.860+0000 7fd85a010800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:44:29.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.860+0000 7fd85a010800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:44:29.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.860+0000 7fd85a010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:44:29.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.863+0000 7fd85a010800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:44:29.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.863+0000 7fd85a010800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:44:29.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.863+0000 7fd85a010800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:44:29.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.863+0000 7fd738ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333591 cookie 93847462597904 notifier 8600 bl.length()=695 2024-09-14T11:44:29.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.863+0000 7fd738ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:44:29.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.863+0000 7fd738ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:44:29.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.866+0000 7fd70bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:44:29.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.868+0000 7fd85a010800 20 remove_watcher() i=0 2024-09-14T11:44:29.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.868+0000 7fd85a010800 2 removed watcher, disabling cache 2024-09-14T11:44:29.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.869+0000 7fd85a010800 20 remove_watcher() i=1 2024-09-14T11:44:29.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.871+0000 7fd85a010800 20 remove_watcher() i=2 2024-09-14T11:44:29.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.872+0000 7fd85a010800 20 remove_watcher() i=3 2024-09-14T11:44:29.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.873+0000 7fd85a010800 20 remove_watcher() i=4 2024-09-14T11:44:29.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.874+0000 7fd85a010800 20 remove_watcher() i=5 2024-09-14T11:44:29.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.875+0000 7fd85a010800 20 remove_watcher() i=6 2024-09-14T11:44:29.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T11:44:29.876+0000 7fd85a010800 20 remove_watcher() i=7 2024-09-14T11:44:29.886 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:44:29.886 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:44:29.887 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:44:29.915 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:44:29.916 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T11:44:29.916 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:44:29.985 DEBUG:teuthology.orchestra.run.smithi028:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:44:30.170 INFO:teuthology.orchestra.run.smithi028.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:44:30.358 INFO:teuthology.orchestra.run.smithi028.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:44:30.641 INFO:teuthology.orchestra.run.smithi028.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:46:26.956 INFO:teuthology.orchestra.run.smithi028.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:46:28.426 INFO:teuthology.orchestra.run.smithi028.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=4c6972b54f41e46fee41f57e43a94ed87f5f4e1ed541b6d91a0a19316ed677ba,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:46:28.427 INFO:teuthology.orchestra.run.smithi028.stdout:py run-test-pre: PYTHONHASHSEED='3757488525' 2024-09-14T11:46:28.427 INFO:teuthology.orchestra.run.smithi028.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:46:28.570 INFO:teuthology.orchestra.run.smithi028.stdout:============================= test session starts ============================== 2024-09-14T11:46:28.571 INFO:teuthology.orchestra.run.smithi028.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:46:28.571 INFO:teuthology.orchestra.run.smithi028.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:46:28.571 INFO:teuthology.orchestra.run.smithi028.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:46:28.571 INFO:teuthology.orchestra.run.smithi028.stdout:configfile: pytest.ini 2024-09-14T11:46:30.415 INFO:teuthology.orchestra.run.smithi028.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:46:30.415 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T11:46:30.733 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:46:30.970 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:46:31.267 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:46:31.568 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:46:31.800 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:46:32.065 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:46:32.414 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:46:32.634 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:46:32.759 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:46:32.881 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:46:33.111 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:46:33.350 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:46:33.582 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:46:33.816 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:46:33.942 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:46:34.067 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:46:34.146 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:46:34.224 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:46:34.302 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:46:34.379 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:46:34.457 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:46:34.536 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:46:34.614 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:46:34.695 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:46:34.774 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:46:34.852 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:46:34.928 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:46:35.006 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:46:35.085 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:46:35.163 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.240 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.318 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.397 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.476 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.554 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.633 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.712 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:46:35.790 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:46:35.867 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:46:35.946 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:46:36.026 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:46:36.104 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:46:36.182 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:46:36.260 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:46:36.339 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.418 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.495 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.573 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.653 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.732 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.810 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.888 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:46:36.966 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:46:37.477 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:46:40.384 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:46:44.506 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:46:49.955 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:46:57.466 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:46:59.085 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:47:01.669 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:47:02.406 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:47:02.597 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:47:02.919 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:47:03.238 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:47:03.889 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:47:04.218 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:47:04.406 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:47:04.407 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:47:04.407 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:47:04.408 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:47:04.409 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:47:04.409 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:47:04.411 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:47:04.411 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:47:04.412 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.413 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.414 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.415 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.415 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:47:04.416 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.417 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.418 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:47:04.419 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:47:04.419 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:47:04.421 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:47:04.421 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:47:04.422 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:47:04.423 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:47:04.423 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:47:04.424 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:47:04.425 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:47:04.426 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:47:04.426 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:47:04.427 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:47:04.516 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:47:04.527 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:47:05.158 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:47:12.550 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:47:12.994 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:47:13.516 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:47:14.036 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:47:14.562 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:47:15.092 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:47:15.481 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:47:16.034 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:47:16.523 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:47:17.001 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:47:17.421 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:47:17.801 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:47:18.179 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:47:18.396 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:47:18.828 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:47:19.325 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:47:19.865 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:47:20.262 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:47:20.658 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:47:21.054 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:47:21.452 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:47:21.845 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:47:22.228 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:47:22.600 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:47:22.826 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:47:23.088 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:47:23.314 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:47:23.543 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:47:23.770 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:47:24.231 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:47:24.473 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:47:24.740 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:47:25.164 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:47:25.569 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:47:25.805 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:47:26.241 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:47:26.647 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:47:27.214 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:47:27.578 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:47:27.977 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:47:28.381 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:47:29.117 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:47:29.673 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:47:30.172 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:47:30.803 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:47:31.532 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:47:32.729 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:47:34.051 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:47:34.782 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:47:35.538 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:47:36.078 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:47:36.827 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:47:37.280 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:47:38.613 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:47:39.443 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:47:40.480 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:47:42.707 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:47:45.679 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:47:47.278 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:47:48.756 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:47:49.865 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:47:50.524 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:47:51.836 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:47:52.731 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:47:53.958 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:47:54.774 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:47:56.402 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:47:57.603 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:47:59.446 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:48:01.230 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:48:02.429 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:48:03.531 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:48:04.374 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:48:06.581 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:48:08.160 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:48:09.992 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:48:11.730 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:48:13.312 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:48:14.900 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:48:16.209 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:48:17.101 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:48:18.123 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:48:20.121 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:48:22.787 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:48:23.863 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:48:25.520 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:48:27.184 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:48:28.728 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:48:30.279 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:48:31.911 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:48:33.491 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:48:34.996 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:48:36.024 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:48:36.833 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:48:37.841 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:48:38.652 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:48:40.017 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:48:41.463 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:48:42.894 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:48:44.250 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:48:45.688 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:48:47.048 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:48:48.465 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:48:49.889 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:48:51.251 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:48:52.702 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:48:54.054 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:48:55.482 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:48:56.370 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:48:57.229 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:48:58.035 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:48:58.825 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:48:59.352 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:49:00.079 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:49:00.728 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:49:01.379 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:49:02.051 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:49:02.699 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:49:03.337 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:49:03.973 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:49:04.645 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:49:05.510 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:49:06.383 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:49:06.893 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:49:07.399 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:49:08.076 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:49:08.699 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:49:09.567 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:49:10.435 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:49:11.058 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:49:11.687 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:49:12.349 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:49:12.977 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:49:13.603 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:49:14.231 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:49:14.862 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:49:15.496 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:49:16.170 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:49:16.797 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:49:17.416 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:49:18.053 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:49:18.637 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:49:19.219 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:49:19.801 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:49:20.457 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:49:21.078 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:50:10.144 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:50:10.757 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:50:11.334 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:50:11.916 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:50:12.498 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:50:13.103 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:50:13.688 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:50:14.264 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:50:14.883 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:50:15.460 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:50:16.045 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:50:16.623 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:50:17.217 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:50:17.844 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:50:18.487 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:50:19.145 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:50:19.766 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:50:20.385 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:50:21.011 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:50:21.634 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:50:22.256 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:50:22.878 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:50:23.556 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:50:24.242 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:50:24.932 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:50:25.555 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:50:26.171 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:50:26.796 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:50:27.458 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:50:27.720 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:50:28.228 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:50:30.130 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:50:32.026 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:50:32.648 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:50:33.335 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:50:33.962 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:50:34.582 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:50:35.361 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:50:36.043 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:50:36.665 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:50:37.294 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:50:37.962 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:50:38.583 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:50:39.201 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:50:39.830 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:50:40.700 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:50:41.816 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:50:42.281 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:50:42.711 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:50:43.121 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:50:43.510 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:50:43.750 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:50:43.986 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:50:44.230 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:50:44.738 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:50:46.422 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:50:46.696 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:50:47.193 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:50:47.578 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:50:47.987 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:50:48.395 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:50:50.365 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:50:51.912 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:51:42.181 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:52:32.476 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:52:32.978 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:52:33.459 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:52:33.979 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:52:34.486 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:52:35.115 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:52:35.629 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:52:36.175 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:52:36.763 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:52:37.320 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:52:37.871 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:52:38.438 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:52:39.074 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:52:39.619 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:52:40.019 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:52:40.494 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:52:41.000 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:52:41.784 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:52:42.292 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:52:42.769 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:52:43.249 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:52:43.783 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:52:44.357 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:52:44.760 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:52:45.167 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:52:45.609 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:52:46.010 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:52:46.412 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:52:46.821 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:52:47.329 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:52:47.737 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:52:48.144 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:52:48.548 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:52:48.973 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:52:49.574 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:52:49.983 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:52:50.387 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:52:50.790 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:52:51.204 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:52:51.610 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:52:52.017 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:52:52.432 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:52:53.573 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:52:54.024 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:52:54.587 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:52:55.136 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:52:55.648 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:52:56.196 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:52:56.753 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:52:58.308 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:52:58.876 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:52:59.469 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:53:00.122 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:53:00.822 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:53:01.481 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:53:02.008 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:53:02.669 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:53:03.359 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:53:03.931 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:53:04.656 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:53:05.149 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:53:05.557 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:53:05.964 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:53:06.435 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:53:06.846 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:53:07.084 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:53:07.746 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:53:08.248 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:53:08.783 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:53:11.942 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:53:12.453 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:53:12.963 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:53:13.471 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:53:14.004 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:53:14.458 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:53:14.972 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:53:15.543 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:53:16.071 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:53:16.563 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:53:17.054 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:53:17.548 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:53:18.040 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:53:18.556 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:53:19.041 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:53:19.584 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:53:20.086 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:53:20.585 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:53:20.828 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:53:21.068 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:53:21.304 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:53:21.684 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:53:22.062 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:53:22.441 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:53:22.832 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:53:23.274 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:53:23.513 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:53:23.750 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:53:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:53:24.410 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:53:24.647 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:53:24.882 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:53:25.119 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:53:25.548 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:53:25.996 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:53:26.401 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:53:26.845 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:53:27.286 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:53:27.724 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:53:28.157 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:53:28.676 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:53:29.133 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:53:29.568 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:53:30.113 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:53:30.655 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:53:31.295 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:53:31.837 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:53:32.380 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:53:33.030 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:53:33.642 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:53:34.276 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:53:34.958 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:53:35.367 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:53:36.076 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:53:36.721 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:53:37.368 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:53:38.006 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:53:38.694 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:53:39.405 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:53:40.006 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:53:40.596 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:53:41.264 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:53:41.867 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:53:42.344 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:53:42.898 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:53:43.477 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:53:44.000 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:53:44.430 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:53:45.087 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:53:45.929 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:53:46.812 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:53:47.664 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:53:48.510 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:53:49.353 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:53:50.203 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:53:51.059 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:53:51.955 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:53:52.809 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:53:53.680 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:53:54.580 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:53:55.450 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:53:56.557 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:53:57.674 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:53:57.898 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:53:58.131 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:53:58.366 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:53:58.787 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:53:59.233 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:53:59.616 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:53:59.992 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:54:00.612 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:54:02.829 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:54:03.746 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:54:04.422 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:54:07.334 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:54:07.995 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:54:08.656 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:54:09.251 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:54:09.897 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:54:11.042 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:54:11.718 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:54:12.454 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:54:13.173 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:54:14.348 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:54:15.485 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:54:15.887 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:54:16.295 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:54:18.226 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:54:18.974 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:54:27.404 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:54:27.850 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:54:28.533 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:54:30.486 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:54:31.115 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:54:32.201 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:54:38.230 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:54:51.133 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:55:09.169 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:56:04.074 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:56:11.940 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:56:24.572 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:56:25.558 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:56:29.037 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:56:31.809 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:56:34.420 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:56:34.972 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:56:37.876 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:56:38.549 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:56:39.141 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:56:39.716 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:56:58.718 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:57:01.641 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:57:02.263 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:57:02.689 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:57:03.305 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:57:07.205 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:57:10.686 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:57:14.155 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:57:14.706 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:57:15.295 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:57:15.835 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:57:16.377 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:57:16.916 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:57:17.454 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:57:18.030 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:57:19.024 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:57:21.118 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:57:24.103 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:57:25.193 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:57:27.236 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:57:30.177 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:57:31.481 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:57:34.562 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:57:39.976 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:57:41.048 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:57:41.767 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:57:42.757 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:57:43.314 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:57:49.483 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:57:50.036 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:57:50.630 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:57:51.177 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:57:51.725 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:57:52.490 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:58:03.982 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:58:05.080 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:58:05.813 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:58:06.802 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:58:07.774 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:58:12.560 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:58:13.569 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:58:19.358 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:58:41.165 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:58:53.540 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:58:55.841 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:58:57.997 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:58:58.867 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:58:59.797 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:59:00.433 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:59:01.559 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:59:02.500 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:59:04.182 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:59:04.664 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:59:05.164 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:59:05.651 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:59:06.057 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:59:06.489 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:59:07.014 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:59:07.444 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:59:07.898 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:59:08.458 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:59:08.883 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:59:09.315 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:59:09.743 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:59:10.172 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:59:10.580 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:59:11.151 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:59:11.734 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:59:12.591 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:59:13.157 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:59:13.725 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:59:14.280 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:59:14.837 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:59:15.286 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:59:15.744 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:59:16.189 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:59:16.672 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:59:45.770 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T12:00:14.485 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T12:00:22.215 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T12:00:22.745 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T12:01:24.262 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T12:02:25.712 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T12:02:26.293 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T12:02:26.851 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T12:02:27.344 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T12:02:27.755 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T12:02:48.081 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T12:02:54.841 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T12:03:01.630 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T12:03:02.154 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T12:03:02.717 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T12:03:03.279 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T12:03:04.147 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T12:03:04.707 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T12:03:05.258 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T12:03:05.815 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T12:03:06.403 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T12:03:07.039 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T12:03:07.664 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T12:03:08.233 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T12:03:08.784 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T12:03:09.726 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T12:03:10.665 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T12:03:12.185 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T12:03:13.672 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T12:03:15.161 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T12:03:16.711 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T12:03:18.190 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T12:03:19.624 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T12:03:21.152 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T12:03:22.716 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T12:03:24.259 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T12:03:24.837 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T12:03:25.347 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T12:03:25.978 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T12:03:27.492 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T12:03:28.995 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T12:03:30.607 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T12:03:31.915 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T12:03:50.224 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T12:03:51.088 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T12:03:52.081 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:03:53.016 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:03:54.231 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T12:03:55.250 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T12:03:55.841 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T12:03:56.792 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T12:03:57.232 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T12:03:57.668 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T12:03:58.070 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T12:03:58.475 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T12:03:59.041 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T12:03:59.514 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T12:04:00.449 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T12:04:00.962 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T12:04:01.405 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T12:04:01.892 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T12:04:02.333 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T12:04:02.818 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T12:04:03.321 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T12:04:03.762 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T12:04:04.201 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T12:04:04.675 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T12:04:05.113 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T12:04:05.728 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T12:04:06.268 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T12:04:06.940 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T12:04:07.580 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T12:04:08.144 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T12:04:08.693 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T12:04:09.410 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T12:04:10.037 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T12:04:10.667 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T12:04:11.261 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T12:04:11.901 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T12:04:12.530 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:04:13.298 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T12:04:14.035 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T12:04:14.688 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:04:15.267 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T12:04:15.811 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T12:04:16.372 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T12:04:17.080 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T12:04:17.661 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T12:04:18.291 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:04:19.107 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:04:19.636 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T12:04:20.270 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T12:04:20.828 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T12:04:31.215 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T12:04:31.780 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T12:04:41.340 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T12:04:41.966 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T12:04:42.618 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T12:04:43.104 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T12:04:43.585 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:04:44.059 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:04:44.559 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:04:45.060 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T12:04:45.537 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T12:04:45.948 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T12:04:46.431 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T12:04:47.016 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T12:04:47.532 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T12:04:48.181 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T12:04:48.772 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T12:04:49.252 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T12:04:49.706 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T12:04:50.427 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T12:04:57.644 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T12:04:58.070 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:04:58.611 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:04:59.193 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:04:59.744 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T12:05:01.104 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T12:05:01.709 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T12:05:02.804 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T12:05:06.425 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T12:05:07.427 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T12:05:12.415 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T12:05:16.714 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T12:05:17.308 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T12:05:18.086 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T12:05:32.422 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T12:05:55.388 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T12:05:58.062 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T12:05:59.946 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T12:06:01.759 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T12:06:03.489 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T12:06:04.079 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T12:06:07.607 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T12:06:11.964 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T12:06:29.031 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T12:06:31.470 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T12:06:33.298 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T12:06:35.032 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T12:06:35.817 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T12:06:41.264 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T12:06:44.339 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T12:06:45.105 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T12:06:46.246 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T12:06:51.830 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T12:06:55.265 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T12:06:59.764 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T12:07:01.298 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T12:07:01.517 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T12:07:05.073 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T12:07:10.981 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T12:07:14.038 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T12:07:17.828 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T12:07:19.030 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T12:07:54.286 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T12:07:54.501 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T12:07:55.477 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T12:07:56.217 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T12:07:56.921 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T12:07:57.781 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T12:07:57.798 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T12:07:57.798 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.798 INFO:teuthology.orchestra.run.smithi028.stdout:=============================== warnings summary =============================== 2024-09-14T12:07:57.798 INFO:teuthology.orchestra.run.smithi028.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T12:07:57.798 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: import imp 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py:120 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: if boto_type is 'S3Connection': 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_headers.py:124 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3.py:359 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T12:07:57.799 INFO:teuthology.orchestra.run.smithi028.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: if k is 'BucketName': 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: @pytest.mark.timeout(10) 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T12:07:57.800 INFO:teuthology.orchestra.run.smithi028.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T12:07:57.801 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.802 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.803 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T12:07:57.804 INFO:teuthology.orchestra.run.smithi028.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1289.23s (0:21:29) = 2024-09-14T12:07:57.926 INFO:teuthology.orchestra.run.smithi028.stdout:___________________________________ summary ____________________________________ 2024-09-14T12:07:57.927 INFO:teuthology.orchestra.run.smithi028.stdout: py: commands succeeded 2024-09-14T12:07:57.927 INFO:teuthology.orchestra.run.smithi028.stdout: congratulations :) 2024-09-14T12:07:57.945 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T12:07:57.945 DEBUG:teuthology.orchestra.run.smithi028:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:07:58.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:07:58.055 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T12:07:58.055 DEBUG:teuthology.orchestra.run.smithi028:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T12:07:58.084 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T12:07:58.085 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T12:07:58.286 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T12:07:58.301 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T12:07:58.301 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T12:07:58.301 DEBUG:teuthology.orchestra.run.smithi028:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:07:58.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:07:58.332 INFO:teuthology.orchestra.run.smithi028.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T12:07:58.332 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:07:58.402 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T12:07:58.402 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T12:07:58.472 INFO:tasks.workunit:timeout=3h 2024-09-14T12:07:58.473 INFO:tasks.workunit:cleanup=True 2024-09-14T12:07:58.473 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T12:07:58.542 INFO:tasks.workunit.client.0.smithi028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T12:08:55.514 INFO:tasks.workunit.client.0.smithi028.stderr:Updating files: 92% (11964/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T12:08:55.968 INFO:tasks.workunit.client.0.smithi028.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T12:08:55.968 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr: git switch -c 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr:Or undo this operation with: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.969 INFO:tasks.workunit.client.0.smithi028.stderr: git switch - 2024-09-14T12:08:55.970 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.970 INFO:tasks.workunit.client.0.smithi028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T12:08:55.970 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:08:55.970 INFO:tasks.workunit.client.0.smithi028.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T12:08:55.971 DEBUG:teuthology.orchestra.run.smithi028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T12:08:56.041 INFO:tasks.workunit.client.0.smithi028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T12:08:56.043 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:08:56.043 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T12:08:56.094 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T12:08:56.144 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T12:08:56.185 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T12:08:56.187 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:08:56.187 INFO:tasks.workunit.client.0.smithi028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T12:08:56.226 INFO:tasks.workunit.client.0.smithi028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T12:08:56.230 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-09-14T12:08:56.230 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T12:08:56.301 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T12:08:56.302 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T12:08:56.302 DEBUG:teuthology.orchestra.run.smithi028:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:08:56.375 INFO:tasks.workunit.client.0.smithi028.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T12:08:56.375 INFO:tasks.workunit.client.0.smithi028.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:08:56.375 INFO:tasks.workunit.client.0.smithi028.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:08:58.769 INFO:tasks.workunit.client.0.smithi028.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ deactivate nondestructive 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ hash -r 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ unset VIRTUAL_ENV 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ export VIRTUAL_ENV 2024-09-14T12:08:58.770 INFO:tasks.workunit.client.0.smithi028.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:08:58.771 INFO:tasks.workunit.client.0.smithi028.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:08:58.771 INFO:tasks.workunit.client.0.smithi028.stderr:++ export PATH 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n '' ']' 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -z '' ']' 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ PS1='(rgw) ' 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ export PS1 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:++ hash -r 2024-09-14T12:08:58.772 INFO:tasks.workunit.client.0.smithi028.stderr:+ pip install pip --upgrade 2024-09-14T12:08:59.010 INFO:tasks.workunit.client.0.smithi028.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T12:08:59.217 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting pip 2024-09-14T12:08:59.223 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T12:08:59.269 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: pip 2024-09-14T12:08:59.270 INFO:tasks.workunit.client.0.smithi028.stdout: Attempting uninstall: pip 2024-09-14T12:08:59.270 INFO:tasks.workunit.client.0.smithi028.stdout: Found existing installation: pip 21.3.1 2024-09-14T12:08:59.434 INFO:tasks.workunit.client.0.smithi028.stdout: Uninstalling pip-21.3.1: 2024-09-14T12:08:59.439 INFO:tasks.workunit.client.0.smithi028.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T12:09:00.216 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed pip-24.2 2024-09-14T12:09:00.264 INFO:tasks.workunit.client.0.smithi028.stderr:+ pip install boto3 2024-09-14T12:09:01.071 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting boto3 2024-09-14T12:09:01.072 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T12:09:01.642 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T12:09:01.643 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T12:09:01.701 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T12:09:01.702 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T12:09:01.757 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T12:09:01.758 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T12:09:01.807 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:09:01.808 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T12:09:01.886 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:09:01.887 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T12:09:02.104 INFO:tasks.workunit.client.0.smithi028.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T12:09:02.105 INFO:tasks.workunit.client.0.smithi028.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T12:09:02.110 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T12:09:02.111 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T12:09:02.120 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T12:09:02.122 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T12:09:02.123 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T12:09:02.124 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T12:09:02.126 INFO:tasks.workunit.client.0.smithi028.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T12:09:02.202 INFO:tasks.workunit.client.0.smithi028.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T12:09:03.518 INFO:tasks.workunit.client.0.smithi028.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T12:09:03.634 INFO:tasks.workunit.client.0.smithi028.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T12:09:03.761 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T12:09:03.797 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:03.797 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:03.836 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.838+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:03.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:03.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 realm 2024-09-14T12:09:03.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:03.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:03.838 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:09:03.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:03.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:03.839 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.840+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:03.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.841+0000 7ff8e1d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:03.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.841+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:03.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.841+0000 7ff8e1d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:09:03.840 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.842+0000 7ff8e1d26800 20 searching for the correct realm 2024-09-14T12:09:03.843 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.845+0000 7ff8d5108640 0 -- 172.21.15.28:0/695994465 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x5614f8c5a100 msgr2=0x5614f8c5c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:03.846 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:03.849+0000 7ff8dd909640 0 -- 172.21.15.28:0/695994465 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7ff8c8057040 msgr2=0x7ff8c8057930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:09:04.056 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.057 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.057+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 zone default found 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 4 Realm: () 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:09:04.058 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 zonegroup default 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.058+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.059+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.059+0000 7ff8e1d26800 20 started sync module instance, tier type = 2024-09-14T12:09:04.059 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.059+0000 7ff8e1d26800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=0 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=1 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=2 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=3 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=4 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=5 2024-09-14T12:09:04.068 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.070+0000 7ff8e1d26800 20 add_watcher() i=6 2024-09-14T12:09:04.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.071+0000 7ff8e1d26800 20 add_watcher() i=7 2024-09-14T12:09:04.069 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.071+0000 7ff8e1d26800 2 all 8 watchers are set, enabling cache 2024-09-14T12:09:04.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff78f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:04.071 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff8e1d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff8e1d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff8e1d26800 5 note: GC not initialized 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff78e7fc640 20 reqs_thread_entry: start 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff8e1d26800 20 init_complete bucket index max shards: 1 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.073+0000 7ff8e1d26800 20 Filter name: none 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff6fffff640 20 reqs_thread_entry: start 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T12:09:04.072 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T12:09:04.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:09:04.073 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T12:09:04.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T12:09:04.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:09:04.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:09:04.074 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.074+0000 7ff8e1d26800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T12:09:04.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.076+0000 7ff8e1d26800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:09:04.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.076+0000 7ff8e1d26800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:09:04.075 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.076+0000 7ff8e1d26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T12:09:04.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.076+0000 7ff7c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333845 cookie 94648073105104 notifier 8615 bl.length()=613 2024-09-14T12:09:04.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.076+0000 7ff7c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T12:09:04.076 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.076+0000 7ff7c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T12:09:04.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.079+0000 7ff8e1d26800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:09:04.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.079+0000 7ff8e1d26800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:09:04.077 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.079+0000 7ff8e1d26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T12:09:04.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.080+0000 7ff7c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336037 cookie 94648073103360 notifier 8615 bl.length()=191 2024-09-14T12:09:04.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.080+0000 7ff7c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T12:09:04.078 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.080+0000 7ff7c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T12:09:04.079 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.082+0000 7ff78f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:04.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.084+0000 7ff8e1d26800 20 remove_watcher() i=0 2024-09-14T12:09:04.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.084+0000 7ff8e1d26800 2 removed watcher, disabling cache 2024-09-14T12:09:04.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.085+0000 7ff8e1d26800 20 remove_watcher() i=1 2024-09-14T12:09:04.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.086+0000 7ff8e1d26800 20 remove_watcher() i=2 2024-09-14T12:09:04.085 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.088+0000 7ff8e1d26800 20 remove_watcher() i=3 2024-09-14T12:09:04.086 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.089+0000 7ff8e1d26800 20 remove_watcher() i=4 2024-09-14T12:09:04.088 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.090+0000 7ff8e1d26800 20 remove_watcher() i=5 2024-09-14T12:09:04.089 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.091+0000 7ff8e1d26800 20 remove_watcher() i=6 2024-09-14T12:09:04.090 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.092+0000 7ff8e1d26800 20 remove_watcher() i=7 2024-09-14T12:09:04.362 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T12:09:04.362 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:09:04.487 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:09:04.516 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:04.516 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:04.555 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.557+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 realm 2024-09-14T12:09:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:09:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.559+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.558 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.560+0000 7fd5ea687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:04.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.560+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.560+0000 7fd5ea687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:09:04.559 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.560+0000 7fd5ea687800 20 searching for the correct realm 2024-09-14T12:09:04.561 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.564+0000 7fd5e8972640 0 -- 172.21.15.28:0/269562889 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7fd4b0088750 msgr2=0x7fd4b008ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:04.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.771+0000 7fd5e8171640 0 -- 172.21.15.28:0/269562889 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fd5dc076180 msgr2=0x7fd5dc076620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:09:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T12:09:04.978 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:09:04.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:09:04.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T12:09:04.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:09:04.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:09:04.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.978+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.979 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 zone default found 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 4 Realm: () 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T12:09:04.980 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 zonegroup default 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.979+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 started sync module instance, tier type = 2024-09-14T12:09:04.981 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.980+0000 7fd5ea687800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T12:09:04.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=0 2024-09-14T12:09:04.988 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=1 2024-09-14T12:09:04.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=2 2024-09-14T12:09:04.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=3 2024-09-14T12:09:04.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=4 2024-09-14T12:09:04.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=5 2024-09-14T12:09:04.989 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.990+0000 7fd5ea687800 20 add_watcher() i=6 2024-09-14T12:09:04.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.991+0000 7fd5ea687800 20 add_watcher() i=7 2024-09-14T12:09:04.990 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.991+0000 7fd5ea687800 2 all 8 watchers are set, enabling cache 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.993+0000 7fd49efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.993+0000 7fd5ea687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.993+0000 7fd5ea687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.993+0000 7fd5ea687800 5 note: GC not initialized 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd49dfdb640 20 reqs_thread_entry: start 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd5ea687800 20 init_complete bucket index max shards: 1 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd5ea687800 20 Filter name: none 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd40f7fe640 20 reqs_thread_entry: start 2024-09-14T12:09:04.992 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd5ea687800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.994+0000 7fd5ea687800 20 rados->read ofs=0 len=0 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.995+0000 7fd5ea687800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.995+0000 7fd5ea687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.995+0000 7fd5ea687800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.995+0000 7fd5ea687800 20 INFO: main: starting shard=0 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.995+0000 7fd5ea687800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782.0 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.996+0000 7fd5ea687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:09:04.994 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.996+0000 7fd5ea687800 20 INFO: main: done 2024-09-14T12:09:04.995 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.997+0000 7fd49efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:04.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.999+0000 7fd5ea687800 20 remove_watcher() i=0 2024-09-14T12:09:04.997 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:04.999+0000 7fd5ea687800 2 removed watcher, disabling cache 2024-09-14T12:09:04.998 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.001+0000 7fd5ea687800 20 remove_watcher() i=1 2024-09-14T12:09:05.000 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.002+0000 7fd5ea687800 20 remove_watcher() i=2 2024-09-14T12:09:05.001 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.003+0000 7fd5ea687800 20 remove_watcher() i=3 2024-09-14T12:09:05.002 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.004+0000 7fd5ea687800 20 remove_watcher() i=4 2024-09-14T12:09:05.003 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.005+0000 7fd5ea687800 20 remove_watcher() i=5 2024-09-14T12:09:05.004 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.006+0000 7fd5ea687800 20 remove_watcher() i=6 2024-09-14T12:09:05.005 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.007+0000 7fd5ea687800 20 remove_watcher() i=7 2024-09-14T12:09:05.018 INFO:tasks.workunit.client.0.smithi028.stderr:rados -p default.rgw.buckets.data ls | grep a1a7fe95-4d07-4e9a-b237-9a0d8236b9e2 2024-09-14T12:09:05.041 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:05.042 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:05.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.110+0000 7f05d3719640 0 -- 172.21.15.28:0/2050160160 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f05c4061c40 msgr2=0x7f05c40074c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:05.131 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:05.133+0000 7f05d2f18640 0 -- 172.21.15.28:0/2050160160 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f05bc0163e0 msgr2=0x7f05bc016840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:05.135 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T12:09:05.135 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:09:05.137 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:09:06.596 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:09:07.010 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T12:09:07.041 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:07.041 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:07.080 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.082+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.084+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.084+0000 7f228432e800 20 realm 2024-09-14T12:09:07.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.084+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.084+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.082 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.084+0000 7f228432e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:09:07.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.084+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.085+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.085+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.083 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.085+0000 7f228432e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:07.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.085+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.086+0000 7f228432e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:09:07.084 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.086+0000 7f228432e800 20 searching for the correct realm 2024-09-14T12:09:07.087 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.090+0000 7f227f8dc640 0 -- 172.21.15.28:0/3589036982 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55f6c0f4df90 msgr2=0x55f6c0f50380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:07.091 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.094+0000 7f22800dd640 0 -- 172.21.15.28:0/3589036982 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f2274048550 msgr2=0x7f227406a510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:07.096 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.097 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.098 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.099+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 zone default found 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 4 Realm: () 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 zonegroup default 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.099 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:07.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 started sync module instance, tier type = 2024-09-14T12:09:07.100 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.100+0000 7f228432e800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=0 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=1 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=2 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=3 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=4 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=5 2024-09-14T12:09:07.108 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.110+0000 7f228432e800 20 add_watcher() i=6 2024-09-14T12:09:07.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.111+0000 7f228432e800 20 add_watcher() i=7 2024-09-14T12:09:07.109 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.111+0000 7f228432e800 2 all 8 watchers are set, enabling cache 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.112+0000 7f2136fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f228432e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f228432e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f228432e800 5 note: GC not initialized 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f2135fdb640 20 reqs_thread_entry: start 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f228432e800 20 init_complete bucket index max shards: 1 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f228432e800 20 Filter name: none 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f20a77fe640 20 reqs_thread_entry: start 2024-09-14T12:09:07.111 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.113+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:09:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 rados->read ofs=0 len=0 2024-09-14T12:09:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:09:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T12:09:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T12:09:07.112 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 INFO: main: starting shard=0 2024-09-14T12:09:07.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.114+0000 7f228432e800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782.0 2024-09-14T12:09:07.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.115+0000 7f228432e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T12:09:07.113 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.115+0000 7f228432e800 20 INFO: main: done 2024-09-14T12:09:07.114 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.116+0000 7f2136fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:07.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.120+0000 7f228432e800 20 remove_watcher() i=0 2024-09-14T12:09:07.117 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.120+0000 7f228432e800 2 removed watcher, disabling cache 2024-09-14T12:09:07.118 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.121+0000 7f228432e800 20 remove_watcher() i=1 2024-09-14T12:09:07.119 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.122+0000 7f228432e800 20 remove_watcher() i=2 2024-09-14T12:09:07.120 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.123+0000 7f228432e800 20 remove_watcher() i=3 2024-09-14T12:09:07.121 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.124+0000 7f228432e800 20 remove_watcher() i=4 2024-09-14T12:09:07.122 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.124+0000 7f228432e800 20 remove_watcher() i=5 2024-09-14T12:09:07.123 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.125+0000 7f228432e800 20 remove_watcher() i=6 2024-09-14T12:09:07.124 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.126+0000 7f228432e800 20 remove_watcher() i=7 2024-09-14T12:09:07.137 INFO:tasks.workunit.client.0.smithi028.stderr:rados -p default.rgw.buckets.data ls | grep 32bd4a6a-afd3-4cd8-a7f9-861b371ddd60 2024-09-14T12:09:07.159 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:07.160 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:07.238 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:07.240+0000 7f301bfff640 0 -- 172.21.15.28:0/2432876582 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f300c0177b0 msgr2=0x7f300c061500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:07.251 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T12:09:07.251 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:09:07.370 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T12:09:08.881 INFO:tasks.workunit.client.0.smithi028.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T12:09:08.882 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T12:09:09.363 INFO:tasks.workunit.client.0.smithi028.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T12:09:09.364 INFO:tasks.workunit.client.0.smithi028.stderr: 2024-09-14T12:09:09.531 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T12:09:13.059 INFO:tasks.workunit.client.0.smithi028.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T12:09:13.474 INFO:tasks.workunit.client.0.smithi028.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T12:09:13.507 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:13.507 INFO:tasks.workunit.client.0.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:13.546 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.549+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.550+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.548 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.550+0000 7fa294b3a800 20 realm 2024-09-14T12:09:13.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.550+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.550+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.550+0000 7fa294b3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:09:13.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.550+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.551+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.549 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.551+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.551+0000 7fa294b3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:13.550 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.552+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.552+0000 7fa294b3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:09:13.551 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.552+0000 7fa294b3a800 20 searching for the correct realm 2024-09-14T12:09:13.553 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.555+0000 7fa28bfff640 0 -- 172.21.15.28:0/3357315085 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7fa28401d060 msgr2=0x7fa284087430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:13.557 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.559+0000 7fa2908bb640 0 -- 172.21.15.28:0/3357315085 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fa27c0393a0 msgr2=0x7fa27c039820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:09:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T12:09:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:09:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:09:13.766 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.766+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 zone default found 2024-09-14T12:09:13.767 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 4 Realm: () 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 zonegroup default 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.767+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.768 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 started sync module instance, tier type = 2024-09-14T12:09:13.769 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.768+0000 7fa294b3a800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T12:09:13.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=0 2024-09-14T12:09:13.776 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=1 2024-09-14T12:09:13.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=2 2024-09-14T12:09:13.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=3 2024-09-14T12:09:13.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=4 2024-09-14T12:09:13.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=5 2024-09-14T12:09:13.777 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.778+0000 7fa294b3a800 20 add_watcher() i=6 2024-09-14T12:09:13.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.779+0000 7fa294b3a800 20 add_watcher() i=7 2024-09-14T12:09:13.778 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.779+0000 7fa294b3a800 2 all 8 watchers are set, enabling cache 2024-09-14T12:09:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa146fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa294b3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:09:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa294b3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:09:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa294b3a800 5 note: GC not initialized 2024-09-14T12:09:13.780 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa145fe3640 20 reqs_thread_entry: start 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa294b3a800 20 init_complete bucket index max shards: 1 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa294b3a800 20 Filter name: none 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.781+0000 7fa0b77fe640 20 reqs_thread_entry: start 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782 : miss 2024-09-14T12:09:13.781 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.782+0000 7fa294b3a800 20 rados->read ofs=0 len=0 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782 info.flags=0x17 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782 to cache LRU end 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 20 bucket index object: :.dir.ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782.0 2024-09-14T12:09:13.783 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T12:09:13.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.783+0000 7fa294b3a800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T12:09:13.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.784+0000 7fa146fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:13.784 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.787+0000 7fa294b3a800 20 remove_watcher() i=0 2024-09-14T12:09:13.785 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.787+0000 7fa294b3a800 2 removed watcher, disabling cache 2024-09-14T12:09:13.786 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.788+0000 7fa294b3a800 20 remove_watcher() i=1 2024-09-14T12:09:13.787 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.789+0000 7fa294b3a800 20 remove_watcher() i=2 2024-09-14T12:09:13.788 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.790+0000 7fa294b3a800 20 remove_watcher() i=3 2024-09-14T12:09:13.789 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.791+0000 7fa294b3a800 20 remove_watcher() i=4 2024-09-14T12:09:13.790 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.792+0000 7fa294b3a800 20 remove_watcher() i=5 2024-09-14T12:09:13.791 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.793+0000 7fa294b3a800 20 remove_watcher() i=6 2024-09-14T12:09:13.792 INFO:tasks.workunit.client.0.smithi028.stderr:2024-09-14T12:09:13.794+0000 7fa294b3a800 20 remove_watcher() i=7 2024-09-14T12:09:13.803 INFO:tasks.workunit.client.0.smithi028.stderr:Deleting bucket versioning-bucket 2024-09-14T12:09:13.887 INFO:tasks.workunit.client.0.smithi028.stderr:Completed bucket versioning tests 2024-09-14T12:09:13.887 INFO:tasks.workunit.client.0.smithi028.stdout:connected to http://localhost:80 2024-09-14T12:09:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:+ deactivate 2024-09-14T12:09:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T12:09:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T12:09:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:+ export PATH 2024-09-14T12:09:13.947 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n '' ']' 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ hash -r 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' -n '' ']' 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset VIRTUAL_ENV 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ unset -f deactivate 2024-09-14T12:09:13.948 INFO:tasks.workunit.client.0.smithi028.stderr:+ echo OK. 2024-09-14T12:09:13.950 INFO:tasks.workunit.client.0.smithi028.stdout:OK. 2024-09-14T12:09:13.950 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T12:09:13.950 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T12:09:14.032 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T12:09:14.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T12:09:14.432 DEBUG:teuthology.parallel:result is None 2024-09-14T12:09:14.433 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:09:14.473 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:09:14.473 DEBUG:teuthology.orchestra.run.smithi028:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T12:09:14.542 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T12:09:14.542 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T12:09:14.554 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T12:09:14.632 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T12:09:14.633 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T12:09:14.633 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T12:09:14.699 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T12:09:14.700 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T12:09:14.758 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:14.759 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:14.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.797+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.798+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.798+0000 7fa25a725800 20 realm 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.798+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.799+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.799+0000 7fa25a725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.799+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.799+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.799+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.800+0000 7fa25a725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.800+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.800+0000 7fa25a725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:09:14.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.800+0000 7fa25a725800 20 searching for the correct realm 2024-09-14T12:09:14.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.804+0000 7fa256b34640 0 -- 172.21.15.28:0/1282074293 >> [v2:172.21.15.28:6808/2721762421,v1:172.21.15.28:6809/2721762421] conn(0x562ee690c100 msgr2=0x562ee690e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:09:14.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.808+0000 7fa256333640 0 -- 172.21.15.28:0/1282074293 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7fa24c094410 msgr2=0x7fa24c094890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:14.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.813+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:09:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 20 zone default found 2024-09-14T12:09:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 4 Realm: () 2024-09-14T12:09:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T12:09:14.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 20 zonegroup default 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.814+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.815+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.815+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.815+0000 7fa25a725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.815+0000 7fa25a725800 20 started sync module instance, tier type = 2024-09-14T12:09:14.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.815+0000 7fa25a725800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T12:09:14.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=0 2024-09-14T12:09:14.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=1 2024-09-14T12:09:14.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=2 2024-09-14T12:09:14.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=3 2024-09-14T12:09:14.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=4 2024-09-14T12:09:14.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=5 2024-09-14T12:09:14.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.824+0000 7fa25a725800 20 add_watcher() i=6 2024-09-14T12:09:14.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.825+0000 7fa25a725800 20 add_watcher() i=7 2024-09-14T12:09:14.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.825+0000 7fa25a725800 2 all 8 watchers are set, enabling cache 2024-09-14T12:09:14.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.827+0000 7fa10cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:14.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.827+0000 7fa25a725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:09:14.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.827+0000 7fa25a725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.865+0000 7fa0877fe640 20 reqs_thread_entry: start 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.865+0000 7fa25a725800 20 init_complete bucket index max shards: 1 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.865+0000 7fa25a725800 20 Filter name: none 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa0857fa640 20 reqs_thread_entry: start 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa25a725800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa25a725800 20 rados->read ofs=0 len=0 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa25a725800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa25a725800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T12:09:14.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa25a725800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T12:09:14.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.866+0000 7fa25a725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T12:09:14.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.867+0000 7fa25a725800 10 removing key index: ZWVUZWTGMECHREEUDEMG 2024-09-14T12:09:14.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.868+0000 7fa25a725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:ZWVUZWTGMECHREEUDEMG, ofs0, ns] 2024-09-14T12:09:14.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.868+0000 7fa139ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336045 cookie 94759436794752 notifier 8723 bl.length()=170 2024-09-14T12:09:14.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.870+0000 7fa25a725800 10 removing email index: tester.client.0_test@test.test 2024-09-14T12:09:14.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.871+0000 7fa25a725800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T12:09:14.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.871+0000 7fa139ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333690 cookie 94759436789136 notifier 8723 bl.length()=181 2024-09-14T12:09:14.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.872+0000 7fa25a725800 10 removing user buckets index 2024-09-14T12:09:14.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.873+0000 7fa25a725800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T12:09:14.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.874+0000 7fa1397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333846 cookie 94759436798512 notifier 8723 bl.length()=172 2024-09-14T12:09:14.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.875+0000 7fa25a725800 10 removing user index: tester.client.0 2024-09-14T12:09:14.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.876+0000 7fa25a725800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T12:09:14.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.876+0000 7fa25a725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T12:09:14.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.876+0000 7fa1397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166336046 cookie 94759436794752 notifier 8723 bl.length()=164 2024-09-14T12:09:14.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.879+0000 7fa10cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.881+0000 7fa25a725800 20 remove_watcher() i=0 2024-09-14T12:09:14.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.881+0000 7fa25a725800 2 removed watcher, disabling cache 2024-09-14T12:09:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.882+0000 7fa25a725800 20 remove_watcher() i=1 2024-09-14T12:09:14.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.883+0000 7fa25a725800 20 remove_watcher() i=2 2024-09-14T12:09:14.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.884+0000 7fa25a725800 20 remove_watcher() i=3 2024-09-14T12:09:14.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.885+0000 7fa25a725800 20 remove_watcher() i=4 2024-09-14T12:09:14.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.886+0000 7fa25a725800 20 remove_watcher() i=5 2024-09-14T12:09:14.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.887+0000 7fa25a725800 20 remove_watcher() i=6 2024-09-14T12:09:14.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:14.888+0000 7fa25a725800 20 remove_watcher() i=7 2024-09-14T12:09:14.897 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T12:09:14.907 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T12:09:14.948 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T12:09:15.007 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T12:09:15.018 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T12:09:15.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:09:15.027 INFO:tasks.rgw.client.0.smithi028.stdout:2024-09-14T12:09:15.024+0000 f878640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44333) UID: 0 2024-09-14T12:09:15.028 INFO:tasks.rgw.client.0.smithi028.stdout:2024-09-14T12:09:15.028+0000 a1c2240 -1 shutting down 2024-09-14T12:09:49.178 INFO:tasks.rgw.client.0.smithi028.stderr:==00:00:58:39.658 44336== could not unlink /tmp/vgdb-pipe-from-vgdb-to-44336-by-root-on-??? 2024-09-14T12:09:49.178 INFO:tasks.rgw.client.0.smithi028.stderr:==00:00:58:39.658 44336== could not unlink /tmp/vgdb-pipe-to-vgdb-from-44336-by-root-on-??? 2024-09-14T12:09:49.178 INFO:tasks.rgw.client.0.smithi028.stderr:==00:00:58:39.658 44336== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-44336-by-root-on-??? 2024-09-14T12:09:51.627 INFO:tasks.rgw.client.0:Stopped 2024-09-14T12:09:51.627 DEBUG:teuthology.orchestra.run.smithi028:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T12:09:51.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T12:09:51.750 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T12:09:51.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T12:09:51.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T12:09:51.794 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T12:09:51.894 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-09-14T12:09:51.895 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T12:09:51.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.935+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.936+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.936+0000 7f043792c800 20 realm 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.937+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.937+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.937+0000 7f043792c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.937+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.937+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:51.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.937+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:51.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.938+0000 7f043792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:51.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.938+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:51.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.938+0000 7f043792c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T12:09:51.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.938+0000 7f043792c800 20 searching for the correct realm 2024-09-14T12:09:51.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:51.941+0000 7f0432e4e640 0 -- 172.21.15.28:0/3563316194 >> [v2:172.21.15.204:6808/1365453965,v1:172.21.15.204:6809/1365453965] conn(0x7f0424081830 msgr2=0x7f04240a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:52.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.148+0000 7f043364f640 0 -- 172.21.15.28:0/3563316194 >> [v2:172.21.15.28:6816/3465733102,v1:172.21.15.28:6817/3465733102] conn(0x7f04280ba550 msgr2=0x7f04280ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 RGWRados::pool_iterate: got zone_info.ee44e0ea-0921-4c74-bba9-e7ba41eeb320 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 RGWRados::pool_iterate: got zonegroup_info.b848263c-a077-484a-bbef-efa86d662add 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T12:09:52.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.355+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.356+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.356+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.356+0000 7f043792c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.356+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.356+0000 7f043792c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 zone default found 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 4 Realm: () 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 4 ZoneGroup: default (b848263c-a077-484a-bbef-efa86d662add) 2024-09-14T12:09:52.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 4 Zone: default (ee44e0ea-0921-4c74-bba9-e7ba41eeb320) 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 zonegroup default 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:52.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.357+0000 7f043792c800 20 rados->read ofs=0 len=0 2024-09-14T12:09:52.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.358+0000 7f043792c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T12:09:52.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.358+0000 7f043792c800 20 started sync module instance, tier type = 2024-09-14T12:09:52.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.358+0000 7f043792c800 20 started zone id=ee44e0ea-0921-4c74-bba9-e7ba41eeb320 (name=default) with tier type = 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=0 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=1 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=2 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=3 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=4 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=5 2024-09-14T12:09:52.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.368+0000 7f043792c800 20 add_watcher() i=6 2024-09-14T12:09:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.369+0000 7f043792c800 20 add_watcher() i=7 2024-09-14T12:09:52.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.369+0000 7f043792c800 2 all 8 watchers are set, enabling cache 2024-09-14T12:09:52.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.371+0000 7f02e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:52.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.371+0000 7f043792c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T12:09:52.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.371+0000 7f043792c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T12:09:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.411+0000 7f02e8fe1640 20 reqs_thread_entry: start 2024-09-14T12:09:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.411+0000 7f043792c800 20 init_complete bucket index max shards: 1 2024-09-14T12:09:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.411+0000 7f043792c800 20 Filter name: none 2024-09-14T12:09:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.411+0000 7f02627fc640 20 reqs_thread_entry: start 2024-09-14T12:09:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.411+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T12:09:52.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.412+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.413+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44701' 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_DJwryjUVQqFq4NYjE8KQGs5VxA0zugz', time=2024-09-14T13:46:49.849462+0000, chain.objs.size()=2 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.ha4wnrZZpJp9g-7MKWHwnl3-SgZaHUn_0 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.ha4wnrZZpJp9g-7MKWHwnl3-SgZaHUn_1 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6688506106975137786', time=2024-09-14T13:46:51.766977+0000, chain.objs.size()=3 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-STANDARD.2~iEGKocfNxoJsQkXcA11RZdOaGk3weqv.1 2024-09-14T12:09:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-STANDARD.2~iEGKocfNxoJsQkXcA11RZdOaGk3weqv.2 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-STANDARD.2~iEGKocfNxoJsQkXcA11RZdOaGk3weqv.3 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18106227854809481325', time=2024-09-14T13:46:58.843054+0000, chain.objs.size()=1 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.162__shadow_.S6ab0mA2hrR6HaA3GIUtz7ih_zXce_F_0 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16336616087776522640', time=2024-09-14T13:47:31.289484+0000, chain.objs.size()=1 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.200__shadow_.cel5eW_GQQY-JT-NnNLeXROMSKflQr__0 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10731242533766870198', time=2024-09-14T13:49:13.360049+0000, chain.objs.size()=1 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.249__shadow_.RixO8grW_bS_fUS3dIH_uu593hYkkH8_0 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13729890764024117170', time=2024-09-14T13:49:58.997688+0000, chain.objs.size()=1 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.K0Ep1sdo6d5HQBngw64fQU6PG-aqqjp_0 2024-09-14T12:09:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4764457686675416705', time=2024-09-14T13:49:58.998537+0000, chain.objs.size()=1 2024-09-14T12:09:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._qeo3q6b4p-WMYTGj7TsXDbY1P0IzFi_0 2024-09-14T12:09:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17600077296799601427', time=2024-09-14T13:49:59.041406+0000, chain.objs.size()=1 2024-09-14T12:09:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.u9iRyCwoQ-XFZLUc1HxsNgs1fmjMPv9_0 2024-09-14T12:09:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16906106100048793677', time=2024-09-14T13:49:59.343086+0000, chain.objs.size()=1 2024-09-14T12:09:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.U-Fsjb0f4GpQlW-Zoa-N_zFY_d5uNx8_0 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6095925212045613813', time=2024-09-14T13:49:59.403097+0000, chain.objs.size()=1 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GwcbANc5w64LYhqZleEGS55xd-l8iRD_0 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10055626678376617615', time=2024-09-14T13:49:59.474194+0000, chain.objs.size()=1 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SZ43_RHNDDIe5xAohPhMUqxORzNvGVM_0 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14697795645391100163', time=2024-09-14T13:49:59.781497+0000, chain.objs.size()=1 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VWwWGbNWL0t6Bf1kfcfFDzu3HGzrECk_0 2024-09-14T12:09:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4436803745644056948', time=2024-09-14T13:50:01.217051+0000, chain.objs.size()=1 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.j4R7TemPvT9973Wt-HA3qnM-ZkWS5Es_0 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6397306222360754864', time=2024-09-14T13:50:02.164820+0000, chain.objs.size()=1 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.STRnNlDrmTc4YgrMLPR5_Q6lkDGVZ5P_0 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5071573764455699322', time=2024-09-14T13:50:02.873367+0000, chain.objs.size()=1 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Om3GR42Gb2QU6nIERg0qc2lf-GsqdFy_0 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7559584932443901225', time=2024-09-14T13:50:02.965714+0000, chain.objs.size()=1 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NB4YhrD66OQfJ2_a3beUrQMkK_cJwWA_0 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1711864519915540128', time=2024-09-14T13:50:03.588446+0000, chain.objs.size()=1 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Sk27YEFP_DUwRWHz7QRtyT3Rn_vyp2Q_0 2024-09-14T12:09:52.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.553135660293928040', time=2024-09-14T13:50:03.780754+0000, chain.objs.size()=1 2024-09-14T12:09:52.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ArOFjd2N6uTVqtshv_WjhoKgmJmqfnE_0 2024-09-14T12:09:52.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.421+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16108303058819024777', time=2024-09-14T13:50:04.996637+0000, chain.objs.size()=1 2024-09-14T12:09:52.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.421+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AcF4MUYn9WtqUcanYOp-2wUZ0YRapg0_0 2024-09-14T12:09:52.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.421+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5336637063157658121', time=2024-09-14T13:50:05.183955+0000, chain.objs.size()=1 2024-09-14T12:09:52.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.421+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7h3hPwFl9xiCZ5tre0T-6qpkaKo1ium_0 2024-09-14T12:09:52.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.424+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11131121731880539205', time=2024-09-14T13:50:06.314673+0000, chain.objs.size()=1 2024-09-14T12:09:52.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.424+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.57i-Ng6rjvLwHwJ-dOigF1ihsqBNSem_0 2024-09-14T12:09:52.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.424+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10795747990580288535', time=2024-09-14T13:50:06.533492+0000, chain.objs.size()=1 2024-09-14T12:09:52.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Jxaa_ESxg2-eePr9dUVC4KhpC6b_2ns_0 2024-09-14T12:09:52.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8080244381475202763', time=2024-09-14T13:50:06.678798+0000, chain.objs.size()=1 2024-09-14T12:09:52.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XSXWtp30kEh8-i8i_-MCOY8b2hlMdCP_0 2024-09-14T12:09:52.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11611720206356325226', time=2024-09-14T13:50:06.679582+0000, chain.objs.size()=1 2024-09-14T12:09:52.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FMXMHbiF3cMZE8HVDeCLixsKkRNtg26_0 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14654602988104759892', time=2024-09-14T13:50:06.828250+0000, chain.objs.size()=1 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aCz3Wb0aB48AKOm0zrIqKOL9bkT_XG7_0 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14911425137852802549', time=2024-09-14T13:50:07.583306+0000, chain.objs.size()=1 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VEqWPkefo8R44EVsA__FIAAD5feKVb6_0 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11493744451442949310', time=2024-09-14T13:50:07.812567+0000, chain.objs.size()=1 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dy1GzQvgV4nE42I-sQAWZ2tJGROD7Ov_0 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10592854499281408130', time=2024-09-14T13:50:08.365620+0000, chain.objs.size()=1 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eCOAztkiXXbduFOH8Oz0o2MRr1IEgqF_0 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16420839328957977870', time=2024-09-14T13:50:09.455728+0000, chain.objs.size()=1 2024-09-14T12:09:52.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.58hhuIO0P3fRCU9lGyfUw7JEDd0RtBM_0 2024-09-14T12:09:52.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14139032140182165200', time=2024-09-14T13:50:09.554705+0000, chain.objs.size()=1 2024-09-14T12:09:52.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Mo8ejF_phR6P5rP8PfJyMYduw-joBfO_0 2024-09-14T12:09:52.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.426+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9426801462661875859', time=2024-09-14T13:50:17.586531+0000, chain.objs.size()=1 2024-09-14T12:09:52.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.275__shadow_.QqoIJQSEpMdatEI-Vh6PlcHQ9liUNO3_0 2024-09-14T12:09:52.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6525194588108230795', time=2024-09-14T13:50:21.379245+0000, chain.objs.size()=1 2024-09-14T12:09:52.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.281__shadow_.ivHzupCbnjGZLwZ0OMPUbXWGFKdAf41_0 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16748288209466064756', time=2024-09-14T13:50:22.632470+0000, chain.objs.size()=1 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.283__shadow_.Ru8jFaRj9Lvps4s9MhfDDdTOJkghTrF_0 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11550245220577348141', time=2024-09-14T13:50:29.882709+0000, chain.objs.size()=1 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.8pOdDstjy3X-0fAYh2S8j15mdmpC2jg_0 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.199892056618064166', time=2024-09-14T13:50:31.675670+0000, chain.objs.size()=1 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.8a_dB_5t3hyFUKlbKRfPJbN20YQzU1Z_0 2024-09-14T12:09:52.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4957227875870736459', time=2024-09-14T13:50:32.398835+0000, chain.objs.size()=1 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.294__shadow_.0F4Hct1e0XB3r0Tiy331B0kbhYH9xiH_0 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10874927453282475129', time=2024-09-14T13:50:38.958814+0000, chain.objs.size()=1 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.304__shadow_.J7HWl5vBieZihPH4304KGSNg_nO-ZsT_0 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14317916617217535284', time=2024-09-14T13:51:31.149240+0000, chain.objs.size()=1 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Pdoa40DeUUun-VPPgCmD31EeqcmMcoW_0 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5363061905908404787', time=2024-09-14T13:51:31.399177+0000, chain.objs.size()=1 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mka33xx-2hkkLakBknqPIbvDIdiGWaP_0 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3493362231653977264', time=2024-09-14T13:51:32.254721+0000, chain.objs.size()=1 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kxW5JFfiNUSalu6mfiNlTRBVtsEpId1_0 2024-09-14T12:09:52.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7988412436665791668', time=2024-09-14T13:51:33.212468+0000, chain.objs.size()=1 2024-09-14T12:09:52.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.erszpET3goILyoPXzO12_AppqMCGTae_0 2024-09-14T12:09:52.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7434546175242698080', time=2024-09-14T13:51:33.837845+0000, chain.objs.size()=1 2024-09-14T12:09:52.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2a2_1XPx5beoxPdSMFkooZkG0x08CtM_0 2024-09-14T12:09:52.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.434+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17912316260533323035', time=2024-09-14T13:51:33.838575+0000, chain.objs.size()=1 2024-09-14T12:09:52.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.434+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ULw7JRv92TGm_6rwcNrHki3azFVU6EZ_0 2024-09-14T12:09:52.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.435+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2086769374394535813', time=2024-09-14T13:51:33.891474+0000, chain.objs.size()=1 2024-09-14T12:09:52.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.435+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5iuM0HavfqilLEocNm5n4sF5MiwAjhW_0 2024-09-14T12:09:52.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.437+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17301422701519729558', time=2024-09-14T13:51:33.998773+0000, chain.objs.size()=1 2024-09-14T12:09:52.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.437+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2pGNTalsosFkmVk_1epxz8DqoP5Zbhb_0 2024-09-14T12:09:52.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4607779764495706456', time=2024-09-14T13:51:35.572761+0000, chain.objs.size()=1 2024-09-14T12:09:52.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.sZXGYE68loByiPRasTIgTfoELBCPI-X_0 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9452437146241104573', time=2024-09-14T13:51:36.246126+0000, chain.objs.size()=1 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.A42SpKIJT_853X1_I2DFhnORKurgggw_0 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11086941018225725028', time=2024-09-14T13:51:36.246910+0000, chain.objs.size()=1 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qHzyxYkDuWQR2VPEmI-M7H7HbJ8EBQc_0 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.271444501808431711', time=2024-09-14T13:51:36.411859+0000, chain.objs.size()=1 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2ktPjjmBXR6TmELeTBca5J87wDEU-mu_0 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12997629163891384179', time=2024-09-14T13:51:36.843034+0000, chain.objs.size()=1 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.KuBkaUKR7ZH_CmDTrtgEka6k8WLfFf3_0 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10407940128738721822', time=2024-09-14T13:51:37.144094+0000, chain.objs.size()=1 2024-09-14T12:09:52.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.NqoIDg_BjyFvqeA1aGTWlW0cRYePRlg_0 2024-09-14T12:09:52.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13993734428498752356', time=2024-09-14T13:51:37.472024+0000, chain.objs.size()=1 2024-09-14T12:09:52.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.73t5te581d8r4zGw085yDotZgLgoQcn_0 2024-09-14T12:09:52.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14244683108672458503', time=2024-09-14T13:51:37.607469+0000, chain.objs.size()=1 2024-09-14T12:09:52.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IMw240Oef0kGK04lebCqKXBY0YCR0IY_0 2024-09-14T12:09:52.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8747120277243801823', time=2024-09-14T13:51:38.278284+0000, chain.objs.size()=1 2024-09-14T12:09:52.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.R-q19Yk8KVkdYbixWFiUl5b21GSoA9O_0 2024-09-14T12:09:52.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.441+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8208341187911664586', time=2024-09-14T13:51:38.466831+0000, chain.objs.size()=1 2024-09-14T12:09:52.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.441+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZiqYJszKl4Nu6i1r-vVmxeWMrsfgwPs_0 2024-09-14T12:09:52.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3709683283071112995', time=2024-09-14T13:51:38.580906+0000, chain.objs.size()=1 2024-09-14T12:09:52.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5a6fSfzYj0ToylL4657j1c5GVIDMbB-_0 2024-09-14T12:09:52.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6943717373683275247', time=2024-09-14T13:51:38.581722+0000, chain.objs.size()=1 2024-09-14T12:09:52.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RdYhyYE2n8lGDNDx3hF502HUxMLSu_r_0 2024-09-14T12:09:52.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9798324495704781803', time=2024-09-14T13:51:38.836195+0000, chain.objs.size()=1 2024-09-14T12:09:52.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WV2LiVIq4ybclXXnM2Ed9z6QRlRhJJL_0 2024-09-14T12:09:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.446+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15736117358676300293', time=2024-09-14T13:51:39.224065+0000, chain.objs.size()=1 2024-09-14T12:09:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.446+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7vKFk5E_6oiuqmEMfBiZb2lq2RjL_MQ_0 2024-09-14T12:09:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.446+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12543290763046587946', time=2024-09-14T13:51:39.307391+0000, chain.objs.size()=1 2024-09-14T12:09:52.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.446+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.FTVZNDI7bv0Po9rm3QWOMbu5z1MGvOE_0 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.515597320160695629', time=2024-09-14T13:51:39.322835+0000, chain.objs.size()=1 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Q2rOaUwoi6ZSAbkD-64ODnEgPWW0rAl_0 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11019990810388952536', time=2024-09-14T13:51:39.699228+0000, chain.objs.size()=1 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hlv3p_ihJtU4PJYXQejuJ0ScQg7_IeJ_0 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3143199640435715997', time=2024-09-14T13:51:39.700001+0000, chain.objs.size()=1 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.obQw6aBVw_QRGsKsZJQM6TEIml9eNwL_0 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6709744611576560670', time=2024-09-14T13:51:40.510638+0000, chain.objs.size()=1 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.447+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.We6vVohSYMJDiL0AENzPFtzAyjw_0fv_0 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9527606123929572494', time=2024-09-14T13:51:41.412602+0000, chain.objs.size()=1 2024-09-14T12:09:52.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uFuE4cUvVBU-pUQIgyfIi-YKyfQYmIc_0 2024-09-14T12:09:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8013184298925252979', time=2024-09-14T13:51:41.516972+0000, chain.objs.size()=1 2024-09-14T12:09:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.f7JIVBXpP1xvqHkFZZEY-nzC4IIJ7X9_0 2024-09-14T12:09:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13613211573246826299', time=2024-09-14T13:51:41.772093+0000, chain.objs.size()=1 2024-09-14T12:09:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dyv06dCo4coVs_p-6DJHNGlGpMCQm0g_0 2024-09-14T12:09:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.449+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5845824981383415689', time=2024-09-14T13:51:41.892585+0000, chain.objs.size()=1 2024-09-14T12:09:52.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.449+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.geHa6VJOky7OqA7mvFhZD7SzVLI-hS2_0 2024-09-14T12:09:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12257103009197280993', time=2024-09-14T13:52:21.232823+0000, chain.objs.size()=1 2024-09-14T12:09:52.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mHw_DTGtKzyScNoooMzGmUvHEf7Cvyb_0 2024-09-14T12:09:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8825684380133649014', time=2024-09-14T13:52:21.406006+0000, chain.objs.size()=1 2024-09-14T12:09:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.1FLwwKgNS3XwmgcMQzQpKpxfhjFh8jd_0 2024-09-14T12:09:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17189356146293227166', time=2024-09-14T13:52:21.769198+0000, chain.objs.size()=1 2024-09-14T12:09:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8bdBq3c8RlUaN7sKlRMeSqhher_6U0p_0 2024-09-14T12:09:52.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6080066342109322853', time=2024-09-14T13:52:22.690131+0000, chain.objs.size()=1 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MN16LSZqF_YLuQP-JWgUIJ6JXkT_8nR_0 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8750349712047729878', time=2024-09-14T13:52:22.951419+0000, chain.objs.size()=1 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zoeDy1iMvMB5cdWQlUK1poiv0RvetdT_0 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8881831208980869844', time=2024-09-14T13:52:23.166738+0000, chain.objs.size()=1 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.B4R9u2-RyK2PdPXQIEATF1RMZPz8wSQ_0 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12565581800570085608', time=2024-09-14T13:52:23.351909+0000, chain.objs.size()=1 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9hCCQ5lacRsBqGv5UOdas2qZwFXAdmo_0 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8255764702413226290', time=2024-09-14T13:52:23.478953+0000, chain.objs.size()=1 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.455+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7htPJkvReCBCM5Aqw3wDJ6u-5ATI8v9_0 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.456+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14041119775474746085', time=2024-09-14T13:52:23.527045+0000, chain.objs.size()=1 2024-09-14T12:09:52.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.456+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.A4bbngVoPMPMROWME09NTqWE6jCCiDl_0 2024-09-14T12:09:52.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.456+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8969919117747784594', time=2024-09-14T13:52:23.708428+0000, chain.objs.size()=1 2024-09-14T12:09:52.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.456+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xZCYinGj69w2-s4qc4iKKzMIEApURbB_0 2024-09-14T12:09:52.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.456+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8073126233523259753', time=2024-09-14T13:52:24.237122+0000, chain.objs.size()=1 2024-09-14T12:09:52.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.456+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.M6DYSy08nwT0m1ZbO3zbQIKWe1VApCZ_0 2024-09-14T12:09:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.457+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9024335029017262987', time=2024-09-14T13:52:24.558810+0000, chain.objs.size()=1 2024-09-14T12:09:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6GTsCMcp8uqoNE9Oybtfd4N49_3-peO_0 2024-09-14T12:09:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5963165795575321748', time=2024-09-14T13:52:24.595453+0000, chain.objs.size()=1 2024-09-14T12:09:52.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.z3nkd4cSvavjRFXxdbBk9vjFjTG3U2H_0 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6947621604669597192', time=2024-09-14T13:52:25.076281+0000, chain.objs.size()=1 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Bz4iAJ6M6vKFnuC2jHHuRTMiVZBFlPx_0 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5689090616449316048', time=2024-09-14T13:52:25.185196+0000, chain.objs.size()=1 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sBx_qzz2RkltXqwuRlh91FPsELdVu7f_0 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7392094820080297462', time=2024-09-14T13:52:25.185879+0000, chain.objs.size()=1 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0bNBRUXKO-qT6sNFTRG1nldbT1Z3Cu3_0 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11380285330220094155', time=2024-09-14T13:52:25.860103+0000, chain.objs.size()=1 2024-09-14T12:09:52.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gfvRH05V_LaL3_qmif4f9WC2MvpVUqm_0 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12521652694510863076', time=2024-09-14T13:52:25.975693+0000, chain.objs.size()=1 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.oSWjTgJets3gioVWLVGZubXpM039PqP_0 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18144075924638065826', time=2024-09-14T13:52:26.018852+0000, chain.objs.size()=1 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.S6xbiyNBkC5RutD9glFB1GYfl3Iuq8J_0 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6274299004883225073', time=2024-09-14T13:52:26.243223+0000, chain.objs.size()=1 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QyZZKwZVjxNOOypQyXcwcyjijVG8sgT_0 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9768247484833400873', time=2024-09-14T13:52:26.393483+0000, chain.objs.size()=1 2024-09-14T12:09:52.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.b9Dhe6s6ESE5LB3G9UOY9mF5h5klcmH_0 2024-09-14T12:09:52.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.461+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12716956296433239543', time=2024-09-14T13:52:27.228121+0000, chain.objs.size()=1 2024-09-14T12:09:52.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.461+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JmjlokRlPvIT3dSiryEhQqn4KqiNGyy_0 2024-09-14T12:09:52.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.461+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17838570504410157646', time=2024-09-14T13:52:27.739910+0000, chain.objs.size()=1 2024-09-14T12:09:52.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.461+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RiGv9ylU6mXRG2bNDyEYet3JtRUEji9_0 2024-09-14T12:09:52.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.461+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14010671287827504762', time=2024-09-14T13:52:28.234006+0000, chain.objs.size()=1 2024-09-14T12:09:52.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.461+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4lXji2_LKuuTwpFw_Ba6G71VA1ooscD_0 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.463+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7187445169483366864', time=2024-09-14T13:52:28.248990+0000, chain.objs.size()=1 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.463+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lIs7mwQwYUbJHC1gm94lV7SszRDINyP_0 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1657491522147614034', time=2024-09-14T13:52:28.667980+0000, chain.objs.size()=1 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5Q1e0tjfaRO9FFU8GrLJctYO2GliW8P_0 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3177391650872862204', time=2024-09-14T13:52:28.668702+0000, chain.objs.size()=1 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PubRFmjV-1Dw3R2pu0b_b82wveHuZgm_0 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1090334872197700495', time=2024-09-14T13:52:28.728989+0000, chain.objs.size()=1 2024-09-14T12:09:52.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UxfqxydMEIr8gHRTfDjabjebRkxl4rL_0 2024-09-14T12:09:52.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.957660318502826437', time=2024-09-14T13:52:28.781026+0000, chain.objs.size()=1 2024-09-14T12:09:52.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VDNiCFYpFemPubusp3ChZzz5QH-AQ31_0 2024-09-14T12:09:52.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14119810963146417716', time=2024-09-14T13:52:28.867289+0000, chain.objs.size()=1 2024-09-14T12:09:52.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.464+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.HEnJIIN5wmfK7DyJCovsNFX1_H85NlT_0 2024-09-14T12:09:52.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.466+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12580179164315186748', time=2024-09-14T13:52:29.033392+0000, chain.objs.size()=1 2024-09-14T12:09:52.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.466+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.35LJ78K0WNC_sehyofvkhilW9mFWxpd_0 2024-09-14T12:09:52.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.468+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2129124300344095372', time=2024-09-14T13:52:30.577009+0000, chain.objs.size()=1 2024-09-14T12:09:52.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.468+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SETaYszGU4cqLgFXwGeLrDmGiJZJofV_0 2024-09-14T12:09:52.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/44701 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8617482117389601585', time=2024-09-14T13:52:30.776109+0000, chain.objs.size()=1 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lW8vudsCWnfqBYurRboGA-90m8sqRN9_0 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13690621014535538585', time=2024-09-14T13:52:30.944125+0000, chain.objs.size()=1 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aFo26qKJ-upQ88s31xf0l3WwbkKAFVx_0 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5375944969434285610', time=2024-09-14T13:52:32.021019+0000, chain.objs.size()=1 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.CFJEnUampxQFLq4SBa2Eo8tiuhq7ykg_0 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16860153462295087028', time=2024-09-14T13:52:32.102155+0000, chain.objs.size()=1 2024-09-14T12:09:52.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.owDaLssTzb6NZBsqs2qcQm2wWyMgYn8_0 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1043289526083444344', time=2024-09-14T13:52:32.186601+0000, chain.objs.size()=1 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.p-VAT9OKkgtTJGSlySRdaLZLkv_QXkS_0 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8676442386580465775', time=2024-09-14T13:53:01.019579+0000, chain.objs.size()=1 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.379__shadow_.G6lUQ7UOMXw41dsWikqkXvkMdkv9M8w_0 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.811490996515486353', time=2024-09-14T13:53:49.938119+0000, chain.objs.size()=1 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.460__shadow_.T_yBqCmKZsUzW7tkY_PwJeSGYfXWtHX_0 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.955804871668815436', time=2024-09-14T13:54:02.582869+0000, chain.objs.size()=1 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.kWwm33XybtGQ7fjpyvcihEt6iERQcdc_0 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1720771563662472475', time=2024-09-14T13:54:12.193841+0000, chain.objs.size()=1 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.495__shadow_.grjiJcueNnGS8CSLgN93LlS6MoLG7D-_0 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11391377075570508269', time=2024-09-14T13:56:16.707869+0000, chain.objs.size()=1 2024-09-14T12:09:52.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~KB5WWU1G_xE-ecRT7GtMrbrX_wTg5td.1 2024-09-14T12:09:52.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13268797181458959887', time=2024-09-14T13:56:31.548855+0000, chain.objs.size()=2 2024-09-14T12:09:52.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.528__multipart_mymultipart.2~BTQ5lP9IDWyfhIgMCsSRFI3O_smv266.1 2024-09-14T12:09:52.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.477+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.528__multipart_mymultipart.2~BTQ5lP9IDWyfhIgMCsSRFI3O_smv266.2 2024-09-14T12:09:52.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.481+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10452227433578520654', time=2024-09-14T13:57:55.949490+0000, chain.objs.size()=1 2024-09-14T12:09:52.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.481+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:0HItrZaG6QYZklAKvi5ZzA4aHbvhK84_.cI1iKXm7SZkV9OwRSRmAF7sDIz6QLgJ_0 2024-09-14T12:09:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5768531391301658200', time=2024-09-14T13:58:01.479156+0000, chain.objs.size()=1 2024-09-14T12:09:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.484+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:1c9H-IilTAYqLWcJhy8rgZQUi62JGuQ_.QNESR7-i2J8cTtb8EZDeGR1gmOTtLXe_0 2024-09-14T12:09:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10917189265759909867', time=2024-09-14T13:58:18.441667+0000, chain.objs.size()=1 2024-09-14T12:09:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.484+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:4aVp7dBYtcVo20xRfUU.VaQD3Ls9GiH_.AiOH8U0Wm_H7LU6k2slfO0kVICYUi_n_0 2024-09-14T12:09:52.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17379493871450579229', time=2024-09-14T13:58:27.640450+0000, chain.objs.size()=1 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:un3MURU3rGrKgS17SCkuS11wisFutpG_.IXbmQyvHUOZ5s006ydHQlu3VklePlIB_0 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13120552935943811749', time=2024-09-14T14:03:01.883865+0000, chain.objs.size()=1 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.626__shadow_.Py4vim4s7yD1MZHkur0YFFGaKDxqbGC_0 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3051003870394524936', time=2024-09-14T14:03:04.440232+0000, chain.objs.size()=1 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.630__shadow_.tIFoWf20k2lmoRq2bbLJ8uZJYvYJ0ct_0 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4892299518235576579', time=2024-09-14T14:03:10.395222+0000, chain.objs.size()=1 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.641__shadow_.6GvVGBE96_CzGpnJN1jEAkStHy9rFc5_0 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11452816318351945622', time=2024-09-14T14:03:53.794629+0000, chain.objs.size()=1 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.666__shadow_.YZC5v-cKyWsIt41PXt-jtlIoVZLZtDR_0 2024-09-14T12:09:52.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9464305676865426453', time=2024-09-14T14:06:11.698588+0000, chain.objs.size()=1 2024-09-14T12:09:52.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.485+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.760__shadow_.yfqqKW2oC3II4455RPVPtDCNN-MTETq_0 2024-09-14T12:09:52.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:52.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.494+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T12:09:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.500+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:52.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.501+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:52.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45192' 2024-09-14T12:09:52.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6413183556505940718', time=2024-09-14T13:46:31.189393+0000, chain.objs.size()=1 2024-09-14T12:09:52.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.147__shadow_.eBro9dzAiFonHUl9bfA6pf52evz9d0z_0 2024-09-14T12:09:52.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.270500318874195789', time=2024-09-14T13:46:44.428509+0000, chain.objs.size()=3 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-STANDARD.2~daNbC84HuTSpRAzHhUEuqvQW3B3RWN_.1 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-STANDARD.2~daNbC84HuTSpRAzHhUEuqvQW3B3RWN_.2 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-STANDARD.2~daNbC84HuTSpRAzHhUEuqvQW3B3RWN_.3 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9790034954975657759', time=2024-09-14T13:49:00.475987+0000, chain.objs.size()=1 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.230__shadow_.KPys_EJH6Sh2hLBWneR6wUHnWuam1os_0 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4148166273602848051', time=2024-09-14T13:49:05.265269+0000, chain.objs.size()=1 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.237__shadow_.JhG1TXxiybd5SUgHx_RyGOjN2mWMnMu_0 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4033283398234594826', time=2024-09-14T13:49:20.204171+0000, chain.objs.size()=1 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.260__shadow_.eFF2DjfW9Bhk0QWnJ6hpJphUuXpX1ye_0 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16112737986559810247', time=2024-09-14T13:49:59.354729+0000, chain.objs.size()=1 2024-09-14T12:09:52.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3tklQyoV57DiV36QF-9tQ27BmQIrt3a_0 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2124968728052254760', time=2024-09-14T13:49:59.521326+0000, chain.objs.size()=1 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vsrKXQCRAvhwXfUjAT1Vvq46S_gkVbC_0 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15944373336849178611', time=2024-09-14T13:49:59.745545+0000, chain.objs.size()=1 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PHH6QE2UiY6uF2c9WL3VILmNETtOOgV_0 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9913490076622703372', time=2024-09-14T13:50:01.464017+0000, chain.objs.size()=1 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2zpYmj5BilfpHQ9Csz60TkLjkfOlSiw_0 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.146904939677563840', time=2024-09-14T13:50:02.250902+0000, chain.objs.size()=1 2024-09-14T12:09:52.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.502+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LVJrscJlz5mwwcSFtOMPmgCUFTwP0jT_0 2024-09-14T12:09:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4433484302653642304', time=2024-09-14T13:50:02.454992+0000, chain.objs.size()=1 2024-09-14T12:09:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jMH_OC_TfuzqjTFNu3yrS-3_jZLzwZL_0 2024-09-14T12:09:52.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14385156383277904837', time=2024-09-14T13:50:02.635145+0000, chain.objs.size()=1 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BxN2-s7eY2XeZAGnj4pDhBjfOMiMXY2_0 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10975704360254333998', time=2024-09-14T13:50:02.970620+0000, chain.objs.size()=1 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZNLCdErlXY53kACJ3-YJNxY4XFjIgQX_0 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1305310710003505725', time=2024-09-14T13:50:03.012043+0000, chain.objs.size()=1 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xG6MOiwTPvS51_OOa37lj-YyHxDpict_0 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.77197787939065512', time=2024-09-14T13:50:03.590559+0000, chain.objs.size()=1 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.r_wVsc3-DxN1QMxBbcR51fOCZ9hq4UE_0 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.97254901001198194', time=2024-09-14T13:50:03.651397+0000, chain.objs.size()=1 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.79AZ9qtTU7tf95jtm2JnhESD_ZfllD5_0 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4032471578638296818', time=2024-09-14T13:50:03.894662+0000, chain.objs.size()=1 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Ns4VpbVF09Rds_HnUWUNLADfS9vpY6U_0 2024-09-14T12:09:52.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7346769336211418092', time=2024-09-14T13:50:03.895444+0000, chain.objs.size()=1 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.II_hUL2XMTs3DImMlGLopreWGK1Y-_6_0 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9656959791513744298', time=2024-09-14T13:50:03.967646+0000, chain.objs.size()=1 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.50oB5mivCWsYiE1qEqme8KACjI58jDm_0 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9485275277902592424', time=2024-09-14T13:50:03.968489+0000, chain.objs.size()=1 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1Ah1TrO1xrGppMpjy7hLqsjfZnudgzU_0 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13712538144312646252', time=2024-09-14T13:50:04.281209+0000, chain.objs.size()=1 2024-09-14T12:09:52.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ejw45bO33i4rrfnRSsayOqr0RqrmCkQ_0 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4176782043560906537', time=2024-09-14T13:50:04.974603+0000, chain.objs.size()=1 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.path3VxPVxUx-YFd3n7E_O8mIv8cYvi_0 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10008080704809207233', time=2024-09-14T13:50:05.026616+0000, chain.objs.size()=1 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rFAL36903Vp8c9WMX25Dma1BMLGbD48_0 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5505974650833591349', time=2024-09-14T13:50:05.203025+0000, chain.objs.size()=1 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.j4e-mRZGG7iINXeVAWfHHIbiW6FQjEl_0 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14948035772822808519', time=2024-09-14T13:50:05.503351+0000, chain.objs.size()=1 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PRk3l_XRTt_z-bfUWA74lOqsk5eGkB8_0 2024-09-14T12:09:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.508929137978669709', time=2024-09-14T13:50:05.760203+0000, chain.objs.size()=1 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.u-mACo3mewHdPhRs2DfGgnHcCWUeVLS_0 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10175997504037851178', time=2024-09-14T13:50:05.818688+0000, chain.objs.size()=1 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0UnFoBK-dkWC6zKkXZThLCHs5484btT_0 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9557735952574594959', time=2024-09-14T13:50:06.202267+0000, chain.objs.size()=1 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-8u8RjVGTLetjMgQB1NGfJU7B0Wwp57_0 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10736344741438447252', time=2024-09-14T13:50:06.920272+0000, chain.objs.size()=1 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2wsa0mQf0jT86dWxWWBR_UEjP-9EjfU_0 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7251484225705867690', time=2024-09-14T13:50:07.107680+0000, chain.objs.size()=1 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5t572meP2Qn9TL9LOfyvJB9pGH4qUz-_0 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2328602389742302475', time=2024-09-14T13:50:07.721681+0000, chain.objs.size()=1 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rchqPrc5wwxIsPzBtFUK_Png5A_pkpL_0 2024-09-14T12:09:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8467105732492059308', time=2024-09-14T13:50:07.852980+0000, chain.objs.size()=1 2024-09-14T12:09:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Dzz6Dqpk21n84EZnsiv0bgrPOs36t01_0 2024-09-14T12:09:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.518+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8987279285923347807', time=2024-09-14T13:50:07.853716+0000, chain.objs.size()=1 2024-09-14T12:09:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._etuccdnYxzGdncNpGE65jvJL8hga5W_0 2024-09-14T12:09:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.518+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2189071554300707421', time=2024-09-14T13:50:08.374920+0000, chain.objs.size()=1 2024-09-14T12:09:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qq76DatwP4-sSWK-V8g2w9eGrAu0ctT_0 2024-09-14T12:09:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.518+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11723902593462278338', time=2024-09-14T13:50:08.608887+0000, chain.objs.size()=1 2024-09-14T12:09:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.y711FVfFCjnLPfilBcRKMbYqGLO0xIg_0 2024-09-14T12:09:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.520+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11918655095228353715', time=2024-09-14T13:50:09.647959+0000, chain.objs.size()=1 2024-09-14T12:09:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.520+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-3YWlqDb9zcva5s3K0qEWdSubu3ptMz_0 2024-09-14T12:09:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.520+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9525191474420068040', time=2024-09-14T13:50:09.665171+0000, chain.objs.size()=1 2024-09-14T12:09:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.520+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ybihIyb9td6JShnXhyja-GG5a-n1EQu_0 2024-09-14T12:09:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.520+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7078707940044347016', time=2024-09-14T13:50:16.961606+0000, chain.objs.size()=1 2024-09-14T12:09:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.520+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.274__shadow_.sQjQlqJk3R9vQlM0aGGeFCGtrKCrRn2_0 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.659+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9266149451306124382', time=2024-09-14T13:50:17.596906+0000, chain.objs.size()=1 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.275__shadow_.RAq0Nz4x5sEo8iTpyEKGK6kSk2RYEXB_0 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13146440800501253059', time=2024-09-14T13:50:23.990298+0000, chain.objs.size()=1 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.285__shadow_.Cqc1BogFRc9v-yXBUDRsQvAwDu1DMNz_0 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.67959694112283691', time=2024-09-14T13:50:24.683041+0000, chain.objs.size()=1 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.286__shadow_.FDWXHL4UgthYaoEsX-yb-brVf3gAbnn_0 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11536833320032379285', time=2024-09-14T13:50:29.786945+0000, chain.objs.size()=1 2024-09-14T12:09:52.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.06CxbnLQ7aA8W-sFGDZwtek50ululvX_0 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16431197501038599484', time=2024-09-14T13:50:29.847200+0000, chain.objs.size()=1 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.UpqCjNgBi3BxF9OcYOKYn3xWICA1K5S_0 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7290364757917326843', time=2024-09-14T13:50:31.746316+0000, chain.objs.size()=1 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.TgVl_kKJMLjnXuFnDf3Mm5932Ihdc9s_0 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18134587898266062506', time=2024-09-14T13:50:32.408635+0000, chain.objs.size()=1 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.294__shadow_.Am9VuCqePdejw4-d9WG46RZ8Rn2ZkIL_0 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17241842210575500373', time=2024-09-14T13:50:50.602334+0000, chain.objs.size()=1 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.321__shadow_.ll8EIrPpKg5Y107sRjQtbzbm0o3YiIB_0 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5650206648237132095', time=2024-09-14T13:51:31.220019+0000, chain.objs.size()=1 2024-09-14T12:09:52.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tlYxNnGPbsDbf0hvpgro3M7VJ3geWTs_0 2024-09-14T12:09:52.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4889864815366842011', time=2024-09-14T13:51:31.270731+0000, chain.objs.size()=1 2024-09-14T12:09:52.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LYIgqYAnBNIGxt8RcXB_O9q4vGVwdQA_0 2024-09-14T12:09:52.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8928898852592329494', time=2024-09-14T13:51:31.556309+0000, chain.objs.size()=1 2024-09-14T12:09:52.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LwRsv7vf4d1PUjaug9RlDsIVereFLMe_0 2024-09-14T12:09:52.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.664+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7255348382186219396', time=2024-09-14T13:51:31.669646+0000, chain.objs.size()=1 2024-09-14T12:09:52.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.664+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._b4jG99aqfTNLRQ7IHBx3Z4sr5vd3kn_0 2024-09-14T12:09:52.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.664+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2719693650926680680', time=2024-09-14T13:51:32.442594+0000, chain.objs.size()=1 2024-09-14T12:09:52.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.664+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._qOBzNE8A1KHZ9M7pFBLgbp70pwaYin_0 2024-09-14T12:09:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.665+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10054066225089850218', time=2024-09-14T13:51:32.592159+0000, chain.objs.size()=1 2024-09-14T12:09:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.665+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vlxzrtrGPUvJdaV3TrjymeNYaz7ENH4_0 2024-09-14T12:09:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.665+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11306465816046370028', time=2024-09-14T13:51:32.753232+0000, chain.objs.size()=1 2024-09-14T12:09:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.665+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ENlITGB64WR0pk5ILozOg9kMwjsfUZp_0 2024-09-14T12:09:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.665+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4104765592242626576', time=2024-09-14T13:51:32.891893+0000, chain.objs.size()=1 2024-09-14T12:09:52.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.665+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Shbt7jN8yq2LpdQdyL1MqUxXnL7I2CV_0 2024-09-14T12:09:52.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10724821146631920750', time=2024-09-14T13:51:33.807248+0000, chain.objs.size()=1 2024-09-14T12:09:52.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zxSvXQ4pDbJ-oX00VBWoQubE0n0LVoF_0 2024-09-14T12:09:52.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1282079784546678141', time=2024-09-14T13:51:34.227945+0000, chain.objs.size()=1 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jvnVhY4STUDeoP2Jr5n3gNNGP0QuoaQ_0 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8943336764428795384', time=2024-09-14T13:51:34.328787+0000, chain.objs.size()=1 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WcebR0GJTCNB_47qm5z6rNYkkyDKCxs_0 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15252715049626397181', time=2024-09-14T13:51:34.407226+0000, chain.objs.size()=1 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Et1XHjOGRYXUs2DriN0SKkr50fRqJ9Q_0 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17870587708925926316', time=2024-09-14T13:51:34.572745+0000, chain.objs.size()=1 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2eER3a6aEV4SbOhI1t7TfIrL4eyCtDW_0 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6273200420961419357', time=2024-09-14T13:51:34.655283+0000, chain.objs.size()=1 2024-09-14T12:09:52.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.idSMcXhn9HLcNhEELWDsJrqfzslL7DP_0 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10173439543233116222', time=2024-09-14T13:51:35.343372+0000, chain.objs.size()=1 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qg8UpeW3OiZr6N_zmfU5GCOunCtiVAd_0 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11467545306694812038', time=2024-09-14T13:51:35.706640+0000, chain.objs.size()=1 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.seVMVKc4rhKduW5AvhDg4KH599NZqC1_0 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11903653958448062709', time=2024-09-14T13:51:35.917214+0000, chain.objs.size()=1 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jde0MdbzUDzEp1otgEaIS4uKc0csRku_0 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10716752980987011017', time=2024-09-14T13:51:36.111186+0000, chain.objs.size()=1 2024-09-14T12:09:52.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.670+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DJDKbmauO-yKaX3W7XI0yOI7mzV67db_0 2024-09-14T12:09:52.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10904073507674926970', time=2024-09-14T13:51:36.289240+0000, chain.objs.size()=1 2024-09-14T12:09:52.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZOfJScgG79eALfF5UmZj9aLzjpB0cRm_0 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9812301873921567778', time=2024-09-14T13:51:36.401628+0000, chain.objs.size()=1 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mZC1e3VHbZtfn_gkgAKnXrEbV6S2Jo5_0 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12835788584049845380', time=2024-09-14T13:51:36.995055+0000, chain.objs.size()=1 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xpzi92qDjWBQQjyjQJ8MehrowdBJ8qY_0 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17865817051701787479', time=2024-09-14T13:51:37.449983+0000, chain.objs.size()=1 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MUig6t9OTgCjCdIVzEXBnel0B_GUsaw_0 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16168125338986774491', time=2024-09-14T13:51:37.587634+0000, chain.objs.size()=1 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6kkki9MKe8_Y_E3yi4mh5KbvndtN2W1_0 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.23733809932941112', time=2024-09-14T13:51:37.795115+0000, chain.objs.size()=1 2024-09-14T12:09:52.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LECLQb2yFQlk09UEq6QN8qNnw9zkNZK_0 2024-09-14T12:09:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1370764460067010220', time=2024-09-14T13:51:38.277548+0000, chain.objs.size()=1 2024-09-14T12:09:52.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.672+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.t7q2aO7gh2HMp7c07N1M0Z7J5ecjhAM_0 2024-09-14T12:09:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.674+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1289159749940583617', time=2024-09-14T13:51:38.286988+0000, chain.objs.size()=1 2024-09-14T12:09:52.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.674+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qVZQJpQ0bPOfdGnHZeiLUDhHNBaYD7e_0 2024-09-14T12:09:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.675+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15691708000648238400', time=2024-09-14T13:51:38.411444+0000, chain.objs.size()=1 2024-09-14T12:09:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.675+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._8iv9LutsIu8T7G7B3Hx5huGYdGFd43_0 2024-09-14T12:09:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.675+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18366260633699968310', time=2024-09-14T13:51:38.465119+0000, chain.objs.size()=1 2024-09-14T12:09:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.675+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YRIq88fDaC8nHjzlz8ZYucnohyNdp6W_0 2024-09-14T12:09:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.675+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18054335864315040579', time=2024-09-14T13:51:38.577034+0000, chain.objs.size()=1 2024-09-14T12:09:52.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.675+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.shRvk60tYyAdNRguMxVjuTOvXSTmWqB_0 2024-09-14T12:09:52.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14305374606828630815', time=2024-09-14T13:51:38.712334+0000, chain.objs.size()=1 2024-09-14T12:09:52.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.imfLo8D_g789uVNziPDIsv38eU4qhf3_0 2024-09-14T12:09:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4322358249545582586', time=2024-09-14T13:51:39.702745+0000, chain.objs.size()=1 2024-09-14T12:09:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Vrm9T1C_WEIq3LhlS9F6M0sOU3dtX1q_0 2024-09-14T12:09:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5881675012495427248', time=2024-09-14T13:51:39.703610+0000, chain.objs.size()=1 2024-09-14T12:09:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.St1Ecj9-1TAxsTo8ZEJtcpuiexAr24A_0 2024-09-14T12:09:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.677+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5264729320459809473', time=2024-09-14T13:51:40.281613+0000, chain.objs.size()=1 2024-09-14T12:09:52.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.677+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dxhlpPhdNiOhMaUNNGw6P54T6bMzuk7_0 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.679+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15826101471688323531', time=2024-09-14T13:51:40.467712+0000, chain.objs.size()=1 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.679+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.NOtmH8jKgBJvgciAu4nVDuOdMg6qcKm_0 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.679+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16157285330081996008', time=2024-09-14T13:51:40.655302+0000, chain.objs.size()=1 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.679+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6WRMpF_bnRMyVlpYyiDz4Quv7tz44vd_0 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5581565266613517643', time=2024-09-14T13:52:21.598426+0000, chain.objs.size()=1 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MHzmGm4pYm_g5LVixg6uqwQuvAdENAL_0 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13698737844688230557', time=2024-09-14T13:52:22.989513+0000, chain.objs.size()=1 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VkQT08vOu0gSeXzDpcIHoSDEGMplRax_0 2024-09-14T12:09:52.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14129401687285101208', time=2024-09-14T13:52:23.077825+0000, chain.objs.size()=1 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QFVt4cxlwIVKUjJpr91ne3HSMMYkPhR_0 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12026394456369313094', time=2024-09-14T13:52:23.153440+0000, chain.objs.size()=1 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KmhjtVfC-nebZcHnFWoJ4ey2Y6jCTCl_0 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12348625411143879409', time=2024-09-14T13:52:24.223132+0000, chain.objs.size()=1 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ch27oKbeCFddl6-cwgXohhLmPZJJDTu_0 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16489460919217417474', time=2024-09-14T13:52:24.882478+0000, chain.objs.size()=1 2024-09-14T12:09:52.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3ycavFfhk_HGBx4VmQetVGEGhOcADT9_0 2024-09-14T12:09:52.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2848130713777433988', time=2024-09-14T13:52:25.243549+0000, chain.objs.size()=1 2024-09-14T12:09:52.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5uq91MawiNIG48RbuxmoVRQMiRVSghX_0 2024-09-14T12:09:52.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7695075728970526614', time=2024-09-14T13:52:25.953976+0000, chain.objs.size()=1 2024-09-14T12:09:52.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MVEm-amQLQv1BiCnurNrr37lQy7RN2g_0 2024-09-14T12:09:52.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5918372644856284701', time=2024-09-14T13:52:26.136060+0000, chain.objs.size()=1 2024-09-14T12:09:52.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.J0Flg1aBk_tgIeWbve7PwCuCOGsRbmS_0 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17952377924436500771', time=2024-09-14T13:52:26.312557+0000, chain.objs.size()=1 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pYvffHoKLpNyhyRWV1q0N8D_DKM5qb0_0 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4118164133187277319', time=2024-09-14T13:52:26.571927+0000, chain.objs.size()=1 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.s3LGjBaMQmhUeH0a9S6UEtSlVDHxSvc_0 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12777792018572318076', time=2024-09-14T13:52:26.597674+0000, chain.objs.size()=1 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cdfvADWSe6HzE7HRucCjnZyfVEeLaqQ_0 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12865239819731673051', time=2024-09-14T13:52:27.611969+0000, chain.objs.size()=1 2024-09-14T12:09:52.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.d36_f-wAQzs0OddnQLMEZS_T4qDWwO-_0 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6212878370193212965', time=2024-09-14T13:52:27.692028+0000, chain.objs.size()=1 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Cb4KPLJGoUjl01kTmpIvsNcc4Ko_ZGv_0 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1293686337295704033', time=2024-09-14T13:52:27.730462+0000, chain.objs.size()=1 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._1cTnnmW1o04KCUg-0Q0deB50Oq2ObZ_0 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16900460856085116548', time=2024-09-14T13:52:27.755289+0000, chain.objs.size()=1 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rqA7_T3AispKQmpSFGC6Kzc72L-oUz1_0 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1392133721676015368', time=2024-09-14T13:52:27.983988+0000, chain.objs.size()=1 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.686+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fF475rgC5dlldB5LfXdJoVjlrIOXqjn_0 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.687+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2026016867897994224', time=2024-09-14T13:52:28.102400+0000, chain.objs.size()=1 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.687+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZqZXD7Q39kU98smT-I_NL2xLI58edVj_0 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.687+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6757324734696157852', time=2024-09-14T13:52:28.608154+0000, chain.objs.size()=1 2024-09-14T12:09:52.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.687+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ga_dOU-Jx7-9a9U5O6oY18_OlVoYCX0_0 2024-09-14T12:09:52.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.691+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/45192 2024-09-14T12:09:52.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9571367145128338716', time=2024-09-14T13:52:28.632264+0000, chain.objs.size()=1 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.reGNYqPCtBUCOJyPOb4YC9gktVaiBKf_0 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17360837076861417834', time=2024-09-14T13:52:28.855720+0000, chain.objs.size()=1 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EZB-_SaWEJyS3ZMBdKRqN8MWBo1zFDy_0 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2301439665835854591', time=2024-09-14T13:52:28.856315+0000, chain.objs.size()=1 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ToSEgL-eNIxJpGJkBw9_B69k6yOYHf4_0 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3830240492444196493', time=2024-09-14T13:52:29.019643+0000, chain.objs.size()=1 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Fi19icPQLUcgEeaNJP8HIjZg12Fmb8X_0 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12539651099821091501', time=2024-09-14T13:52:29.437599+0000, chain.objs.size()=1 2024-09-14T12:09:52.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.C0AU_buGCmh9wPbBwcHXEpRmnaBWI70_0 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4407109872476029813', time=2024-09-14T13:52:29.559556+0000, chain.objs.size()=1 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rwN9grpN1c2Lrb9YYh5gZoFO2wbWgRo_0 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8801590320557198987', time=2024-09-14T13:52:30.237020+0000, chain.objs.size()=1 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.s60pFxB0VHldVYeUscGRPRqdwFeDNr3_0 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13943000421788664112', time=2024-09-14T13:52:30.324558+0000, chain.objs.size()=1 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Z8vpAszNn_1eTbxm7d3jg7o1DqKdyq3_0 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9425288031045027350', time=2024-09-14T13:52:31.067813+0000, chain.objs.size()=1 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PFFDrQAGFkkIyDU11Iy6NGrmwZpEM0A_0 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7514088653568993859', time=2024-09-14T13:52:31.385251+0000, chain.objs.size()=1 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jK3CHlykcr9utgjq-Yv3VluAuA3Jg0k_0 2024-09-14T12:09:52.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8150001445419246523', time=2024-09-14T13:52:31.678356+0000, chain.objs.size()=1 2024-09-14T12:09:52.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TMbk97d-MKee0pWl0x7ds865AK5V0-b_0 2024-09-14T12:09:52.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10920934268177610062', time=2024-09-14T13:52:31.869414+0000, chain.objs.size()=1 2024-09-14T12:09:52.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LRTSP8hxirC-42u3bS669iqRPQMSYsh_0 2024-09-14T12:09:52.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.698+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14438246928135239355', time=2024-09-14T13:52:31.912757+0000, chain.objs.size()=1 2024-09-14T12:09:52.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.698+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZzDuc5cZaEaAqyb8FwngWqOsbuHGOJO_0 2024-09-14T12:09:52.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8857934786018626666', time=2024-09-14T13:52:32.096009+0000, chain.objs.size()=1 2024-09-14T12:09:52.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.v94WiEjhqGsTOQU5hnj8-KExWnH3IHD_0 2024-09-14T12:09:52.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2850648527061216915', time=2024-09-14T13:52:32.202069+0000, chain.objs.size()=1 2024-09-14T12:09:52.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tHlCb_TLSpDx8gS048zAzzLaEaQP2CZ_0 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15180806613285919020', time=2024-09-14T13:52:35.912186+0000, chain.objs.size()=1 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.331__shadow_.LiNoDlPyN1KqyHYtLXvb4qu7KwKNG-w_0 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8301637169680004737', time=2024-09-14T13:53:03.649239+0000, chain.objs.size()=1 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.383__shadow_.MlT_DuuQNRoFJNyzTSq1ajbcVyxofT8_0 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5368272590270381036', time=2024-09-14T13:53:50.793261+0000, chain.objs.size()=1 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.461__shadow_.PnTKoVGSMx3mtzqwFMNCndJXcL5vRAs_0 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2427916498862993669', time=2024-09-14T13:53:54.328467+0000, chain.objs.size()=1 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.465__shadow_.hWwk0kh-xKa5aFYmqcu6TV4DO_XP96K_0 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15430948258507109', time=2024-09-14T13:54:00.356032+0000, chain.objs.size()=1 2024-09-14T12:09:52.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.481__shadow_.9UrtErzzwBy0j0Kvw5qyg9DhEoVdwnl_0 2024-09-14T12:09:52.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7587720199175550543', time=2024-09-14T13:54:03.876839+0000, chain.objs.size()=1 2024-09-14T12:09:52.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.485__shadow_.9vvMYaLakmqSYXp5ldFrg9NMXSvsa2K_0 2024-09-14T12:09:52.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~Jm5RvEJMi92Rg5QRzwK_mQ5mHel8E6o', time=2024-09-14T13:56:37.458409+0000, chain.objs.size()=1 2024-09-14T12:09:52.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.531__multipart_mymultipart.2~Jm5RvEJMi92Rg5QRzwK_mQ5mHel8E6o.1 2024-09-14T12:09:52.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12692540006561300513', time=2024-09-14T13:57:52.959753+0000, chain.objs.size()=1 2024-09-14T12:09:52.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:gpQy4gc86iunY8GIRt51gKeBwe7EMHU_.VViJquuJbWox-db0EMc2Ab0uiupRkuT_0 2024-09-14T12:09:52.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.704+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6643858584704336834', time=2024-09-14T13:57:54.090867+0000, chain.objs.size()=1 2024-09-14T12:09:52.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.704+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:T2XPXeRU-IO7uTLi5.LZSoH3QJf6IsC_.GXqY8a2LJENdTedJipjTVBS9jkcWq2u_0 2024-09-14T12:09:52.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.705+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1708498922845389608', time=2024-09-14T13:58:16.523916+0000, chain.objs.size()=1 2024-09-14T12:09:52.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.705+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:gzMP7ZQrm.lQadTAZboTL7t1cy8FPWJ_.9gtv73c7YyuUkod6P8v48lgHSQZjB5u_0 2024-09-14T12:09:52.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3252853603458147909', time=2024-09-14T13:58:32.292330+0000, chain.objs.size()=1 2024-09-14T12:09:52.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:HeGqQ7O-scgCpdzzUB39BQ7SXvyKojZ_.D1Ga93Wk2DRg_PAWF0WyhJdgTb2Xx3e_0 2024-09-14T12:09:52.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18340383435777277051', time=2024-09-14T13:58:36.113589+0000, chain.objs.size()=1 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:JdaX.rJwEHnXHHLQ1lIypzVxug3jn2n_.1D9o6ZKhEXHfyCjNnN2y0X20r9KCdGC_0 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12601821117679231095', time=2024-09-14T13:58:58.307272+0000, chain.objs.size()=1 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.582__shadow:r0dYNgdWdekpHZLbAzCYhiScFLYIsJ4_.KY-EqMF0jDImM3I5WOjKJu783lz4kaQ_0 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15125453781928736751', time=2024-09-14T13:59:45.504881+0000, chain.objs.size()=6 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.613__multipart_multipart_enc.2~kZqjpSxrh_hwsxe4WOpwpQveAFAzKdp.1 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.613__multipart_multipart_enc.2~kZqjpSxrh_hwsxe4WOpwpQveAFAzKdp.2 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.613__multipart_multipart_enc.2~kZqjpSxrh_hwsxe4WOpwpQveAFAzKdp.3 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.613__multipart_multipart_enc.2~kZqjpSxrh_hwsxe4WOpwpQveAFAzKdp.4 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.613__multipart_multipart_enc.2~kZqjpSxrh_hwsxe4WOpwpQveAFAzKdp.5 2024-09-14T12:09:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.706+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.613__multipart_multipart_enc.2~kZqjpSxrh_hwsxe4WOpwpQveAFAzKdp.6 2024-09-14T12:09:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.709+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.645642480743266592', time=2024-09-14T14:01:23.822511+0000, chain.objs.size()=1 2024-09-14T12:09:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.709+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.617__shadow_.v3jzG5yHvloZn9JKI2_7HMLKoDf4WmJ_0 2024-09-14T12:09:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.710+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7164321619049189280', time=2024-09-14T14:04:13.694909+0000, chain.objs.size()=1 2024-09-14T12:09:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.710+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.703__shadow:9sO1S0vY6qlRy68oiLmnnNubq-Jdegt_.tIx0cBymv-ArmAEG4DX5gCZEo1BmO-9_0 2024-09-14T12:09:52.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.712+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9986569551402771016', time=2024-09-14T14:04:41.712513+0000, chain.objs.size()=1 2024-09-14T12:09:52.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.712+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.718__shadow_.OohprEKa2cM2bds82goqjsioW0m6g0G_0 2024-09-14T12:09:52.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.713+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15356710552967381008', time=2024-09-14T14:04:42.339637+0000, chain.objs.size()=1 2024-09-14T12:09:52.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.713+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.719__shadow_.Wa_EjhHCeWquqfeT_a0ME9EAync8vf-_0 2024-09-14T12:09:52.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.713+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9516656422849138418', time=2024-09-14T14:05:55.134649+0000, chain.objs.size()=1 2024-09-14T12:09:52.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.713+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.752__shadow_._JvZIdBOUWFlle7R9M1co3SX6-p5Fgm_0 2024-09-14T12:09:52.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.717+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.723+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T12:09:52.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.725+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:52.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.725+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48013' 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7105819471834996286', time=2024-09-14T13:47:19.068399+0000, chain.objs.size()=1 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.188__shadow_.0LmYMp9rO0HacyuU8pF08U923oj6I1p_0 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17171967689094196584', time=2024-09-14T13:49:10.810038+0000, chain.objs.size()=1 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.245__shadow_.z5QNCCWwgMLlnJmLuG1JN8lPZ7yeL-0_0 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12624537368882458181', time=2024-09-14T13:49:15.232764+0000, chain.objs.size()=1 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.252__shadow_.rINX3T7sb2kInBbgzpSauhjyUEvvRgu_0 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3115188200727687112', time=2024-09-14T13:49:16.549228+0000, chain.objs.size()=1 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.254__shadow_.V7UZxDRlTrh5_Nw1t4LAanepmIjhJnB_0 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12340805442863841957', time=2024-09-14T13:49:18.388413+0000, chain.objs.size()=1 2024-09-14T12:09:52.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.257__shadow_.WVQ4GblIDgV_Cp4svn3Vzec8fool7t3_0 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13442303932957100764', time=2024-09-14T13:49:20.831244+0000, chain.objs.size()=1 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.261__shadow_.jV8qP3xNWK7_u9Pqlgg1QE3tE9-99m2_0 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11451423170382970096', time=2024-09-14T13:49:59.038535+0000, chain.objs.size()=1 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Vvu69-YVw6oODW0WfvYSHPcAEUya5uV_0 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1785893720328512887', time=2024-09-14T13:49:59.779642+0000, chain.objs.size()=1 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.19Ev6OqS6yClqtMFewBS9qoatxqgy-m_0 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16166255448064716612', time=2024-09-14T13:49:59.924464+0000, chain.objs.size()=1 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EwAL-a6PPjRVwL7cARVnz-NC5c1kben_0 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1700159008198139543', time=2024-09-14T13:50:00.491426+0000, chain.objs.size()=1 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.v8vefK3jHCS8duDKY69GjfynhiiOr8e_0 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12790040203654242179', time=2024-09-14T13:50:00.626941+0000, chain.objs.size()=1 2024-09-14T12:09:52.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oukhC7rPVmGj90g-nokC_Nso2Lu3doq_0 2024-09-14T12:09:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16820393163572996947', time=2024-09-14T13:50:00.928112+0000, chain.objs.size()=1 2024-09-14T12:09:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.726+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SFdP3lDx2cVkuzGcGXGcm2N5OezejE0_0 2024-09-14T12:09:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.729+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7831920524532835727', time=2024-09-14T13:50:02.170094+0000, chain.objs.size()=1 2024-09-14T12:09:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nSU1u52n1SJclNqWmQRQMNVnt7Z49kf_0 2024-09-14T12:09:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18376766476501740016', time=2024-09-14T13:50:02.417618+0000, chain.objs.size()=1 2024-09-14T12:09:52.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LVoUBLSberTqhGZV7vnGhWMNFcorM8C_0 2024-09-14T12:09:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13983436953370934334', time=2024-09-14T13:50:02.994505+0000, chain.objs.size()=1 2024-09-14T12:09:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cEMUA6Vn7EX3eocLRODssAjIjluy6-b_0 2024-09-14T12:09:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1822026098357600333', time=2024-09-14T13:50:03.584748+0000, chain.objs.size()=1 2024-09-14T12:09:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aG6NHgWNDcdtXEOpzypXXwiK25_SHWV_0 2024-09-14T12:09:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6014394489752294419', time=2024-09-14T13:50:03.585278+0000, chain.objs.size()=1 2024-09-14T12:09:52.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1tAeto_d-HouyGu2tItCd6sNUQcfPoP_0 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6915952591582293842', time=2024-09-14T13:50:03.998069+0000, chain.objs.size()=1 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NgdTZzbSKhwBjjIDrdZI0JGNxxYS62y_0 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15872552340284645251', time=2024-09-14T13:50:04.987396+0000, chain.objs.size()=1 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TwhSrHqQenpQF1nZRG2ylryBr5E4nd2_0 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16891811110809993102', time=2024-09-14T13:50:05.467456+0000, chain.objs.size()=1 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jwdfzsjhaoB8Mq5zNkrTj6I-wgYzw5g_0 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5933110652701053717', time=2024-09-14T13:50:05.629753+0000, chain.objs.size()=1 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gSYXXD-CariEEaWDIw0u0jfmjZ-L8sZ_0 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7509587705221781810', time=2024-09-14T13:50:05.725692+0000, chain.objs.size()=1 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PXRMQkZxsXVRSJNNLnTq8fJMQovaEYz_0 2024-09-14T12:09:52.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7101496488997824800', time=2024-09-14T13:50:05.732887+0000, chain.objs.size()=1 2024-09-14T12:09:52.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.731+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.F5cRFc4szNmI5NC_df77aiuNPuMGLy1_0 2024-09-14T12:09:52.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16091636127412228559', time=2024-09-14T13:50:06.202443+0000, chain.objs.size()=1 2024-09-14T12:09:52.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.F-5Vjf3h_DG3EGjMowfDjmSsxG6HlQO_0 2024-09-14T12:09:52.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9629059261614111051', time=2024-09-14T13:50:06.260863+0000, chain.objs.size()=1 2024-09-14T12:09:52.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l7LmsetNpmFFlrGOhKnSuJGdyX1Flwl_0 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1866444619770095177', time=2024-09-14T13:50:06.372771+0000, chain.objs.size()=1 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.b_oy8jEA8LbzqIt4bufD47aYPuYsYWs_0 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10043764923116224950', time=2024-09-14T13:50:06.870548+0000, chain.objs.size()=1 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OPnSGk-sOJMSzrIV7kVwiYdwyeLXo5C_0 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14403581911395765403', time=2024-09-14T13:50:06.928366+0000, chain.objs.size()=1 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Pa_GICoi1JI57CI8dRBMeQo_DuonoyQ_0 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6775133799186446173', time=2024-09-14T13:50:07.236224+0000, chain.objs.size()=1 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0WbMKJrNslfXxd7R8K0r1Bzq3b1Alz9_0 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6766963191327410175', time=2024-09-14T13:50:07.822443+0000, chain.objs.size()=1 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3Gmj47FDWeAZ-huiTNt9et62M4Drlnj_0 2024-09-14T12:09:52.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13426589862533871041', time=2024-09-14T13:50:07.979473+0000, chain.objs.size()=1 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ob9lVa-LsRtrBf5Ua_l_i1SAeYIk1ye_0 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14120748793774313664', time=2024-09-14T13:50:08.143988+0000, chain.objs.size()=1 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fXlwO25_cvrloftnf6JiLDNLAXae-bM_0 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10730489441865460381', time=2024-09-14T13:50:08.243170+0000, chain.objs.size()=1 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lTn6VbDv89CSydimy31xIVYaAoHBCJc_0 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13296820241291939955', time=2024-09-14T13:50:08.415738+0000, chain.objs.size()=1 2024-09-14T12:09:52.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.736+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WpppMCU5XQ-LF2-7WCDDK5_dlIPYN___0 2024-09-14T12:09:52.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11094832053738270415', time=2024-09-14T13:50:09.610385+0000, chain.objs.size()=1 2024-09-14T12:09:52.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WXwlu7FNb9JG6kkx6x3KwdB6T-kV9RG_0 2024-09-14T12:09:52.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14392261109352033403', time=2024-09-14T13:50:20.764959+0000, chain.objs.size()=1 2024-09-14T12:09:52.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.280__shadow_.c4dby3Dpv8lJUEY-F_BPcWqXAJGmcVx_0 2024-09-14T12:09:52.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.739+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6142894470071319721', time=2024-09-14T13:50:21.388884+0000, chain.objs.size()=1 2024-09-14T12:09:52.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.739+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.281__shadow_.-SuzLIg69WHXyAvSkr3Y8EtGxM1WrE5_0 2024-09-14T12:09:52.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.739+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6917747442396022542', time=2024-09-14T13:50:29.784567+0000, chain.objs.size()=1 2024-09-14T12:09:52.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.739+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.DCiciqH8wt2bEeoa_-Kd0yjHl0ItafO_0 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6208370358717010999', time=2024-09-14T13:50:29.785736+0000, chain.objs.size()=1 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.aHt415jUjsc40hA3dq5x0QeJWhq3Vam_0 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16700364945839050904', time=2024-09-14T13:50:31.678115+0000, chain.objs.size()=1 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.DFfjx2RZ2-t_ZmqcPxdqMobK5p_SLcd_0 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9598617925143361412', time=2024-09-14T13:50:33.717235+0000, chain.objs.size()=1 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.296__shadow_.3IK8jCzSKbu-06_FO4D_HLK5mqRSO7C_0 2024-09-14T12:09:52.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12630583110943134351', time=2024-09-14T13:50:35.800858+0000, chain.objs.size()=1 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.299__shadow_.lvBRrWPrvTI3pnXhZEnRLLJb0Cro5s6_0 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13459503833173856587', time=2024-09-14T13:51:31.084156+0000, chain.objs.size()=1 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3D_0h-EhHtSVu7ARhAvomSIpfXfiemK_0 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6840224557248363272', time=2024-09-14T13:51:31.653256+0000, chain.objs.size()=1 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.V1yI18E8Nzc-wdMPz1Sjjm07mZlFd4R_0 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11437911937204547725', time=2024-09-14T13:51:32.327230+0000, chain.objs.size()=1 2024-09-14T12:09:52.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nd9glO7mm49M7zWiLnU5V9efNwx_XXQ_0 2024-09-14T12:09:52.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7365189858505722715', time=2024-09-14T13:51:33.122504+0000, chain.objs.size()=1 2024-09-14T12:09:52.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.37fQBGgKjWFKJtNDdUnq8tCfILswJuw_0 2024-09-14T12:09:52.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7313717407994831373', time=2024-09-14T13:51:34.074020+0000, chain.objs.size()=1 2024-09-14T12:09:52.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Lcuc6Y07ihL3VPp887l4NyYIhMmyBSk_0 2024-09-14T12:09:52.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14983807143140710335', time=2024-09-14T13:51:34.117809+0000, chain.objs.size()=1 2024-09-14T12:09:52.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gF7xj16EYhfaYLSS4SDaEHxIGj5xZ2j_0 2024-09-14T12:09:52.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.744+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7056167332903187606', time=2024-09-14T13:51:34.796298+0000, chain.objs.size()=1 2024-09-14T12:09:52.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.744+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.b5IMWf9DnW6VFsrCX3kJI7eoaS8gvVP_0 2024-09-14T12:09:52.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14936491007956816343', time=2024-09-14T13:51:35.523585+0000, chain.objs.size()=1 2024-09-14T12:09:52.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dTwUOyWc3LYSH7HrvSbXlq21SmFi7JL_0 2024-09-14T12:09:52.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7679759272551187553', time=2024-09-14T13:51:35.741569+0000, chain.objs.size()=1 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3RHK26KBND0NT6BYYrBBUBUzkChHusI_0 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9354948680943137646', time=2024-09-14T13:51:35.896955+0000, chain.objs.size()=1 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EQxt_vZuOefphYrVSvc97Zi1F4Gl2HO_0 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16943719789530437305', time=2024-09-14T13:51:35.946004+0000, chain.objs.size()=1 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.746+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3oVVw6cCLIj7cEYyHi4rfblpljO48Ru_0 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6807987895366301626', time=2024-09-14T13:51:36.147866+0000, chain.objs.size()=1 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dkiT71RYjVO06NgcxnhnIA-Ckalc4Ai_0 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3754507544629229459', time=2024-09-14T13:51:36.872554+0000, chain.objs.size()=1 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8_pcXRlY4ab3_fev12K47zTdpF_SFyH_0 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10492157816484005594', time=2024-09-14T13:51:37.460845+0000, chain.objs.size()=1 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VvXoN30SaFqWOnFW6QC_0IVsV_wrI56_0 2024-09-14T12:09:52.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18369349931214318591', time=2024-09-14T13:51:37.767207+0000, chain.objs.size()=1 2024-09-14T12:09:52.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GM-J4C9l-ngrhRrTSb7ol8WEUal1qF__0 2024-09-14T12:09:52.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.749+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16139881653547238209', time=2024-09-14T13:51:38.576136+0000, chain.objs.size()=1 2024-09-14T12:09:52.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.749+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lIe5pvqZfhDDXZjVyIgq9frHeYRPHDV_0 2024-09-14T12:09:52.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.749+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15711797760012257588', time=2024-09-14T13:51:38.577050+0000, chain.objs.size()=1 2024-09-14T12:09:52.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.749+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cqSCeqNEjJmBtTO7ip4yX5DH7hgFPnh_0 2024-09-14T12:09:52.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.749+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11858941757758601497', time=2024-09-14T13:51:39.175391+0000, chain.objs.size()=1 2024-09-14T12:09:52.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.749+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oOedYqVnm9Fzl0K1ocoDNAgICftawZ0_0 2024-09-14T12:09:52.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.750+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11069252611048405318', time=2024-09-14T13:51:39.713635+0000, chain.objs.size()=1 2024-09-14T12:09:52.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.750+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xuu3rHOG4lHrbT3Hyj9tK36aF01B5UV_0 2024-09-14T12:09:52.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.750+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3773781676878647470', time=2024-09-14T13:51:39.958035+0000, chain.objs.size()=1 2024-09-14T12:09:52.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.750+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TnbSI2OU8PHj9evPEB5caDgUa-4619x_0 2024-09-14T12:09:52.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.750+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12751539690975479065', time=2024-09-14T13:51:40.261179+0000, chain.objs.size()=1 2024-09-14T12:09:52.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.750+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kEbUp5P25F2mYcM3o3fGlXsI2LsSYNc_0 2024-09-14T12:09:52.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7756581771901054985', time=2024-09-14T13:51:40.262014+0000, chain.objs.size()=1 2024-09-14T12:09:52.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JwNJFNNL6k6f0cTWIVhOCCmQH5-Q3U-_0 2024-09-14T12:09:52.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15248912320249003087', time=2024-09-14T13:51:40.474641+0000, chain.objs.size()=1 2024-09-14T12:09:52.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LERP44UIktXdRHAkNlJ-9U5XhCmeCU1_0 2024-09-14T12:09:52.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1410524876901625216', time=2024-09-14T13:52:21.126975+0000, chain.objs.size()=1 2024-09-14T12:09:52.750 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2T5g5J8Kom84W3z1A8ycSAVzXM5nvVD_0 2024-09-14T12:09:52.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17203177540814592680', time=2024-09-14T13:52:21.238626+0000, chain.objs.size()=1 2024-09-14T12:09:52.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AJ71StRH_UHhBvPa1iDG-9xpOL6ABvi_0 2024-09-14T12:09:52.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7123545391550245806', time=2024-09-14T13:52:21.602353+0000, chain.objs.size()=1 2024-09-14T12:09:52.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.751+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ETY8xtClWc1-cOHDwMEaLi3nqtv9_hK_0 2024-09-14T12:09:52.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3101249533354066915', time=2024-09-14T13:52:21.815217+0000, chain.objs.size()=1 2024-09-14T12:09:52.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0smSULcaBLEgeEs3UTSJyrimlsuj__i_0 2024-09-14T12:09:52.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15754556089626945903', time=2024-09-14T13:52:22.108836+0000, chain.objs.size()=1 2024-09-14T12:09:52.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.c1nfaiXAsDAbTmCbtUtyZdearams8of_0 2024-09-14T12:09:52.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5740589575705816028', time=2024-09-14T13:52:22.145885+0000, chain.objs.size()=1 2024-09-14T12:09:52.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MK8am6bsaTZNm4J1u14R5gOJdeDFexf_0 2024-09-14T12:09:52.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.755+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2276066065359410450', time=2024-09-14T13:52:22.953355+0000, chain.objs.size()=1 2024-09-14T12:09:52.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.755+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.S7DZ0-rFpRn0sSSV0_o1ucllr-guiXP_0 2024-09-14T12:09:52.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.755+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18022668352330570682', time=2024-09-14T13:52:23.480570+0000, chain.objs.size()=1 2024-09-14T12:09:52.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.755+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Fduql5S41hYvz8MGo_ju4z_8OsavGgI_0 2024-09-14T12:09:52.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.755+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8811994011057422389', time=2024-09-14T13:52:24.518177+0000, chain.objs.size()=1 2024-09-14T12:09:52.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.755+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._jD29BPtqEs0Xq8Gq8T5w5uqqnEJKd-_0 2024-09-14T12:09:52.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8767786803689519551', time=2024-09-14T13:52:24.649008+0000, chain.objs.size()=1 2024-09-14T12:09:52.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7P6b1tZX3gsiNesJ9Ax__IteAvPMXw4_0 2024-09-14T12:09:52.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4726626380235351516', time=2024-09-14T13:52:25.273732+0000, chain.objs.size()=1 2024-09-14T12:09:52.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8MlyFV-d1-2cIm-fl6ZC4XoFMXwpqME_0 2024-09-14T12:09:52.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.366526304151078891', time=2024-09-14T13:52:26.452897+0000, chain.objs.size()=1 2024-09-14T12:09:52.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZwrogZQPe3YR6XzGiW32E3-M5wb0oyx_0 2024-09-14T12:09:52.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1789489370532208291', time=2024-09-14T13:52:26.708062+0000, chain.objs.size()=1 2024-09-14T12:09:52.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.td6mo81WYDB1xPgBduhQGHkCvPcd9fE_0 2024-09-14T12:09:52.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3707694154333902744', time=2024-09-14T13:52:27.174381+0000, chain.objs.size()=1 2024-09-14T12:09:52.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-7TAGvVbFqN_xqSTXpkiqH0PbRkiZVW_0 2024-09-14T12:09:52.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10300266015104025942', time=2024-09-14T13:52:27.397334+0000, chain.objs.size()=1 2024-09-14T12:09:52.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.759+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eFv7ECO8czsMx3NUSCqyY9iWzKu3E80_0 2024-09-14T12:09:52.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13052498945086636828', time=2024-09-14T13:52:27.484020+0000, chain.objs.size()=1 2024-09-14T12:09:52.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8GrHyf4IbIO_mQwiMyDJxpBp6A0_w18_0 2024-09-14T12:09:52.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12494700685496380811', time=2024-09-14T13:52:27.554035+0000, chain.objs.size()=1 2024-09-14T12:09:52.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bUTCmeN7KzXIU-stpVqxsuntKChoVCs_0 2024-09-14T12:09:52.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.762+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7305739375091434503', time=2024-09-14T13:52:27.638753+0000, chain.objs.size()=1 2024-09-14T12:09:52.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.762+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-mO-OeYOFFqySwls2ywm1q-b0m0iv9C_0 2024-09-14T12:09:52.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.762+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5823551235533565583', time=2024-09-14T13:52:27.789377+0000, chain.objs.size()=1 2024-09-14T12:09:52.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.762+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4HV8ibgyKJWfopFHj1avgYU7Zjggmth_0 2024-09-14T12:09:52.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.762+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11116047290172268238', time=2024-09-14T13:52:28.636278+0000, chain.objs.size()=1 2024-09-14T12:09:52.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.762+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0IpwfdGibjur9i_jUQp9Tlu4JYhHiMC_0 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12890833126684462716', time=2024-09-14T13:52:28.778957+0000, chain.objs.size()=1 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xrv2sifqeOM0lDQ6Ko-7f07unA08yij_0 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2383632295013832163', time=2024-09-14T13:52:29.157264+0000, chain.objs.size()=1 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sMoYBujhxWWvKMgKiZWvY897mki134c_0 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8352455386325356470', time=2024-09-14T13:52:29.157851+0000, chain.objs.size()=1 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.NLLObPSd4mPcgN93SQt9psv4GHT9He__0 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8360399495164097299', time=2024-09-14T13:52:29.571710+0000, chain.objs.size()=1 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tfPeXyP0PJjsJ9ixgqVvZ-iHo1oEpaB_0 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4647638300626052635', time=2024-09-14T13:52:30.004422+0000, chain.objs.size()=1 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0AiLK7g6k3C0DMYXkE6D9aw_5SXyvv4_0 2024-09-14T12:09:52.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18356754542554154354', time=2024-09-14T13:52:30.527386+0000, chain.objs.size()=1 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lXXzpiJ-LKpLnfJwADEvObQDTYpC940_0 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13568165311681880507', time=2024-09-14T13:52:30.644772+0000, chain.objs.size()=1 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.irnWMRoni_XsCc3CXLCE8siNrM--01x_0 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12571759154343524336', time=2024-09-14T13:52:30.796892+0000, chain.objs.size()=1 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5vwXYGqS6bLcY1TuIKNkxsGjoD_GFR2_0 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5540849008064724194', time=2024-09-14T13:52:31.619333+0000, chain.objs.size()=1 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3wn7-cjEoNgZQpuJcs0jBLdryrdzcsq_0 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7958545174311172507', time=2024-09-14T13:52:31.619996+0000, chain.objs.size()=1 2024-09-14T12:09:52.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.a7NqWJoNb1Fk_nwG6fxZouwqB16DHGN_0 2024-09-14T12:09:52.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.767+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11642152703715210317', time=2024-09-14T13:52:31.730146+0000, chain.objs.size()=1 2024-09-14T12:09:52.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.767+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QA5CrQTYY6-Y9D3I6siNaQJ0QDdOnOo_0 2024-09-14T12:09:52.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.767+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8575709537727917460', time=2024-09-14T13:52:32.110482+0000, chain.objs.size()=1 2024-09-14T12:09:52.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.767+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aZM5x2S6HVh0w-YbcBcHHKmYGqCbDTI_0 2024-09-14T12:09:52.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.768+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15555767171779165072', time=2024-09-14T13:52:32.156890+0000, chain.objs.size()=1 2024-09-14T12:09:52.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.768+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VexLV0Na5fLepm_MWi9YVvei8m4SlgJ_0 2024-09-14T12:09:52.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18030106988955152118', time=2024-09-14T13:53:30.393095+0000, chain.objs.size()=1 2024-09-14T12:09:52.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.430__shadow_.4iu0eBIAAoSiezse9OYtjOz0qR1z9Sd_0 2024-09-14T12:09:52.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6588481535984546084', time=2024-09-14T13:54:00.361455+0000, chain.objs.size()=1 2024-09-14T12:09:52.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.481__shadow_.lIAWATkjmeBPRMxnUmrDHkfLue0HTGT_0 2024-09-14T12:09:52.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.775+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48013 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5891768629700226080', time=2024-09-14T13:54:02.579966+0000, chain.objs.size()=1 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.sdhy__beLEgMzqU-WjHhNY0KvZFvw1g_0 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5085707701898010356', time=2024-09-14T13:54:17.968097+0000, chain.objs.size()=1 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.503__shadow:cl2ARxfpauRoDIjBPT2zPE7hlSXN4gW_.mVyB_4O5KFCXr9CJf6BJq8M6WMccC9-_0 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14124429253065898944', time=2024-09-14T13:56:03.773037+0000, chain.objs.size()=6 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.iaB5Md7LKRa-zScdY9yjfw1psXys8gr0.1 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.MWelRfhowB1k1v8veeEJNwzfUEJrzaa9.2 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.WjTvC_O2-U_jQ_y2djrE-hHwM2V9fYR9.3 2024-09-14T12:09:52.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.4MwDafinnPKr7wgADUfQIr48d6zLQpC5.4 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.ip4Z1b5LjVcK_ZGlDIAwaicuvslS-Wqt.5 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.778+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.lvhXtW9VxB9NIvkJNBaJ04BcweIsowpB.6 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7233663996360724222', time=2024-09-14T13:57:02.000536+0000, chain.objs.size()=1 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.537__shadow_.nnJzgNC6khyt774qehWUqqzKuxscZxs_0 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11261840915545340978', time=2024-09-14T13:58:04.380420+0000, chain.objs.size()=1 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.570__shadow:5fPe8iybjwDylw76Yj1xU437De9a1I8_.YZzcurZZ1vUR7YO0azZXLBNNzuUIpvl_0 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18442589654625706354', time=2024-09-14T13:58:04.659504+0000, chain.objs.size()=1 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.570__shadow:1U9z7xJSY2EZKIJPTNF1xCUBdWTybAu_.rKNTC0bcLlBMc6wAq34Tlq_PuEdeq5n_0 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18061383376682100319', time=2024-09-14T13:58:22.324155+0000, chain.objs.size()=1 2024-09-14T12:09:52.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:3CwhPQIr20E09g.mA-LhhQTK7J4L0cG_.mKtZUe5kJp461PhtJ-l2S-VNeIWPN0r_0 2024-09-14T12:09:52.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8129602156077400568', time=2024-09-14T13:58:35.434949+0000, chain.objs.size()=1 2024-09-14T12:09:52.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:qC.-Ig9xy3AEZdsyHEXPZXkeRU4sX2W_.UHbUuGDW6kZ4FntFCXeajjLbjm_HmJa_0 2024-09-14T12:09:52.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17484868261210013403', time=2024-09-14T13:59:03.383262+0000, chain.objs.size()=1 2024-09-14T12:09:52.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:-oL3qvmN-Upfx.S6c8Z6CNGX1hYcBev_.-9Ir0bavGf2rzXZ4PDHaZq4tmg-izt__0 2024-09-14T12:09:52.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6073229849579293058', time=2024-09-14T14:04:17.358859+0000, chain.objs.size()=1 2024-09-14T12:09:52.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.709__shadow_.xoBsCQyCqSk9nCW8tLnZokql2OBcMow_0 2024-09-14T12:09:52.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.786+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:52.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.793+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T12:09:52.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.794+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:52.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.795+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/153003' 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_PI_Bmg8VmciB6i6NSAuiopu1TXwhWCh', time=2024-09-14T13:46:49.508551+0000, chain.objs.size()=2 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.LY6Vd2-Fl2kcCSXFqsFcDd432NncPJ1_0 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.LY6Vd2-Fl2kcCSXFqsFcDd432NncPJ1_1 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~XPUQHsN3ryF9LNWF1aQtplK_MTGkTBP', time=2024-09-14T13:47:33.754695+0000, chain.objs.size()=1 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.202__multipart_mymultipart.2~XPUQHsN3ryF9LNWF1aQtplK_MTGkTBP.1 2024-09-14T12:09:52.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12309371158018569672', time=2024-09-14T13:49:10.185279+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.244__shadow_.0YCYtnS4XnCALqse1eq_AGUCUvtZFD2_0 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15495116542704113803', time=2024-09-14T13:49:20.834008+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.261__shadow_.EqhKUw9E9I1-mfxFu-qsXSVjji3QSwC_0 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14320296537349713822', time=2024-09-14T13:49:58.852648+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YfZixZLHGJc9mPRgFWQnZMa8gzl_4D7_0 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5262841723396533415', time=2024-09-14T13:49:59.939595+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.afIjmadyg3vBMDmOyhAlvUZOKy-wDCK_0 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11606944493916120027', time=2024-09-14T13:50:00.489310+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0Z4rWgel3qNf8mA_KDrMmVxsy_jweU3_0 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4251633500422362078', time=2024-09-14T13:50:01.424261+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Zl7wrLYMrSe66JKHdN82rg1s9FHfPd1_0 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7635238637492152559', time=2024-09-14T13:50:01.984452+0000, chain.objs.size()=1 2024-09-14T12:09:52.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1V8QNgVufmN4RumW4BLYFF0uatUXw67_0 2024-09-14T12:09:52.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6699001530104728342', time=2024-09-14T13:50:01.985739+0000, chain.objs.size()=1 2024-09-14T12:09:52.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CzaSibgcbLSuwlDc4RSY-G-IP9SdFEa_0 2024-09-14T12:09:52.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7426044966131407285', time=2024-09-14T13:50:02.235830+0000, chain.objs.size()=1 2024-09-14T12:09:52.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XzO1oQawahQyLkBMZsXZ9i4LnJFtGJA_0 2024-09-14T12:09:52.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10517038999401527323', time=2024-09-14T13:50:02.704472+0000, chain.objs.size()=1 2024-09-14T12:09:52.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hdKp0LjaNA7X75Pyi4sh_gamSdps5Xr_0 2024-09-14T12:09:52.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1300791548704934977', time=2024-09-14T13:50:06.245268+0000, chain.objs.size()=1 2024-09-14T12:09:52.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.L5eRXPhjppr5lvakV9AHLSJ1cp1NQiw_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13604957165625113335', time=2024-09-14T13:50:07.973327+0000, chain.objs.size()=1 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Zfsu0An99vj_tqN2OR2tkY91k7KwQz1_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7318169902289322383', time=2024-09-14T13:50:08.220432+0000, chain.objs.size()=1 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8tT-hBnGgSn5SU8uywCS6iE9S5orhM4_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16593611270226082125', time=2024-09-14T13:50:08.313375+0000, chain.objs.size()=1 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.bKiHEpnNqBz4aGSX-q9MLG3qpQI2Slj_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5189230396506724920', time=2024-09-14T13:50:08.617524+0000, chain.objs.size()=1 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VI00kBr-aOpLf_PjCTG8eyHn15CnrD-_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6670872007936773993', time=2024-09-14T13:50:08.635670+0000, chain.objs.size()=1 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._T0RZXolU1oupN57hK5tq7u4DGoqDcE_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13793787511834099045', time=2024-09-14T13:50:08.913720+0000, chain.objs.size()=1 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.I-EyeHdCzSjvo8fvlvN206wLSW7FPrt_0 2024-09-14T12:09:52.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10728571975218366740', time=2024-09-14T13:50:08.917541+0000, chain.objs.size()=1 2024-09-14T12:09:52.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8UA8PLzNg_uR5-U1KOZ2IosasowcMYv_0 2024-09-14T12:09:52.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.978687910642225220', time=2024-09-14T13:50:09.339815+0000, chain.objs.size()=1 2024-09-14T12:09:52.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2P56m25twIEpFVSC1TUp--Sx7x6lfgX_0 2024-09-14T12:09:52.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6566237874468542055', time=2024-09-14T13:50:09.340566+0000, chain.objs.size()=1 2024-09-14T12:09:52.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NWhjoawbYBoBD65nXUQoZbUuRUDqWwb_0 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14493462944386044641', time=2024-09-14T13:50:09.821715+0000, chain.objs.size()=1 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LS6LCxiNRR5_xy32rZbn7xJKdRl28hZ_0 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15044770074616639582', time=2024-09-14T13:50:12.249716+0000, chain.objs.size()=1 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.266__shadow_.PDYBSdKdy_uDodHknPv56VuwscqkG9q_0 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7465300782637046806', time=2024-09-14T13:50:19.516451+0000, chain.objs.size()=1 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.278__shadow_.LmCkCnWSnhL63wicOYOtvT3kIjcd5jW_0 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9425209866323539056', time=2024-09-14T13:50:29.747734+0000, chain.objs.size()=1 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.aPA0V8yPycWoWNGO7eKqQ446gxTlRBM_0 2024-09-14T12:09:52.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16837111265620587249', time=2024-09-14T13:50:32.402502+0000, chain.objs.size()=1 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.294__shadow_.G5F9gdT0l3f9Yp6saiTJU2ro-9iuD9Y_0 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15240455981012177274', time=2024-09-14T13:50:35.029940+0000, chain.objs.size()=1 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.298__shadow_.9MUqrTmt8Jw1cjTFHtSUQUgNZDSHJxe_0 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9212664732740608101', time=2024-09-14T13:50:37.050104+0000, chain.objs.size()=1 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.301__shadow_.NYZV0081Qi6R3o9wH14QC_np-P9o7Uh_0 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9694621986588119837', time=2024-09-14T13:50:40.453302+0000, chain.objs.size()=1 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.306__shadow_.a-veS6jmW4ELZf8dJGzYG2DETNt0TLa_0 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4082241847275024122', time=2024-09-14T13:50:41.558422+0000, chain.objs.size()=1 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.307__shadow:PA-jrmxQu4piA2vNvl55vzXtR9kSY55_.AtfpMrO48k5WCOTckaL9n7ujp0LQXOG_0 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14144663025957813571', time=2024-09-14T13:50:41.558928+0000, chain.objs.size()=1 2024-09-14T12:09:52.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.307__shadow:fClTUtpCTYYikVt16Cw6nSotwyOeWp1_.d9sWR6gizYkAMTFv_g5-oZjNW6pvLqb_0 2024-09-14T12:09:52.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14540141763712967758', time=2024-09-14T13:50:49.410391+0000, chain.objs.size()=1 2024-09-14T12:09:52.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.319__shadow:BONyYBTup7vXMgDu.r670dAXsAGxo7C_.N_6xfd-hjxJjE4jezBw8JyfmEN1WonV_0 2024-09-14T12:09:52.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.814+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.138488071499064167', time=2024-09-14T13:51:30.660454+0000, chain.objs.size()=1 2024-09-14T12:09:52.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.814+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZwRmuPqhDWHbocMrbhwTgY8OR1VzQoP_0 2024-09-14T12:09:52.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.814+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7616918328306487181', time=2024-09-14T13:51:31.251682+0000, chain.objs.size()=1 2024-09-14T12:09:52.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.814+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QJ3SQQvG9VC0sQHxL6XJoyzKlJnFCOb_0 2024-09-14T12:09:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10831592105328552079', time=2024-09-14T13:51:31.305092+0000, chain.objs.size()=1 2024-09-14T12:09:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7rtQwnSDDWUs6q2ZnDQilKZYB28t9hn_0 2024-09-14T12:09:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5089447515954632909', time=2024-09-14T13:51:31.585669+0000, chain.objs.size()=1 2024-09-14T12:09:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.i2bj4er6_a6lNqMb7AFWejbmarDRCdo_0 2024-09-14T12:09:52.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12429524278673879907', time=2024-09-14T13:51:31.688659+0000, chain.objs.size()=1 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ulwBfJawkuZH2Hr1kqDH7tEKGWF7Gov_0 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13238246988190230872', time=2024-09-14T13:51:32.575189+0000, chain.objs.size()=1 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lGPr1o6rOyiUCyNmWyjSZErfZDp0d5D_0 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12472373700962783576', time=2024-09-14T13:51:32.893727+0000, chain.objs.size()=1 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.g1UNUvNPnFlOmo3qWRd5tE-S-c84x0D_0 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12685705285719144443', time=2024-09-14T13:51:32.945358+0000, chain.objs.size()=1 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.aZuDs9btzDbU4OfVk8Zw01HjZSa0RWN_0 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13327930515563830894', time=2024-09-14T13:51:33.040315+0000, chain.objs.size()=1 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9JQY0YohQmcY8cCAanjFuLPIW3h0TMC_0 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3240555546973220593', time=2024-09-14T13:51:33.333516+0000, chain.objs.size()=1 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ObKgVJTU2ksuQiRyjjjmOrM98gdhxpK_0 2024-09-14T12:09:52.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9490735151774650240', time=2024-09-14T13:51:33.839237+0000, chain.objs.size()=1 2024-09-14T12:09:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.817+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.C7moMGz_xKiEyagXRPv3wWiTcpXxlK8_0 2024-09-14T12:09:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4025801246808317445', time=2024-09-14T13:51:34.659034+0000, chain.objs.size()=1 2024-09-14T12:09:52.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.n5TrPsySEcAsyH-pp-_G6xdOU1-QAhR_0 2024-09-14T12:09:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12025037500225488783', time=2024-09-14T13:51:35.686208+0000, chain.objs.size()=1 2024-09-14T12:09:52.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3uZpXvtOjrQdM18aZcK2IsYA6Ddbeq1_0 2024-09-14T12:09:52.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.823+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1761008712712667559', time=2024-09-14T13:51:35.731281+0000, chain.objs.size()=1 2024-09-14T12:09:52.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.823+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3OzHUA_jm08KMdodd_h8XTVrtCJdaI5_0 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3373213281444546755', time=2024-09-14T13:51:35.749582+0000, chain.objs.size()=1 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gPMZYSdZFrI1M8O2SGlFC0kctKpSFr5_0 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11478713988396455330', time=2024-09-14T13:51:36.220268+0000, chain.objs.size()=1 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZNB8SbXn986rN-NWCUlWNxociSR8OIw_0 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17540048620363297077', time=2024-09-14T13:51:36.248463+0000, chain.objs.size()=1 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.c0smcok_AzhPxvFllVIZ5oQ-wu_ENtO_0 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7619023308250652229', time=2024-09-14T13:51:36.852666+0000, chain.objs.size()=1 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Qxkl-YVpAevZoQ0o2WzLCQVR1OVsvVN_0 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.867484397192825792', time=2024-09-14T13:51:37.008116+0000, chain.objs.size()=1 2024-09-14T12:09:52.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-W8eB24aQ8Z3GbeP-kSHqXU_v6E69ou_0 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8072917382661687338', time=2024-09-14T13:51:37.134855+0000, chain.objs.size()=1 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Dvr_7TSZ0jwUHASbeIu5DgoQe_tiMi__0 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11572856274323367763', time=2024-09-14T13:51:37.416976+0000, chain.objs.size()=1 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Fy83f-QKoEMxdl9ZSZD4LuFO6uW7wgj_0 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2993462701715593971', time=2024-09-14T13:51:37.561501+0000, chain.objs.size()=1 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9Xy2NzAVnGlhHVqwXuQsNAIM9Hz8eY1_0 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8102686770535643765', time=2024-09-14T13:51:37.634460+0000, chain.objs.size()=1 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BHBwuYR5faJI8JA7mPMx1FTTfs9dXWL_0 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18210692028649344678', time=2024-09-14T13:51:37.634911+0000, chain.objs.size()=1 2024-09-14T12:09:52.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RvXHkSfTWS6AntkseqAuWiIya1-KOO4_0 2024-09-14T12:09:52.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.830+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16614809906481578258', time=2024-09-14T13:51:37.836230+0000, chain.objs.size()=1 2024-09-14T12:09:52.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.830+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gbv6WrOyLFUx4FbJ3SKQw65pDo3rV64_0 2024-09-14T12:09:52.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.830+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10684833642361903269', time=2024-09-14T13:51:37.881301+0000, chain.objs.size()=1 2024-09-14T12:09:52.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.830+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DnpfKBUMVpuoA6cIrgJnOOfbD75AO4R_0 2024-09-14T12:09:52.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.830+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5488169271454080376', time=2024-09-14T13:51:38.473120+0000, chain.objs.size()=1 2024-09-14T12:09:52.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.830+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PqcV0ypYYWkA8voYmkaZzoMuGHY69V5_0 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12115522161233132685', time=2024-09-14T13:51:38.579906+0000, chain.objs.size()=1 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QQWCGEFZYNy2FknIV2HODPLzeXcnz5D_0 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8292146843335016254', time=2024-09-14T13:51:38.725417+0000, chain.objs.size()=1 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2wNscKEvlRXBgznXBt6L6gK9g2sfBS7_0 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5091153370054571577', time=2024-09-14T13:51:39.015778+0000, chain.objs.size()=1 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Sk-MoCkz73l-NERQSQ4M6qna9SKicfg_0 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12948259320336640514', time=2024-09-14T13:51:39.641849+0000, chain.objs.size()=1 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xrZ4Kmr5QhSWW4Rpket9cuhWg5F7Vfm_0 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8567582401720568347', time=2024-09-14T13:51:39.798531+0000, chain.objs.size()=1 2024-09-14T12:09:52.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OMHUFFpWJpbAPZQaYGI_dX5n4ugJ9aO_0 2024-09-14T12:09:52.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2268947101357295300', time=2024-09-14T13:51:40.204613+0000, chain.objs.size()=1 2024-09-14T12:09:52.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-x1TSlhtaQEpXURrpKzt7mO65jgwlJL_0 2024-09-14T12:09:52.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10523904584120193909', time=2024-09-14T13:51:40.437881+0000, chain.objs.size()=1 2024-09-14T12:09:52.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Xs8IuFpAW1OHuLKpjybLYcl8MehNFL2_0 2024-09-14T12:09:52.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7400868297889021409', time=2024-09-14T13:51:40.573397+0000, chain.objs.size()=1 2024-09-14T12:09:52.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YTtm3V7vRRIzsJWMsBadt3bgqhg00S0_0 2024-09-14T12:09:52.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.834+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9771307864106651056', time=2024-09-14T13:51:41.215809+0000, chain.objs.size()=1 2024-09-14T12:09:52.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.834+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wbvC7k64weTEnjsUVuNhKmugeZvMfQD_0 2024-09-14T12:09:52.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.834+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.900377784040969333', time=2024-09-14T13:51:41.216496+0000, chain.objs.size()=1 2024-09-14T12:09:52.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.834+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nM62BK5iGA0DSZNdBmZVde3_ZX5Boes_0 2024-09-14T12:09:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.836+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14480727504336320750', time=2024-09-14T13:52:21.311965+0000, chain.objs.size()=1 2024-09-14T12:09:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.836+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Q6-As0WX_CuStOBPHq01NnVCS1Zf3Qq_0 2024-09-14T12:09:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.836+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6136634383842912362', time=2024-09-14T13:52:21.380539+0000, chain.objs.size()=1 2024-09-14T12:09:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.836+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.1dmofTdbvv4uFbmp3jg5lfsqeunqh0I_0 2024-09-14T12:09:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.836+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15117001033312668354', time=2024-09-14T13:52:21.552838+0000, chain.objs.size()=1 2024-09-14T12:09:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.836+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nEUAg_2apa9QM6FL0V1d6ajbDuTiMSm_0 2024-09-14T12:09:52.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.838+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1189382313302123155', time=2024-09-14T13:52:21.575952+0000, chain.objs.size()=1 2024-09-14T12:09:52.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.838+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ORorVOc_jV7kxN8we0Oa7UmMXIXDrC-_0 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.838+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6067539057131007799', time=2024-09-14T13:52:21.576524+0000, chain.objs.size()=1 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.838+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aVSe0d7ztbzjs7WhzM8k3t6xetj4Oyu_0 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11750743894533390741', time=2024-09-14T13:52:21.699616+0000, chain.objs.size()=1 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.meMcO6BXhg2ySotj7dY4gYEzV0CY-V6_0 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18240688430943721800', time=2024-09-14T13:52:22.815145+0000, chain.objs.size()=1 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.75YAwfwt15GabFAEGzC8veXm6Z0C-Ui_0 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3826377521384078037', time=2024-09-14T13:52:23.287645+0000, chain.objs.size()=1 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bts9YYQp9XEKq2MZW0_UKa-3TqXnNa-_0 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16877424601544370220', time=2024-09-14T13:52:23.450572+0000, chain.objs.size()=1 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.17o6xXHhDCrUc4iV_XiczA8CawoheYU_0 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1540886911913555400', time=2024-09-14T13:52:23.593866+0000, chain.objs.size()=1 2024-09-14T12:09:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.89REwKnZBj8ZI8IratC4SH2iQuPRnis_0 2024-09-14T12:09:52.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13423014098184370417', time=2024-09-14T13:52:24.896298+0000, chain.objs.size()=1 2024-09-14T12:09:52.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.839+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5NGlb0xN-okPwUhTcAJ2pEJTj7YW8KW_0 2024-09-14T12:09:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.841+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12715642264528469796', time=2024-09-14T13:52:25.280795+0000, chain.objs.size()=1 2024-09-14T12:09:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.841+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.E4cbrTxmZgELfSnUxWFLjp5mx64RGVq_0 2024-09-14T12:09:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3592760825589989931', time=2024-09-14T13:52:25.718954+0000, chain.objs.size()=1 2024-09-14T12:09:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.O-e5TdMOPUTY76g66Vc9vIVmAcZw3JW_0 2024-09-14T12:09:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12995357028954442164', time=2024-09-14T13:52:25.720277+0000, chain.objs.size()=1 2024-09-14T12:09:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Hnas7wDNqsPTP-ER_MZoMB5bCOqEy4v_0 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4670459577486434139', time=2024-09-14T13:52:26.155824+0000, chain.objs.size()=1 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.twS3aZKIonlOvTX70hsokfSap0AG6vi_0 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15239088233678576638', time=2024-09-14T13:52:26.195540+0000, chain.objs.size()=1 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.la6Ip9KnHvwvi1hX9tAYQh5AFoIZSmb_0 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11131467530993499883', time=2024-09-14T13:52:26.225330+0000, chain.objs.size()=1 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.v5xG3Y14rwnaNVcgweFy5OfSZa-V_Dl_0 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9486657873054325102', time=2024-09-14T13:52:26.532614+0000, chain.objs.size()=1 2024-09-14T12:09:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6zHE-bJYYRWY6AO9R6Il39VuGtI8g3K_0 2024-09-14T12:09:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7613021967909342287', time=2024-09-14T13:52:27.203455+0000, chain.objs.size()=1 2024-09-14T12:09:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.844+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rYJhv05Z3LswXbPSRFLXGPCH4n1tolv_0 2024-09-14T12:09:52.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.845+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8879905083611949707', time=2024-09-14T13:52:27.422337+0000, chain.objs.size()=1 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.845+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jf2axPJqjLQjGD_w1xBhHVuO0vc1jIX_0 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.845+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1515255050885133026', time=2024-09-14T13:52:27.475960+0000, chain.objs.size()=1 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.845+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.d3GVZRBUGCML1QbgtguB0n1iLEXXIBC_0 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.845+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.711697664078672785', time=2024-09-14T13:52:27.821978+0000, chain.objs.size()=1 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.845+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ubiDCCTx5gROIrNmde3VfhTkDYImB_j_0 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.846+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10569714028691178165', time=2024-09-14T13:52:28.077308+0000, chain.objs.size()=1 2024-09-14T12:09:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.846+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yfbQrccsm77oZyyHjx9NpLQVZ04tYXR_0 2024-09-14T12:09:52.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.847+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5819802346140028652', time=2024-09-14T13:52:28.231015+0000, chain.objs.size()=1 2024-09-14T12:09:52.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.847+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6N3Y2uZXX9GDQ1FwD4pCXy0dUGDzPIa_0 2024-09-14T12:09:52.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.847+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7946087786177618503', time=2024-09-14T13:52:28.846479+0000, chain.objs.size()=1 2024-09-14T12:09:52.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.847+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.g3zKhyUCJIg1CHyhHCw3Sl5HlzZtRkY_0 2024-09-14T12:09:52.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10415703974241920572', time=2024-09-14T13:52:28.945595+0000, chain.objs.size()=1 2024-09-14T12:09:52.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JjqwOKs_Oy_ftkAgMEhzDsom4wftTN__0 2024-09-14T12:09:52.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11860104680793979093', time=2024-09-14T13:52:28.960004+0000, chain.objs.size()=1 2024-09-14T12:09:52.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2xSDH9md34cOj7zjGEBN5Q0nVg7CwXp_0 2024-09-14T12:09:52.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.862093711490362730', time=2024-09-14T13:52:29.156311+0000, chain.objs.size()=1 2024-09-14T12:09:52.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.X0x-TB9-5ObwLgRyBhdrsmREjctGQbv_0 2024-09-14T12:09:52.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9289822721053794971', time=2024-09-14T13:52:30.223136+0000, chain.objs.size()=1 2024-09-14T12:09:52.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bkgARQd1t6wejZ4eCGEbsae0JMYcNob_0 2024-09-14T12:09:52.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2017207921971771723', time=2024-09-14T13:52:30.257573+0000, chain.objs.size()=1 2024-09-14T12:09:52.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.849+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.n1PenybMg14DdyA56aqxsluS8qE9rHh_0 2024-09-14T12:09:52.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.853+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/153003 2024-09-14T12:09:52.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T12:09:52.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.936626457809588541', time=2024-09-14T13:52:30.943190+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.R0q4okPXvbx-1bqc6Oia0etPSmDU7iD_0 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5244705240249644837', time=2024-09-14T13:52:54.869583+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.370__shadow_.gOC6q84hQk12RxUxnpoqap3BG2IH9_0_0 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6389456597099444676', time=2024-09-14T13:53:18.772438+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.408__shadow_.SlaRsBCHlr87_fjrX4avuZYdUoaFX9b_0 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12994928209621468959', time=2024-09-14T13:53:47.403225+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.457__shadow_.MKcXLWr1jJpFDFuHNqJTQeo3yyEN3fI_0 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12763008724237979390', time=2024-09-14T13:53:53.431394+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.464__shadow_.BBuneiwcGpixZ4nBopcCnlRGMkL_kKc_0 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6922025426508685060', time=2024-09-14T13:53:55.203719+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.466__shadow_.-f2QIAQl1yzPjjYJ3M3qkHOFXFB7-M9_0 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13596969252072132212', time=2024-09-14T13:54:03.272353+0000, chain.objs.size()=1 2024-09-14T12:09:52.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.484__shadow_.8GxZFB-QezAeOB_PEmWOro2-kDTnM7E_0 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3985299822057358469', time=2024-09-14T13:54:07.074181+0000, chain.objs.size()=1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.486__shadow_.d7V8m8q8TMx-B1gNsA40iT-gwP5PFJ4_0 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13270207829409110104', time=2024-09-14T13:54:30.221323+0000, chain.objs.size()=1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.513__multipart_mymultipart.2~lXYWIEfIechdtr-2GOlSy6JEicWgHc0.1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.655563170474070793', time=2024-09-14T13:54:37.467839+0000, chain.objs.size()=1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.518__multipart_mymultipart.2~tJPyo7Qm_5oAOqbFfUYo9AO-mtqDuNg.1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4997851963700087148', time=2024-09-14T13:57:29.668139+0000, chain.objs.size()=1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.555__shadow_.6QZ_-UKzvQm9uhoBxU79OZfqNi0CUO7_0 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.430413613696569831', time=2024-09-14T13:57:38.887082+0000, chain.objs.size()=1 2024-09-14T12:09:52.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.855+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.558__shadow_.IGhf6i528UD8suxR0ejr8GPq1frX5GS_0 2024-09-14T12:09:52.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.858+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10334365867706732107', time=2024-09-14T13:57:42.016362+0000, chain.objs.size()=1 2024-09-14T12:09:52.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.858+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.561__multipart_mymultipart.2~0pbaLXnqzVdjythKZYbRP1VDn3nR9Jq.1 2024-09-14T12:09:52.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.858+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3997423280312955526', time=2024-09-14T13:57:43.043366+0000, chain.objs.size()=1 2024-09-14T12:09:52.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.858+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.562__shadow_.EGdCMC38lIWU4-ymWOU_Zq9qLMezLAf_0 2024-09-14T12:09:52.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.859+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15770759730023480554', time=2024-09-14T14:05:02.500889+0000, chain.objs.size()=1 2024-09-14T12:09:52.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.859+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.742__multipart_mymultipart3.2~isCJMRWQofuenyTvVUlPWL5F8JqFPnz.1 2024-09-14T12:09:52.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.860+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~gN1w7MHXKZw7gtOKG1yr0RxU-RJk_w4', time=2024-09-14T14:05:02.564791+0000, chain.objs.size()=1 2024-09-14T12:09:52.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.860+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.742__multipart_mymultipart.2~gN1w7MHXKZw7gtOKG1yr0RxU-RJk_w4.1 2024-09-14T12:09:52.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.860+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2045034801195868882', time=2024-09-14T14:06:33.029040+0000, chain.objs.size()=1 2024-09-14T12:09:52.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.860+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.763__shadow_.gQ2zP9TTY5mIgGx2dcI3bEmkeNZr5ez_0 2024-09-14T12:09:52.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.860+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17615866813208745946', time=2024-09-14T14:07:04.811132+0000, chain.objs.size()=1 2024-09-14T12:09:52.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.860+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.774__shadow_.IXW-DbV8HMNgD1_yT8u9kB7NrW6kv1r_0 2024-09-14T12:09:52.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.863+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:52.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.867+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T12:09:52.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.868+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:52.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.868+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46249' 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_OpnjVgsX6dUgo3wK2p4P1rB8gTaYVtp', time=2024-09-14T13:46:49.876457+0000, chain.objs.size()=2 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.5DTBSYhqD4waEabw632W2E_AXuJsTTm_0 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.5DTBSYhqD4waEabw632W2E_AXuJsTTm_1 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12944840134540169026', time=2024-09-14T13:47:16.738738+0000, chain.objs.size()=1 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.183__shadow_.5cVPTjMKUtFFR9V3QuA1KFC7JIzX0BY_0 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~yAq2FKN8PIHrSC7ZBghISInrWz-MScE', time=2024-09-14T13:47:32.400582+0000, chain.objs.size()=1 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.201__multipart_mymultipart.2~yAq2FKN8PIHrSC7ZBghISInrWz-MScE.1 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16431628450692038871', time=2024-09-14T13:49:12.103689+0000, chain.objs.size()=1 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.247__shadow_.kcYBxW7rHgr7NOBWbd7S5YDm9OgXHko_0 2024-09-14T12:09:52.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2793990305341087771', time=2024-09-14T13:49:13.975841+0000, chain.objs.size()=1 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.250__shadow_.661UAg2t_ue1rvHNN7b5kZJs8l-Jl3x_0 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14617882104756497808', time=2024-09-14T13:49:14.615610+0000, chain.objs.size()=1 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.251__shadow_.JUScC1TWZgxDdS9WhEE7E7rpe5D2dtz_0 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2828440005095125325', time=2024-09-14T13:49:58.852368+0000, chain.objs.size()=1 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MSoLKepmgO4AzYcJ2cEYZmLqOD7sFwk_0 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.294945632214757114', time=2024-09-14T13:49:59.074724+0000, chain.objs.size()=1 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yJJ2YB_rgjAldLWeEpybXO_rbNI_Cp9_0 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4367525653758599367', time=2024-09-14T13:49:59.343141+0000, chain.objs.size()=1 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.o8st8_UZIY_OhjTcszVtZDxwPzdk2lN_0 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13534829780260436090', time=2024-09-14T13:49:59.474151+0000, chain.objs.size()=1 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ruIPHcKcMrY6Wmz62jtvGK8L87yCNGE_0 2024-09-14T12:09:52.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.866226475179892029', time=2024-09-14T13:49:59.634376+0000, chain.objs.size()=1 2024-09-14T12:09:52.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.869+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TFgsIZNiwbx-fEEjrcG6yxk_Eb3G1IT_0 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5710700982229197218', time=2024-09-14T13:50:00.627410+0000, chain.objs.size()=1 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.iMf7hO_ijQWMiWipWwTv_RjldQSlPJB_0 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1743219145379008831', time=2024-09-14T13:50:00.873569+0000, chain.objs.size()=1 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GXw4uPbrSjN5xLR_9SLlbvEQfdDbIWO_0 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16386074833555036405', time=2024-09-14T13:50:01.057322+0000, chain.objs.size()=1 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l_PYrR0YgnNtdwuVztOBe7qeotxTpRi_0 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5962496516321591615', time=2024-09-14T13:50:01.058111+0000, chain.objs.size()=1 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DumSrD4yN0SfPOZ5dFHXb5DIrVfuL1Q_0 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11531814364510846876', time=2024-09-14T13:50:01.423914+0000, chain.objs.size()=1 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9Q3oKVllFSQQJq3coBV6idJqqAzaNGe_0 2024-09-14T12:09:52.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4633693991768742407', time=2024-09-14T13:50:01.979795+0000, chain.objs.size()=1 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yTX5IOhQuAY_GrQRZd70Q_034nTTdvh_0 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15663171215756858060', time=2024-09-14T13:50:01.980351+0000, chain.objs.size()=1 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yEfznKJP_yv0Mw7hhdfRaolrYUkTWjL_0 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16158070593687692218', time=2024-09-14T13:50:02.109911+0000, chain.objs.size()=1 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.si_BJUgB_7ImovoqtbKsZNyQHlVZpM2_0 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13741551023611988945', time=2024-09-14T13:50:02.249265+0000, chain.objs.size()=1 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._AgL07jdVM1jpFxEhF_p1uTV8_HRon6_0 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.721105000268671889', time=2024-09-14T13:50:02.533717+0000, chain.objs.size()=1 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yewKdiFLfoZZqKAtm-gyQtJJSkWhXNb_0 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14878298923300545654', time=2024-09-14T13:50:02.605124+0000, chain.objs.size()=1 2024-09-14T12:09:52.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fbh9-bYMeqBItnR9QXCHj9S1aXHreb1_0 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8954964805067353994', time=2024-09-14T13:50:02.778157+0000, chain.objs.size()=1 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aQxE-UfNyvRgtOSPFT8F3qB2yHRmLTH_0 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14222164202023376658', time=2024-09-14T13:50:03.711716+0000, chain.objs.size()=1 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yUWv1QMZRwwkJso8InYBsdUxN8GW4UR_0 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7640688244164544582', time=2024-09-14T13:50:03.712704+0000, chain.objs.size()=1 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Pr5NPv2HY8wM_5aBdlWfdEaqcho9aC__0 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9390051693285020472', time=2024-09-14T13:50:03.744515+0000, chain.objs.size()=1 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9DsOlGZ0YD4TOlqqYVxIBqPGv_uTnes_0 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11815436321326265876', time=2024-09-14T13:50:03.745221+0000, chain.objs.size()=1 2024-09-14T12:09:52.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5OFwNPwoyuRo36KbrbvIvXPKpSdOm5s_0 2024-09-14T12:09:52.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9076894548552547865', time=2024-09-14T13:50:04.373397+0000, chain.objs.size()=1 2024-09-14T12:09:52.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.z2kN6SFnGWBYryN1JioZ21iTq_YEmef_0 2024-09-14T12:09:52.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4826722256831001436', time=2024-09-14T13:50:04.848092+0000, chain.objs.size()=1 2024-09-14T12:09:52.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-aS-kBQ9R0hvTnjsJy1WbFAa5ZNqkYm_0 2024-09-14T12:09:52.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4182485710274390725', time=2024-09-14T13:50:05.283179+0000, chain.objs.size()=1 2024-09-14T12:09:52.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.E4TTlFH_3a3X4bC3mG8sUl1za7mrwkv_0 2024-09-14T12:09:52.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.883+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5955411929506728089', time=2024-09-14T13:50:05.332361+0000, chain.objs.size()=1 2024-09-14T12:09:52.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.883+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.I9ST79TdTVEFtnWppQJijd8vbgfDrXg_0 2024-09-14T12:09:52.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.883+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3100896877272159808', time=2024-09-14T13:50:06.679389+0000, chain.objs.size()=1 2024-09-14T12:09:52.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.883+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6NcIoW_8lZzh3nEzYvGa9Af1j53bRZe_0 2024-09-14T12:09:52.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.883+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12805219634512159863', time=2024-09-14T13:50:07.026822+0000, chain.objs.size()=1 2024-09-14T12:09:52.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.883+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.F5jjQ1eifmpeB_2dnPsJd_J-9my4aqI_0 2024-09-14T12:09:52.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.885+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13014476403731215183', time=2024-09-14T13:50:07.099267+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.885+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._WW_glrWPs6QoS9jK5U6LZAlL-Jkd3m_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4549985403365866338', time=2024-09-14T13:50:07.706435+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kpmg5KjxmyvO1Xr7rR8C-_1MlbjXwHo_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10196842848551306116', time=2024-09-14T13:50:07.773357+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eFEcclVvrjVkzqoA-3hWwAGgeq5BB5V_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15991595735785799606', time=2024-09-14T13:50:08.099608+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wzMq1OR7oDMj4PZqWSEhLhThTdUZ4qz_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16366192069612181434', time=2024-09-14T13:50:09.536983+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Tgv7jsPUfLHSCrlog6Xosc5rlMGy_pw_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3206956070566082046', time=2024-09-14T13:50:20.128860+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.279__shadow_.13yV3EJTiXOazyt2E6FBDdcs9wl-h2o_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8424805980124138225', time=2024-09-14T13:50:29.750438+0000, chain.objs.size()=1 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.I7cPRagrjgAzA6dbcCv9doYrO3vRJiA_0 2024-09-14T12:09:52.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8890661312081555301', time=2024-09-14T13:50:31.782304+0000, chain.objs.size()=1 2024-09-14T12:09:52.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.886+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.0X6jA-lccDvYG-lvw4-fi24yazJAbTq_0 2024-09-14T12:09:52.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.888+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3784854779777612285', time=2024-09-14T13:50:40.452789+0000, chain.objs.size()=1 2024-09-14T12:09:52.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.888+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.306__shadow_.tCVjqy3uXLhSFdbf4gaXWLesE7IKbxO_0 2024-09-14T12:09:52.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.888+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2374423703548290462', time=2024-09-14T13:51:31.083597+0000, chain.objs.size()=1 2024-09-14T12:09:52.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.888+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vtP0HEchXubeKeNIg3_s6mfMvndlP-4_0 2024-09-14T12:09:52.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.888+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.740026976803771536', time=2024-09-14T13:51:33.181991+0000, chain.objs.size()=1 2024-09-14T12:09:52.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.888+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oiNksfFMp5bCbFgNOigGVs7-wmrNf1-_0 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4832396822765863827', time=2024-09-14T13:51:33.837830+0000, chain.objs.size()=1 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wxcbuXAtfELQP_554G_0Hy-LoTN5bRs_0 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2583545858848933124', time=2024-09-14T13:51:34.303776+0000, chain.objs.size()=1 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DQo2y29xpOmvHrvLM3ViIAxTXip7Pu-_0 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5261096469105766750', time=2024-09-14T13:51:34.305045+0000, chain.objs.size()=1 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tKo2CWCOAJ4hemGX3NJkVB9onsRiC_8_0 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4133048312797897039', time=2024-09-14T13:51:34.389459+0000, chain.objs.size()=1 2024-09-14T12:09:52.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.891+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vaqvcmV2s7Nk-nez3uvdo-BWHOWkYDW_0 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12463319267817260480', time=2024-09-14T13:51:35.880481+0000, chain.objs.size()=1 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.SaVVsY9OAjfwT1gfohJtj53ngcnMqrv_0 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18241895244593357810', time=2024-09-14T13:51:35.881195+0000, chain.objs.size()=1 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pwLZKjZTIv0mJSjz6Y6Djtt05MYz4BA_0 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9554155264006555606', time=2024-09-14T13:51:35.894651+0000, chain.objs.size()=1 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tSFh_O1U2y4a0DJrk8OcFLtf-4wDANw_0 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16013454019755494167', time=2024-09-14T13:51:35.920892+0000, chain.objs.size()=1 2024-09-14T12:09:52.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.892+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WbywylMJia80F39NIyh55k4LwxhLaBT_0 2024-09-14T12:09:52.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.894+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5834144191691230040', time=2024-09-14T13:51:36.041153+0000, chain.objs.size()=1 2024-09-14T12:09:52.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.894+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zzrdHVvtCgs3kxiVT6zqI0k594S7RKo_0 2024-09-14T12:09:52.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.894+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10402050920133565275', time=2024-09-14T13:51:36.151751+0000, chain.objs.size()=1 2024-09-14T12:09:52.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.894+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uPvljWqTqhqi4nstPBMr2PwbteD9IZS_0 2024-09-14T12:09:52.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.894+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18324502603353853260', time=2024-09-14T13:51:36.373828+0000, chain.objs.size()=1 2024-09-14T12:09:52.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.894+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S_HoRAK7f6wK6tYlm-Jtt1c_ZeDfkRj_0 2024-09-14T12:09:52.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8239972385663491059', time=2024-09-14T13:51:36.374409+0000, chain.objs.size()=1 2024-09-14T12:09:52.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qV0ZZJJHlAAfkd39eaQZgAv20UHOlal_0 2024-09-14T12:09:52.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.896+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10392380448565559628', time=2024-09-14T13:51:37.007056+0000, chain.objs.size()=1 2024-09-14T12:09:52.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.896+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9QZE9aIZ2jOkLaENbgeStuUVLUrbhw__0 2024-09-14T12:09:52.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.896+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18420243617468106909', time=2024-09-14T13:51:37.144948+0000, chain.objs.size()=1 2024-09-14T12:09:52.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.896+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vpuEg4JiG2U5AYcj-cRdERBwWphaOhp_0 2024-09-14T12:09:52.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.896+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6796302600218148777', time=2024-09-14T13:51:37.421085+0000, chain.objs.size()=1 2024-09-14T12:09:52.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.896+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.P_A-s5zuRabErCBzPMEojTPP_T3wErQ_0 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12166479245995277663', time=2024-09-14T13:51:37.458814+0000, chain.objs.size()=1 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nH3s_EYVw7jyT6WUxVuNT6NBJqK_H2e_0 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2143229233645288188', time=2024-09-14T13:51:37.898014+0000, chain.objs.size()=1 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UpLLoqdWOMlsIN9ClMpWKlO8i3PCr8a_0 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9441933622739822107', time=2024-09-14T13:51:38.305122+0000, chain.objs.size()=1 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6avjNnj1tWCW_7v4w_Doz7TWwmpEGwh_0 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5996602250928055353', time=2024-09-14T13:51:38.879121+0000, chain.objs.size()=1 2024-09-14T12:09:52.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qBq66-jesVYdbwDqZR_avFyFDBrUFT-_0 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7201324849314527251', time=2024-09-14T13:51:39.057613+0000, chain.objs.size()=1 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WgT0PqGiAROoboJLUhrWfNrCMzswErB_0 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13765582891575303286', time=2024-09-14T13:51:40.279252+0000, chain.objs.size()=1 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7ezbjnKS_lc-Ga8w5lncUw_phi4iOYb_0 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15878103038393361796', time=2024-09-14T13:51:40.280050+0000, chain.objs.size()=1 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.898+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6GhWFLNoj7Y2XxIblQBFybqrRRUVSNZ_0 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.899+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11564899896814538945', time=2024-09-14T13:51:40.651226+0000, chain.objs.size()=1 2024-09-14T12:09:52.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.899+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-6nqCHre_0ErzBOX0ZX4nCq4iEUbVex_0 2024-09-14T12:09:52.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.902+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.588381726231003814', time=2024-09-14T13:51:40.728805+0000, chain.objs.size()=1 2024-09-14T12:09:52.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.902+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Jcb2RrI6XHmmrQ4pNIOWaERNz5T-fy7_0 2024-09-14T12:09:52.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.903+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6795354506685604748', time=2024-09-14T13:51:41.049009+0000, chain.objs.size()=1 2024-09-14T12:09:52.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.903+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-IiDUw-x8lppYDwsLKUnrJO5AG0sUch_0 2024-09-14T12:09:52.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.903+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13322742472299130624', time=2024-09-14T13:51:41.049810+0000, chain.objs.size()=1 2024-09-14T12:09:52.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.903+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.eMaIhet6xwM9nyyG0MJvMNUF6BTuRTU_0 2024-09-14T12:09:52.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.905+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11118211633471455565', time=2024-09-14T13:51:41.516901+0000, chain.objs.size()=1 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.905+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.U0aPLIRSl1cPWJvcBsqMC31iA3onXAd_0 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.905+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8836822056223751892', time=2024-09-14T13:51:41.597400+0000, chain.objs.size()=1 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.905+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UcOSpTBIyVzy_Wj4D3AZc11D2177_BG_0 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.905+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8722074664511577984', time=2024-09-14T13:51:41.601530+0000, chain.objs.size()=1 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.905+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.38_WOneMxgp1QvDUlTjSUzYIm6M7Vo3_0 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5420732435719623566', time=2024-09-14T13:51:41.720827+0000, chain.objs.size()=1 2024-09-14T12:09:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UDEDLwGaayXONxyMnj0-rsK6JmNjtEI_0 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12461739070411345007', time=2024-09-14T13:51:41.758208+0000, chain.objs.size()=1 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jp5Dn7m2o8YiDhYLPE6HFuvRf_lYlAs_0 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15705753151831820602', time=2024-09-14T13:51:41.870140+0000, chain.objs.size()=1 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nMkZnMG7NauidqY7hY9eT9bYKv-KSPi_0 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9079651885446856600', time=2024-09-14T13:52:21.115666+0000, chain.objs.size()=1 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.L-GN2I3leTVww23QUFjgpKGd_UImakY_0 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11358868155728482124', time=2024-09-14T13:52:21.406073+0000, chain.objs.size()=1 2024-09-14T12:09:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.906+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FA6YbmuaTq-2VQ5kRzNTgS9HUXk-e28_0 2024-09-14T12:09:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.907+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17861499950868373566', time=2024-09-14T13:52:21.407556+0000, chain.objs.size()=1 2024-09-14T12:09:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.907+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.o_emgwRPog3m7ycF4wCuPCbMx1dRLao_0 2024-09-14T12:09:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.907+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.546551718112188757', time=2024-09-14T13:52:21.630366+0000, chain.objs.size()=1 2024-09-14T12:09:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.907+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kccJF7mMH1X-W6GI6MJMusXM7ndEwpa_0 2024-09-14T12:09:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.907+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1910909308147328615', time=2024-09-14T13:52:21.813282+0000, chain.objs.size()=1 2024-09-14T12:09:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.907+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.X2onWimYGpvMXImdmy-2gq9tla-K2wy_0 2024-09-14T12:09:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.909+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2248866556917703129', time=2024-09-14T13:52:21.968908+0000, chain.objs.size()=1 2024-09-14T12:09:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.909+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SDZF5_x9rFrxhoUcsnlxgNIBByy0d7e_0 2024-09-14T12:09:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.909+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8815841475016752926', time=2024-09-14T13:52:22.127727+0000, chain.objs.size()=1 2024-09-14T12:09:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.909+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KqrJ6G_9ehkwUvo2xVgTGwZeMihwzk6_0 2024-09-14T12:09:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.910+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.456638298667594632', time=2024-09-14T13:52:22.689951+0000, chain.objs.size()=1 2024-09-14T12:09:52.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.910+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jYRbIFbXYx9Ohc7QzzRrMUdL8d8K8Fa_0 2024-09-14T12:09:52.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.910+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8472344499717459438', time=2024-09-14T13:52:23.351736+0000, chain.objs.size()=1 2024-09-14T12:09:52.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.910+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yXpJ36leQ30wP4ZBmJ_eX3DtNnD96ka_0 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17451325266212306015', time=2024-09-14T13:52:24.289979+0000, chain.objs.size()=1 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tu7mEh_lRd64HMbOem09jW5h8uRkpTc_0 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6989010067367737760', time=2024-09-14T13:52:24.371688+0000, chain.objs.size()=1 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UlO_s6Si2IL6sQYFDSPTptaA9z5eiew_0 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3641346552304279288', time=2024-09-14T13:52:24.499511+0000, chain.objs.size()=1 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mNhOazo6KpAt84FXeU5LZAXD37-b6Og_0 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.913+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6236299965772761060', time=2024-09-14T13:52:24.737021+0000, chain.objs.size()=1 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._EcK2DxMOC9zYAkV5fbYbO3YKJjcUr8_0 2024-09-14T12:09:52.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6205107667721067786', time=2024-09-14T13:52:25.287089+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gL8-sqVcMIkGoBRlXx7XuSe-4QDNDHR_0 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6310376061153125980', time=2024-09-14T13:52:25.975802+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VvS4g9KUMZbWjR7SYtS4Jwrnmt8Zi-n_0 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14030868602604212002', time=2024-09-14T13:52:26.030090+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.j-VZkZwpx4oL6T6hfyLRUFSF8VD8Y6C_0 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7842045003466644622', time=2024-09-14T13:52:26.600235+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TwlglxcMkhXj60eFGVt0Zr8lVk6g-gm_0 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17628679803794845379', time=2024-09-14T13:52:27.850782+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MCbGBHVhNv8n2oz5N38tRVsvhlDEYPe_0 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9317220845369915709', time=2024-09-14T13:52:27.918452+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.P8SRk8wXW5puAEQ-uDQcTHIfmOZk0lI_0 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10474300224925964026', time=2024-09-14T13:52:28.057301+0000, chain.objs.size()=1 2024-09-14T12:09:52.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.914+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BjNtGgY9i4hPwxsOf3m_VUTlnEAa0K5_0 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12383149684998647841', time=2024-09-14T13:52:28.867370+0000, chain.objs.size()=1 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PwkZWbLeZUTOpJktEqC2SKDfXtTb-sh_0 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4116407756991664567', time=2024-09-14T13:52:28.868205+0000, chain.objs.size()=1 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zOQMFA4kSCejCkDl8vhE1EJE1jW7gon_0 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13292133474025513916', time=2024-09-14T13:52:29.373848+0000, chain.objs.size()=1 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Go6aM_OBr8jY46khJeSyZbp4fQtVcDK_0 2024-09-14T12:09:52.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3918676270514508613', time=2024-09-14T13:52:29.414948+0000, chain.objs.size()=1 2024-09-14T12:09:52.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.921+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.itIOIAIwny-G412w24r5LaGqywFam0y_0 2024-09-14T12:09:52.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.926+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/46249 2024-09-14T12:09:52.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T12:09:52.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10463822254532571807', time=2024-09-14T13:52:29.991876+0000, chain.objs.size()=1 2024-09-14T12:09:52.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DCw_Z4HWNLZeXgUOQTGas1td_mjphgy_0 2024-09-14T12:09:52.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13732442009594952401', time=2024-09-14T13:52:30.038420+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BKWbg9WskVAAajOLwTPB2BWJGtI0fKn_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3773586789065020461', time=2024-09-14T13:52:30.138374+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XoMmqcqaLkKiNhHn9zUuaSeTx5JCusR_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3707887315557165541', time=2024-09-14T13:52:30.203258+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.h0W4PfmL8fgIPAsmRMUn98s4pOdzEjG_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17797897301097946394', time=2024-09-14T13:52:30.327295+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eT_NtQtQeb1mVtoDUekSyWLHI42jBur_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2063841061816559077', time=2024-09-14T13:52:30.473710+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.OPcSMS0uhJhNKHmA8Q2IqBTde-78MNR_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7481867750045256327', time=2024-09-14T13:52:30.663997+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.p2V9Vd8nmb2J3Q9IvPIl4NDl8Dx1kwA_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16334222189563912331', time=2024-09-14T13:52:31.717209+0000, chain.objs.size()=1 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xxdb5-r9fGdWEQbdPzDlhhNw3OqRqOc_0 2024-09-14T12:09:52.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5759319597912924270', time=2024-09-14T13:52:39.352701+0000, chain.objs.size()=1 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.337__shadow_.xaOJXYvII4txpovOQ3I6YEV_m8WOgul_0 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16107498626624285089', time=2024-09-14T13:53:00.548453+0000, chain.objs.size()=1 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.378__shadow_.mb9w2a5ezxwUUJvVYMzq9Tg4CYQACT7_0 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15373997313134959322', time=2024-09-14T13:53:53.182622+0000, chain.objs.size()=1 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.464__shadow_.RQISAZ-jRBU7a1IdWbtr8QDtsep8-eV_0 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12328401527491567653', time=2024-09-14T13:53:55.204570+0000, chain.objs.size()=1 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.933+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.466__shadow_.1vMzcwsuOwg1ux04hjkYSIrkchT9tFE_0 2024-09-14T12:09:52.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2681184254038543505', time=2024-09-14T13:54:13.902943+0000, chain.objs.size()=1 2024-09-14T12:09:52.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.497__shadow_.nrS8YxrQXSHpfP_JP2C_SUA0zoxt79c_0 2024-09-14T12:09:52.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.936+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18087037535207742998', time=2024-09-14T13:57:54.335360+0000, chain.objs.size()=1 2024-09-14T12:09:52.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.936+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:LndSqIzYjspskDhElz44pUNJYW4BFQu_.zwSMGLffbTtLKPdZQOoEeWNOvW-ZVxu_0 2024-09-14T12:09:52.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.937+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.600837636884246154', time=2024-09-14T13:57:58.027273+0000, chain.objs.size()=1 2024-09-14T12:09:52.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.937+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:k5Hne9GBJ4fyHQAaSz0nz3SZcVeCuLt_.RwdYp2PfWPINaAio7bQzf-ztwCvXzc7_0 2024-09-14T12:09:52.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.937+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13376372911655385672', time=2024-09-14T13:58:04.608362+0000, chain.objs.size()=1 2024-09-14T12:09:52.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.937+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.570__shadow:qHXdSp1SdtguTZQtyE.yUcq.zsX7pb1_.MyYTNYOG9nN086Fp445N6-DskpOAJYI_0 2024-09-14T12:09:52.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10091910347812618911', time=2024-09-14T13:58:04.710720+0000, chain.objs.size()=1 2024-09-14T12:09:52.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.570__shadow:jABR.vt7wdv-xVuBPuPMBOkIo0Zr5jv_.d7y6SESVBXJax2COMINGV0Uae9lHeIi_0 2024-09-14T12:09:52.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6812971114332778856', time=2024-09-14T13:58:10.757301+0000, chain.objs.size()=1 2024-09-14T12:09:52.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:bFOLrIp2NSc1SPjxwDkpl99wd1-mcYi_.rzFfBa0F1pBRp6Q60BhkBas7ZN-eWWQ_0 2024-09-14T12:09:52.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.674725602634909656', time=2024-09-14T13:58:20.154714+0000, chain.objs.size()=1 2024-09-14T12:09:52.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:wHWcUmCyrjLKVgUe-9Lj9xRSzkIX0hn_.ShS60ltmAwawZuOTdzZrROhA3IShc6H_0 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15812431791631461108', time=2024-09-14T13:58:28.221299+0000, chain.objs.size()=1 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:g5tGV7mMeRqloSSJhmLXqKhngspyqaB_.Obbosv268Lq85dMyTj8bdrCv-khtx5F_0 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1460018072882389201', time=2024-09-14T13:59:03.754723+0000, chain.objs.size()=1 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:g0OuCz5wERM4Bq89nmbkK1bbMfMdUn6_.5RgWi8DPW4RuqL4eSgMrnNJYj3N4NEt_0 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14171027358588296056', time=2024-09-14T14:06:44.067537+0000, chain.objs.size()=1 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.767__shadow_.Q8kpiFwYyrfISYAntKjHei-KVDOkivI_0 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13447669497199264632', time=2024-09-14T14:06:44.840664+0000, chain.objs.size()=1 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.768__shadow_.hblnCLArczTgmUH2M1Xtitjbng_OKlz_0 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6824996111840106316', time=2024-09-14T14:07:54.023340+0000, chain.objs.size()=5 2024-09-14T12:09:52.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.938+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.779__shadow_.MCqQS-Nk3DbDGPJhVTI5DJKuP4jGFXx_0 2024-09-14T12:09:52.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.940+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.779__shadow_.MCqQS-Nk3DbDGPJhVTI5DJKuP4jGFXx_1 2024-09-14T12:09:52.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.779__shadow_.MCqQS-Nk3DbDGPJhVTI5DJKuP4jGFXx_2 2024-09-14T12:09:52.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.779__shadow_.MCqQS-Nk3DbDGPJhVTI5DJKuP4jGFXx_3 2024-09-14T12:09:52.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.942+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.779__shadow_.MCqQS-Nk3DbDGPJhVTI5DJKuP4jGFXx_4 2024-09-14T12:09:52.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.943+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4648989512206148365', time=2024-09-14T14:09:09.480879+0000, chain.objs.size()=1 2024-09-14T12:09:52.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.943+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.782__shadow_.jbu8mpGujCrk0aSvY5lOJq_hCmjH0b9_0 2024-09-14T12:09:52.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.946+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:52.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.949+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T12:09:52.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.950+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:52.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.950+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:52.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47173' 2024-09-14T12:09:52.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15675745333425052138', time=2024-09-14T13:46:54.144257+0000, chain.objs.size()=3 2024-09-14T12:09:52.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-LUKEWARM.2~4sZy1t9gOKgxQWi_-R2Qywi00sAoPnd.1 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-LUKEWARM.2~4sZy1t9gOKgxQWi_-R2Qywi00sAoPnd.2 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-LUKEWARM.2~4sZy1t9gOKgxQWi_-R2Qywi00sAoPnd.3 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13011357870145697760', time=2024-09-14T13:47:01.430176+0000, chain.objs.size()=2 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.164__multipart_foo.2~XTLmBY5lbq7LeFrTRHjAsNQ_4BaC9iq.1 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.164__multipart_foo.2~XTLmBY5lbq7LeFrTRHjAsNQ_4BaC9iq.2 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16517722364485700066', time=2024-09-14T13:49:10.187787+0000, chain.objs.size()=1 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.244__shadow_.0Q1-n33HrrOyJFNG7KlyLPpWXS1px-z_0 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12379776195864332546', time=2024-09-14T13:49:13.362410+0000, chain.objs.size()=1 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.249__shadow_.U_15DaX3M3oeyI5jVcDBnENPp2be7GT_0 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16920325480091645028', time=2024-09-14T13:49:17.171258+0000, chain.objs.size()=1 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.255__shadow_.jSu92-CzFCEPoukbwWQTrjF-Ur8ntu0_0 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15717440658905440041', time=2024-09-14T13:49:58.833997+0000, chain.objs.size()=1 2024-09-14T12:09:52.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.bAVZxvZmZt4L9SqUG7MC-jabU2_3cVk_0 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13678777053463916284', time=2024-09-14T13:49:59.939353+0000, chain.objs.size()=1 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OeLCWj3kAMgjgcP8DeMYobjvg2GwG44_0 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.395451855344500339', time=2024-09-14T13:50:00.489034+0000, chain.objs.size()=1 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BqGlieIAy9V96Fb_o6PuZX7RC3IVwn7_0 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1133561807886271552', time=2024-09-14T13:50:01.443718+0000, chain.objs.size()=1 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RGtGV_CE-y5U4pKGkvsavIFc27vJp6__0 2024-09-14T12:09:52.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11414181988477437913', time=2024-09-14T13:50:01.957116+0000, chain.objs.size()=1 2024-09-14T12:09:52.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.33CrorLHyJc9EAXPUInjS7jP5ij6jmZ_0 2024-09-14T12:09:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6716517291130612764', time=2024-09-14T13:50:02.246933+0000, chain.objs.size()=1 2024-09-14T12:09:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Wt0-0HPfmMVclAN90ziLNqFxo_4Cjgy_0 2024-09-14T12:09:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17295122102695276354', time=2024-09-14T13:50:02.711986+0000, chain.objs.size()=1 2024-09-14T12:09:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LGsgSdBbs8PVfiquW-i5G3NcKN0n1tb_0 2024-09-14T12:09:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6199508659442143747', time=2024-09-14T13:50:03.451876+0000, chain.objs.size()=1 2024-09-14T12:09:52.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.noFSO_0nbnAkh7TJC5mT6M9-Z9zlCfx_0 2024-09-14T12:09:52.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13013793459932102611', time=2024-09-14T13:50:03.521910+0000, chain.objs.size()=1 2024-09-14T12:09:52.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6f48x0NjPIh99mquEsQQ_RhA2cbDGJ9_0 2024-09-14T12:09:52.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11117643954611674121', time=2024-09-14T13:50:03.587384+0000, chain.objs.size()=1 2024-09-14T12:09:52.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Z7IHLawyk-h8LJJphI5rPwEX3UqSlIt_0 2024-09-14T12:09:52.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7461078178266066252', time=2024-09-14T13:50:04.106931+0000, chain.objs.size()=1 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.965YmhghDRlQ6AaBakOJxvxawjQT2yH_0 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3441340804864732849', time=2024-09-14T13:50:04.154492+0000, chain.objs.size()=1 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GiFISEFLBRQP0k8Ak-nb51bOd7nS0s8_0 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11740415516874070855', time=2024-09-14T13:50:04.235833+0000, chain.objs.size()=1 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KTlAYaTX7kjslc8uv4hjSgB8GAJzfEF_0 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10753102095499334294', time=2024-09-14T13:50:04.311077+0000, chain.objs.size()=1 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2xKG93HwY0EPYwpO23qzLgI7iyt2pg6_0 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3373494586823902937', time=2024-09-14T13:50:04.953429+0000, chain.objs.size()=1 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0yc2UH4fzSP1i4Ef_wmU6_8t0gMM4re_0 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5195660665703547976', time=2024-09-14T13:50:05.153432+0000, chain.objs.size()=1 2024-09-14T12:09:52.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.956+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EzRtjjhrMsNOgdZQamMckCdeXyWYy69_0 2024-09-14T12:09:52.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.30693622676484432', time=2024-09-14T13:50:05.253368+0000, chain.objs.size()=1 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Cu4x3ae582HetAjankwiFCilk7MQRoL_0 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7737143216279436223', time=2024-09-14T13:50:05.437588+0000, chain.objs.size()=1 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.suKXYQUQucSM-TRCMgv5zaN5v0sRsAa_0 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13030180206954779113', time=2024-09-14T13:50:05.471446+0000, chain.objs.size()=1 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LVDrt631iO4PMWaPL_gghtlLd9YkUB-_0 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3388939637717868091', time=2024-09-14T13:50:05.591214+0000, chain.objs.size()=1 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sKBiMok5E1KnMnqlf55wy-iCD1Cyp3i_0 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8421100543254784102', time=2024-09-14T13:50:05.632003+0000, chain.objs.size()=1 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.U3QXsRfSR8Kdhx7xRbTJxPVPYVCc98T_0 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12800156655231357760', time=2024-09-14T13:50:05.853394+0000, chain.objs.size()=1 2024-09-14T12:09:52.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Dz49sVyPmzaN3F_7SKsrpIU6-KdXwo-_0 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16758665696165743846', time=2024-09-14T13:50:06.615259+0000, chain.objs.size()=1 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.awMChAGe4kp_glFeJZOd9rrRnL6fKOQ_0 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6402642101704156913', time=2024-09-14T13:50:06.682657+0000, chain.objs.size()=1 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1L7w1BOjcjnV8VIl0-VSt9I6zoGRyD9_0 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11714737147428321054', time=2024-09-14T13:50:06.824903+0000, chain.objs.size()=1 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xeFDeT4sNYH60edmJ_4T7lLCrIuWvwF_0 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11380627918819877598', time=2024-09-14T13:50:06.833179+0000, chain.objs.size()=1 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ejozFWSEzziIncGafvPa_OlTYSdteZa_0 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13225277195711055191', time=2024-09-14T13:50:07.155818+0000, chain.objs.size()=1 2024-09-14T12:09:52.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.962+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Nc0WFc4ojodzhIM42deRklDyXZKyhte_0 2024-09-14T12:09:52.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15485580584121999523', time=2024-09-14T13:50:07.171979+0000, chain.objs.size()=1 2024-09-14T12:09:52.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8ClRugf-bPke3AZw2IcC-y6xeTSHTfo_0 2024-09-14T12:09:52.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1034809274429074376', time=2024-09-14T13:50:08.454063+0000, chain.objs.size()=1 2024-09-14T12:09:52.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jrqpcH-_mwYS88TAAY-cc_eUfx1uKwt_0 2024-09-14T12:09:52.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6519781877641121765', time=2024-09-14T13:50:08.513620+0000, chain.objs.size()=1 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.y7sWw2eHylbY7n3LcospDMduk6z2xwS_0 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5751899638099782575', time=2024-09-14T13:50:09.202258+0000, chain.objs.size()=1 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XVNuK3NLa1cEtKqjd0twYdQW_fTLIFa_0 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3680607806281065805', time=2024-09-14T13:50:09.657313+0000, chain.objs.size()=1 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VHik_aXILDYvw8dzj-7MBHZPWvWAu5Z_0 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10943306191305686775', time=2024-09-14T13:50:09.853791+0000, chain.objs.size()=1 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.964+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZSBTDzL2ICoqzs4btMU5oVB2wXFa5bD_0 2024-09-14T12:09:52.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1573516847701109001', time=2024-09-14T13:50:25.927495+0000, chain.objs.size()=1 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.288__shadow_._sjR38MCohd7o50zpLNxGHNuHXMtUCg_0 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8629693494313761268', time=2024-09-14T13:51:30.950302+0000, chain.objs.size()=1 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4-eK_qdx6pNjfEjOs1e9DG-ikmTf_4I_0 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17020112406534590491', time=2024-09-14T13:51:31.057500+0000, chain.objs.size()=1 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0m7KDr8YHoBj9j3NOQUATuvgzTdH_82_0 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15101889948804167848', time=2024-09-14T13:51:31.058032+0000, chain.objs.size()=1 2024-09-14T12:09:52.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.L8EzBLV8R4KF39MMXsDlnvd9vlgCgRS_0 2024-09-14T12:09:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.967+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4909827245134001923', time=2024-09-14T13:51:31.237970+0000, chain.objs.size()=1 2024-09-14T12:09:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.967+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jh6f154rODY3nlGDeu34bmGMPSdEMFO_0 2024-09-14T12:09:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.968+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14618919761942951461', time=2024-09-14T13:51:31.271979+0000, chain.objs.size()=1 2024-09-14T12:09:52.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.968+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1UYQRwcNaCm1Hx1Yxp6iBHSSL5y4n1b_0 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10303704008709464804', time=2024-09-14T13:51:31.555063+0000, chain.objs.size()=1 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lZctNfFSl7Dc8vT4BKdmaWA6WTEBWLC_0 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7180588237044025415', time=2024-09-14T13:51:32.304953+0000, chain.objs.size()=1 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dj4zipWzxz9nIoEn5Mfk9-njMQaC75f_0 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14736429502815491406', time=2024-09-14T13:51:32.700301+0000, chain.objs.size()=1 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.92mwcEu_QWKExSkP7zb6YVawxgLx9KE_0 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3410410856205897126', time=2024-09-14T13:51:32.753799+0000, chain.objs.size()=1 2024-09-14T12:09:52.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uxtN0Y9OWe4lQW6z9sweOhSc_pL41Ia_0 2024-09-14T12:09:52.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5045565399352822470', time=2024-09-14T13:51:34.034428+0000, chain.objs.size()=1 2024-09-14T12:09:52.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4T85ZVuhTfUcgP9ecvD2hZcMnDYl21V_0 2024-09-14T12:09:52.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10056250129970663922', time=2024-09-14T13:51:34.086938+0000, chain.objs.size()=1 2024-09-14T12:09:52.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kcTblCe5xU6Tr1ZgGfa5cbju4XLzY-y_0 2024-09-14T12:09:52.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12131668895015163289', time=2024-09-14T13:51:34.103333+0000, chain.objs.size()=1 2024-09-14T12:09:52.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.971+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.23dJkC2DHOojeCtLNdoEd0kiZcX7xeR_0 2024-09-14T12:09:52.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2427660583381493306', time=2024-09-14T13:51:34.710604+0000, chain.objs.size()=1 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bP5Qd3VM75SYUmcmR5Ms3E3veu7xxgU_0 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16298346281071442122', time=2024-09-14T13:51:34.856465+0000, chain.objs.size()=1 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Jgd7xsUQZH4fYWuc_omizztc1MJwkMa_0 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5821416727458171785', time=2024-09-14T13:51:34.895378+0000, chain.objs.size()=1 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jAo7p8tc9m1812YeTFvABJR166vdAm0_0 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5234375466715030501', time=2024-09-14T13:51:35.342944+0000, chain.objs.size()=1 2024-09-14T12:09:52.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DRB2euuWXNQ9WSRseCnEmUVFqF2IZhU_0 2024-09-14T12:09:52.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.976+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.414348164954202536', time=2024-09-14T13:51:35.354357+0000, chain.objs.size()=1 2024-09-14T12:09:52.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.976+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kabJo1aBZQJDtZxgk5FzDz_qsycNggu_0 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3128668926514674165', time=2024-09-14T13:51:35.355027+0000, chain.objs.size()=1 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gl80qowCTlBu_rExbQoI9aVc2r3WYfh_0 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1210517422199218642', time=2024-09-14T13:51:35.435504+0000, chain.objs.size()=1 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pWSiavJ-2RN7znfyvc3shwp0goQgrVN_0 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.583243608056834888', time=2024-09-14T13:51:36.042707+0000, chain.objs.size()=1 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fQWfXa8Ja3xIpJQxGiGdrAT-cR1c_Lq_0 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3044367533496733359', time=2024-09-14T13:51:36.290146+0000, chain.objs.size()=1 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.elJo_WLciF9Hr7EswmCL8DoHARZv439_0 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16676438936763066745', time=2024-09-14T13:51:36.944400+0000, chain.objs.size()=1 2024-09-14T12:09:52.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.977+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MBbFcIJ2bLjkIb7mV0ZIZSDxy48LB9O_0 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7970219480699490549', time=2024-09-14T13:51:37.316369+0000, chain.objs.size()=1 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.twGXfIHspzeVrAZ7mTNYqLq6oxQbaYr_0 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14893364534486937079', time=2024-09-14T13:51:37.431633+0000, chain.objs.size()=1 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MFpzOeFH0N3l1t-C9S7wJEyo8UC2Elx_0 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13998668089597275705', time=2024-09-14T13:51:38.699214+0000, chain.objs.size()=1 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.brlkIbUNkV7wlKHzYv_j14UqR08oJ5v_0 2024-09-14T12:09:52.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5991041094492115892', time=2024-09-14T13:51:38.999127+0000, chain.objs.size()=1 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mcmZiIkiJjo77HuMQj0x0ubzdWDVcN9_0 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2255723794302108904', time=2024-09-14T13:51:39.124994+0000, chain.objs.size()=1 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.iH_gBhlKogrD8Z0kQYk8-NEPQ-Uhpca_0 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10037296376871344428', time=2024-09-14T13:51:39.947067+0000, chain.objs.size()=1 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lP-ZlVHcmHcd9NGy5D_-07QjoJeQzr7_0 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10330310317396007229', time=2024-09-14T13:51:40.053388+0000, chain.objs.size()=1 2024-09-14T12:09:52.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xeLHejdr9cKWB6ONBGJ5nQxly7jNf7u_0 2024-09-14T12:09:52.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15046464819696734881', time=2024-09-14T13:51:40.725598+0000, chain.objs.size()=1 2024-09-14T12:09:52.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MdSEenZjbNDj_rqYdiH6SbmY7n1UyDN_0 2024-09-14T12:09:52.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3480791665951532448', time=2024-09-14T13:51:41.029977+0000, chain.objs.size()=1 2024-09-14T12:09:52.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DqPpqAIgCUvrzWZMK1-7edh9h8RQ26G_0 2024-09-14T12:09:52.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13084396258947098608', time=2024-09-14T13:51:41.172793+0000, chain.objs.size()=1 2024-09-14T12:09:52.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oKAMn4q1ELcj4gbPFnFyHuuUrFpfska_0 2024-09-14T12:09:52.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161574820217961884', time=2024-09-14T13:51:41.335260+0000, chain.objs.size()=1 2024-09-14T12:09:52.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6pyoC3tpSNHPfa_vFpsBX5KXh81Rfc4_0 2024-09-14T12:09:52.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.984+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1114465411364345633', time=2024-09-14T13:52:21.457380+0000, chain.objs.size()=1 2024-09-14T12:09:52.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.984+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-MiDVun47qsJ--_Ku0zkwgSBT2eK7aw_0 2024-09-14T12:09:52.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.984+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14873849579389202389', time=2024-09-14T13:52:21.966372+0000, chain.objs.size()=1 2024-09-14T12:09:52.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.984+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-HKWIn3MGhACzh3a7zig176vkBOhhpH_0 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.984+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5123509012051748041', time=2024-09-14T13:52:22.124617+0000, chain.objs.size()=1 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.984+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ff8J7S_mOgg2vliS0rdO2kjyzM5_XRx_0 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15602160714998394410', time=2024-09-14T13:52:22.798142+0000, chain.objs.size()=1 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.y2J6ZUeUyb_FfOQxrhTkxc8_2ODukmk_0 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2081810359905664346', time=2024-09-14T13:52:23.285131+0000, chain.objs.size()=1 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nnnvgjrgRhTIV8bWylFkXBR1ZmecBv9_0 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15404277211259137880', time=2024-09-14T13:52:23.285626+0000, chain.objs.size()=1 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6OwDIeHaYnq9EJSquOmkpzESZ4VEk-6_0 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3215457810109984732', time=2024-09-14T13:52:24.223375+0000, chain.objs.size()=1 2024-09-14T12:09:52.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fCMbJzLvkwvuI4A1_bZ8EXIKJ2y5lSy_0 2024-09-14T12:09:52.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10705576836721293550', time=2024-09-14T13:52:24.237667+0000, chain.objs.size()=1 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.u8B-aGlpoAUIYZ7Nher1qIZ-BDxqPUB_0 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4447988217916531149', time=2024-09-14T13:52:25.827951+0000, chain.objs.size()=1 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qWWdrhP76r7tocUosW1h3kc9aMA5ZFB_0 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9505092102844021224', time=2024-09-14T13:52:25.895972+0000, chain.objs.size()=1 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.49fznyVFGoDkbCLkSX1Zmasa0R9ODS4_0 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7331870993835310837', time=2024-09-14T13:52:25.967128+0000, chain.objs.size()=1 2024-09-14T12:09:52.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.987+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yxjjjW2OAMa1IsFXeauKu-9gerT_uMe_0 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12668397767812187431', time=2024-09-14T13:52:26.463288+0000, chain.objs.size()=1 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9WZfyo3jrk_tkJpoTiNXKScJMWOj8Ba_0 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7432679993053922532', time=2024-09-14T13:52:26.640255+0000, chain.objs.size()=1 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9uP_D4l-XQ9HsQBkiZMZ6i2Vbq1_VyN_0 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4903479607459626207', time=2024-09-14T13:52:26.728598+0000, chain.objs.size()=1 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lbpGYJEICgp0TT2NRz8x_d0Yl7fksjx_0 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16426122673997781374', time=2024-09-14T13:52:26.759373+0000, chain.objs.size()=1 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0I5jbuQJcqH2F5wWvcRhS8-53S80mb6_0 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14422271949291956044', time=2024-09-14T13:52:27.197532+0000, chain.objs.size()=1 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KqaQUe8kA1KSwavotEG-FSitYrW4ya8_0 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14709140896727489568', time=2024-09-14T13:52:27.198081+0000, chain.objs.size()=1 2024-09-14T12:09:52.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AtnASup4HdLKMty30PW5roRZh9NgitB_0 2024-09-14T12:09:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15359404038230720694', time=2024-09-14T13:52:27.757122+0000, chain.objs.size()=1 2024-09-14T12:09:52.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cgTl5uWZMaLz7OzaeO21Ej6xikAhJXR_0 2024-09-14T12:09:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.993+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15321726340350574948', time=2024-09-14T13:52:27.905705+0000, chain.objs.size()=1 2024-09-14T12:09:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.993+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JGXkFymx-k4Gc-oAyTH2nWDGmJKWZ6G_0 2024-09-14T12:09:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.993+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.722524556050701150', time=2024-09-14T13:52:28.100244+0000, chain.objs.size()=1 2024-09-14T12:09:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.993+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.T399I1mhf9BooeQLC1YhAkShNs8HJ0t_0 2024-09-14T12:09:52.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.993+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5673413979106482568', time=2024-09-14T13:52:28.777429+0000, chain.objs.size()=1 2024-09-14T12:09:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.993+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Sbul-5ipira-iwMYO_84lDMqe5jF5db_0 2024-09-14T12:09:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.994+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14296204243018636161', time=2024-09-14T13:52:28.911658+0000, chain.objs.size()=1 2024-09-14T12:09:52.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.994+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.z1QMrjvLSgc-eBoPMWAmRjU6lP3wGb7_0 2024-09-14T12:09:52.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.995+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14695463288098954669', time=2024-09-14T13:52:29.287125+0000, chain.objs.size()=1 2024-09-14T12:09:52.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.995+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.c0Y5FkiIpFd_lsotSAdKj_plv8KATGj_0 2024-09-14T12:09:52.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.995+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16324863438424161899', time=2024-09-14T13:52:30.172337+0000, chain.objs.size()=1 2024-09-14T12:09:52.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.995+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YpBjOrDoevhC-cNr1Sa-oPbFsBO_dTW_0 2024-09-14T12:09:52.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1427052025356418405', time=2024-09-14T13:52:30.629826+0000, chain.objs.size()=1 2024-09-14T12:09:52.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BEk14IK4QMUjPX4pLmaTgMRZ6KNwibC_0 2024-09-14T12:09:52.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13062499051531693422', time=2024-09-14T13:52:30.795271+0000, chain.objs.size()=1 2024-09-14T12:09:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2WQTyon0o6pxFGmDDv3gmhj-sM55It3_0 2024-09-14T12:09:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2649957574504580895', time=2024-09-14T13:52:30.938339+0000, chain.objs.size()=1 2024-09-14T12:09:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.g9lOcRYo3FZOc1PtAIG6cPEY5DqwMAS_0 2024-09-14T12:09:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10479956781922027559', time=2024-09-14T13:52:31.505388+0000, chain.objs.size()=1 2024-09-14T12:09:52.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:52.998+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xUPfIKUTSJFn1xXCsfVrNIy8WWpQFBe_0 2024-09-14T12:09:53.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.004+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47173 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9697403235899972727', time=2024-09-14T13:53:46.513767+0000, chain.objs.size()=1 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.456__shadow_.IwNLswTOAWK1vPRonzPHvHYdgIbJVT3_0 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15778967521852860247', time=2024-09-14T13:53:53.432026+0000, chain.objs.size()=1 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.464__shadow_.mhp6d0SiUWOqhJsgjYYfBhE4zZa3O_H_0 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15031232148007586421', time=2024-09-14T13:54:17.794366+0000, chain.objs.size()=1 2024-09-14T12:09:53.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.503__shadow:cl2ARxfpauRoDIjBPT2zPE7hlSXN4gW_.mVyB_4O5KFCXr9CJf6BJq8M6WMccC9-_0 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7793587184026853204', time=2024-09-14T13:54:50.872321+0000, chain.objs.size()=6 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.519__multipart_mymultipart.2~4ic12VT6pgvwM7u6nATqzCEuIVCEEbc.1 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.519__multipart_mymultipart.2~4ic12VT6pgvwM7u6nATqzCEuIVCEEbc.2 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.519__multipart_mymultipart.2~4ic12VT6pgvwM7u6nATqzCEuIVCEEbc.3 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.519__multipart_mymultipart.2~4ic12VT6pgvwM7u6nATqzCEuIVCEEbc.4 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.519__multipart_mymultipart.2~4ic12VT6pgvwM7u6nATqzCEuIVCEEbc.5 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.519__multipart_mymultipart.2~4ic12VT6pgvwM7u6nATqzCEuIVCEEbc.6 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU', time=2024-09-14T13:55:37.674395+0000, chain.objs.size()=1 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU.3 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10140872387473805623', time=2024-09-14T13:56:19.721994+0000, chain.objs.size()=2 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~onMg40LT30plKa62V8jNvqBkUj7LQYQ.1 2024-09-14T12:09:53.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.009+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~onMg40LT30plKa62V8jNvqBkUj7LQYQ.2 2024-09-14T12:09:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.014+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17234673190485309440', time=2024-09-14T13:58:15.144195+0000, chain.objs.size()=1 2024-09-14T12:09:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.014+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:bFfiuIDLVjGIHuiVnVwqusKzl2N.yzp_.YZG0sEWT1aWTUUYsuHxEleP3mSvOefW_0 2024-09-14T12:09:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.014+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17018149221750352933', time=2024-09-14T13:58:29.896556+0000, chain.objs.size()=1 2024-09-14T12:09:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.014+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:MN3oX8TI9WbEs9u36OLPdWbh2.aTw1q_.QvRB4p-Vw-4_AfGhYkoiEtvMQpytYlB_0 2024-09-14T12:09:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.014+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11425595517443230000', time=2024-09-14T13:58:51.581946+0000, chain.objs.size()=4 2024-09-14T12:09:53.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.014+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~JrfqPPiQHHhUNmmjnr_KtV9bQtyyX-s.1 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~JrfqPPiQHHhUNmmjnr_KtV9bQtyyX-s.2 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~JrfqPPiQHHhUNmmjnr_KtV9bQtyyX-s.3 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~JrfqPPiQHHhUNmmjnr_KtV9bQtyyX-s.4 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1959048320407353112', time=2024-09-14T13:58:52.598090+0000, chain.objs.size()=4 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~OATk38j2uYWHqY6OyOEykmzjtS2i7uz.1 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~OATk38j2uYWHqY6OyOEykmzjtS2i7uz.2 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~OATk38j2uYWHqY6OyOEykmzjtS2i7uz.3 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~OATk38j2uYWHqY6OyOEykmzjtS2i7uz.4 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15265171733379802601', time=2024-09-14T13:59:03.356345+0000, chain.objs.size()=1 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:d09CQ7irNwDdgxh-3qsvCqTtar-wCvp_.aMqvWs5ckhnChb9YwF_nnIBYMHWMMWV_0 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2739855063790831472', time=2024-09-14T14:02:47.814271+0000, chain.objs.size()=6 2024-09-14T12:09:53.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.017+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.623__multipart_multipart_enc.2~R2iKtPxrLem89g3x_uv8urxZaLpu2uw.1 2024-09-14T12:09:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.019+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.623__multipart_multipart_enc.2~R2iKtPxrLem89g3x_uv8urxZaLpu2uw.2 2024-09-14T12:09:53.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.019+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.623__multipart_multipart_enc.2~R2iKtPxrLem89g3x_uv8urxZaLpu2uw.3 2024-09-14T12:09:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.623__multipart_multipart_enc.2~R2iKtPxrLem89g3x_uv8urxZaLpu2uw.4 2024-09-14T12:09:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.623__multipart_multipart_enc.2~R2iKtPxrLem89g3x_uv8urxZaLpu2uw.5 2024-09-14T12:09:53.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.623__multipart_multipart_enc.2~R2iKtPxrLem89g3x_uv8urxZaLpu2uw.6 2024-09-14T12:09:53.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.024+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9506479493364265451', time=2024-09-14T14:04:16.825866+0000, chain.objs.size()=1 2024-09-14T12:09:53.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.024+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.708__shadow:3g.4-4YxQX0HnQJ1ErIdT8r4Yog0VW6_.ZWli8k3tegZ-5VgHqAVE1grOjsP0Jaq_0 2024-09-14T12:09:53.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.029+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.031+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T12:09:53.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.034+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.034+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48446' 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.824672040761740903', time=2024-09-14T13:46:44.373995+0000, chain.objs.size()=3 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-FROZEN.2~zU-J0EaG0H8cRgc3DvEQbCzrhi23CY8.1 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-FROZEN.2~zU-J0EaG0H8cRgc3DvEQbCzrhi23CY8.2 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-FROZEN.2~zU-J0EaG0H8cRgc3DvEQbCzrhi23CY8.3 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2988023866905474196', time=2024-09-14T13:49:04.392973+0000, chain.objs.size()=1 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.236__shadow_.hJMrzf3UGbolgvN3ZeTcDSw7fZAzvDE_0 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1794015887019830564', time=2024-09-14T13:49:06.134259+0000, chain.objs.size()=1 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.238__shadow_.Gvf5K7SgG4lfCfaaKF2TD2WjGEvMZnX_0 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1112661725733770097', time=2024-09-14T13:49:15.901741+0000, chain.objs.size()=1 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.253__shadow_.cpALg4VLkAS18wshYpgbFwJlyeW_aHN_0 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15140085136311024781', time=2024-09-14T13:49:20.211712+0000, chain.objs.size()=1 2024-09-14T12:09:53.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.260__shadow_.bQ7wU3icVAMHuwVVyv1e8klKStl7S5i_0 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1976760008637100601', time=2024-09-14T13:49:58.939777+0000, chain.objs.size()=1 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5e-lykQO2KufSZxLsYBnccyWjvGXmCn_0 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4904462383124502992', time=2024-09-14T13:49:59.913612+0000, chain.objs.size()=1 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pjccSv-ehjZnzrCpRtfVfsI1wN2wEic_0 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13571064553258623029', time=2024-09-14T13:50:00.489883+0000, chain.objs.size()=1 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eNLFmulvkMPDMI35MOmllN2ZK-p4HY1_0 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.990903638402302681', time=2024-09-14T13:50:00.779367+0000, chain.objs.size()=1 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vW_KTq9uBUTCO8Blqc0vmvcEwKTCyKQ_0 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13414567751267152413', time=2024-09-14T13:50:00.779983+0000, chain.objs.size()=1 2024-09-14T12:09:53.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.035+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SH-xAVvCtWXsdnJ2rn7ywW27WnVEbwO_0 2024-09-14T12:09:53.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6662662339191998378', time=2024-09-14T13:50:00.928111+0000, chain.objs.size()=1 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1NdR3e0IVRibt-HYJ0Nw2K0vW0NeTS__0 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16183174622727238563', time=2024-09-14T13:50:01.443249+0000, chain.objs.size()=1 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MF1uxdBGhq88N3mIL1FKYwkQT6YhWwQ_0 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10496961158665022285', time=2024-09-14T13:50:01.444083+0000, chain.objs.size()=1 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VPl2AWqLjlTBtFy9uDP8EYbWoHfYOUT_0 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18029221089183227422', time=2024-09-14T13:50:03.712017+0000, chain.objs.size()=1 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MzOP-9Lgqzg-VhXaHE9J9zgb2za2c1t_0 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3640357641230625088', time=2024-09-14T13:50:03.744101+0000, chain.objs.size()=1 2024-09-14T12:09:53.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.040+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dcTyhLs01UzKDPkU7wuNYUcLmdI9JKh_0 2024-09-14T12:09:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8931349038939330192', time=2024-09-14T13:50:04.425247+0000, chain.objs.size()=1 2024-09-14T12:09:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AtYt3Ey6X_SawgQwvn6Gu-4-mFY0JAZ_0 2024-09-14T12:09:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17608960610666511318', time=2024-09-14T13:50:04.843699+0000, chain.objs.size()=1 2024-09-14T12:09:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZiXKUR59rLrYPh4zkZaCVkbqf2q8oJD_0 2024-09-14T12:09:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3022705870373531378', time=2024-09-14T13:50:04.844497+0000, chain.objs.size()=1 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HXmq4akkJhm0-4nKfMPjES1f3X4f1vV_0 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12134232815133655320', time=2024-09-14T13:50:05.300860+0000, chain.objs.size()=1 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rYulLsv8hDj3_GmQMh2itvtABB4z68U_0 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.783837867258057324', time=2024-09-14T13:50:06.368648+0000, chain.objs.size()=1 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.042+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aWV4cQ5V8sixPXw36M9UDvfEpVdo0xZ_0 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.043+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13132488737019807048', time=2024-09-14T13:50:06.663640+0000, chain.objs.size()=1 2024-09-14T12:09:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.043+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4zmZHSQ2GQqbZXuCLzCmNM1DhCC4KJ5_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13809932699415803489', time=2024-09-14T13:50:06.769891+0000, chain.objs.size()=1 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.C1kzfTRv5nf215vxrR_7cjLkqHrt8gQ_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14663673740106225335', time=2024-09-14T13:50:07.565222+0000, chain.objs.size()=1 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Swt05WdA8o1osapgWAE4a5-7fO3ylp3_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11714659824527010336', time=2024-09-14T13:50:07.707004+0000, chain.objs.size()=1 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.h0AHFbeKn7WZ7UPf9WfdjwTaCdmNELl_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5387079729218756508', time=2024-09-14T13:50:08.219830+0000, chain.objs.size()=1 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._jN_tt7QEkfT-w9hq9MkpgQlw2sWsgl_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7262533491349804205', time=2024-09-14T13:50:08.261147+0000, chain.objs.size()=1 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.f1OYSX0atznzA7vAwdkiFklPev3pwxV_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16691785634283784952', time=2024-09-14T13:50:09.207365+0000, chain.objs.size()=1 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AdiUE-F3o2t3e1mqJ9_tIBi4XsC0-nO_0 2024-09-14T12:09:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11817262764019158659', time=2024-09-14T13:50:12.250151+0000, chain.objs.size()=1 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.266__shadow_.FYiBLJvpmVKKrGxQ8mBt88TBBUegtH4_0 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14701461336322070162', time=2024-09-14T13:50:14.593776+0000, chain.objs.size()=1 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.270__shadow_.bRKoPxc9cifpnnGpKSGcWkZi3nVqo43_0 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3835195117442142028', time=2024-09-14T13:50:16.372134+0000, chain.objs.size()=1 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.273__shadow_.B891ldIf0lDTOw0UGwwPgOOeyPAmguW_0 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1459039708183459684', time=2024-09-14T13:50:18.902329+0000, chain.objs.size()=1 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.277__shadow_.PnJD__Lv54TNdXgFMBGgbehusNp8SwX_0 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4529252626531156754', time=2024-09-14T13:50:22.631610+0000, chain.objs.size()=1 2024-09-14T12:09:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.283__shadow_.T7txIIDDW6cVinXE5OwVHR59I1SbQSz_0 2024-09-14T12:09:53.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.053+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11664706032649053299', time=2024-09-14T13:50:31.759917+0000, chain.objs.size()=1 2024-09-14T12:09:53.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.053+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.aqkr_h2jX08UZTYyuNQ90fRfETntJkf_0 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5302958874416415765', time=2024-09-14T13:50:31.769592+0000, chain.objs.size()=1 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.d6Fu5K_DDoTzbDtczYIb3bHlNYQfA_7_0 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8849598114097043825', time=2024-09-14T13:50:36.413642+0000, chain.objs.size()=1 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.300__shadow_.WXYyHmfjKvAlT3U7zjXHpTKb7mOUlHe_0 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17413631786351314366', time=2024-09-14T13:50:51.356972+0000, chain.objs.size()=1 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.322__shadow_.lb-Pu83253U2btCcwv0ES9CfyIRYM-w_0 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7408577858875786031', time=2024-09-14T13:51:30.791290+0000, chain.objs.size()=1 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7q7rGnt8JNK043hXycFsv5KQHE-aTlR_0 2024-09-14T12:09:53.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5481579631953639284', time=2024-09-14T13:51:30.792070+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UaGw2q8FRWIyxqPmgec-vi0fYj2y6Ix_0 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8429370771512334317', time=2024-09-14T13:51:31.084228+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ToDnpH6PL8Rg_eFhxS0RUsUeHYAPCB9_0 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7149166450651389590', time=2024-09-14T13:51:31.140562+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RpqleOHs--2CZRJXIBj4R3CFaud8LM1_0 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13418170475337339999', time=2024-09-14T13:51:31.237616+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1G8gnzgXnsEQ2is4Dyc0tohToNLe8wW_0 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12713944420605220818', time=2024-09-14T13:51:31.249736+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0bbLP9emyoSuhPA8X6Iljkd5w0Kvzvq_0 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.471680706111608198', time=2024-09-14T13:51:31.383230+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ytWMYSuiZcHMi6NKyxhVfBjzvQaCnE1_0 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2343997472595727225', time=2024-09-14T13:51:32.327221+0000, chain.objs.size()=1 2024-09-14T12:09:53.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.056+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LMMGsPX44V1no3Qc9cx5NBe3ZWSHXiW_0 2024-09-14T12:09:53.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17680020075652854571', time=2024-09-14T13:51:32.327954+0000, chain.objs.size()=1 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wWXpNNEEp_W2o2GXc7XXTD0mL1Rseiv_0 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6173012727983901422', time=2024-09-14T13:51:32.505801+0000, chain.objs.size()=1 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GDq1r-0YE9MQDoyIWXO-LI4rcBVKKJt_0 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1992649909954937411', time=2024-09-14T13:51:33.081046+0000, chain.objs.size()=1 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XICWkT54YEC84YzImeDnaWxIcu-3r9G_0 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3818906320062627309', time=2024-09-14T13:51:33.121696+0000, chain.objs.size()=1 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RobavCu_9o3ij5zycztozPVFZ96bmuG_0 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14031889797052192957', time=2024-09-14T13:51:33.862974+0000, chain.objs.size()=1 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.T-W6IILohkHpa-aWXps9BwPkHgl-b2r_0 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9504845612742009078', time=2024-09-14T13:51:34.600958+0000, chain.objs.size()=1 2024-09-14T12:09:53.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.062+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Trmqe5pMklMlhfzkyITBXxXHzl9y77F_0 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18241261682567178779', time=2024-09-14T13:51:34.712103+0000, chain.objs.size()=1 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wXQdIsCuChwY4zIVVnowxFGOsv9mXln_0 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12763041561667423019', time=2024-09-14T13:51:35.391249+0000, chain.objs.size()=1 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tf4WIARE8i-glkDjjnQnKWthaEG4gxB_0 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14895396319025662075', time=2024-09-14T13:51:35.777083+0000, chain.objs.size()=1 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jeEGjQY18i4GhthycumWAI8z1oKjcYn_0 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10289439775972152095', time=2024-09-14T13:51:35.821710+0000, chain.objs.size()=1 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.asWNT5-q7ARtB4UgmaquOAgAf8XWq16_0 2024-09-14T12:09:53.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.905277241899777751', time=2024-09-14T13:51:37.019672+0000, chain.objs.size()=1 2024-09-14T12:09:53.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.063+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.N-3t1ROLNcLrVCFT4JMxHV87-VlTFMX_0 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.065+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13334768721799222183', time=2024-09-14T13:51:37.551708+0000, chain.objs.size()=1 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.065+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wQduZCdACJseL2PzQPfNOq70-1ttCwT_0 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.065+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12542930154770486574', time=2024-09-14T13:51:38.310489+0000, chain.objs.size()=1 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.065+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Zw28zsev8U4uKRpZ2XhzWJkhtpaJjHo_0 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.066+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6370392763126904402', time=2024-09-14T13:51:38.311353+0000, chain.objs.size()=1 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.066+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Q6NRPQESLPo5dOKI_qM3ASRnXpMqiOy_0 2024-09-14T12:09:53.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.066+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11972018709800807160', time=2024-09-14T13:51:38.970126+0000, chain.objs.size()=1 2024-09-14T12:09:53.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.066+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jkNhn6R6Rc1eQugj3fPSH9wyBY7dE3W_0 2024-09-14T12:09:53.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.066+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8724003856511145005', time=2024-09-14T13:51:39.230037+0000, chain.objs.size()=1 2024-09-14T12:09:53.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.066+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uZS14uAlUeEM83XNdmLNjZUmQ3UHIL2_0 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4316861198145682434', time=2024-09-14T13:51:39.327727+0000, chain.objs.size()=1 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.H8XTti3ZwqrBkICIfvHQeCJzf_kfXDJ_0 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6560662630429630914', time=2024-09-14T13:51:39.351271+0000, chain.objs.size()=1 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PPbz2hX30iCLsxfISaKFjNEJmiJDaMb_0 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17548876485768510508', time=2024-09-14T13:51:39.713635+0000, chain.objs.size()=1 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.CB39Z1A_7JOkOGH4IA3eTIQxut-UtWh_0 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6769760205440088538', time=2024-09-14T13:51:39.915695+0000, chain.objs.size()=1 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2Ht_6yZKRnaH03h0wHXhLnHfSK4Eh6K_0 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4772048641212145331', time=2024-09-14T13:51:40.092981+0000, chain.objs.size()=1 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.M6v9QnUCRrKzLy-njr0kpYkTs39hCWn_0 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16366170669770167289', time=2024-09-14T13:51:40.662261+0000, chain.objs.size()=1 2024-09-14T12:09:53.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tGGHQd5XhGy3q82yio-J6OixMxwTnXL_0 2024-09-14T12:09:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4689599505990026015', time=2024-09-14T13:51:41.216859+0000, chain.objs.size()=1 2024-09-14T12:09:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.KrYDVL57HLznb0dI_D-zdt97zuAhPcS_0 2024-09-14T12:09:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18167548403093364109', time=2024-09-14T13:51:41.217604+0000, chain.objs.size()=1 2024-09-14T12:09:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.g4oO1vCW9oF2A_KfHPatp6rolldhJy__0 2024-09-14T12:09:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.070+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1599482711622520530', time=2024-09-14T13:51:41.724999+0000, chain.objs.size()=1 2024-09-14T12:09:53.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.070+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vziQgYx6F6GQJRDynHDiWhn6T4lfL2O_0 2024-09-14T12:09:53.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.070+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17502707944761760598', time=2024-09-14T13:51:41.897216+0000, chain.objs.size()=1 2024-09-14T12:09:53.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.070+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nji4inkDLSfPxvILo0vvg0sSOIC3giW_0 2024-09-14T12:09:53.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.071+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17009637882879425337', time=2024-09-14T13:52:21.056479+0000, chain.objs.size()=1 2024-09-14T12:09:53.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.071+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.HflIvhP-EjhyWeQlY6wvZx0hEuABpBI_0 2024-09-14T12:09:53.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.072+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13759480354570146625', time=2024-09-14T13:52:21.584871+0000, chain.objs.size()=1 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.072+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zGnLWQkXTfdbCBXMOee2c9Z-qlOmNqE_0 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.072+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14014080938721948124', time=2024-09-14T13:52:21.815154+0000, chain.objs.size()=1 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.072+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-h0aq3Onn6b2Da2OvUw_DsRBGuTkD0N_0 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.072+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7610965523622915492', time=2024-09-14T13:52:21.994687+0000, chain.objs.size()=1 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.072+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XyvNdmXSkJCM9Y_I7I0bCEY4JLDE7re_0 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.073+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10293078120632353592', time=2024-09-14T13:52:22.844600+0000, chain.objs.size()=1 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.073+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Eaq0VgnfH-ZDGgxTeDE-vGadBKdb7Az_0 2024-09-14T12:09:53.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.073+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1655308321646948914', time=2024-09-14T13:52:23.067389+0000, chain.objs.size()=1 2024-09-14T12:09:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.073+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.g-XqYVFfJIvHbqx7jz4mQUxOCj7cU2G_0 2024-09-14T12:09:53.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.074+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2773495641209123180', time=2024-09-14T13:52:23.175298+0000, chain.objs.size()=1 2024-09-14T12:09:53.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.074+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fcH9ekeZKadbJJ1y6aC22tas3pMLcHZ_0 2024-09-14T12:09:53.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.074+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1731181082478925319', time=2024-09-14T13:52:23.187140+0000, chain.objs.size()=1 2024-09-14T12:09:53.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.074+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.d7H4iLhLlGkBH6jn7OHOwBPZ0w3MZT9_0 2024-09-14T12:09:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13612857452569610246', time=2024-09-14T13:52:23.532640+0000, chain.objs.size()=1 2024-09-14T12:09:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eXQW6U7NQk_KpgZqmpqJ01EpLIh_mh9_0 2024-09-14T12:09:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12767958822304986807', time=2024-09-14T13:52:24.387421+0000, chain.objs.size()=1 2024-09-14T12:09:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.uRnoqfvaFQEd9zK_Lw5DKOZd1ztyleJ_0 2024-09-14T12:09:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8196676674125412224', time=2024-09-14T13:52:24.689808+0000, chain.objs.size()=1 2024-09-14T12:09:53.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.50F30AIyLrykCbhOdwkp6CGmXsxZKzY_0 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12597332268349571248', time=2024-09-14T13:52:25.057601+0000, chain.objs.size()=1 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UQbtENvo8X_5AdF3VY6Vu_caPzncwIS_0 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3479548574576727103', time=2024-09-14T13:52:26.117260+0000, chain.objs.size()=1 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.076+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Af4w1qdO9lusvfxiZuoCBFXo6zIhmH2_0 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17914792865430896539', time=2024-09-14T13:52:26.128089+0000, chain.objs.size()=1 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GGfDelHiE3cih3aJ6T3UGOmQcs7I9dG_0 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11097915971763985931', time=2024-09-14T13:52:26.275531+0000, chain.objs.size()=1 2024-09-14T12:09:53.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kxNHXThtaJt_sOF0wkwfykzzYoux0JU_0 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9213980147635669580', time=2024-09-14T13:52:26.461934+0000, chain.objs.size()=1 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BFpGEx5ZRRmGbBnlTsNW3fVrU-tW3l8_0 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12918378438534148427', time=2024-09-14T13:52:26.610143+0000, chain.objs.size()=1 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0tr-wKBk5zWAFX3ZEWZjeGZ0KcJ1AlQ_0 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2171504025628886175', time=2024-09-14T13:52:26.722485+0000, chain.objs.size()=1 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MvXUMsbRmswRu4N7ujtEYU7lx1xIn45_0 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14693021983813827579', time=2024-09-14T13:52:26.769377+0000, chain.objs.size()=1 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RHRuQxFrN4y2_spnsXeA-KgSJ7Wnzva_0 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12276203915470141406', time=2024-09-14T13:52:26.773746+0000, chain.objs.size()=1 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rX0wOTwOccF8EqcETXE6nlA5zWFq8QB_0 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16759083872486488789', time=2024-09-14T13:52:26.779619+0000, chain.objs.size()=1 2024-09-14T12:09:53.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.079+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.g5yD7md6yp4XurWdGGSsNVVds_Wk6i__0 2024-09-14T12:09:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.080+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8745062716257139468', time=2024-09-14T13:52:27.553086+0000, chain.objs.size()=1 2024-09-14T12:09:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.080+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vaV1RHCjD9RAgxxOAEf_saPZEihw23r_0 2024-09-14T12:09:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.080+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2152585828694567002', time=2024-09-14T13:52:27.754889+0000, chain.objs.size()=1 2024-09-14T12:09:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.080+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LySN3ONg_4tJalh-_diH7qYNJ_-7S4u_0 2024-09-14T12:09:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3848905683760129118', time=2024-09-14T13:52:27.822017+0000, chain.objs.size()=1 2024-09-14T12:09:53.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JzTvBiN_zJSKzNjzMnDKsyVJHYNNIKp_0 2024-09-14T12:09:53.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16567291384412475381', time=2024-09-14T13:52:27.896007+0000, chain.objs.size()=1 2024-09-14T12:09:53.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lIJuuncZaCAIFR265QY4BVyliGMBa4Y_0 2024-09-14T12:09:53.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15626108733806521366', time=2024-09-14T13:52:28.025732+0000, chain.objs.size()=1 2024-09-14T12:09:53.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.i-wSbLWc8SqrDpRigo1_ng9j3iQPJMv_0 2024-09-14T12:09:53.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4993698373551164655', time=2024-09-14T13:52:28.762780+0000, chain.objs.size()=1 2024-09-14T12:09:53.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JauTYbfVZDTNCzYX53J8sLFDj-Vf8Kn_0 2024-09-14T12:09:53.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15122417252795517586', time=2024-09-14T13:52:29.110394+0000, chain.objs.size()=1 2024-09-14T12:09:53.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xnJUMjPdQzbQnBHdni7Y_0V3YYFKScz_0 2024-09-14T12:09:53.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14208455748845835320', time=2024-09-14T13:52:29.228326+0000, chain.objs.size()=1 2024-09-14T12:09:53.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fgkLfg4cRPuMI6z5qB1BAsVIqFHsTOa_0 2024-09-14T12:09:53.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.087+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2799183085991787359', time=2024-09-14T13:52:29.544336+0000, chain.objs.size()=1 2024-09-14T12:09:53.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.087+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BmlZuhhm8f3wWE6orpsY5pNfTsGCf4y_0 2024-09-14T12:09:53.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.090+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48446 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1033473219907159114', time=2024-09-14T13:52:29.683725+0000, chain.objs.size()=1 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0XO1Ai7I4gsz8Z7-YpxXzIWcjBy8Due_0 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.893793517586661647', time=2024-09-14T13:52:30.032726+0000, chain.objs.size()=1 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XpEyXhXVCKXYGcG4AKNs1Ak9lKZCpFy_0 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11550593643935862385', time=2024-09-14T13:52:30.342570+0000, chain.objs.size()=1 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Y-vbgiSLtyMqUMul0qA6a7u2oRU9KQs_0 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3352974083966487850', time=2024-09-14T13:52:30.399070+0000, chain.objs.size()=1 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-RM9fnvmeqaB2ASFl5SaPqrx3DeDz4w_0 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12546553797642603639', time=2024-09-14T13:52:30.483212+0000, chain.objs.size()=1 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AFi_d0df8f3j3crRVc7ctIWEgp4B8F__0 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6261142173704578098', time=2024-09-14T13:52:30.910299+0000, chain.objs.size()=1 2024-09-14T12:09:53.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wXAD6QpkZhDGXjH-45qXoGWHWRmJEK8_0 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3012552254153576179', time=2024-09-14T13:52:30.944410+0000, chain.objs.size()=1 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.llAE228xMUiCUMz_56JvkVJXY_saVGB_0 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11806675930385285705', time=2024-09-14T13:52:31.040241+0000, chain.objs.size()=1 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rRbWEEQMO7fEy2R41nuHcjs0zYxq_hX_0 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2182466025444414582', time=2024-09-14T13:52:31.365021+0000, chain.objs.size()=1 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RDEUrmt1JYe024uMi-_5U6T0w5iPfmp_0 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.553196498981778336', time=2024-09-14T13:52:31.590051+0000, chain.objs.size()=1 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4IhAG5ouq7R2RsuOp73C9y47T5agW65_0 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6804703261210729659', time=2024-09-14T13:52:31.784596+0000, chain.objs.size()=1 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.f6cTtsrgOGIdMKbwAlT1DQJckTHsc1Q_0 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8929322208684167073', time=2024-09-14T13:52:31.858630+0000, chain.objs.size()=1 2024-09-14T12:09:53.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2duXmaFrAh-n5KABUV1rNSVsM8tK2Dm_0 2024-09-14T12:09:53.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.098+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7532423393957703397', time=2024-09-14T13:52:32.079274+0000, chain.objs.size()=1 2024-09-14T12:09:53.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.098+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7s2BlkbPi4feXm4G9jdbIBo7LCFXfKY_0 2024-09-14T12:09:53.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.101+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12474085050516398277', time=2024-09-14T13:52:42.983618+0000, chain.objs.size()=1 2024-09-14T12:09:53.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.101+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.344__shadow_.81IxqgjTZ4nAvc4DCwDCEMJ9ZVpTL_V_0 2024-09-14T12:09:53.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.101+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2918917444058728982', time=2024-09-14T13:52:43.497440+0000, chain.objs.size()=1 2024-09-14T12:09:53.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.101+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.345__shadow_._MyGRjZGvZWbA6K-3D4i07cziFiw77t_0 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15203703997562354844', time=2024-09-14T13:53:11.477379+0000, chain.objs.size()=1 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.394__shadow:CReG05jjjctAhOXKC74XXJ8Wmtz0AEQ_.D68ZujwxHDSskXbSx1mpcEIwiVY68vF_0 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10273418701031628333', time=2024-09-14T13:53:48.244743+0000, chain.objs.size()=1 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.458__shadow_.pMsrGfuo2D7Kh9NJosbHGWHiOlRC0xS_0 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12502559469847106238', time=2024-09-14T13:54:02.529969+0000, chain.objs.size()=1 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.xpGzzOPoCSB7Hy7MZldbcFA09fvuNNh_0 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10929727161537946388', time=2024-09-14T13:54:02.566906+0000, chain.objs.size()=1 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.tENunJIsWkdqxKViihLCs_d5Ghr-TcD_0 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11275450598734530681', time=2024-09-14T13:56:24.310970+0000, chain.objs.size()=2 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~acPJ_dpAP3RuRk1yF-dkHGOSRQyg2Uw.1 2024-09-14T12:09:53.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~acPJ_dpAP3RuRk1yF-dkHGOSRQyg2Uw.2 2024-09-14T12:09:53.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17227987396652085273', time=2024-09-14T13:57:57.089576+0000, chain.objs.size()=1 2024-09-14T12:09:53.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:bjsoPiCBzZdBMcST8ob1NqPS40MDdSQ_.E3BaN1kExPz4rCZDrb3RtYHAasVx8T9_0 2024-09-14T12:09:53.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.187286658458271690', time=2024-09-14T13:58:37.613024+0000, chain.objs.size()=1 2024-09-14T12:09:53.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.102+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:sjwATJR5SvSV.l.U210haZrxbcdDTSw_.4F1FneR3sIMsxw5x80PKkPUytsxX_ax_0 2024-09-14T12:09:53.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.104+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14688833664287579170', time=2024-09-14T13:59:14.011281+0000, chain.objs.size()=1 2024-09-14T12:09:53.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.104+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.607__shadow_.ZayVJRhppRFWkWuPj6zCyat1t6oSiuJ_0 2024-09-14T12:09:53.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.106+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2112069700008006335', time=2024-09-14T14:03:55.578087+0000, chain.objs.size()=1 2024-09-14T12:09:53.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.106+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.670__shadow_.lLvLIAqi6Hn6hPgIS7IQhmCCBMcp1lm_0 2024-09-14T12:09:53.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.106+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18375136770620381081', time=2024-09-14T14:04:18.039328+0000, chain.objs.size()=1 2024-09-14T12:09:53.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.106+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.710__shadow:NNDPU4VdvlEteVEedLb-3S19S3PW.-L_.uk1vUMFvL0EBVh0W2rTCJGFuPwU7080_0 2024-09-14T12:09:53.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.107+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13417061991438445953', time=2024-09-14T14:06:34.765464+0000, chain.objs.size()=1 2024-09-14T12:09:53.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.107+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.764__shadow_.3yTzp5O2n0QmTZHGkwqpAcdlohxceiv_0 2024-09-14T12:09:53.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.112+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.120+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T12:09:53.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.121+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47004' 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12288644170845098182', time=2024-09-14T13:46:44.401601+0000, chain.objs.size()=3 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-LUKEWARM.2~lEhj8N-SO8eDgVg6keDevE96lfxjtft.1 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-LUKEWARM.2~lEhj8N-SO8eDgVg6keDevE96lfxjtft.2 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.159__multipart_mymultipart-LUKEWARM.2~lEhj8N-SO8eDgVg6keDevE96lfxjtft.3 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2851437707707722591', time=2024-09-14T13:47:34.469135+0000, chain.objs.size()=1 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.203__shadow_.pcYsrMfSPNsemYEb-DMt_is2PAVbYRa_0 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.695352088934698005', time=2024-09-14T13:49:05.266287+0000, chain.objs.size()=1 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.237__shadow_.ZUm7aHh9C9qWJJ78e7uD8SbzlXBzxuM_0 2024-09-14T12:09:53.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12283480207502977401', time=2024-09-14T13:49:17.809236+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.122+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.256__shadow_.NFjFJx05DReB-Al5IWMjj9RgdoOPAlD_0 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15130306948267780301', time=2024-09-14T13:49:58.995704+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UHcc7RMMynLkJLlDMUFVIq2yvPF89VN_0 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3438280825026566924', time=2024-09-14T13:49:59.342571+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.C_2M-qA9TT0qS1btT0T9lmFGWl-P7B-_0 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1000905303932688153', time=2024-09-14T13:49:59.587868+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HwNbc5xFbcioiirfs2KpvMcXBeQTs9t_0 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18391572510718375519', time=2024-09-14T13:49:59.618024+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BXguIYyby_AABp1EB9CR2bGyMv0H732_0 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12241124633008281036', time=2024-09-14T13:50:00.629287+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3MgjopP6g8XzE_Ad092guVurGbMiyKn_0 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4684124627532303088', time=2024-09-14T13:50:01.046257+0000, chain.objs.size()=1 2024-09-14T12:09:53.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4Ni3ImAr0pP7uzddYdK-gkIlFXq6FHH_0 2024-09-14T12:09:53.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10031920401546984416', time=2024-09-14T13:50:01.309473+0000, chain.objs.size()=1 2024-09-14T12:09:53.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.judIArBIQsO0dzwUdHFTA76kGNNl8MH_0 2024-09-14T12:09:53.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12247294625150166880', time=2024-09-14T13:50:02.009379+0000, chain.objs.size()=1 2024-09-14T12:09:53.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.V5hUxxVHbMcM8qDEmxsU8pby9dl-oZj_0 2024-09-14T12:09:53.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15223704689345085857', time=2024-09-14T13:50:02.273314+0000, chain.objs.size()=1 2024-09-14T12:09:53.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KETsQH7G4prPn40i0sDEIkjse-aLBx1_0 2024-09-14T12:09:53.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11937528203243161700', time=2024-09-14T13:50:02.454393+0000, chain.objs.size()=1 2024-09-14T12:09:53.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PapHtqdzizFrhgfKKmSUhtHU2BhCMrO_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1015492855748219536', time=2024-09-14T13:50:02.490547+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8Z2kuCcNAWhY4E9jO7tAIrVO47aTwCM_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17051292034333627871', time=2024-09-14T13:50:02.604667+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7TX493AQ37UF8-NLhGSk9U_VvlzEt2x_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11816540896774335462', time=2024-09-14T13:50:02.635412+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FivYg0hqLojviszUhHSklMhozDixwcI_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3521849658394945852', time=2024-09-14T13:50:02.947067+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AvARf4kIhE7D-VmnjkJ88m6r0JNp2lV_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12732126682019249191', time=2024-09-14T13:50:04.017980+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HGxTwRZ9PSDMWSOSIRrmD1Ojtx77Bvw_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18141544313663889180', time=2024-09-14T13:50:04.310033+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.uxAWhl3aooUTvYFikGyTH0N6aiPXvem_0 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15582782963704601890', time=2024-09-14T13:50:04.460676+0000, chain.objs.size()=1 2024-09-14T12:09:53.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lUdarW7AwyZirUUwt0k7WJ9WquhnmB0_0 2024-09-14T12:09:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.132+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9287076804566895290', time=2024-09-14T13:50:05.150603+0000, chain.objs.size()=1 2024-09-14T12:09:53.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.132+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.p_3ifu8I7Vz_izemkb1y2eWcUFhkgau_0 2024-09-14T12:09:53.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.135+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3419363414077413549', time=2024-09-14T13:50:06.225369+0000, chain.objs.size()=1 2024-09-14T12:09:53.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.135+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.B99JRahOC1og5eIWMphsXDNic6SN00d_0 2024-09-14T12:09:53.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3981529058224207280', time=2024-09-14T13:50:07.653980+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.w9qsalC-1YrI9p1KE9PRXYl2WE-SlnF_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15936663911154959334', time=2024-09-14T13:50:07.707466+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.N6mkPlDuDQpweqHROqAtlE0DqD3tnpa_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9148145312879244358', time=2024-09-14T13:50:08.001494+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l0fGhcNrT94bJlg6XVCL4PNjmNuLY72_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14520043102959570885', time=2024-09-14T13:50:08.137837+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.B-A4-7hIM0m_UKWale1Y0wTsS55ZMsD_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11535323964371390570', time=2024-09-14T13:50:08.530909+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tX51m3Pl3I2BCAYJVHDTu714zItQluB_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5259588277390040367', time=2024-09-14T13:50:08.570504+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ibs6lgv0qzr1jYzUxXljo1-4KGq-3KR_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14794302992894540021', time=2024-09-14T13:50:08.626129+0000, chain.objs.size()=1 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._l4f1IN5t6a86A60ve4OuEF7BC-nAQj_0 2024-09-14T12:09:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4522194791129419443', time=2024-09-14T13:50:08.914936+0000, chain.objs.size()=1 2024-09-14T12:09:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gJo8WZLw1ShLCzZqXj6UpX5lZA2hrqy_0 2024-09-14T12:09:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.142934750362328453', time=2024-09-14T13:50:09.076947+0000, chain.objs.size()=1 2024-09-14T12:09:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.blb1g9wHV4QJ8LRdpRhjKc2IK8XE2ko_0 2024-09-14T12:09:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16507090521389849491', time=2024-09-14T13:50:09.338455+0000, chain.objs.size()=1 2024-09-14T12:09:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jLbcVV8W_ZVAOttOJloSjD-YRpUJvl8_0 2024-09-14T12:09:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.140+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8755253759114989551', time=2024-09-14T13:50:11.663134+0000, chain.objs.size()=1 2024-09-14T12:09:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.140+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.265__shadow_.X7lCRRLDdMWYpNlrtNMtPpZZ-QhQRJd_0 2024-09-14T12:09:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.140+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17293802158721776304', time=2024-09-14T13:50:25.308463+0000, chain.objs.size()=1 2024-09-14T12:09:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.140+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.287__shadow_.iCNkbkcochJ3wA229f5Cy83HrB8bH4B_0 2024-09-14T12:09:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.140+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7178015909461243083', time=2024-09-14T13:50:27.171514+0000, chain.objs.size()=1 2024-09-14T12:09:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.140+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.290__shadow_.WgFpzugKy5IxwxvVV41zYROtif4xLwo_0 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4983271088463464142', time=2024-09-14T13:50:27.173792+0000, chain.objs.size()=1 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.290__shadow_.-82U5hftoCxEHSzu9TAeYH12gfrbTc8_0 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14660936426506140372', time=2024-09-14T13:50:31.653505+0000, chain.objs.size()=1 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.QQ0idpuuog_42SPzalm3LzFS7dxzlr2_0 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14454367486034248342', time=2024-09-14T13:50:31.678717+0000, chain.objs.size()=1 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.pQzYVe7jQQUWRD3PNTAPB5iWgop3DBS_0 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8056490041437947777', time=2024-09-14T13:50:34.340188+0000, chain.objs.size()=1 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.297__shadow_.JXdks9q4pAWx8OuxrDcO1LMKGZGVIr-_0 2024-09-14T12:09:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14195742245513238824', time=2024-09-14T13:50:38.950927+0000, chain.objs.size()=1 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.304__shadow_.ForNG1XWINJmJ1B0Y8LaJIO_xqBBOP-_0 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6129684782464023057', time=2024-09-14T13:50:49.326371+0000, chain.objs.size()=1 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.319__shadow:dOQO5Xi2dURMBLWfVTy.Jtoj8xKXPWD_.RXZawpv6yy8Q9kiRt2-_LNCrupXLlec_0 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12930085689726915942', time=2024-09-14T13:51:31.444199+0000, chain.objs.size()=1 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oDVQRBRo7ywWA1rlLXS4rPar7oE8Xny_0 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1778184706954380586', time=2024-09-14T13:51:31.687341+0000, chain.objs.size()=1 2024-09-14T12:09:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.143+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mUwmxHW0MpWSpNkMBvkf3RZXKy3bGZ__0 2024-09-14T12:09:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2899324199684479724', time=2024-09-14T13:51:32.256454+0000, chain.objs.size()=1 2024-09-14T12:09:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tpdSd1wqg9zYPjdXbwUahADodPd4wAO_0 2024-09-14T12:09:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14283363742951733798', time=2024-09-14T13:51:32.892688+0000, chain.objs.size()=1 2024-09-14T12:09:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BkWrniJ4G2op-JyJ_c68IRM7Jy2EmGv_0 2024-09-14T12:09:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.333208498198390342', time=2024-09-14T13:51:33.110488+0000, chain.objs.size()=1 2024-09-14T12:09:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yUoMWJnSce7I-hfh7-RLKedsdV2lugC_0 2024-09-14T12:09:53.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4845102489869307326', time=2024-09-14T13:51:34.091189+0000, chain.objs.size()=1 2024-09-14T12:09:53.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QphZVrp1o2YHOeQIEQFzeKc_rSbNHxo_0 2024-09-14T12:09:53.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12685099158011252487', time=2024-09-14T13:51:34.162444+0000, chain.objs.size()=1 2024-09-14T12:09:53.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xszGkJi2eCew0DA7y4g19QXCSR5xKk4_0 2024-09-14T12:09:53.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2051649725366643596', time=2024-09-14T13:51:34.343210+0000, chain.objs.size()=1 2024-09-14T12:09:53.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6c8qyLL9TxJTlU-tXmB7J--n_Veop4w_0 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6792986137958362897', time=2024-09-14T13:51:34.688971+0000, chain.objs.size()=1 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TN8cP2WCHUPLxG1Z2glFJco-SLVPrng_0 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.368114123036118867', time=2024-09-14T13:51:35.941628+0000, chain.objs.size()=1 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.T6qkhBzDgxlk-7RcOSTx6CHOK5nU8Lx_0 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12120299658246197521', time=2024-09-14T13:51:36.085119+0000, chain.objs.size()=1 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.THnW3jQEiP61JJheSIuTU4fzRqa9iAy_0 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7721613463672587037', time=2024-09-14T13:51:37.008151+0000, chain.objs.size()=1 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uQpf9aRAI0iI1gHdNksfHsec9kIERgD_0 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10557598206947191976', time=2024-09-14T13:51:37.599435+0000, chain.objs.size()=1 2024-09-14T12:09:53.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.T9FmlhbM3j03LJqgYbmSMV3or5xD9kY_0 2024-09-14T12:09:53.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.153+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8480497435795267699', time=2024-09-14T13:51:37.632880+0000, chain.objs.size()=1 2024-09-14T12:09:53.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.153+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.iTXGxpJUdfooXsO5ff5pI5EbPxkP643_0 2024-09-14T12:09:53.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.153+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1333265341882051401', time=2024-09-14T13:51:37.837353+0000, chain.objs.size()=1 2024-09-14T12:09:53.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.153+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jJjZIPXXZCAG6jaqtddD-hXsPB_jA0b_0 2024-09-14T12:09:53.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.153+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17552436908374774900', time=2024-09-14T13:51:38.277263+0000, chain.objs.size()=1 2024-09-14T12:09:53.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.153+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.n-eQkw8wNsh6vWLdkfcVkfD0h2Z_V-C_0 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18099263012619860273', time=2024-09-14T13:51:38.278452+0000, chain.objs.size()=1 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5xRA-c4GcmLl33yUE6WgRoZVPnSbW8v_0 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8983297031950584272', time=2024-09-14T13:51:38.429657+0000, chain.objs.size()=1 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7Snt_uxB9ZH4P-QyOX_whXn0PkZceVj_0 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.344651067812825154', time=2024-09-14T13:51:39.016822+0000, chain.objs.size()=1 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ob58lvu3-otsKRZQf-nPI2BivWjOlb8_0 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2534621520705699280', time=2024-09-14T13:51:39.017918+0000, chain.objs.size()=1 2024-09-14T12:09:53.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.o01mfZCza1gAtJjEU8nWjB_F_ylQMcE_0 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12060085293888223620', time=2024-09-14T13:51:39.344210+0000, chain.objs.size()=1 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MhF6ux9aDb9PO6n_QEH96h21NzRXEGt_0 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2110742989260562076', time=2024-09-14T13:51:39.851457+0000, chain.objs.size()=1 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ThnXGBvH1tiy7NGTCp1WMx36cHfKqtT_0 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7413238480324196795', time=2024-09-14T13:51:40.325657+0000, chain.objs.size()=1 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xvL5sdsqJi_-QxBYL_FKhDE36GqdchN_0 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6282454515814076481', time=2024-09-14T13:51:40.474425+0000, chain.objs.size()=1 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BlV1AUcezoJ80_HlRnB0RMzxpuVDTFJ_0 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.930672817748340635', time=2024-09-14T13:51:40.573377+0000, chain.objs.size()=1 2024-09-14T12:09:53.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.J-pc_pOvPDuX_x8bJqqoxanYLej21zO_0 2024-09-14T12:09:53.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.158+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17512677258197821625', time=2024-09-14T13:51:40.741528+0000, chain.objs.size()=1 2024-09-14T12:09:53.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.158+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kaK9iW9iCYd2kHaleG-M6myIZGHe-eU_0 2024-09-14T12:09:53.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.158+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17163740561170738079', time=2024-09-14T13:51:41.215967+0000, chain.objs.size()=1 2024-09-14T12:09:53.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.158+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.CXjsQjj1-dnhIukfE8LmRdyLPYh5Vio_0 2024-09-14T12:09:53.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5212823603142489957', time=2024-09-14T13:51:41.274509+0000, chain.objs.size()=1 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7iUn_uOoVYmG0eFYskarjJ2JsoR2xbF_0 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16061743082167187486', time=2024-09-14T13:51:41.896013+0000, chain.objs.size()=1 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yk4Ivzw8YEimbryHRqqWTuNqb24OzIo_0 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7168761612743560183', time=2024-09-14T13:52:21.148445+0000, chain.objs.size()=1 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LtZW6dTT4JAniJ_tXli-xpzkFjqesqK_0 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11050889040466114255', time=2024-09-14T13:52:21.442651+0000, chain.objs.size()=1 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lEP6k6xrGpJ2y1Szq8R34dv-p_uRBaw_0 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15799677672622780217', time=2024-09-14T13:52:21.552851+0000, chain.objs.size()=1 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qCmmV-UURfhSiSuoclUKqs8yxA4e7hz_0 2024-09-14T12:09:53.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2428469585457196978', time=2024-09-14T13:52:22.027108+0000, chain.objs.size()=1 2024-09-14T12:09:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.162+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eflpmpKATdeaGakH7nzoTjg3bzkyjh4_0 2024-09-14T12:09:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18155743852950055264', time=2024-09-14T13:52:22.169118+0000, chain.objs.size()=1 2024-09-14T12:09:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZPbnxRef_iAJ_zWdmbSG71C1_NxZ1zT_0 2024-09-14T12:09:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1395027575174138119', time=2024-09-14T13:52:23.683022+0000, chain.objs.size()=1 2024-09-14T12:09:53.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.p8Ea0Gnnau90G0ElR9Z3YlO2V8OEfeY_0 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2539255113713408586', time=2024-09-14T13:52:23.707488+0000, chain.objs.size()=1 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wwFhddY6zfgpbYlJKNQFbDZehiN4DUd_0 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17204700872408529519', time=2024-09-14T13:52:24.235402+0000, chain.objs.size()=1 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WKWmYW_ZolpFxd3Jaf3IAljqO8UrZDp_0 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5163697195944114272', time=2024-09-14T13:52:24.343199+0000, chain.objs.size()=1 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qnNMFNjlAyrYA13_-bSt4C8DFHJIT1f_0 2024-09-14T12:09:53.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17493460955988102451', time=2024-09-14T13:52:26.155827+0000, chain.objs.size()=1 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9-vhKAv_TFMU86MVQVv_-mjbT2W9XTH_0 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17175979883518275845', time=2024-09-14T13:52:26.225295+0000, chain.objs.size()=1 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Fpqgu30HGRbeI7tY_hsZ0Md30MOf6Xu_0 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17169723351403118201', time=2024-09-14T13:52:26.397578+0000, chain.objs.size()=1 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VzSRncizRUm1KDj0LJorcz8-zb78bUS_0 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16331411792228394066', time=2024-09-14T13:52:26.412276+0000, chain.objs.size()=1 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.N6uaVundkztwryGX1lrDLXu1H6KruOa_0 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5079597253501184843', time=2024-09-14T13:52:26.596232+0000, chain.objs.size()=1 2024-09-14T12:09:53.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.165+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VbWXfPYTo1qcDkqUqn_OiK4o4M044kW_0 2024-09-14T12:09:53.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.166+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14598246034928214824', time=2024-09-14T13:52:27.203621+0000, chain.objs.size()=1 2024-09-14T12:09:53.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.166+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.645cVmHCjZQcfmE7HjBaWnAh8WwSL24_0 2024-09-14T12:09:53.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.167+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1685777816143638289', time=2024-09-14T13:52:28.201894+0000, chain.objs.size()=1 2024-09-14T12:09:53.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.167+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mNzEe0z9TPGX83ucPzeEd-WqhKNrLkG_0 2024-09-14T12:09:53.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13919565595458808278', time=2024-09-14T13:52:28.248679+0000, chain.objs.size()=1 2024-09-14T12:09:53.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.W9xNXQPxnkzE9RVVPZHpOOM-SqjDd4O_0 2024-09-14T12:09:53.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6793400654938335928', time=2024-09-14T13:52:28.254401+0000, chain.objs.size()=1 2024-09-14T12:09:53.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5PCMddM5SG7t4Mw8I5G1PDH-1E8dnj-_0 2024-09-14T12:09:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8681099997233241433', time=2024-09-14T13:52:29.274479+0000, chain.objs.size()=1 2024-09-14T12:09:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DFL408VH5DmOrqwYL2Bt4Py-8MwejDW_0 2024-09-14T12:09:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.695570111770688377', time=2024-09-14T13:52:29.370224+0000, chain.objs.size()=1 2024-09-14T12:09:53.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.168+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pUjYE5iL7U1CK4NY_etJHGRi_qnXiS1_0 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18347240542164155193', time=2024-09-14T13:52:29.442376+0000, chain.objs.size()=1 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EgTAKqJENLnR6hPo6STQ2zWeOczHfpn_0 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12535488526677774109', time=2024-09-14T13:52:29.639084+0000, chain.objs.size()=1 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vqOfQb8bmbig6y_Ov_uKO-uifHhiHnT_0 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9079344341906965664', time=2024-09-14T13:52:30.222089+0000, chain.objs.size()=1 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.uTdttoZUZ8vTNh0gneifbEjftkIZGGb_0 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14486515131875032685', time=2024-09-14T13:52:30.461220+0000, chain.objs.size()=1 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JRsSVg6SzHi84Aif1YBuNv4GvMR2vNZ_0 2024-09-14T12:09:53.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8892830815824331187', time=2024-09-14T13:52:30.808260+0000, chain.objs.size()=1 2024-09-14T12:09:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MviYnJgLgRKWZ1m7B4Ip5MXCLwr4Vij_0 2024-09-14T12:09:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.170+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16713162420734377412', time=2024-09-14T13:52:30.808802+0000, chain.objs.size()=1 2024-09-14T12:09:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.170+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mR-pWO1UsyivDhD8UYY5tsNi0hMNLiZ_0 2024-09-14T12:09:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.171+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17461729723370191138', time=2024-09-14T13:52:31.920893+0000, chain.objs.size()=1 2024-09-14T12:09:53.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.171+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dj50rQGgo47xEixw9dnkNFiq95G1Jbt_0 2024-09-14T12:09:53.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.171+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8385666680550593931', time=2024-09-14T13:52:32.136459+0000, chain.objs.size()=1 2024-09-14T12:09:53.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.171+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Wb9gGXQ3SnEao3xigyiahiRFbZU0br-_0 2024-09-14T12:09:53.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.172+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4524350439199272573', time=2024-09-14T13:52:34.686664+0000, chain.objs.size()=1 2024-09-14T12:09:53.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.172+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.329__shadow_.on5ZkvWd_Ck3NIHPBapwAa77SKNE_sZ_0 2024-09-14T12:09:53.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.175+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47004 2024-09-14T12:09:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T12:09:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17502461529822264307', time=2024-09-14T13:54:02.567063+0000, chain.objs.size()=1 2024-09-14T12:09:53.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_._Dmy2wD3JOdHJXKgcg_x23sLDdE0anh_0 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4065550947615671971', time=2024-09-14T13:55:07.734105+0000, chain.objs.size()=3 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~D1rANuZQ0NZUnNtQFprJuRnNkYzx4m9.1 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~D1rANuZQ0NZUnNtQFprJuRnNkYzx4m9.2 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~D1rANuZQ0NZUnNtQFprJuRnNkYzx4m9.3 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu', time=2024-09-14T13:55:47.818927+0000, chain.objs.size()=1 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu.2 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu', time=2024-09-14T13:55:47.823185+0000, chain.objs.size()=1 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu.3 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZJNozVoCLNs6sDsPDy2IvOcgHcy0c-V', time=2024-09-14T13:56:44.254471+0000, chain.objs.size()=1 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.535__multipart_mymultipart.2~ZJNozVoCLNs6sDsPDy2IvOcgHcy0c-V.3 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16598380465002395663', time=2024-09-14T13:57:23.522763+0000, chain.objs.size()=2 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.552__shadow_.o2MAK49594vHdVOcwmwDFD6XsJNsAlu_0 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.552__shadow_.o2MAK49594vHdVOcwmwDFD6XsJNsAlu_1 2024-09-14T12:09:53.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18180985500261148014', time=2024-09-14T13:57:39.710263+0000, chain.objs.size()=2 2024-09-14T12:09:53.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.558__shadow_.ILn8Khk32txjaCp-Qkj4X-FwBbA6r-i_0 2024-09-14T12:09:53.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.558__shadow_.ILn8Khk32txjaCp-Qkj4X-FwBbA6r-i_1 2024-09-14T12:09:53.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12279007872451801124', time=2024-09-14T13:57:58.474876+0000, chain.objs.size()=1 2024-09-14T12:09:53.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.177+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:5HoXl8311W58h0l3TXTsM2uEPRlkRh0_.nTUPhxFkNpP6VM371v633umzSu1Z2CE_0 2024-09-14T12:09:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1008890947577690455', time=2024-09-14T13:58:10.216006+0000, chain.objs.size()=1 2024-09-14T12:09:53.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:v9KFYCNfuQ8KepxjT4FeI7ptFCio0F5_.bp22W8akpEwQn9kBgEUtky4NH_SUoO-_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1950590621802740550', time=2024-09-14T13:58:13.152881+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.575__shadow_.UVVd2WJFdAawEHKcAXFVuCzvFh0JHVv_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7555904000702216285', time=2024-09-14T13:58:57.739354+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:fHbIaWgxXwr5whlZPM.0sw4dLBoPf0F_.GlqVSPi6Lb1kRE9bcAEeEkM8QSRHNBb_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4996629636507161860', time=2024-09-14T14:03:25.084520+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.652__shadow_.zmSg29MvUFF8u91gVY-SIyZz_nSCKTL_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3509089865690068135', time=2024-09-14T14:03:52.767913+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.665__shadow_.d8YpmU8EQso5qcoDd3gokBpVLl6ud5h_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17479150925656129064', time=2024-09-14T14:04:08.424112+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.695__shadow_.xmftDiE_crPjB2Q_N_0uahCeVqjec-n_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15658498761580951266', time=2024-09-14T14:04:11.554736+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.700__shadow:LXSTKOLGiosqhL56fe8hdAlCxEe93KK_.iwghzbGEUKuq3oQ7vdCmSiuJQzlgK21_0 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6213146885059871079', time=2024-09-14T14:06:45.981973+0000, chain.objs.size()=1 2024-09-14T12:09:53.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.182+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.769__shadow_.GHuNa04z4H-bRjtgMnWbCUWPFW2-S6O_0 2024-09-14T12:09:53.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.189+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.191+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T12:09:53.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.192+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48835' 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8923440443315580624', time=2024-09-14T13:46:37.390115+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.157__shadow:Q9e9gdFZq7seXPS.kxzMGH0Vx8ToNke_.VGJJYuyLFOnlpzMC0ZgViqwISgSi0rF_0 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10357915849453379160', time=2024-09-14T13:49:06.123154+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.238__shadow_.W_uS3S9H2gGv0LIhdoaymq-lB5Yw0_T_0 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17418595538226185151', time=2024-09-14T13:49:14.608181+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.251__shadow_.iO0ud7crtP0B9nuXr_7NsmKuPkctpU7_0 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3200458831567632185', time=2024-09-14T13:49:58.995531+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KSn9L5nC8O1J-to8MULLpnWtp6xJ7qh_0 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1622853445801339773', time=2024-09-14T13:49:59.121109+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fgokHrWwPgQUUZY3Ix7xYR_EvEjBKYD_0 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8962150025900962359', time=2024-09-14T13:49:59.619405+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.67xnlhqtjUdNifBYaPLSMGhp4-fhb14_0 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3167315318899226375', time=2024-09-14T13:49:59.883151+0000, chain.objs.size()=1 2024-09-14T12:09:53.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.047ZmK-QvgkiS8IJmkHzvWw-iAtOvo3_0 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12014899923686417041', time=2024-09-14T13:50:00.892709+0000, chain.objs.size()=1 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.q4IgllqtIpdFHrLRZvXh5mKXGagT2bs_0 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10949617231277342465', time=2024-09-14T13:50:00.925821+0000, chain.objs.size()=1 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZT4HZx8zklyhadCgSEYAuNhIOLiZ1GT_0 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15564297548241608513', time=2024-09-14T13:50:01.059232+0000, chain.objs.size()=1 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mnDCFx0SPgoPptyEZZBTSmlO8l0FmWR_0 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5212225784113850658', time=2024-09-14T13:50:01.138841+0000, chain.objs.size()=1 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._MfOrXmlkWDGtpNb_P5ULXdLZMMN7AJ_0 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5957298689044844283', time=2024-09-14T13:50:02.353759+0000, chain.objs.size()=1 2024-09-14T12:09:53.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Jr6QXrxg6bHOF9whtC3TyU1gUcOwVkV_0 2024-09-14T12:09:53.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.197+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10028072314812522509', time=2024-09-14T13:50:02.454362+0000, chain.objs.size()=1 2024-09-14T12:09:53.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.197+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FJ5Qqxwq2V9h8QHPhZxcZ4gz4kbRMvO_0 2024-09-14T12:09:53.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.197+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8106212128754511573', time=2024-09-14T13:50:02.455017+0000, chain.objs.size()=1 2024-09-14T12:09:53.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.197+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.K9dm4ooPx_o2cBeMTW4tSDeUQbY7T2y_0 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1538086182625093347', time=2024-09-14T13:50:03.454003+0000, chain.objs.size()=1 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0Mgffw2UgaaJxbntl2DTXeZxU5UiRm4_0 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15379065558086888987', time=2024-09-14T13:50:03.455249+0000, chain.objs.size()=1 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hizJbVc3B5AcclzXxaDAnc1Ti6tII6U_0 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10468280053153181727', time=2024-09-14T13:50:03.742605+0000, chain.objs.size()=1 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.veG1KjzpKgwoincZfgGMp37mc5gfvhK_0 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6420418423255021537', time=2024-09-14T13:50:04.154282+0000, chain.objs.size()=1 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FB0b9dpWyTjpHZudnzw1q2W1ZE8UEaV_0 2024-09-14T12:09:53.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17010164243830491061', time=2024-09-14T13:50:04.842807+0000, chain.objs.size()=1 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._NMjug_Su6_SuFafp3y5pJ5CSnwmv-6_0 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4448154200374060778', time=2024-09-14T13:50:05.316793+0000, chain.objs.size()=1 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SfxMHxeLx0MK1-keOfMl6q7V0zs_EJG_0 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6030744012002101813', time=2024-09-14T13:50:06.223861+0000, chain.objs.size()=1 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wl1l6qLQBXYmGaA626BOxZRZvYE1GSO_0 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16558187481446516977', time=2024-09-14T13:50:06.226641+0000, chain.objs.size()=1 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.smE5KPuwH0bC6hREj6uzfTf99ApQAp8_0 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16489820548233312278', time=2024-09-14T13:50:06.866037+0000, chain.objs.size()=1 2024-09-14T12:09:53.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.199+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CyHit-YdmmpV_5UC-mQwUZEXUskl4kp_0 2024-09-14T12:09:53.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.202+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3386010949614914033', time=2024-09-14T13:50:07.234475+0000, chain.objs.size()=1 2024-09-14T12:09:53.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.202+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qsw3OE2U6KmQNq8io-fqx8UPtoLx9NE_0 2024-09-14T12:09:53.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.202+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14381190418096077307', time=2024-09-14T13:50:08.444333+0000, chain.objs.size()=1 2024-09-14T12:09:53.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.202+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.t4yRdrPr3UWNhNwtZIiWDG0c5OLomAS_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2224721294487952223', time=2024-09-14T13:50:08.445948+0000, chain.objs.size()=1 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IHKq22dtElHQEoF1O7BDC8xRJsh9nd-_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.261626554941800389', time=2024-09-14T13:50:08.598985+0000, chain.objs.size()=1 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.o5mFEylHL0IUtzw1NzrM_zc3SpgBX5a_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18171486753566866512', time=2024-09-14T13:50:16.959781+0000, chain.objs.size()=1 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.274__shadow_.WBOMm3zGYAtp5EDPtDkukjcWZ0F7VCT_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12970194154107482713', time=2024-09-14T13:50:22.631220+0000, chain.objs.size()=1 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.283__shadow_.FTvdwg6G93G20EF1X2DB24bYOqdIPvb_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6318080244798739484', time=2024-09-14T13:50:24.678067+0000, chain.objs.size()=1 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.286__shadow_.OhJGBbN-bj1aFUx3pK0t60Vm2VREl9O_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13533016302027794874', time=2024-09-14T13:50:29.786177+0000, chain.objs.size()=1 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.0ZqQqKy6MBqBtYW4MsuGz2vyjW92WS3_0 2024-09-14T12:09:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7404257880391748292', time=2024-09-14T13:50:33.711065+0000, chain.objs.size()=1 2024-09-14T12:09:53.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.203+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.296__shadow_.e7tlGVpyPr9DD7aIXDtuEH0WzB2YJww_0 2024-09-14T12:09:53.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.204+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12796889518909476837', time=2024-09-14T13:50:34.340623+0000, chain.objs.size()=1 2024-09-14T12:09:53.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.204+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.297__shadow_.a_TJPxsHGme7O0YuytoIO1qGh9j7xxz_0 2024-09-14T12:09:53.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.204+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11003654634854460537', time=2024-09-14T13:50:34.341368+0000, chain.objs.size()=1 2024-09-14T12:09:53.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.204+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.297__shadow_.cDYxgS-yf4HqVPfysna0tJohqWC1NC2_0 2024-09-14T12:09:53.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.206+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2053742127400638617', time=2024-09-14T13:50:35.019061+0000, chain.objs.size()=1 2024-09-14T12:09:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.206+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.298__shadow_.SIyg2WI3k_7J1Vdt7UM1niGShDF7L-b_0 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12075843965748361700', time=2024-09-14T13:50:38.340230+0000, chain.objs.size()=1 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.303__shadow_.nkU1kb4S3ytu_zZVNl0cFlYx09LAY-f_0 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13775241261978273084', time=2024-09-14T13:51:31.222901+0000, chain.objs.size()=1 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UKJFziQsYCKuSXamkTqn6s0IpXbS7Pj_0 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2033721474601196969', time=2024-09-14T13:51:31.444184+0000, chain.objs.size()=1 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.F2Xu52dlZZmyKQMmY2sCtMS6-dFBm6v_0 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17152326405134796910', time=2024-09-14T13:51:31.647440+0000, chain.objs.size()=1 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Or6XmVaMfq93p5HG-J6R6hGXVXmScgx_0 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3880307487661032972', time=2024-09-14T13:51:32.316427+0000, chain.objs.size()=1 2024-09-14T12:09:53.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zxKFsYimBd7CXM8AesBk5d2o3qwAUMg_0 2024-09-14T12:09:53.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11725373034267541434', time=2024-09-14T13:51:32.361063+0000, chain.objs.size()=1 2024-09-14T12:09:53.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.208+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rBbAaAEpywSYavstQGnnR25i07LGD4f_0 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15514710014713427885', time=2024-09-14T13:51:33.268986+0000, chain.objs.size()=1 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GodfGWpQJUCoefqsV1tWt-dTJTuKRAj_0 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10755060680337601526', time=2024-09-14T13:51:33.830940+0000, chain.objs.size()=1 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BWOxI69O0b6NATghrbgAiYMoJpx4wA0_0 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14967070770159265909', time=2024-09-14T13:51:33.927606+0000, chain.objs.size()=1 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-3lzpFFKGEzQa9ym9GbYjaSWcKy9h6W_0 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4658785908905733832', time=2024-09-14T13:51:34.186931+0000, chain.objs.size()=1 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZWLo0GIZTV8wIR7AxqaUlvaowpqKwVk_0 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3784806574834943794', time=2024-09-14T13:51:34.268288+0000, chain.objs.size()=1 2024-09-14T12:09:53.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dxZfIuScpa9NNRnbdQrF7ArnjTBvYzK_0 2024-09-14T12:09:53.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5388829815385542423', time=2024-09-14T13:51:34.343686+0000, chain.objs.size()=1 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nXDOGx2K1-3nEjM1Nt4hyRwxUBjCU_9_0 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8156028149888406848', time=2024-09-14T13:51:34.552491+0000, chain.objs.size()=1 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rcVpTmVWgnCROtbWvvHvVJ0XTyiIyi-_0 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3758450782813762890', time=2024-09-14T13:51:34.618775+0000, chain.objs.size()=1 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BX4P4g7eswXP-2ckJtQZ7EmJg7F16--_0 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13124379736653766714', time=2024-09-14T13:51:34.744801+0000, chain.objs.size()=1 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tHdGjoNiBkz1BSXrqo3L6n5xME5wyqc_0 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9654578554963788071', time=2024-09-14T13:51:35.394872+0000, chain.objs.size()=1 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JTQ31n6C3K75MTryIT1Hg_aO2ETStOm_0 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15259623509191607912', time=2024-09-14T13:51:35.526528+0000, chain.objs.size()=1 2024-09-14T12:09:53.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.u9gbe8KVTVnMn9PvQtK36JqozC0GjA9_0 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18398590007471603678', time=2024-09-14T13:51:35.527982+0000, chain.objs.size()=1 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nTnWrPFchxcQn5xApn7abX6ID4A71m3_0 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6176359961777678339', time=2024-09-14T13:51:36.177597+0000, chain.objs.size()=1 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.i_jMcSFEQHD5RfP7JnEX27aNwx_XYRd_0 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17794569061945676262', time=2024-09-14T13:51:36.408155+0000, chain.objs.size()=1 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.REB8FR0f-1T-35lmhaOHjuLAF2RHQMC_0 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1187508382931713183', time=2024-09-14T13:51:36.411295+0000, chain.objs.size()=1 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.monjUreqJ-G_uY_GuXelH17XJVjeR69_0 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8888348731121098290', time=2024-09-14T13:51:36.853205+0000, chain.objs.size()=1 2024-09-14T12:09:53.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VDSzcWE3WaXwzD1ym3lYMmCxKqT1odH_0 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7522370738176545087', time=2024-09-14T13:51:37.006772+0000, chain.objs.size()=1 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OIWMb39SP5yj4vHva0Yb88Dk9CCwNxJ_0 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11474148155470539533', time=2024-09-14T13:51:37.291788+0000, chain.objs.size()=1 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.s8bITIZ6kK9B_O6IzqBzxpz5vZbY9jU_0 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8196252843435974532', time=2024-09-14T13:51:37.292340+0000, chain.objs.size()=1 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JBBHiypZG2ZxbZjDLzoi4eii5ZhnVa9_0 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12763659633772834561', time=2024-09-14T13:51:37.514619+0000, chain.objs.size()=1 2024-09-14T12:09:53.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.217+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.04xavYP2y2oi1jUjVrTYsMCoivJ8csI_0 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3360749802999708043', time=2024-09-14T13:51:39.244337+0000, chain.objs.size()=1 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Zvc1GofZs41eAhoFs8LRowHNQy4tkq0_0 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6007180490265098595', time=2024-09-14T13:51:39.661468+0000, chain.objs.size()=1 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JQI-v5qSu5yux7ofPcmHegfziM0l5KO_0 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6292922893322945149', time=2024-09-14T13:51:39.798490+0000, chain.objs.size()=1 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8WFT-xwh7d1F-NH2tk7XaeRP5r6ZcJN_0 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5915074676870400057', time=2024-09-14T13:51:39.912729+0000, chain.objs.size()=1 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uXI37ve7EzkmbV19_yar-3L5bC7xyVY_0 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18205360659056910735', time=2024-09-14T13:51:40.284052+0000, chain.objs.size()=1 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.z9gQef7Tx2CbPgqAKJa4DSTjU6vL8yO_0 2024-09-14T12:09:53.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1251130308666206483', time=2024-09-14T13:51:40.670799+0000, chain.objs.size()=1 2024-09-14T12:09:53.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ehF8xZXi9Dp_YDMDU97eru8kXgmy5PU_0 2024-09-14T12:09:53.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6818334131639388660', time=2024-09-14T13:51:41.145095+0000, chain.objs.size()=1 2024-09-14T12:09:53.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oapcsJkBvm2PCciqjSNFL8ZeaSHpr3o_0 2024-09-14T12:09:53.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.220+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3520324082663035628', time=2024-09-14T13:51:41.211148+0000, chain.objs.size()=1 2024-09-14T12:09:53.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.220+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.W3ZrS7gkUyg636zdzDsotENunoESruk_0 2024-09-14T12:09:53.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4463595306309693771', time=2024-09-14T13:51:41.212286+0000, chain.objs.size()=1 2024-09-14T12:09:53.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._Ze7UCBgJanTu_49ziTYBfeYbrls1f7_0 2024-09-14T12:09:53.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1189764147472701979', time=2024-09-14T13:51:41.370288+0000, chain.objs.size()=1 2024-09-14T12:09:53.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.USg712eTXWvca-zycizU5OQAH33xb0T_0 2024-09-14T12:09:53.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2482638319424518265', time=2024-09-14T13:51:41.371348+0000, chain.objs.size()=1 2024-09-14T12:09:53.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PiGS4NBGqpeJhlee4sadUA_2xFP3wXt_0 2024-09-14T12:09:53.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16028233607504034169', time=2024-09-14T13:51:41.895912+0000, chain.objs.size()=1 2024-09-14T12:09:53.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fSSTUvn-wlzF_3fYUSbnjgJVXXyTEiI_0 2024-09-14T12:09:53.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17187992238690436494', time=2024-09-14T13:52:21.311964+0000, chain.objs.size()=1 2024-09-14T12:09:53.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EKnHinS_6V4g1mfmxUGtwd9Cob6i5Xt_0 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9104550497478054877', time=2024-09-14T13:52:21.853573+0000, chain.objs.size()=1 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.et6oFnL0s1Rqbi1D4LkBQS8zDUDsgwD_0 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2844322173263814076', time=2024-09-14T13:52:21.900840+0000, chain.objs.size()=1 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ulm5HOjfva1dpryjWVQoQH8LQZm-etk_0 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13059968580880257319', time=2024-09-14T13:52:22.043407+0000, chain.objs.size()=1 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dB39Lrqn6tQfXP41l9jeOTxo8p3O1PC_0 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13395563280649634418', time=2024-09-14T13:52:22.158363+0000, chain.objs.size()=1 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Y5ZrdmzrVAPozrehJdA5mBJnVnik5NF_0 2024-09-14T12:09:53.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13708783463110387580', time=2024-09-14T13:52:22.992564+0000, chain.objs.size()=1 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fgn9hEFsrTYT6-qlPYdN3W-PfrCm2bP_0 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.224+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9999335118736350044', time=2024-09-14T13:52:23.683039+0000, chain.objs.size()=1 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.224+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ICwC-YBNq9G9kMlVegwm8T0bJPMFk-f_0 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.224+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17847628745073983911', time=2024-09-14T13:52:24.408410+0000, chain.objs.size()=1 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.224+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hXDGZYFma_2oeiNawcsNg6CqbXTbJ3y_0 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.225+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12177506291452043793', time=2024-09-14T13:52:24.614954+0000, chain.objs.size()=1 2024-09-14T12:09:53.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.225+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cJVvxQWzQgv5xL5NJpMFfxebrlMDfWO_0 2024-09-14T12:09:53.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.225+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13559833907578908875', time=2024-09-14T13:52:24.776743+0000, chain.objs.size()=1 2024-09-14T12:09:53.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VLoslVQwZBiYfqujRJ_MoxzJOWpzpbS_0 2024-09-14T12:09:53.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4779323152967088983', time=2024-09-14T13:52:25.207774+0000, chain.objs.size()=1 2024-09-14T12:09:53.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FjZUj6Xkz_BFEVZXQ9os4uLfoDFVWyU_0 2024-09-14T12:09:53.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.686082832728842701', time=2024-09-14T13:52:25.248496+0000, chain.objs.size()=1 2024-09-14T12:09:53.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ptDsaVMEu_qs2XzH5FRanjigN6IEti3_0 2024-09-14T12:09:53.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7978449926511148939', time=2024-09-14T13:52:25.772114+0000, chain.objs.size()=1 2024-09-14T12:09:53.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.226+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RUCDBHKKAyBykyMzMmZXHp35oBVAChN_0 2024-09-14T12:09:53.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11759429150876021801', time=2024-09-14T13:52:26.055053+0000, chain.objs.size()=1 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.K4Kg5v2xbb4yrgj41dp2QO_dQlg_M7n_0 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18148519115960611246', time=2024-09-14T13:52:26.466315+0000, chain.objs.size()=1 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7Eq9L9w1fA0astLH5Q5xDRxZlm5jy4Y_0 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10795391606437595020', time=2024-09-14T13:52:26.522301+0000, chain.objs.size()=1 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.w0wSpGBxx1zFFWpnWtAU263N3udyyFW_0 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15364796849958632226', time=2024-09-14T13:52:26.546770+0000, chain.objs.size()=1 2024-09-14T12:09:53.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5EGC9Kqzoiw1AN6UWcl9EvXc2YLuHXO_0 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.229+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9503865740497761555', time=2024-09-14T13:52:27.203652+0000, chain.objs.size()=1 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.229+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._azzQvyCFXEkNlhQzX57FBnrejmW7cE_0 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.229+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17272628227311491483', time=2024-09-14T13:52:27.569912+0000, chain.objs.size()=1 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.229+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.D3nzxWOMGugs1ugYL7TjJJUhyXIpyyR_0 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.229+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16561237930677672488', time=2024-09-14T13:52:27.606560+0000, chain.objs.size()=1 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.229+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ixGQlYgeoBSSzBhH3mSXdOxDyPAk-Zo_0 2024-09-14T12:09:53.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16489811951788998919', time=2024-09-14T13:52:28.151062+0000, chain.objs.size()=1 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Cqc03SYkMJFSYkCNegZk2vDxGEJRK4Z_0 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13982025495813113336', time=2024-09-14T13:52:28.230466+0000, chain.objs.size()=1 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RpqhuxkERLKr0V5qts-9CpA81Hiy8ux_0 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11784631052248730427', time=2024-09-14T13:52:29.085765+0000, chain.objs.size()=1 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gwkrfNCDgpQjSG8_Q6eg3kp_GStO6di_0 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3802405203608325386', time=2024-09-14T13:52:29.115372+0000, chain.objs.size()=1 2024-09-14T12:09:53.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.230+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.V2XBMA_NInbzrkUmXv0EKIx3U8GDxEI_0 2024-09-14T12:09:53.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.233+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13146131218983432226', time=2024-09-14T13:52:29.476501+0000, chain.objs.size()=1 2024-09-14T12:09:53.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.233+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IbJPoAbFFeCMBVuApPhNTOxpkOVL080_0 2024-09-14T12:09:53.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.233+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10448538029947548629', time=2024-09-14T13:52:30.036854+0000, chain.objs.size()=1 2024-09-14T12:09:53.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.233+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._OV_TvINw5yUdZ8eIna0RhtvlyRO24Q_0 2024-09-14T12:09:53.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.233+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10592856039039232931', time=2024-09-14T13:52:30.941990+0000, chain.objs.size()=1 2024-09-14T12:09:53.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.233+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2BSv4DE_8hSSGKvLqIq4pIEJc6Ac9jZ_0 2024-09-14T12:09:53.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.239+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48835 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9356995970435116496', time=2024-09-14T13:52:31.510955+0000, chain.objs.size()=1 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wgzfEj9nIAM9j2_2O5sfzWoiDgxEQiL_0 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17688934012876241048', time=2024-09-14T13:52:31.660475+0000, chain.objs.size()=1 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MxxTsfIRvgUamfozmjOF-k3M1d2D17u_0 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6322016074106726871', time=2024-09-14T13:52:31.661059+0000, chain.objs.size()=1 2024-09-14T12:09:53.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mSB-soGJ50usvPQyL2Nk6L-Uihz7zbN_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6854142965102709867', time=2024-09-14T13:52:31.661518+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LORd3Ov0KADETbSsKFLYiCXAZwGoXOj_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2364541930820695527', time=2024-09-14T13:52:42.507358+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.343__shadow_.wfMYyi7Rkoz0rodAiay3GkARCZAjYRy_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2456339865665432461', time=2024-09-14T13:53:42.636928+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.450__shadow_._ksPAh0j4yDh8O-8Co6tZ4BpZAk2XTF_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.271239671067707312', time=2024-09-14T13:54:02.556846+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.U7g6wUBZYjL860MV93Xbt2ikwebCk94_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8264771508293702752', time=2024-09-14T13:58:00.309050+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:ODRK9Asipv6Fs57naTiaHJHamtJji9C_.ASCaffw7K_60pvhymGly5pMNhtHRpTP_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18158406169391820108', time=2024-09-14T13:58:03.326381+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:kyh0aOSrgyEFMTUM2m2H9FVIaxrmInW_.eroJVXb-_9acdUByHDRwdWDBPIeov4W_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2225928312150148074', time=2024-09-14T13:58:13.038832+0000, chain.objs.size()=1 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.575__shadow_.UVVd2WJFdAawEHKcAXFVuCzvFh0JHVv_0 2024-09-14T12:09:53.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6969500025751022728', time=2024-09-14T13:58:17.100035+0000, chain.objs.size()=1 2024-09-14T12:09:53.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:JDv1WRIvE5dZAQHCR7QhZMKdm3aCIzA_.97oNp5F3HTbPhCle9q6B5dNvJfPet9d_0 2024-09-14T12:09:53.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4954408096105755843', time=2024-09-14T13:58:26.277935+0000, chain.objs.size()=1 2024-09-14T12:09:53.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:MPH5KwShUgb9lQ5lsLCkoefc3vC4kBO_.ub7VwAKl1h1-ktMyFFFMtqfyw9jWTjH_0 2024-09-14T12:09:53.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15883297528454421972', time=2024-09-14T13:58:36.894230+0000, chain.objs.size()=1 2024-09-14T12:09:53.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:TqUK78wBz8nK.tcJxZBOwuB9BJNri1O_.qtgR9vwpH5OGkrviqgF0b_AY4FpRTza_0 2024-09-14T12:09:53.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5147590772893103737', time=2024-09-14T13:58:38.844497+0000, chain.objs.size()=1 2024-09-14T12:09:53.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:U9.3jRd1NMKTXedSpDHgQhSe0xucL6d_.CepDWAj8KVE5dB5Ysf4LLZ5SePyqD3I_0 2024-09-14T12:09:53.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2551508162883841928', time=2024-09-14T13:58:55.548137+0000, chain.objs.size()=1 2024-09-14T12:09:53.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:w61vLvotI75Vb.vOeQ7zOt479jQrtGF_.vavwVWzc697Qy9VLp1pNmllJ4j1OI9E_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7172769069781640126', time=2024-09-14T13:59:02.183578+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.586__shadow:.Qju5HFfYVlIlICVo7wTApXkRDSR5kM_.Gg9Dqw95C2gnsKooP__wC5YJcEChy0i_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1413457490635424164', time=2024-09-14T13:59:12.890674+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.605__shadow_.aTWzotBTEpvrBcGBlWP_GUXabctYwnv_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.976244083044065855', time=2024-09-14T14:03:02.447601+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.627__shadow_.3Wipq0t1VzZMUfnNW9OaTTe0WzIemRd_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7926457841020610669', time=2024-09-14T14:03:56.347836+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.671__shadow_.Hc8-XtQNeB44i3EkikImwi6jj07QPh0_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1296114687858098627', time=2024-09-14T14:04:00.202949+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.679__shadow_.CY5iSx420ykyzZQC8Ari67pn92v2XZB_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7467147278689169703', time=2024-09-14T14:04:19.926662+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.713__shadow:EAkCbVyETzaykMYwS7EJy4oDzhDFDiF_.-D0pgINtPJk0wCX7qgP72FC5Z0Pq9cy_0 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18182328218476968935', time=2024-09-14T14:06:59.496440+0000, chain.objs.size()=1 2024-09-14T12:09:53.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.772__shadow_.dRo3Bq1qEUIOxtzoevAZk5pmC6X4LXw_0 2024-09-14T12:09:53.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.251+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.256+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T12:09:53.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.257+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.257+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48195' 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13285484733165105811', time=2024-09-14T13:49:15.248183+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.252__shadow_.DZfxQrnT6Orbxs7yGI3KbByKnZ0RiYg_0 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1774474558469015775', time=2024-09-14T13:49:19.550299+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.259__shadow_.pmqtufSX5hehCuZz633FSojvG1_4-Lh_0 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16943895137237425661', time=2024-09-14T13:49:20.831921+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.261__shadow_.q_-5LpjzoCJVcrl-6couCRURrWQw-lP_0 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10842169079787828504', time=2024-09-14T13:49:58.850715+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.r9tFzyeLJPnOp4zCj_cUF7pKtGqmrHk_0 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8685912788416268130', time=2024-09-14T13:49:58.995704+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cRp36FZ7q9xtt02uYIriaG1jDxDGeo8_0 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14412381891507613435', time=2024-09-14T13:49:59.138143+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.moFZ51EMmX1gT8RapWuagrzQTggow-K_0 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11091229379060593248', time=2024-09-14T13:49:59.142429+0000, chain.objs.size()=1 2024-09-14T12:09:53.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VRQIOAGUrogR42aXzd7t9Ji4YMAUwFE_0 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6472247403938654004', time=2024-09-14T13:49:59.619423+0000, chain.objs.size()=1 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ylE3BhU5jokZfcckk5sowADzJl5fLaA_0 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9050928023200996812', time=2024-09-14T13:49:59.803934+0000, chain.objs.size()=1 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.258+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.58j4aXADRPE1cjnU6kVmbDAczsa0UY6_0 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.259+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11091082316082054549', time=2024-09-14T13:50:00.630740+0000, chain.objs.size()=1 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.259+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.R3ern6eBn49pKa20X4iD6U_l2EGGOuc_0 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.259+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4476845313237995510', time=2024-09-14T13:50:00.633303+0000, chain.objs.size()=1 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.259+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xG3GdMWd7AlC58rOrjdUZPCesyQa9Ww_0 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.259+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8680237649098784788', time=2024-09-14T13:50:00.923978+0000, chain.objs.size()=1 2024-09-14T12:09:53.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.259+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7G47Y5flJmReJQyzGW0l-0GB8vqZaWI_0 2024-09-14T12:09:53.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13725402488077078274', time=2024-09-14T13:50:00.925217+0000, chain.objs.size()=1 2024-09-14T12:09:53.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kkEVZASq-QAPuow0yUeEBBR-AgUhKZj_0 2024-09-14T12:09:53.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17556977308452825818', time=2024-09-14T13:50:00.925948+0000, chain.objs.size()=1 2024-09-14T12:09:53.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ubwEyuaTCmTWfpdVtbMPY9lVg-TcIhG_0 2024-09-14T12:09:53.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16535196382397795880', time=2024-09-14T13:50:01.274194+0000, chain.objs.size()=1 2024-09-14T12:09:53.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oTt7tD4Px2flBQCeqnxJDxeH5rHRKFe_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7216092464748058584', time=2024-09-14T13:50:01.508979+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9F9ewmsHRRkJwoxwqigEy-LVpPWPohX_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5091440484422653124', time=2024-09-14T13:50:01.982985+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ejt4eZ9Jl9N0h-8lneLH_N3LkhaowNr_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4389689127607671570', time=2024-09-14T13:50:02.166713+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.265+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l2e_TgSp5SHY4hne643KWED4wXsLuP0_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.19809972267500083', time=2024-09-14T13:50:02.489076+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ep8UtySqsbrer7d3p77MxxvkQfewEb4_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15254418728308376960', time=2024-09-14T13:50:02.635456+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.L8wrqkLBBYy56jxUfd2Ow4-h8PgWViK_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10946133214589695360', time=2024-09-14T13:50:02.779259+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xH9MfKwRW3LPN53ucOoA-lzHtw4i1X1_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10160167380542640882', time=2024-09-14T13:50:03.566685+0000, chain.objs.size()=1 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hX6xWlM-tvvM4NlQSo15yxOgBgg5f0H_0 2024-09-14T12:09:53.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1133849615896999418', time=2024-09-14T13:50:03.714369+0000, chain.objs.size()=1 2024-09-14T12:09:53.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nW_ctGwM2U_vo6cGjkATGS3_U9xW7NT_0 2024-09-14T12:09:53.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.269+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1918242983539752417', time=2024-09-14T13:50:04.843133+0000, chain.objs.size()=1 2024-09-14T12:09:53.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.269+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.a5ynFsxVEjaHdZdnKVvlkfRLsnzCNMI_0 2024-09-14T12:09:53.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.269+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16492210482160086349', time=2024-09-14T13:50:04.843774+0000, chain.objs.size()=1 2024-09-14T12:09:53.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.269+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.w3ib0Pz6U_NpujLsEVjwYM0VnRjiRzp_0 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.269+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2100017598897461562', time=2024-09-14T13:50:04.871448+0000, chain.objs.size()=1 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.269+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.uMdoKchJV2v4mjfovKPpUonA598jhr-_0 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16445859141619759367', time=2024-09-14T13:50:05.151249+0000, chain.objs.size()=1 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Gf8pWVjeWtH5Ri8UAe-tnLzA6AYxNgG_0 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15542071066729228484', time=2024-09-14T13:50:05.652880+0000, chain.objs.size()=1 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gz75toBfwoWroflujivJij6jiaz_N2G_0 2024-09-14T12:09:53.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3215872039324897061', time=2024-09-14T13:50:05.870605+0000, chain.objs.size()=1 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EZ0Mr7OoRw3CCFj0b8sRzcw_PTMWPeA_0 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.358003544872742241', time=2024-09-14T13:50:06.402107+0000, chain.objs.size()=1 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4dqEaFXrjbsaDnsBYpa24Ruz83DmHWi_0 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.739849116521253170', time=2024-09-14T13:50:06.424858+0000, chain.objs.size()=1 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Lkjw8dG_GBgC-eD9BQ9WGEQdEKz9_th_0 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18298843402497146937', time=2024-09-14T13:50:06.984579+0000, chain.objs.size()=1 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tUbUXgEcG-iyXSvolirqiHkCao2qqTx_0 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16464923016394825054', time=2024-09-14T13:50:07.233211+0000, chain.objs.size()=1 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qhbK3ane5051zxDuvO-vMbk38Hh9JzF_0 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7859362303238165049', time=2024-09-14T13:50:07.583976+0000, chain.objs.size()=1 2024-09-14T12:09:53.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.270+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IPsN_NjC4hxrGB04oxyRcdvDLdvRvSm_0 2024-09-14T12:09:53.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.273+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11509436748359086066', time=2024-09-14T13:50:07.812290+0000, chain.objs.size()=1 2024-09-14T12:09:53.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.273+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hWFrjQiVe8OhFCt_dLGlYEdp6BqL5UO_0 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4975138231514891431', time=2024-09-14T13:50:08.314110+0000, chain.objs.size()=1 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gNNMFqwxoP5vSpN9CjvBz_0i2NsvKy1_0 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3956907907546537509', time=2024-09-14T13:50:08.358638+0000, chain.objs.size()=1 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qrcx4EBYe57JtUXiRiM1XvDtLWRyj01_0 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12055055392556882270', time=2024-09-14T13:50:08.445889+0000, chain.objs.size()=1 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pyfvUfLthS7SAVdWrj98NyHaBNGGA4p_0 2024-09-14T12:09:53.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11217571454286789317', time=2024-09-14T13:50:08.918171+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.r87b1L_u92CnbqT63vO_W2vPzn8pMjd_0 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.684495973776505216', time=2024-09-14T13:50:09.498720+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.X1FptlyPP8wuYZS8yZBF8XvDoZ2flFY_0 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8110010414953468410', time=2024-09-14T13:50:13.433163+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.268__shadow_.9Z116pEMlRnCrdk6kVY6EbIkHTFVqmz_0 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7087626801486272222', time=2024-09-14T13:50:14.017841+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.269__shadow_.oXVSDWuI8ae4P3GzuVuosJ6rhGzzTJ8_0 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7309828447884247517', time=2024-09-14T13:50:15.212425+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.271__shadow_.pyJKr1ZiNADaqUvuA2p3MwCXskLIfZy_0 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.279285794767967453', time=2024-09-14T13:50:19.511393+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.278__shadow_.rvObsJUR8gnTONy9Ci3w7N0rqdkU9zH_0 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16208521725195576331', time=2024-09-14T13:50:23.989119+0000, chain.objs.size()=1 2024-09-14T12:09:53.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.285__shadow_.lZxklmInBlmdH7_sZbZ3UwnIJaJFeDP_0 2024-09-14T12:09:53.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.276+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13857410773313890918', time=2024-09-14T13:50:26.540970+0000, chain.objs.size()=1 2024-09-14T12:09:53.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.276+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.289__shadow_.0HMMOw5-AZX5CZNA1ZloqRt3Rz5CunH_0 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5567192207143248706', time=2024-09-14T13:50:26.552325+0000, chain.objs.size()=1 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.289__shadow_.2zuoi4y013Z88GUe3tsNrAZ4_tFq9CA_0 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14184091415599872978', time=2024-09-14T13:50:29.750166+0000, chain.objs.size()=1 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.04z78vydgmUvYX-UTKp-RclWTBf19s4_0 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5501323628712205495', time=2024-09-14T13:50:29.786275+0000, chain.objs.size()=1 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_._7K18xA-wHRMYvYVPBebxuf7jGJPmR7_0 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17404997556766963845', time=2024-09-14T13:50:33.047613+0000, chain.objs.size()=1 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.295__shadow_.wxC1huoAIjqIiBBSXOhEiSs_JEccUX-_0 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11956368173178479442', time=2024-09-14T13:50:49.409828+0000, chain.objs.size()=1 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.319__shadow:7gSkGuo9zzc7Z-vY-v7Rwy5EKVbh.g6_.ScCn7zhUzN0d29es78IzI-wMGyk4UbD_0 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292722898378252717', time=2024-09-14T13:51:30.670038+0000, chain.objs.size()=1 2024-09-14T12:09:53.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S18IUvbzM_pgoziZb02foaJRZGZvSm6_0 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10261249088696295400', time=2024-09-14T13:51:30.700032+0000, chain.objs.size()=1 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tol5TgWY7FXfktZSbhbV5VgMqLq2_wM_0 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2561257147068426061', time=2024-09-14T13:51:30.790328+0000, chain.objs.size()=1 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3zWgrkvTDNKz7_u585QPjEjC5e0kWsI_0 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4858509060318151836', time=2024-09-14T13:51:31.031602+0000, chain.objs.size()=1 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xx8fqTlqJSxNyu7vNWz-fNJYlT-LtvA_0 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16528793289819222345', time=2024-09-14T13:51:31.305635+0000, chain.objs.size()=1 2024-09-14T12:09:53.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.279+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nF8I6yQtg-Vt8VgthEQHbWvaYbnQIo3_0 2024-09-14T12:09:53.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.280+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3912728128054420387', time=2024-09-14T13:51:31.362229+0000, chain.objs.size()=1 2024-09-14T12:09:53.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.280+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bb-2dU_SZfAs7Wn2loHMuMjXg9pIKUC_0 2024-09-14T12:09:53.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5248289828678523644', time=2024-09-14T13:51:31.646956+0000, chain.objs.size()=1 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UhzIM69r05onAMaO3Lz3bfngek7xNFI_0 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10669715383054389290', time=2024-09-14T13:51:32.990175+0000, chain.objs.size()=1 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oLOk8-yB7nUZK3d_gwl70YJ0xCO29Bn_0 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13863634186677062396', time=2024-09-14T13:51:33.204418+0000, chain.objs.size()=1 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7YWfOhUYOBvRMAz-SBSxU1dVSkiUosR_0 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14422056975906592126', time=2024-09-14T13:51:33.250072+0000, chain.objs.size()=1 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MHlyoK2XcN--RFNHLhopifuDl1OiJWh_0 2024-09-14T12:09:53.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7549266512744165094', time=2024-09-14T13:51:33.347098+0000, chain.objs.size()=1 2024-09-14T12:09:53.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2Zas_kZSY2gqCPXVF-VNFo-h-iI3P3X_0 2024-09-14T12:09:53.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.284+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3274754738651881632', time=2024-09-14T13:51:33.832331+0000, chain.objs.size()=1 2024-09-14T12:09:53.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.284+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.sHS6tuuCxs6UieGon_QE6y7hd_ZCEyP_0 2024-09-14T12:09:53.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15288839411036293578', time=2024-09-14T13:51:33.950043+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vM97c3wghTf9ff-Q7nhCFHzxwWbKF_-_0 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15914821248103559895', time=2024-09-14T13:51:34.019458+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1m2xAnke5maUXYt0dBkRFIqPLQAr8CA_0 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3495228138962694828', time=2024-09-14T13:51:34.439740+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5rPflRuBfEDLA5cyDcmT_71oGMuLhyZ_0 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10590352534550985149', time=2024-09-14T13:51:34.551194+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4KQ4FWf5yt3PjH-0vp3fqajqoXg8BFU_0 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8755757773176341357', time=2024-09-14T13:51:34.793137+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MOjDckXBjZ-lNxyXegNfDQVeDIZybz4_0 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18295646025579998072', time=2024-09-14T13:51:34.869622+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.t_2W8dCBx3jWymbMIFtrQSNAP5ubV7H_0 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14219694316654720591', time=2024-09-14T13:51:34.905446+0000, chain.objs.size()=1 2024-09-14T12:09:53.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QckTb9ZcATJ91XZ1GEdOgEV1HCu8HyF_0 2024-09-14T12:09:53.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6416473445595121176', time=2024-09-14T13:51:35.525577+0000, chain.objs.size()=1 2024-09-14T12:09:53.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MG750k62NZbXdwhCwQmo-11A10ieNw__0 2024-09-14T12:09:53.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.287+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6102892549630744445', time=2024-09-14T13:51:35.526483+0000, chain.objs.size()=1 2024-09-14T12:09:53.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.287+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.r5vJJMCZV7mCr4YSEgeGcgGglcncS6T_0 2024-09-14T12:09:53.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.287+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2995456393891266847', time=2024-09-14T13:51:35.527293+0000, chain.objs.size()=1 2024-09-14T12:09:53.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.287+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IwtP0orIz3OFRQnVQ9tAnoJHU_j08o4_0 2024-09-14T12:09:53.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.288+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11795358680307302967', time=2024-09-14T13:51:35.821229+0000, chain.objs.size()=1 2024-09-14T12:09:53.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.288+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Z2C-nJwNXgzCuJqBr1fChUsGG4f04Oo_0 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.91912738071470667', time=2024-09-14T13:51:36.086572+0000, chain.objs.size()=1 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7WDUFiT41ra26RtKUhSzzqsBvw7Xdud_0 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5288210595076963244', time=2024-09-14T13:51:37.478280+0000, chain.objs.size()=1 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._yCcLFGCknvJ3PVQoIojN7YchACOGQv_0 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10727282255166225406', time=2024-09-14T13:51:38.278478+0000, chain.objs.size()=1 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fNea1gSATYDJGBwNCaOFct-XGRCPRwM_0 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10854369515197180152', time=2024-09-14T13:51:38.581065+0000, chain.objs.size()=1 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nhVRuQ4PhF15Mr0NUfB0nofx51KJ31k_0 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2574156467172736094', time=2024-09-14T13:51:38.724653+0000, chain.objs.size()=1 2024-09-14T12:09:53.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UwarImx7nMxxymzrIkEcUbpSYA7bC24_0 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7264011111249098486', time=2024-09-14T13:51:38.906798+0000, chain.objs.size()=1 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uR7dNdTZXIFarMnKHtXUetsQrOgx6ZQ_0 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16197701870582549253', time=2024-09-14T13:51:38.991008+0000, chain.objs.size()=1 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.n9Q0gmgnHviyM_KjxOnT0pHWjY24TcL_0 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18235721863695740326', time=2024-09-14T13:51:39.244375+0000, chain.objs.size()=1 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.aIzyTXelNgyJL3cWFSWb7fTtrUolwo9_0 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14438618054868542715', time=2024-09-14T13:51:39.850285+0000, chain.objs.size()=1 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.291+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pjcTM7_wYMW3_eEkXOhw7mxRal-SY31_0 2024-09-14T12:09:53.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.292+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4259873201960972898', time=2024-09-14T13:51:39.954140+0000, chain.objs.size()=1 2024-09-14T12:09:53.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.292+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9lH-jvhfy7ZEwT7dafWuE5K6aLOuoRe_0 2024-09-14T12:09:53.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.292+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13147756453768864821', time=2024-09-14T13:51:40.145644+0000, chain.objs.size()=1 2024-09-14T12:09:53.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.292+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3gcgbZs8roNyAK_hnYvlpNrhA5v6AK5_0 2024-09-14T12:09:53.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.294+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10302897824154355468', time=2024-09-14T13:51:40.387604+0000, chain.objs.size()=1 2024-09-14T12:09:53.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.294+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bNB5kgyOhQEPrQC3VCPClqISMYqQtPr_0 2024-09-14T12:09:53.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.294+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16128785011895808061', time=2024-09-14T13:52:21.865633+0000, chain.objs.size()=1 2024-09-14T12:09:53.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.294+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FeBAUTohTkR52kKhdKPHesEfprySohQ_0 2024-09-14T12:09:53.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.296+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6010348379853544123', time=2024-09-14T13:52:22.107411+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.296+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.A1lmdxk1mGbg0XbQTaXPDl9Y7-bXk_T_0 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9860639508498507051', time=2024-09-14T13:52:22.145124+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mt3nh3i8cycf-g9_bBVxArfN9mbqFPe_0 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3005760139720407629', time=2024-09-14T13:52:22.670611+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.X82iAnBRN5U4wsveQZ6dJvjYVz5UwlS_0 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2212575601012664804', time=2024-09-14T13:52:22.671145+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.CK19guLIcrNilEed8ADsLk5_2vRWAC8_0 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2925834192975705099', time=2024-09-14T13:52:22.794550+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LPQRimXnygedLCBlMTml4m2xjERG0SO_0 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9582057788934109690', time=2024-09-14T13:52:22.949093+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MP1XBtaWKxAqsqZzqWtxtYtaeTQRKF__0 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.815215687873918880', time=2024-09-14T13:52:23.186757+0000, chain.objs.size()=1 2024-09-14T12:09:53.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.usfIOne5awC-ugnj1T4EeoHyhdb6AC8_0 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16331292429858215420', time=2024-09-14T13:52:23.419836+0000, chain.objs.size()=1 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Z05Jt_0RPPTaLUnoFRdT55SRajwqjJ2_0 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8670853699188735660', time=2024-09-14T13:52:23.529994+0000, chain.objs.size()=1 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IDRlx3nqDk7Dznl80YGz6jSDjqtRD0f_0 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6039633381820305970', time=2024-09-14T13:52:23.568107+0000, chain.objs.size()=1 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KfLaWK2DhFoGdURIbZlUC54HVU_7F8g_0 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12682016071068195476', time=2024-09-14T13:52:23.594546+0000, chain.objs.size()=1 2024-09-14T12:09:53.297 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3RIxoUNTjhAj3LqHRu94Fkr_T6cwMAz_0 2024-09-14T12:09:53.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.300+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12046370488404342308', time=2024-09-14T13:52:23.693568+0000, chain.objs.size()=1 2024-09-14T12:09:53.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.300+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EGoXYxmUvRC7i16uteTpftfT7hf77yn_0 2024-09-14T12:09:53.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.302+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13987580963520335994', time=2024-09-14T13:52:23.741368+0000, chain.objs.size()=1 2024-09-14T12:09:53.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.302+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.E62Ni2C-8IbjCH4uTz_R-xYdspCdBFn_0 2024-09-14T12:09:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.303+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48195 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3606446712832771145', time=2024-09-14T13:52:24.343212+0000, chain.objs.size()=1 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gTbZKkGKRTmakYGUIz5GWGOg0rmfw-L_0 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10390191076148592586', time=2024-09-14T13:52:24.517973+0000, chain.objs.size()=1 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KOUL_R-KxOZWypQdG46Z2Vnn361xFc4_0 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7893012795666065064', time=2024-09-14T13:52:24.558012+0000, chain.objs.size()=1 2024-09-14T12:09:53.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.F7vuwbeiQtUh5V0mPrPqdHu-z98SrHt_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7054404628023756669', time=2024-09-14T13:52:24.965527+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yJIQRRCHSL20WD7Q4ZhYYFGHrOdQqqP_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7400522623331087005', time=2024-09-14T13:52:25.247421+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.67nBe5cIqbpCBV4vA-9esS6mRPxa409_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14250684792613840925', time=2024-09-14T13:52:26.341601+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xV62TmzgdELV_y2RpRxWIJy2iu806ti_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8097829519650755415', time=2024-09-14T13:52:26.596295+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.av_9sFKnbl4HDcsuLlcHCIo5baEL1rj_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7217940202055443315', time=2024-09-14T13:52:26.783344+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nM-y_KgNHlIIlKN0BzeR-PrfaOwYKyV_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12059373575730541301', time=2024-09-14T13:52:27.174571+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Vbmdb0BtdaTQf-enwOIEfuj33JFIu1l_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12176311798012489838', time=2024-09-14T13:52:27.421593+0000, chain.objs.size()=1 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vWtzS-mbWxs2li6oSwsfSTqWU07_cd8_0 2024-09-14T12:09:53.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15444876613570781334', time=2024-09-14T13:52:27.607895+0000, chain.objs.size()=1 2024-09-14T12:09:53.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PnWZor7qPa5ZepaJn2fX82s7ZkH0Z5V_0 2024-09-14T12:09:53.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7685534706582327354', time=2024-09-14T13:52:27.638155+0000, chain.objs.size()=1 2024-09-14T12:09:53.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.306+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IKmywWG9vE8tUXnssK86XP4nP6-zYFn_0 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.309+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10624890380608616541', time=2024-09-14T13:52:27.760559+0000, chain.objs.size()=1 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.309+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JZkauJIgc8VJqaAcJkeuoq066SF2B6c_0 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.309+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8635500052068966398', time=2024-09-14T13:52:28.127825+0000, chain.objs.size()=1 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.309+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.CSRPRMnXAbNEX0meG-AVyhSbEW0UoL0_0 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.309+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13564609645789119510', time=2024-09-14T13:52:28.262948+0000, chain.objs.size()=1 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.309+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2VnMtK2nn5iTIGK5Ok7_qECgjTGegdJ_0 2024-09-14T12:09:53.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18414263696296315189', time=2024-09-14T13:52:29.115386+0000, chain.objs.size()=1 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QJ6TJsHfW-dgPewBaqFRoKJBFVmBiWl_0 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14056055767828812142', time=2024-09-14T13:52:29.156887+0000, chain.objs.size()=1 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.R-6C3sePXxynURHhIzpst9XQt70Cc_X_0 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12211248170761721223', time=2024-09-14T13:52:29.271900+0000, chain.objs.size()=1 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MK3w5MlBuxdAkMVCq2oRMw2BVBlQNJl_0 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17637290015734129548', time=2024-09-14T13:52:29.442302+0000, chain.objs.size()=1 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6xlxzuLXKfOuz_sSiRjpyWYwTc2AOVi_0 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14592493005769301172', time=2024-09-14T13:52:29.639100+0000, chain.objs.size()=1 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TCM0klC9X2ShdS8f8SyVagCG_NSe-Lt_0 2024-09-14T12:09:53.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9604068723678504850', time=2024-09-14T13:52:29.962381+0000, chain.objs.size()=1 2024-09-14T12:09:53.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tOGR8dEoZIT-noCJnek71NDAzGQWQwa_0 2024-09-14T12:09:53.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8393176045102594922', time=2024-09-14T13:52:30.005339+0000, chain.objs.size()=1 2024-09-14T12:09:53.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.310+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bdrBan5zZFE1CNJpC0qco9AJitT-J_-_0 2024-09-14T12:09:53.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.311+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16632713130276728817', time=2024-09-14T13:52:30.165467+0000, chain.objs.size()=1 2024-09-14T12:09:53.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.311+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-sR4Pk_QYar6LeiNjZZ8JyuYHZZcAsa_0 2024-09-14T12:09:53.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.312+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7911282387333531941', time=2024-09-14T13:52:30.380552+0000, chain.objs.size()=1 2024-09-14T12:09:53.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.312+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ye5uxMQTMbytG-Yu98_HuFXTQ1X4QBg_0 2024-09-14T12:09:53.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.313+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7744103890170661196', time=2024-09-14T13:52:30.381159+0000, chain.objs.size()=1 2024-09-14T12:09:53.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.313+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zlync5cdmfcRYIexFYbjTeAPO92O7KW_0 2024-09-14T12:09:53.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.313+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5058955399688171632', time=2024-09-14T13:52:30.557805+0000, chain.objs.size()=1 2024-09-14T12:09:53.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.313+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XZbazpH-o9uL1CavPVcXm7lgHOmooTA_0 2024-09-14T12:09:53.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2649635750086677509', time=2024-09-14T13:52:30.715160+0000, chain.objs.size()=1 2024-09-14T12:09:53.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PQDFshlGWUA-4TbmlFgqI965mT2mhe6_0 2024-09-14T12:09:53.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8624680564678516783', time=2024-09-14T13:52:31.068252+0000, chain.objs.size()=1 2024-09-14T12:09:53.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.K4bwoXxK9N5k4EIR8sBrbWEhwSlbe-5_0 2024-09-14T12:09:53.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6234366914714879998', time=2024-09-14T13:52:31.079272+0000, chain.objs.size()=1 2024-09-14T12:09:53.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fBZb4jALQP8eSLBd4oElK6WmYZmzJ-F_0 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5948955304036845364', time=2024-09-14T13:53:07.491635+0000, chain.objs.size()=1 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.390__shadow_.AofqT11KJ8ZhDC0I7awKygzlsKwE3p9_0 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.607842130522231398', time=2024-09-14T13:53:35.812398+0000, chain.objs.size()=1 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.439__shadow_.y_fFL9CFPi0bK7Yt3VOoiBgfYUOeN9Y_0 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7643911796964715064', time=2024-09-14T13:54:36.198886+0000, chain.objs.size()=1 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.518__multipart_mymultipart.2~AUEuu0XCmMWBVLoGdlBtdpM8ntfM-Bl.1 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.315+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13720064338825697404', time=2024-09-14T13:57:26.971689+0000, chain.objs.size()=1 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.315+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.554__shadow_.rmVR_oGJQoRV7wBxUKPfx73HscnUYPT_0 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.315+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4481611490776172583', time=2024-09-14T13:57:55.230162+0000, chain.objs.size()=1 2024-09-14T12:09:53.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.315+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:r0CTG7xMPUuZ5EPfFTUbR1Ev4I-G5SI_.8Rge4usmfKFxurjs-TWdyXBY8m83yv8_0 2024-09-14T12:09:53.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.315+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11281489932653855099', time=2024-09-14T13:58:08.514563+0000, chain.objs.size()=1 2024-09-14T12:09:53.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.315+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow_.qQeSj7PFcFMTB5zGVjPaBsgIZImi1yb_0 2024-09-14T12:09:53.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.317+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5417720559891604841', time=2024-09-14T13:58:09.635416+0000, chain.objs.size()=1 2024-09-14T12:09:53.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.317+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:CzMIrk22C4bWg3ORf2htMD6MxRkjJ7M_.Cfwbliz9gpBy17Hx9CxIZIp6R7eIpXp_0 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1093452138757967454', time=2024-09-14T13:58:11.208502+0000, chain.objs.size()=1 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:yH5DnVNlk9WrmqNiwKcUXI8wtY4fmPs_.cOxljuM6tpGQK6auOoUhNYZ_ZaMwR9z_0 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11439258838751251090', time=2024-09-14T13:58:11.586276+0000, chain.objs.size()=1 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:UGTol2xUT.WsAbcFAO73Yri8jO.Ne--_.6gbExCg27YBWnfRBAoWgH5y-cARGVBe_0 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15754719471461426949', time=2024-09-14T14:03:03.014659+0000, chain.objs.size()=1 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.628__shadow_.-DrFyYUdAPnjdovan6Q_yOTqwSei2aX_0 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8729574522079073544', time=2024-09-14T14:03:14.894022+0000, chain.objs.size()=2 2024-09-14T12:09:53.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.644__shadow_.5QmlSy_Rbmmts5h1pxilJBNMaS3XylD_0 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.644__shadow_.5QmlSy_Rbmmts5h1pxilJBNMaS3XylD_1 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17406706539775062534', time=2024-09-14T14:04:08.997619+0000, chain.objs.size()=1 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.696__shadow:cre2Ih0pO0Zf9PZOgPEYoL778z42Wbj_.NmWA6GB4goQoJcY5T9x3KFyMozYMfas_0 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16035150523926045620', time=2024-09-14T14:06:03.814145+0000, chain.objs.size()=1 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.758__shadow_.-C2CoPP9Q-DMyqrZE63NJzBO65vkLf__0 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.215022283945602714', time=2024-09-14T14:06:28.763087+0000, chain.objs.size()=1 2024-09-14T12:09:53.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.319+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.761__shadow_.BhG7Opm9mJ3slGPTCNB03Wm-GYsC9Rk_0 2024-09-14T12:09:53.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.325+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T12:09:53.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.327+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.327+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43991' 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_KE-LGuNOGmsV2An2fRhZBCqqpWJFRsf', time=2024-09-14T13:46:52.198907+0000, chain.objs.size()=2 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.uV8p0KLJDPhUp1mF_r1vUtVtACje-Tq_0 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.uV8p0KLJDPhUp1mF_r1vUtVtACje-Tq_1 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_Xw53KgfbdwRvuFkIybQ2ATOIuaT3qNY', time=2024-09-14T13:46:57.360130+0000, chain.objs.size()=2 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.wdemiUI8Mfa3NspnTWV8AxwXkxl3u-g_0 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.wdemiUI8Mfa3NspnTWV8AxwXkxl3u-g_1 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9310679342092128612', time=2024-09-14T13:49:03.077482+0000, chain.objs.size()=1 2024-09-14T12:09:53.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.234__shadow_.C-kB-Ns9cVRo6PwdhykIuuOOKEndMD1_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15322142205960815657', time=2024-09-14T13:49:06.628887+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.239__shadow_.2Xg2muJnvMcWr-7v58JWMirA2J1xNLE_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6329614418192497464', time=2024-09-14T13:49:11.427150+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.246__shadow_.yGLaFb8ZXeDaNRA9SA7S2gMxu-VscRi_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9477659320018089519', time=2024-09-14T13:49:20.212080+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.260__shadow_.hSdXc98SXQZG0fKwFqavWEpAO63e_of_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5036142629077067655', time=2024-09-14T13:49:58.959434+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mm4QnmLa4pEhXRFpMoyH0vJlSgILwhs_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18314601075769591178', time=2024-09-14T13:49:59.143639+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.O8DX6NKOo1TeuW7_oDETxbgWkDps9R-_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.281239616450229931', time=2024-09-14T13:49:59.354137+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hUcokuXpWJBIOknbjKJ_jTA5E1fY8YZ_0 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1055706139625897237', time=2024-09-14T13:49:59.746252+0000, chain.objs.size()=1 2024-09-14T12:09:53.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.M7RP7gXwzKoRybXhnlcQZd0tAkBPjRI_0 2024-09-14T12:09:53.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12526358922426394201', time=2024-09-14T13:49:59.929890+0000, chain.objs.size()=1 2024-09-14T12:09:53.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BeF8XMXMXxHY0VkPAJBqrWpxx7iTOx-_0 2024-09-14T12:09:53.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14475776207964077365', time=2024-09-14T13:50:00.499250+0000, chain.objs.size()=1 2024-09-14T12:09:53.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sqlGHx8Z1clhv4ANLIMhEVgzlfXHjN5_0 2024-09-14T12:09:53.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2156709491277176487', time=2024-09-14T13:50:01.463998+0000, chain.objs.size()=1 2024-09-14T12:09:53.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XKPpGyaE79CnDBt9_ydzSRzgpubQcen_0 2024-09-14T12:09:53.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6518457877039265998', time=2024-09-14T13:50:02.005883+0000, chain.objs.size()=1 2024-09-14T12:09:53.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.doPLH-cjjfFs7ntH1N_KU54vKYcSEt2_0 2024-09-14T12:09:53.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15108486103820983342', time=2024-09-14T13:50:02.308258+0000, chain.objs.size()=1 2024-09-14T12:09:53.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Oszzu2WvcugVSlJ4EwAvX-KeBDLwkAp_0 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1584264834063975981', time=2024-09-14T13:50:02.454993+0000, chain.objs.size()=1 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6I-G0o7-OCLQxlKUpuXXJ-L7d8UZieZ_0 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7338164205258205721', time=2024-09-14T13:50:02.635238+0000, chain.objs.size()=1 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.j-CTo0wWYcmmgLHtAyuX9wDpnNEoWdC_0 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3259262099147877998', time=2024-09-14T13:50:02.742006+0000, chain.objs.size()=1 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eD4VaeIA-kVjZL9mdsC7pk3Z9sMEG9w_0 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.334+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11581882785668000953', time=2024-09-14T13:50:02.941363+0000, chain.objs.size()=1 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.334+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VuWQ5G4gO2K95Qt-KC5iAJ_Yzeijh-o_0 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.334+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17041962313105017899', time=2024-09-14T13:50:02.942086+0000, chain.objs.size()=1 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.334+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WSMXir4oMCWqIvEoAsewfZ0pekWEpU0_0 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.334+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8132960245485984206', time=2024-09-14T13:50:03.852206+0000, chain.objs.size()=1 2024-09-14T12:09:53.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.334+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.i_eVwGgobPEPRZB6y_BhNrvNxLcCaWG_0 2024-09-14T12:09:53.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.335+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9461970033897587869', time=2024-09-14T13:50:04.254870+0000, chain.objs.size()=1 2024-09-14T12:09:53.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.335+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hCGy9B3YLAU0BlvDFtyYP5qNrzgM7wh_0 2024-09-14T12:09:53.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.335+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6486001057705730086', time=2024-09-14T13:50:04.316486+0000, chain.objs.size()=1 2024-09-14T12:09:53.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.335+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mL_D_4_d5vS0UUytm-8iwycTSGAebMk_0 2024-09-14T12:09:53.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11909809600991921607', time=2024-09-14T13:50:04.317378+0000, chain.objs.size()=1 2024-09-14T12:09:53.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PeY3e3gFwhLC-ClniU86HgFXBznPzPi_0 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16025708653781261823', time=2024-09-14T13:50:04.382329+0000, chain.objs.size()=1 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zTvY-HP0_RObzJ-uDT-yvC0_TzZG1Cc_0 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3358651473864445936', time=2024-09-14T13:50:05.159689+0000, chain.objs.size()=1 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.G9mKfbweqY6iGCOw53Cy1IkTuyw2iu1_0 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.344494317459742972', time=2024-09-14T13:50:05.332166+0000, chain.objs.size()=1 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SbK3VBywL9Xis9CIba5iGk9Wij07f9j_0 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9618990785197115490', time=2024-09-14T13:50:05.599788+0000, chain.objs.size()=1 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Dt4qCZ_12oNYaEVHfa38bRqGsYZssjM_0 2024-09-14T12:09:53.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.338+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1470122492014466623', time=2024-09-14T13:50:05.859157+0000, chain.objs.size()=1 2024-09-14T12:09:53.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.338+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qSBYwNN4hjzZ2aBg7GuKufBzgtDXXwM_0 2024-09-14T12:09:53.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17983256620849525196', time=2024-09-14T13:50:06.421493+0000, chain.objs.size()=1 2024-09-14T12:09:53.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HnbFWlx1-sr4iLiYlmnqer6WNbKr9TY_0 2024-09-14T12:09:53.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1570199305248595262', time=2024-09-14T13:50:06.513229+0000, chain.objs.size()=1 2024-09-14T12:09:53.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sJD1dsm5mqOTFghSR4DfsLsqalnSazj_0 2024-09-14T12:09:53.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15377212497125881269', time=2024-09-14T13:50:06.963263+0000, chain.objs.size()=1 2024-09-14T12:09:53.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.s9Ddufoie4J4vLODTC_2LHwLFz1iFVn_0 2024-09-14T12:09:53.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11033725868949606091', time=2024-09-14T13:50:07.176457+0000, chain.objs.size()=1 2024-09-14T12:09:53.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jmLi77iH8iSjzXLdnoUaKLOnMv0ynRD_0 2024-09-14T12:09:53.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16992542868732311293', time=2024-09-14T13:50:07.721703+0000, chain.objs.size()=1 2024-09-14T12:09:53.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.339+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wigOuG3fhRx4_BPCGAHg1d_tkqKfe3-_0 2024-09-14T12:09:53.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.340+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4735234975106811382', time=2024-09-14T13:50:08.015249+0000, chain.objs.size()=1 2024-09-14T12:09:53.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.340+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fohEjv3U7_drWduAVEnQHSbjhuVt5j6_0 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18106798387697364806', time=2024-09-14T13:50:08.105732+0000, chain.objs.size()=1 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4Cfj1gLkfZXKfH3O8j5lefmEjyqMyhI_0 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16729658095422531433', time=2024-09-14T13:50:09.013142+0000, chain.objs.size()=1 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.am-Tgs4CtTZDT6HGfkVmjevMiE2Drt4_0 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17939993016590735970', time=2024-09-14T13:50:09.153403+0000, chain.objs.size()=1 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.189EDD9n-CHbm7qLcMVOoBcwQ4jr8XK_0 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6942621368909513584', time=2024-09-14T13:50:09.189048+0000, chain.objs.size()=1 2024-09-14T12:09:53.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.q9IBRh3ShZmIM21WA_rNKgMpk38iR1d_0 2024-09-14T12:09:53.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16814697406103681158', time=2024-09-14T13:50:09.347745+0000, chain.objs.size()=1 2024-09-14T12:09:53.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AVjAQUDG0hNlolzvvC0CcrGx3OMHI5z_0 2024-09-14T12:09:53.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11685675165531120516', time=2024-09-14T13:50:09.348831+0000, chain.objs.size()=1 2024-09-14T12:09:53.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BldMk3NNqGTu9LVi1i6uQfaAE54LCKP_0 2024-09-14T12:09:53.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12917514056716762791', time=2024-09-14T13:50:09.465064+0000, chain.objs.size()=1 2024-09-14T12:09:53.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IcIIzS8DMv5KjMWAzYmeF8ppQcDqLAD_0 2024-09-14T12:09:53.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4432100528524160929', time=2024-09-14T13:50:09.823485+0000, chain.objs.size()=1 2024-09-14T12:09:53.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.343+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yrcW4hPYYBL8rMNDKrlRBEQjypeK7RJ_0 2024-09-14T12:09:53.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16901896320550501633', time=2024-09-14T13:50:14.594588+0000, chain.objs.size()=1 2024-09-14T12:09:53.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.270__shadow_.guNMQaFCxGZ5f7eiDc2fwE13l38jNlj_0 2024-09-14T12:09:53.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.68783675003647038', time=2024-09-14T13:50:23.305983+0000, chain.objs.size()=1 2024-09-14T12:09:53.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.284__shadow_.sqr-Ij3SKLbCqFkxrTHpHYXVL6qGxV0_0 2024-09-14T12:09:53.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.345+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2089828351349990187', time=2024-09-14T13:50:24.686627+0000, chain.objs.size()=1 2024-09-14T12:09:53.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.345+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.286__shadow_.MyTxD1sXRLOQQGvEBrWKaWiea4mCb4O_0 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2507378671409832707', time=2024-09-14T13:50:27.963755+0000, chain.objs.size()=1 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.291__shadow_.83_308FLCxbN80f-VkkcGQzXuolv_c4_0 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17350909946776755086', time=2024-09-14T13:50:29.786984+0000, chain.objs.size()=1 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.XKbrjRgeGL-wlHVFLcLnN7WEvdyTkmj_0 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1525826521300748412', time=2024-09-14T13:50:29.878837+0000, chain.objs.size()=1 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.YvfH5RkwE-QdOtCN4amRMqXRGlu5Oue_0 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.459589559147810173', time=2024-09-14T13:50:36.418520+0000, chain.objs.size()=1 2024-09-14T12:09:53.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.300__shadow_.ofeGi4yhSaIUcQMxGmaEDoLaOLTJPrW_0 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14877076046347504398', time=2024-09-14T13:50:38.959012+0000, chain.objs.size()=1 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.304__shadow_.bONRc290RXNvgZyTj7GoNr-qovGGWIs_0 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13013384363243289758', time=2024-09-14T13:51:30.893525+0000, chain.objs.size()=1 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IXIogrF8HQRsRoiimg10vVbvXjmn34E_0 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17505331314135309834', time=2024-09-14T13:51:31.062972+0000, chain.objs.size()=1 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GicYu1Uc3KdqVClvnoUbEwaKZfr8QFg_0 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11535660357432367108', time=2024-09-14T13:51:31.284529+0000, chain.objs.size()=1 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pasujsEBkLBiP8bXBJ1LAKHKiiegpDO_0 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11737831201943759877', time=2024-09-14T13:51:31.386826+0000, chain.objs.size()=1 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ID0XV0cRN6m8NHB-AVGYHBY2ZiMOsek_0 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18322780043847890705', time=2024-09-14T13:51:31.413857+0000, chain.objs.size()=1 2024-09-14T12:09:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wjlNobDgOmsX0mzRjmzUHIvcPDJwZSP_0 2024-09-14T12:09:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15440881281320259029', time=2024-09-14T13:51:31.440613+0000, chain.objs.size()=1 2024-09-14T12:09:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.45Hp6QZnWSqVmSpBCN3lj8x5Jr57FT-_0 2024-09-14T12:09:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12552721165538935917', time=2024-09-14T13:51:32.416833+0000, chain.objs.size()=1 2024-09-14T12:09:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6biNI0ek1ckTCEe2-UXDUCSIOZJCYMu_0 2024-09-14T12:09:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.353+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16504797815546068189', time=2024-09-14T13:51:32.632728+0000, chain.objs.size()=1 2024-09-14T12:09:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.353+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Eh8ZvtYFbU51vJSxh9H6PAM-uBnZW1O_0 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6012021675699114858', time=2024-09-14T13:51:32.846092+0000, chain.objs.size()=1 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WWh7Q18utkTWqEfUqVvAxmex4axE4ew_0 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1035295266666624606', time=2024-09-14T13:51:33.317625+0000, chain.objs.size()=1 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vQtJnMUFB2gnjQvMKSVljVJCyNEgYIL_0 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6520258214716635307', time=2024-09-14T13:51:33.827431+0000, chain.objs.size()=1 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LokEgrUhnhrZx-rb-mwRS1NAoS5y6uE_0 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10500921613360687417', time=2024-09-14T13:51:33.828333+0000, chain.objs.size()=1 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.E0dd5GXO_vU-8fJ8CilcfMix9Pilj4F_0 2024-09-14T12:09:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15319595148015880582', time=2024-09-14T13:51:33.948988+0000, chain.objs.size()=1 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ICtNr0L7dt7CV8IMBJAHVeBxeOaXkrN_0 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5185596772052519117', time=2024-09-14T13:51:36.045326+0000, chain.objs.size()=1 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.o_OoETP259c523FiLLdZDV8rBHhKJoe_0 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8638399521280773744', time=2024-09-14T13:51:36.086942+0000, chain.objs.size()=1 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e-VU-ou_LORbt23K_TSI-DDYMO_sqcB_0 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7378667921392164854', time=2024-09-14T13:51:37.178115+0000, chain.objs.size()=1 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lk8PBRsgpq6pQAW73zdNPSxm1rKnwrn_0 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.787306250142406589', time=2024-09-14T13:51:37.746378+0000, chain.objs.size()=1 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0ge7K5Zk64wvgtFUD314XJl4s1IplEk_0 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11965611324368811272', time=2024-09-14T13:51:37.857737+0000, chain.objs.size()=1 2024-09-14T12:09:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oZ9ujknOncHKpP22R5AE54dd5x9-oXJ_0 2024-09-14T12:09:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.357+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12763221447042868564', time=2024-09-14T13:51:38.430808+0000, chain.objs.size()=1 2024-09-14T12:09:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.357+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XRi-FKywDlrCN__jKuvYqSEaBJDsrrR_0 2024-09-14T12:09:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.357+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13543662000796585011', time=2024-09-14T13:51:38.773496+0000, chain.objs.size()=1 2024-09-14T12:09:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.357+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.POXcUEhGvrtBGd7Ol72CXgbDs4-BmAD_0 2024-09-14T12:09:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11017646742776853639', time=2024-09-14T13:51:39.703581+0000, chain.objs.size()=1 2024-09-14T12:09:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5oO-5ylWrJxf_qArhc2LWZZ7iw__zEA_0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2522870866381259376', time=2024-09-14T13:51:40.179797+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Wc0w7jTwQVkPxgLKPTXJ42g6px_RfeT_0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17745914243699295730', time=2024-09-14T13:51:40.366697+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ije3PKP8mKhyMrgt4OrJG4WolbYG-mG_0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2022572202008664697', time=2024-09-14T13:51:40.674109+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0BUR9hkI7QNOIdEsKQ1f7x_QSIZUTX6_0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15966990549626497437', time=2024-09-14T13:51:41.356729+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.azXtYkoy6gACXxFa9hmy_lTIo8l7XbV_0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3508453784645857735', time=2024-09-14T13:51:41.621718+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.un08PQr0jvKndhjLnS64QdTUCMKMFm3_0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5845986131964926068', time=2024-09-14T13:52:21.108606+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.D64KSR0AXin0TyjQng7qCSz5w93TIj__0 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11819996276543441812', time=2024-09-14T13:52:21.274428+0000, chain.objs.size()=1 2024-09-14T12:09:53.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mQhkb24yLITheYQxLp02c5R9agIP-Ih_0 2024-09-14T12:09:53.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5385505939954192787', time=2024-09-14T13:52:21.379182+0000, chain.objs.size()=1 2024-09-14T12:09:53.359 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bR2VgI7zX-Ck4LIC0NODx5sJQaiUOaZ_0 2024-09-14T12:09:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.361+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3000473803212473096', time=2024-09-14T13:52:21.655689+0000, chain.objs.size()=1 2024-09-14T12:09:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.361+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.veISehqUcz8QbgT6S7OpWEeMKmxN9-w_0 2024-09-14T12:09:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.361+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11036366405441776609', time=2024-09-14T13:52:21.807707+0000, chain.objs.size()=1 2024-09-14T12:09:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.361+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ejE9JwOtOVzjoVE8Wl33Ep_mRVVM9k3_0 2024-09-14T12:09:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.361+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2774396929969310880', time=2024-09-14T13:52:22.791390+0000, chain.objs.size()=1 2024-09-14T12:09:53.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.361+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.g_kmdWO0QpfY92KeOByhBw7qEaqyRjp_0 2024-09-14T12:09:53.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4176090834032550368', time=2024-09-14T13:52:23.287645+0000, chain.objs.size()=1 2024-09-14T12:09:53.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EE8GWrQ284Bom_y9J1uSl7U_vLXLY0U_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8640168123196448619', time=2024-09-14T13:52:23.288409+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mfZa2jc_KtVHlraAxJgTPjLDtQMRpSZ_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2752548868101772599', time=2024-09-14T13:52:24.239853+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5iwRodq1FLvLuiSG3UwL3xtbRHlJUzl_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8841375130849459610', time=2024-09-14T13:52:24.358586+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hJxiLhz7Jvkrbbl_TouNcit7mAV7OKz_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18376644021730909050', time=2024-09-14T13:52:25.720098+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LR4RaMB7-Kb__Yz9KyHCb7iark9u7zN_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14590553602405080136', time=2024-09-14T13:52:25.846033+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eBhuu0USPatZ7XpW3nneEsB-9YNhGQU_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5980826051169203081', time=2024-09-14T13:52:25.859851+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mqDWhdEoezkvEwvid5u0glc8_lpdhvl_0 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12203155315304086543', time=2024-09-14T13:52:25.915942+0000, chain.objs.size()=1 2024-09-14T12:09:53.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ecQdyYUvbvpHvt9FxmqQmWbbEsUQVSw_0 2024-09-14T12:09:53.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5176035120774968339', time=2024-09-14T13:52:26.547854+0000, chain.objs.size()=1 2024-09-14T12:09:53.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qax5JaBIQdfCoQ5GM4z2rmd62rHM2zC_0 2024-09-14T12:09:53.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.365+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10045683025423452679', time=2024-09-14T13:52:26.665215+0000, chain.objs.size()=1 2024-09-14T12:09:53.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.365+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Es-uMfapeFq5TSkOPwpDDbNKXJMcz70_0 2024-09-14T12:09:53.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.365+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16161606925633858050', time=2024-09-14T13:52:26.690447+0000, chain.objs.size()=1 2024-09-14T12:09:53.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.365+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Q2ozdnizNdbO0tNGFFnBK8ljupfnjvr_0 2024-09-14T12:09:53.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.369+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11448193434928995427', time=2024-09-14T13:52:27.196791+0000, chain.objs.size()=1 2024-09-14T12:09:53.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.369+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ee-oD53EDnook8xBmmHbpfggNAFdEH-_0 2024-09-14T12:09:53.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.369+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6046778876043034288', time=2024-09-14T13:52:27.322899+0000, chain.objs.size()=1 2024-09-14T12:09:53.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.369+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RSXlIqYQDh_uV40bmAIMxM3_G8RmbJS_0 2024-09-14T12:09:53.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17777382502001734475', time=2024-09-14T13:52:29.298341+0000, chain.objs.size()=1 2024-09-14T12:09:53.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.b-1WeQasKoiSFwo6zhmHihyDJA4pojn_0 2024-09-14T12:09:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9506799833859355814', time=2024-09-14T13:52:29.370809+0000, chain.objs.size()=1 2024-09-14T12:09:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zlELCDMAZjjfr8m1kwI0EQXRavHiJIS_0 2024-09-14T12:09:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5404859108810283010', time=2024-09-14T13:52:29.559490+0000, chain.objs.size()=1 2024-09-14T12:09:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rkz1vUOilr-13Roz2evsmCpi8MJyijJ_0 2024-09-14T12:09:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12503987540468431644', time=2024-09-14T13:52:30.091468+0000, chain.objs.size()=1 2024-09-14T12:09:53.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.370+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pS7VRU3FXDR8u9i1ym_Yov9F20BhzBx_0 2024-09-14T12:09:53.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.374+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/43991 2024-09-14T12:09:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T12:09:53.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2106738214450531124', time=2024-09-14T13:52:30.198869+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RSl9YFM3RxApEa7gCBPT9xIb2-EneN9_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3977554954015646074', time=2024-09-14T13:52:30.450472+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.89QQxwohoWL7bXCXvwNyIyaYLy1cTwU_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15275679592684516480', time=2024-09-14T13:52:30.651424+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eohzfkUu2-7DC7QQd0e6zOyRV7U03tE_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7056690751778632720', time=2024-09-14T13:52:30.652082+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Hjo1vzdVkLi0B7iRM6F6TCkuoRh3gwv_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1051064611604014096', time=2024-09-14T13:52:30.789396+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.oNPhn4lygPGaESPvXkS7wC8IVN6FHkp_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7021376670207209530', time=2024-09-14T13:52:30.848938+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GZNh0yHtUreb3ISjelwbFUyPOwzI4jF_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11527839890932224560', time=2024-09-14T13:52:32.012671+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.376+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dm7LSS89f8nW7Aezf8xFgy4RSamGoAE_0 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16037186972835737726', time=2024-09-14T13:52:55.934046+0000, chain.objs.size()=1 2024-09-14T12:09:53.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.372__shadow_.ca_y8SRBfYLeRoJu1s6MPcKVUbvGjRf_0 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15885063690809599045', time=2024-09-14T13:54:02.585342+0000, chain.objs.size()=1 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.mtn-5zJgLZf_BLatUW2eBbNanhkPE0x_0 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9099802404041192517', time=2024-09-14T13:54:07.726735+0000, chain.objs.size()=1 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.487__shadow_._GnQx5LZlG4fjelImX2dIivSGWowTW__0 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6055968118529494459', time=2024-09-14T13:54:11.324750+0000, chain.objs.size()=1 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.493__shadow_.J9lTh66qXu7lidXF5SpLkaxJ1xMwlvE_0 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1102761248277212726', time=2024-09-14T13:57:20.618580+0000, chain.objs.size()=1 2024-09-14T12:09:53.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.377+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.551__shadow_.ZQW9AbFJTgAfzxeMNrMjfBc_8BRdIRP_0 2024-09-14T12:09:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.380+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2443078874272313627', time=2024-09-14T13:57:24.927849+0000, chain.objs.size()=1 2024-09-14T12:09:53.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.380+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.553__shadow_.BF5b1xCQXQ_YUuoChPsEMSW9pB0B0f5_0 2024-09-14T12:09:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.380+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10331680128477543198', time=2024-09-14T13:57:41.497344+0000, chain.objs.size()=1 2024-09-14T12:09:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.380+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.560__shadow_.eD8GJtw9nkQtmOAHXXF7RVIyBPg8T0T_0 2024-09-14T12:09:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2062565098652319661', time=2024-09-14T13:57:42.490314+0000, chain.objs.size()=1 2024-09-14T12:09:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.561__multipart_mymultipart.t3ghiVv7vbXUbMPZalSQHjA-llVJxeLG.1 2024-09-14T12:09:53.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8419087036092414589', time=2024-09-14T13:57:49.772356+0000, chain.objs.size()=1 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.564__shadow_.BIOFv2VlvfMzqiVmWxny3Q_RdJF5UaJ_0 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13978867583511789252', time=2024-09-14T13:57:58.920750+0000, chain.objs.size()=1 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:JO5twsEiBrghn9miVcWe8ktWyPiUSzr_.-8OtrrdHYXkL2ZsqF9AVDduPC1CyQya_0 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10796590341190526844', time=2024-09-14T13:58:00.787014+0000, chain.objs.size()=1 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:C26jHw67UI8bxaKi3Ry0jGMLlm8O1-O_.3Ab5KtjPoXpjbXAX85DTe5vY1Tp4dvR_0 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10637664179311448724', time=2024-09-14T13:58:22.905954+0000, chain.objs.size()=1 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:SxZIElaPhJcRRSb-6BQaTWQjn-4mXLG_.hmY6yOWF_xa_cDoinWzmr1eZGGuLt4X_0 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4772719324931154920', time=2024-09-14T13:58:23.421268+0000, chain.objs.size()=1 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:aoekP7usNg5cdzXEUEhFhepo8.v5nih_.XO5JOQggCbSEBh8RO7RdvIBKAPdj1Z__0 2024-09-14T12:09:53.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16551668911326067467', time=2024-09-14T13:58:24.247324+0000, chain.objs.size()=1 2024-09-14T12:09:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:O3miQyXUgU0o92Hurihxp1moeC4652c_.pIRAuV-w2iOm198chMsWKQ4SO3OGhwy_0 2024-09-14T12:09:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11650512347449122093', time=2024-09-14T14:00:21.947624+0000, chain.objs.size()=6 2024-09-14T12:09:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.615__multipart_multipart_enc.2~k2KRvmFb2w8CtkZboMYPm9ymXncINvr.1 2024-09-14T12:09:53.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.381+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.615__multipart_multipart_enc.2~k2KRvmFb2w8CtkZboMYPm9ymXncINvr.2 2024-09-14T12:09:53.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.615__multipart_multipart_enc.2~k2KRvmFb2w8CtkZboMYPm9ymXncINvr.3 2024-09-14T12:09:53.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.615__multipart_multipart_enc.2~k2KRvmFb2w8CtkZboMYPm9ymXncINvr.4 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.615__multipart_multipart_enc.2~k2KRvmFb2w8CtkZboMYPm9ymXncINvr.5 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.615__multipart_multipart_enc.2~k2KRvmFb2w8CtkZboMYPm9ymXncINvr.6 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4132253269475137867', time=2024-09-14T14:02:25.432660+0000, chain.objs.size()=1 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.618__shadow_.gLZU3s8OiRfPHJ2PtK_6wxdwCoMZxij_0 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15733640914841260764', time=2024-09-14T14:03:03.877857+0000, chain.objs.size()=1 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.629__shadow_.dZX0MAIJRimBgAZ1AX1ge75VJQCR9OX_0 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4648182722055928089', time=2024-09-14T14:03:23.988843+0000, chain.objs.size()=1 2024-09-14T12:09:53.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.385+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.650__shadow_.4eHg8ZirTrPS9Az86DLENwRBdgZWxVM_0 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17489944254343577492', time=2024-09-14T14:03:25.699638+0000, chain.objs.size()=1 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.653__shadow_.tq8YxhWmK-oHyujRDy-rq7sIdtGdNvS_0 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4467074175438738229', time=2024-09-14T14:03:54.805967+0000, chain.objs.size()=1 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.668__shadow_.ZBqqH0oz8tnM3yDD7fXz-qc7Etec77h_0 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8819280072069819081', time=2024-09-14T14:04:00.202080+0000, chain.objs.size()=1 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.679__shadow_.IUvcK1ckk8Xp-A1smX5BBbkaLcqRohQ_0 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15329535442278320220', time=2024-09-14T14:05:00.837021+0000, chain.objs.size()=1 2024-09-14T12:09:53.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.740__shadow_.5f9pKd1bAskoiPz_jM-nV63pWrq7bBQ_0 2024-09-14T12:09:53.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3811986210307459053', time=2024-09-14T14:06:31.224786+0000, chain.objs.size()=1 2024-09-14T12:09:53.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.387+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.762__shadow_.IC1xbp7hYlFgaAhMprknIpADoVqSRww_0 2024-09-14T12:09:53.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.388+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8687009540520187437', time=2024-09-14T14:07:13.771234+0000, chain.objs.size()=1 2024-09-14T12:09:53.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.388+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.776__shadow_.ZIIVURGAqtLFUMIjp-afrZNXsObh1SM_0 2024-09-14T12:09:53.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.392+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.394+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T12:09:53.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.398+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.398+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45066' 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11358646636761737462', time=2024-09-14T13:46:49.112492+0000, chain.objs.size()=2 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.Nz-aSeajPNoYl89mO9GzHXH0OBxeyEY_0 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.Nz-aSeajPNoYl89mO9GzHXH0OBxeyEY_1 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_JydXmTMFKJtItme8diHWypAOKm0KAlq', time=2024-09-14T13:46:57.333109+0000, chain.objs.size()=2 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.9clqAKjn-DNbBa9uEpXP9_-Q9Xy17Ir_0 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.9clqAKjn-DNbBa9uEpXP9_-Q9Xy17Ir_1 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.854679685220972674', time=2024-09-14T13:47:35.214866+0000, chain.objs.size()=1 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.204__shadow_.LGvDJagxxCV_3xBxC1uRAB0baIN2Z2r_0 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6770371225154029234', time=2024-09-14T13:49:07.788135+0000, chain.objs.size()=1 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.241__shadow_.dUQ62AvRqNgnKacoU-suLKj_yNc30ny_0 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4962636278451936771', time=2024-09-14T13:49:17.809157+0000, chain.objs.size()=1 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.256__shadow_.d_B9TfdOl0S5uTR5pnMN8XlpO3Z9xVL_0 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.138326201504918839', time=2024-09-14T13:49:58.830208+0000, chain.objs.size()=1 2024-09-14T12:09:53.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.62J9jVnW0cCLtF0H05XsBL-PILOQTeF_0 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9590538034145978299', time=2024-09-14T13:49:59.678429+0000, chain.objs.size()=1 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vf3UHkEiXdXCsSSAihhcrjlxR4kwGsL_0 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4206324502914477195', time=2024-09-14T13:49:59.679104+0000, chain.objs.size()=1 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WjMTtum7EPICjXL16jIcPV1PsL6C2BQ_0 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3077539105406058067', time=2024-09-14T13:50:00.489275+0000, chain.objs.size()=1 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._BjNyanYNEiLjCHSgYFopxyeo3GcIDR_0 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14494935360891724497', time=2024-09-14T13:50:00.606322+0000, chain.objs.size()=1 2024-09-14T12:09:53.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8zUDfxP0alRksTXObca_oNRW5kyRlT6_0 2024-09-14T12:09:53.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1262623756861373771', time=2024-09-14T13:50:00.753041+0000, chain.objs.size()=1 2024-09-14T12:09:53.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RSHBCnf9WSU6RQSyM6QaStp3ezZdvbH_0 2024-09-14T12:09:53.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2620956944547822114', time=2024-09-14T13:50:00.925217+0000, chain.objs.size()=1 2024-09-14T12:09:53.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.agNwB9NDyDDRqe9J1Y7neEkC2Zv4DGS_0 2024-09-14T12:09:53.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11317930489882967569', time=2024-09-14T13:50:01.157830+0000, chain.objs.size()=1 2024-09-14T12:09:53.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-YLTnezlrxEeZVmsGQQPqKNuey2ghc5_0 2024-09-14T12:09:53.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7463970756148903115', time=2024-09-14T13:50:01.439201+0000, chain.objs.size()=1 2024-09-14T12:09:53.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.deQcHGreHTke2ivwJoN9eyvRn_bk12B_0 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4530709733506107173', time=2024-09-14T13:50:01.508957+0000, chain.objs.size()=1 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DQ91P0KA9v1RQoI-Lwujin7xUC-ImeA_0 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15529254711009919200', time=2024-09-14T13:50:02.166719+0000, chain.objs.size()=1 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.daonwKIhj-qyK4I1HRYhFqt2fCjF6VE_0 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6808162270255584773', time=2024-09-14T13:50:02.453323+0000, chain.objs.size()=1 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pqLUt9DuekRTqalNvlpMy8xTXjeeBau_0 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4198456879451887220', time=2024-09-14T13:50:02.603489+0000, chain.objs.size()=1 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eWjoAbQg-VLceqYn2Zt9yLfXo9USGc__0 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9842734270347931578', time=2024-09-14T13:50:02.604617+0000, chain.objs.size()=1 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hMQn7_DhGmHgBNofwKgC-IpDXZtdqs4_0 2024-09-14T12:09:53.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1728705549184077862', time=2024-09-14T13:50:02.883972+0000, chain.objs.size()=1 2024-09-14T12:09:53.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GK6zs_7NFOocxJIYYqwgOwMtpeU3ppd_0 2024-09-14T12:09:53.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17941760128141096463', time=2024-09-14T13:50:03.646018+0000, chain.objs.size()=1 2024-09-14T12:09:53.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.405+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SQ7BjWSvSLtRov17iRVoxkBCbmspvfR_0 2024-09-14T12:09:53.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.163654367314262053', time=2024-09-14T13:50:03.840677+0000, chain.objs.size()=1 2024-09-14T12:09:53.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.JTUbJzvJRL6jeW0Lb_OIM_gU4SnBPyb_0 2024-09-14T12:09:53.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16107352770541017782', time=2024-09-14T13:50:03.871404+0000, chain.objs.size()=1 2024-09-14T12:09:53.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.K--Cp4Iwmlqux3GXO0uyuaWy54ZodSh_0 2024-09-14T12:09:53.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17437487441164957792', time=2024-09-14T13:50:04.443319+0000, chain.objs.size()=1 2024-09-14T12:09:53.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7UDiYwqsYHYf-02bur4BPn71F6Y5eiT_0 2024-09-14T12:09:53.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9606376666037983381', time=2024-09-14T13:50:04.871425+0000, chain.objs.size()=1 2024-09-14T12:09:53.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._WeHr4GohSZth9NXmLLPLqyDSqgDqA4_0 2024-09-14T12:09:53.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7719438103696092626', time=2024-09-14T13:50:05.551989+0000, chain.objs.size()=1 2024-09-14T12:09:53.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lDTcsk6454d02jH9PclhMTH01-FDLb9_0 2024-09-14T12:09:53.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7113691059583439305', time=2024-09-14T13:50:06.245322+0000, chain.objs.size()=1 2024-09-14T12:09:53.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kVFAAL-9aDw3MLMbt92PCxaqk3b651H_0 2024-09-14T12:09:53.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12577751400020415823', time=2024-09-14T13:50:08.002904+0000, chain.objs.size()=1 2024-09-14T12:09:53.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9xpIzd-B5r4iPT-qeV1FUFBhhycczkK_0 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12171305401073623379', time=2024-09-14T13:50:08.137893+0000, chain.objs.size()=1 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._9Ia64yYWuS5kMk7qeL2SL3xWW8eVAU_0 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3507013932837047171', time=2024-09-14T13:50:08.243893+0000, chain.objs.size()=1 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZrLT7rrGzV5k7tlnCIhF-c-k9Y4-BD1_0 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3425558856247184702', time=2024-09-14T13:50:08.259892+0000, chain.objs.size()=1 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YQdlUl2dxPPXQUEGDzxaWWw0qvMlzBF_0 2024-09-14T12:09:53.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7044674894033233228', time=2024-09-14T13:50:09.032120+0000, chain.objs.size()=1 2024-09-14T12:09:53.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.h9vH9twKakhcaDtfZWarWylLSXjDmEb_0 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.411+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8200636025005844514', time=2024-09-14T13:50:09.060756+0000, chain.objs.size()=1 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.411+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HCVDF6B-O2mWTPoq_n3JptuwYVInRZ7_0 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.411+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1614784902196333506', time=2024-09-14T13:50:09.316945+0000, chain.objs.size()=1 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.411+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lVLYVGn5h_7K9yCcCkCemMFHcz4SKIN_0 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.412+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13776985921411397462', time=2024-09-14T13:50:09.373863+0000, chain.objs.size()=1 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.412+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.H6D62HDeghIQjUIQkI6pNwF3GmAvogC_0 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.412+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16012688143783887641', time=2024-09-14T13:50:09.545913+0000, chain.objs.size()=1 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.412+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0EuV9pIloEuk4OTqzMW2mIGBkXG3ukm_0 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.412+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17219542147107598752', time=2024-09-14T13:50:12.837221+0000, chain.objs.size()=1 2024-09-14T12:09:53.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.412+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.267__shadow_.T3aL2YQbEVYdkQndpe7yZ1zWGYxXZTZ_0 2024-09-14T12:09:53.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.414+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17361611867107404763', time=2024-09-14T13:50:26.545279+0000, chain.objs.size()=1 2024-09-14T12:09:53.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.414+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.289__shadow_.S4M5bDWXXEoMvsrtON7KfBGwXq69CwT_0 2024-09-14T12:09:53.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14766103090694256309', time=2024-09-14T13:50:37.703971+0000, chain.objs.size()=1 2024-09-14T12:09:53.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.302__shadow_.6yNyFW6-j9pqcJ5LSz9wBo0U1SixI0-_0 2024-09-14T12:09:53.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18032584180120349291', time=2024-09-14T13:50:39.579353+0000, chain.objs.size()=1 2024-09-14T12:09:53.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.305__shadow_.dLyl04DXjInExSVnhqUbjx781WiPbSJ_0 2024-09-14T12:09:53.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10367688363800426814', time=2024-09-14T13:51:30.790269+0000, chain.objs.size()=1 2024-09-14T12:09:53.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4Br5mm3u0SPWxp3K7iKBKZBs_XmCkni_0 2024-09-14T12:09:53.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16519584563061135299', time=2024-09-14T13:51:30.790991+0000, chain.objs.size()=1 2024-09-14T12:09:53.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.415+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uGNB9SNnBxCUhVKagn_ZqR-PwZmtm-l_0 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14654384986743757244', time=2024-09-14T13:51:30.892846+0000, chain.objs.size()=1 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ONEe1MthyF6dV6DRIyUoKC8NaJb5KUg_0 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3112529835686755788', time=2024-09-14T13:51:31.362278+0000, chain.objs.size()=1 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e1_AAfP6ggEHDU_iZzEjqAjnUrq8gJC_0 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1756263374518886398', time=2024-09-14T13:51:31.721806+0000, chain.objs.size()=1 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.x5OFFCouDjtnwBcKlzEE5XoOnAJIwgl_0 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11515667385913781436', time=2024-09-14T13:51:32.316509+0000, chain.objs.size()=1 2024-09-14T12:09:53.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WXrpXO5UJSoXiQganhQNty9RCgt3C3D_0 2024-09-14T12:09:53.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14513038727434110556', time=2024-09-14T13:51:32.317601+0000, chain.objs.size()=1 2024-09-14T12:09:53.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vaJL30xru_QC1TV7CDmN3SAcwQfbvOf_0 2024-09-14T12:09:53.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2362820941137564115', time=2024-09-14T13:51:32.394818+0000, chain.objs.size()=1 2024-09-14T12:09:53.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.416+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MvadNFhy6sZ37Qdse3b7C3wX_8ol5K-_0 2024-09-14T12:09:53.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12316016265308211301', time=2024-09-14T13:51:32.518355+0000, chain.objs.size()=1 2024-09-14T12:09:53.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bZXA0rBYz3pwagDNTKQj020d3Duw4us_0 2024-09-14T12:09:53.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6782198727782179743', time=2024-09-14T13:51:32.698352+0000, chain.objs.size()=1 2024-09-14T12:09:53.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tKMKU0jWERR_cu1c4jeOsju8rFNM80X_0 2024-09-14T12:09:53.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.419+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1869064263230341652', time=2024-09-14T13:51:32.821156+0000, chain.objs.size()=1 2024-09-14T12:09:53.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.419+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EbEgtzqyTeAtpStICkvGU1gHW8G5D-R_0 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15194194270698273959', time=2024-09-14T13:51:32.833075+0000, chain.objs.size()=1 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uvHJ6FXr5tF58MR4uTyzNpeDq4TMg8d_0 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9975001810429432193', time=2024-09-14T13:51:33.110457+0000, chain.objs.size()=1 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dyR1qdDp3g0FPAh5_qG-KY1wQzHliIC_0 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5279318061990608624', time=2024-09-14T13:51:33.250067+0000, chain.objs.size()=1 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IEPSX6bO3ON6YJHuV3HZeN5TOxsaBi0_0 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17467715848670774769', time=2024-09-14T13:51:33.282573+0000, chain.objs.size()=1 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YZ3Jva55p3TGTDqF-ljJ9uByOdF8Qrd_0 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7206206190859514161', time=2024-09-14T13:51:33.839198+0000, chain.objs.size()=1 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TqVVVf1fLgE75E2qFlp0OAeQ-eCbocY_0 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14375564587536495298', time=2024-09-14T13:51:34.163813+0000, chain.objs.size()=1 2024-09-14T12:09:53.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.n7IYgAI32MZBjydQS9WVkQZyFOxpiR6_0 2024-09-14T12:09:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12549901329938943523', time=2024-09-14T13:51:34.343717+0000, chain.objs.size()=1 2024-09-14T12:09:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Yotk6VmT11GZpzEjYhUnzisQMW8YaR1_0 2024-09-14T12:09:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15164885405706478376', time=2024-09-14T13:51:34.793110+0000, chain.objs.size()=1 2024-09-14T12:09:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QHj-ePn22MoL-8FpTmk6xQaRjVJnrhG_0 2024-09-14T12:09:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16694661249060543568', time=2024-09-14T13:51:35.685192+0000, chain.objs.size()=1 2024-09-14T12:09:53.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wrT6TioqtgPasZXR-a8sdina3-Lm2An_0 2024-09-14T12:09:53.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.424+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4837090945221341391', time=2024-09-14T13:51:36.177632+0000, chain.objs.size()=1 2024-09-14T12:09:53.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.424+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LRMLPWkocZifQ1dPyIXpj-_XL7iV02H_0 2024-09-14T12:09:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8611459819591370816', time=2024-09-14T13:51:36.409333+0000, chain.objs.size()=1 2024-09-14T12:09:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.a5da-TecMJc7TTe6UuuXFdcFeg4o4zC_0 2024-09-14T12:09:53.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15743528298987539388', time=2024-09-14T13:51:36.944106+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-aEFq_AsOXn03ZHTNOBZMiLTqZP5Bg6_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4144059827531370267', time=2024-09-14T13:51:37.082674+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e93PwYTAPaEWQPqVoTu8UwEffUDMun0_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4095422754081249680', time=2024-09-14T13:51:37.477874+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.NPBCgermZGwt5DUpuzzPIsL9IUAurP4_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.425+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16494020567342028631', time=2024-09-14T13:51:37.735768+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rL0kzh2hV6P1X96urPHA3jIgcSaeuE1_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12788047988958880967', time=2024-09-14T13:51:37.880254+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yjDMI4vHbYmldFq3anNjVzsY7Pd_Atp_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7549187937850090277', time=2024-09-14T13:51:37.881341+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5l7A_KBIbU-CNHijLcsANXarTaMTBYC_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15623576749167265898', time=2024-09-14T13:51:38.345280+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5-s6rTCu9xXdpHbAIA9oBlEjz08JIAp_0 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13953275189246675306', time=2024-09-14T13:51:38.471689+0000, chain.objs.size()=1 2024-09-14T12:09:53.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nHJJo7BTWrwD1YdgBD69ZabBGy8pifv_0 2024-09-14T12:09:53.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14591271232631492758', time=2024-09-14T13:51:38.473114+0000, chain.objs.size()=1 2024-09-14T12:09:53.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.426+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4uFc41xZwboP6Ymx4XdNH9taYCE0rCc_0 2024-09-14T12:09:53.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.428+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16611414755510193552', time=2024-09-14T13:51:38.581887+0000, chain.objs.size()=1 2024-09-14T12:09:53.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.428+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hOAYuOBiMfr-iDvJJKr9SKXLV56cn_I_0 2024-09-14T12:09:53.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12616678485746695110', time=2024-09-14T13:51:38.906790+0000, chain.objs.size()=1 2024-09-14T12:09:53.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lkm8xMzLbzCZHLyMCxK4VeJVEcwCYRr_0 2024-09-14T12:09:53.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15743670407682516210', time=2024-09-14T13:51:39.851367+0000, chain.objs.size()=1 2024-09-14T12:09:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.CV4xkbX2QQQ7n1tdjMoY1rLSVsjIBs-_0 2024-09-14T12:09:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2568729688430159461', time=2024-09-14T13:51:39.954135+0000, chain.objs.size()=1 2024-09-14T12:09:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pB9UghpMX9vGMvZi23r4L9pSVkGdTYC_0 2024-09-14T12:09:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13815720114351970577', time=2024-09-14T13:51:40.511953+0000, chain.objs.size()=1 2024-09-14T12:09:53.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.n4YDNRA4l03ueEwAWboC6Pefu5-bY5a_0 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6327197735000080825', time=2024-09-14T13:51:40.710404+0000, chain.objs.size()=1 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._iEEV1ExWKCH7z7mH-fr9mIX8alYQNE_0 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14226215049308126272', time=2024-09-14T13:51:41.275050+0000, chain.objs.size()=1 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.f7Yb54xPI5sSXW2QD9-AW-BNsPiPCoE_0 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13108792551294819302', time=2024-09-14T13:51:41.376810+0000, chain.objs.size()=1 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Fnmpp3HTxeKD166WzLN4Ey0NUqQQBHT_0 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12392566753660683135', time=2024-09-14T13:51:41.757368+0000, chain.objs.size()=1 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-TbPvtFWOf60F9k2YxzVk4YbhHRi4oD_0 2024-09-14T12:09:53.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.131863498608754124', time=2024-09-14T13:52:21.126332+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yEhJuM8lDu4siZOsRCtPFAKZ1DcZjWd_0 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16190115011329184498', time=2024-09-14T13:52:21.128132+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Pauj5LLug2Yiu9K6v9mRdPiG91SqfaK_0 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.565615494102233606', time=2024-09-14T13:52:21.238932+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fs8eyT46gQZlYZx0SA3qgCVtwDz1j6N_0 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18194708303036716298', time=2024-09-14T13:52:21.380539+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QpA1Goa1azAhy9LeT8b1M19jgXEDB1-_0 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4717363736183407805', time=2024-09-14T13:52:21.853554+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Pkzukf8YEC0hNFFba5d3EzdDPGqzibz_0 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1162402633744303985', time=2024-09-14T13:52:21.916961+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lcOMweN7ITexmMAkIO3HpRy2uiEgFmR_0 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.902326980007256049', time=2024-09-14T13:52:21.965957+0000, chain.objs.size()=1 2024-09-14T12:09:53.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ry2141w5zI6rHfMAwSUS4bH5C2SVz0c_0 2024-09-14T12:09:53.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.435+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11653624941048386518', time=2024-09-14T13:52:22.930616+0000, chain.objs.size()=1 2024-09-14T12:09:53.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.435+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YIIUp8CZsgEC3_lwSQLPAeaIw6zWtLA_0 2024-09-14T12:09:53.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.435+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14151332494492594032', time=2024-09-14T13:52:22.974912+0000, chain.objs.size()=1 2024-09-14T12:09:53.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.435+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SvGn4agqnCj7KSjlqfjMjUqgAjayFt4_0 2024-09-14T12:09:53.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.435+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6388144944625193659', time=2024-09-14T13:52:23.121919+0000, chain.objs.size()=1 2024-09-14T12:09:53.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.435+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.OZ43BfN2IzQw5EXODSDxXDcxjXJh8r0_0 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.708234572635456518', time=2024-09-14T13:52:23.336888+0000, chain.objs.size()=1 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nyE4j7CC3UFZjyfGrz9NeKbr11WC1Nb_0 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6524574858132469537', time=2024-09-14T13:52:23.402586+0000, chain.objs.size()=1 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7keyqnjuU0Lu4u_u3CSNnsGeUd1lPRZ_0 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8726584340300631025', time=2024-09-14T13:52:24.517973+0000, chain.objs.size()=1 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vl9JsW42M1A863KWpgZFQYeIjndl-Tu_0 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15606432222249690680', time=2024-09-14T13:52:24.637962+0000, chain.objs.size()=1 2024-09-14T12:09:53.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aXAwC9aWY-ydrq7euL0YB7BwpgasMW4_0 2024-09-14T12:09:53.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.437+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4457928905171553686', time=2024-09-14T13:52:24.945023+0000, chain.objs.size()=1 2024-09-14T12:09:53.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.437+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KPnDkTh9iNpvDVxvVOriGDOiV2KDGua_0 2024-09-14T12:09:53.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3958096604882368817', time=2024-09-14T13:52:25.104782+0000, chain.objs.size()=1 2024-09-14T12:09:53.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hPDKlrdK9mJ9HFezNe5MMsAbJP0BWAY_0 2024-09-14T12:09:53.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14440661109489645055', time=2024-09-14T13:52:25.773018+0000, chain.objs.size()=1 2024-09-14T12:09:53.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kt4H_oGPbh91H5IaQSpeYWgvGWKfW8f_0 2024-09-14T12:09:53.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1468414662214111195', time=2024-09-14T13:52:25.773721+0000, chain.objs.size()=1 2024-09-14T12:09:53.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RP67RCRrzQSknpVx3gyNWJzUKYXe5jf_0 2024-09-14T12:09:53.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3296080558474223043', time=2024-09-14T13:52:27.605338+0000, chain.objs.size()=1 2024-09-14T12:09:53.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.joHIy8GK_Tjo1IUxgVc-rGQKYoG55Gb_0 2024-09-14T12:09:53.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1858418134961460915', time=2024-09-14T13:52:28.001041+0000, chain.objs.size()=1 2024-09-14T12:09:53.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7qXBbV40q2X3PM-Tbaa6oq9qMHzeTIc_0 2024-09-14T12:09:53.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.442+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/45066 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10245832114223252768', time=2024-09-14T13:52:28.231005+0000, chain.objs.size()=1 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-fHlJPm9A1LzZUbgJzApji68EFkpbJi_0 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9597818692047218437', time=2024-09-14T13:52:28.945549+0000, chain.objs.size()=1 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jFEY6nb2P212ScIUugIH8ZTaKqZMLf7_0 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.835327826340158781', time=2024-09-14T13:52:29.441806+0000, chain.objs.size()=1 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sSVnDwRmGd0qEYBwBSVQhyXGUCPdruJ_0 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14593258720678373723', time=2024-09-14T13:52:29.571593+0000, chain.objs.size()=1 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aML3kwFVSixzlyX6Cpg88Uow6vpJk8F_0 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11650332938818760308', time=2024-09-14T13:52:29.670034+0000, chain.objs.size()=1 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yYxQqMvOL5OtsOuTcAI0-KULHKZac-H_0 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8748175052156366339', time=2024-09-14T13:52:30.109542+0000, chain.objs.size()=1 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.icPnmGENtKdS4ZlvkOxAVNciCjDa5Ma_0 2024-09-14T12:09:53.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5376127691657829568', time=2024-09-14T13:52:30.645478+0000, chain.objs.size()=1 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bBAO6KVqzIjLqAvufuYzHErL28jEmY6_0 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10221770606458669315', time=2024-09-14T13:52:30.715171+0000, chain.objs.size()=1 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SW2xkTaUqXjLEOg6O4EhErj8i0t0auh_0 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2529490502168027972', time=2024-09-14T13:52:30.860300+0000, chain.objs.size()=1 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.CxorZ6CYqmyx14mZHHgmcUbkrUY6BpR_0 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16187686091679186665', time=2024-09-14T13:52:30.943156+0000, chain.objs.size()=1 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UWX_dUMZv_EodpNmHoNieCxzZC-uSxs_0 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18309508931285120076', time=2024-09-14T13:52:31.321824+0000, chain.objs.size()=1 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ms3FwK5kCiamV1K6pIszQHMotckehLy_0 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16824846396607660595', time=2024-09-14T13:52:31.355788+0000, chain.objs.size()=1 2024-09-14T12:09:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.448+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9xRwbZblnaYKGF2TSm9BhY9m06RTLPb_0 2024-09-14T12:09:53.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.452+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1460959307298503154', time=2024-09-14T13:52:31.384993+0000, chain.objs.size()=1 2024-09-14T12:09:53.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.452+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ihpg1bvm8ExW6KnWP3Ji0HobyhLeLZ0_0 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12876364292988990885', time=2024-09-14T13:52:31.541852+0000, chain.objs.size()=1 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZyU4yGDkXqS07pSM9jZve74MZ-N5yVg_0 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17818998977707989577', time=2024-09-14T13:52:32.214487+0000, chain.objs.size()=1 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BXsvGcH7CTfoJjojZUJ0c6LlJYSAThw_0 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4333030684695012573', time=2024-09-14T13:52:40.230627+0000, chain.objs.size()=1 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.339__shadow_.mpDcyGhvTACJcMKxU03U5DexnNenPBG_0 2024-09-14T12:09:53.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3250535930774116835', time=2024-09-14T13:52:40.735698+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.340__shadow_.b3ACtE78N_vKg3FyQUXZhAf8JBi-JwR_0 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4265331381455173297', time=2024-09-14T13:53:31.575656+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.432__shadow_.i9kLZJKkvSlxfAzq51HoiQa3tBPELF3_0 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7157139497058734594', time=2024-09-14T13:56:06.046535+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~hKTfQZG5cm2GFhRxnJJUlkML-b2iHdZ.1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~VGf5G_ggldSzt0eipwASBmYwcL9m3x4', time=2024-09-14T13:56:37.531586+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.531__multipart_mymultipart2.2~VGf5G_ggldSzt0eipwASBmYwcL9m3x4.1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5302967271143186995', time=2024-09-14T13:57:34.295071+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.557__shadow_.AT46JKE5JMT6XWmWX8u879qYsA_W1XQ_0 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7986922105711316080', time=2024-09-14T13:57:49.213957+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.563__shadow_.s2XIrS-Rl63CVmvcgZYH49IbTCdL_II_0 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10799918911057866738', time=2024-09-14T13:58:15.878256+0000, chain.objs.size()=1 2024-09-14T12:09:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:oSR4XGVw1L2cjwZQjsKD5n5h.UC.YVL_.N2qDTyGkM0eeH1xiHzWIlXUHBlQRQ-d_0 2024-09-14T12:09:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9241255776378467552', time=2024-09-14T13:58:18.059396+0000, chain.objs.size()=1 2024-09-14T12:09:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:vlDXsKkV6iMoKI3f1k.U1UmXNaelfLP_.Uj77oMR92xRlFmNSWDLbyiJPNp6frJ7_0 2024-09-14T12:09:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1731385522374550466', time=2024-09-14T13:58:29.191037+0000, chain.objs.size()=1 2024-09-14T12:09:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:3ksIt2O2impNPOcroIws4cQfiZzmBI9_.jg4O0s9YXL8ohc_KUmwjlLhkBbrwYDK_0 2024-09-14T12:09:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14126688217382545904', time=2024-09-14T13:58:34.490869+0000, chain.objs.size()=1 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:.jCCvoihnikwa.5fsF9edG6BMmr.LSF_.RTOmtCwgxZWWkBO_XLLriDTwwxSf9ck_0 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7630023333856701907', time=2024-09-14T14:03:30.338875+0000, chain.objs.size()=1 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.656__shadow_.SMpaJg2yjZ3FBBcyqfVdj6fhJWneqlp_0 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16545549505704852491', time=2024-09-14T14:03:49.600813+0000, chain.objs.size()=6 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.660__multipart_bar.2~Tzh6gD_apI4uafLWlSuT-Ukpi1ziIv6.1 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.660__multipart_bar.2~Tzh6gD_apI4uafLWlSuT-Ukpi1ziIv6.2 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.660__multipart_bar.2~Tzh6gD_apI4uafLWlSuT-Ukpi1ziIv6.3 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.457+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.660__multipart_bar.2~Tzh6gD_apI4uafLWlSuT-Ukpi1ziIv6.4 2024-09-14T12:09:53.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.660__multipart_bar.2~Tzh6gD_apI4uafLWlSuT-Ukpi1ziIv6.5 2024-09-14T12:09:53.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.459+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.660__multipart_bar.2~Tzh6gD_apI4uafLWlSuT-Ukpi1ziIv6.6 2024-09-14T12:09:53.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.459+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10562831388523913853', time=2024-09-14T14:04:00.204687+0000, chain.objs.size()=1 2024-09-14T12:09:53.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.459+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.679__shadow_.wHxisp_FZBv-0nteCSrHBEGMN1Iv3Qq_0 2024-09-14T12:09:53.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9821980306273752696', time=2024-09-14T14:04:19.289164+0000, chain.objs.size()=1 2024-09-14T12:09:53.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.712__shadow:2xG17a-2BsBUOvygTRY3kbqod9lEEfn_.eq-E1Pi1D_E69g5KeYEJgbD0gqqwfjK_0 2024-09-14T12:09:53.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13455613730593031735', time=2024-09-14T14:04:50.156521+0000, chain.objs.size()=1 2024-09-14T12:09:53.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.734__shadow_.bqegkxJKvefCbKKkmFNU_Wm1BJBDAaF_0 2024-09-14T12:09:53.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5354469004970272251', time=2024-09-14T14:04:59.476048+0000, chain.objs.size()=1 2024-09-14T12:09:53.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.739__shadow_.kpzrq1q92VW3ftGFUtCXDV3K5v0PkEy_0 2024-09-14T12:09:53.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11113919177353223474', time=2024-09-14T14:05:57.795809+0000, chain.objs.size()=1 2024-09-14T12:09:53.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.753__shadow_.zH6nWhIKqaYFUgEutdn-sRCN5UkeWyX_0 2024-09-14T12:09:53.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.465+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.468+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T12:09:53.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.470+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.470+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/71807' 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1419756693584582918', time=2024-09-14T13:49:07.139627+0000, chain.objs.size()=1 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.240__shadow_.htSsPIhuFHSix46dL7rujM2DLKZRyCv_0 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7714449144460887721', time=2024-09-14T13:49:07.790949+0000, chain.objs.size()=1 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.241__shadow_.84qtLOtL-fOEcDBnn-E_AfpYv-GumA6_0 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4909030730773432446', time=2024-09-14T13:49:09.311256+0000, chain.objs.size()=1 2024-09-14T12:09:53.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.243__shadow_.KN-o2q4ylPxUMY3jqyFVo0x8nlfDLcW_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15859334554453140324', time=2024-09-14T13:49:10.809861+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.245__shadow_.MVjaHatlC7gWlskMI7keE_tDNAULSiS_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13102896983940821422', time=2024-09-14T13:49:12.103684+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.247__shadow_.1upDbDT3cfGEMuvU-BoJOWdR385zEai_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15527694693665743762', time=2024-09-14T13:49:59.343048+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ULVyDFP6ngmT5hTu3UXBGhpShbGTf3M_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4545809640274749814', time=2024-09-14T13:49:59.823216+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-SqkeJTg-68s_dqEu_w42qoUU5RvHFy_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6727068968034569655', time=2024-09-14T13:50:01.266923+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1VkJhkq_ZoKKmEHUdF9TkLhlHRFh78F_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10654334963334057624', time=2024-09-14T13:50:01.513975+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oGC1Gp3nbfvZRUzW2Uw_JJqvhuqouxM_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11825985666044730809', time=2024-09-14T13:50:02.370121+0000, chain.objs.size()=1 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.f4wijUgwSwC4IXZAi8UzatybxXtwBIn_0 2024-09-14T12:09:53.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10525368002598992501', time=2024-09-14T13:50:02.533804+0000, chain.objs.size()=1 2024-09-14T12:09:53.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tTq1k33tocxRSK8M-t953B4nmd2pB4M_0 2024-09-14T12:09:53.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1709346360884201074', time=2024-09-14T13:50:02.549227+0000, chain.objs.size()=1 2024-09-14T12:09:53.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.471+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2GR7WbTqmV1bpZOTCTSFI2uySZyyZlE_0 2024-09-14T12:09:53.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15175037531561119193', time=2024-09-14T13:50:02.777590+0000, chain.objs.size()=1 2024-09-14T12:09:53.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l2e3mmkTkP1kjPZ6YLIfrN_VUxihhyi_0 2024-09-14T12:09:53.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12152335745733449420', time=2024-09-14T13:50:02.994215+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SgM2fCcZPzWG_pxbHS6d7n8shsZZqQm_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9872590436567710088', time=2024-09-14T13:50:03.428410+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._PjKzEQsCAall0kBegISq9ydWzgy-EY_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18140629240098310479', time=2024-09-14T13:50:04.146799+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PmvoQtsDk1wECQbJjxQNilIjWwTil7t_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4392670470274249541', time=2024-09-14T13:50:04.438478+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.96YzPOGuo_liCdMt5Ynu0kRL9x7-nEg_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6638151647347645921', time=2024-09-14T13:50:04.996612+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RVyQYsspKZaX_PnoXbcXJJw8Ymsqq5j_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11538021738193134897', time=2024-09-14T13:50:05.384392+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.iPAzrW2rjcbSxaax_qnZ0kc5JJJJf43_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14923722769132656977', time=2024-09-14T13:50:05.593008+0000, chain.objs.size()=1 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cWZZWdvWDtsaiM6u2RjoXm0-viMXU1Q_0 2024-09-14T12:09:53.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17979395337724779604', time=2024-09-14T13:50:06.468163+0000, chain.objs.size()=1 2024-09-14T12:09:53.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1hyB3OItkUmSZyWFWS-XQfoOovFleKR_0 2024-09-14T12:09:53.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10037648266295589814', time=2024-09-14T13:50:06.901063+0000, chain.objs.size()=1 2024-09-14T12:09:53.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.anGQVWdd58-FUpTxhf-BO8dwnSf4ADN_0 2024-09-14T12:09:53.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.128954017749834892', time=2024-09-14T13:50:06.986871+0000, chain.objs.size()=1 2024-09-14T12:09:53.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.475+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sdRZjVbTNmOcj2EVvbo28oJcFn45X5r_0 2024-09-14T12:09:53.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.479+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9421835934804130443', time=2024-09-14T13:50:06.987718+0000, chain.objs.size()=1 2024-09-14T12:09:53.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.479+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6znHl4VNn4P6ciskersxqp69QjUcdiX_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3652805086437081702', time=2024-09-14T13:50:07.077650+0000, chain.objs.size()=1 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tzjrVkTyuyKgeuV6OuJgmGaslI6IIl8_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14400211682167137762', time=2024-09-14T13:50:07.143235+0000, chain.objs.size()=1 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gQIG2MDYDTHyqJeeN5WxhaPmKBpoupt_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10849446806350967103', time=2024-09-14T13:50:08.099560+0000, chain.objs.size()=1 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xrXWRc_9-Vrgj3unV3iSDbQ-TiyR1q9_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14445732921439810347', time=2024-09-14T13:50:08.168872+0000, chain.objs.size()=1 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FeG52hLqpN5IQ6Hykhz6wu-vQSpvPEv_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16484453250958282839', time=2024-09-14T13:50:08.318430+0000, chain.objs.size()=1 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4EZiVYY173LNQRxxJpd2ofA803dJkfp_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3894215005540582404', time=2024-09-14T13:50:08.600352+0000, chain.objs.size()=1 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cnNVIf8Dl_84xy5Zzu4izGVizCupBpp_0 2024-09-14T12:09:53.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9337476507733930959', time=2024-09-14T13:50:09.045102+0000, chain.objs.size()=1 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oyBjvZN2Lr3PSGmsie2iPcbOyggQX1A_0 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13239375823950934805', time=2024-09-14T13:50:09.428667+0000, chain.objs.size()=1 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dii5ZRqKz2t1khmdCb3quDDJ8UQv_Ga_0 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17428040550164131687', time=2024-09-14T13:50:09.541130+0000, chain.objs.size()=1 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vtEi3Z7Mz5hchav9KfAjIzSoXuT_FQ__0 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10361242510192816337', time=2024-09-14T13:50:11.087487+0000, chain.objs.size()=1 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.480+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.264__shadow_.Ic-BHdmgGZRXwKBW_tYRw6ZuzoW4P-M_0 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.482+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4597956624972979780', time=2024-09-14T13:50:18.892048+0000, chain.objs.size()=1 2024-09-14T12:09:53.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.482+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.277__shadow_.5__q-RSlsSuH82JBoEfCsrRQqasHLzj_0 2024-09-14T12:09:53.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.482+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4373021783880805182', time=2024-09-14T13:50:20.135323+0000, chain.objs.size()=1 2024-09-14T12:09:53.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.482+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.279__shadow_.lfzsaPCe9V-ncxc4vfEextQ4GfWLkzU_0 2024-09-14T12:09:53.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.483+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1532888308103319243', time=2024-09-14T13:50:29.792178+0000, chain.objs.size()=1 2024-09-14T12:09:53.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.483+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.RLb4PMQxNIVApALA6HWGKbS84JwoG8x_0 2024-09-14T12:09:53.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.483+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3915891548694423222', time=2024-09-14T13:50:38.331600+0000, chain.objs.size()=1 2024-09-14T12:09:53.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.483+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.303__shadow_.sikXY2LNbNOOMfXb5U7T1Za3jGbr5BK_0 2024-09-14T12:09:53.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1086508915455406753', time=2024-09-14T13:51:30.831353+0000, chain.objs.size()=1 2024-09-14T12:09:53.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MxZZRK5ONqgh19HvblysH7YvtPNGX5e_0 2024-09-14T12:09:53.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16867175771596830360', time=2024-09-14T13:51:31.084345+0000, chain.objs.size()=1 2024-09-14T12:09:53.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._osLZT8xqDhOnmRVtQ2OoEI8vBdK7WU_0 2024-09-14T12:09:53.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6468446656704178029', time=2024-09-14T13:51:31.714072+0000, chain.objs.size()=1 2024-09-14T12:09:53.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TvUoW0PEjf-YR6jWzYE_YOOpNVEWP4y_0 2024-09-14T12:09:53.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17119067638264562237', time=2024-09-14T13:51:33.249353+0000, chain.objs.size()=1 2024-09-14T12:09:53.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.484+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.w35gd_yudLhKO9es7rZzLgQ_ftGPULa_0 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9710022429602675275', time=2024-09-14T13:51:33.282088+0000, chain.objs.size()=1 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ik9Ohf04tdVQ1V7qW-guk7q00xFXIcS_0 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4421613244421304049', time=2024-09-14T13:51:33.998797+0000, chain.objs.size()=1 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-R1Bk22r4ltoMAAwykbZvmwR-1f62XV_0 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1674179859838925756', time=2024-09-14T13:51:34.496557+0000, chain.objs.size()=1 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fWHz1g8HsYEP0lMiJbSMbB2d6ggyBzu_0 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12304776855679148454', time=2024-09-14T13:51:34.533917+0000, chain.objs.size()=1 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XlM99WjsTkyyiR6Sqjyk7I89Y8zbG0i_0 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12045333866313107001', time=2024-09-14T13:51:34.900173+0000, chain.objs.size()=1 2024-09-14T12:09:53.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.486+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.d1AXsFxDn9TGdMUBhUNmWEM-uGU-uiC_0 2024-09-14T12:09:53.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.487+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11962361746010650883', time=2024-09-14T13:51:35.493837+0000, chain.objs.size()=1 2024-09-14T12:09:53.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.487+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._z9qPJF2KtNsa1b5ci4ZoRpgKCc5gKK_0 2024-09-14T12:09:53.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.487+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15686595976752073877', time=2024-09-14T13:51:35.655040+0000, chain.objs.size()=1 2024-09-14T12:09:53.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.487+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-9_COBZMt4bPwD-kHET-ecNgnRltpE7_0 2024-09-14T12:09:53.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.487+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2659239677058146045', time=2024-09-14T13:51:35.802014+0000, chain.objs.size()=1 2024-09-14T12:09:53.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.487+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rEg78Z3LD67BqnkvU2hAFIetvPqB6Js_0 2024-09-14T12:09:53.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.489+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1475481255122695840', time=2024-09-14T13:51:35.901389+0000, chain.objs.size()=1 2024-09-14T12:09:53.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.489+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3K5rvKmFsfNvphF6PDgTvKhhzD6AHrw_0 2024-09-14T12:09:53.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.489+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12213976671019947074', time=2024-09-14T13:51:36.041153+0000, chain.objs.size()=1 2024-09-14T12:09:53.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.489+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.484Vnt36Te1hGNmQjJ5XORjzPQKJneh_0 2024-09-14T12:09:53.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.489+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13634491432264472604', time=2024-09-14T13:51:36.318105+0000, chain.objs.size()=1 2024-09-14T12:09:53.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.489+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.aiu_mdef2FdMzWtILNoY-nNo7SA6eOv_0 2024-09-14T12:09:53.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9638191571716061739', time=2024-09-14T13:51:37.007796+0000, chain.objs.size()=1 2024-09-14T12:09:53.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IlCDjcmr4xTKJQ1cfGHxXvYOue_Wv2J_0 2024-09-14T12:09:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3319283658767664300', time=2024-09-14T13:51:37.312861+0000, chain.objs.size()=1 2024-09-14T12:09:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.khvKhkSpw7qV3xdt_n0TJLQtCPMAMDm_0 2024-09-14T12:09:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12668449812485665886', time=2024-09-14T13:51:38.580993+0000, chain.objs.size()=1 2024-09-14T12:09:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3WhBGkFYppud-7bIHZcQewTcso4NGu9_0 2024-09-14T12:09:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16288507507745417606', time=2024-09-14T13:51:38.701280+0000, chain.objs.size()=1 2024-09-14T12:09:53.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.G1U6eSXPJzp4Bx-W2yVz4tPrQ-6eXWi_0 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5772801197732595694', time=2024-09-14T13:51:39.699240+0000, chain.objs.size()=1 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oMQN_8WKmgHxfLCZnPyLdojo_tSovyt_0 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2604965588866084225', time=2024-09-14T13:51:39.850172+0000, chain.objs.size()=1 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Nm3rG0b-7ObCTs8vb-JdQJWv8rFnPKr_0 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12488768121004578647', time=2024-09-14T13:51:39.955446+0000, chain.objs.size()=1 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8CmL_pdgr4jDWJ5WtfcJBE6rHaiECZ8_0 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13122759157649333029', time=2024-09-14T13:51:39.962947+0000, chain.objs.size()=1 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dxUPQZUUZT0IkxJyUM-t7gFXi7hmJlG_0 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.492+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8986133837099156272', time=2024-09-14T13:51:41.808601+0000, chain.objs.size()=1 2024-09-14T12:09:53.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vFPpQnMWijA0fJv_ZmsMSxa0SZMwUHE_0 2024-09-14T12:09:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.492+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3731805387471475412', time=2024-09-14T13:52:21.075138+0000, chain.objs.size()=1 2024-09-14T12:09:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.j5MY9UPFOufqnmUNJ8sQDIVl1TGlcX7_0 2024-09-14T12:09:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.492+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17096397367193534334', time=2024-09-14T13:52:21.075883+0000, chain.objs.size()=1 2024-09-14T12:09:53.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eJLyv65bQsKaTlORJxE9KCr6zLUHCIS_0 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.494+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15661748138074085879', time=2024-09-14T13:52:21.168345+0000, chain.objs.size()=1 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.494+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YX4qKx9j_eo64N75huDScQQZEwyheWR_0 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.963484101359165080', time=2024-09-14T13:52:21.232829+0000, chain.objs.size()=1 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZUiZVCNK_Gqh83jck6hY_-5juNqTOhs_0 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1232905490235701009', time=2024-09-14T13:52:21.275303+0000, chain.objs.size()=1 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JG8ITqikoS2ViARFoKTBAyomu1K4fLN_0 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8151054418578930972', time=2024-09-14T13:52:21.406869+0000, chain.objs.size()=1 2024-09-14T12:09:53.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wOylFokXSMTTIKHQV9sBxXyQos5GaDG_0 2024-09-14T12:09:53.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5898022939152398063', time=2024-09-14T13:52:21.525632+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RribGx2UNqrNAQLyNzE_7vLsZs_SXqq_0 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5078558773822057691', time=2024-09-14T13:52:21.700073+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Y6mJCEu6wIp-5JodYL9oOhy74k1Kq3-_0 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4684058868920931775', time=2024-09-14T13:52:21.857098+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.M9cWpTbukqncVlADrdCRwXcuhcgqtms_0 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3985622799683005116', time=2024-09-14T13:52:23.011385+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MfysMlIFNBmvtiMXKGfFO-_R4zeC2qn_0 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14624846878226104364', time=2024-09-14T13:52:23.440409+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xhhGHk4UM1xwjPPEd9vSP5F6mdj0BlF_0 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4183811287141595800', time=2024-09-14T13:52:23.765845+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sUgHpQLKfGnmXb9Kexyv1VsopLOuKFf_0 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5480955147411858278', time=2024-09-14T13:52:24.423360+0000, chain.objs.size()=1 2024-09-14T12:09:53.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.uS6mTalN9hoJUYRM8EyydN_J0vdtRVK_0 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.498+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14666689730545112008', time=2024-09-14T13:52:24.498595+0000, chain.objs.size()=1 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.498+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WR42ow1krZf098nWyz92z3KSrlV7VJm_0 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.498+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13622642437451771665', time=2024-09-14T13:52:24.701506+0000, chain.objs.size()=1 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.498+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lTelctOmlmC4GatHCNYuPUUnNtIlB2w_0 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.499+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14649946635887249692', time=2024-09-14T13:52:24.898273+0000, chain.objs.size()=1 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.499+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.l32g8jDmcb7gBcdu58yFM_XalPg4xnu_0 2024-09-14T12:09:53.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.499+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2135068216523292094', time=2024-09-14T13:52:24.899100+0000, chain.objs.size()=1 2024-09-14T12:09:53.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.499+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Y5kiESUJvnnde1Np9Dgu40peamHnLMN_0 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15212131480835593696', time=2024-09-14T13:52:25.287732+0000, chain.objs.size()=1 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.choj5dGp90ZJVF1rUCYGxX1McrwGsXM_0 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2106257075564021480', time=2024-09-14T13:52:26.289993+0000, chain.objs.size()=1 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Fl0jxj93pnDEqgcMCMZ4gGEYtBn7ydS_0 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5058781619656497160', time=2024-09-14T13:52:26.473583+0000, chain.objs.size()=1 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LHycdxdfR-0G94YreDZeIPQzaTunzNc_0 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14195456589297964864', time=2024-09-14T13:52:26.793955+0000, chain.objs.size()=1 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2gSVK8G28oiu0v7xiOazjv56br8LJh4_0 2024-09-14T12:09:53.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5172078318977573760', time=2024-09-14T13:52:27.228151+0000, chain.objs.size()=1 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dNjz6qHtnRTk9gJ_QNMQYRIsw8FAL0X_0 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13037730855055505382', time=2024-09-14T13:52:27.269954+0000, chain.objs.size()=1 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pl3L6IsWJ3VUQFKuukAGnkHP1JE3mjr_0 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16717459996493672649', time=2024-09-14T13:52:28.026456+0000, chain.objs.size()=1 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.R-7Y5wYz0FYXaAOfME_yy8x8ZvTgT0b_0 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.502+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17005659986185080939', time=2024-09-14T13:52:28.152713+0000, chain.objs.size()=1 2024-09-14T12:09:53.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AQZtELkHR-cjlSDrxaNxGrGwbAO7K7Z_0 2024-09-14T12:09:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11120306365543458897', time=2024-09-14T13:52:28.153559+0000, chain.objs.size()=1 2024-09-14T12:09:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.euoZGJS-83F98U8d9u0_osjSo6fl97T_0 2024-09-14T12:09:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1072893049612412863', time=2024-09-14T13:52:28.667850+0000, chain.objs.size()=1 2024-09-14T12:09:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hRvwMnFzqL7U0M4flWI56X6LKSWH5DS_0 2024-09-14T12:09:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4699129651288430830', time=2024-09-14T13:52:28.868148+0000, chain.objs.size()=1 2024-09-14T12:09:53.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.OVNDzpi0-CjvIYK-F4AbbZ495nwlAtf_0 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13682797979624854249', time=2024-09-14T13:52:29.244544+0000, chain.objs.size()=1 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.D_AIAYye2lU9GSH-ue_r0WYppv6_cAy_0 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.504519082588130885', time=2024-09-14T13:52:29.300808+0000, chain.objs.size()=1 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UpJ-08-zU_maEIJ1bRIn_EFVuyfcX4Y_0 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8939429851214424448', time=2024-09-14T13:52:29.374003+0000, chain.objs.size()=1 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Zf_iqDUQ-gZmsR54FN-eOVfApQTilh8_0 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13014537923176692274', time=2024-09-14T13:52:29.374834+0000, chain.objs.size()=1 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ybDcnCsSEU7cS_GgjqNu5cRxxqTGXDI_0 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15163559592614223471', time=2024-09-14T13:52:29.486529+0000, chain.objs.size()=1 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.948yS91pndNttlxnomlZu5WmuLVBEtY_0 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16658677424375309203', time=2024-09-14T13:52:29.629743+0000, chain.objs.size()=1 2024-09-14T12:09:53.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LsdU9nv8EXdwjLn0qNBNxtRFAKvjxaU_0 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9609696925078570165', time=2024-09-14T13:52:29.667961+0000, chain.objs.size()=1 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8u2YyWUeXsz4pKE7g3d8Dn2RmxTAJwG_0 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2228324031443142527', time=2024-09-14T13:52:30.383314+0000, chain.objs.size()=1 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.204OgSO57sCBohoCvNDKlEwwUYA-e3H_0 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.815431646961973919', time=2024-09-14T13:52:30.775977+0000, chain.objs.size()=1 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.A7l4l7uVF1889_CeTwpOibCMQQ8C7lA_0 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6380305872181109513', time=2024-09-14T13:52:30.993742+0000, chain.objs.size()=1 2024-09-14T12:09:53.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.507+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4VkG397xFIdVng2hGzOVDLf_SpAO434_0 2024-09-14T12:09:53.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.513+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/71807 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12234191041245252040', time=2024-09-14T13:52:31.588089+0000, chain.objs.size()=1 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2K2MU93ZruvDRG3Dp_WkByaL4OuoFcl_0 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11760237442129075530', time=2024-09-14T13:52:31.883824+0000, chain.objs.size()=1 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.a9iTjNlB-yj_FhQ0ncE4Bl6aB3gdnA7_0 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4648336886818448053', time=2024-09-14T13:52:32.216230+0000, chain.objs.size()=1 2024-09-14T12:09:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pY6a5Ph7XXFZ_WIdCt1yjPAc03FXvKR_0 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3991794812622817233', time=2024-09-14T13:52:33.716663+0000, chain.objs.size()=1 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.327__shadow_.KMOONPKhflZDQq50MGmzTIpxreWT8k9_0 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6967210803152992998', time=2024-09-14T13:53:47.403122+0000, chain.objs.size()=1 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.457__shadow_.B8YM_WsaONFaXmgv6ED9VT_CzOHdNVh_0 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18360866099676710278', time=2024-09-14T13:53:52.550135+0000, chain.objs.size()=1 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.463__shadow_.7hFY18c1HkZZofE1Jij_YC0lqMSTmc7_0 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2761904322828310870', time=2024-09-14T13:53:54.329596+0000, chain.objs.size()=1 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.465__shadow_.WFwfkUDouTD6dHZOl2xvCcP-IiKVE1u_0 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11990928054738259067', time=2024-09-14T13:54:26.973096+0000, chain.objs.size()=6 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.1 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.2 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.3 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.4 2024-09-14T12:09:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.5 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.6 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14020942258504715052', time=2024-09-14T13:54:27.151840+0000, chain.objs.size()=6 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.1 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.2 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.3 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.4 2024-09-14T12:09:53.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.5 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.519+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.6 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.519+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13650083780214509028', time=2024-09-14T13:54:37.808946+0000, chain.objs.size()=1 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.519+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.517__shadow_.MZMfA-ArcM39i72Ue4H347GMkVfFL_6_0 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.519+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12905895462932680122', time=2024-09-14T13:54:37.965627+0000, chain.objs.size()=1 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.519+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.518__multipart_mymultipart.2~T6TvfTKaXNaTx6s4aFXAWbk1CP3p3HF.1 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.520+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F', time=2024-09-14T13:56:25.337436+0000, chain.objs.size()=10 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.520+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.1 2024-09-14T12:09:53.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.520+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.2 2024-09-14T12:09:53.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.523+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.3 2024-09-14T12:09:53.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.523+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.4 2024-09-14T12:09:53.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.523+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.5 2024-09-14T12:09:53.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.523+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.6 2024-09-14T12:09:53.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.523+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.7 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.8 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.9 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.526__multipart_mymultipart.2~63s9quAxyXV4oyMiFCODbdXs-7vmU0F.10 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~xf1PhEyRksK5mEVDYGygLUf8fXlt6Dc', time=2024-09-14T13:56:37.494896+0000, chain.objs.size()=2 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.531__multipart_mymultipart.2~xf1PhEyRksK5mEVDYGygLUf8fXlt6Dc.1 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.531__multipart_mymultipart.2~xf1PhEyRksK5mEVDYGygLUf8fXlt6Dc.2 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~t58XLBFBzWiutTf3C_z_eaJNmxKK9T1', time=2024-09-14T13:56:39.488258+0000, chain.objs.size()=1 2024-09-14T12:09:53.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.534__multipart_mymultipart.2~t58XLBFBzWiutTf3C_z_eaJNmxKK9T1.1 2024-09-14T12:09:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.526+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14284170475119458649', time=2024-09-14T13:57:29.913599+0000, chain.objs.size()=1 2024-09-14T12:09:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.526+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.555__shadow_.TtVbY-WUg2K8tEtw7qIGxwZ0jTqbH6t_0 2024-09-14T12:09:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11730047870021450605', time=2024-09-14T13:57:33.265786+0000, chain.objs.size()=1 2024-09-14T12:09:53.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.557__shadow_.UWodKWH-dnt5FkkYQ9ZY1F9PHmBFKBp_0 2024-09-14T12:09:53.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13801046643190815117', time=2024-09-14T13:58:03.574369+0000, chain.objs.size()=1 2024-09-14T12:09:53.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:dVoqQEfDihrCuFzyM2JLPk1OkYqSV9P_.c7j-OlrQvzGKukJJgiqHnCPXpEwtZSf_0 2024-09-14T12:09:53.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13945953874866858972', time=2024-09-14T13:58:12.147815+0000, chain.objs.size()=1 2024-09-14T12:09:53.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:BPxUHEyZBZX34AqKtcoTUbp-Cpzt33R_.55a6mID0yFIygQbRstgu0TCvqFzG9NV_0 2024-09-14T12:09:53.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13908047964261056563', time=2024-09-14T13:58:13.245264+0000, chain.objs.size()=1 2024-09-14T12:09:53.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.527+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.575__shadow:FEl2pm-x6bE-kE62PSynwN8wcAZfGB5_.j-hBpGhSGoyjZXJRLrEjflZH0_VnF68_0 2024-09-14T12:09:53.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.528+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15097787312398493686', time=2024-09-14T13:58:19.006990+0000, chain.objs.size()=1 2024-09-14T12:09:53.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.528+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:ZrWOW5Hz-qAPCYLoMcm7FnudqRC-FwT_.JCCXTkWaXugAcq9BCtJ6SvEY5CEWSCX_0 2024-09-14T12:09:53.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.528+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11352987908642732752', time=2024-09-14T13:59:02.230385+0000, chain.objs.size()=1 2024-09-14T12:09:53.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.528+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.586__shadow:5KcrEvxSmw8iHZDgSK9GDQFz1Dh0A9U_.HUS_wGW-8GyuZNN5h4bruA5W5KIHPQp_0 2024-09-14T12:09:53.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.528+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7019012811230935785', time=2024-09-14T14:02:26.585807+0000, chain.objs.size()=1 2024-09-14T12:09:53.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.528+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.620__shadow_.X_mEWBfmOyMbFJpfX6JQ9G0F7nlhP4U_0 2024-09-14T12:09:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.530+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9498416805993011321', time=2024-09-14T14:04:06.009625+0000, chain.objs.size()=1 2024-09-14T12:09:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.530+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.691__shadow_.LvlpTOTJEEd-swJeLYOSG3sRAnodIt2_0 2024-09-14T12:09:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.530+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1858597350316781930', time=2024-09-14T14:06:51.563358+0000, chain.objs.size()=1 2024-09-14T12:09:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.530+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.770__shadow_.N83nMyYfRzdn9gBdAr7H5G0Iu4oDj6y_0 2024-09-14T12:09:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.530+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7050670661610867635', time=2024-09-14T14:07:01.032177+0000, chain.objs.size()=1 2024-09-14T12:09:53.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.530+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.773__shadow_.uiOcVqYFVjIXyQXwzE_jWe1ue1TREPb_0 2024-09-14T12:09:53.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.534+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.536+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T12:09:53.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.537+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.538+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47234' 2024-09-14T12:09:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2780715144739980043', time=2024-09-14T13:46:56.496693+0000, chain.objs.size()=3 2024-09-14T12:09:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-FROZEN.2~zaKTBhIQvxUbOn9pW1Q8tx01NAxgTw6.1 2024-09-14T12:09:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-FROZEN.2~zaKTBhIQvxUbOn9pW1Q8tx01NAxgTw6.2 2024-09-14T12:09:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__multipart_foo-FROZEN.2~zaKTBhIQvxUbOn9pW1Q8tx01NAxgTw6.3 2024-09-14T12:09:53.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9145969585680155678', time=2024-09-14T13:47:14.294383+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.178__shadow_.X4tSlpSfrQBAXI_BiTdJb07Gh3-Zklz_0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4855462444375304930', time=2024-09-14T13:49:06.129376+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.238__shadow_.4tTlP465VdlbZKE9WNvtYKnmHljqCj-_0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12115772061565864195', time=2024-09-14T13:49:10.184925+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.244__shadow_.7ziQYZZrdz7tPynubQvxP1GOjTkRa2__0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17000189514398287568', time=2024-09-14T13:49:11.435582+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.246__shadow_.1FendZX2H77mzzA5nZVcgFCewGA4dQr_0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7144930430845079145', time=2024-09-14T13:49:16.555252+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.254__shadow_.-Th6L0x3ai3E3HDRZjmLEPnbvs7O_ov_0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10477243747962064214', time=2024-09-14T13:49:59.907109+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qXdQmljr3BqWC8n7SywrfH9nAPcFIJ3_0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10334881214127974394', time=2024-09-14T13:49:59.925045+0000, chain.objs.size()=1 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qxFyWPaZmnBib_M7rFNig4EYVKqUqYr_0 2024-09-14T12:09:53.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11165073497147007396', time=2024-09-14T13:50:00.929578+0000, chain.objs.size()=1 2024-09-14T12:09:53.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dF2qtwhwasbOTz_FfAQ9WAne9fXD9jd_0 2024-09-14T12:09:53.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15754995259912119374', time=2024-09-14T13:50:01.232049+0000, chain.objs.size()=1 2024-09-14T12:09:53.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.539+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9VYiIJ8BYHTpJuB7fkpylK-L-9pdOPm_0 2024-09-14T12:09:53.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.543+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17117642653601387792', time=2024-09-14T13:50:01.498845+0000, chain.objs.size()=1 2024-09-14T12:09:53.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.543+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rIgnQ4Qk7h2Bqde6Q9o0rBCabqC-UqF_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6972358265101632927', time=2024-09-14T13:50:02.129492+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.haxYkFtqYe8qSZvPh3FJlCidtCgN4Lr_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12205540896247459189', time=2024-09-14T13:50:02.354419+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eF3FAg2gt2jO0-LXc03NAGG97xYH0VP_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16736685655362865544', time=2024-09-14T13:50:02.418252+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BId2xObc7mTx-z3yUt1fQebxA47iG-D_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12580338040693717400', time=2024-09-14T13:50:02.456383+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.h9-doMHJp0XrYUX4MxWt1TU1PsCJDhT_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7575708140358469214', time=2024-09-14T13:50:03.584100+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hUrfnqx3Di0KydShNgjSOuXYTPNSJYz_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15358763075917980625', time=2024-09-14T13:50:03.712049+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fm7U4Ajyc4gUruZn5tTAWmlHWJj5ZrH_0 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1258320621223388911', time=2024-09-14T13:50:04.445029+0000, chain.objs.size()=1 2024-09-14T12:09:53.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EW_5suYZnV6vb4vb2kwJDBcVqDSSuGa_0 2024-09-14T12:09:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4458603252526352899', time=2024-09-14T13:50:04.872627+0000, chain.objs.size()=1 2024-09-14T12:09:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EJo1R5X92O6N7M0UXmwdRpADHMvjNiw_0 2024-09-14T12:09:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17736145921273149138', time=2024-09-14T13:50:05.468348+0000, chain.objs.size()=1 2024-09-14T12:09:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PWD5F8j7K0TI57Bt7_cZIs1AYt41uRm_0 2024-09-14T12:09:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13201248705765953419', time=2024-09-14T13:50:05.653293+0000, chain.objs.size()=1 2024-09-14T12:09:53.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.24OuCkwJeoh4_SnMgO0fZvMOsfafE4Z_0 2024-09-14T12:09:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.547+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17588188921123610180', time=2024-09-14T13:50:05.764636+0000, chain.objs.size()=1 2024-09-14T12:09:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.547+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kkiDRxspFlrfCPCOKrfbsqluFTpuQPz_0 2024-09-14T12:09:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.547+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16772175537763889479', time=2024-09-14T13:50:05.842418+0000, chain.objs.size()=1 2024-09-14T12:09:53.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.547+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4AVWDlP1QgUETp5QIz3b4okJzDSZccs_0 2024-09-14T12:09:53.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6539528238797686729', time=2024-09-14T13:50:05.850812+0000, chain.objs.size()=1 2024-09-14T12:09:53.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zpM6wIRSPwhUfrYBatauhyEupnNm1GP_0 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4200095611277650114', time=2024-09-14T13:50:06.251201+0000, chain.objs.size()=1 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qnzFy501EPGYFIJazBN0T-1wE2lr574_0 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12380858667090239403', time=2024-09-14T13:50:06.663555+0000, chain.objs.size()=1 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.N_rKueV79BqbDkG0PGtRhfk35b35rPF_0 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2163352944991486112', time=2024-09-14T13:50:06.820612+0000, chain.objs.size()=1 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ito_5Kzk-_s9aX6-2b2lL1nnt4I5qze_0 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13503780009666307973', time=2024-09-14T13:50:07.821783+0000, chain.objs.size()=1 2024-09-14T12:09:53.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZdaueXJ58PcfMiHIBPA-sE_bo_dLqdE_0 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5408322984091181428', time=2024-09-14T13:50:07.849999+0000, chain.objs.size()=1 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.njPXLjkhIBiTVxiZoAFX53fZHSAp0XT_0 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6876758363242145908', time=2024-09-14T13:50:07.916875+0000, chain.objs.size()=1 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fuDFX_Vi_nGcO7l56Q1tHeIj9CCzGWY_0 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4120452913400213731', time=2024-09-14T13:50:08.010125+0000, chain.objs.size()=1 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AqGcv_c1wwkFFi1UN2irp8FlqgxXNYB_0 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14412462274597069678', time=2024-09-14T13:50:08.415010+0000, chain.objs.size()=1 2024-09-14T12:09:53.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.548+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.99uF4uil3gTwul2sYBsyHdJJmoKvfcg_0 2024-09-14T12:09:53.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.551+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4663414882639968735', time=2024-09-14T13:50:09.354695+0000, chain.objs.size()=1 2024-09-14T12:09:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.551+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IoQorvaEK1-y2Llrzl6Eko5chEEnlFk_0 2024-09-14T12:09:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.551+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4430325986622233056', time=2024-09-14T13:50:09.423610+0000, chain.objs.size()=1 2024-09-14T12:09:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.551+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wIfWN20d-9XsGnjiw53axsH4dO14tj5_0 2024-09-14T12:09:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15910154628686383902', time=2024-09-14T13:50:09.609696+0000, chain.objs.size()=1 2024-09-14T12:09:53.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ioTiVhiEJOLE3CZEJt4lKnXJez7khaf_0 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17359833723847200403', time=2024-09-14T13:50:16.366378+0000, chain.objs.size()=1 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.273__shadow_.x6b8HNhPZ9KkimTURThTjpL3-NrkzBd_0 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3449567522615604831', time=2024-09-14T13:50:19.522666+0000, chain.objs.size()=1 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.278__shadow_.9yetJAkrIoBdsOxTYtnNHHEynq9rwT2_0 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2057611820137158157', time=2024-09-14T13:50:23.998678+0000, chain.objs.size()=1 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.285__shadow_.JpT_X2vmI5CAs0yUBc7t4-SxK9Uf4i-_0 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.329081942932670666', time=2024-09-14T13:50:25.309151+0000, chain.objs.size()=1 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.287__shadow_.p-uJaG40veG83pEb0NAr-ZzcZ8l0kcT_0 2024-09-14T12:09:53.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16151979453467422822', time=2024-09-14T13:50:29.785207+0000, chain.objs.size()=1 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.jLk1-LTtisl9AdlKx8R-KPaNHLeSZD__0 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.755628453778250469', time=2024-09-14T13:50:31.678749+0000, chain.objs.size()=1 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.7mGlfRkxfCybHdSes98sZo6OgTYyhCp_0 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9633655546096450388', time=2024-09-14T13:50:33.055687+0000, chain.objs.size()=1 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.295__shadow_.SGwPRO-DbTmZqmNSzv7rIMQ-nhzZo7v_0 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15359326833441934891', time=2024-09-14T13:50:37.704365+0000, chain.objs.size()=1 2024-09-14T12:09:53.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.552+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.302__shadow_.n4HjN39QzgcwF44nsDtsH33yXQeKHD5_0 2024-09-14T12:09:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.555+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7370660691072592190', time=2024-09-14T13:50:51.361324+0000, chain.objs.size()=1 2024-09-14T12:09:53.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.555+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.322__shadow_.IIj_AZ_HQZ9OaCIjbjJ5ym1eTT4Jtem_0 2024-09-14T12:09:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.921806945880110010', time=2024-09-14T13:51:31.652547+0000, chain.objs.size()=1 2024-09-14T12:09:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lm5KjzgkNYE4lWIYZHonpFTAt2Jn567_0 2024-09-14T12:09:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2662682079481998110', time=2024-09-14T13:51:32.505650+0000, chain.objs.size()=1 2024-09-14T12:09:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WKUuMpguDqgmWqeESht6MLQ-KLCpY6k_0 2024-09-14T12:09:53.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3588164511042644252', time=2024-09-14T13:51:33.121727+0000, chain.objs.size()=1 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nsa8Pfg1Tqp9vgwWhrMprQytb0cnT9Z_0 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2510707144639669022', time=2024-09-14T13:51:33.317025+0000, chain.objs.size()=1 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.HUeiD2Aa6f2ZmWUZi8JHe9m2ty5MC5o_0 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7908545247680983671', time=2024-09-14T13:51:33.317731+0000, chain.objs.size()=1 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.557+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.AHoIfcHEp7yIOhhz1TaO5o8-4mXQJdw_0 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2639524684440698052', time=2024-09-14T13:51:33.964197+0000, chain.objs.size()=1 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.b6Ck2sluzv28zdM3VGipIDTvwU5Ncf4_0 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18299891015495700698', time=2024-09-14T13:51:34.251185+0000, chain.objs.size()=1 2024-09-14T12:09:53.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.w4hAGISaebTvk4NHxMe7xd4Jk4OjnqD_0 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.619283748793948725', time=2024-09-14T13:51:34.406085+0000, chain.objs.size()=1 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vuu09fM-r3bMBVcYjOJI9YVnh_HoGm2_0 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4569950384363547608', time=2024-09-14T13:51:34.875953+0000, chain.objs.size()=1 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.as1-F7tAClHKZa4LNM_E-YRCwnw9CGu_0 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8757083006443473952', time=2024-09-14T13:51:34.876609+0000, chain.objs.size()=1 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.U5bhEpAT7qDLp7TkNWIVG8fJ4wqa2Ho_0 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.559+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4742851955201529915', time=2024-09-14T13:51:36.094554+0000, chain.objs.size()=1 2024-09-14T12:09:53.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.559+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.E5hiwa1tJiYAgzesaeqjx4Mm__DchSM_0 2024-09-14T12:09:53.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.560+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1332760816715591781', time=2024-09-14T13:51:36.095944+0000, chain.objs.size()=1 2024-09-14T12:09:53.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.560+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.g2RaZ0lfyTgJi6XMkOMRmVDI0zO2Ey9_0 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7159146370592204790', time=2024-09-14T13:51:36.255343+0000, chain.objs.size()=1 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-lg4p2jEAjnkL9MAfEXnxWrtzJtKQ6f_0 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9828461250038765193', time=2024-09-14T13:51:36.386227+0000, chain.objs.size()=1 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kaw0_HlP8fH9eCApD1tdohzQWqDmq_z_0 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14148692361730525484', time=2024-09-14T13:51:37.461421+0000, chain.objs.size()=1 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7flbv3djtDY9NDERT3grlpZYO5vW4M9_0 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4154503637635056615', time=2024-09-14T13:51:38.730532+0000, chain.objs.size()=1 2024-09-14T12:09:53.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4_TS9TeQ5lgxcji3k2PhCbsYYpGzMQL_0 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6216495083081351393', time=2024-09-14T13:51:38.731255+0000, chain.objs.size()=1 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ik6k9RJH76mGSu8SUw3S16EhORj7XJu_0 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2821722110425112908', time=2024-09-14T13:51:38.970596+0000, chain.objs.size()=1 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nT2deDlsrbeb59lIjfwPnmB_-sXsTDv_0 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7647499772001791446', time=2024-09-14T13:51:39.797546+0000, chain.objs.size()=1 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.aRu3ry90DADRgUMPTJDF_W95OHQKrtS_0 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14969217110962155737', time=2024-09-14T13:51:39.915560+0000, chain.objs.size()=1 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S06PPrSlUEZ2QRCVk4FJWa1QKEP3ldN_0 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13282041622066087450', time=2024-09-14T13:51:40.759210+0000, chain.objs.size()=1 2024-09-14T12:09:53.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2luT_FElLKArld9rKXI-Qj_vpq7_pAl_0 2024-09-14T12:09:53.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1291378270381199228', time=2024-09-14T13:51:41.046846+0000, chain.objs.size()=1 2024-09-14T12:09:53.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LpnHiZJCggMFBSV2xKIz5Irq1DFtguc_0 2024-09-14T12:09:53.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11022087387163844995', time=2024-09-14T13:51:41.275511+0000, chain.objs.size()=1 2024-09-14T12:09:53.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4RHAQ21WLzXDzmPu5t5ZnSKh7MASC9X_0 2024-09-14T12:09:53.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13596506107091901449', time=2024-09-14T13:51:41.381259+0000, chain.objs.size()=1 2024-09-14T12:09:53.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3VjV2ljpTGCj3NanAo_xg_PwcCLZzdr_0 2024-09-14T12:09:53.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3127157663873283186', time=2024-09-14T13:51:41.381988+0000, chain.objs.size()=1 2024-09-14T12:09:53.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hhkrsvA-sGZtQ7AjTDHT5KfFyWRhMqx_0 2024-09-14T12:09:53.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18300520523041041271', time=2024-09-14T13:51:41.506827+0000, chain.objs.size()=1 2024-09-14T12:09:53.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2eeCr0mDsznkFbBDLizeAF111F2HG7e_0 2024-09-14T12:09:53.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2841055833664618022', time=2024-09-14T13:51:41.661939+0000, chain.objs.size()=1 2024-09-14T12:09:53.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.brGaz0yo8BeOpFkSBrmetiDnUwZ-1WE_0 2024-09-14T12:09:53.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5099665357470635979', time=2024-09-14T13:52:21.069651+0000, chain.objs.size()=1 2024-09-14T12:09:53.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6hifZml6o4Mj_ThWr3j9ExrPmZ2dJSy_0 2024-09-14T12:09:53.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13181734455048367313', time=2024-09-14T13:52:21.239615+0000, chain.objs.size()=1 2024-09-14T12:09:53.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TvwP91L49jM7vSsWbFCcx0-ZeVGoHXo_0 2024-09-14T12:09:53.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13120131742384930341', time=2024-09-14T13:52:21.994711+0000, chain.objs.size()=1 2024-09-14T12:09:53.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.c-csw-do2_V7SP4rw_ngwptg3T1zbWk_0 2024-09-14T12:09:53.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8811100051716297584', time=2024-09-14T13:52:22.162914+0000, chain.objs.size()=1 2024-09-14T12:09:53.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.J6VwFw_P-tGm28oz2kdEr3i005uhGyH_0 2024-09-14T12:09:53.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13175663119077275483', time=2024-09-14T13:52:22.682952+0000, chain.objs.size()=1 2024-09-14T12:09:53.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wK198elFWenMnXIBhuNrbLTWTjUsZN6_0 2024-09-14T12:09:53.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16863313678864413987', time=2024-09-14T13:52:23.408293+0000, chain.objs.size()=1 2024-09-14T12:09:53.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dlHSQ5P7edfSftuLvckuwyeX4OhSeYF_0 2024-09-14T12:09:53.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13783514720076504611', time=2024-09-14T13:52:24.387448+0000, chain.objs.size()=1 2024-09-14T12:09:53.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PmKYJwcTy2A9-MCZRVqEYzEzBHNScAL_0 2024-09-14T12:09:53.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.571+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2327077642945567109', time=2024-09-14T13:52:24.680295+0000, chain.objs.size()=1 2024-09-14T12:09:53.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.571+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0TxyMnSh2yG5kIkNux7Ua1CEb4YfMQV_0 2024-09-14T12:09:53.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.571+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7069483253062910080', time=2024-09-14T13:52:25.120021+0000, chain.objs.size()=1 2024-09-14T12:09:53.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.571+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DHcSZz8Q8hg2i8JejhBhFO2yR3M2zFe_0 2024-09-14T12:09:53.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1668419748223518110', time=2024-09-14T13:52:26.240612+0000, chain.objs.size()=1 2024-09-14T12:09:53.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wGMLrFuwbwaa6ysiq_0l8ALCSmfmHsg_0 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7291388065505753550', time=2024-09-14T13:52:26.558888+0000, chain.objs.size()=1 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.W4XO8OamS1uNqMpGRRKWeeeWezyi4FO_0 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4407338029366674698', time=2024-09-14T13:52:26.752776+0000, chain.objs.size()=1 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6EfGOxy-ra4tQm6xx8nyO53wTnj8odP_0 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11480392395293104205', time=2024-09-14T13:52:27.265742+0000, chain.objs.size()=1 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iWB0givnwIXIxuFMnRbtHF0tkPQF1G8_0 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17930682399526155886', time=2024-09-14T13:52:27.282698+0000, chain.objs.size()=1 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.574+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ylNGZ3QLlfMAb3VfpqXxyYhdvY9Tw0s_0 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18330027638832156455', time=2024-09-14T13:52:27.493514+0000, chain.objs.size()=1 2024-09-14T12:09:53.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4PqYlCYSHKdDMYlHROA0dwM4hIwjUsu_0 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9861475414459885907', time=2024-09-14T13:52:27.553065+0000, chain.objs.size()=1 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.NNmlhLERUvszRSTYn8IYG9EjZb38spy_0 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1116897870095106816', time=2024-09-14T13:52:27.957403+0000, chain.objs.size()=1 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0fQY2giIDd3eLl3YBL-1Grj0Otlf7tS_0 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15928127500216242963', time=2024-09-14T13:52:27.958321+0000, chain.objs.size()=1 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jMPSOcxjy1UTIrtbVE7j9sg3R5Ffw-J_0 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2698400967036345865', time=2024-09-14T13:52:28.025696+0000, chain.objs.size()=1 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VraeFCv4vSTFYWqZhPDWZBBz56U1MX5_0 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10323132408801441329', time=2024-09-14T13:52:28.634532+0000, chain.objs.size()=1 2024-09-14T12:09:53.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QW20O053D_RRuDun4tNBe0y9nEhAv8W_0 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16381076536987861856', time=2024-09-14T13:52:28.635397+0000, chain.objs.size()=1 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Jze6UhKB3Agbfcma_Mm37o8Wg-vhLj3_0 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11355815973464461042', time=2024-09-14T13:52:29.057324+0000, chain.objs.size()=1 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.T69-cVrUZ6-rLihXO9lQLtEgEuCH3e__0 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10463597213665084225', time=2024-09-14T13:52:29.554371+0000, chain.objs.size()=1 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gcjlXA9lMlFGxlQxM5toQlbUon5NCIb_0 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4491301633448344516', time=2024-09-14T13:52:29.683743+0000, chain.objs.size()=1 2024-09-14T12:09:53.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9ojKaQGqwnUH3gDdKFV834v74z9LgJ9_0 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12282304618509928011', time=2024-09-14T13:52:30.543413+0000, chain.objs.size()=1 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0DVBoHlN5vSDFwly5kYQrrOcb7J6a-8_0 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9808595292434455400', time=2024-09-14T13:52:31.065175+0000, chain.objs.size()=1 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Vvxgi2-KMMjCUXETUvVsAabQyrxncrG_0 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17918214310397827777', time=2024-09-14T13:52:31.386916+0000, chain.objs.size()=1 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.reTjZOUTGEQzDKSXvCjBgG9owP6eCPW_0 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14972853497101944098', time=2024-09-14T13:52:31.729560+0000, chain.objs.size()=1 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Mr3EEKZXFXDLi2DfJ5VuTLIVU1wuNpI_0 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1117691118107487280', time=2024-09-14T13:52:32.079276+0000, chain.objs.size()=1 2024-09-14T12:09:53.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kNa1iizDXRoC5MCkv9W2t0Px04qGZd__0 2024-09-14T12:09:53.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.585+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47234 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1263913938626112500', time=2024-09-14T13:52:32.179456+0000, chain.objs.size()=1 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aoZCIGhZeuYjh0PeKWNOQ0t1zLln3fZ_0 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12661252492634505319', time=2024-09-14T13:53:18.289912+0000, chain.objs.size()=1 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.407__shadow_.3BfNSdYT9KoIosd1CFC4CgIMVUirAGU_0 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14831892727008630434', time=2024-09-14T13:53:32.534421+0000, chain.objs.size()=1 2024-09-14T12:09:53.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.434__shadow_.4BhCYgMXeekXuWZ_KNM-2uZ4jsVw25f_0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12272964273596577048', time=2024-09-14T13:53:45.666842+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.455__shadow_.WRbyTecQJzhYVD0Vgi5CfXUBpY1H0pc_0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1219838841191077316', time=2024-09-14T13:54:02.579421+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.6ADbiJORSk1qvr8Az3myfJQQe9j62Bw_0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13088100804603764736', time=2024-09-14T13:54:15.066839+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.499__shadow_.tWAY1FOJ-VYfFTsfIWQ5WvZxkZcqKz__0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4537483695117946514', time=2024-09-14T13:56:24.130794+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.524__shadow_.T4NRCjcVWqE2IlqyVcTa9TzE_Wa_NBI_0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1446924073272012906', time=2024-09-14T13:57:55.607286+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:t-VAmK4DYP3d6j60N7fvFl6Y8wTwC9E_.Azrt_rUQj4w8-tFPKxoG2do-5IAxdGi_0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12767775747891351751', time=2024-09-14T13:58:17.614843+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:PD1bXA8Eh9DRPr5ZMZNDSx1JmTWYkaf_.4MoPaEbl-SggYNToWsv4YxQ1EZPZu0c_0 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6139420819368359247', time=2024-09-14T13:59:02.207687+0000, chain.objs.size()=1 2024-09-14T12:09:53.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.586__shadow:H0KzW6S0QAmiFs8Zy6D2Wfma-q7ab0E_.MTyNkVdCAHFy20tr3Y7X1MxnjgPQq0B_0 2024-09-14T12:09:53.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17835240993937619338', time=2024-09-14T14:03:16.446538+0000, chain.objs.size()=1 2024-09-14T12:09:53.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.645__shadow_.jLDAfo2JAfnegIEKtWfjeR_PC77vaCi_0 2024-09-14T12:09:53.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13069067110800082317', time=2024-09-14T14:03:53.797796+0000, chain.objs.size()=1 2024-09-14T12:09:53.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.588+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.666__shadow_.klhT636ODfO0CcAvxoqz2fK3BTHh8oA_0 2024-09-14T12:09:53.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6676263342184373861', time=2024-09-14T14:04:14.282746+0000, chain.objs.size()=1 2024-09-14T12:09:53.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.704__shadow:GaGivg8fbLivn.0Eo4deF7aesChQFiN_.ecZao9sYg-Hs-RSEaTrgAjsw1zGdryy_0 2024-09-14T12:09:53.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16365808912581340368', time=2024-09-14T14:07:10.710133+0000, chain.objs.size()=1 2024-09-14T12:09:53.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.775__shadow_.__fBvnlPEUjFdN_gccM9fpF9WiGWNBR_0 2024-09-14T12:09:53.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.594+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.597+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T12:09:53.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.598+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.599+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48837' 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5300971459384567008', time=2024-09-14T13:46:40.307884+0000, chain.objs.size()=1 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.158__shadow_.GA1GGgz4K5YQ0p2uKi50bkx3_QCQXcz_0 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13845859314688986741', time=2024-09-14T13:46:45.674488+0000, chain.objs.size()=2 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.43djquz4I_YL4JNrzs5gxIg0sXUmgzW_0 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.43djquz4I_YL4JNrzs5gxIg0sXUmgzW_1 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14379944807703240593', time=2024-09-14T13:47:15.771660+0000, chain.objs.size()=1 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.181__shadow_.7OjB89jbgqglFGYD5zejCQCl-EN13A9_0 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8171074841595807343', time=2024-09-14T13:49:00.484801+0000, chain.objs.size()=1 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.230__shadow_.HsQaC7LaGpbsOtYO3RmYuVM-L9XIWQX_0 2024-09-14T12:09:53.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14440962612110761702', time=2024-09-14T13:49:01.129137+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.231__shadow_.k7NLx1UWu4zq9HwfwQkuXwi695uKzv9_0 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4301347017064617951', time=2024-09-14T13:49:13.985725+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.250__shadow_.Q8XYtJQx-OoGalPy87T2IVOeO0Gj86r_0 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7751453583768980731', time=2024-09-14T13:49:14.617292+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.251__shadow_.mROj5xkzDJoVoOy1P1o5g99z0Kh0Y33_0 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9936226726932716699', time=2024-09-14T13:49:17.172682+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.255__shadow_.dduIqwKVGo3cM_2aaXwo0b-3IvgndXM_0 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6346766860796742440', time=2024-09-14T13:49:58.957947+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.quyDNVqC7g8m_Wu7ZjYssJRxrt1PmUL_0 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1138748281328140679', time=2024-09-14T13:49:59.510223+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wTbByzBVAj59Zgzq7v7IeLDQOXlErnI_0 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3295001553314047328', time=2024-09-14T13:49:59.522488+0000, chain.objs.size()=1 2024-09-14T12:09:53.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.600+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.inn6yaSvmybmSaap92vrxUuPPBwaWPg_0 2024-09-14T12:09:53.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8228312469675691764', time=2024-09-14T13:49:59.554893+0000, chain.objs.size()=1 2024-09-14T12:09:53.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qiQEaI54OBwxOQmkJtbKDETLaU-MK5c_0 2024-09-14T12:09:53.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15679304546988561491', time=2024-09-14T13:49:59.917861+0000, chain.objs.size()=1 2024-09-14T12:09:53.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qJGU9ZDXzOMEAJ78swk5kE0piYkI1oO_0 2024-09-14T12:09:53.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5653539506662876630', time=2024-09-14T13:50:01.046500+0000, chain.objs.size()=1 2024-09-14T12:09:53.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NwDNOUxmwb5H5DWhfAIa1V_VP2oWh6v_0 2024-09-14T12:09:53.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5391411570495296619', time=2024-09-14T13:50:01.047213+0000, chain.objs.size()=1 2024-09-14T12:09:53.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.b7pm_iqkt7LkHPbNjSH2QVAy0MD_Rwi_0 2024-09-14T12:09:53.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4331108716886969444', time=2024-09-14T13:50:01.067968+0000, chain.objs.size()=1 2024-09-14T12:09:53.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.603+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2tUhNRZg4mN2gvzD-X3-lrvOLS35uQX_0 2024-09-14T12:09:53.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17592359549541126775', time=2024-09-14T13:50:01.297968+0000, chain.objs.size()=1 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.haY_RdoCym_fShMjJXHZT_rrdiwba9K_0 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13119914108246505156', time=2024-09-14T13:50:01.985406+0000, chain.objs.size()=1 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GpszyxW950mRVIEAapytqBvRWtdhu5P_0 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15525283280439421979', time=2024-09-14T13:50:02.461101+0000, chain.objs.size()=1 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RWuJx9eJOQPLbb44hbBH0_3cgHkMkKx_0 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11312557364291708688', time=2024-09-14T13:50:02.599392+0000, chain.objs.size()=1 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pvh_yh4KzNlUBdJ2RFkjfuGNMwrtowz_0 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12601461660463389337', time=2024-09-14T13:50:03.842541+0000, chain.objs.size()=1 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.x6h8q0fFUXF3tnxSCdWMVLa42kOY0-J_0 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4156087429956747216', time=2024-09-14T13:50:03.929514+0000, chain.objs.size()=1 2024-09-14T12:09:53.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.604+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.uyH27x9LiA2ltcIATX9EdHJymMKlueM_0 2024-09-14T12:09:53.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9202304943592162184', time=2024-09-14T13:50:04.865720+0000, chain.objs.size()=1 2024-09-14T12:09:53.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.A40DTvy_kOK9aYrOB6tqj0YlsyGLIS6_0 2024-09-14T12:09:53.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.825872727592584504', time=2024-09-14T13:50:04.952386+0000, chain.objs.size()=1 2024-09-14T12:09:53.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.erlHtPuu4KTANliT_5ou1X7IIghuLk9_0 2024-09-14T12:09:53.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13655164068348979117', time=2024-09-14T13:50:05.304539+0000, chain.objs.size()=1 2024-09-14T12:09:53.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.idm7gETQOXIAjpoIXL6xRQywJSFJ39d_0 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8154571880438616293', time=2024-09-14T13:50:05.305122+0000, chain.objs.size()=1 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pRa9szIbm0aQK9Gv42VotMW1Yt8ZL4f_0 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16574583342461116011', time=2024-09-14T13:50:06.386640+0000, chain.objs.size()=1 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Gwuexi3a5-CvfuB7OoT2IGjMWleW_NP_0 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5219394074053887571', time=2024-09-14T13:50:06.666247+0000, chain.objs.size()=1 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9lzJCf94GIJUMVOsI87Hg98KLVY1NiS_0 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2112817635760828499', time=2024-09-14T13:50:06.828256+0000, chain.objs.size()=1 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.du2dQOE0RfHLaQZ7GcgG-oWYIooFCbM_0 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11205859527985535621', time=2024-09-14T13:50:07.124542+0000, chain.objs.size()=1 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.arK0DkM9z2wDhXM1fzKpl02KkcJErL2_0 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8936153819945667199', time=2024-09-14T13:50:07.142395+0000, chain.objs.size()=1 2024-09-14T12:09:53.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XKY9SupHyByEZ89IL4VPx9SEWbDEnFs_0 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13542408298622041393', time=2024-09-14T13:50:08.017802+0000, chain.objs.size()=1 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NMRBdZ3yVUDMu-IA31oajybUzrc46G-_0 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13718303678366697723', time=2024-09-14T13:50:08.094668+0000, chain.objs.size()=1 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.608+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.F2K1aA2_oQdg6CHyHnD7yxvdopIR9pR_0 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.609+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.103423540217798648', time=2024-09-14T13:50:08.260591+0000, chain.objs.size()=1 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.609+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l2IapbilJMX8kWH8Z4WCxWM9vklcQ6Z_0 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.609+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7652950321426882336', time=2024-09-14T13:50:08.443461+0000, chain.objs.size()=1 2024-09-14T12:09:53.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.609+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CwvfQdDKq-d3uRpK320Awhmxpsb0ftl_0 2024-09-14T12:09:53.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14616224200046673724', time=2024-09-14T13:50:08.631543+0000, chain.objs.size()=1 2024-09-14T12:09:53.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AiKzZxYwms_m56kJZbs8jI7DeYsouQP_0 2024-09-14T12:09:53.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.612+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2904235769445843062', time=2024-09-14T13:50:08.919501+0000, chain.objs.size()=1 2024-09-14T12:09:53.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.612+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jr8b80Eg7kSnFBxXA5XN0Djg9WnfSM1_0 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7710394648572885266', time=2024-09-14T13:50:09.041251+0000, chain.objs.size()=1 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Atfl_h50dE5tZ3y6YOxy3v19HdcEeL-_0 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1848186242349993866', time=2024-09-14T13:50:09.060994+0000, chain.objs.size()=1 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zR5K7iy6GgE58kL-e0ihWrhmAWcNA-w_0 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15992868419716847291', time=2024-09-14T13:50:09.200784+0000, chain.objs.size()=1 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.QL7FzDUBjK9RDfnOsWYX5ELdxNEm9Q2_0 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4450840643983398271', time=2024-09-14T13:50:09.497655+0000, chain.objs.size()=1 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sqrKt_5KUFQsn76fwzfkEB9qfbIQyFX_0 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9638603277617941793', time=2024-09-14T13:50:23.296831+0000, chain.objs.size()=1 2024-09-14T12:09:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.284__shadow_.30KdwwxUS4t3lJJe7B1otNNztHH2T1S_0 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11024812221638797575', time=2024-09-14T13:50:46.921842+0000, chain.objs.size()=1 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.315__shadow_.HJYFK9gUDM5E3t4w2rH_3HgvxaWuakc_0 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10428303301417932417', time=2024-09-14T13:50:49.375989+0000, chain.objs.size()=1 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.319__shadow:9Y7mfEH82vQBez53bp00egmPPm7QyWM_.JV_xmLx5FtVQpOwAIDPuR5P1xdcZGRn_0 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15061561934714788622', time=2024-09-14T13:51:30.661258+0000, chain.objs.size()=1 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.613+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dPn3wXR2MXC53LjiBF9ikqGL53Au2Uh_0 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13917854748420316385', time=2024-09-14T13:51:30.995009+0000, chain.objs.size()=1 2024-09-14T12:09:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.G901UxPDJuYxRoubXXwrH8-nZruaQTR_0 2024-09-14T12:09:53.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.615+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3509211296103199826', time=2024-09-14T13:51:31.069889+0000, chain.objs.size()=1 2024-09-14T12:09:53.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.615+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4YSfhXQdSk5Bin0m94CmY3TLiUWYjXk_0 2024-09-14T12:09:53.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.616+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.942523642231410724', time=2024-09-14T13:51:31.183569+0000, chain.objs.size()=1 2024-09-14T12:09:53.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.616+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ywn6fSw9d0nNGp3SojgcT3M7EURrIij_0 2024-09-14T12:09:53.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.616+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1685868264567734549', time=2024-09-14T13:51:31.227179+0000, chain.objs.size()=1 2024-09-14T12:09:53.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.616+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9MIULzK1c023LnFKLIWpuvVNImN-7m3_0 2024-09-14T12:09:53.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.617+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16708461168577379082', time=2024-09-14T13:51:31.442340+0000, chain.objs.size()=1 2024-09-14T12:09:53.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.617+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bn_XpSSi1vL37lZj8xN_K1uqd-Ey_j4_0 2024-09-14T12:09:53.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7490717202125023314', time=2024-09-14T13:51:31.489471+0000, chain.objs.size()=1 2024-09-14T12:09:53.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.iidZ1UEk3MCKpDobwYJ1F3NEyvZkq95_0 2024-09-14T12:09:53.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11979924363348936118', time=2024-09-14T13:51:33.212902+0000, chain.objs.size()=1 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cvOOxmUz9Z_gG6UaeWDQ0GnMh9k4iA2_0 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10683047076604922243', time=2024-09-14T13:51:34.503761+0000, chain.objs.size()=1 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.28rpn7nwpXcWrIuc2OVPbphdBE2U659_0 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7213663946680628656', time=2024-09-14T13:51:34.653956+0000, chain.objs.size()=1 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.adK1lSL5-s0U4pr6InCOrDZbyOA1n1i_0 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12663374304687204175', time=2024-09-14T13:51:34.784044+0000, chain.objs.size()=1 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.iDw4Ot_dFzHn4zome7ujsRfFbB2kfhQ_0 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10244646745513123610', time=2024-09-14T13:51:34.852431+0000, chain.objs.size()=1 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.oCQOVx6deaxQqq4OCPz-rbM0DZuLc-i_0 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16884970205166532392', time=2024-09-14T13:51:34.895507+0000, chain.objs.size()=1 2024-09-14T12:09:53.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.618+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YAX0RXmVuFYInAI_37SmK93GM74FiYq_0 2024-09-14T12:09:53.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.619+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14220871698810665042', time=2024-09-14T13:51:35.369129+0000, chain.objs.size()=1 2024-09-14T12:09:53.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.619+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Q5iP36IbYL6CYuU4P_aawdxt1ub2Prg_0 2024-09-14T12:09:53.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3345690589217149299', time=2024-09-14T13:51:35.680352+0000, chain.objs.size()=1 2024-09-14T12:09:53.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GpO09Zl2zdhI3UehuitpW4xfMD5O_lK_0 2024-09-14T12:09:53.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16429054888296496064', time=2024-09-14T13:51:35.681833+0000, chain.objs.size()=1 2024-09-14T12:09:53.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.aFdtMbUDTBN4rhJr94q15T-6BpzwFKJ_0 2024-09-14T12:09:53.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.630701675840685362', time=2024-09-14T13:51:35.783730+0000, chain.objs.size()=1 2024-09-14T12:09:53.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3Ig6Rk5rWV_mdthH-MiqjohGEVU0utB_0 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11861996033835564254', time=2024-09-14T13:51:36.197321+0000, chain.objs.size()=1 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.i3IcM15_JvTuu7iJQDtuwTAxKJiwPGN_0 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3419434434064894712', time=2024-09-14T13:51:36.822206+0000, chain.objs.size()=1 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qcGu5DiJbup0xRGzUhRnzmBwDQWB9qc_0 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7291830860771674879', time=2024-09-14T13:51:37.010861+0000, chain.objs.size()=1 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.eezvcBYw2TWxsaG1zgKDn9VcCsXqn73_0 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3143750139291873441', time=2024-09-14T13:51:37.246069+0000, chain.objs.size()=1 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7fDcFPm6nFIW2KaHgSANiMP4TKt2fAy_0 2024-09-14T12:09:53.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2302637797141159122', time=2024-09-14T13:51:37.268034+0000, chain.objs.size()=1 2024-09-14T12:09:53.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.H62-nBg6EwfqzWOtlV8CGBgkZwm7zKK_0 2024-09-14T12:09:53.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12594288869362402936', time=2024-09-14T13:51:38.306629+0000, chain.objs.size()=1 2024-09-14T12:09:53.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wm5512SJ4CoBCJQb7hD6ZjWySzz0W7i_0 2024-09-14T12:09:53.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17062558697890939741', time=2024-09-14T13:51:38.545716+0000, chain.objs.size()=1 2024-09-14T12:09:53.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2M8x2f_yNB-QF-E2ldeg7PhoGVJtyKj_0 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5757215348118913242', time=2024-09-14T13:51:39.025518+0000, chain.objs.size()=1 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wbZPPyCKprubIwJZiJSDl46kZ2PFdrM_0 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4346711926894313948', time=2024-09-14T13:51:39.153331+0000, chain.objs.size()=1 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YhmmoRmwDk6pHgQlgAk35h3NjMiF-vI_0 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17785063851275031230', time=2024-09-14T13:51:39.701151+0000, chain.objs.size()=1 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Tl1Yc21JM0a-mPVjPW5nwTpp3HVunSN_0 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3853267585747993517', time=2024-09-14T13:51:39.776723+0000, chain.objs.size()=1 2024-09-14T12:09:53.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.624+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pWFqvoI6unKC04kEIahSVOp2DPw1Dh4_0 2024-09-14T12:09:53.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.626+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6976252967628428105', time=2024-09-14T13:51:39.897786+0000, chain.objs.size()=1 2024-09-14T12:09:53.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.626+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ge5H_VxC2v5gWsFa-dpGIGLvhvS6I_2_0 2024-09-14T12:09:53.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.626+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3606685922908247621', time=2024-09-14T13:51:40.018674+0000, chain.objs.size()=1 2024-09-14T12:09:53.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.626+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wT5JKvFd1D5rvt_NXiiDbzNsr8uqeBU_0 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4938845192534413696', time=2024-09-14T13:51:40.195833+0000, chain.objs.size()=1 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kFd0p2L8MUvICfA3F8kWdf8iMbv4oAk_0 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4818891523131193095', time=2024-09-14T13:51:41.053874+0000, chain.objs.size()=1 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Wjoyz7VU_YPsu25H4NonADObCkEIbE0_0 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8951328088212495871', time=2024-09-14T13:51:41.756166+0000, chain.objs.size()=1 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.HDna8jEjR0ZNNMfq9QhJmRQsZPpPzTz_0 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.430684284653682757', time=2024-09-14T13:52:21.238437+0000, chain.objs.size()=1 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lTcWvIBcygsV8h9sRxfnUFOL8hqFEXp_0 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18422385607435078959', time=2024-09-14T13:52:21.634208+0000, chain.objs.size()=1 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.z9usEjhiO7NVK4jPIyNDp_l4zBsovTl_0 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7128122054320929276', time=2024-09-14T13:52:22.743655+0000, chain.objs.size()=1 2024-09-14T12:09:53.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.btNwlSOqko7cbDylmABO5U9jJwmhC5Q_0 2024-09-14T12:09:53.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17432772754245142300', time=2024-09-14T13:52:23.177312+0000, chain.objs.size()=1 2024-09-14T12:09:53.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.i_qZ6GBSeZm7YdH8tsDJ-jeytO_-v8K_0 2024-09-14T12:09:53.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3932136051729577557', time=2024-09-14T13:52:23.291452+0000, chain.objs.size()=1 2024-09-14T12:09:53.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xSrzob6WhBuQERiv2Wcte-8ihYDpmcP_0 2024-09-14T12:09:53.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14270420356138128205', time=2024-09-14T13:52:23.450016+0000, chain.objs.size()=1 2024-09-14T12:09:53.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qp8I7lrR4DF2yziEHMFVvONOTas7V1r_0 2024-09-14T12:09:53.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.630+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1783912477212966052', time=2024-09-14T13:52:23.613657+0000, chain.objs.size()=1 2024-09-14T12:09:53.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.630+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LSouxrsq9e1Z2TR96mszZoO4_m9Feqc_0 2024-09-14T12:09:53.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.630+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10307411346116719832', time=2024-09-14T13:52:23.708670+0000, chain.objs.size()=1 2024-09-14T12:09:53.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.630+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kKp6LZMWFU06sgBWlOB-Ba-ctQ-6xVc_0 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9525995008959618374', time=2024-09-14T13:52:23.753122+0000, chain.objs.size()=1 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Y0AJvwzoxkk5EPxl6-xz0clmvsMhdQI_0 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2451700878136602025', time=2024-09-14T13:52:24.211522+0000, chain.objs.size()=1 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vIPZbEaJ-f6hRJKylmbbi7k6jvobGu5_0 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15667870934598516142', time=2024-09-14T13:52:24.517938+0000, chain.objs.size()=1 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.45lm2sYaxku2FACOwH0ce9xxNaHVIEK_0 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11118980402126172282', time=2024-09-14T13:52:24.601936+0000, chain.objs.size()=1 2024-09-14T12:09:53.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.631+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3wTCTn3lXMKJwEYOXodK2LMLHwcY1TX_0 2024-09-14T12:09:53.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16587137003039978005', time=2024-09-14T13:52:24.663625+0000, chain.objs.size()=1 2024-09-14T12:09:53.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EpN7RRN6c6AwNOeT0Xn5H98EZNFkJdc_0 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11248500666352986467', time=2024-09-14T13:52:25.776117+0000, chain.objs.size()=1 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UrqPz_br3HR77k1sKouQnR5GKl9Oqqj_0 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12475047555924482389', time=2024-09-14T13:52:25.902157+0000, chain.objs.size()=1 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ue51whnloendjUidZop9S6FGHn_DTdJ_0 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14809438672725745542', time=2024-09-14T13:52:26.057821+0000, chain.objs.size()=1 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vTyRG1JCbnDgTQpUb_53oCij56wzVnl_0 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16688745701362347782', time=2024-09-14T13:52:26.110136+0000, chain.objs.size()=1 2024-09-14T12:09:53.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.633+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bEmV-jYG-ruQoR4DMwFFYlFvBj5FtxI_0 2024-09-14T12:09:53.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.634+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15083128658990463926', time=2024-09-14T13:52:26.170571+0000, chain.objs.size()=1 2024-09-14T12:09:53.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.634+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GTtVB3XUalQ5KsKqJQTme_e8nx9IrPp_0 2024-09-14T12:09:53.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.634+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17906527879221952097', time=2024-09-14T13:52:26.415516+0000, chain.objs.size()=1 2024-09-14T12:09:53.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.634+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6hli0jmqZbGkkQDzLQTZTEHMfqmpUis_0 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13786235439940589243', time=2024-09-14T13:52:26.730861+0000, chain.objs.size()=1 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FIp5o9MSsfYgxkAHG7H5y5x0wBQlXyC_0 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12254145323395693270', time=2024-09-14T13:52:28.051394+0000, chain.objs.size()=1 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RfrVMsKoKwVTxzFThb61bvSjLqb3dS1_0 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13526443200428342335', time=2024-09-14T13:52:28.668708+0000, chain.objs.size()=1 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FgVVrUWa3c5WUvR_gIl8P0qarYHcaoN_0 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7045972699424580107', time=2024-09-14T13:52:28.737032+0000, chain.objs.size()=1 2024-09-14T12:09:53.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.637+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.95vYrElimBIhdFPlAzzDf0gxAXtZB9g_0 2024-09-14T12:09:53.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.641+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48837 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17382897893746335278', time=2024-09-14T13:52:29.471181+0000, chain.objs.size()=1 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sPQZNkesybhVi1AukQU4v4yH9qrh6y3_0 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13935071442090614668', time=2024-09-14T13:52:29.611267+0000, chain.objs.size()=1 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7GckdVYhiXJMdJsf6a_RHymNInkQ6Kl_0 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15247358328791115573', time=2024-09-14T13:52:29.675173+0000, chain.objs.size()=1 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LNbzCg-xotOXNhtxMCwYztdmDRC7HVr_0 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9911156858182876225', time=2024-09-14T13:52:30.413695+0000, chain.objs.size()=1 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Dn7iZzHuxrjOPfzvz5mluNdECS1IJTd_0 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17578139078568045300', time=2024-09-14T13:52:30.819272+0000, chain.objs.size()=1 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SLt91ocSP7NhUlKo9qUdou2hqCKDnJR_0 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3829804556294705240', time=2024-09-14T13:52:31.358365+0000, chain.objs.size()=1 2024-09-14T12:09:53.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WAeQNaNzXskwga5wCkdW9Gova91wxb7_0 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6516542710365157520', time=2024-09-14T13:52:31.732144+0000, chain.objs.size()=1 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.CdL1nKu67X2uU5cFcsyRkI8e95j40O7_0 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1523620031157670507', time=2024-09-14T13:52:33.193516+0000, chain.objs.size()=1 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.326__shadow_.haR4hYvXTlqJCw13OFtxk_FWT6d3yUT_0 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8117718481279900938', time=2024-09-14T13:52:34.222916+0000, chain.objs.size()=1 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.328__shadow_.SoF8DZK2jEHIlAOId--yCAP5vBju0Fl_0 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3284833855933621808', time=2024-09-14T13:52:54.311641+0000, chain.objs.size()=1 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.369__shadow_.rK4Z2ysqzMJ5vnHZgXQ5Kq9PAZQrX-L_0 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14002488873010978170', time=2024-09-14T13:52:58.593479+0000, chain.objs.size()=1 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.375__shadow_.fqOjX3GfNhJ7rs-LW0Y_FN78nyP3avQ_0 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7150361972743660532', time=2024-09-14T13:53:02.405162+0000, chain.objs.size()=1 2024-09-14T12:09:53.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.645+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.381__shadow_.IkE4xPju-13sPR2WXeHQExEpBZLu3gI_0 2024-09-14T12:09:53.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.648+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14296751374594083301', time=2024-09-14T13:53:29.847886+0000, chain.objs.size()=1 2024-09-14T12:09:53.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.648+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.429__shadow_.OO9L36_m7pHjusdGbnmHtA4XQpJJnST_0 2024-09-14T12:09:53.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.648+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12166115680611069316', time=2024-09-14T13:54:08.399935+0000, chain.objs.size()=1 2024-09-14T12:09:53.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.648+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.488__shadow_.zL-3yy29HJruVyVd5H4rCwLoPzv28si_0 2024-09-14T12:09:53.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.648+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14135924503013946299', time=2024-09-14T13:54:15.066577+0000, chain.objs.size()=1 2024-09-14T12:09:53.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.648+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.499__shadow_.tWAY1FOJ-VYfFTsfIWQ5WvZxkZcqKz__0 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8', time=2024-09-14T13:56:00.381322+0000, chain.objs.size()=1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8.1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8', time=2024-09-14T13:56:00.385538+0000, chain.objs.size()=1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8.2 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8', time=2024-09-14T13:56:00.389304+0000, chain.objs.size()=1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8.3 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8', time=2024-09-14T13:56:00.392976+0000, chain.objs.size()=1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8.4 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8', time=2024-09-14T13:56:00.396763+0000, chain.objs.size()=1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8.5 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8', time=2024-09-14T13:56:00.400784+0000, chain.objs.size()=1 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~7anHR5GJmIEqg2LS12UFjsY9QZWETk8.6 2024-09-14T12:09:53.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14937638889899021127', time=2024-09-14T13:56:00.420961+0000, chain.objs.size()=6 2024-09-14T12:09:53.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu.1 2024-09-14T12:09:53.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.igt86egGVxAUlzyq05FkZkfmxA20wHRi.2 2024-09-14T12:09:53.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.651+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.lygAfuJwRyxACs9aO5rkEWe3sz4HfUMS.3 2024-09-14T12:09:53.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.651+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu.4 2024-09-14T12:09:53.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.651+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu.5 2024-09-14T12:09:53.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.654+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~pCtpqm-tHmUY81JVju2Bqy5XMh9dGfu.6 2024-09-14T12:09:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.654+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16411050429182490632', time=2024-09-14T13:57:26.743453+0000, chain.objs.size()=1 2024-09-14T12:09:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.654+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.554__shadow_.qHn3rgSAlr3un9aoY_J6vKQvOLz8202_0 2024-09-14T12:09:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.654+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4888469564994939804', time=2024-09-14T13:57:30.668017+0000, chain.objs.size()=1 2024-09-14T12:09:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.654+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.556__shadow_.gGadt0SmiSHaj6bCm8wPNBY_nruseDE_0 2024-09-14T12:09:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.654+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2979586926040240332', time=2024-09-14T13:57:59.612837+0000, chain.objs.size()=1 2024-09-14T12:09:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.655+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:msccjpnxMukZDuoPI89Fxyz-9lz1CMA_.7Co82MIHODsIIMQVB5rFuA4O-59Q4G__0 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2657626343720223976', time=2024-09-14T13:58:04.760804+0000, chain.objs.size()=1 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.570__shadow:clzBXOysMOrFx9rcfMyMGFgbUrhjUEY_.tpPmc4p8bgs_73f5p4cCMUKwBC4pNJN_0 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1194219777117854369', time=2024-09-14T13:58:07.306248+0000, chain.objs.size()=1 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.573__shadow_.Isa-zwtSSMEUEl5d4262l2MyncUx-t1_0 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13193553904549819072', time=2024-09-14T13:58:08.618437+0000, chain.objs.size()=1 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow_.69sjVMtotNo3WXQ7tQxCIKcozmdMuFz_0 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12484725185111497885', time=2024-09-14T13:58:28.740865+0000, chain.objs.size()=1 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:YoQBaj07pQxkJul09QGaBZKL-6XQ3l8_.GKicdgC2g-4QAkzOTth7kCDc2uUWPwI_0 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3014873281233314839', time=2024-09-14T13:58:30.801147+0000, chain.objs.size()=1 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:XtDlWGIpdTDsPItyraQlINTp7UFkBIV_.qdJVmfZh5y-3UWDgRVKqANHFgvIrDWA_0 2024-09-14T12:09:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5032311473236177200', time=2024-09-14T13:58:40.788530+0000, chain.objs.size()=1 2024-09-14T12:09:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:fXBqRo5p.OqWFmKuJ1kQtsATnV8DG8C_.eltxz_Ulncb055px5qJJjowz4YcSYJl_0 2024-09-14T12:09:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.657+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8553192076346640484', time=2024-09-14T13:58:55.436906+0000, chain.objs.size()=1 2024-09-14T12:09:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.657+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:zBHKcNeDBfLHoqu2-83pxISmyET3SWv_.GTlxLjN72LXY2DEfH1HB1WJ0_Ty_D7N_0 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.659+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7948347199321860140', time=2024-09-14T13:58:57.483174+0000, chain.objs.size()=1 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.659+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:c-m7kAVL0lEvJm4Wkfqx.yzdQRR1NIn_.GkqPwxTjFBqUkZFYZYqe6X0AmRhHm_T_0 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.659+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.231503920423295474', time=2024-09-14T13:58:57.748379+0000, chain.objs.size()=1 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:c-m7kAVL0lEvJm4Wkfqx.yzdQRR1NIn_.GkqPwxTjFBqUkZFYZYqe6X0AmRhHm_T_0 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2352661646926411184', time=2024-09-14T13:59:03.671373+0000, chain.objs.size()=1 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:ZFL9hmNArqUwNyIYD82LMDvkf9mADm0_.JINifqNogVULBrPPitbtem6NziKdeWI_0 2024-09-14T12:09:53.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8436256746747802138', time=2024-09-14T14:02:25.294405+0000, chain.objs.size()=1 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.618__shadow_.gireA-dXYK7jBMZR1Ri7zAGZiyUfJ5w_0 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9', time=2024-09-14T14:03:01.405757+0000, chain.objs.size()=6 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.625__multipart_multipart_enc.2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9.1 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.625__multipart_multipart_enc.2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9.2 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.625__multipart_multipart_enc.2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9.3 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.625__multipart_multipart_enc.2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9.4 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.625__multipart_multipart_enc.2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9.5 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.625__multipart_multipart_enc.2~0nZeDEt8hzJwvlzngwqHcj829jOvBU9.6 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7359157499667869641', time=2024-09-14T14:03:24.565444+0000, chain.objs.size()=1 2024-09-14T12:09:53.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.651__shadow_.zM9xLpjGv42CmmhkoVATY73mMhGE7wg_0 2024-09-14T12:09:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.664+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9185996079968414633', time=2024-09-14T14:03:50.828353+0000, chain.objs.size()=1 2024-09-14T12:09:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.664+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.663__shadow_.TffgFjWwwg1CEbVYeskkLQ6VbdpZrIb_0 2024-09-14T12:09:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.664+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16488731046090922299', time=2024-09-14T14:04:18.849567+0000, chain.objs.size()=1 2024-09-14T12:09:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.664+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.711__multipart_file1.2~xJGzHVvXc2K2HxSNuG_ufHU63UX0l4-.1 2024-09-14T12:09:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.664+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15944344500213095727', time=2024-09-14T14:05:16.444425+0000, chain.objs.size()=1 2024-09-14T12:09:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.664+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.746__shadow_.4ZUWeV7sZqvfrEMijiuxzrxXe9JDGWV_0 2024-09-14T12:09:53.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.668+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.670+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T12:09:53.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.672+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.672+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47058' 2024-09-14T12:09:53.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17152077022349674573', time=2024-09-14T13:49:02.429082+0000, chain.objs.size()=1 2024-09-14T12:09:53.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.233__shadow_.jAp-qRj2HQ_dEv8SUcC-8ZlhQDyRbJe_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2006374078540793803', time=2024-09-14T13:49:08.448046+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.242__shadow_.vq6ssboUCbSTyyEJWjFwg-BudVtv78m_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15957696302957870572', time=2024-09-14T13:49:09.310736+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.243__shadow_._WJx9l8SveJGx8UG8UMWs9nS4a0oFML_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2837623668375408602', time=2024-09-14T13:49:12.731572+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.248__shadow_.sbEBToKl5elU00cbzlbB68C4PNUtCGR_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12554687285956292726', time=2024-09-14T13:49:12.732196+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.248__shadow_.BxG8FCmsF7mE7X6A_61fRNPdw2VjdJN_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9282927283931331232', time=2024-09-14T13:49:58.851870+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.C8dvl5rJQ0LBS3wV9zVk5SEu2VWKusq_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12956365344267036184', time=2024-09-14T13:49:59.121151+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3VEhggvkdDACQaHEp3TXi7wzbX-uNGr_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18151417066889581515', time=2024-09-14T13:49:59.652489+0000, chain.objs.size()=1 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jm9V0zoQdEnlckHd2OcfKQxsZIVBdjv_0 2024-09-14T12:09:53.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16632137559352782598', time=2024-09-14T13:50:00.768156+0000, chain.objs.size()=1 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZcxhK37bNSMZz0Ag0eVQ5XpXfB_kZXz_0 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14742628030943413520', time=2024-09-14T13:50:00.768654+0000, chain.objs.size()=1 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7gg0VXaNQVSvMgt2TZ223ZGb4FLxbuz_0 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13427587638489395225', time=2024-09-14T13:50:01.009850+0000, chain.objs.size()=1 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6ZGFill3hmvbN2EQQdSPz6pC_1kxGac_0 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3907328457210078779', time=2024-09-14T13:50:01.157884+0000, chain.objs.size()=1 2024-09-14T12:09:53.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.673+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Xq0LLYpH101Yb0UDYutZlWrcnsbr3zL_0 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3931980516861751773', time=2024-09-14T13:50:01.187599+0000, chain.objs.size()=1 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5thKTfah8xzF8JI1OjmYxbBjqNE4Mpo_0 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7416395881520413065', time=2024-09-14T13:50:01.218738+0000, chain.objs.size()=1 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wldpypYrLBZBn6PghXN-_d_w3pPfBZi_0 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10737954683873154034', time=2024-09-14T13:50:01.424850+0000, chain.objs.size()=1 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fm1GI0y3ZmdbZH8nK-FQP7lM_WPJ-aI_0 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11322141300181460247', time=2024-09-14T13:50:01.439223+0000, chain.objs.size()=1 2024-09-14T12:09:53.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.676+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5_wJM9vB7VdGLJdFb1W41klCJOP2NA5_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9459894496184633451', time=2024-09-14T13:50:01.985192+0000, chain.objs.size()=1 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OAdTFS3tKDhTNa99HY88XSkWlHOImw1_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15487039056907238050', time=2024-09-14T13:50:02.009823+0000, chain.objs.size()=1 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7gYEQnJ50ht5btbR939J2t83-UTrqZM_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.125597017123997731', time=2024-09-14T13:50:02.899222+0000, chain.objs.size()=1 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TAXAXF093iPwDb1v2hnKE1dCqI3tznw_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7032176800028592609', time=2024-09-14T13:50:03.455581+0000, chain.objs.size()=1 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OX0ix2aDtKGfx165TZVeMDnHQ01LQcV_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10342749129650642783', time=2024-09-14T13:50:03.585636+0000, chain.objs.size()=1 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DJQBRquelxEi1pThV8nO1WwuqaR6VIZ_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11724825559092021814', time=2024-09-14T13:50:03.855993+0000, chain.objs.size()=1 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GgKGZd-wv9EgyQ1epgBkKwV7l_2e3JO_0 2024-09-14T12:09:53.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.436674198145082286', time=2024-09-14T13:50:03.871273+0000, chain.objs.size()=1 2024-09-14T12:09:53.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.678+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.U1ZAkxBDcRZGnBhnVQx6taBhx4V7404_0 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8204831450611091900', time=2024-09-14T13:50:04.109078+0000, chain.objs.size()=1 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.x30p_hpSOIoB9NCxKyyiXtIeGQNJFbY_0 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3180646632342179147', time=2024-09-14T13:50:04.154193+0000, chain.objs.size()=1 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zDXIjEdwQADyvnZlg1Kme3cymuGIWOd_0 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17601124821750636615', time=2024-09-14T13:50:04.376129+0000, chain.objs.size()=1 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._v0_Bpxj8KxsN6DMmmZuKwtQheAi0mB_0 2024-09-14T12:09:53.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1498423453438584868', time=2024-09-14T13:50:05.114646+0000, chain.objs.size()=1 2024-09-14T12:09:53.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.680+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GDjBKe5g89dUnooCPvcH8ZtZ3aS-V1x_0 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14536658228065422125', time=2024-09-14T13:50:05.149386+0000, chain.objs.size()=1 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VHfIhsmZXrJujzrGD0Nbbf6ulJrsSvv_0 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5602727865663911983', time=2024-09-14T13:50:05.150536+0000, chain.objs.size()=1 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Fio4oYcTpZq_hegyemGvWzi2mByJyqD_0 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5374995898789018660', time=2024-09-14T13:50:05.430289+0000, chain.objs.size()=1 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rC17O9HQZYpzOsUP4utiAlOXzT4HZm5_0 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3080718832017000531', time=2024-09-14T13:50:05.760329+0000, chain.objs.size()=1 2024-09-14T12:09:53.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YvBNsayqXdR1MT3NsS7R6iNnYK_16Iw_0 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7555023718791459831', time=2024-09-14T13:50:05.871222+0000, chain.objs.size()=1 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kb_7003tNxYO05Xvk7132w6FAhj8jbG_0 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12126942197125297362', time=2024-09-14T13:50:06.532290+0000, chain.objs.size()=1 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zYOYFAR7T8saTKQU3j-91Wgt40xc26g_0 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10390389561025478370', time=2024-09-14T13:50:07.004654+0000, chain.objs.size()=1 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.682+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RqPkB50NeTCVl_B85VhBxGbPEEq5WmB_0 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.683+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8961831274556207216', time=2024-09-14T13:50:07.200784+0000, chain.objs.size()=1 2024-09-14T12:09:53.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.683+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DTX34iLLw22KmcLwVYZ3IfSRcsbYVFk_0 2024-09-14T12:09:53.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.685+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16119255227377479350', time=2024-09-14T13:50:07.565610+0000, chain.objs.size()=1 2024-09-14T12:09:53.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.685+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9hYOa8ljFsjZF-IW98ISHraPsNBj_xv_0 2024-09-14T12:09:53.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8680991426052839112', time=2024-09-14T13:50:07.707469+0000, chain.objs.size()=1 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ebyyFKhAUaQzm8cw4qJpsAXUvh7-BtI_0 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9508113502836549004', time=2024-09-14T13:50:07.923306+0000, chain.objs.size()=1 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GliA5cvl65Pw8XkL-Nd7QxHrNyRHo_0_0 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2089406309528429844', time=2024-09-14T13:50:08.314790+0000, chain.objs.size()=1 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Q7YPpNBLgP8NvR7PTkhXJwvWAPPS3ya_0 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17199905984936779483', time=2024-09-14T13:50:08.413929+0000, chain.objs.size()=1 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.688+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DjC7yHs2u4h3ZxC8keJvYrBzALsTnqk_0 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9005102382181596030', time=2024-09-14T13:50:08.414549+0000, chain.objs.size()=1 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.U9gRXTClyz6tl91CoSELaqGz0oCGR8l_0 2024-09-14T12:09:53.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4260782900332934546', time=2024-09-14T13:50:09.288951+0000, chain.objs.size()=1 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7KjFhjC_ZRZ8OJP4X1fgD5e6dc9uFcz_0 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2872520428331267143', time=2024-09-14T13:50:09.852829+0000, chain.objs.size()=1 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XjAfu0o4YqG7IA-Wl-ty6p7-kj2lgv7_0 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18267784487846089946', time=2024-09-14T13:50:11.091043+0000, chain.objs.size()=1 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.264__shadow_.v4QI2waSktSGTzmwojWSru-WjiqX3pB_0 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2854633611439577504', time=2024-09-14T13:50:15.794462+0000, chain.objs.size()=1 2024-09-14T12:09:53.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.689+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.272__shadow_.QvJ6HAzso2ChGhtihQC_koPBsWh24k5_0 2024-09-14T12:09:53.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.691+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2480820359358431638', time=2024-09-14T13:50:18.897814+0000, chain.objs.size()=1 2024-09-14T12:09:53.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.691+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.277__shadow_.pfbl5MN3faTFW3SmfspYLrcszNFkDbB_0 2024-09-14T12:09:53.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.691+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4346177716829092509', time=2024-09-14T13:50:31.653274+0000, chain.objs.size()=1 2024-09-14T12:09:53.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.691+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.wfQqBUsSLZVPkryJkdpAVONtwvjly8f_0 2024-09-14T12:09:53.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.691+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5288628820790218606', time=2024-09-14T13:50:31.653954+0000, chain.objs.size()=1 2024-09-14T12:09:53.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.691+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.Bc8G0JSIrzS-UyO9booiUYDUqp7-t7W_0 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17978707330119615664', time=2024-09-14T13:50:35.796437+0000, chain.objs.size()=1 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.299__shadow_.DR-bFZRGlrSt2_q7bSxBuoI70Ep8nfD_0 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11399297969929352168', time=2024-09-14T13:50:37.049503+0000, chain.objs.size()=1 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.301__shadow_.IWoc9MwI8DSbRngmwn1dXBxMaYb38hO_0 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1525656179417315999', time=2024-09-14T13:50:37.703887+0000, chain.objs.size()=1 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.302__shadow_.Mfkv-sUoMA2LTbgblzesLqbmuXr9e7A_0 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16331624665358314950', time=2024-09-14T13:51:31.085921+0000, chain.objs.size()=1 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.FPrYGoK8a7TgSjeqwQFuY_mrTY4OzER_0 2024-09-14T12:09:53.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5098680095000234620', time=2024-09-14T13:51:31.745735+0000, chain.objs.size()=1 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.692+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uxllVwMNOoUIeoPsrANlQQoLvLcX7Ga_0 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3444698335923181901', time=2024-09-14T13:51:32.619661+0000, chain.objs.size()=1 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OZ-qeKLsTLrZbiiLnrR3TAe1CfF04L9_0 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4322137565956514141', time=2024-09-14T13:51:32.732721+0000, chain.objs.size()=1 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yfX3H0kP5Ae2hEF-ePYuuUMgdvyGTG5_0 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.694+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3621293560295515913', time=2024-09-14T13:51:33.130549+0000, chain.objs.size()=1 2024-09-14T12:09:53.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.694+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.HXhQrJ74qj9x__fqtT91rT9cF13Lf7w_0 2024-09-14T12:09:53.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.695+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16327080567284500772', time=2024-09-14T13:51:33.317259+0000, chain.objs.size()=1 2024-09-14T12:09:53.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.695+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.HtLDMyGZ7K_aElSSBwkZnZz7UlgyVeu_0 2024-09-14T12:09:53.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.695+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8137935087053194283', time=2024-09-14T13:51:34.020010+0000, chain.objs.size()=1 2024-09-14T12:09:53.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.695+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.281C8Sm8FoF_7w288txv0x3CLUFLIop_0 2024-09-14T12:09:53.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.695+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16716610788914487911', time=2024-09-14T13:51:34.868958+0000, chain.objs.size()=1 2024-09-14T12:09:53.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.695+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tInG_6gTZ0u34Ii0ui55IQevbzNFx5z_0 2024-09-14T12:09:53.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17836061994098353921', time=2024-09-14T13:51:35.535165+0000, chain.objs.size()=1 2024-09-14T12:09:53.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.731ZE2eIKiQ1_LFJsaFi-WESijeniiu_0 2024-09-14T12:09:53.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14277135308732520012', time=2024-09-14T13:51:35.685474+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Upf1XivXk6EwfM6tw8OYKmdszblFy-w_0 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12433355359352254507', time=2024-09-14T13:51:37.736772+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.B4TH6AsUO6bl5zRXyWXCTY5cut9v_aQ_0 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3551327387789862184', time=2024-09-14T13:51:38.581883+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1gkjB1TIp2zLZmrSv4s9gbStfnsG7P7_0 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.379967359162197675', time=2024-09-14T13:51:38.728853+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.697+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fkM1IcCKPPkMg2IJUiySKVn_rZ80bGn_0 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.698+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6522526280140202081', time=2024-09-14T13:51:39.157935+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.698+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1zQqFzIOoP-F2Rlb1aTx4fS6SfG8ZpB_0 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.698+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14900188234356768353', time=2024-09-14T13:51:39.826788+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.698+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pOA8AOeZUOhtjOeLyB7j2V8bx0KeK03_0 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.698+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14090622706075080325', time=2024-09-14T13:51:40.204081+0000, chain.objs.size()=1 2024-09-14T12:09:53.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.698+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OblWcChI55Cgo3lUqt5WC7_784QqeCY_0 2024-09-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.699+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.592998669667701011', time=2024-09-14T13:51:40.529689+0000, chain.objs.size()=1 2024-09-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.699+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BSiyWW0eqHQnT8DsXLIo1Nene8agI1Y_0 2024-09-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.699+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2314908741432884119', time=2024-09-14T13:51:40.572388+0000, chain.objs.size()=1 2024-09-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.699+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GY01cyBuxmBzMmCPZObh2wrvbvTWS8P_0 2024-09-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.699+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11622613295029800510', time=2024-09-14T13:51:41.369458+0000, chain.objs.size()=1 2024-09-14T12:09:53.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.699+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JEc8AH84lNq8fIWSLPZUW44_-FIIjW7_0 2024-09-14T12:09:53.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16635990527355774174', time=2024-09-14T13:51:41.370338+0000, chain.objs.size()=1 2024-09-14T12:09:53.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._uR7utKAew7nLbwOY-0jlT85HQj_IYg_0 2024-09-14T12:09:53.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.701+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5174184254559423587', time=2024-09-14T13:51:41.375721+0000, chain.objs.size()=1 2024-09-14T12:09:53.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.701+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WnZAU74oyqMMAT7qLXSdVYsRhCKIVMP_0 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2618922664613587538', time=2024-09-14T13:51:41.479014+0000, chain.objs.size()=1 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pDRXWfE6IDVzBXMj1ledmFkytkdx22z_0 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11405248820387494821', time=2024-09-14T13:51:41.480107+0000, chain.objs.size()=1 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lzksU4SSCoFDiaUgEPNowkf89p3PonY_0 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10946824623835593658', time=2024-09-14T13:51:41.528788+0000, chain.objs.size()=1 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Z55HRkcYr86QFGahDV3DaojTVLnKn1P_0 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1362209902749465999', time=2024-09-14T13:52:21.389894+0000, chain.objs.size()=1 2024-09-14T12:09:53.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.702+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SoQCAfxmwZgiJuvcx2rVGilLc5oR7jE_0 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.704+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5304225631246196364', time=2024-09-14T13:52:21.644931+0000, chain.objs.size()=1 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.704+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TgHgS4rK_Xe-XNGjhkbmqtkzwx-5jiX_0 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.704+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6283709055513779963', time=2024-09-14T13:52:21.732100+0000, chain.objs.size()=1 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.704+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ODKE73kvBprBUnNPbfCeJvBu30r_zl2_0 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.704+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17511785124232081870', time=2024-09-14T13:52:21.853074+0000, chain.objs.size()=1 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.704+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.naDSJpvqozVHo7xPpN3Pat7bNS4gXAL_0 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.897236699553178151', time=2024-09-14T13:52:21.899867+0000, chain.objs.size()=1 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.X-8l-4137Om9QeWeCWO7IIN7OgWDanC_0 2024-09-14T12:09:53.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14940130449989749323', time=2024-09-14T13:52:21.965932+0000, chain.objs.size()=1 2024-09-14T12:09:53.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cwOkPdvOJVGtfNcX-3BXpRfwTozw5c7_0 2024-09-14T12:09:53.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15806060890084678043', time=2024-09-14T13:52:21.994770+0000, chain.objs.size()=1 2024-09-14T12:09:53.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vjfnS48IYgCfOf3l32rWIhWTput3Q4X_0 2024-09-14T12:09:53.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3434657691112074026', time=2024-09-14T13:52:22.814391+0000, chain.objs.size()=1 2024-09-14T12:09:53.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.705+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MWA2NgEMa_SAkR5EObSPLX3NnWyRGhR_0 2024-09-14T12:09:53.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15843409844300460837', time=2024-09-14T13:52:22.949681+0000, chain.objs.size()=1 2024-09-14T12:09:53.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WXR-XWG_42Sg-TQamgGaGss725TP3Dy_0 2024-09-14T12:09:53.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13216513007989274116', time=2024-09-14T13:52:23.288196+0000, chain.objs.size()=1 2024-09-14T12:09:53.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bQLLo_RM5MMZeVas7YBI_JTIM6CunU3_0 2024-09-14T12:09:53.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2444533861664316935', time=2024-09-14T13:52:23.512223+0000, chain.objs.size()=1 2024-09-14T12:09:53.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FelhFEVP6cQRge9OjCTIENmDqEodXXu_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3402735466246357446', time=2024-09-14T13:52:23.600474+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TEZUe8ceo-A31SPLlZ9xYvKLyN56BLk_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17406726419186755955', time=2024-09-14T13:52:23.754818+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ryPrWlvcj4NybiLCHsJs2RgdDs4gfKM_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12221907660778403720', time=2024-09-14T13:52:24.485306+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rbFX3xTkQt69qxhYibUsE0SrAgabEMV_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14675735970976406909', time=2024-09-14T13:52:24.776635+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.W1uJqJ4FzWLZKjtUeDDKHYe1LJ2wJpi_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3317313934844547357', time=2024-09-14T13:52:24.946368+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.D2ZhxJ5ut2I3BQbX5up1nTkQLCQQhm__0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5993758872280579914', time=2024-09-14T13:52:25.000643+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.707+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WKdal7g-0U06SzQ81G9M_X7auXKMaLp_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.708+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1150322587210364323', time=2024-09-14T13:52:25.104788+0000, chain.objs.size()=1 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.708+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vMHp2MhvomGI_fTb5ThCqegCNlReVxa_0 2024-09-14T12:09:53.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.708+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12905120859519232604', time=2024-09-14T13:52:25.165777+0000, chain.objs.size()=1 2024-09-14T12:09:53.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.708+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lGb9cJ4qkhGfm3WbBicNg9d4w1ltq8m_0 2024-09-14T12:09:53.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.711+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8403948150043049545', time=2024-09-14T13:52:25.249171+0000, chain.objs.size()=1 2024-09-14T12:09:53.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.711+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ezFR8JuA_pyagN6JzCGp92DbXQlc9bS_0 2024-09-14T12:09:53.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.712+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1623997704910280346', time=2024-09-14T13:52:25.773060+0000, chain.objs.size()=1 2024-09-14T12:09:53.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.712+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.n6RHdTpMJ0sxgNpc9nTkP__3_BKuDQy_0 2024-09-14T12:09:53.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.712+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17018482640523202066', time=2024-09-14T13:52:26.752438+0000, chain.objs.size()=1 2024-09-14T12:09:53.710 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.712+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3Fu5QVPEDEDncq8rpMrQZoKDI6FTHlv_0 2024-09-14T12:09:53.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.712+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5113443795540440134', time=2024-09-14T13:52:27.886184+0000, chain.objs.size()=1 2024-09-14T12:09:53.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.712+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cyeoOnVwknPfVE6jr-JC1lk9SKxpXC8_0 2024-09-14T12:09:53.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.713+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16450055001020115065', time=2024-09-14T13:52:28.001093+0000, chain.objs.size()=1 2024-09-14T12:09:53.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.713+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bYqzSErUQspMot6LO9uDYcwbb8azitL_0 2024-09-14T12:09:53.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.713+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3189834569148380700', time=2024-09-14T13:52:28.763091+0000, chain.objs.size()=1 2024-09-14T12:09:53.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.713+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QGqM_rWZElfdWAF5jXXawUe1rtcRJ7s_0 2024-09-14T12:09:53.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.717+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47058 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5668073654437142809', time=2024-09-14T13:52:30.109866+0000, chain.objs.size()=1 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iqElGT-2QepegAmqVCmqs8lYRGji1eE_0 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2940434679186464901', time=2024-09-14T13:52:31.052968+0000, chain.objs.size()=1 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.leP59uoPNRvO5CdvyzopsHoxxweCm2p_0 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6591260927708507129', time=2024-09-14T13:52:31.472253+0000, chain.objs.size()=1 2024-09-14T12:09:53.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-2t-Xdm3h_v1-IRCrWU3VPvDda_lBEd_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17319261287698745270', time=2024-09-14T13:52:31.565439+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LmePUMB81VKUlf18dCEKVCBEXVCpbiw_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12317045545095397801', time=2024-09-14T13:52:31.679763+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cblvd5VP3tsIthDYsoqp2mnzwvqaI9W_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8754389609227652839', time=2024-09-14T13:52:32.197499+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.flLo3Pg02LYSOcht3YW0SNi5exCLl8s_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3523814071549442526', time=2024-09-14T13:52:32.213032+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3cOR4Pqyj1H_savyTe-FOe6wF5qIDtv_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5244224530863225793', time=2024-09-14T13:53:04.392756+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.384__shadow_.djejIkU6L_8abK5_l4EADMZ3m73ipLW_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3914162812977141033', time=2024-09-14T13:53:34.015867+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.436__shadow_.SR4HzjZFSoo2zWBxHWZvz64s6e70i_H_0 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10449483467022032297', time=2024-09-14T13:53:34.693540+0000, chain.objs.size()=1 2024-09-14T12:09:53.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.437__shadow_.4gfeulqaftjNbZryiFoHJcY5orzn9-8_0 2024-09-14T12:09:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2457160380491064666', time=2024-09-14T13:53:41.001630+0000, chain.objs.size()=1 2024-09-14T12:09:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.447__shadow_.aDVfxm59QdyOR9T2xQiE3J5KwX7HA0q_0 2024-09-14T12:09:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8389087165584822678', time=2024-09-14T13:53:53.073205+0000, chain.objs.size()=1 2024-09-14T12:09:53.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.721+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.464__shadow_.KPkVwbxrf9Ao52OLEBD5OYlmUlEMH-M_0 2024-09-14T12:09:53.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17908251493150637075', time=2024-09-14T13:54:02.549792+0000, chain.objs.size()=1 2024-09-14T12:09:53.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.84n2LJULnNrgr97vFOb66f5g3TMvIe-_0 2024-09-14T12:09:53.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7010319400829084684', time=2024-09-14T13:54:08.400194+0000, chain.objs.size()=1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.488__shadow_.zL-3yy29HJruVyVd5H4rCwLoPzv28si_0 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8711195672031059386', time=2024-09-14T13:54:15.230068+0000, chain.objs.size()=1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.500__shadow_.FflvEDjjzbvLJ0l7bIXSDMs-zFG2hIZ_0 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9533973104140528381', time=2024-09-14T13:56:11.672612+0000, chain.objs.size()=2 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~t1r-8pYU4XStmnzPCtNkXxIwqIqKD8E.1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~t1r-8pYU4XStmnzPCtNkXxIwqIqKD8E.2 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~n3kj06Q1vGPQJDfndKMeXPWzBFUdYeM', time=2024-09-14T13:56:34.010495+0000, chain.objs.size()=2 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.529__multipart_mymultipart.2~n3kj06Q1vGPQJDfndKMeXPWzBFUdYeM.1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.529__multipart_mymultipart.2~n3kj06Q1vGPQJDfndKMeXPWzBFUdYeM.2 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14323959174535039655', time=2024-09-14T13:57:31.216930+0000, chain.objs.size()=1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.556__shadow_.v_F6WZrB_bSYEeAWivclMwPuuuvrEPY_0 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3301050974042999487', time=2024-09-14T13:57:37.367454+0000, chain.objs.size()=1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.558__shadow_.OrTl1s47ENafzG1xYCHP4WtxUwRnq_u_0 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14138969759589006456', time=2024-09-14T13:57:54.785208+0000, chain.objs.size()=1 2024-09-14T12:09:53.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:9jQPk3TSyhSeweXvDKYACFdN9N4MWI4_.EGyyhPG4IakDTjP2mM3MoYBrTpuCtzC_0 2024-09-14T12:09:53.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8281725822506137142', time=2024-09-14T13:57:56.195944+0000, chain.objs.size()=1 2024-09-14T12:09:53.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.725+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:RS3sAUT4o9AnfXhA1T5HM8yhscPYXdM_.zOdfEsSVWa70mui6G79mcdEGuK86CWc_0 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.688084767011254191', time=2024-09-14T13:58:24.812171+0000, chain.objs.size()=1 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:kXVD0S3SiP5v7kJTRvJccNj6f6S1wjk_.Y2kK27B7tG0VgATlk-1E0UtENNXRmcm_0 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5414529655540804512', time=2024-09-14T13:58:26.992973+0000, chain.objs.size()=1 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:rUNusMhT.UuUWZRbVK8tUaogIMGmtWy_.12c3AknuCN5QHJAEtiLby16eJrM7h0C_0 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6401474780587834767', time=2024-09-14T14:01:23.991584+0000, chain.objs.size()=1 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.617__shadow_.eXOuTZUoB7q14Kg0bsZy4_IpuCK-MCo_0 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12939974656581028427', time=2024-09-14T14:03:10.214460+0000, chain.objs.size()=1 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.640__shadow_.fDx6WoaCTQSYNoWBKe75oxIr5Ck8uH4_0 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8963685544559969973', time=2024-09-14T14:03:51.828395+0000, chain.objs.size()=1 2024-09-14T12:09:53.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.728+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.664__shadow_.w1xd0bWq6jR8c6qNkNK0bqRYcNo2Z_M_0 2024-09-14T12:09:53.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3715276207481253685', time=2024-09-14T14:04:10.326015+0000, chain.objs.size()=1 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.698__shadow:zGrLnPvGPUVF4FcJAVIe2sYP-ItooFG_.cfzF9IIZZ91MmpGg4tl8Giwl7xxGy6K_0 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14862800818407872329', time=2024-09-14T14:04:12.150417+0000, chain.objs.size()=1 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.701__shadow:cXnzl1y4ndIolQ6I0suEIhonyz4TwM._._ptVofY-h5xVAAlN66KDayurvl2t1oS_0 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3286196378398620295', time=2024-09-14T14:04:12.916240+0000, chain.objs.size()=1 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.702__multipart_file1.2~T2xwUek5i_doLBsVJLj_QFDxGTJa_WP.1 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4246856806574466664', time=2024-09-14T14:06:40.959556+0000, chain.objs.size()=1 2024-09-14T12:09:53.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.730+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.766__shadow_.N-BRL3TbWP2SS2I8fcMsNSRdefs95B-_0 2024-09-14T12:09:53.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.733+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.736+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T12:09:53.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.737+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.737+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43645' 2024-09-14T12:09:53.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12747333950925539114', time=2024-09-14T13:49:02.431858+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.233__shadow_.f_mIRS2PUYPQGqlS9mUan2xhduhU7Q0_0 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9402984531576400929', time=2024-09-14T13:49:12.103684+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.247__shadow_._VjqMMyQxA1fs7zMWrDzzoUI-1VVvQQ_0 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8028316396725686090', time=2024-09-14T13:49:13.359963+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.249__shadow_.IXacjEhzc9ZKZ6LPmBTKnAnNth5sPFi_0 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6275026633871746863', time=2024-09-14T13:49:15.907379+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.253__shadow_.g9NHgp3QjHnCfhD2t5jJhknC6XvEavN_0 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15377986552926713272', time=2024-09-14T13:49:59.074787+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.InhdRdcg8JZVrk2TazQ7OrL3yYJ1t3i_0 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14010833862201798674', time=2024-09-14T13:49:59.343120+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Cdnmt-omaooEMY9YiHxmvmrJFEgpBhK_0 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16750370307792886283', time=2024-09-14T13:50:00.780515+0000, chain.objs.size()=1 2024-09-14T12:09:53.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WI7V9lXn_brOzQgiA8Ohx_xfF1kcvLh_0 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17890552273308519704', time=2024-09-14T13:50:01.315363+0000, chain.objs.size()=1 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4HaEGQa1HsTnmux0-8q6wt16-4RjNYT_0 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17678141002018859664', time=2024-09-14T13:50:01.356535+0000, chain.objs.size()=1 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.p812SSv833zzuKhgff6hQULdiulM2Kd_0 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12587274875182413620', time=2024-09-14T13:50:02.436295+0000, chain.objs.size()=1 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tQ8cYxUjLgD10Es1B5BRuZS_39YsIeN_0 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1338137180737516980', time=2024-09-14T13:50:02.684750+0000, chain.objs.size()=1 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wFzj7AO8VUbCZZwmxv6pOfCH_wyDhuO_0 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.328149055850817524', time=2024-09-14T13:50:03.445644+0000, chain.objs.size()=1 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.738+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AzRI7PUldPqhO_huBKyX55CR9wgCJoL_0 2024-09-14T12:09:53.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13509598829649099733', time=2024-09-14T13:50:03.744373+0000, chain.objs.size()=1 2024-09-14T12:09:53.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hMuVD1YBB-E2EEaFE56ZuSnrfIGlTYz_0 2024-09-14T12:09:53.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.741+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.454824305034827890', time=2024-09-14T13:50:03.756920+0000, chain.objs.size()=1 2024-09-14T12:09:53.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.741+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4y1ZyJUBxTdhUsr_g9Zn1poD5LuPfQ9_0 2024-09-14T12:09:53.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.742+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16840216744550867691', time=2024-09-14T13:50:04.017822+0000, chain.objs.size()=1 2024-09-14T12:09:53.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.742+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jJFoyXerQ0RbxoCA3y9SKq2dHcQk8Ei_0 2024-09-14T12:09:53.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.742+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1482863801182945369', time=2024-09-14T13:50:04.029504+0000, chain.objs.size()=1 2024-09-14T12:09:53.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.742+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RW4W1xJMLLWfeLtVlPUXbMmkYAwy_H8_0 2024-09-14T12:09:53.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9152955559274234250', time=2024-09-14T13:50:04.431104+0000, chain.objs.size()=1 2024-09-14T12:09:53.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cfBMFyEoN70nmQeEuikKE0CfVV9YDtr_0 2024-09-14T12:09:53.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16238045275807675130', time=2024-09-14T13:50:05.145388+0000, chain.objs.size()=1 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mpMMohOMIKyVLW_7k7XQN2Ozb8Xq6XB_0 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10159080141865728365', time=2024-09-14T13:50:05.471682+0000, chain.objs.size()=1 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.b5B1DRx272052BVaFGekA6LVEs7o60J_0 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15985814630205963432', time=2024-09-14T13:50:06.286244+0000, chain.objs.size()=1 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fQrqWaedjZckslzyznTmzyUs8dbqCzT_0 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3975855003394452703', time=2024-09-14T13:50:06.678762+0000, chain.objs.size()=1 2024-09-14T12:09:53.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.743+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6TPIE8ubvN9Q0qHB_FuDqf6JK1hrgSO_0 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.744+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3557366597154160328', time=2024-09-14T13:50:06.945255+0000, chain.objs.size()=1 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.744+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YBYv52OCPdZ3FrRtM7fawlrI-A3aBhq_0 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.744+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14741167719897787225', time=2024-09-14T13:50:06.987074+0000, chain.objs.size()=1 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.744+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zXWXLQ9iXRdxC7HTUnZ7jkbpEOTsqhV_0 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.744+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8426892047031813702', time=2024-09-14T13:50:07.026810+0000, chain.objs.size()=1 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.744+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Y3atVNgaLW1KnFRkV4CtT-DI9mpeTap_0 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.745+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1088422791481742978', time=2024-09-14T13:50:07.173259+0000, chain.objs.size()=1 2024-09-14T12:09:53.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.745+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pXmHzJ-l78e5Om-mrblLmtHvXHppTGM_0 2024-09-14T12:09:53.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.745+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14415469105946524306', time=2024-09-14T13:50:07.214826+0000, chain.objs.size()=1 2024-09-14T12:09:53.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.745+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qM9yfXOkVL5D9CprSEldbNlgT1JQuUe_0 2024-09-14T12:09:53.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.745+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7229899385116370878', time=2024-09-14T13:50:07.822767+0000, chain.objs.size()=1 2024-09-14T12:09:53.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.745+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0Gdc06xl_-VNokm1xntGpzHIiuuETVI_0 2024-09-14T12:09:53.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.746+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7859958374201452412', time=2024-09-14T13:50:07.923439+0000, chain.objs.size()=1 2024-09-14T12:09:53.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.746+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2ERoV19CnKrd47AxqD9qIa-n7isABym_0 2024-09-14T12:09:53.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.746+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1762109484937434882', time=2024-09-14T13:50:08.049596+0000, chain.objs.size()=1 2024-09-14T12:09:53.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.746+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3vTKD16GWyCIARKRezB7Vkj4AMTGiR0_0 2024-09-14T12:09:53.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10880677110865677571', time=2024-09-14T13:50:08.306702+0000, chain.objs.size()=1 2024-09-14T12:09:53.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pP9cOsUHJAEpZFnBE33pMUdjANGl5De_0 2024-09-14T12:09:53.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11955689822882835837', time=2024-09-14T13:50:08.531891+0000, chain.objs.size()=1 2024-09-14T12:09:53.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xYO9aMLXi8xE_-quCA5SaIzaz6xvGld_0 2024-09-14T12:09:53.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.747+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18414845475644071031', time=2024-09-14T13:50:08.599308+0000, chain.objs.size()=1 2024-09-14T12:09:53.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.747+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-8wXDb97Bsk6pM2fuba_icSYX8TmxyL_0 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1300320417170519507', time=2024-09-14T13:50:08.918192+0000, chain.objs.size()=1 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nlIc-5I0BjkY1L8c2sebw45f9WvRChL_0 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1691350785979569703', time=2024-09-14T13:50:09.199822+0000, chain.objs.size()=1 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KdXRrhu-N6qj9iYAKYtGlgsD73f1fhY_0 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9987334555489193624', time=2024-09-14T13:50:09.608407+0000, chain.objs.size()=1 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.JcE5B1iQA9ZYcpd8ggq_ojDyrOIa5wT_0 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14732426989323454269', time=2024-09-14T13:50:09.874217+0000, chain.objs.size()=1 2024-09-14T12:09:53.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.748+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FR5ZZhgKR3U503IRMStaKqrqbPqBY4c_0 2024-09-14T12:09:53.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.750+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17190234871266138389', time=2024-09-14T13:50:16.955286+0000, chain.objs.size()=1 2024-09-14T12:09:53.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.750+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.274__shadow_.Mizhbf6FI_4UnAn0DXxrM8YiDTxDojb_0 2024-09-14T12:09:53.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.750+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14747211037430451958', time=2024-09-14T13:50:29.841722+0000, chain.objs.size()=1 2024-09-14T12:09:53.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.750+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.7H_bCQYj2NBV9eUxSepGgTLO7u5HMJ7_0 2024-09-14T12:09:53.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.750+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1506623097651245879', time=2024-09-14T13:50:29.872741+0000, chain.objs.size()=1 2024-09-14T12:09:53.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.750+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.ZsRB3riVU0BYHR2lO3-ppi4xmF0pu63_0 2024-09-14T12:09:53.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15377531199078125993', time=2024-09-14T13:50:33.719815+0000, chain.objs.size()=1 2024-09-14T12:09:53.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.296__shadow_.hF4y0c0qekYHvOuoGHYAioSkABOHSfd_0 2024-09-14T12:09:53.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2688814662453594647', time=2024-09-14T13:50:35.020588+0000, chain.objs.size()=1 2024-09-14T12:09:53.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.298__shadow_.rWTiMEVSPy1K8TM5W_KT12WVsE7V-3H_0 2024-09-14T12:09:53.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6571685649323047669', time=2024-09-14T13:50:37.049042+0000, chain.objs.size()=1 2024-09-14T12:09:53.751 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.301__shadow_.iQzOZ8udysnljfFW6dLzNWUrldsAaoZ_0 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17015258769892964540', time=2024-09-14T13:50:38.951783+0000, chain.objs.size()=1 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.304__shadow_.1weSq4DJz6WFJ75JYZmaWLvxOkxibUo_0 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.898998779509994071', time=2024-09-14T13:51:30.688328+0000, chain.objs.size()=1 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pOD1ikkaxJJH5uBvHJqPCQOkdSYXjt3_0 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17964109566939430266', time=2024-09-14T13:51:31.266574+0000, chain.objs.size()=1 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.sgf2Z2je7yQIyzLzBn7B8WuVvrhsfl__0 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8068727836912663460', time=2024-09-14T13:51:31.683745+0000, chain.objs.size()=1 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PlzZdIO867H9fWbgyvfYNAz1iN-ux6V_0 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9305483456155773986', time=2024-09-14T13:51:32.254784+0000, chain.objs.size()=1 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.752+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qWEUwqtVx_XsnKsJOhWwrG6pSmPhO2A_0 2024-09-14T12:09:53.752 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.753+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2794623480817185262', time=2024-09-14T13:51:32.277995+0000, chain.objs.size()=1 2024-09-14T12:09:53.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.753+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fYxpB9A5udNXgDPIQ37VKAwOLhnkd6d_0 2024-09-14T12:09:53.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.754+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15445823938298179995', time=2024-09-14T13:51:32.755260+0000, chain.objs.size()=1 2024-09-14T12:09:53.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.754+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PawnkuZVfqDInVZzL6XuYJfdTiZoIj9_0 2024-09-14T12:09:53.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.754+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4123460468457321020', time=2024-09-14T13:51:33.027191+0000, chain.objs.size()=1 2024-09-14T12:09:53.753 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.754+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ebNcXEDl_GNq6kJoe_1LJwizo5fGkW-_0 2024-09-14T12:09:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13412603108330107268', time=2024-09-14T13:51:33.039032+0000, chain.objs.size()=1 2024-09-14T12:09:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.P4q8YK93qIUeaelooh3yL2579Pt6RAy_0 2024-09-14T12:09:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11722383632031763354', time=2024-09-14T13:51:34.113046+0000, chain.objs.size()=1 2024-09-14T12:09:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fjC8YnC5XDsYQe86Zj8Emz004zC3hFW_0 2024-09-14T12:09:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16726998514896343711', time=2024-09-14T13:51:35.355322+0000, chain.objs.size()=1 2024-09-14T12:09:53.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DSEnjxc1XIa4tp7R3KcQJ7itUnO-xIh_0 2024-09-14T12:09:53.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4014991116077341551', time=2024-09-14T13:51:35.493848+0000, chain.objs.size()=1 2024-09-14T12:09:53.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.756+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Tw46_Y-x1L9D3Pnp8San_aXWUDC3Gcq_0 2024-09-14T12:09:53.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13330006059719286671', time=2024-09-14T13:51:35.612126+0000, chain.objs.size()=1 2024-09-14T12:09:53.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._jeQ8rr8qxVVxeQBaERiQKavH00Bh5H_0 2024-09-14T12:09:53.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14489278346478081281', time=2024-09-14T13:51:36.041151+0000, chain.objs.size()=1 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jWMjRmS3HEhzFZFyCtOC6fZL8DsQm-2_0 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5387748136587302723', time=2024-09-14T13:51:36.373882+0000, chain.objs.size()=1 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QeJRZKPVJUyEC8PAVUoreUwyJQXSuR1_0 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14724626404382488789', time=2024-09-14T13:51:36.820958+0000, chain.objs.size()=1 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kkgpumtNptZeWgoayykboNoSmo_BLft_0 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11196846904526331982', time=2024-09-14T13:51:37.513008+0000, chain.objs.size()=1 2024-09-14T12:09:53.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.757+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.unY8TQU55XjKldbwKdlsMD6GeoXv5j8_0 2024-09-14T12:09:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4082319619003929517', time=2024-09-14T13:51:37.513770+0000, chain.objs.size()=1 2024-09-14T12:09:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.w142ijbN2wRcQfS8XJZnuPgyUcaOb9V_0 2024-09-14T12:09:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12635714565423397618', time=2024-09-14T13:51:37.749025+0000, chain.objs.size()=1 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rU1nftHGQqvyo-O-M90-Z6Kv9-Y2dwK_0 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11709978363734203660', time=2024-09-14T13:51:37.857546+0000, chain.objs.size()=1 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vfMXNmxxWI5wM_NQSEkslKxhReNfPxK_0 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9223290545655203458', time=2024-09-14T13:51:37.897984+0000, chain.objs.size()=1 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._LSeb-9YOIHi6S4Ef4ePxEubt4dkqDA_0 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6028570567595994672', time=2024-09-14T13:51:38.901552+0000, chain.objs.size()=1 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.eDr4qNnOf_2-J8YoCXeMIZZx-VaCkDu_0 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11310850618979082025', time=2024-09-14T13:51:38.902394+0000, chain.objs.size()=1 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.760+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RCpeWSk0jWXkFwNFD67Cv11srrbLdcb_0 2024-09-14T12:09:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8772599139602450212', time=2024-09-14T13:51:39.977580+0000, chain.objs.size()=1 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qLriSnfLuC2cVbhguB7rdtV1hkGTe5C_0 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14328644182998594687', time=2024-09-14T13:51:39.997778+0000, chain.objs.size()=1 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.W5DT7ND60B7XZ3fB6vHwBZw4P6wSKc3_0 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10629323306878979815', time=2024-09-14T13:51:40.378253+0000, chain.objs.size()=1 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e9r7jOsAEni4C8nVyWWhOJoacpz8JjU_0 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11785556062298905159', time=2024-09-14T13:51:40.566826+0000, chain.objs.size()=1 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.761+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wsiYw1RM0ZZUm2Jlbx68fDzk7Dt3Auq_0 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.762+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10159656840227412409', time=2024-09-14T13:51:40.635898+0000, chain.objs.size()=1 2024-09-14T12:09:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.762+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vS1PyP9e5IruxxafTveMJEeMzEzxC9z_0 2024-09-14T12:09:53.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.763+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13222677002162411537', time=2024-09-14T13:51:40.728772+0000, chain.objs.size()=1 2024-09-14T12:09:53.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.763+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YBj-kaSDCvI66KVvBfvfxQI4Uz2c2Sh_0 2024-09-14T12:09:53.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.764+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13011454142591005750', time=2024-09-14T13:51:40.753325+0000, chain.objs.size()=1 2024-09-14T12:09:53.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.764+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bWB8zBnNnj27lohbiejsUhLpjiL8k1B_0 2024-09-14T12:09:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.764+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15926143104570014318', time=2024-09-14T13:51:41.049001+0000, chain.objs.size()=1 2024-09-14T12:09:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.764+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Jahl8lsod1rZroHBXl1ssI2jdPW_dnR_0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1112433824395679119', time=2024-09-14T13:51:41.049800+0000, chain.objs.size()=1 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LtWrpEmW-ofMl6uqWesyR-TNtHY6HCv_0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10532997938563927177', time=2024-09-14T13:51:41.050379+0000, chain.objs.size()=1 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.27R0G5sZtHkCUH-OlZS_JwqcVDtNTf__0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9146626566198791480', time=2024-09-14T13:51:41.085760+0000, chain.objs.size()=1 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ixvNf6NN0ZnN7R-pNbgQwea-26VrlG0_0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6779400816014312026', time=2024-09-14T13:51:41.086514+0000, chain.objs.size()=1 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Y8bhPmQUnzzq6JRCcyTefH9iTVJEJ4W_0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4624189796865811644', time=2024-09-14T13:51:41.892577+0000, chain.objs.size()=1 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dIKB03DUtIotJA4HhlBgmpnk_6v4mB7_0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11503974941736620550', time=2024-09-14T13:52:22.818816+0000, chain.objs.size()=1 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.snVYO7o7-otEUuTdIzymS90acRmqQ9r_0 2024-09-14T12:09:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10482219094191880746', time=2024-09-14T13:52:23.227832+0000, chain.objs.size()=1 2024-09-14T12:09:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.765+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SQS0_S6HQYPM1uJ1FFSMG9HiU23kfb6_0 2024-09-14T12:09:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3709995813107055797', time=2024-09-14T13:52:24.289971+0000, chain.objs.size()=1 2024-09-14T12:09:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mT9NpuGlZWd2LfBXGZiq3xkHOrVBkYd_0 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2420861506751856130', time=2024-09-14T13:52:24.915856+0000, chain.objs.size()=1 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cHR_roYtrpVCodHb8FlOii-OUR1NUud_0 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.417601976035755788', time=2024-09-14T13:52:26.393667+0000, chain.objs.size()=1 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dnHpms_YY2Jw0ikANPKC5H3hYfy3Pdc_0 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12254541142089205224', time=2024-09-14T13:52:26.793181+0000, chain.objs.size()=1 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6Kczhrezh_U7f1i-ADaS3schVQFOf6E_0 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13977847961034139893', time=2024-09-14T13:52:27.338755+0000, chain.objs.size()=1 2024-09-14T12:09:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.768+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DQbLmbb2H8Nwnwc2S2l2MGhmrnBeLVm_0 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11302855897849664892', time=2024-09-14T13:52:28.866998+0000, chain.objs.size()=1 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JJT-junBqRRRrQX2G_PqbSdSJBVG2qD_0 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14630808109701453625', time=2024-09-14T13:52:29.373895+0000, chain.objs.size()=1 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.baDHH2N_G8_oPzH4sKhGC_Va1hSZrnX_0 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8219575117119571377', time=2024-09-14T13:52:29.455598+0000, chain.objs.size()=1 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mf0-12L1H5nSHdBxNYqHKNJxrpIQ1Sm_0 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12782992504454643028', time=2024-09-14T13:52:30.038589+0000, chain.objs.size()=1 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.J5adbHPu-_BrLudEuT9zzYLAyXnwvrW_0 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8652057583360168631', time=2024-09-14T13:52:30.307047+0000, chain.objs.size()=1 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dkHitSxq6jRzECgwGVYkyDJIS0Mstit_0 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4270246142402209793', time=2024-09-14T13:52:30.626063+0000, chain.objs.size()=1 2024-09-14T12:09:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Cv0S10Y8Flkr5OS42zX4iK_CH0YJyJN_0 2024-09-14T12:09:53.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.772+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12745365573485206202', time=2024-09-14T13:52:31.795197+0000, chain.objs.size()=1 2024-09-14T12:09:53.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.772+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.woKE83MBglkeshaF_iAkj20oA6lCmsM_0 2024-09-14T12:09:53.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.772+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18295639024728521292', time=2024-09-14T13:52:31.850598+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.772+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bTaDv0vGab5AxB7VoFFCBDfDTvYANhk_0 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.772+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5994493156373022357', time=2024-09-14T13:52:32.020959+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.772+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9lnN5JUMA3Kw1zyX0b3NR7XIVZkXjbc_0 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4958438623741202365', time=2024-09-14T13:52:32.172835+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5MhHYCbnvcP3guxVkL60dOG-6Ve1Uk3_0 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2337639554836682998', time=2024-09-14T13:52:35.363992+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.330__shadow_.U6rIpVdwB2jJad9DHjWl1KxPer3ly-I_0 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6977626867550826586', time=2024-09-14T13:53:31.032228+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.431__shadow_.QUmm3GZtooF8OxTQ4IjJtmFPWD6DvjZ_0 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6898092255518690146', time=2024-09-14T13:53:36.453401+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.440__shadow_.h9efccEKbCIo5DctS2uNJqncP_Rbm5w_0 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2834025245748628375', time=2024-09-14T13:53:49.095672+0000, chain.objs.size()=1 2024-09-14T12:09:53.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.459__shadow_.v8NhyLPGZdylBh3hu0yQaYewqAdOLPU_0 2024-09-14T12:09:53.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17178327165938569689', time=2024-09-14T13:54:08.964150+0000, chain.objs.size()=1 2024-09-14T12:09:53.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.489__shadow_.GVuHwJloR1LimkcxLbssgcyWnwW3VxP_0 2024-09-14T12:09:53.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.777+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/43645 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11516812854065477048', time=2024-09-14T13:57:01.367958+0000, chain.objs.size()=1 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.536__multipart_mymultipart.2~U-k8sBgkKY4j0dJl96BNLSaMq9g0kgD.1 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10524553728409676714', time=2024-09-14T13:57:24.720883+0000, chain.objs.size()=1 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.553__shadow_.BlbDHLoiO16b9-Q-Asuw-PIvnubybtj_0 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8888267583521463973', time=2024-09-14T13:57:57.781909+0000, chain.objs.size()=1 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:g1rZcuE5AmmsKpAZuQWKjoEaVwU5qZo_.PM1Pk4ipUrXoxbOwVVLpxCifF_xZU1k_0 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18261726395510308573', time=2024-09-14T13:57:59.302036+0000, chain.objs.size()=1 2024-09-14T12:09:53.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:yzzHJKGFDGgRd0NhG.eJ.0gDk47xcuE_.dBe0w5BJtFpgngy7NobpI7xTxiwRsI3_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4960922996147914370', time=2024-09-14T13:58:23.867760+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:D.QwufjRFWIbUIphF9sgN1t0CMcUDgd_.DQbFrc3sXgaJtykLTNCBinUYuSimLL1_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7982375364064444259', time=2024-09-14T13:58:58.320049+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.582__shadow:U.V5ZfuUlgUZYTOJG8iqdN1.i0Xab27_.NyAfxWzrA-zo_ou8nye98r7ePkx3Vzn_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10401241252332721173', time=2024-09-14T13:59:01.241551+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.585__shadow:IsbxwgaJ0903cqWOPOLgOdot5x.fb7b_.Zrq292sM6kMdTXKNUEAEGijn-4mQuHE_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4783088026206497593', time=2024-09-14T14:03:19.360308+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.647__shadow_.PV8pV2G97rh5wHj49ECALQYl9K-1nQ8_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6253275742104722732', time=2024-09-14T14:03:22.453540+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.649__shadow_.nmnjaV3yisSUyDpN8omxqv1wi8254Il_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3117453193078105643', time=2024-09-14T14:03:53.802245+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.666__shadow_.gcJ_CMqQ_jLGVa24YvW924M-N1E2jmz_0 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13226378068868343805', time=2024-09-14T14:04:20.490568+0000, chain.objs.size()=1 2024-09-14T12:09:53.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.714__shadow:xqzbziHaHel8mHI4L4Sk2g0sCov1lf9_.T04E_eu8ysTlGiEniIP4DSu_NuicFjS_0 2024-09-14T12:09:53.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6462073946962013538', time=2024-09-14T14:05:17.624125+0000, chain.objs.size()=1 2024-09-14T12:09:53.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.748__shadow_.cSIJJQ5L_kKNm2siT4m6xT0EmnQb6pE_0 2024-09-14T12:09:53.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.785+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.791+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T12:09:53.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.792+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.793+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48493' 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_JkANZzRC4reSLdpBzLIJN5mvOKo0MND', time=2024-09-14T13:46:59.005841+0000, chain.objs.size()=1 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.163__shadow_.n33pSCLCO7CuiLyZGlXowuSC_DI4Efg_0 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17312837722998353286', time=2024-09-14T13:47:02.313431+0000, chain.objs.size()=1 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.166__shadow_.YcZ_pSxNaOqLY-TXA7Vpp96GgCoMLEU_0 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16893874551652878965', time=2024-09-14T13:49:04.393955+0000, chain.objs.size()=1 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.236__shadow_.Nn1RISjlmKlFUv_lh9BYVUiFTlF57Rn_0 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17735378741768767641', time=2024-09-14T13:49:12.723515+0000, chain.objs.size()=1 2024-09-14T12:09:53.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.248__shadow_.kfjkUBBZ9AHxzF9_LlGmMWZy-n8is4z_0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5384068521263378666', time=2024-09-14T13:49:14.608412+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.251__shadow_.kdywUTl28tTH5qE3esbYSJ99zMqFf6-_0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3674955853525990310', time=2024-09-14T13:49:18.389069+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.257__shadow_.y17rYQLBzUoZqkM3mPkpiAXWJOFWwP1_0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14161764005861186049', time=2024-09-14T13:49:18.965550+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.258__shadow_.tmcjvozgp71vnrwmuOmqKjLzZtUl53__0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6357937301301256739', time=2024-09-14T13:49:18.966084+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.258__shadow_.peF8qlJKkaUH9Cv9vAx8QCxNshMSg0l_0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10494609701503847809', time=2024-09-14T13:49:58.818389+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.47gnpj3NKHV50125XvuBlftcPX-IMFB_0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1091048018443184059', time=2024-09-14T13:49:59.404412+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2yqnUvgWRPzmzsytjUbwLxXlIZKTwJF_0 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18421920615604458616', time=2024-09-14T13:49:59.821079+0000, chain.objs.size()=1 2024-09-14T12:09:53.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mCvTkxowlmtNgkPs2xQ6RwLlsONs9vP_0 2024-09-14T12:09:53.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5307822232792609253', time=2024-09-14T13:50:00.487736+0000, chain.objs.size()=1 2024-09-14T12:09:53.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.noHHV0S7YA1up2r-YCx6vRUS77BcJVi_0 2024-09-14T12:09:53.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.796+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7678896630209168847', time=2024-09-14T13:50:00.633069+0000, chain.objs.size()=1 2024-09-14T12:09:53.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.796+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1SwmDez-q0j9uDB1x8nsMbUjzQMd7gy_0 2024-09-14T12:09:53.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17043436780473630370', time=2024-09-14T13:50:01.273510+0000, chain.objs.size()=1 2024-09-14T12:09:53.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TkeO3ddFM0FusFrRMJ16TfJcQQK4oxa_0 2024-09-14T12:09:53.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11371778821077685356', time=2024-09-14T13:50:02.108663+0000, chain.objs.size()=1 2024-09-14T12:09:53.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kKPdscfd6hbxeLr-kjq9oqwusq0jtXF_0 2024-09-14T12:09:53.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9456755080304711056', time=2024-09-14T13:50:02.163531+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.iAPxdJ79H7I4551MMdem0keDyZEoVDx_0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9744562045200679939', time=2024-09-14T13:50:02.293950+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EZQ0FYrYcd8UHkEPGx3fBYrri9cOuOJ_0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17860422137570949266', time=2024-09-14T13:50:02.335384+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Rh7ZFgjU9_eU0ngFvUzPjXSxcQ5WAbH_0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8963584564793669007', time=2024-09-14T13:50:02.335950+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mnZAbvwFiQ0_HYXCMbwtKBnxIQwfH84_0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18199318445339478844', time=2024-09-14T13:50:02.856759+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9LEwlgRrNBlEPmUYTBR7lQ67R31XYz__0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2203400658731721160', time=2024-09-14T13:50:03.450528+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.muv-XcbzshlmXstzfPn5BLBPwtz5AQF_0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15895528028870115620', time=2024-09-14T13:50:03.929855+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AlCw7Rsvg-SoHrXyUYs5i8yS0fvPpD5_0 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14501828764331276051', time=2024-09-14T13:50:04.233098+0000, chain.objs.size()=1 2024-09-14T12:09:53.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HNRTYVz8vxsFQkQlU5hrx1LNNwTS1xF_0 2024-09-14T12:09:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16820600399514228706', time=2024-09-14T13:50:04.342913+0000, chain.objs.size()=1 2024-09-14T12:09:53.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tp4kMyZrRYQnb4Pbein12-4oOHjmawT_0 2024-09-14T12:09:53.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.802+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13662386990700540350', time=2024-09-14T13:50:04.372970+0000, chain.objs.size()=1 2024-09-14T12:09:53.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.802+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zzC5F2gxbtNM4Q9ywfVu55-7GUhdTjn_0 2024-09-14T12:09:53.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.802+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3565652373314990263', time=2024-09-14T13:50:04.847559+0000, chain.objs.size()=1 2024-09-14T12:09:53.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.802+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.m4tp0EhIS_5UvNIYEO4f2ReErCA2tUL_0 2024-09-14T12:09:53.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.802+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9816039619935237286', time=2024-09-14T13:50:04.866492+0000, chain.objs.size()=1 2024-09-14T12:09:53.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.802+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qJjbFAKDvFRRtbMSsdbqitEyWnQvk4D_0 2024-09-14T12:09:53.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18421057219489780907', time=2024-09-14T13:50:04.867145+0000, chain.objs.size()=1 2024-09-14T12:09:53.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.npTjHiGMs_T5084ctzMnV6v1RzqccDe_0 2024-09-14T12:09:53.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6159513664690529396', time=2024-09-14T13:50:05.078855+0000, chain.objs.size()=1 2024-09-14T12:09:53.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sJQ-av3FuBt9Y2pg8MQGbrDSfx6_j-X_0 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18227714588278674955', time=2024-09-14T13:50:05.530265+0000, chain.objs.size()=1 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Z-yhrEHEvK8whkqL1TaIrxUTLj-ztCe_0 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1799843116614396272', time=2024-09-14T13:50:05.843173+0000, chain.objs.size()=1 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oGxAwZSkK33fnRNQcEFs5NErO4ARbRd_0 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4066141379242752950', time=2024-09-14T13:50:05.856287+0000, chain.objs.size()=1 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OcuKl9RaP_0PtqN02EaYqGwnx8lXHaQ_0 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9965631144957185323', time=2024-09-14T13:50:06.531284+0000, chain.objs.size()=1 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ayRcUMHIownagpTUC6IxJY8O7nU4EFQ_0 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14005375341255026248', time=2024-09-14T13:50:06.532479+0000, chain.objs.size()=1 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.R3_aaUhdEEUIpk40P_KLT2Emll92RD2_0 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5195773314987310544', time=2024-09-14T13:50:06.533157+0000, chain.objs.size()=1 2024-09-14T12:09:53.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lQ-RTaYE_KW2WedHcPmn21Lkd-EzDPv_0 2024-09-14T12:09:53.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.805+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6834261670050181554', time=2024-09-14T13:50:06.682455+0000, chain.objs.size()=1 2024-09-14T12:09:53.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.805+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.x7_R0DMXid_T8ULsO6ru496Fnf-FG-U_0 2024-09-14T12:09:53.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.807+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2829483243635239519', time=2024-09-14T13:50:07.123097+0000, chain.objs.size()=1 2024-09-14T12:09:53.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.807+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XcYrt0HXW_Ut1su41JqwGK4ol5wWm6u_0 2024-09-14T12:09:53.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.807+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11959236993263804766', time=2024-09-14T13:50:07.252182+0000, chain.objs.size()=1 2024-09-14T12:09:53.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.807+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.X-ebPqtie2OPH7XhgPDpwxL24wFsp1o_0 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6371027940073424089', time=2024-09-14T13:50:07.584663+0000, chain.objs.size()=1 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SWFagn3mOa8Gr5dwu2M276wOZFt0ZWE_0 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16122430785690042541', time=2024-09-14T13:50:07.585370+0000, chain.objs.size()=1 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ALx0aP1ySVPY5DYeIqfouVB8N0G1wEn_0 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15362769199358279255', time=2024-09-14T13:50:08.306893+0000, chain.objs.size()=1 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FnR32A2GlNCDtJBAI51ra9FIXGBfFS1_0 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8454981438858786034', time=2024-09-14T13:50:08.519726+0000, chain.objs.size()=1 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5PK-vMJtwvBcuYugtBftcbB-PI9XMi4_0 2024-09-14T12:09:53.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3296670197673636865', time=2024-09-14T13:50:09.204088+0000, chain.objs.size()=1 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UKz1tOdHsb_Z3wgPYgnHv-CkP0L_aEz_0 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4469719262484368654', time=2024-09-14T13:50:10.474716+0000, chain.objs.size()=1 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.263__shadow_.r0DLjZrAA4NmHtID5ZYeSUQtqbJwdcx_0 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3801191389107212596', time=2024-09-14T13:50:25.927209+0000, chain.objs.size()=1 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.288__shadow_.82kyysSY8ifr8v9dJmfQodWHRNFXIAJ_0 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17805673589218769826', time=2024-09-14T13:50:29.866917+0000, chain.objs.size()=1 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.IjPfALjrSOSBu212IDPD0TvMt2FpFv4_0 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5063579313911322461', time=2024-09-14T13:50:29.881506+0000, chain.objs.size()=1 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.809+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.YDZI5OBpFCjprCpB8D61wxzEWK3Za8r_0 2024-09-14T12:09:53.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.811+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15780732745750322553', time=2024-09-14T13:50:32.398484+0000, chain.objs.size()=1 2024-09-14T12:09:53.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.811+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.294__shadow_.Uevf6m8wFy5cvB5Can9O6X22lC-SJES_0 2024-09-14T12:09:53.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.812+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3836254556725673654', time=2024-09-14T13:50:50.597995+0000, chain.objs.size()=1 2024-09-14T12:09:53.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.812+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.321__shadow_.Ku8BtFDHerYAK1KWFCKf0NTIRByDhsY_0 2024-09-14T12:09:53.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5440194815711267910', time=2024-09-14T13:51:30.694125+0000, chain.objs.size()=1 2024-09-14T12:09:53.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DOzcxixxGKfOVoJUS2XzpocUtDY3-F-_0 2024-09-14T12:09:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13506401003904356191', time=2024-09-14T13:51:32.277852+0000, chain.objs.size()=1 2024-09-14T12:09:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vIPWGwSzA3FZWap8Onm4h-fy27Pavmw_0 2024-09-14T12:09:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12569458642335613185', time=2024-09-14T13:51:32.558236+0000, chain.objs.size()=1 2024-09-14T12:09:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e8FEyZzHFgb3hdxzHVEt6Iy7MvRhKL7_0 2024-09-14T12:09:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15951921163134292832', time=2024-09-14T13:51:32.569699+0000, chain.objs.size()=1 2024-09-14T12:09:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OWTY-0hgHzP2H1o22jcvAnua8fDD4d9_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2876265933264090146', time=2024-09-14T13:51:32.570279+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bJurS6RZJMzzNIH-6EvtqI3Zu-ieaCf_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9196536952797592481', time=2024-09-14T13:51:32.731945+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6z26OMFSbj39LC-1HqAugI0cRRJQn1Y_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7951135144540125484', time=2024-09-14T13:51:32.741890+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4O9Lcp0ZHKxtrZcY9Q9dS-pjJFklRxq_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15594449171868711669', time=2024-09-14T13:51:32.840453+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.HkwAJ82OqaWI0QRI3vAoY3Jh1Dg_k8-_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17526020275518260053', time=2024-09-14T13:51:32.892997+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DRBKUgj8dV9AvP2AxYBYbt7gr79RKyB_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7794499122241770525', time=2024-09-14T13:51:32.987339+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OqFxoIwLUR3_8_SKTaebQ_Uc0vyI7F8_0 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9340610099592641624', time=2024-09-14T13:51:33.116651+0000, chain.objs.size()=1 2024-09-14T12:09:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.815+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.f6i0w8TPO4CaJDAsk_qoptWaXa4NpQe_0 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16928523481466442688', time=2024-09-14T13:51:33.170612+0000, chain.objs.size()=1 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PYvXjOLV--kNRhyD8JzStWDaVnGVtMJ_0 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15824560953648261333', time=2024-09-14T13:51:33.828694+0000, chain.objs.size()=1 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cy86Z3qyhD03-ryA9DdxI_9_LQIVmve_0 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3661459388708166414', time=2024-09-14T13:51:33.995504+0000, chain.objs.size()=1 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5E3WQdI36E_QvhVZf6HyMiCMMlXfiIo_0 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4783930982411863648', time=2024-09-14T13:51:34.201418+0000, chain.objs.size()=1 2024-09-14T12:09:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.819+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2cdv-b3d2w6q5ptInfEJheUo5UnOXM__0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8484409616828249844', time=2024-09-14T13:51:34.247688+0000, chain.objs.size()=1 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pFVLsN0ekp5bZD0ropqe8Hs7uu0vnWu_0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9818682482170398403', time=2024-09-14T13:51:34.398312+0000, chain.objs.size()=1 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._KWMD-SW4qVb_n9eul7N0YxS8XD2Mqg_0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15693253193796786779', time=2024-09-14T13:51:34.531632+0000, chain.objs.size()=1 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pzHPTG-ptqman6GiCOkeiW97d-QNz05_0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4291068639658345264', time=2024-09-14T13:51:34.593307+0000, chain.objs.size()=1 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.q0pTkp2k_ipd8nokFK3MkbCw7d9Orz4_0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3874769436182484144', time=2024-09-14T13:51:34.729993+0000, chain.objs.size()=1 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jPq0poO3QsCciM55DLI3EUYxJb-ippe_0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9395442454149999389', time=2024-09-14T13:51:35.500498+0000, chain.objs.size()=1 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DUp76cIVUz5PnkBEj4VD9h-3yItx3Ql_0 2024-09-14T12:09:53.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3304290276611509077', time=2024-09-14T13:51:36.164107+0000, chain.objs.size()=1 2024-09-14T12:09:53.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.820+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YILBT76NU7T0KPNUm9v581hrblxziKL_0 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6264570643145491099', time=2024-09-14T13:51:36.374383+0000, chain.objs.size()=1 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ph_w1WtHNz961f6nYrFFlxNIL2pPC65_0 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4403666961094553581', time=2024-09-14T13:51:36.412248+0000, chain.objs.size()=1 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8-iqJbcUt99hptnW28xCQDGBh9dRuyR_0 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3502223739801287393', time=2024-09-14T13:51:36.823194+0000, chain.objs.size()=1 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qBxMzoNi99R1jV10DZ-rF_e5H-ke1hG_0 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5308219902631511693', time=2024-09-14T13:51:36.845158+0000, chain.objs.size()=1 2024-09-14T12:09:53.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.824+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DHZnMXauB7CYmvK2Ay9MHjapS1SmSFd_0 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11922022790406463622', time=2024-09-14T13:51:37.067791+0000, chain.objs.size()=1 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TKOU7mUtaXDU2f460HP__VZdekYHOBi_0 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16067210949035914562', time=2024-09-14T13:51:37.107348+0000, chain.objs.size()=1 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ccvpe8ksgCVf564oK011D1qmq6-fn2J_0 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17836875396402485790', time=2024-09-14T13:51:37.161048+0000, chain.objs.size()=1 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MF8eM4sF2QSe4sWXoGljmU10rdAEi9f_0 2024-09-14T12:09:53.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1024642212708782944', time=2024-09-14T13:51:37.161893+0000, chain.objs.size()=1 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.KnZAw3P4KR67ntQN2AktBWURLzi3OQT_0 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14245418329075098454', time=2024-09-14T13:51:37.374533+0000, chain.objs.size()=1 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0gHPMD61fXuyRwMHlwZltrodoPsTAAU_0 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2670091044092820445', time=2024-09-14T13:51:37.379707+0000, chain.objs.size()=1 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jxt9Ytyxcw0WInRNWUIoAe9Zxoi1klE_0 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.825+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4989277739573394353', time=2024-09-14T13:51:37.592140+0000, chain.objs.size()=1 2024-09-14T12:09:53.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.826+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.q6indKOChKP54FPm19cBODACoxGsa1Q_0 2024-09-14T12:09:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.829+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12385307328096421808', time=2024-09-14T13:51:37.768938+0000, chain.objs.size()=1 2024-09-14T12:09:53.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.829+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VrCCqX7qsNMyR2RJfSqwR24OmgV14lm_0 2024-09-14T12:09:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.830+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3659751110080216309', time=2024-09-14T13:51:38.468326+0000, chain.objs.size()=1 2024-09-14T12:09:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.830+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9XYdAaQW0lnFQkzgcCdGqCS_pDV_vtf_0 2024-09-14T12:09:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.830+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12648315103789648149', time=2024-09-14T13:51:39.262737+0000, chain.objs.size()=1 2024-09-14T12:09:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.830+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mc6oY6Qx6bNxTlphB8cl2KHhMm8QCXp_0 2024-09-14T12:09:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.830+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13945679838776536195', time=2024-09-14T13:51:40.127245+0000, chain.objs.size()=1 2024-09-14T12:09:53.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.830+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5yGn7HjqGWo1tfa0fmEoZ1JZoDN6T8B_0 2024-09-14T12:09:53.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10078654312850545601', time=2024-09-14T13:51:40.168354+0000, chain.objs.size()=1 2024-09-14T12:09:53.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XwNixkVWa5XEODGGO3f7MrPfMnlspE5_0 2024-09-14T12:09:53.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13514814912827214824', time=2024-09-14T13:51:40.317164+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lrrxVSQ0Q6AEQ1qGiPiG77kSDVTh18L_0 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17638181069507158250', time=2024-09-14T13:51:40.731490+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.FGnOmyc__0W9Z6dIzMsg-1mdachOAUX_0 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9056010424475912653', time=2024-09-14T13:51:41.846607+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5qrR1w-BqIjaYqoaROZNjgT5nl0kAON_0 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5366109344343925192', time=2024-09-14T13:52:21.411300+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fIDljh0jOAvnL9lGZ_vnY1SwfLM06pR_0 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13051308652157968941', time=2024-09-14T13:52:23.027692+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.HKCfzDDDS149kc8FXTtxvuaL7jtjLjj_0 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7237131805862452536', time=2024-09-14T13:52:23.177322+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.831+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ofxj-_66t0fTDjR3gRqjmgqW-D80rfV_0 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.832+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14861326406874271636', time=2024-09-14T13:52:23.708759+0000, chain.objs.size()=1 2024-09-14T12:09:53.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.832+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nmpQ1e8KQPNeYsZWp3l8E9Z7aHWPylK_0 2024-09-14T12:09:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.834+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10422187168587407813', time=2024-09-14T13:52:24.691035+0000, chain.objs.size()=1 2024-09-14T12:09:53.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.834+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TM4tT5-wL4TjpZ7eBbGgdn-hLbAAKXU_0 2024-09-14T12:09:53.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.834+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11724843505753307535', time=2024-09-14T13:52:24.740326+0000, chain.objs.size()=1 2024-09-14T12:09:53.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.834+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ElfVDb32uVHb_qnsrw39RzwuwZb8MRR_0 2024-09-14T12:09:53.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.835+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17644847458526289109', time=2024-09-14T13:52:24.903666+0000, chain.objs.size()=1 2024-09-14T12:09:53.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.835+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._lweJwjgGOMbjhVDqcwdTOd3Hgq3hr8_0 2024-09-14T12:09:53.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.836+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4589432450491844603', time=2024-09-14T13:52:24.950390+0000, chain.objs.size()=1 2024-09-14T12:09:53.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.836+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WCSV9btIzEYcPGKG0KRJQiXqqbIFEk8_0 2024-09-14T12:09:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.837+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14928208719336705274', time=2024-09-14T13:52:25.057221+0000, chain.objs.size()=1 2024-09-14T12:09:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.837+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IigBgvC2jHL6A__zFZQuwpgNnRYkD-V_0 2024-09-14T12:09:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.837+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.192786733538809666', time=2024-09-14T13:52:25.117897+0000, chain.objs.size()=1 2024-09-14T12:09:53.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.837+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sjKQZzJgC6Ws3V5JcB5Qd-UoFsGBFC7_0 2024-09-14T12:09:53.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.840+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48493 2024-09-14T12:09:53.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T12:09:53.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16237573570890638709', time=2024-09-14T13:52:25.207757+0000, chain.objs.size()=1 2024-09-14T12:09:53.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.OGH8dti91ccbfYzu203R8CcJAv-bEYM_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13481637796071703664', time=2024-09-14T13:52:25.246116+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.aWKmQt_K70nbIu0R1o98zetyDB_Cuuf_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3098228457634107538', time=2024-09-14T13:52:25.717984+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iGpG5E1WSGnlHnvfqm1DK6O-QQ-6zu4_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3300390207481081852', time=2024-09-14T13:52:26.394047+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ihPetgVsM-uGZlxEzxmV3h01cXH7hle_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4648550294675981734', time=2024-09-14T13:52:27.640168+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.REJS-XIad_ExNgBpa0K2bK794Jgn8P5_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8606893892175451893', time=2024-09-14T13:52:28.051436+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VKoOJayhWDDIgTQCBFJRq8L2cyqwyjN_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11595214159240983215', time=2024-09-14T13:52:28.669244+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yXokH756ajqo6TmCvQ3KRwoQ5t4_J-9_0 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9172614772714916021', time=2024-09-14T13:52:29.121426+0000, chain.objs.size()=1 2024-09-14T12:09:53.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4GEC7jL3Rp5vO6Yfy8l-UFWloru-hrn_0 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4963191826081659218', time=2024-09-14T13:52:29.303575+0000, chain.objs.size()=1 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cToC9NHq3uBktqHd45sYXTZur6bDlI1_0 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10654181865879245995', time=2024-09-14T13:52:29.555920+0000, chain.objs.size()=1 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ccmIYy4Dwq-0NDgqfY6wQVn9Ds6KwQN_0 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.303859457768120035', time=2024-09-14T13:52:29.578139+0000, chain.objs.size()=1 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BNE-qaPVaKVcUrSCPUUfXaJzc_eqbEL_0 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7645800663200775651', time=2024-09-14T13:52:29.674543+0000, chain.objs.size()=1 2024-09-14T12:09:53.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.842+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YwCRQQFgyOpIQEQ31ZtNMcge0Pv4ewP_0 2024-09-14T12:09:53.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.847+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16596893535688654433', time=2024-09-14T13:52:30.044521+0000, chain.objs.size()=1 2024-09-14T12:09:53.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.847+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.O0z6QzBr8CKmsw9NRdETkVFBO3wbCpe_0 2024-09-14T12:09:53.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.847+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17234742578372446323', time=2024-09-14T13:52:30.045648+0000, chain.objs.size()=1 2024-09-14T12:09:53.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.847+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.G5MH-BE8plpXpkG7AA9D8k700imN5Z8_0 2024-09-14T12:09:53.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.847+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.835190057743580666', time=2024-09-14T13:52:30.237282+0000, chain.objs.size()=1 2024-09-14T12:09:53.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.847+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RKapwqwuVrmtzcVwv9sLzzJH4fNkfrl_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2752896675127656832', time=2024-09-14T13:52:30.347114+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.b6_Qb6XqnU_L8e-o_qEHEb_ovPbmp5I_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6147355921590200194', time=2024-09-14T13:52:30.578522+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8pub3fWnEulsNHIePuwoZdWZr6Bthbw_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2318367885770284578', time=2024-09-14T13:52:30.778525+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BhLAlYu6kdN5fv6UTDwjCwe6KhMRUDs_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6489846651192166060', time=2024-09-14T13:52:30.981118+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KOhHJ9AzIWuPsZzKMb9bG1mtsw0QmBb_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15629691803952563096', time=2024-09-14T13:52:31.071408+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wMu-VIhBUem6V1NwuKKmL5wcMaxJe33_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3663196776704773740', time=2024-09-14T13:52:31.327493+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.93pHrZ4NtxM2juQUmukoyavLMq9pg5m_0 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8445621613968825908', time=2024-09-14T13:52:31.656054+0000, chain.objs.size()=1 2024-09-14T12:09:53.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.NCynFReS5zqKuBg6_VaQaerS73gAFrs_0 2024-09-14T12:09:53.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14334997799314231555', time=2024-09-14T13:53:37.101009+0000, chain.objs.size()=1 2024-09-14T12:09:53.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.848+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.441__shadow_.g455idKrW-f5PAHL1se38UpRktdAwI7_0 2024-09-14T12:09:53.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.850+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9385586107827767974', time=2024-09-14T13:55:08.706448+0000, chain.objs.size()=1 2024-09-14T12:09:53.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.850+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.520__shadow:0XjaWrPEtG8CteahOzHvuQR12ZHh6Yt_._2Os7a-TIMuffBMPz5xuzb7zMDGHZRm_0 2024-09-14T12:09:53.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.851+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17571743321851019213', time=2024-09-14T13:55:26.736343+0000, chain.objs.size()=6 2024-09-14T12:09:53.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.851+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.GZ0YzPmkMKhZC8idZyeghsz_h_9B1tOK.1 2024-09-14T12:09:53.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.851+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH.2 2024-09-14T12:09:53.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.851+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH.3 2024-09-14T12:09:53.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.851+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH.4 2024-09-14T12:09:53.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH.5 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH.6 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4302446642524143372', time=2024-09-14T13:58:34.870803+0000, chain.objs.size()=1 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:Lohf9ZlCC8MlI8ycTbaSGDoci-wSXG._.ZK_9txiAXK6GfjVcUhX76M_DvnCw8Qh_0 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7837383789308108830', time=2024-09-14T13:59:08.198495+0000, chain.objs.size()=1 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.596__shadow_.8iyn6sy8-WdhEflSfD3un3VIzTSqGwH_0 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13153972980098066722', time=2024-09-14T14:04:30.956908+0000, chain.objs.size()=1 2024-09-14T12:09:53.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.853+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.715__shadow:Y7m18nxhTmy9pgbdVQlRX5ehIJSrS3j_.X4qYBS8TyUWm7mNUsqGno9RyVupGUw2_0 2024-09-14T12:09:53.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.856+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.859+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T12:09:53.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.860+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44922' 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18240286841916475829', time=2024-09-14T13:48:59.685390+0000, chain.objs.size()=1 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.228__shadow_.qwmw5_cD8903sK494kO28Go8RHSNg08_0 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11749581033775526282', time=2024-09-14T13:49:03.723441+0000, chain.objs.size()=1 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.235__shadow_.sYBNvCfX20nBAe-r1-9pMt_GR7xq2Tm_0 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16170140729507041285', time=2024-09-14T13:49:19.550495+0000, chain.objs.size()=1 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.259__shadow_.Mo8V-N8Zq_0o_pMqsCWFzpcE_Hdd5Kh_0 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2030368569258723679', time=2024-09-14T13:49:20.211670+0000, chain.objs.size()=1 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.260__shadow_.IV-kf9iwOe3cuKclJ2ppajL56xjfF9p_0 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7188018339501806629', time=2024-09-14T13:49:59.342969+0000, chain.objs.size()=1 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.01AXPyQgWC58t9W_aENBEnmSRRbdPax_0 2024-09-14T12:09:53.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2076281506171538911', time=2024-09-14T13:49:59.442681+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UNMpgpK0L5eU5Oh0YFFiop-t4nfNP2K_0 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8147367229020909184', time=2024-09-14T13:49:59.780383+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.imMM92KKkeD8mmRBLswqVPfNI38wJks_0 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7234089478478010271', time=2024-09-14T13:49:59.825117+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1nss2lqJ5DPY-0153nNXKZXh9q9LDKX_0 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16739786744802220054', time=2024-09-14T13:49:59.873113+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LY40SNo60bbU1aV5cSl2pTnaR-Anh0k_0 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8128290765598204817', time=2024-09-14T13:50:00.628765+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rQs8qfdykpquQFB23Y7_hwxRnlwATJs_0 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2066729815001105953', time=2024-09-14T13:50:00.667354+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5C28FUWm1h6FI5fpqldiGty7xnH4LmY_0 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17231602320672346352', time=2024-09-14T13:50:00.778693+0000, chain.objs.size()=1 2024-09-14T12:09:53.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.861+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.JwiCrT_qsdwe2PV3u_KSdmo2Qy0GxxP_0 2024-09-14T12:09:53.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.863+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16965199494940239790', time=2024-09-14T13:50:00.928996+0000, chain.objs.size()=1 2024-09-14T12:09:53.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.863+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UeyjwltIQLeEvlpuBHEe5KYKVQQwinx_0 2024-09-14T12:09:53.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3126370293569642583', time=2024-09-14T13:50:01.443276+0000, chain.objs.size()=1 2024-09-14T12:09:53.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jmbZdTVa1JCC-TPR-umnACImw0uigGI_0 2024-09-14T12:09:53.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8591969444783821164', time=2024-09-14T13:50:01.980810+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.s1JRwgszQCx60mjUWuodJIWNvaFQdgD_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1639945393317806933', time=2024-09-14T13:50:02.091535+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6jfG9Kwomt_SIk2loCJNaZuYh3U8PBd_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12003340373279805960', time=2024-09-14T13:50:02.130289+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qaS3eXU1FZU7looSTDtjiKPmA1FZxRo_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7729372064979696367', time=2024-09-14T13:50:02.292204+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BLywh-9LevFsvsibpO1Vw8YUfFJMmEe_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15351072189595172097', time=2024-09-14T13:50:02.605660+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Sdj3nQ6yUBnZ79iySaMABajMK_aF9bX_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15701205450252246290', time=2024-09-14T13:50:02.606543+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PYe6pN-84RcaatfagSpER8Fcg6SeKMR_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8581838388056124730', time=2024-09-14T13:50:02.942437+0000, chain.objs.size()=1 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZCNR4coDk6mE5Mq4sj-_S9pKoxxsveV_0 2024-09-14T12:09:53.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12441505340469439440', time=2024-09-14T13:50:02.995283+0000, chain.objs.size()=1 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cPuiorbylHtrjFU8BsyGbiAGUG6Z77M_0 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16067462120688914248', time=2024-09-14T13:50:03.430993+0000, chain.objs.size()=1 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9FqdVkWfuhI84gt_NedFwjNv8aCsisb_0 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12155228428843808480', time=2024-09-14T13:50:03.446633+0000, chain.objs.size()=1 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.866+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1zC1blXQcADPBK8fVPGcQYqTdB1iivE_0 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.868+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8232653019066568790', time=2024-09-14T13:50:04.220575+0000, chain.objs.size()=1 2024-09-14T12:09:53.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.868+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.d9KTpdij_ZWCmZNHuUpyD5URs3gicEl_0 2024-09-14T12:09:53.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3196223511846469418', time=2024-09-14T13:50:04.425241+0000, chain.objs.size()=1 2024-09-14T12:09:53.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hfZZ6tKn4QweAYtUCfgz2f2KcgaCmic_0 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9087933534111815869', time=2024-09-14T13:50:04.986589+0000, chain.objs.size()=1 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.uThbsBgwq79LQL6E5vq9rlVaUMTZYMG_0 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14079992205166996069', time=2024-09-14T13:50:04.988232+0000, chain.objs.size()=1 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lcnomBRRqZuIxbbYG8f4O9dqLSxPWI6_0 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5486515494240126958', time=2024-09-14T13:50:05.151342+0000, chain.objs.size()=1 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dTXqlFrTkatgO3VYzv5MLxgmUG-cKDr_0 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12575463206075103080', time=2024-09-14T13:50:05.273415+0000, chain.objs.size()=1 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NBtgvOQDEa_z30YtuUDiHVIxJT4Noq7_0 2024-09-14T12:09:53.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5670858230227214202', time=2024-09-14T13:50:05.300837+0000, chain.objs.size()=1 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Yj2zT9RUsncnLN8xhtd5aER7GV8RanG_0 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9911180502162863755', time=2024-09-14T13:50:05.469168+0000, chain.objs.size()=1 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GrAcPNcqf5cWeBYJIf5UQ8P9-MKf_Zy_0 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7264864577321681523', time=2024-09-14T13:50:05.592509+0000, chain.objs.size()=1 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.870+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9B0sdVAk-bF5t8BKegbQ-yCsJiYgZIh_0 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.871+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9307121294621365238', time=2024-09-14T13:50:05.781536+0000, chain.objs.size()=1 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.871+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Ok3oKLvBwl-59UCs_m9VdNLMQvWwtPi_0 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.871+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10842557895482380031', time=2024-09-14T13:50:06.285296+0000, chain.objs.size()=1 2024-09-14T12:09:53.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.871+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6QDVws2apaPqe63HDi8w0xHZUGMy4cw_0 2024-09-14T12:09:53.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.873+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6552227295894752700', time=2024-09-14T13:50:06.313347+0000, chain.objs.size()=1 2024-09-14T12:09:53.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.873+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.bgciVwRTek6aPMUDBsHHJc5teJl8YR-_0 2024-09-14T12:09:53.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7980541841062557935', time=2024-09-14T13:50:06.381947+0000, chain.objs.size()=1 2024-09-14T12:09:53.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._vzhir1Q9_xonWeDw_JO9OmjicdcsGK_0 2024-09-14T12:09:53.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5248218080688372108', time=2024-09-14T13:50:06.664252+0000, chain.objs.size()=1 2024-09-14T12:09:53.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._pvVB558IZ8lWv_cFdANHUlheCycyF8_0 2024-09-14T12:09:53.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5145781978358933708', time=2024-09-14T13:50:06.769948+0000, chain.objs.size()=1 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.c2BiFZfbAirBcu0sZv496SK1ams1Lwu_0 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11189212551152948679', time=2024-09-14T13:50:06.985638+0000, chain.objs.size()=1 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Di-__lI4RT4Trn2zMa3D3_hkwJdnb-U_0 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6395275071334680309', time=2024-09-14T13:50:07.068245+0000, chain.objs.size()=1 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EXjuQHEGgQ0cZNynWzVWwH0r_OX4zYX_0 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8807737364509260879', time=2024-09-14T13:50:07.564621+0000, chain.objs.size()=1 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.874+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.V-EsTiZB9RVF0vtkmPhI0i33Vp6F_lp_0 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15782569036880292794', time=2024-09-14T13:50:07.565355+0000, chain.objs.size()=1 2024-09-14T12:09:53.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XLT7x3iKyc7uayV_DaDSg3mCWkiqAw6_0 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17362321250932077865', time=2024-09-14T13:50:07.566098+0000, chain.objs.size()=1 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PkiIA3doDbpuASBi4lYrkZC1Fwr3fUu_0 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3711087260884856194', time=2024-09-14T13:50:08.599810+0000, chain.objs.size()=1 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yu9aYPwh5dboEYThZmAbTDQvOW5OET7_0 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11374702782532159167', time=2024-09-14T13:50:09.076458+0000, chain.objs.size()=1 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.875+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NZqaEVnuER1a_1u9eitzHxDnJKyGqj9_0 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.876+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8616889853944634197', time=2024-09-14T13:50:09.424252+0000, chain.objs.size()=1 2024-09-14T12:09:53.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.876+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HmW-GvekgldJREVPeOTZknudaLotuxk_0 2024-09-14T12:09:53.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.878+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8616632884040411411', time=2024-09-14T13:50:14.014593+0000, chain.objs.size()=1 2024-09-14T12:09:53.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.878+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.269__shadow_.srlE0E31d1YSoc8YOqjyruGnFFn42Fo_0 2024-09-14T12:09:53.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.878+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11897804826496360048', time=2024-09-14T13:50:17.593726+0000, chain.objs.size()=1 2024-09-14T12:09:53.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.878+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.275__shadow_._jVgSZbBAbLCKt_fRtDhDk3hpqXvpUD_0 2024-09-14T12:09:53.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.879+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.354654292428539504', time=2024-09-14T13:50:21.390555+0000, chain.objs.size()=1 2024-09-14T12:09:53.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.879+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.281__shadow_.yCJwA0M5QeiIzjf8kPV2QLduuXvBQ3x_0 2024-09-14T12:09:53.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9184714043672910939', time=2024-09-14T13:50:23.311866+0000, chain.objs.size()=1 2024-09-14T12:09:53.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.284__shadow_.yZXDW41rm8Z_5NNCFcvLr_6kJS2XI4Q_0 2024-09-14T12:09:53.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17596668290155277159', time=2024-09-14T13:50:31.679447+0000, chain.objs.size()=1 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.Tflv13I6ow4T2dAnTV3ULobl7W72y89_0 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14962671879623582232', time=2024-09-14T13:50:31.759882+0000, chain.objs.size()=1 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.c7QhcQOTjsGxz7iMoFavLFbLb3xKKoD_0 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9333216532560067299', time=2024-09-14T13:50:39.578957+0000, chain.objs.size()=1 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.305__shadow_.J9RdhQ0yl63oTMbzPY5TxNd0JmCJKei_0 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16054636242952613168', time=2024-09-14T13:50:39.579831+0000, chain.objs.size()=1 2024-09-14T12:09:53.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.305__shadow_.PVx9CJe6tcolzuqnKqllz1-81Q-hpII_0 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13703291529204066927', time=2024-09-14T13:51:30.700676+0000, chain.objs.size()=1 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.slv5OEF1LBOWn7DPzP8u_AWGGoONKIk_0 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4874265838082890370', time=2024-09-14T13:51:30.791246+0000, chain.objs.size()=1 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3cnqfwaZVtGRJEL4w2ADlDbDgBJIDSz_0 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12718219718194816633', time=2024-09-14T13:51:30.828362+0000, chain.objs.size()=1 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.awRA_trBLPwYIGml4ShRRDO7cNHbkN7_0 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7875198158412101208', time=2024-09-14T13:51:30.886919+0000, chain.objs.size()=1 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.880+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GhFiDH2lVbIYk-l87q19f7HHte9ZUu3_0 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.881+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15028343843650634222', time=2024-09-14T13:51:31.039934+0000, chain.objs.size()=1 2024-09-14T12:09:53.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.881+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rvkFs8t7yeqBHf7jED3WHC_M_yynePg_0 2024-09-14T12:09:53.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.883+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10860273605980459183', time=2024-09-14T13:51:31.458140+0000, chain.objs.size()=1 2024-09-14T12:09:53.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.883+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bVSeLd1sKsSrflFzu07rLy5OqDluWfu_0 2024-09-14T12:09:53.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15725016411286445074', time=2024-09-14T13:51:32.444567+0000, chain.objs.size()=1 2024-09-14T12:09:53.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.NSutKvOXNAPKJct2VXg0F4nuVskVRgj_0 2024-09-14T12:09:53.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13333959358943442407', time=2024-09-14T13:51:32.506208+0000, chain.objs.size()=1 2024-09-14T12:09:53.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.r4yDpIC9MZGIpzVuqIvVI44fICW3O4m_0 2024-09-14T12:09:53.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3257599008224459919', time=2024-09-14T13:51:32.506752+0000, chain.objs.size()=1 2024-09-14T12:09:53.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gkXRS2jUc3I_zXDCFjKV-_5wBnvvUs-_0 2024-09-14T12:09:53.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15977679627904438174', time=2024-09-14T13:51:32.575799+0000, chain.objs.size()=1 2024-09-14T12:09:53.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fXy7xT3Vh8OleFO6ZyHk-L633W03BmI_0 2024-09-14T12:09:53.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14994774885372450064', time=2024-09-14T13:51:32.759374+0000, chain.objs.size()=1 2024-09-14T12:09:53.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.885+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nUIHmIo3n-2uOQlUkv9DMINQW3C28dd_0 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14926265813399245395', time=2024-09-14T13:51:34.161149+0000, chain.objs.size()=1 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yo3TCqkM-nhcB9h1Nod23vhk-JaveWi_0 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3277803703960224120', time=2024-09-14T13:51:34.161757+0000, chain.objs.size()=1 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EzO2lPTyUZgOy9Dx9cZIXgbj_L7uDx__0 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1506763801880943245', time=2024-09-14T13:51:34.688452+0000, chain.objs.size()=1 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Okjhkh59nQd5jmI_DieviGeMgGbe_NK_0 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6658947564990674611', time=2024-09-14T13:51:34.903816+0000, chain.objs.size()=1 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PyWTk1Lj6hAQF2adWUJQfJpoaZbliGQ_0 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14045206230464506892', time=2024-09-14T13:51:35.391255+0000, chain.objs.size()=1 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ouUG1Qpq529Ge_1W3OX38FRInI0UaRT_0 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18205731729955202317', time=2024-09-14T13:51:35.777069+0000, chain.objs.size()=1 2024-09-14T12:09:53.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.887+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xd8k5LJpU00yLP9XOckFlXyYOty07HG_0 2024-09-14T12:09:53.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.888+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7246807558134072110', time=2024-09-14T13:51:36.095257+0000, chain.objs.size()=1 2024-09-14T12:09:53.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.888+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pkqGlCteLNmsp9Pg2ik08c8m6cGfKNy_0 2024-09-14T12:09:53.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.888+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3405174453378478943', time=2024-09-14T13:51:36.147302+0000, chain.objs.size()=1 2024-09-14T12:09:53.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.888+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1zqPVctLaz8F1faz86hnGU2X6lig1uj_0 2024-09-14T12:09:53.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1779689737549440153', time=2024-09-14T13:51:36.295729+0000, chain.objs.size()=1 2024-09-14T12:09:53.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.R2ZJE0fvEO99gxH17828MRNZs95Q_Zd_0 2024-09-14T12:09:53.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17428174674452424255', time=2024-09-14T13:51:37.460040+0000, chain.objs.size()=1 2024-09-14T12:09:53.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2TdVHUEv9InV14vVc9xOolXlkG0flZW_0 2024-09-14T12:09:53.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6244843744785531674', time=2024-09-14T13:51:37.778013+0000, chain.objs.size()=1 2024-09-14T12:09:53.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dKQc4Kk889kAAFTXafK5SITESw3o5K9_0 2024-09-14T12:09:53.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4154781502718687091', time=2024-09-14T13:51:37.881626+0000, chain.objs.size()=1 2024-09-14T12:09:53.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VH9uDmPuThNTFl2WbAQp5eXBvXK8Slw_0 2024-09-14T12:09:53.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10004182145371598467', time=2024-09-14T13:51:38.731821+0000, chain.objs.size()=1 2024-09-14T12:09:53.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UHtcmf-k43mzERuru3zyiZUGwAIhuYs_0 2024-09-14T12:09:53.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7626437907902663236', time=2024-09-14T13:51:38.860499+0000, chain.objs.size()=1 2024-09-14T12:09:53.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.890+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5nzcrRFtMsRae2BJo1a9_doMPkHlu-r_0 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5323878305547998750', time=2024-09-14T13:51:38.861092+0000, chain.objs.size()=1 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZAmQl1BY_mUK1OkkGpk333YpM8vrlYx_0 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16999104668036879693', time=2024-09-14T13:51:39.064074+0000, chain.objs.size()=1 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.K_xuZq1M9D9Oh2oNJYnj6Hg0XFW3k-W_0 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6918487687949705707', time=2024-09-14T13:51:39.155079+0000, chain.objs.size()=1 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6dMePH8Z77sEhTATS3hg9_9jtWKTexV_0 2024-09-14T12:09:53.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15613821550116370783', time=2024-09-14T13:51:39.648393+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.80xMOv5u53ycp6zexdt6sMRnCKdY8l1_0 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12007706922458667457', time=2024-09-14T13:51:40.262740+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GLO7QfCMxJilOBSZBFfHyMX5Cbr56d2_0 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16772434788313593351', time=2024-09-14T13:51:40.569547+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.U0ZS6cysOg2X6mS4xdSuPqZskMyfOyk_0 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.757686388429991646', time=2024-09-14T13:51:40.662331+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RGOyGdAP_X8ZUBqNfEKoDjZIE96zY5w_0 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16899148065435608635', time=2024-09-14T13:51:41.216839+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5JcS7GflidpuwiR7-mFUtLtoiCZfm2Y_0 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3549066808552874568', time=2024-09-14T13:51:41.494846+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Qtynxy2zpEz5nZQPWgvezAsaD5CXvYP_0 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3268700898366997199', time=2024-09-14T13:51:41.774505+0000, chain.objs.size()=1 2024-09-14T12:09:53.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2VxmLPrMKxNCgl7LRgF68fMGwVB5yKv_0 2024-09-14T12:09:53.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3783048918729077860', time=2024-09-14T13:52:21.097005+0000, chain.objs.size()=1 2024-09-14T12:09:53.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.895+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XmQ3QYkgrzuKSW_f1iOwSBZyLWYTRmQ_0 2024-09-14T12:09:53.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.899+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6004168086151968432', time=2024-09-14T13:52:21.272115+0000, chain.objs.size()=1 2024-09-14T12:09:53.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.899+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YkwFnP89CiEP1CbReB2coC9poUoHtbm_0 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13286875825976131010', time=2024-09-14T13:52:21.389585+0000, chain.objs.size()=1 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BYsMmSwQTsMV8YHj7ySeJa2fxKJZSuC_0 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4620745867569137496', time=2024-09-14T13:52:21.968235+0000, chain.objs.size()=1 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QcjS1xrBl62Avqv_eFFyjSwDNSEHeap_0 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4214947797426537846', time=2024-09-14T13:52:21.968904+0000, chain.objs.size()=1 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iZ7TLJmIX1zj2BJIAde-NZjKasure0i_0 2024-09-14T12:09:53.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17979114350175490466', time=2024-09-14T13:52:21.969588+0000, chain.objs.size()=1 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fuDtJYDIW_s6kv8TMF4bvfWKMLbaA3W_0 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9118092205835422577', time=2024-09-14T13:52:22.740325+0000, chain.objs.size()=1 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ir77I6FSsHOe19ffombIvENNTiJ7D6T_0 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17683081676853862511', time=2024-09-14T13:52:23.095940+0000, chain.objs.size()=1 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UZkV2EyghV9MkbI3W7xCJDRNM2_AfB9_0 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6147617334682843', time=2024-09-14T13:52:23.168078+0000, chain.objs.size()=1 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-j-0DOB3YIBuTNcostEcPwqbYbN34_j_0 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12011494804017929509', time=2024-09-14T13:52:24.347210+0000, chain.objs.size()=1 2024-09-14T12:09:53.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.901+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Rz__4CDJgvqxQNI7U9HKHQcMpYh6R6x_0 2024-09-14T12:09:53.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.909+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/44922 2024-09-14T12:09:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T12:09:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1688841972870185299', time=2024-09-14T13:52:24.407944+0000, chain.objs.size()=1 2024-09-14T12:09:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0kt-SQyT686FUBbx3lQPoiX8Z45YvkB_0 2024-09-14T12:09:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14799269573027524213', time=2024-09-14T13:52:24.408689+0000, chain.objs.size()=1 2024-09-14T12:09:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.x_SHX4F-RlRnHQ3Eu_6PV6uTaMmNdCE_0 2024-09-14T12:09:53.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2842511269884216007', time=2024-09-14T13:52:26.316964+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fVyQ6KedeW-855IYfY_JKIH45dS_Q_f_0 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17626101727353367172', time=2024-09-14T13:52:26.559760+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fVRlb3freBYG5_Tuwi44Lna2pw_Rpgy_0 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14225150282075953947', time=2024-09-14T13:52:26.610133+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.skNuXTReHigDatN0JvKrOY_2sYcHMhI_0 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3283250106561940267', time=2024-09-14T13:52:26.689563+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LawyYEinL-MIgFXNMa0lQxNB5vT3D6f_0 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14990148772108818557', time=2024-09-14T13:52:28.718228+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LUWmStr5EfvsQXTgTZhP0YbvWI1g_XA_0 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11318945207469582276', time=2024-09-14T13:52:30.462228+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vgOotmiP_fUZ6yGFPiALiK5L28CwTht_0 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1908702893166766565', time=2024-09-14T13:52:31.024926+0000, chain.objs.size()=1 2024-09-14T12:09:53.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.H2wGNQmVdyoBzW-ZTjzzCZtMtYYv3zu_0 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1956731326333465186', time=2024-09-14T13:52:31.455224+0000, chain.objs.size()=1 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JTKofPdmld8NDc3W0j7JYUbQ3QkkqAU_0 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7381001129094472930', time=2024-09-14T13:52:31.507640+0000, chain.objs.size()=1 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.60w9AhZRbZEpZY5Klu1IwdfRnnBhe_p_0 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7305751250768939593', time=2024-09-14T13:52:31.936143+0000, chain.objs.size()=1 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.912+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VsBKisx-It4sABnFYhWrOuU00aqQbHA_0 2024-09-14T12:09:53.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12937069880895618524', time=2024-09-14T13:53:54.847757+0000, chain.objs.size()=1 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.466__shadow_.2TPL4J5cfIk8OMaSms3mU9ufdoZ8iGL_0 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13913772027933843345', time=2024-09-14T13:54:12.913086+0000, chain.objs.size()=1 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.496__shadow_.XT1IKDCaNhYnglJUkJpUAmQWcxvAl1O_0 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9153018663575045655', time=2024-09-14T13:54:26.782819+0000, chain.objs.size()=6 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.1 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.915+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.2 2024-09-14T12:09:53.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.3 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.4 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.5 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.6 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16807289508800583964', time=2024-09-14T13:55:08.682979+0000, chain.objs.size()=1 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.520__shadow:7zdP59qtbz02iVdNTCXGT4I17v9-dd0_.Z37dVJnK2RTRyGxxYUX7BJehvek37Cf_0 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11378763143243915571', time=2024-09-14T13:56:10.126175+0000, chain.objs.size()=3 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~DycPIDK-5fqS_y6tplo1F6vNCIvHiBO.1 2024-09-14T12:09:53.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.916+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~DycPIDK-5fqS_y6tplo1F6vNCIvHiBO.2 2024-09-14T12:09:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.919+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~DycPIDK-5fqS_y6tplo1F6vNCIvHiBO.3 2024-09-14T12:09:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.919+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11075688143768821871', time=2024-09-14T13:56:23.466704+0000, chain.objs.size()=3 2024-09-14T12:09:53.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.919+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~4EIUlaB9uH7QyMeORwd9lRoA-2zqgrO.1 2024-09-14T12:09:53.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.920+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~4EIUlaB9uH7QyMeORwd9lRoA-2zqgrO.2 2024-09-14T12:09:53.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.920+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~4EIUlaB9uH7QyMeORwd9lRoA-2zqgrO.3 2024-09-14T12:09:53.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.921+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~aBHX-77ojtHYh8N1nIVUktV_i_CeGd4', time=2024-09-14T13:57:42.212100+0000, chain.objs.size()=1 2024-09-14T12:09:53.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.921+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.561__multipart_mymultipart.2~aBHX-77ojtHYh8N1nIVUktV_i_CeGd4.1 2024-09-14T12:09:53.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.921+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5549651601684606721', time=2024-09-14T13:58:08.451189+0000, chain.objs.size()=1 2024-09-14T12:09:53.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.921+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow_.t5f-aTS0gukgsmcLBpswMiA5Ik0Tdhp_0 2024-09-14T12:09:53.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7462522662233353937', time=2024-09-14T13:58:18.760489+0000, chain.objs.size()=1 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:xNbaJ-TkWrGGYObB2qdNBwAw7ldc3O3_.C2rTdGWXvTPG6aqpsASLbbn9t_ORs8J_0 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6595201659760011909', time=2024-09-14T13:58:31.580982+0000, chain.objs.size()=1 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:d1QCS33RUJ.uDHUJSK-qPv5QPIQhi2d_.snMpWiG-n409IwTwRFgDHocIUjr-HDC_0 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16667376837040926439', time=2024-09-14T13:58:55.473857+0000, chain.objs.size()=1 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:yN0IqHZrViqLL3tDd9C2f.-8zX76O5A_.ZWBM-xe2vf-byM66BQB72uSOJ7nZ7S7_0 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16902669659086182334', time=2024-09-14T13:58:59.231721+0000, chain.objs.size()=1 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.583__shadow:enDwJkyf-B9UUDczs76QM0u6uX6tx.5_.DxqOw1JVDaHCbU2lJfp2CacwfllAxiM_0 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9649331229949082736', time=2024-09-14T14:03:49.968040+0000, chain.objs.size()=6 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.662__multipart_foo.2~msC-pyIBVD1mFfpn--lLAozUfJTHkaU.1 2024-09-14T12:09:53.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.922+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.662__multipart_foo.2~msC-pyIBVD1mFfpn--lLAozUfJTHkaU.2 2024-09-14T12:09:53.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.923+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.662__multipart_foo.2~msC-pyIBVD1mFfpn--lLAozUfJTHkaU.3 2024-09-14T12:09:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.926+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.662__multipart_foo.2~msC-pyIBVD1mFfpn--lLAozUfJTHkaU.4 2024-09-14T12:09:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.926+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.662__multipart_foo.2~msC-pyIBVD1mFfpn--lLAozUfJTHkaU.5 2024-09-14T12:09:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.927+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.662__multipart_foo.2~msC-pyIBVD1mFfpn--lLAozUfJTHkaU.6 2024-09-14T12:09:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.927+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4644442590169238492', time=2024-09-14T14:05:01.438849+0000, chain.objs.size()=1 2024-09-14T12:09:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.927+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.741__shadow_.mebl6GgK_jzr5QgzRjo17__ZNsyW4fP_0 2024-09-14T12:09:53.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.930+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.932+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T12:09:53.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.934+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:53.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.934+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:53.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47619' 2024-09-14T12:09:53.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_PaDt4LfoGqiycKMM9p6NLDsgHhVn3oR', time=2024-09-14T13:46:57.387916+0000, chain.objs.size()=2 2024-09-14T12:09:53.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.bh4tZtX1lbeheYWYIttFQNvKjGd6Mhu_0 2024-09-14T12:09:53.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.bh4tZtX1lbeheYWYIttFQNvKjGd6Mhu_1 2024-09-14T12:09:53.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2667278252294313891', time=2024-09-14T13:47:16.252503+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.182__shadow_.leYHAihkAbhWfbeyD9PqCfTJLv08hPp_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17614825732906587017', time=2024-09-14T13:49:02.431467+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.233__shadow_.iPsGgSULfj9KvHnXKrTa0XgfAGZbNnO_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3673877546303461820', time=2024-09-14T13:49:04.393966+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.236__shadow_.z8CeplqNV-RlCoU1OkXpdToNSqcLNzK_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13429349679791202991', time=2024-09-14T13:49:06.137954+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.238__shadow_.TEkbqUnoVsmgvFgGTs5csz0wNdT8wLl_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14892285168546685260', time=2024-09-14T13:49:11.434159+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.246__shadow_.nA6ufghUry0mCoyQM_wYyL-W99_WNHB_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11071090306643655015', time=2024-09-14T13:49:13.976984+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.250__shadow_.1CzymlbJbXtS0EN985Ma8QvqdiSswMi_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6220221737255197962', time=2024-09-14T13:49:18.388995+0000, chain.objs.size()=1 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.257__shadow_.-ljUV5Ac8LfOCp0e2Zl3gFzOwuD_qjs_0 2024-09-14T12:09:53.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12317744172090318632', time=2024-09-14T13:49:58.992254+0000, chain.objs.size()=1 2024-09-14T12:09:53.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sly3WvxkhoMRgMyzDhyUhY_guc_y8nE_0 2024-09-14T12:09:53.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3304825502444444785', time=2024-09-14T13:49:59.652947+0000, chain.objs.size()=1 2024-09-14T12:09:53.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.efB74v9B8LKKX2beBJO1ZnpiWWR2wYE_0 2024-09-14T12:09:53.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8548183959259911172', time=2024-09-14T13:50:00.771257+0000, chain.objs.size()=1 2024-09-14T12:09:53.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.935+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OSQd7DIA-dp7vkGdTcnFLy9LLYghKeN_0 2024-09-14T12:09:53.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5636015598020273526', time=2024-09-14T13:50:02.107855+0000, chain.objs.size()=1 2024-09-14T12:09:53.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WSwf8LV8xuqv48_6twl1hNpWkDmlIe4_0 2024-09-14T12:09:53.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7702831534232029332', time=2024-09-14T13:50:02.108626+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-tbqiNVZmwrAekBI9W316weWfS_NmUP_0 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8581684584073680870', time=2024-09-14T13:50:02.272930+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.A4S2zdiIu0xCp56wuT5666ikwaTDaAP_0 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16762255915340793613', time=2024-09-14T13:50:02.461658+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dEA_HA0Xhrk5gd0u5FU_GAWB4za5VFj_0 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17560819846046117173', time=2024-09-14T13:50:02.743933+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tRNWmonY5nUJQeUf1S_2_R5s0sTa1uQ_0 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10292005405501004714', time=2024-09-14T13:50:02.772905+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cZL3zjESQ7MiDgV0Lss51I-_UMRyZnk_0 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17187219941692475498', time=2024-09-14T13:50:02.968639+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.k-fdw0wIh7Axg1bBUa7_YTtq7nveLuy_0 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5714009797239869965', time=2024-09-14T13:50:03.705059+0000, chain.objs.size()=1 2024-09-14T12:09:53.940 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6dZUI-hkxbQQKUTn2K_F4qzkbfAEIjo_0 2024-09-14T12:09:53.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13064846108464439701', time=2024-09-14T13:50:03.746731+0000, chain.objs.size()=1 2024-09-14T12:09:53.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7gVTh9uyaYz4Eroc9--rlxo5po0AhtD_0 2024-09-14T12:09:53.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5426747470671322289', time=2024-09-14T13:50:03.896028+0000, chain.objs.size()=1 2024-09-14T12:09:53.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xBafFgeG0Fp82SC8b0e6VSonW0P91Nz_0 2024-09-14T12:09:53.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10743471945399817369', time=2024-09-14T13:50:04.147299+0000, chain.objs.size()=1 2024-09-14T12:09:53.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.941+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Lpdi87G2iXh7GZ3OmBGDlDtofTh_UV8_0 2024-09-14T12:09:53.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4191078055009922740', time=2024-09-14T13:50:04.297101+0000, chain.objs.size()=1 2024-09-14T12:09:53.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UQNzp1oT4DDVMM224SBKOS5yPBRzkqS_0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8168665994632543701', time=2024-09-14T13:50:05.036956+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5M2QwJpOMr8SAWlTj9UzL4irCguxM5V_0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.104219919285839586', time=2024-09-14T13:50:05.148740+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eq3HNOeG3uREz9UxXUBZygojy1magpD_0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11826057583687401326', time=2024-09-14T13:50:05.281160+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rCvsw4IAAZdv12ZFtRvx1xPlb3iRafY_0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14039940121263339166', time=2024-09-14T13:50:05.590817+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IVbLCREcldHLmQC0zf0cgv6VfEGPZo__0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.369926508191046312', time=2024-09-14T13:50:05.729521+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IsTkXYORaAJrJB3GdmyU2KJfbX91FmG_0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.945+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9768156447994197297', time=2024-09-14T13:50:05.855037+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mRQ0WqJVeT_gRR4e4qmX90UomIEk5an_0 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17599449157212066221', time=2024-09-14T13:50:06.529809+0000, chain.objs.size()=1 2024-09-14T12:09:53.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1yZSEVCj3qbnUREXf3eTFRwkK4Zoss8_0 2024-09-14T12:09:53.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.581318468390622678', time=2024-09-14T13:50:07.585087+0000, chain.objs.size()=1 2024-09-14T12:09:53.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ItbkBKuswSXC5Cpb6jb-5bRayPdS785_0 2024-09-14T12:09:53.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17522611941041594380', time=2024-09-14T13:50:08.025686+0000, chain.objs.size()=1 2024-09-14T12:09:53.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8LfqLtoY184RLOdPkiNNmpsVuR9g0Gv_0 2024-09-14T12:09:53.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13153231637171652074', time=2024-09-14T13:50:08.415371+0000, chain.objs.size()=1 2024-09-14T12:09:53.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.946+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sXtJT3GL_5Q0TDHqKwnfUZuoBNxFdFx_0 2024-09-14T12:09:53.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13314377522091599485', time=2024-09-14T13:50:08.548081+0000, chain.objs.size()=1 2024-09-14T12:09:53.947 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.avbNndpZD45VdTbaiD0NqSiNAl3RVjd_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2211182594778735982', time=2024-09-14T13:50:08.622865+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5gCZv__bCoKIN9emRkYbIGyacjmAfhk_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16387180300215793986', time=2024-09-14T13:50:08.890802+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KCKCE_ldfbWPRnSUcOuW9XPyLMkP0yl_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13627276679004617777', time=2024-09-14T13:50:09.081059+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OWmF08bDqgRNUrfTK0zmvMYBle0MLdY_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18394974634623747922', time=2024-09-14T13:50:10.474718+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.263__shadow_.YVXVDGACValG6s7uZmzYo20cCi93d09_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8877279863093009985', time=2024-09-14T13:50:11.087991+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.264__shadow_.YN6SkKHkS_XGv5MAlBpsoKFpY-xfZHD_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5609708092546778327', time=2024-09-14T13:50:12.247252+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.266__shadow_.5L4jRn6k4JbWKlowUl9HrRhyTC4qXdW_0 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10940129636552913392', time=2024-09-14T13:50:22.003722+0000, chain.objs.size()=1 2024-09-14T12:09:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.282__shadow_.EBtnW_n2JanbPEdRS5HDMAUDbeMPi0X_0 2024-09-14T12:09:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11572271870730058355', time=2024-09-14T13:50:31.670714+0000, chain.objs.size()=1 2024-09-14T12:09:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.Os5sMQfFODyOoMgB5fntdUvwI53pEFm_0 2024-09-14T12:09:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5877209727688238170', time=2024-09-14T13:50:31.759727+0000, chain.objs.size()=1 2024-09-14T12:09:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.949+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.4vy2srdINEtEtY39G8VkRKDzigOd0Es_0 2024-09-14T12:09:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.951+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6956271929769842948', time=2024-09-14T13:51:30.694109+0000, chain.objs.size()=1 2024-09-14T12:09:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.951+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yg37h6sMKzD2VK9OxIQESUzRs353wVc_0 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2043095586811670904', time=2024-09-14T13:51:30.893816+0000, chain.objs.size()=1 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e1FoMhYMVh_zpBQqsDPtHGoF0UI65t7_0 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10017350996110280883', time=2024-09-14T13:51:30.955073+0000, chain.objs.size()=1 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GcDmpU7ss_GdbsM9Jre8MvevdoYJykG_0 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7942973824620548711', time=2024-09-14T13:51:31.071181+0000, chain.objs.size()=1 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WF0NP_AGOGk9-TDTyDWVpBiMTEIFB_6_0 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7647590433028432553', time=2024-09-14T13:51:31.071744+0000, chain.objs.size()=1 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.s3aIVD_rkNIrSocW3IQYinfkgQLP0JL_0 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2112000331448373529', time=2024-09-14T13:51:31.080153+0000, chain.objs.size()=1 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RocO7JjZ8yJA4cfVR7PTdhsRngPB6Jc_0 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14367983741284415749', time=2024-09-14T13:51:31.553102+0000, chain.objs.size()=1 2024-09-14T12:09:53.953 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.954+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.95CuuEX41fsEgyUo7PvMGrUr5Xtnc2s_0 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14376799494787074260', time=2024-09-14T13:51:31.553923+0000, chain.objs.size()=1 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-ERQ42-F7UKCtplyv1hS3fMZn-8lusr_0 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11734215947208429036', time=2024-09-14T13:51:32.277870+0000, chain.objs.size()=1 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zD1MT8e1C0ZsRd-nGhujy0OIhExm-TG_0 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8859829474128415336', time=2024-09-14T13:51:32.867293+0000, chain.objs.size()=1 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8_qfnRNlHYxvphMfgIgEjp0QHDHxs3L_0 2024-09-14T12:09:53.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18401746538930153289', time=2024-09-14T13:51:32.950682+0000, chain.objs.size()=1 2024-09-14T12:09:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jxJ1flEqAkcnqHmJMiWoT0Rg3OoNt_w_0 2024-09-14T12:09:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2284243182292319491', time=2024-09-14T13:51:32.951212+0000, chain.objs.size()=1 2024-09-14T12:09:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.955+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cx4py9MDDfGrncJhEF0-QNCqjSSumHa_0 2024-09-14T12:09:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.957+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3577853263994437947', time=2024-09-14T13:51:33.138832+0000, chain.objs.size()=1 2024-09-14T12:09:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.957+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.T4f3HNXTjXjcRzExqIpnTJPNploafZa_0 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624003757219903557', time=2024-09-14T13:51:33.343212+0000, chain.objs.size()=1 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.41lb-EeituKZNMVK3utifApUxzMR-Yp_0 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11799082087460464600', time=2024-09-14T13:51:34.086499+0000, chain.objs.size()=1 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3VykZbqz0cJdiEdP-ESS9BHSz7SYgX8_0 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5628907880478013931', time=2024-09-14T13:51:35.369804+0000, chain.objs.size()=1 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ayvcQ1BK1LuyNgFX54nJSlwD2bBv9fR_0 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10281684198345680589', time=2024-09-14T13:51:35.948074+0000, chain.objs.size()=1 2024-09-14T12:09:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jigPzuwtgBFY-NNvnMs7rmbLpiHrTnK_0 2024-09-14T12:09:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17239090289677334104', time=2024-09-14T13:51:36.282170+0000, chain.objs.size()=1 2024-09-14T12:09:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.959+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PVDfD8y7WHo8qO4GvttBW99bq3djr5B_0 2024-09-14T12:09:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11088723456486835388', time=2024-09-14T13:51:36.975495+0000, chain.objs.size()=1 2024-09-14T12:09:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.da3zqgz3f9CBqtq5Rgw4baMN4mkAuHb_0 2024-09-14T12:09:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.960+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17028741404807854310', time=2024-09-14T13:51:37.875884+0000, chain.objs.size()=1 2024-09-14T12:09:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.960+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3raVmanfaxkCYutOyLG--JrLKAiZh1L_0 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15573785918213684313', time=2024-09-14T13:51:38.289731+0000, chain.objs.size()=1 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GrC1bIcWjC_ta7Bhtkp9IHYb5V5isQX_0 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10261669603645033660', time=2024-09-14T13:51:38.291159+0000, chain.objs.size()=1 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZX04WWMAi5tODxs6Y-bo723ZGWjFSQZ_0 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8537714428543299243', time=2024-09-14T13:51:38.715008+0000, chain.objs.size()=1 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VVi8S9pG8iuBafvGh32gSIPfyBfg3io_0 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8633425579516236668', time=2024-09-14T13:51:38.833110+0000, chain.objs.size()=1 2024-09-14T12:09:53.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.961+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.FdFj0tF6GKbPK512rLR1ejMutQuqUDr_0 2024-09-14T12:09:53.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.965+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12430277089252730381', time=2024-09-14T13:51:38.936878+0000, chain.objs.size()=1 2024-09-14T12:09:53.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.965+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VC1PDI6tIQU0OE5pK_ZQBW9Dq2G-vZ8_0 2024-09-14T12:09:53.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8550412448397629609', time=2024-09-14T13:51:39.026240+0000, chain.objs.size()=1 2024-09-14T12:09:53.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OJsr_0zXdon0Bf7SZgGBQkGVXfdEAhw_0 2024-09-14T12:09:53.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4530920205730521603', time=2024-09-14T13:51:39.056025+0000, chain.objs.size()=1 2024-09-14T12:09:53.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UHKC-a9RcNQBN0kz70q1BxI-YGTIGkX_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5795720078488582854', time=2024-09-14T13:51:39.125433+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.KBbVRxvWszcCKnlbSb4Wavq_QvJlP2D_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11164773802721272175', time=2024-09-14T13:51:39.174475+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vrMYYurjt7FlMdI3z67QWknJezsT3Qs_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5210031493920846246', time=2024-09-14T13:51:39.847688+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fLPvKHLbBEfZU1rSIOb2Cmlro8ZMiS6_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10457104810837671326', time=2024-09-14T13:51:40.317242+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Sp63T3B-nlO-edqSixVC8ehAZrbw8Ng_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12059863850083994813', time=2024-09-14T13:51:41.197470+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.K_OREZyZR_2ucN35eRWWpz6FQh3B5YX_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4455563856480028979', time=2024-09-14T13:51:41.357601+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EHTreuL09VNNorA2V-_5wXONRPJjYES_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13048610515408648057', time=2024-09-14T13:51:41.511629+0000, chain.objs.size()=1 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ui6wmd5sjcYRUv23gWBqawd_gOB5XHC_0 2024-09-14T12:09:53.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10598372125883165281', time=2024-09-14T13:51:41.650876+0000, chain.objs.size()=1 2024-09-14T12:09:53.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.966+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BYkMPklxzgUM5isjGriPfRgluEcl-Fv_0 2024-09-14T12:09:53.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.969+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11450565271869452067', time=2024-09-14T13:51:41.868798+0000, chain.objs.size()=1 2024-09-14T12:09:53.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.969+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Rn78BKfJUsHYzfxat392fE6rvpqpEBr_0 2024-09-14T12:09:53.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.969+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7183710298972787117', time=2024-09-14T13:52:21.129473+0000, chain.objs.size()=1 2024-09-14T12:09:53.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.969+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zWeGYu0zAfD7MUUCu3sTU7-MCpeDxEb_0 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8525804655172777498', time=2024-09-14T13:52:21.634812+0000, chain.objs.size()=1 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6k89blF3C-50Keo-bRbzwiKBbp2i3OE_0 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5268208966984034723', time=2024-09-14T13:52:21.708717+0000, chain.objs.size()=1 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ud2-Zw-xU7gIEWA35e5ugkDQLQGR8tA_0 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7975420808401993077', time=2024-09-14T13:52:21.860445+0000, chain.objs.size()=1 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KLUIQtZUI5wvpl_hcWO3A6gvWRV2flP_0 2024-09-14T12:09:53.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10032216020016859843', time=2024-09-14T13:52:22.130711+0000, chain.objs.size()=1 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.i2Ssa56OVSuENnmocOf0GkeyXi0Jk58_0 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12506759699410883791', time=2024-09-14T13:52:22.655123+0000, chain.objs.size()=1 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.oF4SpO3UmYcyQoszCMn4wWcXGoWhcj2_0 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9625562510248777656', time=2024-09-14T13:52:22.956025+0000, chain.objs.size()=1 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.A2T2PmjGmDPi0ZFWagGFCabmOAeuL2-_0 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14557639064824974998', time=2024-09-14T13:52:23.450567+0000, chain.objs.size()=1 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PyiinthofLO6YRfy72uBuojEFpejKgb_0 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12338049203342264705', time=2024-09-14T13:52:23.611572+0000, chain.objs.size()=1 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2udlhLXU95TGd6LyT4z9W9L9dfc6aSU_0 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11231503651241544625', time=2024-09-14T13:52:23.613088+0000, chain.objs.size()=1 2024-09-14T12:09:53.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.970+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.b1B-Z8kCO3Ij7l6rYh1uTLVDcq3uK_P_0 2024-09-14T12:09:53.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16145789631306353976', time=2024-09-14T13:52:25.023064+0000, chain.objs.size()=1 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.G-qNvfH6wKU2i_MQdBFpRGU_e2QW25Y_0 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14790292681828358041', time=2024-09-14T13:52:25.057229+0000, chain.objs.size()=1 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ePtQqnZS2c5vCYC3fCt95uzZuOpfKdb_0 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7805299179048121396', time=2024-09-14T13:52:25.117505+0000, chain.objs.size()=1 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.i3Y13YE-AILtKxMXw9Q0vIFcisXqQZa_0 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6669084892419693805', time=2024-09-14T13:52:26.168170+0000, chain.objs.size()=1 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZHvzKIStJP_7Yj-0IvPmA-zgzBIOy3G_0 2024-09-14T12:09:53.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14375543099646962580', time=2024-09-14T13:52:26.171683+0000, chain.objs.size()=1 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ou2v2jWuIA_b4fZeOWgVwog245E6H14_0 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.66694513547835594', time=2024-09-14T13:52:26.699326+0000, chain.objs.size()=1 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.973+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.O3Td_LN-i9W6HD7b_0_ObVLVk72EpRm_0 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7407915610538539020', time=2024-09-14T13:52:27.206416+0000, chain.objs.size()=1 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EPYnBMIq3bKQy0Pob9ekXnzGgKpTd7u_0 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1254200824141594826', time=2024-09-14T13:52:27.340784+0000, chain.objs.size()=1 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-OT0QADKKjMx6K7anAJCFSmxJ-79_T8_0 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.974+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3407841627466268473', time=2024-09-14T13:52:28.669359+0000, chain.objs.size()=1 2024-09-14T12:09:53.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.974+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TKcQ71bbAfSpSFGWkHhz7HxTlLVzJ42_0 2024-09-14T12:09:53.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.975+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1473395188215020363', time=2024-09-14T13:52:28.670056+0000, chain.objs.size()=1 2024-09-14T12:09:53.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.975+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8Br5zhWBG3BQWlzvn5Dfg8p6ue48qG5_0 2024-09-14T12:09:53.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.975+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6899775150691285791', time=2024-09-14T13:52:29.241689+0000, chain.objs.size()=1 2024-09-14T12:09:53.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.975+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AElkkH-tpVGa4UcUMluiRtUO3OC7moq_0 2024-09-14T12:09:53.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.979+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47619 2024-09-14T12:09:53.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.981+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-14T12:09:53.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.981+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15813751029077328927', time=2024-09-14T13:52:29.580519+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Lt7CtqEoiDL4m-PV_msmjfMVOxDsauc_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10632487238624090464', time=2024-09-14T13:52:30.267643+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JqZcG1SPLj6HsmpLG5_BH4BGWhb-Ofx_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.364820686276190053', time=2024-09-14T13:52:30.386853+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.e9mFtZTzwXviPEV1EKZquHkNQ3qJGPd_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4355789512242220837', time=2024-09-14T13:52:30.578741+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.U8EXZY-g-mdxn7K15INxeXCy7Zrq406_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16613856626735440234', time=2024-09-14T13:52:31.551233+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AI-RP6-msf7CTC1Wxqhpf8rxNhW1wyT_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16723273305990302011', time=2024-09-14T13:52:31.572780+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.K5mgWV7LWwqSUHzPG6IzEwbU2zNC-Np_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11080843267999078104', time=2024-09-14T13:52:32.173182+0000, chain.objs.size()=1 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.z3pxVBSeztcTlCnSYM--WvJ_ZF221B5_0 2024-09-14T12:09:53.981 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2119187534424900013', time=2024-09-14T13:53:33.181265+0000, chain.objs.size()=1 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.435__shadow_.GE38bQpmQ-jQuw7Whbt-Zz7bC5naVT8_0 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7112461780931547656', time=2024-09-14T13:53:49.937678+0000, chain.objs.size()=1 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.460__shadow_.timANdWsOR-6sH0xo0DZd2jIBkdsG88_0 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17031311844737721649', time=2024-09-14T13:54:12.912866+0000, chain.objs.size()=1 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.496__shadow_.XT1IKDCaNhYnglJUkJpUAmQWcxvAl1O_0 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1380888234620670531', time=2024-09-14T13:54:14.104911+0000, chain.objs.size()=1 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.498__shadow_.-CJq3ySPGHRL77yFZFqNS50fGxCVb8p_0 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7683712496612827434', time=2024-09-14T13:54:17.597532+0000, chain.objs.size()=1 2024-09-14T12:09:53.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.982+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.503__shadow:cl2ARxfpauRoDIjBPT2zPE7hlSXN4gW_.mVyB_4O5KFCXr9CJf6BJq8M6WMccC9-_0 2024-09-14T12:09:53.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.984+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17054087684783518579', time=2024-09-14T13:55:08.906858+0000, chain.objs.size()=3 2024-09-14T12:09:53.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.984+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~oScpmiT7WdjgL58LE6esqdkr4zqhDV-.1 2024-09-14T12:09:53.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~oScpmiT7WdjgL58LE6esqdkr4zqhDV-.2 2024-09-14T12:09:53.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~oScpmiT7WdjgL58LE6esqdkr4zqhDV-.3 2024-09-14T12:09:53.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.985+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15771299506409876169', time=2024-09-14T13:57:59.857477+0000, chain.objs.size()=1 2024-09-14T12:09:53.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:TmwsyaUFvy95KmVlfHjU79GSY7-.64._.KqELm8222miABBcriS8FOvNN5Z2KtP0_0 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.985+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4125594068140023199', time=2024-09-14T13:58:55.289699+0000, chain.objs.size()=1 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.985+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:snlkkN6djXArugG.UOFTTEqBR-cy4y1_.NZC19XR6z92x1mmNrTr8K31UnQT15ZW_0 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11097898461045292169', time=2024-09-14T13:58:55.506997+0000, chain.objs.size()=1 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:BsJaCpN8fv55FQwjPgaFf2x0s7FrFpd_.vAR8nM80g4c4TMCpr2t2_5bcJ46-iD8_0 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6714707970458848556', time=2024-09-14T13:59:03.268569+0000, chain.objs.size()=1 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:gU2tWJfivvP83EDWg8fuaZMdhmSr1io_.y1RGykXjeSTbqM_cU8P-NCaUoPgxguV_0 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3621559910481717403', time=2024-09-14T13:59:03.303881+0000, chain.objs.size()=1 2024-09-14T12:09:53.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:urJS.ji1bTRd5ibdmpOIv6JFyKDc-A6_.DAoahulzdRWpKOaMGkElJIiCGGovXcR_0 2024-09-14T12:09:53.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16389744321266807308', time=2024-09-14T14:00:22.475382+0000, chain.objs.size()=1 2024-09-14T12:09:53.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.616__shadow_.zirk2A427tXxW-m4Udb6Aq56FPY94gA_0 2024-09-14T12:09:53.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N', time=2024-09-14T14:02:54.615754+0000, chain.objs.size()=6 2024-09-14T12:09:53.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624__multipart_multipart_enc.2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N.1 2024-09-14T12:09:53.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.986+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624__multipart_multipart_enc.2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N.2 2024-09-14T12:09:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.989+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624__multipart_multipart_enc.2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N.3 2024-09-14T12:09:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.989+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624__multipart_multipart_enc.2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N.4 2024-09-14T12:09:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.989+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624__multipart_multipart_enc.2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N.5 2024-09-14T12:09:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.989+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.624__multipart_multipart_enc.2~DgtLru6Jvfu0DKrrciws3pWIaO8ad-N.6 2024-09-14T12:09:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9626327351125165836', time=2024-09-14T14:03:05.546701+0000, chain.objs.size()=1 2024-09-14T12:09:53.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.632__shadow_.-iP_lWIYj9J5qN0rkhSbi2rgGLflwVn_0 2024-09-14T12:09:53.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.990+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1036999843003793739', time=2024-09-14T14:04:41.084897+0000, chain.objs.size()=1 2024-09-14T12:09:53.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.990+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.717__shadow:zGm7U8RBiYzfmOegtARDu9U0RIeEjS8_.xAQkJz3GWXpVsB2KGVuzyZOgRUDLa1P_0 2024-09-14T12:09:53.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.991+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5676772319772602401', time=2024-09-14T14:06:01.493494+0000, chain.objs.size()=1 2024-09-14T12:09:53.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.991+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.756__shadow_.oI9tHtLJi0D7FYWtPij5h6Mx7Et7zym_0 2024-09-14T12:09:53.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.991+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7835371901361097685', time=2024-09-14T14:06:03.225509+0000, chain.objs.size()=1 2024-09-14T12:09:53.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.991+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.757__shadow_.xC-gTz9aNTyK0uHc-H-U1QgbhONFCJv_0 2024-09-14T12:09:53.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.996+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:53.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:53.999+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T12:09:54.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.001+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.002+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48627' 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13857403972179956267', time=2024-09-14T13:46:40.254663+0000, chain.objs.size()=2 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.158__shadow_.CmqykcW0tvCG6AJEbFZUTcBmOh7oAOz_0 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.158__shadow_.CmqykcW0tvCG6AJEbFZUTcBmOh7oAOz_1 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6865388701268107252', time=2024-09-14T13:47:14.826954+0000, chain.objs.size()=1 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.179__shadow_.3KoNDmZULzylBIX5spWRZdM8ltxwnMx_0 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8162036783141255178', time=2024-09-14T13:49:00.481166+0000, chain.objs.size()=1 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.230__shadow_.w45xe6PdK4vSUACE3kcQGgTnf4Uz9U0_0 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4292126169813990979', time=2024-09-14T13:49:01.128865+0000, chain.objs.size()=1 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.231__shadow_.yzzPx4T16ghPx7d66fLu1f4DEkzXMbX_0 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9880775939489871288', time=2024-09-14T13:49:05.249724+0000, chain.objs.size()=1 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.237__shadow_.5AzflGpIwDCIDIQY52R-R61r2WRNZl-_0 2024-09-14T12:09:54.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4631060213460497480', time=2024-09-14T13:49:05.266738+0000, chain.objs.size()=1 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.237__shadow_.ru03_GKbWf3b0EODA5-t8riJw1ML7O5_0 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17626699353106965701', time=2024-09-14T13:49:09.320663+0000, chain.objs.size()=1 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.243__shadow_.ri-zODRGBlZKcSzotnv8j7UHZjcHBBl_0 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6405681648075512543', time=2024-09-14T13:49:09.321258+0000, chain.objs.size()=1 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.243__shadow_.SgFB8qKj2EtLdvKtMHSZusLuxIekCBJ_0 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16900213212775361141', time=2024-09-14T13:49:10.814562+0000, chain.objs.size()=1 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.245__shadow_.6ukxBPYYT4ShQiuiagrlP_PgHtaK5LK_0 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16276983882873884762', time=2024-09-14T13:49:12.094738+0000, chain.objs.size()=1 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.247__shadow_.q5cOfxd5OM0yQwzzLNlFzYqiht6NqM9_0 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11920114824301374053', time=2024-09-14T13:49:13.977003+0000, chain.objs.size()=1 2024-09-14T12:09:54.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.003+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.250__shadow_.V7p9xHhJp8SO093yZJheFrVooHzW-RU_0 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2048851796418755449', time=2024-09-14T13:49:58.853398+0000, chain.objs.size()=1 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Am965SVrqSRJM0w7L5Am1uaaRM10mAG_0 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13688047705545066038', time=2024-09-14T13:49:58.993252+0000, chain.objs.size()=1 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AzqHJk_vL1sNv49Ufig90oH9X7Ku12n_0 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13277371313243133203', time=2024-09-14T13:49:59.533574+0000, chain.objs.size()=1 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.uqXMtVILLA70_o4e3WbMXYg35NOcr8Z_0 2024-09-14T12:09:54.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5428336829314187066', time=2024-09-14T13:49:59.820988+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vNkcPbFJn6syEl9zuUvpI0bPyYHJfO9_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6370919585790567521', time=2024-09-14T13:50:00.487700+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EeZa_Nm23_62pnj1f3ZtqR1nMKU11he_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8241515935974176087', time=2024-09-14T13:50:00.769955+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sTKKyp5__7djX-AYm4Yu5LokxSPutX1_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.666904519802137097', time=2024-09-14T13:50:00.779196+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vq0Xu00xZXvvy19xUalQtzehUsf2Ir-_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14479088862705560076', time=2024-09-14T13:50:00.923203+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vkTt9TdxGDqgWmDms71qoKny3-_Z6JA_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11653713649997115848', time=2024-09-14T13:50:01.108108+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GXdB6aMI2X_v7lbl6SUGMlw1UaAQoc-_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18294842385812925541', time=2024-09-14T13:50:01.297967+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VMeOVAUHtlOTFLnTKfMg_znajEqFfqo_0 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3506373833819472402', time=2024-09-14T13:50:01.442434+0000, chain.objs.size()=1 2024-09-14T12:09:54.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.007+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UeO0WR7xkKHhzs8U7I7vxt0AgcHM6-z_0 2024-09-14T12:09:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.012+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16382171480896399737', time=2024-09-14T13:50:02.249798+0000, chain.objs.size()=1 2024-09-14T12:09:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.012+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KuoOTiQMR13p3GLxTR6hLT8iXPZfpy__0 2024-09-14T12:09:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.012+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12450935687126775633', time=2024-09-14T13:50:02.599337+0000, chain.objs.size()=1 2024-09-14T12:09:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.012+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FAMtnn5eMLQDCIOpXRBS0GQYus7pBJG_0 2024-09-14T12:09:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.012+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7085101654488459106', time=2024-09-14T13:50:02.600102+0000, chain.objs.size()=1 2024-09-14T12:09:54.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.012+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CeIa4L0BIbcWnSjLoXfRiV-rT8h5Gxr_0 2024-09-14T12:09:54.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.013+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6386871618591510527', time=2024-09-14T13:50:02.828437+0000, chain.objs.size()=1 2024-09-14T12:09:54.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.013+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RuPLrf4d6acIVWO7XWkvBgrqKUlS4Ug_0 2024-09-14T12:09:54.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.013+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6139124086345748713', time=2024-09-14T13:50:03.614544+0000, chain.objs.size()=1 2024-09-14T12:09:54.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.013+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nlNovz6aHLN6Ymj4LPTkr9zLGLxJFzx_0 2024-09-14T12:09:54.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5757312977784524334', time=2024-09-14T13:50:03.856905+0000, chain.objs.size()=1 2024-09-14T12:09:54.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.q2KYCz1ZzwALlm0FSHgGrHI0KvRY2cy_0 2024-09-14T12:09:54.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8337605897437054512', time=2024-09-14T13:50:03.884599+0000, chain.objs.size()=1 2024-09-14T12:09:54.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sD1mH_Cc6qA5VQzK48r92eTGTyJY14X_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14937525650052617178', time=2024-09-14T13:50:03.997562+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RQL0Zd64XZHv6F76ls9MX6M7ISv7gLC_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.283452637142202215', time=2024-09-14T13:50:04.297075+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Ld0Htqc2QToZbOsfDSP1jXZASuPG6HZ_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7509529177244435748', time=2024-09-14T13:50:04.299517+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.s9nDIBlOy9mFJnPkyspgYRXeE43XE4W_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7460951649686859139', time=2024-09-14T13:50:04.998472+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lOALnVN_WazUGV48R-DBmq71Ifa5k-5_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2599182219820770589', time=2024-09-14T13:50:05.384286+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5foqXCDIe3qcxyr94jGzWn4Udp38ZT4_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2346669165024469867', time=2024-09-14T13:50:05.510597+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6RfALHEt0h0yVhDSwlaV8YA9UoOnbxW_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7744674186833494847', time=2024-09-14T13:50:05.729586+0000, chain.objs.size()=1 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.015+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NehS72DPj88g5Sxf2XL4bCl_95qJEv7_0 2024-09-14T12:09:54.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.016+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6218294870998621540', time=2024-09-14T13:50:05.734677+0000, chain.objs.size()=1 2024-09-14T12:09:54.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.016+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gaQm4JeTWEXtBGYWacIWol_nX-_GSPz_0 2024-09-14T12:09:54.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.016+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3823467602435083199', time=2024-09-14T13:50:05.769931+0000, chain.objs.size()=1 2024-09-14T12:09:54.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.016+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mc4Bt-oAECwHrK00LGlKnl7IFE3Tz9R_0 2024-09-14T12:09:54.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.019+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17868138843291704213', time=2024-09-14T13:50:05.856592+0000, chain.objs.size()=1 2024-09-14T12:09:54.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.019+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lFqEsPI5NET_X2uHRL2yC_lGGnAh0Cp_0 2024-09-14T12:09:54.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.019+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6339850322334827523', time=2024-09-14T13:50:06.204599+0000, chain.objs.size()=1 2024-09-14T12:09:54.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.019+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Uu7wNLFqnWSZSY0ycjjaE1eNv-5wcr2_0 2024-09-14T12:09:54.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.019+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4345361179174299260', time=2024-09-14T13:50:06.300687+0000, chain.objs.size()=1 2024-09-14T12:09:54.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.019+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rzrQVnRKoNqbp2t5sRIJ10O-DOEuBjR_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2327903081989738043', time=2024-09-14T13:50:06.537845+0000, chain.objs.size()=1 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3gg_jUpImlVdBIkYLfqNab7_1TGR2eb_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17229492626964686969', time=2024-09-14T13:50:06.826316+0000, chain.objs.size()=1 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.REIhHT0sWA3f7ccI5ye-Z0aCo6ZxntD_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10734791355575687484', time=2024-09-14T13:50:06.957137+0000, chain.objs.size()=1 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ymih8AmVHtXVaUOElX8IZsBl53XMUdI_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15442036885674092801', time=2024-09-14T13:50:07.064901+0000, chain.objs.size()=1 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eaxXEUOaVWDM2y4yN63Qy_kKlPBQx77_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.357143183176204621', time=2024-09-14T13:50:07.708078+0000, chain.objs.size()=1 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TUV-2ep4nz28tfsFWv-JVhfnCV-Et8l_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16374630301125187551', time=2024-09-14T13:50:07.708959+0000, chain.objs.size()=1 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YW_EsLKzvKT6peeaWdNjtLEuzMwC5TU_0 2024-09-14T12:09:54.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17958416468075658485', time=2024-09-14T13:50:07.902061+0000, chain.objs.size()=1 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IZyxW3mgfAAq6lZ7g9j9H58awbA_YXw_0 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1945208199682037438', time=2024-09-14T13:50:09.346400+0000, chain.objs.size()=1 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.37Xt5c4XG9_n4051rs4UQ21czXanqz9_0 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1088440931418069469', time=2024-09-14T13:50:09.869878+0000, chain.objs.size()=1 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Yxrm-2TQzMPBgQkeBjxGgXJyHrUSjUY_0 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13800367339404970380', time=2024-09-14T13:50:11.658217+0000, chain.objs.size()=1 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.021+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.265__shadow_.52F0XpaOZph0kxh6AG3yVzbu7W3x1PA_0 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.022+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9359037304908355983', time=2024-09-14T13:50:19.522362+0000, chain.objs.size()=1 2024-09-14T12:09:54.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.022+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.278__shadow_.vrHdt2-t87ekQ0-DRyGQ1Uat4j5vmw6_0 2024-09-14T12:09:54.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.871478468860598992', time=2024-09-14T13:50:20.757054+0000, chain.objs.size()=1 2024-09-14T12:09:54.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.280__shadow_.1UUblNMN5U5JKk1m5mdzIXCiHbyWvca_0 2024-09-14T12:09:54.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9157163882767202354', time=2024-09-14T13:50:21.388502+0000, chain.objs.size()=1 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.281__shadow_.yj75I_LGIhvnjRzk33Zstd3SZkb2pR6_0 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10282071487167410033', time=2024-09-14T13:50:22.014769+0000, chain.objs.size()=1 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.282__shadow_.jsa_VscEOVGoO8c5b8qlWGBaEpiHx8y_0 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15745685349375188327', time=2024-09-14T13:50:23.997119+0000, chain.objs.size()=1 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.285__shadow_.LWPz3ce8-uiMkfESGjvl4GX_9JKrqFk_0 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1806692786207205675', time=2024-09-14T13:50:26.549072+0000, chain.objs.size()=1 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.289__shadow_.3F9LSTaSbNVRRUEIN-J547RjcKU4XhU_0 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9917393087828751207', time=2024-09-14T13:50:29.866944+0000, chain.objs.size()=1 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.CH580Jwv7q7W-AkwRC-kzTiR-M2Ea-y_0 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16230787819501329204', time=2024-09-14T13:51:30.945922+0000, chain.objs.size()=1 2024-09-14T12:09:54.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.025+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gNgpDOIWzXdLntFNdtUxrE4vYCZlpNM_0 2024-09-14T12:09:54.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12184984001847367564', time=2024-09-14T13:51:31.709783+0000, chain.objs.size()=1 2024-09-14T12:09:54.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.HpW7Ch-UWOXLK2ZyPfCpuM0JY-zBy47_0 2024-09-14T12:09:54.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6545744314151810306', time=2024-09-14T13:51:32.941547+0000, chain.objs.size()=1 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bK92dfntjstd95HySJ-irF0sUr1p80c_0 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13393898226910802297', time=2024-09-14T13:51:32.967405+0000, chain.objs.size()=1 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.H1IVz0ym6YB8KlENo_e33mEXDjd5MbS_0 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4955695561282404721', time=2024-09-14T13:51:33.788785+0000, chain.objs.size()=1 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OTl-CKE6yFjigUYS0fFVxNy1AW17tFF_0 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6264344161305216360', time=2024-09-14T13:51:33.789465+0000, chain.objs.size()=1 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6D78zNCmxriANwvUst0Hkrjq2qlr7ZE_0 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15419635621247326749', time=2024-09-14T13:51:34.685294+0000, chain.objs.size()=1 2024-09-14T12:09:54.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.028+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.h7CfcDwNPyqqGdWG9G13kacq-SSNSJ9_0 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16822596866260486858', time=2024-09-14T13:51:34.784026+0000, chain.objs.size()=1 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zmeWL37RDJSMsU8gCRcrYTRpOL7oLE3_0 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13521794471837440285', time=2024-09-14T13:51:34.851677+0000, chain.objs.size()=1 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._-ann6WicoJ0-NOwOI5qYM8-rrum83N_0 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15632194004908035907', time=2024-09-14T13:51:35.368692+0000, chain.objs.size()=1 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wr21PHwClwFMxo1sMKOf_sdNm3lLTfJ_0 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8541787218987677611', time=2024-09-14T13:51:36.041487+0000, chain.objs.size()=1 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.029+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YCDT4NKwWjUK5yZ2BMRpg_VoavR4RFv_0 2024-09-14T12:09:54.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.030+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14675932997700485106', time=2024-09-14T13:51:36.402069+0000, chain.objs.size()=1 2024-09-14T12:09:54.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.030+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e9PLh5jw53YjzL-rG40PkhJqtQ15B08_0 2024-09-14T12:09:54.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.031+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.236981829004157584', time=2024-09-14T13:51:37.161124+0000, chain.objs.size()=1 2024-09-14T12:09:54.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.031+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xsSBNbFxLreaMUMZGWJphyobU2bilHl_0 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.033+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1567693857272437515', time=2024-09-14T13:51:37.343153+0000, chain.objs.size()=1 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.033+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.uGnXNWGpBrOMcNwQwLiDBx1DgPNsiQ-_0 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9489906184387235027', time=2024-09-14T13:51:37.609526+0000, chain.objs.size()=1 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ycVMq0I4VMxKddg6EpOxTMNiy2tznDa_0 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13302023950572444860', time=2024-09-14T13:51:37.875915+0000, chain.objs.size()=1 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IW5rjGX-_2uyJn1xFx-gFawopRi2Zfx_0 2024-09-14T12:09:54.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18149642630215175839', time=2024-09-14T13:51:38.407441+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qJZ_mIlsUsdKN3rOEvXTg2Kkt0dFH0P_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7109940941819643258', time=2024-09-14T13:51:38.896887+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.AuNmqhsCujoSJ2FlLjwSjk_KzwlHNNO_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2516993554928629255', time=2024-09-14T13:51:38.897429+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BFI0bsC295RLfPIRysDZCFfEdhGENwB_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7982085468683276077', time=2024-09-14T13:51:39.282776+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.b4dVYuh7f5n3sLJ1W9DvJ6PcZii_yZA_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1607880999627084041', time=2024-09-14T13:51:39.846098+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.k-MamTMNbYTlBQW2ZDMJ9a9rvS887C6_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3072913058714957409', time=2024-09-14T13:51:39.969393+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xnr3-N5kuzsN91pWcsZfhzZoBUvw1dq_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6348876915284477927', time=2024-09-14T13:51:39.996301+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6Um-Ip3s0wRZy4MMnwUgtQUgJ1IjOYu_0 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17778491310173196924', time=2024-09-14T13:51:40.092313+0000, chain.objs.size()=1 2024-09-14T12:09:54.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.034+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ipesTXaIIZpOK1yu2H7n0Gr2XkvEbfN_0 2024-09-14T12:09:54.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.036+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7706246876002673144', time=2024-09-14T13:51:40.107407+0000, chain.objs.size()=1 2024-09-14T12:09:54.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.036+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Zdhcw3GhbPJW053K9fxPiobXAnSC9gf_0 2024-09-14T12:09:54.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.036+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13028514167513239065', time=2024-09-14T13:51:40.234978+0000, chain.objs.size()=1 2024-09-14T12:09:54.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.036+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Q1GnBFsnZEMllljA6Z1_oGoDPDVi8u6_0 2024-09-14T12:09:54.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.038+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1404012111474900165', time=2024-09-14T13:51:40.702762+0000, chain.objs.size()=1 2024-09-14T12:09:54.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.038+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OhwxpNaLqDLCPI70aWj9FS8oGNPb_yf_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18073147147939307147', time=2024-09-14T13:51:41.846592+0000, chain.objs.size()=1 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GjtugcevNa6zeRqDj20kCTTE3IlnvgN_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12958343321034394006', time=2024-09-14T13:52:21.409911+0000, chain.objs.size()=1 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LA6AA4-OCwRMNg6qK1g08Psfk1L9jtY_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7745792998062084176', time=2024-09-14T13:52:21.561884+0000, chain.objs.size()=1 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.K7gdMeEaBNuqRiUN8f1KD7B6ylEtJ0R_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12315324473807249175', time=2024-09-14T13:52:21.634494+0000, chain.objs.size()=1 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DG4_Q9LHJLTaG5jcdRVi0YAI6Ou8PQI_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17025055493012602057', time=2024-09-14T13:52:22.004301+0000, chain.objs.size()=1 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.okc8-063HOpmKDygws78jFcZS9Lv637_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10341850974093632816', time=2024-09-14T13:52:22.060506+0000, chain.objs.size()=1 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZiyVvJgh6SmnuwfMkEJXZ8BVgI7NLVt_0 2024-09-14T12:09:54.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1429427122202579505', time=2024-09-14T13:52:22.694647+0000, chain.objs.size()=1 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gFB_t0cI9fYkmYtq3X5uDIl4bZDwptm_0 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5137812460294832983', time=2024-09-14T13:52:22.839734+0000, chain.objs.size()=1 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BJe6JUIZ0ovcKJnwjmOPaPFf6SDrLBZ_0 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3415555416881408246', time=2024-09-14T13:52:23.176189+0000, chain.objs.size()=1 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.039+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.L7xyOR4fGwWvgIn-hix6Q5Jttq5MXiM_0 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.040+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1240768470802311598', time=2024-09-14T13:52:23.292410+0000, chain.objs.size()=1 2024-09-14T12:09:54.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.040+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MXrsm_puX6d6P0KmOZ03a01nBpkv-C6_0 2024-09-14T12:09:54.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.041+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11532319095837349984', time=2024-09-14T13:52:23.556724+0000, chain.objs.size()=1 2024-09-14T12:09:54.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.041+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AcQtmjq49VBAAKYXxcYfbsIWIavMTPw_0 2024-09-14T12:09:54.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.041+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17905569228577164314', time=2024-09-14T13:52:23.573048+0000, chain.objs.size()=1 2024-09-14T12:09:54.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.041+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vB3G0iLPVR9rxbFmeDDBja3OlKSxpRO_0 2024-09-14T12:09:54.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.043+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11805950519764731864', time=2024-09-14T13:52:24.244826+0000, chain.objs.size()=1 2024-09-14T12:09:54.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.043+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wJIDFJNLS8xpm3i-NgRGQFKBcWFc6Qt_0 2024-09-14T12:09:54.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.043+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17655844902836794281', time=2024-09-14T13:52:24.512353+0000, chain.objs.size()=1 2024-09-14T12:09:54.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.043+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0t-ZFLirYgT0xBgcMeiMgQO-oAoW5di_0 2024-09-14T12:09:54.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.043+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14093646979423214219', time=2024-09-14T13:52:24.586508+0000, chain.objs.size()=1 2024-09-14T12:09:54.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.043+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.h0fANgwgeEUxbYgHhOYNKm553gZIvX8_0 2024-09-14T12:09:54.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.046+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48627 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=45, truncated=0, next_marker='' 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5021585689880493787', time=2024-09-14T13:52:24.636255+0000, chain.objs.size()=1 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PQEqO73-CYAKwZI5rX2WyaNy3-bce-d_0 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17297034196296236589', time=2024-09-14T13:52:24.784743+0000, chain.objs.size()=1 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4PiOvBleEXxcPr3LFYx4YqCTrO-03ek_0 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.455263045819910761', time=2024-09-14T13:52:24.861328+0000, chain.objs.size()=1 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4sEGeMnCS9oy6d5kSeEy0VcZUp4xMIk_0 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11618598240135117853', time=2024-09-14T13:52:25.718388+0000, chain.objs.size()=1 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6MjdvylUptv3EMqFhJ4MEXT3IdNBa9e_0 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16708937567930405761', time=2024-09-14T13:52:26.173701+0000, chain.objs.size()=1 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5MkWdZYYk4YV1HGRde9AXovMgwo8MDR_0 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4819763958075277481', time=2024-09-14T13:52:26.243069+0000, chain.objs.size()=1 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ll8RpDtBz-y7GkT4NdJ-tmJYiWml950_0 2024-09-14T12:09:54.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18394093933950419939', time=2024-09-14T13:52:26.474506+0000, chain.objs.size()=1 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LSYgA3k-HiKsYpoS8aSnyd_vfixg36k_0 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7891538482917485209', time=2024-09-14T13:52:27.340722+0000, chain.objs.size()=1 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cIj7-jpl_e8Jy6ZIKe6iRuXXAaeuVPI_0 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17279635615780070565', time=2024-09-14T13:52:27.372385+0000, chain.objs.size()=1 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5xD_ypk6funRyp6JeGvIPFycLqrBsAj_0 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12888557306636760159', time=2024-09-14T13:52:27.421595+0000, chain.objs.size()=1 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-ZAUIJFHkjDPMFI5D35VJ2PsjlgrFY4_0 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13575318566971245967', time=2024-09-14T13:52:27.860868+0000, chain.objs.size()=1 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.048+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fi6MB7RNt4FprTRUbJoSMRSXDZdX_zc_0 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.049+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16991847780818137006', time=2024-09-14T13:52:28.201568+0000, chain.objs.size()=1 2024-09-14T12:09:54.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.049+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ACg7JF6eHBexDXxd9_Yl31Rl7cRAOw1_0 2024-09-14T12:09:54.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.052+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14456004042442052347', time=2024-09-14T13:52:28.271984+0000, chain.objs.size()=1 2024-09-14T12:09:54.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.052+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jEMSZLRlOoa8BxQkw_SP13q8BaGbBR4_0 2024-09-14T12:09:54.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.053+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7162433399210781852', time=2024-09-14T13:52:28.669245+0000, chain.objs.size()=1 2024-09-14T12:09:54.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.053+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.156Q7ZRZKvSSQJN8RhMjpwf_5nZLQv2_0 2024-09-14T12:09:54.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3501015809451415823', time=2024-09-14T13:52:28.820495+0000, chain.objs.size()=1 2024-09-14T12:09:54.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LwRnI3XXVyLuQQrTe_DzkGHOIEfpRVa_0 2024-09-14T12:09:54.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5270877979332212021', time=2024-09-14T13:52:29.129932+0000, chain.objs.size()=1 2024-09-14T12:09:54.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IXpJlc8vxc-MBAm4b8CYmdW86vTEjcI_0 2024-09-14T12:09:54.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7428425672248751621', time=2024-09-14T13:52:29.164822+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jxUQwR_4CYQt8pbEeJCoIjkaas-6av3_0 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3315630627351864736', time=2024-09-14T13:52:29.209458+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7Vu9orc8UOwmdjjHkHe7EvHDcSoK5Tl_0 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16282137634851351528', time=2024-09-14T13:52:29.443040+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.S1aG0sXYF3WJ-FRo70uIAklwzYZhBkk_0 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1914006291565800183', time=2024-09-14T13:52:30.386828+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wAlar-8WfEipk2ZyZdWGlspGx-j3wCU_0 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4710623947746277053', time=2024-09-14T13:52:30.513913+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EBhHzWcvHyDY41ZsuGUlDO0YcM1x952_0 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16600936497351740631', time=2024-09-14T13:52:30.514462+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VxF3RKRej16CBt1OV3fkVBQHK6KhlaX_0 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3049497538414174045', time=2024-09-14T13:52:31.071377+0000, chain.objs.size()=1 2024-09-14T12:09:54.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.054+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.N-BleNxyGeUR19mNTYSWsxz5knOd6C2_0 2024-09-14T12:09:54.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13971491976025503366', time=2024-09-14T13:52:31.621904+0000, chain.objs.size()=1 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.1-mNv3soFKMvZijbzlOZnMry3jjGLaP_0 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4006097661713275788', time=2024-09-14T13:52:31.656042+0000, chain.objs.size()=1 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kKog986GeBamDwSFZL-GD8pUlKmYIvw_0 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12786053364767994683', time=2024-09-14T13:52:31.774348+0000, chain.objs.size()=1 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UNIvFTKxzbQwCKAYLBvkRRHON0zs9hi_0 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6968519704679180528', time=2024-09-14T13:52:32.036909+0000, chain.objs.size()=1 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.058+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.awNYXw4DBNTbWBnChfR045EFfHP-EBJ_0 2024-09-14T12:09:54.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11238839076846854428', time=2024-09-14T13:52:32.037674+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iNYMlP3SOmbjdsdwfX2k8AZu1m2rq6D_0 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4290576488389495830', time=2024-09-14T13:52:32.105038+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tFPCgOsqH5zh5qGyMyhzWxVsQgxQbCY_0 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1350490054319024380', time=2024-09-14T13:52:36.340997+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.332__shadow_.kAo7mA15wgECbdyb3xHHEjM2xi7rveI_0 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4872534482415072327', time=2024-09-14T13:52:38.805114+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.336__shadow_.xo8-9a_-V8LMbZE7jxodC7pBoYomy_Q_0 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2640248621875957941', time=2024-09-14T13:52:42.027729+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.342__shadow_.3rzMsCfkc8pbT4ygY9yZl08aSuHj9_5_0 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8221058722102628169', time=2024-09-14T13:53:45.670337+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.455__shadow_.Rg6VIQFaCl5xa7Pu-vLvgY-eH4brRzQ_0 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4435567552040723445', time=2024-09-14T13:54:02.557057+0000, chain.objs.size()=1 2024-09-14T12:09:54.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.059+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.CssZRT99FrWhRm0QEuWSumfjZ1Rbsc6_0 2024-09-14T12:09:54.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14559860166561135115', time=2024-09-14T13:54:37.807060+0000, chain.objs.size()=2 2024-09-14T12:09:54.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.517__shadow_.FzQB_a1troe8B2pPKZFXYP3EOO6IcoY_0 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.517__shadow_.FzQB_a1troe8B2pPKZFXYP3EOO6IcoY_1 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4080028014827897410', time=2024-09-14T13:56:06.915395+0000, chain.objs.size()=2 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~t6T-kzTcGxbteoi3ydI205pZjAJDy9v.1 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~t6T-kzTcGxbteoi3ydI205pZjAJDy9v.2 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16324493939496201913', time=2024-09-14T13:56:17.976832+0000, chain.objs.size()=2 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~kuSy-jzJzm9LO-S6uSL0GQfFzkPwBFD.1 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~kuSy-jzJzm9LO-S6uSL0GQfFzkPwBFD.2 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9430342237786495754', time=2024-09-14T13:57:30.866815+0000, chain.objs.size()=1 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.556__shadow_.8NfDVD-r49p9rA1DuTU6QilTmNZmQy7_0 2024-09-14T12:09:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3009109617652157931', time=2024-09-14T13:57:32.712247+0000, chain.objs.size()=1 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.557__shadow_.-ZZ43ZH63NXgClMkJMThnRZpFHxkkD9_0 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16116530929777640020', time=2024-09-14T13:58:14.359505+0000, chain.objs.size()=1 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.576__shadow:UIbD.39ZKIwyqFfoJJdxSGTd7Xlbgr6_.pPWxu3btrQnLIvsujPDZ0MkdSFngSfZ_0 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11491561139272260634', time=2024-09-14T13:58:24.563159+0000, chain.objs.size()=1 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.064+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:8KwlQ1wbHsixPBVk9qRiF-yQOlixkDb_.ryO516fY8FVdVXLsIjsrDt30p5A3b55_0 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.065+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9241349718785784037', time=2024-09-14T13:58:57.478497+0000, chain.objs.size()=1 2024-09-14T12:09:54.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.065+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:fHbIaWgxXwr5whlZPM.0sw4dLBoPf0F_.GlqVSPi6Lb1kRE9bcAEeEkM8QSRHNBb_0 2024-09-14T12:09:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.067+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11215163202181134350', time=2024-09-14T13:59:03.725539+0000, chain.objs.size()=1 2024-09-14T12:09:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.067+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:q1O6dqmwyTqtoxxdumDEn8UMJepEgFQ_.zbvwNjYzUICb_r3UaFoBLOvoaSpEDB0_0 2024-09-14T12:09:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3848327303905573569', time=2024-09-14T14:03:17.924108+0000, chain.objs.size()=1 2024-09-14T12:09:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.646__shadow_.GEUejxG_Mt_cUr76eAhcdVRar4nC75O_0 2024-09-14T12:09:54.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.068+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7365753895204752677', time=2024-09-14T14:04:16.125706+0000, chain.objs.size()=1 2024-09-14T12:09:54.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.068+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.707__shadow:xUXpmc57mzp46elUXo1oA2WzwI0X4vv_.5GZxyCWVyU0rsWbzUGbvCBuiUMDFCNe_0 2024-09-14T12:09:54.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.072+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.075+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T12:09:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.076+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.076+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48310' 2024-09-14T12:09:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9550515585748572796', time=2024-09-14T13:46:47.366631+0000, chain.objs.size()=2 2024-09-14T12:09:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.IEj4Dy_kG_KsE-1hgRsDvKf94_K6a-2_0 2024-09-14T12:09:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.IEj4Dy_kG_KsE-1hgRsDvKf94_K6a-2_1 2024-09-14T12:09:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_b4vGxyvxcPdDkWLvXIlGV7_IsDTuK4k', time=2024-09-14T13:47:01.563071+0000, chain.objs.size()=2 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.165__shadow_.8Kn3iBBG3dwmoPDZ5M228POUI0XWYt3_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.165__shadow_.8Kn3iBBG3dwmoPDZ5M228POUI0XWYt3_1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4314102744551138139', time=2024-09-14T13:47:01.946540+0000, chain.objs.size()=1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.166__shadow_.29IMSKzSiWygc7HO9dUb8YZNXAI-5L3_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11514821337307763061', time=2024-09-14T13:47:13.775837+0000, chain.objs.size()=1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.177__shadow_.gaLFLOJ0veRDY1yO3Bps6N5Ae53bY3y_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4364790584296487789', time=2024-09-14T13:49:07.796625+0000, chain.objs.size()=1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.241__shadow_._ufkbgLx8Hx05qVaIYb8CiArbyanHhN_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14528057939725731269', time=2024-09-14T13:49:15.920807+0000, chain.objs.size()=1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.253__shadow_.RRcwFAHA923X7161QV3ju87JQJkZCLZ_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8264511890521421417', time=2024-09-14T13:49:17.164680+0000, chain.objs.size()=1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.255__shadow_.iHGXFmG_k_yWc2Hg0Lz32BLiR534zb9_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1456074012205182271', time=2024-09-14T13:49:17.807877+0000, chain.objs.size()=1 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.256__shadow_.drT5tPmDGuO2IG2CnNcTnt2FALICIB-_0 2024-09-14T12:09:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1277534934847688607', time=2024-09-14T13:49:58.899071+0000, chain.objs.size()=1 2024-09-14T12:09:54.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Qocpda2bQeWF93WSzzQA-2cMAFnaMX7_0 2024-09-14T12:09:54.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5829462194023310114', time=2024-09-14T13:49:58.959434+0000, chain.objs.size()=1 2024-09-14T12:09:54.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.077+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-LHWLaUOusbqQ8O6UhFl4Fh96MZbPgS_0 2024-09-14T12:09:54.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2485223489060009537', time=2024-09-14T13:49:59.322955+0000, chain.objs.size()=1 2024-09-14T12:09:54.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GEbRPfyvFW7kE7FrrFzdtpYubwENYQM_0 2024-09-14T12:09:54.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8627682546971948537', time=2024-09-14T13:49:59.354175+0000, chain.objs.size()=1 2024-09-14T12:09:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mUkxYTI-64oJZff635r936XRGwRt8Wj_0 2024-09-14T12:09:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5013852564371275202', time=2024-09-14T13:49:59.489705+0000, chain.objs.size()=1 2024-09-14T12:09:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-O-iX1kY7E-Nf5E2JkII-DtnJUwG95p_0 2024-09-14T12:09:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13767070323404167324', time=2024-09-14T13:49:59.780853+0000, chain.objs.size()=1 2024-09-14T12:09:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.081+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BTWzyDK55YDPMagfC8eqX5Ng9vwEL-S_0 2024-09-14T12:09:54.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16084940528091935994', time=2024-09-14T13:50:00.499256+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.phLlUMsFjVf0O5Jq9uaEHtHBNhJ8VAv_0 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15412478719502192095', time=2024-09-14T13:50:00.586706+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.78BoD_DMzLelJQ9T2XJTZNfKLnY3Bnu_0 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9487076904080250339', time=2024-09-14T13:50:00.644902+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dp3Nb24NVR-no6RgKL4l270D1mpwxQA_0 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1260876997172806359', time=2024-09-14T13:50:00.645532+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1EAekeGBaQNTiGAAg1693qjunAbzV_K_0 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14076764359513403234', time=2024-09-14T13:50:00.805564+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Yixk6D5_5kjMMkP_5mw1i20XsddNBxR_0 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17732286669683832084', time=2024-09-14T13:50:00.806549+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AP3QQBcU5pSkUcl88I5U1tKWpeexvRk_0 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18155373342549381915', time=2024-09-14T13:50:01.046748+0000, chain.objs.size()=1 2024-09-14T12:09:54.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.082+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fB1dx03-fWFjOuWjuUM0V30W9Xvxrsb_0 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7666916940666398781', time=2024-09-14T13:50:01.463979+0000, chain.objs.size()=1 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qs9j47LYNbH6YOOUL8RtIe1XQ_eF0GO_0 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14973036951623159335', time=2024-09-14T13:50:01.498658+0000, chain.objs.size()=1 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FkNXGZ8xiRt8gU6x8gwod_YeVE0vd2-_0 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7311719309148228941', time=2024-09-14T13:50:01.985324+0000, chain.objs.size()=1 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KHMisRSHEgQEDlX4njgGDQAuIDW6F-e_0 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10332449036719772554', time=2024-09-14T13:50:02.251517+0000, chain.objs.size()=1 2024-09-14T12:09:54.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.084+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ReqvxuhAmteXFPBk-fOL_HFVMe0Wd2H_0 2024-09-14T12:09:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1754141513073660317', time=2024-09-14T13:50:02.635193+0000, chain.objs.size()=1 2024-09-14T12:09:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KnhrTRMmaMyPLGP5pTJtBUgKLw0MH1e_0 2024-09-14T12:09:54.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17283280274091603882', time=2024-09-14T13:50:02.783776+0000, chain.objs.size()=1 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.O7_7kjKFkJmYu3DJS-XbsZwnU2ZMzlz_0 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8116024489972464642', time=2024-09-14T13:50:03.852206+0000, chain.objs.size()=1 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LLkGoFqhwJkNKf0xnfPMXEK4d_vzqBV_0 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16232387952153949876', time=2024-09-14T13:50:04.442089+0000, chain.objs.size()=1 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EW87mdnRbqzMmbhF9x79o-eHoKqpzmm_0 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6362573892219598433', time=2024-09-14T13:50:04.460539+0000, chain.objs.size()=1 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Qj8WXiMQzBbjcIXca50SEo3cMyHh8Xo_0 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15860166738796234131', time=2024-09-14T13:50:05.503392+0000, chain.objs.size()=1 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.g0an4_Q-465sSrtlJZPvl5kTP5lJmxW_0 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14432952059607988247', time=2024-09-14T13:50:06.244924+0000, chain.objs.size()=1 2024-09-14T12:09:54.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.086+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-1WhNM2nqNfF1gUcrUb92YNXUXzu3cU_0 2024-09-14T12:09:54.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.088+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4320449628452854852', time=2024-09-14T13:50:06.421509+0000, chain.objs.size()=1 2024-09-14T12:09:54.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.088+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MDl7YMSYbapv32UtwyGbb4VK5-PaoZ-_0 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14234400599475314244', time=2024-09-14T13:50:06.513217+0000, chain.objs.size()=1 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vfRxJUqaaN29LCDmFy53szn5B00Ifaz_0 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7068790160176656630', time=2024-09-14T13:50:07.216823+0000, chain.objs.size()=1 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ocCoXhYdByuAGEdZiDyTwfZW4gK-69f_0 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11624768537222068023', time=2024-09-14T13:50:07.586252+0000, chain.objs.size()=1 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MjL--nyonaM-EAllhGy2R5ZfMwN3M0k_0 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3497324138059948624', time=2024-09-14T13:50:07.587193+0000, chain.objs.size()=1 2024-09-14T12:09:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.089+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BPe5d-KG1Zd50F0arK6875kfr3T2h9C_0 2024-09-14T12:09:54.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17445097564290729896', time=2024-09-14T13:50:08.243230+0000, chain.objs.size()=1 2024-09-14T12:09:54.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RQdYD6aDgVg6CBeBr2qKUiql_eE2OZD_0 2024-09-14T12:09:54.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3640238972503075955', time=2024-09-14T13:50:09.044919+0000, chain.objs.size()=1 2024-09-14T12:09:54.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Cr_a35KOUj59_pM82tKn0qwWw1ljmMD_0 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8073238427536926285', time=2024-09-14T13:50:09.084951+0000, chain.objs.size()=1 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.r7be6hVxRT2IJtAk9Fhy-CD6ykcqHxG_0 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7824805380934026464', time=2024-09-14T13:50:09.188954+0000, chain.objs.size()=1 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TzhE6ZkawT8XDzuJrVE6Vm6LLYE5Xxd_0 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17952856587255004912', time=2024-09-14T13:50:09.232519+0000, chain.objs.size()=1 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8WoPIxPABw6q1zcMMhMfis7haN7HaMO_0 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17568676081313804889', time=2024-09-14T13:50:09.347859+0000, chain.objs.size()=1 2024-09-14T12:09:54.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.091+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HWRtRLr90vRZXPi2q74XXjV5uk8mknM_0 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15527792853763966745', time=2024-09-14T13:50:09.465040+0000, chain.objs.size()=1 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.s3e3c_DBXyATyVVxGEMEvtcbNY5n6Gi_0 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14515864303302830625', time=2024-09-14T13:50:09.518839+0000, chain.objs.size()=1 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3PnUN1SkxjbLaMJrwoKYlsXGBcCiH2m_0 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4693586003423701484', time=2024-09-14T13:50:15.212359+0000, chain.objs.size()=1 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.271__shadow_.QWN61l_Xm1e03zgYJXAnrxymrPFczec_0 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3162463318652928804', time=2024-09-14T13:50:20.757751+0000, chain.objs.size()=1 2024-09-14T12:09:54.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.280__shadow_.zEJ677q3CZohPH6V8xT3bBIF3Uy3Ngq_0 2024-09-14T12:09:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15389093629282844547', time=2024-09-14T13:50:25.926974+0000, chain.objs.size()=1 2024-09-14T12:09:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.288__shadow_.qDnh-y6PNX9QYHMSaM6sW-M3fe0sBZw_0 2024-09-14T12:09:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16519929533238921119', time=2024-09-14T13:50:29.878820+0000, chain.objs.size()=1 2024-09-14T12:09:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.094+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.MyYvXR4ot603Vb44jMijFFxaoBNnFiB_0 2024-09-14T12:09:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.095+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8498812850827400690', time=2024-09-14T13:50:38.341254+0000, chain.objs.size()=1 2024-09-14T12:09:54.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.095+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.303__shadow_.JclY4lVwx2QrN2WUzk30BpYByu4gPDp_0 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16576249873680259796', time=2024-09-14T13:51:30.692859+0000, chain.objs.size()=1 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3DvHKyLQBHTy-UWTDBu9wyf21PUBAtF_0 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1843157891513996388', time=2024-09-14T13:51:30.693730+0000, chain.objs.size()=1 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DJekAm4M0dnPcvfOuCCZij2NgMDs3hp_0 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.668191933438791909', time=2024-09-14T13:51:30.825464+0000, chain.objs.size()=1 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.F--FzJ38tGvcay39sHps-i2YoF57lEr_0 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11037284539195500835', time=2024-09-14T13:51:30.880529+0000, chain.objs.size()=1 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.096+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Lx-a-z81IUJWvzU750h1fGlTymKFlrX_0 2024-09-14T12:09:54.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.097+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3413068138906583332', time=2024-09-14T13:51:31.386845+0000, chain.objs.size()=1 2024-09-14T12:09:54.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.097+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XxUlJIiG3XRhgZA4H-jqVIrFXSqrsDz_0 2024-09-14T12:09:54.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.097+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9283892950460082160', time=2024-09-14T13:51:31.387675+0000, chain.objs.size()=1 2024-09-14T12:09:54.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.097+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1fyekmqBvdGRPXOJ6XBqA95q5LUdh-Z_0 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16010869910985226677', time=2024-09-14T13:51:31.629103+0000, chain.objs.size()=1 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.leMQ88soW7gjuD375eYcSb1NPES-nhM_0 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9577903917462627854', time=2024-09-14T13:51:31.736231+0000, chain.objs.size()=1 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ulte55DSZ6vIVZIIVAxyVHc9yO_TLRb_0 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.97431144215892257', time=2024-09-14T13:51:32.416766+0000, chain.objs.size()=1 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bJAOtc0A_5bw0OnI8ARO2NkD-FkrkKt_0 2024-09-14T12:09:54.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18385328081915787789', time=2024-09-14T13:51:34.392537+0000, chain.objs.size()=1 2024-09-14T12:09:54.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.098+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BIJwqyGIQ9oItCBBkyIFD3vyjwIDN-2_0 2024-09-14T12:09:54.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.099+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17558911113283365883', time=2024-09-14T13:51:34.443206+0000, chain.objs.size()=1 2024-09-14T12:09:54.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.099+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Rc1m73JormqAxoB27Z0BnnGLHBPcz6R_0 2024-09-14T12:09:54.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8723160825143263095', time=2024-09-14T13:51:34.712401+0000, chain.objs.size()=1 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MwpKglNKfCXoejmMdToZlTwPxfQpBHj_0 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.371904573005922707', time=2024-09-14T13:51:35.343372+0000, chain.objs.size()=1 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fo2H2FsyjM8J88HekJubeLJIekK4c_J_0 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17080217482447010769', time=2024-09-14T13:51:35.373192+0000, chain.objs.size()=1 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Y3FSxuv21tGGOmZAQkjNI5xcLUiVfUM_0 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5183388692759105992', time=2024-09-14T13:51:36.289209+0000, chain.objs.size()=1 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lDLadyRulJcIwhsXwnAZ8TVJ2BlB5-X_0 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4445697144173110933', time=2024-09-14T13:51:36.822792+0000, chain.objs.size()=1 2024-09-14T12:09:54.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.100+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Yc0SW-mpclCIqExCPY7mnKbpuQhgqmg_0 2024-09-14T12:09:54.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.101+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2579868491958000164', time=2024-09-14T13:51:37.130992+0000, chain.objs.size()=1 2024-09-14T12:09:54.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.101+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.NFU9gxXBEXYwNre45zywmTzc40giwq3_0 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7740678611915421353', time=2024-09-14T13:51:37.146786+0000, chain.objs.size()=1 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.FO_qLoSZXLDb1DrK2bJuINxDs_WEvBf_0 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13582807813739003254', time=2024-09-14T13:51:37.628945+0000, chain.objs.size()=1 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TACfhTO5G3k7Ls2l1ibUdR4eE9YV4sO_0 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17004520640557160024', time=2024-09-14T13:51:37.653809+0000, chain.objs.size()=1 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PdkYDxGrR6Mv73R82I0jxWTH4Or4T9O_0 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17565262584246050204', time=2024-09-14T13:51:37.754148+0000, chain.objs.size()=1 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PhV9pWnHCUDWBNMY3qbOUy1Q06TRxRb_0 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7217014552050116783', time=2024-09-14T13:51:38.553046+0000, chain.objs.size()=1 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UgueERt4hlGlf926TQf6Xh4uFrYA7vR_0 2024-09-14T12:09:54.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14508181719216773395', time=2024-09-14T13:51:38.557861+0000, chain.objs.size()=1 2024-09-14T12:09:54.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QtoHH2sRiYRJj4imThFVLVQCTNP7R_4_0 2024-09-14T12:09:54.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5058580654416588161', time=2024-09-14T13:51:38.595803+0000, chain.objs.size()=1 2024-09-14T12:09:54.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WPzoB4sNGR9aTT0Pk7hM9xSg-iTasIO_0 2024-09-14T12:09:54.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2407523286947446510', time=2024-09-14T13:51:39.205646+0000, chain.objs.size()=1 2024-09-14T12:09:54.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.103+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.I7_GF6jfqfwdZeIQwYbXW__0oV_Rz8G_0 2024-09-14T12:09:54.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.105+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17925784071252585746', time=2024-09-14T13:51:39.350343+0000, chain.objs.size()=1 2024-09-14T12:09:54.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.105+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9k0q9ocxrbykWb-3Et0RIwmXeQNdmlA_0 2024-09-14T12:09:54.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.105+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8589492764723731805', time=2024-09-14T13:51:39.702771+0000, chain.objs.size()=1 2024-09-14T12:09:54.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.105+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.iIxBo93MOnaT0oGYn1LpiZfY25TAd0h_0 2024-09-14T12:09:54.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.105+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18105929788189072672', time=2024-09-14T13:51:40.467713+0000, chain.objs.size()=1 2024-09-14T12:09:54.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.105+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6tMWYZc4ATeV7HqTK2lVWIVxn9Puhw0_0 2024-09-14T12:09:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.106+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.616537039879381887', time=2024-09-14T13:51:41.356720+0000, chain.objs.size()=1 2024-09-14T12:09:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.106+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.VaOlUZq3xTiqxQmoymoqH4__iUPHpeE_0 2024-09-14T12:09:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.107+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14475316284234526102', time=2024-09-14T13:51:41.357590+0000, chain.objs.size()=1 2024-09-14T12:09:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.107+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hkFZ5ZLVka2C_IJxfZyYXpOOyJEsDKm_0 2024-09-14T12:09:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.107+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7064335634346737082', time=2024-09-14T13:52:21.391682+0000, chain.objs.size()=1 2024-09-14T12:09:54.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.107+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GAsrD2lwlvALaQJAvTUvMpJLSh2APdH_0 2024-09-14T12:09:54.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.108+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2826216008528337758', time=2024-09-14T13:52:21.488066+0000, chain.objs.size()=1 2024-09-14T12:09:54.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.108+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.x_xnbimtaTdPJ1uKS6l-Hv-V_9xr4vv_0 2024-09-14T12:09:54.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.108+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15435036760052045765', time=2024-09-14T13:52:21.503788+0000, chain.objs.size()=1 2024-09-14T12:09:54.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.108+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-_miNQqlIwzEjywM8OI4C9kF0yykj2a_0 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6616179043338836358', time=2024-09-14T13:52:21.807641+0000, chain.objs.size()=1 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7ovQpBvy0yuidkwcIYgPuraiBOD7C-K_0 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11722633195206923743', time=2024-09-14T13:52:22.117129+0000, chain.objs.size()=1 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AbHrgSlDIRwb508nEvjokzXKPcyRHeI_0 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16812568320466931185', time=2024-09-14T13:52:22.878325+0000, chain.objs.size()=1 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.m6tsPvnBr6hvZODJix9d7Juw2lm7jtb_0 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5358227341218285123', time=2024-09-14T13:52:23.054252+0000, chain.objs.size()=1 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ck9t1ezQfIYeB8zmoqWmARD-hfqWSlW_0 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1305153985420428979', time=2024-09-14T13:52:23.419420+0000, chain.objs.size()=1 2024-09-14T12:09:54.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.109+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2-pBkKnLnz8pChtGChT8mbW6Vn97Y4W_0 2024-09-14T12:09:54.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.110+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6291308512004802016', time=2024-09-14T13:52:24.411231+0000, chain.objs.size()=1 2024-09-14T12:09:54.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.110+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LYtoc25uuoQ3DD2fZHlfLaHhgCGkphM_0 2024-09-14T12:09:54.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.110+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6580740960796256042', time=2024-09-14T13:52:24.760495+0000, chain.objs.size()=1 2024-09-14T12:09:54.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.110+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-LKkPWj8aAQN2YhLaEjpebLzmnsFUlL_0 2024-09-14T12:09:54.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.111+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9819233023976564907', time=2024-09-14T13:52:24.803205+0000, chain.objs.size()=1 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.111+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Ab7q1405-7dcd4TBj-AyglZujiTGthw_0 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.111+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11265503215573095690', time=2024-09-14T13:52:25.720013+0000, chain.objs.size()=1 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.111+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hvKLgX-DFVvJS9DCbVU5c-M7Pdjvkia_0 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.112+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3677277378825834066', time=2024-09-14T13:52:25.915943+0000, chain.objs.size()=1 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.112+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hOwGPmfNcJKfRYTXVO-WQXb81bpeCFT_0 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.112+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14824430397011551049', time=2024-09-14T13:52:26.312553+0000, chain.objs.size()=1 2024-09-14T12:09:54.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.112+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hY-xz50pFIwgXtMmHNTXmnccHsNptcL_0 2024-09-14T12:09:54.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.112+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.488534248865268757', time=2024-09-14T13:52:26.354345+0000, chain.objs.size()=1 2024-09-14T12:09:54.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.112+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BA1PMTwMQ0Bn_udLN7_npkTrFhG9_ZB_0 2024-09-14T12:09:54.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.114+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17816508147767415401', time=2024-09-14T13:52:27.196732+0000, chain.objs.size()=1 2024-09-14T12:09:54.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.114+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-GatiBCifZ49mXn2KW23ECAJoVlGq5Z_0 2024-09-14T12:09:54.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.114+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1904142789772059372', time=2024-09-14T13:52:27.829388+0000, chain.objs.size()=1 2024-09-14T12:09:54.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.114+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9-0Z_IohFA_aydEyWemYALe8UjCc6PY_0 2024-09-14T12:09:54.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.114+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4309173290406002217', time=2024-09-14T13:52:27.944096+0000, chain.objs.size()=1 2024-09-14T12:09:54.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.114+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.h0Rzc8tibZFNAAXSw3F1qEKvnj8rw2D_0 2024-09-14T12:09:54.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.115+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.429964343716765901', time=2024-09-14T13:52:28.206601+0000, chain.objs.size()=1 2024-09-14T12:09:54.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.115+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._9CH-tWh_pDSSriFJE3KlkmSJXIbnG2_0 2024-09-14T12:09:54.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.115+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12670045834822436322', time=2024-09-14T13:52:28.836601+0000, chain.objs.size()=1 2024-09-14T12:09:54.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.115+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xDtRd7av4bct67HL7wnsLELN1LthNcz_0 2024-09-14T12:09:54.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.118+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48310 2024-09-14T12:09:54.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:09:54.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17360907729626321534', time=2024-09-14T13:52:29.141567+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dml4knoQ5_DX5OEHlnidY8U5fH19mId_0 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14459733844851563014', time=2024-09-14T13:52:30.009430+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VwQswzaEQdE3axpjw0o6NB6_-xTYUej_0 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6789169655988067791', time=2024-09-14T13:52:30.324511+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Y5rR0OzvKHaB4DT7pHUES4qtKz-jFwt_0 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16034545689013409564', time=2024-09-14T13:52:30.714437+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.bCyBqxHb-xB7upmfqYtOoNYgdn9wq_A_0 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17379336324374828984', time=2024-09-14T13:52:30.835473+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mpB7P5nxx-uytGXV4hsVrBwxKSJNIyl_0 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10394445373331258514', time=2024-09-14T13:52:31.484949+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LbfdFFFIWuBifxoojXzgQdu0B-Vf9VT_0 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3823258620575983151', time=2024-09-14T13:52:31.810418+0000, chain.objs.size()=1 2024-09-14T12:09:54.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.73dXqO_XYEkz1tkrkuRak5yR01GmaTy_0 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3224210875926919720', time=2024-09-14T13:52:32.012678+0000, chain.objs.size()=1 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.v8Eqo93bGQPUY7_x0KydqFRr17vzhr__0 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4078210853631962493', time=2024-09-14T13:52:32.052797+0000, chain.objs.size()=1 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.u_4tVPzQ0COhcKPotsdhKmjK5aRyZJS_0 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7854904665680089104', time=2024-09-14T13:52:32.168042+0000, chain.objs.size()=1 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MawtHN7TWw3Mk4XXI7pLP6w_YZBE7aX_0 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5922878317704493350', time=2024-09-14T13:53:01.215516+0000, chain.objs.size()=1 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.379__shadow_.yOJ9qhx6s8rRachuMJed4ckubg2TlS0_0 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15997234485708090057', time=2024-09-14T13:53:07.493462+0000, chain.objs.size()=1 2024-09-14T12:09:54.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.120+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.390__shadow_.IB9NGCoYRCM2gRRr_F4x89T1a-_cOfc_0 2024-09-14T12:09:54.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.123+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2441043716010393774', time=2024-09-14T13:53:50.796334+0000, chain.objs.size()=1 2024-09-14T12:09:54.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.123+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.461__shadow_.7UeKXPmRWiY71FnUv7Pf_BvZfCvPVwv_0 2024-09-14T12:09:54.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.124+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4182614633316602933', time=2024-09-14T13:54:03.283097+0000, chain.objs.size()=1 2024-09-14T12:09:54.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.124+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.484__shadow_.OdSpo_516dGk0PnoafyNe6X-fzESPPF_0 2024-09-14T12:09:54.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.124+0000 7f043364f640 0 -- 172.21.15.28:0/3563316194 >> [v2:172.21.15.204:6816/3569450741,v1:172.21.15.204:6817/3569450741] conn(0x7f0424081830 msgr2=0x7f02fc092ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11122419531759333975', time=2024-09-14T13:54:07.074027+0000, chain.objs.size()=1 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.486__shadow_.d7V8m8q8TMx-B1gNsA40iT-gwP5PFJ4_0 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7227597975453270373', time=2024-09-14T13:54:10.341476+0000, chain.objs.size()=1 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.491__shadow_.VlJI0OqkC-_7wPwHKzUbdOUVGsR2o2z_0 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3241312510817930363', time=2024-09-14T13:54:26.770075+0000, chain.objs.size()=6 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.1 2024-09-14T12:09:54.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.2 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.3 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.4 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.5 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.6 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6411919868454290650', time=2024-09-14T13:57:53.403771+0000, chain.objs.size()=1 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:KTXk8sR3OGj8Dyn08SscJT4tN0KggS3_.89t5x520Wb7-n7gsMRu4KknRdPGQG1s_0 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1130951617723002377', time=2024-09-14T13:58:06.178411+0000, chain.objs.size()=1 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.572__shadow:a9f.leuv6Z-28ErtI7wPmGwVK0XPG52_.DF0RmLJKDOAhRfkpLd49QIiXv_kO8kN_0 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10929625808106566600', time=2024-09-14T13:58:32.943735+0000, chain.objs.size()=1 2024-09-14T12:09:54.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.126+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:xkq1lGKXgkcocKF.qY27F8QCZQO35QL_.eI2yGi_yGR8C_ZoE5nuRT-tF_vZW8vd_0 2024-09-14T12:09:54.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.128+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10055444787235732162', time=2024-09-14T13:59:03.694574+0000, chain.objs.size()=1 2024-09-14T12:09:54.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.128+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:t09rrMcXnhL-mxPmdrdJKreEcszGbMw_.eim9QpU8p8Dn1uggNgOcgzFdN85spnr_0 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13074814698192848067', time=2024-09-14T13:59:13.452845+0000, chain.objs.size()=1 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.606__shadow_.dFosCnsjGQlB4LC5VxIAK61jo7XsB7r_0 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1459195992528926759', time=2024-09-14T14:00:14.217358+0000, chain.objs.size()=6 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.614__multipart_multipart_enc.2~uurV18OKK5YuygHN-ZiHqY6tJJDY1_u.1 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.614__multipart_multipart_enc.2~uurV18OKK5YuygHN-ZiHqY6tJJDY1_u.2 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.614__multipart_multipart_enc.2~uurV18OKK5YuygHN-ZiHqY6tJJDY1_u.3 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.614__multipart_multipart_enc.2~uurV18OKK5YuygHN-ZiHqY6tJJDY1_u.4 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.614__multipart_multipart_enc.2~uurV18OKK5YuygHN-ZiHqY6tJJDY1_u.5 2024-09-14T12:09:54.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.129+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.614__multipart_multipart_enc.2~uurV18OKK5YuygHN-ZiHqY6tJJDY1_u.6 2024-09-14T12:09:54.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.131+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8361848271984807337', time=2024-09-14T14:03:51.831604+0000, chain.objs.size()=1 2024-09-14T12:09:54.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.131+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.664__shadow_.5xB_mnbUFeqUoJGGL9OhNWmfBW_lmDF_0 2024-09-14T12:09:54.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.131+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16202502337260476183', time=2024-09-14T14:03:53.971892+0000, chain.objs.size()=1 2024-09-14T12:09:54.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.131+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.666__shadow_.gcJ_CMqQ_jLGVa24YvW924M-N1E2jmz_0 2024-09-14T12:09:54.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.131+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7332030817261541262', time=2024-09-14T14:04:57.382849+0000, chain.objs.size()=10 2024-09-14T12:09:54.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.131+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.1 2024-09-14T12:09:54.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.134+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.2 2024-09-14T12:09:54.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.134+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.3 2024-09-14T12:09:54.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.134+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.4 2024-09-14T12:09:54.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.134+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.5 2024-09-14T12:09:54.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.134+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.6 2024-09-14T12:09:54.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.134+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.7 2024-09-14T12:09:54.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.135+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.8 2024-09-14T12:09:54.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.9 2024-09-14T12:09:54.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.735__multipart_foo.2~ev-86qjnoKmd07SOrLVcMwj1xYa51Dw.10 2024-09-14T12:09:54.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.136+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6770026942176371568', time=2024-09-14T14:06:54.990872+0000, chain.objs.size()=1 2024-09-14T12:09:54.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.136+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.771__shadow_.O5UpzE51rHg-ApCEeXHYE74YL0xTxtW_0 2024-09-14T12:09:54.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.136+0000 7f0433e50640 0 -- 172.21.15.28:0/3563316194 >> [v2:172.21.15.204:6800/410575023,v1:172.21.15.204:6801/410575023] conn(0x7f02fc088740 msgr2=0x7f02fc08ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T12:09:54.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.140+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.143+0000 7f0432e4e640 0 -- 172.21.15.28:0/3563316194 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x55b9b06875d0 msgr2=0x7f02fc0951f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:54.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.143+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T12:09:54.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.144+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.144+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42392' 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_J0h__wl7CEPaQOalZmE6cIZ-gLfAZh-', time=2024-09-14T13:46:56.971150+0000, chain.objs.size()=2 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.zxOZMNMc5_5DRHAiGvZRGcXbK-rYt_B_0 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.zxOZMNMc5_5DRHAiGvZRGcXbK-rYt_B_1 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9479299651731706704', time=2024-09-14T13:49:58.830251+0000, chain.objs.size()=1 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.51635uNjuLY4jueYGPX-N0XNpn631NK_0 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1861786659074745680', time=2024-09-14T13:49:59.139567+0000, chain.objs.size()=1 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AohUmsn_cZ0tLNccHdG7iyCJpnx4CIQ_0 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5745102966670652759', time=2024-09-14T13:49:59.453005+0000, chain.objs.size()=1 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._NMeIhIc1-BH00yUWWtvCkNIYO6hqMr_0 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3353061777147502911', time=2024-09-14T13:49:59.481575+0000, chain.objs.size()=1 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.p2Ex4ptRGdvURaM6hzjT0X00S5-Znlu_0 2024-09-14T12:09:54.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8970770951720023351', time=2024-09-14T13:49:59.838153+0000, chain.objs.size()=1 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.S7MLK9GkOgf0Yapp7NvDTOLfkTplsFz_0 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3304382017830861237', time=2024-09-14T13:50:01.156654+0000, chain.objs.size()=1 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sD9JoH2bZxUOpDxVjNcYNDi1f_jMGeF_0 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3832185429917084910', time=2024-09-14T13:50:01.157794+0000, chain.objs.size()=1 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YvGCEb5B5oOMx0gbVSoVOD9NYAzPXHO_0 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10166008792230198202', time=2024-09-14T13:50:01.393751+0000, chain.objs.size()=1 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZRSkvXu8Msjride9Vc6CBSLBSXPZDmX_0 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7161425407595585941', time=2024-09-14T13:50:02.371843+0000, chain.objs.size()=1 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._6PKy8PH1GVPN8uoxxr6oG7kbWTgX2G_0 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12373770822517171870', time=2024-09-14T13:50:02.779337+0000, chain.objs.size()=1 2024-09-14T12:09:54.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.145+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Va6AI6-CgPJk9VuZBQTkK-bk_DA27ps_0 2024-09-14T12:09:54.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5757577932095431374', time=2024-09-14T13:50:03.455270+0000, chain.objs.size()=1 2024-09-14T12:09:54.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3M3nWRV5nWrqZ6ossdC6TJD7H0cM2w0_0 2024-09-14T12:09:54.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11153570086697238641', time=2024-09-14T13:50:03.871404+0000, chain.objs.size()=1 2024-09-14T12:09:54.148 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hnRa21TPhQuP1G8LJs7XKwUAp7WlvG4_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9269806837852859436', time=2024-09-14T13:50:04.232442+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RtW2r9M0S26dV-RELfVmuWLGDcueysO_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9720734610690489386', time=2024-09-14T13:50:05.014041+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4h7cnAFJdWY-UYaKrAkpmqqsnPfalDn_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5789517654794838998', time=2024-09-14T13:50:05.652880+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MxwMrs0xLKOv_WsO7PX3DyjcEltQp-F_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10520720639818378559', time=2024-09-14T13:50:05.720757+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eDzZt1EWQAeBjXvpHu7S4cF5O9qwylS_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6093836514449883411', time=2024-09-14T13:50:06.367004+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EpeUctQDAYGZf78yQ_QEYv_yx24Yp2N_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18012831193924886822', time=2024-09-14T13:50:06.401609+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FkjWg26b4_E4qsJjlCSbzEfHahKzK8f_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6055906878259076258', time=2024-09-14T13:50:06.670072+0000, chain.objs.size()=1 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Owkh8BlIs_U0og-2tA2biPfN0ZDvJIR_0 2024-09-14T12:09:54.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6616222111460421273', time=2024-09-14T13:50:06.865241+0000, chain.objs.size()=1 2024-09-14T12:09:54.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OBJhF0hEx1HvTbPNT6YWrw5-M0uWyCK_0 2024-09-14T12:09:54.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14620201010105805710', time=2024-09-14T13:50:07.235096+0000, chain.objs.size()=1 2024-09-14T12:09:54.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.150+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DY4ojQHJKlmSFBgVpqtzKKyB0RiMZF6_0 2024-09-14T12:09:54.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.153+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10191578684985548808', time=2024-09-14T13:50:08.003508+0000, chain.objs.size()=1 2024-09-14T12:09:54.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.153+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KRN6onCX_sHla1uchMNN_QQ8-b3E962_0 2024-09-14T12:09:54.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.153+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8409983257681482459', time=2024-09-14T13:50:08.115408+0000, chain.objs.size()=1 2024-09-14T12:09:54.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.153+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wKKjB-LjpRbt5GdBVDxY88hYXEY68WT_0 2024-09-14T12:09:54.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.153+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4894024390599527015', time=2024-09-14T13:50:08.128789+0000, chain.objs.size()=1 2024-09-14T12:09:54.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.153+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aRE8hQMe-D2SiS-8J9G1kypZ1pQ65Qc_0 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12861344058487154544', time=2024-09-14T13:50:08.186094+0000, chain.objs.size()=1 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Pe_f98ixk_EmCInIP3_K6HmUTyWNdqg_0 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13147627449121635399', time=2024-09-14T13:50:08.599034+0000, chain.objs.size()=1 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.lNYZ1CWt9YnrXYR_i6jz7KywEVbZ3jC_0 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2205079233133405369', time=2024-09-14T13:50:09.040236+0000, chain.objs.size()=1 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WrkQqcSgtJEcCQd-3zq8vUNjEVJJESt_0 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6541803109650205866', time=2024-09-14T13:50:09.060756+0000, chain.objs.size()=1 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.VES4T1EnTk-vA9N747yBWINyNycweGV_0 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5733282613071510287', time=2024-09-14T13:50:09.820781+0000, chain.objs.size()=1 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.bunUQBqrupBNGL-Sh3O6n_Rtqn38_9N_0 2024-09-14T12:09:54.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15286915499740340484', time=2024-09-14T13:50:09.821591+0000, chain.objs.size()=1 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.je__cSLg2L0N0Z6ksYCq2p8lubRVnrM_0 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15692890465937738296', time=2024-09-14T13:50:20.135109+0000, chain.objs.size()=1 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.279__shadow_.P5YqboIIIHenZ2Trn6Wx9NR8Jj7BT8K_0 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1834584850660053196', time=2024-09-14T13:50:20.140019+0000, chain.objs.size()=1 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.279__shadow_.ct7TmvsYCGLvK6d_G8dYy4eMxexpzRL_0 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.962325984429801298', time=2024-09-14T13:50:27.173017+0000, chain.objs.size()=1 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.155+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.290__shadow_.eLWXu8o2FHyRu_RLAj1QX3aSY0W9819_0 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3638191053793464376', time=2024-09-14T13:50:36.416305+0000, chain.objs.size()=1 2024-09-14T12:09:54.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.300__shadow_.Bg9PgQigLf_QVsIduKXaQc0OWLq9rLi_0 2024-09-14T12:09:54.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.156+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11225740180935428487', time=2024-09-14T13:51:32.316258+0000, chain.objs.size()=1 2024-09-14T12:09:54.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.156+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.b142zQsHzi0MMpb-pswWQ2U5gmFWPVa_0 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7639849666712585388', time=2024-09-14T13:51:32.317025+0000, chain.objs.size()=1 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dzdS6HPo2AZy7RPy9-RES6MHYpcbYpH_0 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9263483866368686878', time=2024-09-14T13:51:32.518431+0000, chain.objs.size()=1 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZrkE7Wf78vaU5naXyFQEu3esvJLk9_Q_0 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17731177625287319805', time=2024-09-14T13:51:32.731424+0000, chain.objs.size()=1 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kQRoyGO7NhAdH6WvyEVaFxIwukUxo1K_0 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17529136240693235688', time=2024-09-14T13:51:32.821556+0000, chain.objs.size()=1 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mnokatFgXi9143kAvJYXub04IPvGDYR_0 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18195217191924096414', time=2024-09-14T13:51:32.893668+0000, chain.objs.size()=1 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1SgVR555rEfXyRgQld41BpIMVkY12vF_0 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6514905352939667740', time=2024-09-14T13:51:33.040301+0000, chain.objs.size()=1 2024-09-14T12:09:54.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PXbMcrwb2OvKpPLop552YXfvjtynfjO_0 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9932822835634488283', time=2024-09-14T13:51:33.041207+0000, chain.objs.size()=1 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3t6N4qEn4Qsf4SmrHyLfBVkgOksnQEy_0 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8015882839404659027', time=2024-09-14T13:51:34.019659+0000, chain.objs.size()=1 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6wC_p2JVum31PnL3AYEWcGI0StHigfF_0 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.719519369686593520', time=2024-09-14T13:51:34.166006+0000, chain.objs.size()=1 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.k6TvJnl_Sl3Icbhp5n_bp7QKDIHJI1B_0 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17557465014395737542', time=2024-09-14T13:51:34.552469+0000, chain.objs.size()=1 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0imlYeJev94sqYOxtjYeS6jPtyXa2xr_0 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16977953184448830081', time=2024-09-14T13:51:34.553298+0000, chain.objs.size()=1 2024-09-14T12:09:54.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.160+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XLQEx3kynECeML-mloa2pXIDf18S7X3_0 2024-09-14T12:09:54.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.163+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4663847228168702572', time=2024-09-14T13:51:35.578457+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.163+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rL04k08XDAg2S2sUDHm99qVtBgjaOI-_0 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6643971322035617975', time=2024-09-14T13:51:35.639150+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hXmN4Dggjau9jfnYpZiuveZB1u4dPJx_0 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8035111902062069927', time=2024-09-14T13:51:35.731961+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nNeHBQgn-u5ngpV3m0qgSwKwFkuCtVh_0 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14053071047144021602', time=2024-09-14T13:51:35.893030+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LkE4t-QCT1JjYIc4Yvhp6IO1OqQmWMM_0 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4546590441374504690', time=2024-09-14T13:51:36.374692+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tLX9VhJ1h40c-G4hsRbEc4lpSqnB1vV_0 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16428589741845843105', time=2024-09-14T13:51:36.853236+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OUyycm7IEmEAaQ9KqL1dtetrANzReyP_0 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10251802092467947098', time=2024-09-14T13:51:36.853997+0000, chain.objs.size()=1 2024-09-14T12:09:54.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9W5-RjCLo3tmzTaqBGE5d556TpHB0dJ_0 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9397638782320933698', time=2024-09-14T13:51:37.009412+0000, chain.objs.size()=1 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.066LI4JbFG2pE97CFg7-WKG9h0_KWR6_0 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6464449827645839983', time=2024-09-14T13:51:37.436136+0000, chain.objs.size()=1 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.c41nCHEEFJcQ7cqpkMeRCJGezRbP4Ob_0 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1127243213008022208', time=2024-09-14T13:51:37.514469+0000, chain.objs.size()=1 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.eEuBiOoZnFREGE5TsiKmGyI_qQJKHEF_0 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8352397556285657633', time=2024-09-14T13:51:37.634092+0000, chain.objs.size()=1 2024-09-14T12:09:54.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.164+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4-44O3ym5aRPp_wL4LjLCZmnRbiKjA2_0 2024-09-14T12:09:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.167+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17554556263686972330', time=2024-09-14T13:51:37.634699+0000, chain.objs.size()=1 2024-09-14T12:09:54.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.167+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Li1x78Zhu4-jrQsjJ-3OOcY20gcGV5S_0 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15871742777711323346', time=2024-09-14T13:51:38.725284+0000, chain.objs.size()=1 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.n4vvNnR-rPV77TuVINm6bAl9j3wjSZz_0 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8437504727981122158', time=2024-09-14T13:51:38.726094+0000, chain.objs.size()=1 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9WJjGXuHejFwrZfrjKXIQ5a6tT2FIHO_0 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17465610568076563107', time=2024-09-14T13:51:38.728775+0000, chain.objs.size()=1 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.sh6HYUD0Qv-m39TLsoib0zd9I2bIwpj_0 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7182265359735403396', time=2024-09-14T13:51:39.096470+0000, chain.objs.size()=1 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vURtQCy540ASG_IEdosMglDogAfqfl4_0 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.211019328068472259', time=2024-09-14T13:51:39.158039+0000, chain.objs.size()=1 2024-09-14T12:09:54.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-yUlApswU8geSdHp_Ip1vesC9csHCVg_0 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6758645836172418875', time=2024-09-14T13:51:40.141770+0000, chain.objs.size()=1 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cBDlKaUjQThdxVtyzcf2VQ3xPY9Vwfm_0 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2158718641161126863', time=2024-09-14T13:51:40.434474+0000, chain.objs.size()=1 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.IWw64P2tdZ7FeyQ7TDBDxxb0SniiQDm_0 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9972318684708277779', time=2024-09-14T13:51:41.044642+0000, chain.objs.size()=1 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.u7NzBno5EXexX1MdiGWBX3h8bGEx5Vw_0 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8116938977270419674', time=2024-09-14T13:51:41.663307+0000, chain.objs.size()=1 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gEv7gSTyKDeTM0selCIdZfUVPYkcTh4_0 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2675550767639846551', time=2024-09-14T13:51:41.702957+0000, chain.objs.size()=1 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.169+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fwcvpy0uXSTl4bHJTfZyP5FQ3CdsBoX_0 2024-09-14T12:09:54.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.171+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5921361329826911479', time=2024-09-14T13:52:21.064553+0000, chain.objs.size()=1 2024-09-14T12:09:54.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.171+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qH9xMzuPPUeKzR9s--EhfMGhGswcVjJ_0 2024-09-14T12:09:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3883774448900082351', time=2024-09-14T13:52:21.698900+0000, chain.objs.size()=1 2024-09-14T12:09:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.F8ZkJ78y9NblA_UPxOMiMw_5kXtMwd1_0 2024-09-14T12:09:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14006666781455030435', time=2024-09-14T13:52:22.107447+0000, chain.objs.size()=1 2024-09-14T12:09:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qaVNZOJrkhGmFHYXN9TkuEtYns-7lkW_0 2024-09-14T12:09:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3459455922529597724', time=2024-09-14T13:52:22.158379+0000, chain.objs.size()=1 2024-09-14T12:09:54.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gtTCJmmPRK5KfaYVr1qAYecdhQt7nWH_0 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10432540929702082159', time=2024-09-14T13:52:22.656488+0000, chain.objs.size()=1 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.o2xQFwA9zUDD_dU40FexZ6C8A_VdjL-_0 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17336588040767276609', time=2024-09-14T13:52:22.815165+0000, chain.objs.size()=1 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.173+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iN3pwTnBVL_OU_ILAeKtZeRvsbX126D_0 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12274861489314382093', time=2024-09-14T13:52:23.101805+0000, chain.objs.size()=1 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3OBTc6G4x4Xk0xd3oruBo7mMT354wBe_0 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17824111190584177158', time=2024-09-14T13:52:23.611866+0000, chain.objs.size()=1 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.v04wppqGz6F2fnd-SbbptLSYh202953_0 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14676605270569829915', time=2024-09-14T13:52:23.693553+0000, chain.objs.size()=1 2024-09-14T12:09:54.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cyecwh3yBaN1MRdnmWVigBXK9ICtVJn_0 2024-09-14T12:09:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6704830486289658262', time=2024-09-14T13:52:24.225318+0000, chain.objs.size()=1 2024-09-14T12:09:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZW5C6xNW60Gx4gdrITphECK76ubECVy_0 2024-09-14T12:09:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8776012636670204897', time=2024-09-14T13:52:24.594987+0000, chain.objs.size()=1 2024-09-14T12:09:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cpLG_GmMWDXHM-TAFXetS0u0UyYagQt_0 2024-09-14T12:09:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6363746358746989161', time=2024-09-14T13:52:24.761161+0000, chain.objs.size()=1 2024-09-14T12:09:54.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.174+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hfBf535a5YoAsF4FBKbE35nA3_UsqwZ_0 2024-09-14T12:09:54.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.176+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3089333682557263180', time=2024-09-14T13:52:25.248530+0000, chain.objs.size()=1 2024-09-14T12:09:54.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.176+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.txTeS-INikU0DJuAArZ1NANMLkjrn0R_0 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17048022548646251366', time=2024-09-14T13:52:25.287648+0000, chain.objs.size()=1 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.lrYz_q0vHxacXwbxsDCgBy1wJXZ1K2n_0 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5403200686552849753', time=2024-09-14T13:52:26.315177+0000, chain.objs.size()=1 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yps1VLkN6xYky6MSFlc4nnfTaW5o7R7_0 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12427341975828404141', time=2024-09-14T13:52:26.649902+0000, chain.objs.size()=1 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KqYRNNmF1QwU145v4dcHWj4EvV5nn5V_0 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6968179583557417582', time=2024-09-14T13:52:26.685096+0000, chain.objs.size()=1 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ukq1C0-IV6C2AEd-uwAz0_R0h0ElUQh_0 2024-09-14T12:09:54.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3524595020826728659', time=2024-09-14T13:52:26.752497+0000, chain.objs.size()=1 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.70pf-YK1xo22-dQ7VEokh8jrV9W9Dso_0 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.352304349255184393', time=2024-09-14T13:52:27.355461+0000, chain.objs.size()=1 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jixtBeKHGWBlnCZWkwNzJXwhSNZCcWk_0 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18366656817468574080', time=2024-09-14T13:52:27.495479+0000, chain.objs.size()=1 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._Mnbb-QT17ue9Aj1HuK4xRAaZz6MJpC_0 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13788641757148319251', time=2024-09-14T13:52:27.495980+0000, chain.objs.size()=1 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.D8BFfZ-2tiKZ_lyVx1JK9YbkMTJtfrs_0 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12402132188834032099', time=2024-09-14T13:52:27.906432+0000, chain.objs.size()=1 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ALpBhciSkoXYdAx9pNAlla55U6HJW-E_0 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17368538866044026243', time=2024-09-14T13:52:28.850674+0000, chain.objs.size()=1 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.178+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0u8moGu27RMW2ed74XvkxQ2pzy2y0hD_0 2024-09-14T12:09:54.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.180+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4862754526978971834', time=2024-09-14T13:52:29.035790+0000, chain.objs.size()=1 2024-09-14T12:09:54.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.180+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UQuUOqqwEmS1znlCt1moH34TqUzu2nl_0 2024-09-14T12:09:54.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.181+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16265340457542080860', time=2024-09-14T13:52:29.273137+0000, chain.objs.size()=1 2024-09-14T12:09:54.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.181+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.91haLcfuQRbRVCJHNnTBm4rZp0Ra5Oi_0 2024-09-14T12:09:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11206684275534560689', time=2024-09-14T13:52:30.132683+0000, chain.objs.size()=1 2024-09-14T12:09:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wu_76R0hzsoJ6xmh8C9yocjuKpXqcr6_0 2024-09-14T12:09:54.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17033364724173396464', time=2024-09-14T13:52:30.164237+0000, chain.objs.size()=1 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XjGOAaygfqISN4aVR6CQVGrv8BveGGe_0 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5407042371588461267', time=2024-09-14T13:52:30.634024+0000, chain.objs.size()=1 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VFV3U0sEwhwyT0qfvSkdantgFov-Grp_0 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8656122301350344172', time=2024-09-14T13:52:31.355804+0000, chain.objs.size()=1 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9gK046Q9YsjZw1tjGlS3hROT0vh2g6t_0 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10381583058954771383', time=2024-09-14T13:52:31.385720+0000, chain.objs.size()=1 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SsNXXNPMupy0IckW4lasEBig3PTssiS_0 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8427914332410024781', time=2024-09-14T13:52:31.541811+0000, chain.objs.size()=1 2024-09-14T12:09:54.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.183+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3MKjeAmRhN3KZ2Wk9uvbnE3fL0niDld_0 2024-09-14T12:09:54.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.187+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/42392 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4570489108474721253', time=2024-09-14T13:52:31.787963+0000, chain.objs.size()=1 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZWoYvcwRhdAMGM_lSe0GyqGqdTF8uss_0 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9682567716502117534', time=2024-09-14T13:52:32.003717+0000, chain.objs.size()=1 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.HXrjxQn4Ybt5eIftOaKs4C2pRldn6wy_0 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10876783855754187715', time=2024-09-14T13:52:32.051968+0000, chain.objs.size()=1 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RvIW6CQVbFDtjd5c6qr1B_TdoFocWyK_0 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.189+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8541048440176787039', time=2024-09-14T13:52:41.516888+0000, chain.objs.size()=1 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.341__shadow_.9GsVNajzFb1PN2PjyZVXPWUZhjbbNx5_0 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6121097181556991719', time=2024-09-14T13:52:53.307606+0000, chain.objs.size()=1 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.367__shadow_.670XE_BthcbzvJZ5NCc4C8jjOxLBM6z_0 2024-09-14T12:09:54.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15280032391417977418', time=2024-09-14T13:52:56.488531+0000, chain.objs.size()=1 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.373__shadow_.rK20bOZgA56AwHfBWaIAex1-3Qmlsc2_0 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11863448946742129964', time=2024-09-14T13:53:49.096268+0000, chain.objs.size()=1 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.459__shadow_.3MoN0AMHzlk3lIa-Cu4w6XUltsdY0Rq_0 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14173644122250435058', time=2024-09-14T13:54:03.280405+0000, chain.objs.size()=1 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.484__shadow_.wEFQWwQkv0_RWKDRJXduI6LS8vbpPeX_0 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8592395412236209591', time=2024-09-14T13:54:15.230030+0000, chain.objs.size()=1 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.500__shadow_.FflvEDjjzbvLJ0l7bIXSDMs-zFG2hIZ_0 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11289219549147333482', time=2024-09-14T13:54:26.782292+0000, chain.objs.size()=6 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.1 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.2 2024-09-14T12:09:54.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.190+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.3 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.4 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.5 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.6 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17953594382510671204', time=2024-09-14T13:55:08.724818+0000, chain.objs.size()=1 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.520__shadow:fAkIBV9m8lQMzJNdpYG.bVot816fGY-_.jn3GAkk0PXig9UM-vRBbkJF0djvx88p_0 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5199644790149206074', time=2024-09-14T13:56:31.180154+0000, chain.objs.size()=1 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.192+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.528__shadow_.8xGh5l7YgGHmgagGrsaWyOTJqZuq7zr_0 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7107846381547692972', time=2024-09-14T13:57:18.761409+0000, chain.objs.size()=1 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.550__shadow_.4z13gdTR3u-Mnbb9k6Xh4wF_h3aJUry_0 2024-09-14T12:09:54.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1324857233357899515', time=2024-09-14T13:57:50.360435+0000, chain.objs.size()=1 2024-09-14T12:09:54.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.565__shadow_.tYWlPL9ltpDKaPYACLaOaSyBLG3m4zW_0 2024-09-14T12:09:54.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.193+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7663103082941657241', time=2024-09-14T13:58:08.982395+0000, chain.objs.size()=1 2024-09-14T12:09:54.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.193+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:aatOUZKusjyIu82BLIJlXKq0MmIxE1y_.THRTMW7hzzVGfEhNeYrtxUjlc9SeWVT_0 2024-09-14T12:09:54.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7146227933438845345', time=2024-09-14T13:58:40.543389+0000, chain.objs.size()=1 2024-09-14T12:09:54.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:G1CuDkI8Jxq1UYNexHy033QOmHGbGrv_._rsdorebKqhkWlssmHcLuZjR5rP9UAs_0 2024-09-14T12:09:54.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15231402501356855310', time=2024-09-14T13:58:55.292910+0000, chain.objs.size()=1 2024-09-14T12:09:54.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:I96R9Hezfbz.YGg7rC5.4Bsjd19OGGf_.aJR2S-rsLq6KfstX96QeYfpBg8Yql03_0 2024-09-14T12:09:54.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.194+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7502264790954111185', time=2024-09-14T13:59:08.198792+0000, chain.objs.size()=1 2024-09-14T12:09:54.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.194+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.596__shadow_.ef4xm-DZXdgKL5d1fzUuRloELzCH_y8_0 2024-09-14T12:09:54.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6429683339362461328', time=2024-09-14T13:59:11.468917+0000, chain.objs.size()=1 2024-09-14T12:09:54.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.603__shadow_.MeKjEuuUkIHvvRt-5n82Al2E8E1nb4__0 2024-09-14T12:09:54.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5973237394457975971', time=2024-09-14T14:04:05.380851+0000, chain.objs.size()=1 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.690__shadow:tc7SdWQSWJtUOQ6Y2FblSvF32uuA.Eh_.Ay60BFrHVDfqoHhR3OtBZFUm8HX0Mkz_0 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4899322974302561813', time=2024-09-14T14:04:10.921429+0000, chain.objs.size()=1 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.699__shadow:-vay7EN73ufGHstRRewvtR28MHILWzB_.1Jnov8hILPBqtR1XTCz3FxzZlFd0k8B_0 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18057158946935734715', time=2024-09-14T14:05:32.116430+0000, chain.objs.size()=1 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.750__shadow_.UCWVQDi9P4B3bpNZ2VgAy1SX1VzXEwV_0 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4903923304675754602', time=2024-09-14T14:07:17.563411+0000, chain.objs.size()=1 2024-09-14T12:09:54.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.196+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.777__shadow_.kdLaRhnOLnzSjt6yFYy4fbzFPswKTyE_0 2024-09-14T12:09:54.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.200+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.202+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T12:09:54.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.204+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.204+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46226' 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_GadXWX4R5CQi_P4O1vULQktXp-xpTry', time=2024-09-14T13:46:46.055163+0000, chain.objs.size()=2 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.SqBLIFwBQ_EaZTlGSM0iJMngcrlmIeP_0 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.SqBLIFwBQ_EaZTlGSM0iJMngcrlmIeP_1 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_U8oLYpoJze8egCj4cfWvPPD0MmtJko5', time=2024-09-14T13:46:47.793633+0000, chain.objs.size()=2 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.x3sBElYjmINy_emzpIabx2TQgcpg3W7_0 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.x3sBElYjmINy_emzpIabx2TQgcpg3W7_1 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_c471lbY_jfzseXpLvie7SeShN7Mdv6f', time=2024-09-14T13:46:49.822407+0000, chain.objs.size()=2 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.fC0wYz0R9FaG6hjreMa4fSvcqAPCg9t_0 2024-09-14T12:09:54.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.160__shadow_.fC0wYz0R9FaG6hjreMa4fSvcqAPCg9t_1 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.708799889244739662', time=2024-09-14T13:47:03.803168+0000, chain.objs.size()=1 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.170__shadow_.vaVTz5orgDjqlZ60ZjY3mg725Ppkq8a_0 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18214659400443985729', time=2024-09-14T13:49:03.083289+0000, chain.objs.size()=1 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.234__shadow_.arr_zsUZP9EjUoLL30WN7v7eBfSX5bq_0 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16558985885607485094', time=2024-09-14T13:49:08.448708+0000, chain.objs.size()=1 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.242__shadow_.QDDjFRCqjHpGMONNcjGPlYVKiuB2ON1_0 2024-09-14T12:09:54.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5271532966970410633', time=2024-09-14T13:49:15.239270+0000, chain.objs.size()=1 2024-09-14T12:09:54.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.252__shadow_.QC1NpmMhln4GjElrq3kPfgA3q_pLGoT_0 2024-09-14T12:09:54.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14289179979491497405', time=2024-09-14T13:49:17.171441+0000, chain.objs.size()=1 2024-09-14T12:09:54.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.255__shadow_.ls8AnPzh4IoH4JRPJqgcp_m_qBnB28z_0 2024-09-14T12:09:54.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6057927605317951951', time=2024-09-14T13:49:19.550832+0000, chain.objs.size()=1 2024-09-14T12:09:54.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.205+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.259__shadow_.yzLVwaUJuymCJTOYA9mpyRNKrsgaZqv_0 2024-09-14T12:09:54.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.209+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16471085335517592329', time=2024-09-14T13:49:58.852900+0000, chain.objs.size()=1 2024-09-14T12:09:54.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.209+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Ap4-LAs5AR3dRhlzT73WPvZtP-LcZQy_0 2024-09-14T12:09:54.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3367155208436269459', time=2024-09-14T13:49:59.000885+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AKYU_4Y1x1lchN6W-xEuw3e1RPKNr8s_0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7445176495760744284', time=2024-09-14T13:49:59.143639+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.QDCxkMFPuruPP0yD4wIeBZfRrqwYYr__0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16349841434957122580', time=2024-09-14T13:49:59.283468+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.92RcMzyA1q_DmC7gF32lzhSooaTUwfT_0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5169971618885545859', time=2024-09-14T13:49:59.322962+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CUEpoUbof5AOnrNhJHPraE3Acd7x_H-_0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17860841181481860415', time=2024-09-14T13:49:59.354222+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Vq-mbnSiyT100RZylD1pmORlt_pIEpx_0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14047342677732809749', time=2024-09-14T13:49:59.902906+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4n--MTpnYy7k70IJG9gKn-iR64AwjGw_0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13292932421504096642', time=2024-09-14T13:50:00.499221+0000, chain.objs.size()=1 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RLt4w52xnMNMHuQFcA8gAGD0HlnjXus_0 2024-09-14T12:09:54.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2718725684424944589', time=2024-09-14T13:50:00.500039+0000, chain.objs.size()=1 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LF6D28AYh9u0xDWz7ze3_3wkBIZO30Y_0 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15569679472142206529', time=2024-09-14T13:50:00.500790+0000, chain.objs.size()=1 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0qysdCX4qJMYbKnPoiNpCn77IwZIJLU_0 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6574308677244008072', time=2024-09-14T13:50:00.666196+0000, chain.objs.size()=1 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.210+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Uqyt6dizIhQoY5cUAOFRq42-X1SKrbe_0 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.211+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10146116160522761696', time=2024-09-14T13:50:01.010124+0000, chain.objs.size()=1 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.211+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.h1cusqqm4MLgWBELDTmZ2CmHaWpIsNR_0 2024-09-14T12:09:54.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.212+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4407277463411398739', time=2024-09-14T13:50:01.315993+0000, chain.objs.size()=1 2024-09-14T12:09:54.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.212+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OMjfeti9f6O_tZkCSlykAVWCqub1VI__0 2024-09-14T12:09:54.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.213+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17632371524578822997', time=2024-09-14T13:50:01.985320+0000, chain.objs.size()=1 2024-09-14T12:09:54.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.213+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XRqsQYWL2-kuXO5TyMym3trYvHhA-LR_0 2024-09-14T12:09:54.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12037933180316530981', time=2024-09-14T13:50:02.904548+0000, chain.objs.size()=1 2024-09-14T12:09:54.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tPkKX_fgXKYNGbqEkiACEkfXfERKsmw_0 2024-09-14T12:09:54.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15576970201820588043', time=2024-09-14T13:50:03.457098+0000, chain.objs.size()=1 2024-09-14T12:09:54.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yhjuo3oTJU7vkyCMhoNhTFa-_25a6TZ_0 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5017018589929327526', time=2024-09-14T13:50:04.077237+0000, chain.objs.size()=1 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YKeXS_dPV0gS2wVIneZ-A8tqC5qXsb6_0 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17971158932599364139', time=2024-09-14T13:50:04.442053+0000, chain.objs.size()=1 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4sBtcygIGVJ-u1GezVEoru5bFp8Vob2_0 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16761151670607793789', time=2024-09-14T13:50:04.889613+0000, chain.objs.size()=1 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kl3EKZuCQwx3cwB1HXNU23xxeOrR-AB_0 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13281462673123928662', time=2024-09-14T13:50:04.986213+0000, chain.objs.size()=1 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Y7a2D9jBWP0qMfEby6myQ98mKmY0fRZ_0 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3032604318442143858', time=2024-09-14T13:50:05.081197+0000, chain.objs.size()=1 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AccG4uT_LREYiHDOXJAEcj3vkyIgg-o_0 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17449021365448663224', time=2024-09-14T13:50:05.159680+0000, chain.objs.size()=1 2024-09-14T12:09:54.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.214+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.h41NAn3PxYjJiOEqKFLGclxDK4tMa90_0 2024-09-14T12:09:54.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.216+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17292480404405377569', time=2024-09-14T13:50:05.760275+0000, chain.objs.size()=1 2024-09-14T12:09:54.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.216+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oleRF1PiqajB2KpTmAZMPcfqXRrrlBA_0 2024-09-14T12:09:54.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.216+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2884847813229897886', time=2024-09-14T13:50:05.818685+0000, chain.objs.size()=1 2024-09-14T12:09:54.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.216+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.w4H_QuiYJkZUVRdk3Exeo0ufcxD0-zS_0 2024-09-14T12:09:54.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2838132756980330847', time=2024-09-14T13:50:06.513383+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.217+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.j6xOWy2sqRiuhrJSs3wxIjS8etLmdTk_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9822023249840311337', time=2024-09-14T13:50:06.548359+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.217+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-xpiqtrT3YPR7CnuFzJ7gxinWgMs-x3_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.217+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5502280524849106371', time=2024-09-14T13:50:06.569378+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.2owNi80MlW5gxh7Q_s46eC62Genb0TM_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11110682677272821855', time=2024-09-14T13:50:07.586251+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.UGyCWgkZq8R6J61_rapl-HHELd2xpPU_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15658098793916547310', time=2024-09-14T13:50:07.936095+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.23Zy2TCJW5kNM2KjsaUf93Ek1yvZhao_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11446859317452488771', time=2024-09-14T13:50:08.233770+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.JV6nhfOVv3-9xQWSfj3awAfcgVXVm3R_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17101831221950103602', time=2024-09-14T13:50:08.944713+0000, chain.objs.size()=1 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.gpSUDRTSqOr_XeE0WmxxmC-pQsLCStS_0 2024-09-14T12:09:54.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.346510955677756153', time=2024-09-14T13:50:09.161315+0000, chain.objs.size()=1 2024-09-14T12:09:54.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.218+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TvyV91Ig6k4gX8Z41asFnYUHkDok45r_0 2024-09-14T12:09:54.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.219+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5753408222808091857', time=2024-09-14T13:50:09.188975+0000, chain.objs.size()=1 2024-09-14T12:09:54.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.219+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nXybqGx8Y8wwRsj7z6WuJ7cGVsbX-kM_0 2024-09-14T12:09:54.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.220+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9749468153868391298', time=2024-09-14T13:50:09.295144+0000, chain.objs.size()=1 2024-09-14T12:09:54.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.220+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ADZ03N3hqkCA4Z5NW5VxLytnvzd3O0N_0 2024-09-14T12:09:54.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.221+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14096263094540216415', time=2024-09-14T13:50:09.348580+0000, chain.objs.size()=1 2024-09-14T12:09:54.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.221+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5GJqWyLjX1D5TfXC88NCWaJZkLYGpxg_0 2024-09-14T12:09:54.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11626811941885744202', time=2024-09-14T13:50:11.664903+0000, chain.objs.size()=1 2024-09-14T12:09:54.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.265__shadow_.jiTUW-WqL1wOBnLEDuPRxPZ9-ECG7Nc_0 2024-09-14T12:09:54.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8646682067600922367', time=2024-09-14T13:50:12.843304+0000, chain.objs.size()=1 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.267__shadow_.VrIbTpoWeXq9qtVfe67xbR4mwwHmYgW_0 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14329927239356830362', time=2024-09-14T13:50:20.765924+0000, chain.objs.size()=1 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.280__shadow_.BfVE_Xrlxv-PPF8Wjk_Mfpnqs1qvtdo_0 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.222+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8310602659799265932', time=2024-09-14T13:50:24.686695+0000, chain.objs.size()=1 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.286__shadow_.FQKG1sMyBYnRkAqVQ529fWOs8HJebZa_0 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14000507674992924042', time=2024-09-14T13:50:29.787643+0000, chain.objs.size()=1 2024-09-14T12:09:54.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.8NgYngZKHxjSDyDZS-I4mPHSStsZtow_0 2024-09-14T12:09:54.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11042966112424341365', time=2024-09-14T13:50:31.652582+0000, chain.objs.size()=1 2024-09-14T12:09:54.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.wvFGENDTPocUvf050JYOcZEWRG1ehD9_0 2024-09-14T12:09:54.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18257432197769225905', time=2024-09-14T13:50:31.778018+0000, chain.objs.size()=1 2024-09-14T12:09:54.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.QP5vE21WY1YcvF-1W1uWkiY4kVYqDFY_0 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5937023044189097062', time=2024-09-14T13:50:33.050018+0000, chain.objs.size()=1 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.295__shadow_.X_KkL4fjw0a55pNzGcuzN93JDnNbyeP_0 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11795599616973143655', time=2024-09-14T13:50:33.717377+0000, chain.objs.size()=1 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.223+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.296__shadow_.Odzg0Q5rcckXf9ueTnVbi-aEP-xCzdk_0 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.225+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15250036431508693614', time=2024-09-14T13:50:34.331003+0000, chain.objs.size()=1 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.225+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.297__shadow_.JyyF-hTGjMY5PQcR-l9a4xynhSygWET_0 2024-09-14T12:09:54.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.225+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3921570804770258159', time=2024-09-14T13:50:35.797422+0000, chain.objs.size()=1 2024-09-14T12:09:54.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.225+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.299__shadow_.RzzWAmsQTPHEvqd7x1jT1MaSl74ejoU_0 2024-09-14T12:09:54.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.225+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11598228109554439538', time=2024-09-14T13:50:38.341196+0000, chain.objs.size()=1 2024-09-14T12:09:54.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.225+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.303__shadow_.wSMXI56jOJE5l7KXhjYlYpCHu3bhiye_0 2024-09-14T12:09:54.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.226+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12833367159176411711', time=2024-09-14T13:51:31.270771+0000, chain.objs.size()=1 2024-09-14T12:09:54.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.226+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mc-CdNQQdaNQodpx9tpnoabmIg5qeip_0 2024-09-14T12:09:54.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4107852495293971762', time=2024-09-14T13:51:32.442540+0000, chain.objs.size()=1 2024-09-14T12:09:54.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mjJlxP5XN2sYt4mVo1u5UtXKuNKeTAn_0 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8263831394872842071', time=2024-09-14T13:51:32.481979+0000, chain.objs.size()=1 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0qElseXrChoZqP1qST6NysOPRXB_gu2_0 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11371398750004995251', time=2024-09-14T13:51:33.973424+0000, chain.objs.size()=1 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.P7GNoQ1OgKSSKccLOyg8e-7DT5EoS7h_0 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15200357916976321188', time=2024-09-14T13:51:34.180308+0000, chain.objs.size()=1 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.o-9aO9S3WRSjyinR8N4WXdPreCtgclG_0 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16571893765648600785', time=2024-09-14T13:51:34.307011+0000, chain.objs.size()=1 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.XmDpdisHiPHBwRWklISCTm7qu2cByL8_0 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12655049139073065314', time=2024-09-14T13:51:34.392445+0000, chain.objs.size()=1 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.KBnjW3NC8YzvDIZ7I3oP6axtjSSZnzI_0 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9901124721768563136', time=2024-09-14T13:51:34.782789+0000, chain.objs.size()=1 2024-09-14T12:09:54.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.228+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.otxvhu7Gqfb1wcWLc-4cpwsoRgcRO-d_0 2024-09-14T12:09:54.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.229+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12755118895620705395', time=2024-09-14T13:51:34.855525+0000, chain.objs.size()=1 2024-09-14T12:09:54.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.229+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.J-_CSwsPJ9Ks0pCzHzLkLI441wIeOaq_0 2024-09-14T12:09:54.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.231+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17870121701327591704', time=2024-09-14T13:51:35.682896+0000, chain.objs.size()=1 2024-09-14T12:09:54.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.231+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.M5GjiMgUiN83a0J-78F_Kwcp0ptQqDG_0 2024-09-14T12:09:54.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.231+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4015535823124777254', time=2024-09-14T13:51:37.275370+0000, chain.objs.size()=1 2024-09-14T12:09:54.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.231+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DrSrVO1TVaGcyyJKWFY1ysLjvkCgg2k_0 2024-09-14T12:09:54.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.231+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5104370226018380355', time=2024-09-14T13:51:38.277566+0000, chain.objs.size()=1 2024-09-14T12:09:54.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.231+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QsdhhmC8uvOduur8w1gJD2QkFNkEG4b_0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12566459952160375880', time=2024-09-14T13:51:38.411455+0000, chain.objs.size()=1 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.weK18lOLUkX7rVUZpWW5uAM-4jSy_mb_0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13998932814125634274', time=2024-09-14T13:51:38.762238+0000, chain.objs.size()=1 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.j1pweTVVbfrqFs9xaYR0bO8pOQq4QC__0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5443613505435117949', time=2024-09-14T13:51:38.835446+0000, chain.objs.size()=1 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.43mcGc6RPVjv-buMJYSGBoYZhpdiq2x_0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1078149645386573799', time=2024-09-14T13:51:39.659687+0000, chain.objs.size()=1 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pZ159LUeQbAdSoHMM8PDO4Vow_uzKdW_0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10145518030106556712', time=2024-09-14T13:51:39.704386+0000, chain.objs.size()=1 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OzM0Gv3Sk5nmc-NZmy_E6toOAMIPQiN_0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4693417059563047168', time=2024-09-14T13:51:40.053460+0000, chain.objs.size()=1 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WXQAWpZIfQgfFCi3GMAcKttprRf938i_0 2024-09-14T12:09:54.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5907159778332820934', time=2024-09-14T13:51:40.511011+0000, chain.objs.size()=1 2024-09-14T12:09:54.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.232+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WrypWsvv2BE4YPpwGh1VKNbddKVnILl_0 2024-09-14T12:09:54.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.233+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5986305211742829290', time=2024-09-14T13:51:41.087598+0000, chain.objs.size()=1 2024-09-14T12:09:54.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.233+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tV02R-il1A5lhaCapj8nDCnrM1yz7vB_0 2024-09-14T12:09:54.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.235+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9190915853181508431', time=2024-09-14T13:51:41.197720+0000, chain.objs.size()=1 2024-09-14T12:09:54.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.235+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.otT27gq53MZEwWF3Bv2OTaORWhTwrdX_0 2024-09-14T12:09:54.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.235+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1119839971485907118', time=2024-09-14T13:51:41.606150+0000, chain.objs.size()=1 2024-09-14T12:09:54.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.235+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UJ5K1TtINBKZIgWfW4BpBfJHQb3s3p3_0 2024-09-14T12:09:54.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.235+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12371209277534180857', time=2024-09-14T13:51:41.740215+0000, chain.objs.size()=1 2024-09-14T12:09:54.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.235+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JcKAnEkpVX_BHEO_pOEVxE917kl13NY_0 2024-09-14T12:09:54.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5640629058211219151', time=2024-09-14T13:51:41.749670+0000, chain.objs.size()=1 2024-09-14T12:09:54.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lUIdpYb81qO_GZ3fVj1KTfnCvZ2VtuB_0 2024-09-14T12:09:54.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18039757295493904095', time=2024-09-14T13:52:21.506564+0000, chain.objs.size()=1 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.U4oN0gF7dD3l77GU7rcxPu0g0aMsjhm_0 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8818315069118691324', time=2024-09-14T13:52:21.729167+0000, chain.objs.size()=1 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vmE9EEIi63ww_KCK1Y8ZSKxEgJgx73k_0 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5272527467987760798', time=2024-09-14T13:52:22.648671+0000, chain.objs.size()=1 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.07aUQvQq9EZauL2qZNIBQVQHXN-XuL__0 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14482240976755661060', time=2024-09-14T13:52:22.683747+0000, chain.objs.size()=1 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.J1LmQndFE_KVrpB4MxRjQ6zGTdytoq7_0 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4723578885964819333', time=2024-09-14T13:52:23.077816+0000, chain.objs.size()=1 2024-09-14T12:09:54.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.237+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QZCvoimRTyzLsb2jGrnvR954_pbxamG_0 2024-09-14T12:09:54.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11530131531615764368', time=2024-09-14T13:52:24.239807+0000, chain.objs.size()=1 2024-09-14T12:09:54.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QdM8XiPnXdc6KsvQZHdNKtW8TwfnHbx_0 2024-09-14T12:09:54.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14601152051868886561', time=2024-09-14T13:52:24.286331+0000, chain.objs.size()=1 2024-09-14T12:09:54.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2vJY3N2xJMkAXUY8rcJrdJbA16OoR9Q_0 2024-09-14T12:09:54.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14718383564730236279', time=2024-09-14T13:52:24.557503+0000, chain.objs.size()=1 2024-09-14T12:09:54.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JFeE_A0ZoVn8K7mwSBEAp_GOU45sfe5_0 2024-09-14T12:09:54.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16206046224113235669', time=2024-09-14T13:52:24.745144+0000, chain.objs.size()=1 2024-09-14T12:09:54.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.239+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XFqrq3Rg8ls_PZWintNa6sWb1tIvQlR_0 2024-09-14T12:09:54.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.241+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7994509488954791367', time=2024-09-14T13:52:24.803247+0000, chain.objs.size()=1 2024-09-14T12:09:54.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.241+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IneKEBzxHiqhJ0DMFotB3A79B942dR2_0 2024-09-14T12:09:54.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8775506988361008358', time=2024-09-14T13:52:24.882425+0000, chain.objs.size()=1 2024-09-14T12:09:54.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.p6b_51DEgctANaP3ieEbUyGVelhGjQW_0 2024-09-14T12:09:54.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8147456159162168367', time=2024-09-14T13:52:26.110934+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zd4YtYtDwaGSDMv5l_ZWseR3i8BUzwV_0 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15934694002546786627', time=2024-09-14T13:52:27.169029+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0xcyMYQU5q_lCuF-BpoLAfq8GwuutUM_0 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.252556726365529736', time=2024-09-14T13:52:27.276499+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3y2nNIblnKpUFWNOAlz8ry8yNYDI9KG_0 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9409506705202610573', time=2024-09-14T13:52:27.342837+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9_bGjw7DXlU0SYQq41ue4D3Avytl1Db_0 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1751507975285482932', time=2024-09-14T13:52:27.682804+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nbdvFfSxTYOAM2lR0BWlxnFnX5cenmJ_0 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12087978850853869170', time=2024-09-14T13:52:28.644872+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GF230QzjW9BSSdus6leOX4bBU1YqG0l_0 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5750856345872140250', time=2024-09-14T13:52:28.910562+0000, chain.objs.size()=1 2024-09-14T12:09:54.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.242+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yZcJiO6U7u8-bXg7QhPMIGtAsWcSUVv_0 2024-09-14T12:09:54.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.244+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4110190644394838997', time=2024-09-14T13:52:29.110750+0000, chain.objs.size()=1 2024-09-14T12:09:54.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.244+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pqvGVh5v_H4jZBGAoCIR2YtEouKKgXG_0 2024-09-14T12:09:54.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.244+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16591597118813593518', time=2024-09-14T13:52:29.666637+0000, chain.objs.size()=1 2024-09-14T12:09:54.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.244+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MNVlkWqRd7YLSZdKRaChkQ8u4RaujVH_0 2024-09-14T12:09:54.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.246+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/46226 2024-09-14T12:09:54.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T12:09:54.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.741068729273589060', time=2024-09-14T13:52:30.019407+0000, chain.objs.size()=1 2024-09-14T12:09:54.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WU_GERxgVnghH4FE5oZ-oCtonTxe8Bw_0 2024-09-14T12:09:54.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16151723937421006717', time=2024-09-14T13:52:30.939174+0000, chain.objs.size()=1 2024-09-14T12:09:54.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ldNScgKvQKfwLlcSJIymhApivg_uBSS_0 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.700089964564404991', time=2024-09-14T13:52:31.526676+0000, chain.objs.size()=1 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ydNCFI9KD9q5OSAANrSKoNkOdKgbtMf_0 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.93086336331616932', time=2024-09-14T13:52:31.912829+0000, chain.objs.size()=1 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.w0BNbfoYD5MkDCj22xk7c0lyxHTIJBk_0 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14451304540497940018', time=2024-09-14T13:53:51.693438+0000, chain.objs.size()=1 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.462__shadow_.-VtvDQ0E27PQtg53QJag_p1nVr6F-qT_0 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2441522473318901041', time=2024-09-14T13:53:51.694106+0000, chain.objs.size()=1 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.462__shadow_.ERL-X5cG6bhkIspBTx0Wi1IX6hekGic_0 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8566558664632051040', time=2024-09-14T13:53:53.948226+0000, chain.objs.size()=1 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.465__shadow_.HdCqNEmGIcu85MmyPBn6uS9lk4uC0mr_0 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5871645135251573909', time=2024-09-14T13:56:11.531983+0000, chain.objs.size()=3 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~5KI2LQsRotsnR2PfOxddfc2__P0Dx08.1 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~5KI2LQsRotsnR2PfOxddfc2__P0Dx08.2 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~5KI2LQsRotsnR2PfOxddfc2__P0Dx08.3 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12075173282029352111', time=2024-09-14T13:56:21.618082+0000, chain.objs.size()=3 2024-09-14T12:09:54.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~WaZtP9eCuan5lMYn_z7fr_qMqlVDvSY.1 2024-09-14T12:09:54.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.249+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~WaZtP9eCuan5lMYn_z7fr_qMqlVDvSY.2 2024-09-14T12:09:54.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.252+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.525__multipart_mymultipart.2~WaZtP9eCuan5lMYn_z7fr_qMqlVDvSY.3 2024-09-14T12:09:54.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.252+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14139795729065789281', time=2024-09-14T13:57:34.034563+0000, chain.objs.size()=1 2024-09-14T12:09:54.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.252+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.557__shadow_.f_SwLy1VclWnzi0s9PghnnenUKkim9G_0 2024-09-14T12:09:54.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8821616565447820247', time=2024-09-14T13:57:40.587819+0000, chain.objs.size()=1 2024-09-14T12:09:54.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.559__shadow_.ZgSqHmoBEdGXgS-aMHM0KyGctTE7dxT_0 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11356223800980522978', time=2024-09-14T13:57:56.646548+0000, chain.objs.size()=1 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:hWIbE356Od5z0.mWW7Qn4RDGJZ.fGub_.DqKjK6O1BeTpu_qspIo8sTGx3KrEVmr_0 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18376176523767260056', time=2024-09-14T13:58:06.297766+0000, chain.objs.size()=1 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.572__shadow_.03Btk1rde0wc1pcKYyP04WcJMm70QfY_0 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.86498112033974367', time=2024-09-14T13:58:11.899352+0000, chain.objs.size()=1 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.574__shadow:j3zN2pqnM32JydKAOoKRfxicofKP36s_.2XVSi5NebSgH566X83Jt7QDZX43POyC_0 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13489948777445367266', time=2024-09-14T13:58:35.186690+0000, chain.objs.size()=1 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:wBTi.cUkqSyNfO35iDrv2xIdvVFOZ3q_.xW5Zrtu880EAEtSqOKLEh1aJbbxmRVa_0 2024-09-14T12:09:54.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5851194073968823836', time=2024-09-14T13:58:55.461793+0000, chain.objs.size()=1 2024-09-14T12:09:54.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:acdwUSVZuUGwPsHCq-Wjq6qRiqYLShe_.1ZfMns8ouWLLQj3ln9maEm-hwG9uqKv_0 2024-09-14T12:09:54.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3139518678629007909', time=2024-09-14T14:04:09.695170+0000, chain.objs.size()=1 2024-09-14T12:09:54.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.253+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.697__shadow:sYx0vdmGhabNa41oJSqfyg2aVbVLhdN_.ddnxzHKKSZmk1UQCROsXqWywyIjut3b_0 2024-09-14T12:09:54.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.257+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.260+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T12:09:54.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.261+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.261+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54025' 2024-09-14T12:09:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13096886149500008767', time=2024-09-14T13:49:16.548698+0000, chain.objs.size()=1 2024-09-14T12:09:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.254__shadow_.g03yc7srwwVttxWbyQkMOjl3ZCsHazV_0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8408204925441255041', time=2024-09-14T13:49:59.122485+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TpikZihe7RQmDQBLZM5EEFM-o-H_V-x_0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2489573257670331292', time=2024-09-14T13:49:59.403100+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oh9yFFoRn5SCwNJ1KzRKT3oCrWppsue_0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18252826363352372077', time=2024-09-14T13:49:59.424870+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.iMCANcn7PjgadmN0hU5KFY90Fa0Pg6k_0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6903850266878654758', time=2024-09-14T13:49:59.533212+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.sXJs5DSr6lVGQgehGqbxAaDbvEDrIf__0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8422714980407939013', time=2024-09-14T13:49:59.534010+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.75MkZKtJ098k27gBkLLz4GAvV1n9faD_0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13662042089242769026', time=2024-09-14T13:49:59.676120+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XjfE_hZ4dUC1rsyXrugX4mUhGFxdAO4_0 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11167422394487625090', time=2024-09-14T13:50:01.238385+0000, chain.objs.size()=1 2024-09-14T12:09:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.l5uk7z6tNgG2vzmhJjjT7Vz0ENCvTdd_0 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11020241002781745654', time=2024-09-14T13:50:02.000474+0000, chain.objs.size()=1 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.37BAJHPsPPxTb3AsKlBPfdtEiny35dr_0 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17581880898390090955', time=2024-09-14T13:50:02.164829+0000, chain.objs.size()=1 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EYcbGCqawrVxkkyLqGDRvG_lnnQxxew_0 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13192129364419221592', time=2024-09-14T13:50:02.248411+0000, chain.objs.size()=1 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fvSxT0LCkk5Fa9KP7sQsltPMeV3v1Xa_0 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3536539268022005607', time=2024-09-14T13:50:02.777593+0000, chain.objs.size()=1 2024-09-14T12:09:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.262+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zoFrumn6IMau7ysLHoblQnTEjC6KJJA_0 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3533101111206549123', time=2024-09-14T13:50:02.941505+0000, chain.objs.size()=1 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.T5clJCOM0uZao5_-QyV_EuRwa0AYKCU_0 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16666026082878410392', time=2024-09-14T13:50:02.999950+0000, chain.objs.size()=1 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SGyBXHYj4nZoln0qgBXAtWjy8xQK_fj_0 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2405479515061192868', time=2024-09-14T13:50:03.566413+0000, chain.objs.size()=1 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kxS2QE9fMnjGT27ytt3S9TGLcWUxiaX_0 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12597129052529187505', time=2024-09-14T13:50:03.582523+0000, chain.objs.size()=1 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xSiDusT2ZHKLD_KUsTedVRzTJSmAytM_0 2024-09-14T12:09:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17961567746748083252', time=2024-09-14T13:50:03.583042+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TSIZC16d3Pt80nCiXZxETlRjhLD0zs8_0 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16687319602146421424', time=2024-09-14T13:50:04.146743+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.L9ceb6WZFoforSKm17YXiisOEpbSaL8_0 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1404956930069270175', time=2024-09-14T13:50:04.219759+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Nl2ZaISZGYilloUpd5EvPBBA1ItZKVm_0 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12458624909136733086', time=2024-09-14T13:50:04.996682+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nfNZqnNe6wPytEGmHZWFrmtK1_qFoN3_0 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2948497821827815067', time=2024-09-14T13:50:05.145326+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pUVYFkP1-bRUOOe__8J4ke2TQ8D3kGJ_0 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13647891347609396461', time=2024-09-14T13:50:05.471681+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yrhrmUi4TUPKwi65-ssOGf6o0YJi_hI_0 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2909456396734916701', time=2024-09-14T13:50:06.678718+0000, chain.objs.size()=1 2024-09-14T12:09:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.266+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fvH5_4WmuTrWKOdozEBBWJndgCf9hcN_0 2024-09-14T12:09:54.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.269+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4803638823852803151', time=2024-09-14T13:50:06.680142+0000, chain.objs.size()=1 2024-09-14T12:09:54.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.269+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.d9mjRfki443O4QIppPJsKD_ktk30-7__0 2024-09-14T12:09:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6635099671243668327', time=2024-09-14T13:50:06.782857+0000, chain.objs.size()=1 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MrD3O_SZLd33mztTuXlWE2VUYx8fOV1_0 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.823373593267758577', time=2024-09-14T13:50:07.249421+0000, chain.objs.size()=1 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rpkN-aDCdQ_VBTiV5e_xKHtS85a9nr8_0 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4270219841964161902', time=2024-09-14T13:50:07.583265+0000, chain.objs.size()=1 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BFnkoS2J_4dJVCyKkVa3xVEoSD3Wr5z_0 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12135792314930221585', time=2024-09-14T13:50:07.707215+0000, chain.objs.size()=1 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vVfyA4FT_VJZUh-n4Hhpec0Fc6GNkq9_0 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5822502900974859614', time=2024-09-14T13:50:08.003011+0000, chain.objs.size()=1 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.skTRPOyQ-RR2R1Xo2acUHUHkbB2BEEj_0 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10774147778182549149', time=2024-09-14T13:50:08.943130+0000, chain.objs.size()=1 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6Hndu2-0Lp5gr6cgFRNMw6JmqOykij__0 2024-09-14T12:09:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1910649104107423611', time=2024-09-14T13:50:09.199912+0000, chain.objs.size()=1 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.24IZtX0A23Z7paI1Rgu_zQPyECkbixT_0 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10888223113922924001', time=2024-09-14T13:50:09.554709+0000, chain.objs.size()=1 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jGlx3zpz5vZevQEkICSfffYOFzlOon0_0 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8391180849676604946', time=2024-09-14T13:50:14.016842+0000, chain.objs.size()=1 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.269__shadow_.o-BTwCzLWeczHjbiOoVYSWipppY77u8_0 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10024343558235749259', time=2024-09-14T13:50:18.231194+0000, chain.objs.size()=1 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.276__shadow_.N-y4HHnmeIhuE7KXuEwLdcbyCe8by4F_0 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11078477602974906580', time=2024-09-14T13:50:44.472962+0000, chain.objs.size()=1 2024-09-14T12:09:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.271+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.313__shadow_.J2lf8z266XYJy4FG-0VcuML6BYktr1D_0 2024-09-14T12:09:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.669856701560063781', time=2024-09-14T13:50:51.353971+0000, chain.objs.size()=1 2024-09-14T12:09:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.322__shadow_.YdJT5R6-tvgknLxO9bIyZjuS0XMSEKk_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12916054533803785941', time=2024-09-14T13:51:30.688314+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tvrp7iuYlr2v0vb-CmM6Qeg7lAjo99j_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10141167207073512534', time=2024-09-14T13:51:30.969422+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.wuaXBG7XReBKbfVurqlEQ52Bfx4Lust_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17140064978565079609', time=2024-09-14T13:51:31.253998+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4IEv300G1E3tUkMQxyzQdAPdZPzf_Hq_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11800758804274256964', time=2024-09-14T13:51:31.443769+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.45gfafbdbyZAY2pdG-hUPrHYNYgwIk6_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6454058605533246699', time=2024-09-14T13:51:31.554970+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.sCESxBj49Q6Pxb6WynonfOj6zl_ViOB_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13457615003445303701', time=2024-09-14T13:51:31.669370+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8JH5_g9skOUwqh9IfPhqAJMJeGM3ek4_0 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.81064824217524691', time=2024-09-14T13:51:33.309908+0000, chain.objs.size()=1 2024-09-14T12:09:54.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pWe7AEuNKiD9lR7JphqgWIH0sQt7SzT_0 2024-09-14T12:09:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13410047572053383749', time=2024-09-14T13:51:34.304421+0000, chain.objs.size()=1 2024-09-14T12:09:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.275+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QUvNGSjbKPNAfL0w1XI0SdmMUJW1JAE_0 2024-09-14T12:09:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.276+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11078091727208492016', time=2024-09-14T13:51:34.675192+0000, chain.objs.size()=1 2024-09-14T12:09:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.276+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4aNxjjS7wVg51KZ21UQUz2bVdP8LU6H_0 2024-09-14T12:09:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.276+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13544864676212848090', time=2024-09-14T13:51:35.355309+0000, chain.objs.size()=1 2024-09-14T12:09:54.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.276+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.6l_EEtZ946lxipJlZ4JLcsYIIyZOOnu_0 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11765828515393808928', time=2024-09-14T13:51:35.572666+0000, chain.objs.size()=1 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.euX2uFICW0jlN59qTao7CxB6-7IkyRL_0 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4458842982296922195', time=2024-09-14T13:51:37.007666+0000, chain.objs.size()=1 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S7TQxLEQn5UbYrhGL_iQ937nwHZOMpN_0 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11949297521494038627', time=2024-09-14T13:51:37.144085+0000, chain.objs.size()=1 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bkTsTM91YCy0pNvlsRWlZt60IqtXjMI_0 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4455632078274419883', time=2024-09-14T13:51:37.312896+0000, chain.objs.size()=1 2024-09-14T12:09:54.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yM3l6i9K48xOhDoi_wDVn5z_7JbvDzO_0 2024-09-14T12:09:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11356079263462517007', time=2024-09-14T13:51:37.653226+0000, chain.objs.size()=1 2024-09-14T12:09:54.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.278+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jmLCvI7p8vXZqcvtEsfkhcLm4-DkR5m_0 2024-09-14T12:09:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18100971939792947184', time=2024-09-14T13:51:39.339169+0000, chain.objs.size()=1 2024-09-14T12:09:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZvwUxGJUoGyLAecPf6XUoaa6Khlefgs_0 2024-09-14T12:09:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16389060099704925201', time=2024-09-14T13:51:40.167211+0000, chain.objs.size()=1 2024-09-14T12:09:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.se4Ye_1awwTxdKsFLNA7aTVMKUqX5DH_0 2024-09-14T12:09:54.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3834951700413278125', time=2024-09-14T13:51:40.325834+0000, chain.objs.size()=1 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.I-DQjCc53tRU78TCoW8lpAaucjD9EbS_0 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13909762395477804513', time=2024-09-14T13:51:40.404696+0000, chain.objs.size()=1 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.281+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.idlQjLk9XjSM5IQ34_yKhF89uwRvR4t_0 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14978009860439961712', time=2024-09-14T13:51:40.488160+0000, chain.objs.size()=1 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.y4ByryAiZMjoERods13neSj2ZbzdbWM_0 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.282+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9246239545105060750', time=2024-09-14T13:51:40.737412+0000, chain.objs.size()=1 2024-09-14T12:09:54.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.282+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.SB1Z4EzDIrtIDPgtj1-C9YcbgSHBwCg_0 2024-09-14T12:09:54.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.284+0000 7f0432e4e640 0 -- 172.21.15.28:0/3563316194 >> [v2:172.21.15.28:6824/1073830879,v1:172.21.15.28:6825/1073830879] conn(0x7f02fc088b60 msgr2=0x7f02fc09e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12982794662408726902', time=2024-09-14T13:51:41.050510+0000, chain.objs.size()=1 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.aFLQJ4eSNuTt_5BEOUk-ltCNe-LLZFT_0 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12481019909304677737', time=2024-09-14T13:51:41.171345+0000, chain.objs.size()=1 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vrxuqHIMaDXaEjG_o5t1gmQ1SmRmLue_0 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7452575291956921664', time=2024-09-14T13:51:41.639263+0000, chain.objs.size()=1 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.roXmeknS7QGMTdTpLOtBNof35e7HCvG_0 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4085123384858032112', time=2024-09-14T13:51:41.838036+0000, chain.objs.size()=1 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nir9CFXM2BFpKFjju5_5ArHcTtY84AM_0 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.403218056655696030', time=2024-09-14T13:51:41.870802+0000, chain.objs.size()=1 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qVzOT6_qoF1qRBxRQ9ndFgBjXXxZBfp_0 2024-09-14T12:09:54.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5527374396211526832', time=2024-09-14T13:52:21.075097+0000, chain.objs.size()=1 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mttr5cuB_Kkfzcyi9H3kEI-AbwsuNDf_0 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12977694542107590164', time=2024-09-14T13:52:21.330969+0000, chain.objs.size()=1 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.O0HMwmjxb-ntiIkOsz_7HYwj6lwAuOM_0 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10398365444280921787', time=2024-09-14T13:52:21.857222+0000, chain.objs.size()=1 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.S5jaZM6F0PG0EJVN5rFgn8yrIkDSsTZ_0 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12145276003351309845', time=2024-09-14T13:52:22.690661+0000, chain.objs.size()=1 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LkGcvxsm2kvt9zGIhCNF1hCgiuWSV1P_0 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8776735113805156746', time=2024-09-14T13:52:23.440221+0000, chain.objs.size()=1 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.oCYlJ1RkdZgdQFR4JRGpUQLTgb0-qDY_0 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2752453693029196092', time=2024-09-14T13:52:23.610145+0000, chain.objs.size()=1 2024-09-14T12:09:54.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.286+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zHYK8hwGR7jDmxuWP-xNCrZoycu4oBx_0 2024-09-14T12:09:54.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.289+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3952588128780041899', time=2024-09-14T13:52:23.708485+0000, chain.objs.size()=1 2024-09-14T12:09:54.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.289+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BNmwl0BufjzeL1gxr_7OxijgFQRAmTO_0 2024-09-14T12:09:54.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.289+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3113174906167862446', time=2024-09-14T13:52:23.752041+0000, chain.objs.size()=1 2024-09-14T12:09:54.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.289+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WBRyfimXWSPmaQdPsIkpVU7NjV4DGUA_0 2024-09-14T12:09:54.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.289+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1281031587428001164', time=2024-09-14T13:52:24.354578+0000, chain.objs.size()=1 2024-09-14T12:09:54.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.289+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.fq2Vh2_Lsf2EpvjZ_4BAkWmwpUNno8y_0 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6490775112275585569', time=2024-09-14T13:52:24.423330+0000, chain.objs.size()=1 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GFb91hBWqBTnRtxpD_DO48IkPH273jZ_0 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10589895527127065866', time=2024-09-14T13:52:24.498679+0000, chain.objs.size()=1 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ImgCOQmUu-0sYVDhfwyq48UyG88pRTf_0 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12579409566725295173', time=2024-09-14T13:52:24.806245+0000, chain.objs.size()=1 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YugWLHmDJ2YG37fyFfe-NoXhbg1avFt_0 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14393117143835158228', time=2024-09-14T13:52:25.919979+0000, chain.objs.size()=1 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BuhJO8VPwHzMzRRxB5L9zdXmpMBmLh1_0 2024-09-14T12:09:54.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15467535709049451825', time=2024-09-14T13:52:26.030836+0000, chain.objs.size()=1 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3axsIOKBLSjtIjXALlMOigszeCEUzKP_0 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1628859411858625477', time=2024-09-14T13:52:26.075874+0000, chain.objs.size()=1 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xN4bKFhjzHED-Rv4ErpMsr1K9Uuu7y9_0 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11469052355940314231', time=2024-09-14T13:52:26.272519+0000, chain.objs.size()=1 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0gPbMP2so_yptfEAyVcxKxqzSa3IKlV_0 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15175315327924735173', time=2024-09-14T13:52:27.179763+0000, chain.objs.size()=1 2024-09-14T12:09:54.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.290+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-g2AAlhSKdKilblCuAwQAG5Nuwq3Mhv_0 2024-09-14T12:09:54.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.293+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16895800241079207143', time=2024-09-14T13:52:27.739968+0000, chain.objs.size()=1 2024-09-14T12:09:54.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.293+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.r5Dzvt2Edll0Z63PkgW-kFOLi80UJd6_0 2024-09-14T12:09:54.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.293+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16340869976934119304', time=2024-09-14T13:52:27.917570+0000, chain.objs.size()=1 2024-09-14T12:09:54.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.293+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qR1lZfy2QYsi0i76k3yR99O6zWFLKSd_0 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13326002027944412457', time=2024-09-14T13:52:29.086646+0000, chain.objs.size()=1 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JsNzOqRuorSyLkUwPqwEsB3saKKvW11_0 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3294132371833149237', time=2024-09-14T13:52:29.300698+0000, chain.objs.size()=1 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.u2ceM5NzDAzBMmGxnGhyNFxeZLvpVKb_0 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7693503513823778136', time=2024-09-14T13:52:30.663038+0000, chain.objs.size()=1 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.vyL8xNdSFburzSz9Ww2Ux0hrr3nCyxd_0 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8474631675747574265', time=2024-09-14T13:52:31.023316+0000, chain.objs.size()=1 2024-09-14T12:09:54.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.294+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VMj2cUfqv1rJLjGjXt9cw49_GKGq1cH_0 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9594340716278345621', time=2024-09-14T13:52:32.102109+0000, chain.objs.size()=1 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VmyWcHJPA7SwtzF9T4Bsw5nR_p4pD1S_0 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5946226223953497203', time=2024-09-14T13:52:34.786703+0000, chain.objs.size()=1 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.329__shadow_.LXkae3e4j-ZJMLdZ9mdx1LCeaVhJ0Gi_0 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3344515126926609830', time=2024-09-14T13:52:36.896952+0000, chain.objs.size()=1 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.333__shadow_.Nziaqa42Q9cdNvNVLo3C2IcMOSZtVPv_0 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12678011195325660039', time=2024-09-14T13:52:47.066291+0000, chain.objs.size()=1 2024-09-14T12:09:54.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.295+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.353__shadow_.NSiR8ctht_26MggY-E-4Cuv6v9NqqDq_0 2024-09-14T12:09:54.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.296+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13388019908280442913', time=2024-09-14T13:52:59.859176+0000, chain.objs.size()=1 2024-09-14T12:09:54.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.296+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.377__shadow_.527UTg8kFFLSp69N2FodxxjOYTpfbw4_0 2024-09-14T12:09:54.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.296+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14151161680159061959', time=2024-09-14T13:53:02.205988+0000, chain.objs.size()=1 2024-09-14T12:09:54.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.296+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.381__shadow_.l6_HFjCuRjufUPbZGNY7f7DWzlnvEjp_0 2024-09-14T12:09:54.295 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3355038931422187234', time=2024-09-14T13:53:07.491667+0000, chain.objs.size()=1 2024-09-14T12:09:54.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.390__shadow_.tGk7fM2InhrIl4I5ATO2IYDRd_IP3He_0 2024-09-14T12:09:54.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.297+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2284566065427946206', time=2024-09-14T13:54:14.105809+0000, chain.objs.size()=1 2024-09-14T12:09:54.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.297+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.498__shadow_.-CJq3ySPGHRL77yFZFqNS50fGxCVb8p_0 2024-09-14T12:09:54.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.298+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9586814266212740562', time=2024-09-14T13:54:30.044714+0000, chain.objs.size()=1 2024-09-14T12:09:54.296 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.298+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.512__shadow_.OJmEV_tNG7Cga2wbGAITBo-KEUOIRLM_0 2024-09-14T12:09:54.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.299+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8784057774667757111', time=2024-09-14T13:55:05.012963+0000, chain.objs.size()=3 2024-09-14T12:09:54.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.299+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~o7qU1dHsruV1GaRkwlKI38-Az0cbHjx.1 2024-09-14T12:09:54.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.299+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~o7qU1dHsruV1GaRkwlKI38-Az0cbHjx.2 2024-09-14T12:09:54.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.299+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.521__multipart_mymultipart.2~o7qU1dHsruV1GaRkwlKI38-Az0cbHjx.3 2024-09-14T12:09:54.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.301+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11494718153918395364', time=2024-09-14T13:57:20.855609+0000, chain.objs.size()=1 2024-09-14T12:09:54.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.301+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.551__shadow_.ELTnmybERLg9qM4mKVYOwQSWxpUUspu_0 2024-09-14T12:09:54.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.301+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9043541162812337206', time=2024-09-14T13:58:01.725635+0000, chain.objs.size()=1 2024-09-14T12:09:54.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.301+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:g8KI-1P1Xu2CdT7cY3-vPs30lm6wXpJ_.wT0aTLWs_AWKfZ0yMgtAAxO2TqbnPLk_0 2024-09-14T12:09:54.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.301+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5052076047344084057', time=2024-09-14T13:58:21.674283+0000, chain.objs.size()=1 2024-09-14T12:09:54.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.301+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:JheXr6FXOjn-LaQyf4XYwIQ3OhFwN7H_.qMGJEx7-oy-mZ8Q41vG0Dz6u4UO2F_x_0 2024-09-14T12:09:54.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.303+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1196048590651230458', time=2024-09-14T13:58:25.469202+0000, chain.objs.size()=1 2024-09-14T12:09:54.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.303+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:2K91.G8dhgV5RPwtPaFGjUpLqqGcAci_.A7uBmJHIbPkXvbilEPL3KR9vFr-_6G0_0 2024-09-14T12:09:54.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.303+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8152254624369673101', time=2024-09-14T13:58:38.262716+0000, chain.objs.size()=1 2024-09-14T12:09:54.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.303+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:6fJ-4SeNKvoXgfCW1idfx-jt28xwC3E_.va42puc207rlJEpTrHcTHUAplgo2MTc_0 2024-09-14T12:09:54.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.305+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/54025 2024-09-14T12:09:54.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T12:09:54.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17641288700232875792', time=2024-09-14T13:59:14.568358+0000, chain.objs.size()=1 2024-09-14T12:09:54.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.608__shadow_.kwHe4EHrnhqDQYVqyX3cGPWuOfDKX15_0 2024-09-14T12:09:54.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6321286353452747053', time=2024-09-14T14:03:54.980865+0000, chain.objs.size()=1 2024-09-14T12:09:54.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.668__shadow_.QdFagT7jBzdcS4wl850X8AzhqhrUuyi_0 2024-09-14T12:09:54.306 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18184615458932080546', time=2024-09-14T14:04:14.341801+0000, chain.objs.size()=1 2024-09-14T12:09:54.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.704__shadow:z.DVM5lilRn5S5p-1Vl5afdKMyBXBgU_.c-N3oD78QFsXoOCEHftFbh0lph2hOIc_0 2024-09-14T12:09:54.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9628872907967284264', time=2024-09-14T14:06:07.340438+0000, chain.objs.size()=1 2024-09-14T12:09:54.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.307+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.759__shadow_.A0UkXadhHLDqWvXnRZCdfD78AE6ZjSa_0 2024-09-14T12:09:54.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.309+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.311+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T12:09:54.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.312+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.313+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48560' 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_4Zmbd6qzAhoz9dYb_IRiZMB73hz2nYc', time=2024-09-14T13:46:54.609605+0000, chain.objs.size()=2 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.edpcw7VVF5eYMGYh1ykiOTou4egx2sy_0 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.161__shadow_.edpcw7VVF5eYMGYh1ykiOTou4egx2sy_1 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9136027158949766211', time=2024-09-14T13:47:30.425395+0000, chain.objs.size()=1 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.199__shadow_.XJZbMMRl_ecfUTct8g97GoUKNcgHEzW_0 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10472342825507946850', time=2024-09-14T13:49:07.796626+0000, chain.objs.size()=1 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.241__shadow_.3RhonDDAf7h2XtUhENxBYpUIMLrbOXT_0 2024-09-14T12:09:54.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15183221430300458808', time=2024-09-14T13:49:18.966900+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.258__shadow_.01HdsZAoMApT39ZUoG3S4_KIrIGMIQ__0 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15005197194701600976', time=2024-09-14T13:49:59.283495+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jwWf6YsxdY3JT82rj7Nl-6-lmYTSi71_0 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.335101983707925332', time=2024-09-14T13:49:59.284400+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.stbUNQZ33g9yIFKIIicsLQAm31Cma-J_0 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16140144812547766541', time=2024-09-14T13:49:59.662139+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.voB9zYhwyI19V4dAgPf3ZUVAl6dH_MI_0 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11238264216745558152', time=2024-09-14T13:49:59.873559+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.fwpNbi-_rt52gVaCW0E9Tfla38U60gj_0 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13901609659117538381', time=2024-09-14T13:49:59.929842+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.bIUxuBCml6VYqp2cWicWhajl66znccS_0 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12292360654456782537', time=2024-09-14T13:50:00.499243+0000, chain.objs.size()=1 2024-09-14T12:09:54.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RAPTh_xg85L76E-lCSp0TiEmjH2qRTP_0 2024-09-14T12:09:54.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6319532156970110902', time=2024-09-14T13:50:00.805523+0000, chain.objs.size()=1 2024-09-14T12:09:54.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.314+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wkahTdarJ6Dty4Dk6IAkkhRs5FpdTKn_0 2024-09-14T12:09:54.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.317+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3614342829331388330', time=2024-09-14T13:50:00.897799+0000, chain.objs.size()=1 2024-09-14T12:09:54.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.317+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KDwoFxy9nK1ME-GKOIBVZX-s8wtgsJc_0 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14718315963563459486', time=2024-09-14T13:50:00.944965+0000, chain.objs.size()=1 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.u31UwTsI3uiLRc4jU4rYhBTUxJ77-Dj_0 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2344101624220197272', time=2024-09-14T13:50:01.403128+0000, chain.objs.size()=1 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.rx4U91C_95Y7FMvIy4mbZ5AJ-Jgybs6_0 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2092083974155932279', time=2024-09-14T13:50:02.783776+0000, chain.objs.size()=1 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5MrtuwN875cubyX75wAjmTuqpgIo06O_0 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12972085086238962280', time=2024-09-14T13:50:02.820435+0000, chain.objs.size()=1 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.AFYsaW2ckk7dPWi7hvADbY-7E5-bVR5_0 2024-09-14T12:09:54.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2088591511349003525', time=2024-09-14T13:50:03.590514+0000, chain.objs.size()=1 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LCBnTwdsScOUClcjWqFWTdCNH0tV2kj_0 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15331775394773456771', time=2024-09-14T13:50:04.077267+0000, chain.objs.size()=1 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.26oZ_vdu1i9f8jlqmRLBg9OSqUYFrAo_0 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11422416641242483730', time=2024-09-14T13:50:04.452894+0000, chain.objs.size()=1 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.707WAUK1BF1q2y-8FdA2BTqTYdKpIDx_0 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7555228942524767129', time=2024-09-14T13:50:05.257843+0000, chain.objs.size()=1 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5QEi1Odyls2mmFFMy-XtFe_RECpR3oF_0 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15048139180702530304', time=2024-09-14T13:50:05.332168+0000, chain.objs.size()=1 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mLbPDPaBFvCZRlDdHr32R7Jajfi7tp6_0 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16812701665212559314', time=2024-09-14T13:50:06.244883+0000, chain.objs.size()=1 2024-09-14T12:09:54.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.318+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.MJ17_Y1Mmetn1ln-2_TB-vnx_265Jme_0 2024-09-14T12:09:54.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.320+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16684825548807667295', time=2024-09-14T13:50:06.372542+0000, chain.objs.size()=1 2024-09-14T12:09:54.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.320+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.02WxwDTkF1uQBoYBELr6uM_A8WvG9lk_0 2024-09-14T12:09:54.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.321+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1341576744165786985', time=2024-09-14T13:50:06.513205+0000, chain.objs.size()=1 2024-09-14T12:09:54.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.321+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0mBmNuwfn_6txhoaNFonPoc70uDObax_0 2024-09-14T12:09:54.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.322+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14382239981025042392', time=2024-09-14T13:50:06.514239+0000, chain.objs.size()=1 2024-09-14T12:09:54.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ckCF5ciFWedUByCQj-to06QnPmJYQwl_0 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12230114915732670163', time=2024-09-14T13:50:06.878600+0000, chain.objs.size()=1 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vHLxjW0Ws64OatWmRSK9M0sSZWlVtKL_0 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14274222649572930340', time=2024-09-14T13:50:07.176521+0000, chain.objs.size()=1 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pIJi2ixTh0kBOH1MKDGnxkuzvR5YHji_0 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8071449293369403471', time=2024-09-14T13:50:07.203338+0000, chain.objs.size()=1 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4SrRPixy-rI1tvCM8zUzlmtTjiZVo-B_0 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6487842167826716859', time=2024-09-14T13:50:07.852971+0000, chain.objs.size()=1 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.04FijGyTjhtUP2MWXPVWu77ptnSfrm1_0 2024-09-14T12:09:54.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16232095501247242624', time=2024-09-14T13:50:08.186794+0000, chain.objs.size()=1 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9-Ar3Yb5HsSVP0EHvrYblwqdueDk2OG_0 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12317703410384220239', time=2024-09-14T13:50:08.394621+0000, chain.objs.size()=1 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ovIcd_UVth90vUOO2S0KpXt38_ijkzb_0 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8099181272400965301', time=2024-09-14T13:50:08.456380+0000, chain.objs.size()=1 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Z72gSBqiCQ-d9cZypIYuRipFIOHGYpX_0 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10879522846552126471', time=2024-09-14T13:50:08.522079+0000, chain.objs.size()=1 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YSe_sWDC_KSk8mZseRqWvdj3bFdZmuo_0 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17246621943136553588', time=2024-09-14T13:50:08.608886+0000, chain.objs.size()=1 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.323+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._UvJJ34aUsAf-vkIe9iGhNOcDBoc3vB_0 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.324+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8204611426304679332', time=2024-09-14T13:50:08.944766+0000, chain.objs.size()=1 2024-09-14T12:09:54.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.324+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4mXg68d3RH-l6OlYF-XqhVDgMaZBVrk_0 2024-09-14T12:09:54.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.327+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15758009710593181246', time=2024-09-14T13:50:09.347807+0000, chain.objs.size()=1 2024-09-14T12:09:54.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.327+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._pO8P7cM1auh3iOiEzkLhAHSrj52sFM_0 2024-09-14T12:09:54.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14218126349263884953', time=2024-09-14T13:50:10.477161+0000, chain.objs.size()=1 2024-09-14T12:09:54.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.263__shadow_.x2bflnYnR8dNmXGwogiJZ0zC6u_QhMQ_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7054663728248428831', time=2024-09-14T13:50:12.836544+0000, chain.objs.size()=1 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.267__shadow_.4KUdw-28fwgm2qN4keUDqlz-JoOVoEQ_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9596908705910212893', time=2024-09-14T13:50:13.437875+0000, chain.objs.size()=1 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.268__shadow_.CTsBgISkFc1Nv8xSHEopKybu_R11F-b_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10706537694996547017', time=2024-09-14T13:50:13.438391+0000, chain.objs.size()=1 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.268__shadow_.oLzFNbMDO0HFuQZCPUiHMNUMfilHNPG_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6749219142413353235', time=2024-09-14T13:50:15.793658+0000, chain.objs.size()=1 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.272__shadow_.Dh3SRPLT3e5sJUc_Vy5UFpDSAvRVZFR_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10967397566506553746', time=2024-09-14T13:50:29.724978+0000, chain.objs.size()=1 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.aZ3K0JZcFMHucdSraUtecpO0JQ3D2Dk_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7558545948102167618', time=2024-09-14T13:50:37.046916+0000, chain.objs.size()=1 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.301__shadow_.aWtGWOccvkjyRt70srlDph682d7Uzwz_0 2024-09-14T12:09:54.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15737097069858013841', time=2024-09-14T13:50:40.454150+0000, chain.objs.size()=1 2024-09-14T12:09:54.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.306__shadow_.FdHdQPZm89Sf9v1RnzSB411bITURKxe_0 2024-09-14T12:09:54.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15913906829525619359', time=2024-09-14T13:51:30.763213+0000, chain.objs.size()=1 2024-09-14T12:09:54.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ok1FAwUXVJHxvQpJMHfcOtdlNuG-qpX_0 2024-09-14T12:09:54.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12822592928210508618', time=2024-09-14T13:51:31.386918+0000, chain.objs.size()=1 2024-09-14T12:09:54.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.328+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JaMv0xcRbf471kFZHfIwaaN7YNlFrzS_0 2024-09-14T12:09:54.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.331+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14019489646248212762', time=2024-09-14T13:51:32.592245+0000, chain.objs.size()=1 2024-09-14T12:09:54.330 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.331+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LVa5Tm37h5g0rVc6xMMeuIi0QJEFPxn_0 2024-09-14T12:09:54.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.332+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16163545354032890230', time=2024-09-14T13:51:32.632727+0000, chain.objs.size()=1 2024-09-14T12:09:54.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.332+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EsEmassDxb445_ktT8NP2H4ZHMARrBR_0 2024-09-14T12:09:54.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.332+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6013028600006585628', time=2024-09-14T13:51:33.108794+0000, chain.objs.size()=1 2024-09-14T12:09:54.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.332+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BITQXiwnGRVENEZqquSVMi-FL_Tjguz_0 2024-09-14T12:09:54.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15326643989685703923', time=2024-09-14T13:51:33.790985+0000, chain.objs.size()=1 2024-09-14T12:09:54.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.67QrdPPp0x3Ne9SKh3pemStg9JhPh4G_0 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3045293591527129155', time=2024-09-14T13:51:33.959097+0000, chain.objs.size()=1 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8lgHQ0git36ViY2mqxqMcP3SZRnBio1_0 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8661230210635640747', time=2024-09-14T13:51:33.973425+0000, chain.objs.size()=1 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yNdb--XnAT9NE8stiN-g1N--gwAXDS1_0 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18080840278400089060', time=2024-09-14T13:51:33.974065+0000, chain.objs.size()=1 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Kx4pH3pIePD6Mt2ZWDIIoR95PYBYFjx_0 2024-09-14T12:09:54.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5902429333054681328', time=2024-09-14T13:51:34.244917+0000, chain.objs.size()=1 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PCNiiPdP2KvQpDrC0TUv6UcaQQW0fxL_0 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8535650255402742101', time=2024-09-14T13:51:34.529267+0000, chain.objs.size()=1 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BP5ERfcMum7jyK24E1uMpfx92gP5YXe_0 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13785712905835330765', time=2024-09-14T13:51:34.855525+0000, chain.objs.size()=1 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.E_LIXt35n6jo7ryN_MmSmKzi3RGhNIR_0 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18380713651054620602', time=2024-09-14T13:51:35.322178+0000, chain.objs.size()=1 2024-09-14T12:09:54.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.333+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.TvlSDG2Yt-rgTKiie7rNJrh2R3gKO3V_0 2024-09-14T12:09:54.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6962173905265192580', time=2024-09-14T13:51:35.503109+0000, chain.objs.size()=1 2024-09-14T12:09:54.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ttKX46mqaC4ZmdpRgYM-1UYta3k51KJ_0 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11498569792618606533', time=2024-09-14T13:51:35.523831+0000, chain.objs.size()=1 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tbgOpah-4e8ItxUTslw5BgTP-knU5S3_0 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3643278886097009048', time=2024-09-14T13:51:35.589732+0000, chain.objs.size()=1 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cRi9HQ0X4PPRFGGUchkwRo1RkYJBTwg_0 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2209282799912870078', time=2024-09-14T13:51:35.682814+0000, chain.objs.size()=1 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.V41iDDXuyjtQW_QS09SScrmdo_ehXuY_0 2024-09-14T12:09:54.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16312016671950954488', time=2024-09-14T13:51:35.879026+0000, chain.objs.size()=1 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.m0Y_N4m4Gao4Mej0NAA_MLwJ1GhJY5r_0 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8254511833468875242', time=2024-09-14T13:51:35.917145+0000, chain.objs.size()=1 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pSe7H_ylQgc7DRB0boSWvPLZJ_CM7tE_0 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.423437406934568309', time=2024-09-14T13:51:36.289132+0000, chain.objs.size()=1 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.336+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1edC6Hav_tWWbQey4O0QvW9R5Kt906r_0 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3697090963189079289', time=2024-09-14T13:51:36.407915+0000, chain.objs.size()=1 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xXGgiXm3a5IN1jsCK5RFx7RDIOcFEQ3_0 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17536205230213788', time=2024-09-14T13:51:37.178111+0000, chain.objs.size()=1 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5T9dFbzQ83oH9hYoiJcSAr0GIbtYmPR_0 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2375349954853727028', time=2024-09-14T13:51:37.376842+0000, chain.objs.size()=1 2024-09-14T12:09:54.336 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PZ-T-eRUdsO6qUJIfcl9WU9GSScGN73_0 2024-09-14T12:09:54.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13760943944848964651', time=2024-09-14T13:51:37.731496+0000, chain.objs.size()=1 2024-09-14T12:09:54.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.337+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hPqjtBfiPlEc6spP6O3L6SWqULaJ29T_0 2024-09-14T12:09:54.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.339+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4042197855153074123', time=2024-09-14T13:51:38.289930+0000, chain.objs.size()=1 2024-09-14T12:09:54.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.339+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DlzfcCf2Fov9kW0VBt7oALL3OqJtYUZ_0 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.340+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6315875631571057501', time=2024-09-14T13:51:38.411362+0000, chain.objs.size()=1 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.340+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fkhqSrgjxwpbxjYxkYr9H4YLJMbkQP__0 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.340+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1548533072244429297', time=2024-09-14T13:51:38.595803+0000, chain.objs.size()=1 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.340+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dpKLANpPXaL5Jv2Nj1gu50uzYY6-E3D_0 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.340+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2305676937634929135', time=2024-09-14T13:51:38.760079+0000, chain.objs.size()=1 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.340+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YsT5VValadYvALzkclEdVErd_Z4lgSU_0 2024-09-14T12:09:54.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17308383403328477226', time=2024-09-14T13:51:38.835446+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lX8EqUj9joyoNDSKyWjg5q07X6VdeKf_0 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11714110747316152778', time=2024-09-14T13:51:39.057325+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2j4w_e77BJm6oH8RWIUl8Rtum1yYuSE_0 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13386918779570600392', time=2024-09-14T13:51:39.278394+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.eVq1joNldH4Z_5PfGH-JWrU-oZlaHiU_0 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3087062020070437631', time=2024-09-14T13:51:39.279094+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lhJ5fYQjprtHASpjeJp8viREnjpj_xI_0 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14421944983757951370', time=2024-09-14T13:51:39.339348+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8ewdZ0C1YtnfkNBiJ8D1oLesHEPR0KB_0 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3618268363522187229', time=2024-09-14T13:51:40.084553+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.c8p-nRlZTGTIZeSQAl2nhKUbEQcqR2u_0 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12386099996283679962', time=2024-09-14T13:51:40.386979+0000, chain.objs.size()=1 2024-09-14T12:09:54.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.341+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.sfd2ChCgOqv0B_ZL2mDvqS5mn3gxm_v_0 2024-09-14T12:09:54.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.342+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13260936279672770996', time=2024-09-14T13:51:41.236457+0000, chain.objs.size()=1 2024-09-14T12:09:54.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.342+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.eIR68otz74KA3SJPNofaaUODmMWENXG_0 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7890688296078093903', time=2024-09-14T13:51:41.519060+0000, chain.objs.size()=1 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.g4wwLTqqMgPKELAwbGHUrn8rigtI1R1_0 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12969911895237925399', time=2024-09-14T13:51:41.740215+0000, chain.objs.size()=1 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3OSc1AZenl3nl5CG-u5cc5RWPq4eOo-_0 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14803124828118498234', time=2024-09-14T13:51:41.879695+0000, chain.objs.size()=1 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2ntf2JG3_F_33ztqiIVaV7EodNBOV6O_0 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14750117889748799912', time=2024-09-14T13:52:21.759571+0000, chain.objs.size()=1 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6bqE7iSoN0Nk9-718PAQT2kgZEliyf8_0 2024-09-14T12:09:54.343 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17168691595547926198', time=2024-09-14T13:52:21.769518+0000, chain.objs.size()=1 2024-09-14T12:09:54.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FZSBChWd6DDayVGeF52XnFGZbbF8Raw_0 2024-09-14T12:09:54.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18039735627214333325', time=2024-09-14T13:52:22.105063+0000, chain.objs.size()=1 2024-09-14T12:09:54.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YWdCzrDKWd0CZXe67oiigxro8esMsj0_0 2024-09-14T12:09:54.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17964927899904602223', time=2024-09-14T13:52:23.750819+0000, chain.objs.size()=1 2024-09-14T12:09:54.344 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.344+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cJ7liNk1zDgWt7s3apI_pQY5g6jo8SJ_0 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.302949190308555148', time=2024-09-14T13:52:24.950765+0000, chain.objs.size()=1 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.d6UcjXN1l_N0Sk1D9kRfpGOYu2BJ7jU_0 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1143031183216840567', time=2024-09-14T13:52:25.720041+0000, chain.objs.size()=1 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZjGjZyzy4sD1mYWXCUwcBHH4O69YdgM_0 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5342716879608022042', time=2024-09-14T13:52:26.029539+0000, chain.objs.size()=1 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tz_KUs4ApKm3eWLKdB4Mwm6aheBZ5-W_0 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14598698204033630304', time=2024-09-14T13:52:26.049970+0000, chain.objs.size()=1 2024-09-14T12:09:54.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.346+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.NbYBAPXlwWbwgNtweD0T6S55EUM2EDu_0 2024-09-14T12:09:54.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.347+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1479022410354895916', time=2024-09-14T13:52:26.708946+0000, chain.objs.size()=1 2024-09-14T12:09:54.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.347+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EnbCJlU0MEwxOqJf67RrBfpF2pA6s-g_0 2024-09-14T12:09:54.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6698034463405665252', time=2024-09-14T13:52:27.892954+0000, chain.objs.size()=1 2024-09-14T12:09:54.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EWZJkCItP4KjzJ9TYZ1WzBPdlHZmvy3_0 2024-09-14T12:09:54.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.348+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13070069248329043350', time=2024-09-14T13:52:28.024010+0000, chain.objs.size()=1 2024-09-14T12:09:54.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.348+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.w5dhPLDLgSroP0QJ5KT1hlZtLtfNQrh_0 2024-09-14T12:09:54.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17282582598439400536', time=2024-09-14T13:52:28.960416+0000, chain.objs.size()=1 2024-09-14T12:09:54.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AacDz6TAZACSW4B-A8xSKH1UAlyhZgs_0 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1624354930873151437', time=2024-09-14T13:52:29.019640+0000, chain.objs.size()=1 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Nohwpt51HlkNBPYcY34kHcEk3FZV6En_0 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3205407785016881347', time=2024-09-14T13:52:29.298340+0000, chain.objs.size()=1 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Qd9op_FZkMPDHR-rNAOLnJdtfbakI-V_0 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6050211142264748193', time=2024-09-14T13:52:29.666672+0000, chain.objs.size()=1 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.q9SbIBtlR5uEfze5vOGg4ydVLW7CLmw_0 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7867392814610148686', time=2024-09-14T13:52:30.091494+0000, chain.objs.size()=1 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8zK-4id8H6c2u8OIPu_vlmZzaHO88t-_0 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8827936955636448299', time=2024-09-14T13:52:30.324553+0000, chain.objs.size()=1 2024-09-14T12:09:54.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.349+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WW7BFoTlpcSy63QJbuElbfxZ7Qzno_8_0 2024-09-14T12:09:54.351 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.353+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/48560 2024-09-14T12:09:54.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T12:09:54.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1604273499515888983', time=2024-09-14T13:52:30.386622+0000, chain.objs.size()=1 2024-09-14T12:09:54.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.w0MY6543xIF1ckLIjEGrv7OI8tVygpr_0 2024-09-14T12:09:54.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7077098867347340505', time=2024-09-14T13:52:30.474798+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rgkXyryTdu__H2qMTdtZnX6QunYDbdc_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16267822081148213025', time=2024-09-14T13:52:31.022451+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EB2B37dgz4D2NvwgDS2lY_rOtxE9OoA_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12262332563645737753', time=2024-09-14T13:52:31.355247+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Sip_WL1kU-nJtERFQu-O1cYRl_oOw5E_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13569373628581833617', time=2024-09-14T13:52:31.892238+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.H_QLVaFFqCbF-_bs_kENQS0lEfN3g3n_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15319838827039799751', time=2024-09-14T13:52:32.202035+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ICcIUE6ZZg9JjHQFMlbsoJ31SW564Yn_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7339581897009841778', time=2024-09-14T13:52:36.499721+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.332__shadow_.PVmJyAPGHbbGN2vioHktGPvWMYuTQQc_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.143022505820856651', time=2024-09-14T13:52:37.608537+0000, chain.objs.size()=1 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.334__shadow_.4vlXINYIYtBvxKJk8Yp9lP_G9iE9QIg_0 2024-09-14T12:09:54.355 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.978297946034948144', time=2024-09-14T13:52:59.204142+0000, chain.objs.size()=1 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.376__shadow_.QTAk_QRtC82Mkv5Cr4mfM8ftijaPiMA_0 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17717906263614496628', time=2024-09-14T13:54:03.283049+0000, chain.objs.size()=1 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.484__shadow_.OykNfQPc637Vf6b7QgD7HiTtXoAu88N_0 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12729365466739122338', time=2024-09-14T13:54:09.430715+0000, chain.objs.size()=1 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.490__shadow_.pNqKgG35lUVzxWCrWMeyf5U3fCb0KYI_0 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12729365466739122338', time=2024-09-14T13:54:09.630396+0000, chain.objs.size()=1 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.355+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.490__shadow_.pNqKgG35lUVzxWCrWMeyf5U3fCb0KYI_0 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10897526861133554938', time=2024-09-14T13:54:37.807595+0000, chain.objs.size()=1 2024-09-14T12:09:54.356 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.517__shadow_.EhpVORguzDAwpbDZ1znSw7yDVYnglgh_0 2024-09-14T12:09:54.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10515335533322092391', time=2024-09-14T13:55:47.843562+0000, chain.objs.size()=6 2024-09-14T12:09:54.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU.1 2024-09-14T12:09:54.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU.2 2024-09-14T12:09:54.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.dwOl1VG8Zv9SOh2_GoJ0sDgXoPGnmT39.3 2024-09-14T12:09:54.357 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU.4 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU.5 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~1mRWBy_pnKLkcB8uLmG5dI6L-z2wfNU.6 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13990513315259079676', time=2024-09-14T13:57:39.390066+0000, chain.objs.size()=1 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.358+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.558__shadow_.xvrXmskwkzDXCv_ixXuxaE7GZ0X1p2R_0 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14795008882735992898', time=2024-09-14T13:58:01.165363+0000, chain.objs.size()=1 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:5YBk4ItqdusDYreMsDa6D4thpZMoMf4_.YtVgOtoIcL23h99Leorj29o8zVy0CtR_0 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4319888432896941015', time=2024-09-14T13:58:34.042370+0000, chain.objs.size()=1 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:.eITy7MjscC.voG.6VBCTM2N59o194a_.RIqOsNX18SvI5BNhXw1xwLnsWhr7wtp_0 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.359+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12384160625131965721', time=2024-09-14T13:58:53.196298+0000, chain.objs.size()=4 2024-09-14T12:09:54.358 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.359+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~RW6dcoIJlD9rKnvSd_hq4oDb1EV9hrI.1 2024-09-14T12:09:54.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.362+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~RW6dcoIJlD9rKnvSd_hq4oDb1EV9hrI.2 2024-09-14T12:09:54.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.362+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~RW6dcoIJlD9rKnvSd_hq4oDb1EV9hrI.3 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.578__multipart_testobj.2~RW6dcoIJlD9rKnvSd_hq4oDb1EV9hrI.4 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12666957905265857796', time=2024-09-14T13:58:57.477005+0000, chain.objs.size()=1 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:fHbIaWgxXwr5whlZPM.0sw4dLBoPf0F_.GlqVSPi6Lb1kRE9bcAEeEkM8QSRHNBb_0 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9274285731370419175', time=2024-09-14T13:58:57.745358+0000, chain.objs.size()=1 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:c-m7kAVL0lEvJm4Wkfqx.yzdQRR1NIn_.GkqPwxTjFBqUkZFYZYqe6X0AmRhHm_T_0 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18157550197186208420', time=2024-09-14T14:02:26.029127+0000, chain.objs.size()=1 2024-09-14T12:09:54.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.619__shadow_.CXOb4SxOSSh8Phvp609eXy1Cwvw9uxl_0 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13101738699506422306', time=2024-09-14T14:03:06.140231+0000, chain.objs.size()=1 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.633__shadow_.GQJ-guA7stRYQsRCQ48s5FM1yqwM74s_0 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9815099674019411939', time=2024-09-14T14:03:09.460632+0000, chain.objs.size()=1 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.639__shadow_.6D77tbYKgzn7o6XFUD5EuRE849uNbzI_0 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12974396836116760786', time=2024-09-14T14:03:51.824023+0000, chain.objs.size()=1 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.363+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.664__shadow_.QBVmgT5UXmwXN3nR-dYs_fzyIcLhHls_0 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12784483520461763123', time=2024-09-14T14:03:52.764435+0000, chain.objs.size()=1 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.665__shadow_.ruGEmNGRTZRZE288cXMDQGUQ51ksCxh_0 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.364+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3211582269729731673', time=2024-09-14T14:04:31.530479+0000, chain.objs.size()=1 2024-09-14T12:09:54.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.364+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.716__shadow:Lb0XaebVjZs.ftseb89F2fn6xnS0.a9_.ND2ZdPZKc9vA1aFD7DoscpKfnwxYv-x_0 2024-09-14T12:09:54.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.366+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3039084278651932075', time=2024-09-14T14:04:41.712525+0000, chain.objs.size()=1 2024-09-14T12:09:54.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.366+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.718__shadow_.OohprEKa2cM2bds82goqjsioW0m6g0G_0 2024-09-14T12:09:54.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.366+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~7RknABIBlz5w2c1441rdUh1mPTBJL3x', time=2024-09-14T14:05:02.581236+0000, chain.objs.size()=1 2024-09-14T12:09:54.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.366+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.742__multipart_mymultipart2.2~7RknABIBlz5w2c1441rdUh1mPTBJL3x.1 2024-09-14T12:09:54.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.370+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.372+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T12:09:54.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.373+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.374+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47744' 2024-09-14T12:09:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_oyl0FtyddmMK7M5aiv8TGTk6deE0_my', time=2024-09-14T13:46:58.979471+0000, chain.objs.size()=1 2024-09-14T12:09:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.163__shadow_.wQRMb6W5xWvibmqOeDUnIzwGCtE0aFp_0 2024-09-14T12:09:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16154631036701923572', time=2024-09-14T13:49:03.725611+0000, chain.objs.size()=1 2024-09-14T12:09:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.235__shadow_.Asl7Uw8F4onBh42t5Ssxuf3EaSDBOZZ_0 2024-09-14T12:09:54.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4847911592262035626', time=2024-09-14T13:49:08.452477+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.242__shadow_.gaGurNofGzIFLZHyEMuZ1FqU9omZWJg_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7174683444028081447', time=2024-09-14T13:49:10.811437+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.245__shadow_.xNl9IoztxI_Fz85w3bUx-UBzAmfT9wU_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3262695855734906285', time=2024-09-14T13:49:11.439098+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.246__shadow_.os9Q13PoWIUgCuhcmbkm87TKMy-oqaI_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17403103478547303827', time=2024-09-14T13:49:58.831352+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Rqo24yhTg5vMvQAenbD-Xt6BncUzAwF_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4750058782037195913', time=2024-09-14T13:49:58.962866+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CZudKB4HmAq8QXXswit_1iF0jxNfNl0_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292380359170979693', time=2024-09-14T13:49:59.122225+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.N_zz3iXQcHqsMKk1iBT02lpTSJ1CJ_6_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15218678370044516917', time=2024-09-14T13:49:59.655324+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._5Ijv1Tg9gay8zg0yzsXcHP-QpD8O8r_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6609460162966116014', time=2024-09-14T13:50:00.928410+0000, chain.objs.size()=1 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.g7Gny2NLes5VDNbB3PP4kAkSsDIt0Fx_0 2024-09-14T12:09:54.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12829428765752900248', time=2024-09-14T13:50:01.066360+0000, chain.objs.size()=1 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wjAd_ZAd_IS6ySywmGlZ9apXrX_d5iS_0 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3182742835451992784', time=2024-09-14T13:50:01.191876+0000, chain.objs.size()=1 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.375+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.J9uEvWNVMHmkkDDvcYGL-8Q04KQAMEN_0 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7210390065059824860', time=2024-09-14T13:50:01.512811+0000, chain.objs.size()=1 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cTENEHJOt1bQapMX9S7mBMzodynz3O3_0 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12923731912348745099', time=2024-09-14T13:50:02.438305+0000, chain.objs.size()=1 2024-09-14T12:09:54.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.CGbbLZG28K2vrdprnn6PdQXUH5PnNY__0 2024-09-14T12:09:54.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2821177925220287284', time=2024-09-14T13:50:02.452813+0000, chain.objs.size()=1 2024-09-14T12:09:54.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.esOy5ew58iy0FwM1dL-jvaU0jUem0dB_0 2024-09-14T12:09:54.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3233100299432618396', time=2024-09-14T13:50:02.899822+0000, chain.objs.size()=1 2024-09-14T12:09:54.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.V9BjHPPWt3GR9AAB4bN6bGbG8HJKI95_0 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9835643296866704024', time=2024-09-14T13:50:04.017770+0000, chain.objs.size()=1 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.52DxXp9o-DhAsEKyXzIet3VIL3-C_2O_0 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11912506932428572616', time=2024-09-14T13:50:04.446035+0000, chain.objs.size()=1 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8ggvWKYcr4vDNaujciu8Ej5oZ3iTEpd_0 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15080076732278996751', time=2024-09-14T13:50:06.365658+0000, chain.objs.size()=1 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.x2LBpacpcMCzdBfImuDeY1ujDl8f_l8_0 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9166744152873680642', time=2024-09-14T13:50:06.538367+0000, chain.objs.size()=1 2024-09-14T12:09:54.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.378+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zUI7f5aHIeza4ExRkClEvuxjmwDrki7_0 2024-09-14T12:09:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.380+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7856115971900689596', time=2024-09-14T13:50:06.670942+0000, chain.objs.size()=1 2024-09-14T12:09:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.380+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3A3KpOWHxEL8Vm57qKZ9NgJ9oUhaIvN_0 2024-09-14T12:09:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.380+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17006760882964874536', time=2024-09-14T13:50:06.679512+0000, chain.objs.size()=1 2024-09-14T12:09:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.380+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jh1pmsloaSXQu7NOJgGBsJHL7q3AroL_0 2024-09-14T12:09:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.380+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18396944800931958183', time=2024-09-14T13:50:06.768628+0000, chain.objs.size()=1 2024-09-14T12:09:54.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.380+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Pa29Idw5gWqKoPrXGRxgfUGY1N62NNx_0 2024-09-14T12:09:54.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13480197924935389023', time=2024-09-14T13:50:06.828662+0000, chain.objs.size()=1 2024-09-14T12:09:54.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NN3T2HXqIVrMIsgO3kZOBx6IfnFKpCS_0 2024-09-14T12:09:54.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2211705371551545649', time=2024-09-14T13:50:06.946181+0000, chain.objs.size()=1 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cS74ClxNakiUcZzlYAUGf_SJS0FIdtU_0 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12018147953696767623', time=2024-09-14T13:50:07.099602+0000, chain.objs.size()=1 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Zp6pAqSUjziHqgZuViDQmFTnXWtkgol_0 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2324570305169010722', time=2024-09-14T13:50:08.262400+0000, chain.objs.size()=1 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-iL8XyMfJYsqbjVvSsiS8meBF8w47Cl_0 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16861943425397784700', time=2024-09-14T13:50:09.080181+0000, chain.objs.size()=1 2024-09-14T12:09:54.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.382+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-mThxK0IPo3kANCmgUmt0B6n-i9DCAL_0 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6110882806106719791', time=2024-09-14T13:50:09.542253+0000, chain.objs.size()=1 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.S6Kk0Zmwm5IliKGoUpulkNXYFqOcZN6_0 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4295126288077029529', time=2024-09-14T13:50:15.794328+0000, chain.objs.size()=1 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.272__shadow_.czYzBm2GZmiJs5-Fzg-k8LN8awn6f0l_0 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17247628452976420123', time=2024-09-14T13:50:17.603696+0000, chain.objs.size()=1 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.275__shadow_.fZcDe0Qtcn3f7tlVgN95nYCA30at6f2_0 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8299183491497267461', time=2024-09-14T13:50:25.310218+0000, chain.objs.size()=1 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.287__shadow_.CTCubqTC9JOKAsJLvVodF27j7Stw38H_0 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16232418974945510720', time=2024-09-14T13:50:41.553414+0000, chain.objs.size()=1 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.307__shadow:dqRyger.cqssJtIABGpCtW9hw9Gnt6._.1aKhupCqK4Hd-Wq0o7k0jOHSnyCKIn5_0 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3733299691301772244', time=2024-09-14T13:51:30.790921+0000, chain.objs.size()=1 2024-09-14T12:09:54.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.golOaWrujKRw87WhQGxdkBMoaXDEsdX_0 2024-09-14T12:09:54.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.199421885016351187', time=2024-09-14T13:51:31.431779+0000, chain.objs.size()=1 2024-09-14T12:09:54.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.384+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MstfjjavhMfkvjJyAQU2KCnBQPFHsIG_0 2024-09-14T12:09:54.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6490751399575583543', time=2024-09-14T13:51:31.432513+0000, chain.objs.size()=1 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hfdvZ9sMwUfqpIJ4Z1S-ecBjpJDeVf__0 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18005976275840970287', time=2024-09-14T13:51:31.554363+0000, chain.objs.size()=1 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Is158mSQCgaZwOKitBBIG7Vq5-nqJzV_0 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13554518098774757370', time=2024-09-14T13:51:31.555109+0000, chain.objs.size()=1 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.v65m5Ncxdz5t6rfRabWKbJyM8aVyVdm_0 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15920250116364077297', time=2024-09-14T13:51:31.670297+0000, chain.objs.size()=1 2024-09-14T12:09:54.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.386+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5x0sZ4VOz5uyhHboJq9KvC5CFvRvMdr_0 2024-09-14T12:09:54.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.388+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2207565862563093477', time=2024-09-14T13:51:32.304876+0000, chain.objs.size()=1 2024-09-14T12:09:54.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.388+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fNScFioYJ6j7FfuePcJmGl1KihQSTAb_0 2024-09-14T12:09:54.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15740915639198749263', time=2024-09-14T13:51:32.967815+0000, chain.objs.size()=1 2024-09-14T12:09:54.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.b3GnsEKTASpx_PNBXulubLB85naozhr_0 2024-09-14T12:09:54.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6694529128481021216', time=2024-09-14T13:51:33.246523+0000, chain.objs.size()=1 2024-09-14T12:09:54.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.P9VaSHVbi5j2lJ6kZi-fAu4TP2hnC8M_0 2024-09-14T12:09:54.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17006591086546540379', time=2024-09-14T13:51:34.087308+0000, chain.objs.size()=1 2024-09-14T12:09:54.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Fk0rtTeUwh9reRO1UANeGkNMXE1Eg_Z_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7473838572271054003', time=2024-09-14T13:51:34.341269+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QAVDPPW9_Uw-a_MH2Fwg95kTiidH_kG_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17289519976245711365', time=2024-09-14T13:51:34.548100+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xncRgO7wajD_2lmjeEQCFv-I66Z6NmD_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12045893908661277577', time=2024-09-14T13:51:35.342953+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4QYUoMFsEDYyLR52eZOApC9EmbaQ4JF_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5217270814585883393', time=2024-09-14T13:51:35.799430+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7saiX5zHJfPeazV0zQnE8phqfmTxQkH_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2827363250515424354', time=2024-09-14T13:51:35.879133+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lbbCMsyDJcKsd9Bmvg0fVGOIqEgvgtU_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9696524173769490383', time=2024-09-14T13:51:36.824311+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LWy5nyq5rssav8T6mqdvkx17XA1rQC9_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5249794187105941422', time=2024-09-14T13:51:36.841156+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.390+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S1j6IqLXsPRVcOMcOeOKqa_C5Uclf5X_0 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.391+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7089052460464588909', time=2024-09-14T13:51:37.230371+0000, chain.objs.size()=1 2024-09-14T12:09:54.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.391+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.v9GXFPWnj4bmvS7i1AjydT1ymvgPYBA_0 2024-09-14T12:09:54.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.393+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12526905598731745305', time=2024-09-14T13:51:37.266518+0000, chain.objs.size()=1 2024-09-14T12:09:54.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.393+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1TKAdPPKf8Y-w3qXluvslqN9xNbTASG_0 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1135371983263216054', time=2024-09-14T13:51:37.267115+0000, chain.objs.size()=1 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.h68q_8dOO8jJ2lxcyMYvFGFSHDKTZLL_0 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8365574554641058731', time=2024-09-14T13:51:37.862581+0000, chain.objs.size()=1 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9ddhAGhMLvq5OL8LhoJHSlwFkbDtcpc_0 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12973866596779876944', time=2024-09-14T13:51:38.412084+0000, chain.objs.size()=1 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xMnctUILQXSYmkCtWXGSVmWB0RTDbdZ_0 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11376257420387699840', time=2024-09-14T13:51:38.999134+0000, chain.objs.size()=1 2024-09-14T12:09:54.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.394+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.33DJ0HYu9NK0jrCcebMkT4Lg---mNtb_0 2024-09-14T12:09:54.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12970980523675895412', time=2024-09-14T13:51:39.280867+0000, chain.objs.size()=1 2024-09-14T12:09:54.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3wO_BXcVC_GLhEi6VV-gBwKTAlJJQeX_0 2024-09-14T12:09:54.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5149679066758732169', time=2024-09-14T13:51:39.705424+0000, chain.objs.size()=1 2024-09-14T12:09:54.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.x8oucj8n96sKnyxIapqRLMswsyXToMJ_0 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7212798673650555025', time=2024-09-14T13:51:39.994975+0000, chain.objs.size()=1 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.qaUOqNE2OTMzuE_-SJ3Eq25nt-UgpQQ_0 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1193880910136355975', time=2024-09-14T13:51:40.167478+0000, chain.objs.size()=1 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pUQLqqM7pY44ZMEYOpvuTF9gZwLXqgV_0 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12541811010679343836', time=2024-09-14T13:51:40.281973+0000, chain.objs.size()=1 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ya5-EPGrCzkFpoVhb1fxsH8hA9_duI3_0 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.990711568109270008', time=2024-09-14T13:51:40.407488+0000, chain.objs.size()=1 2024-09-14T12:09:54.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.396+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MWzrW92Qa3XHdx-mDgvaeYETkCacays_0 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6966081149194633278', time=2024-09-14T13:51:40.423629+0000, chain.objs.size()=1 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hHwHJ3bqRKuS9UKNiyX6-kQoMu-YbiJ_0 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11269341054435395881', time=2024-09-14T13:51:41.199384+0000, chain.objs.size()=1 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._TJxtJR8CAnUErZwpt09oyvZ1bYw42-_0 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15790072940338641806', time=2024-09-14T13:51:41.518389+0000, chain.objs.size()=1 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.QS3t26QWU9Znq6YesB5x4fwMNvdUh-P_0 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16750507820836910491', time=2024-09-14T13:51:41.804242+0000, chain.objs.size()=1 2024-09-14T12:09:54.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.398+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.msu4mb8ZwtEXMDEozrsWK_9z3dPQ-wN_0 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12580150209566578949', time=2024-09-14T13:51:41.805172+0000, chain.objs.size()=1 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.A6AyaliDPhgVxJoryNt08ZExLb85tcn_0 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1960117264527906522', time=2024-09-14T13:52:21.686577+0000, chain.objs.size()=1 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Sonv0SahWe6bZr9IhcCudM6bnmDh-6v_0 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15338301811860561543', time=2024-09-14T13:52:22.683081+0000, chain.objs.size()=1 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TbDbq6WwdIb6EbO0RGPkylIeRv3mk-f_0 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5031936936272154476', time=2024-09-14T13:52:23.292668+0000, chain.objs.size()=1 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.B5utnIUiu1cFNBRfbd9o9IPjnKH3bRy_0 2024-09-14T12:09:54.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17813238387199980912', time=2024-09-14T13:52:24.779280+0000, chain.objs.size()=1 2024-09-14T12:09:54.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Uqk7MoeB4JEjTui0tibTvnHd-Sow5g6_0 2024-09-14T12:09:54.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11031350346898372103', time=2024-09-14T13:52:25.000703+0000, chain.objs.size()=1 2024-09-14T12:09:54.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tI5dAjEsGWA7gEhcmK272vu4WUm1fC4_0 2024-09-14T12:09:54.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1195091700956830941', time=2024-09-14T13:52:25.040126+0000, chain.objs.size()=1 2024-09-14T12:09:54.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.399+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.oqXIyS30VtG1gtgG-v9IJNDUVzRZrII_0 2024-09-14T12:09:54.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4230029190593775174', time=2024-09-14T13:52:25.243323+0000, chain.objs.size()=1 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Cq6qElp8ONCxr13WChI2IuSM6RpJNYH_0 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7760296522479873769', time=2024-09-14T13:52:25.852619+0000, chain.objs.size()=1 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.7izpVTjhQJRcPSkauo5sOqx2wEZ8Qyl_0 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15740440092403419231', time=2024-09-14T13:52:26.022697+0000, chain.objs.size()=1 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.GMRMKE-jc49okE-jSbbdRq6CP5UEaEt_0 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17967754100695937309', time=2024-09-14T13:52:27.469429+0000, chain.objs.size()=1 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nlSC75G-7siQk1A2GucKBjvsBw7sBKf_0 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.989383635434067992', time=2024-09-14T13:52:27.608179+0000, chain.objs.size()=1 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.wFKcI9uiWj24x9SkJOCkwUP_nBfGszL_0 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6667833372105610435', time=2024-09-14T13:52:27.905763+0000, chain.objs.size()=1 2024-09-14T12:09:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.403+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pTJoTZgHjlSnWEEudfqPb0eO6ife_9u_0 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11161265356068471742', time=2024-09-14T13:52:28.151204+0000, chain.objs.size()=1 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AvgmSiH84smTfO4SYuX9LbHwIVSZHkQ_0 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7024998193496379484', time=2024-09-14T13:52:28.164645+0000, chain.objs.size()=1 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XmIcr3XLImO1S9_jHZOR4Q2r0_Kkw0G_0 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1310874125609904936', time=2024-09-14T13:52:28.633034+0000, chain.objs.size()=1 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.s8P1HOQw55ojasJpuOGPmKteSD5336v_0 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10843213039888111712', time=2024-09-14T13:52:29.250209+0000, chain.objs.size()=1 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RbO5ob1yqeo3M6yyEEj_8Hy03Ze59WR_0 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7268423198175065848', time=2024-09-14T13:52:29.437294+0000, chain.objs.size()=1 2024-09-14T12:09:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.404+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tlKN4lplsXCvEkR2sXANd0lciAeF-1g_0 2024-09-14T12:09:54.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.406+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12908231679283139657', time=2024-09-14T13:52:29.559589+0000, chain.objs.size()=1 2024-09-14T12:09:54.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Pumi8bZFImOQnwDYAodLAX1zNpp01Ww_0 2024-09-14T12:09:54.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13037503058944936601', time=2024-09-14T13:52:30.008956+0000, chain.objs.size()=1 2024-09-14T12:09:54.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ei7_Pt8B7oKyvLOe8kxXDDNY5ETdAJz_0 2024-09-14T12:09:54.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4065709381609109305', time=2024-09-14T13:52:30.132029+0000, chain.objs.size()=1 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.oo4hCmvTj6TDSf1W7VeWEtKf4UHM50Z_0 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14371130600400908242', time=2024-09-14T13:52:30.234960+0000, chain.objs.size()=1 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qz9HjXKWTwxrFjGb_G4cV4uy52L780u_0 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15562703694880295607', time=2024-09-14T13:52:30.266916+0000, chain.objs.size()=1 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.nt-9UgbALlk9Pty8ENnQvGnLO36BDmA_0 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11607631539441097829', time=2024-09-14T13:52:30.511724+0000, chain.objs.size()=1 2024-09-14T12:09:54.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.407+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.yNtLApP0cMth6AfH6cjwcJs7dOrPrSJ_0 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1456168171510044509', time=2024-09-14T13:52:30.714623+0000, chain.objs.size()=1 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-w6JhQKmtbatN3jb40C3lPHKpUwF6lf_0 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10125806647437370212', time=2024-09-14T13:52:30.774542+0000, chain.objs.size()=1 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mWLwab5GOntk6Ow8Jia_dysrtbWFjTP_0 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2880129155581744797', time=2024-09-14T13:52:30.938363+0000, chain.objs.size()=1 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.08uY0ioK_HjLijBi6wVqQ4cKmKallVo_0 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12633653259195945231', time=2024-09-14T13:52:30.960150+0000, chain.objs.size()=1 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zYHkfg0dP94KEoZUDY5o0FZZSCMZjI9_0 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14034154845237623266', time=2024-09-14T13:52:30.960668+0000, chain.objs.size()=1 2024-09-14T12:09:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.408+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ADPS9h5qbgXT6oK8eIsaffGERxiP-3W_0 2024-09-14T12:09:54.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.410+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6016341198913056561', time=2024-09-14T13:52:31.067999+0000, chain.objs.size()=1 2024-09-14T12:09:54.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.410+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.c5i8ZCb6mrKWJn2--j4KLi5S1pfqNAW_0 2024-09-14T12:09:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4999787147225918039', time=2024-09-14T13:52:31.364830+0000, chain.objs.size()=1 2024-09-14T12:09:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.EwXf544zqwBiE0wf32XUMG_vzuHQsyR_0 2024-09-14T12:09:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16547539544982254814', time=2024-09-14T13:52:31.385314+0000, chain.objs.size()=1 2024-09-14T12:09:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.67zLo4hkOacBznPgGD2CB9gGZAcxjEq_0 2024-09-14T12:09:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6400176199948841161', time=2024-09-14T13:52:31.608760+0000, chain.objs.size()=1 2024-09-14T12:09:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xRWoyqG4Sd2Dq3n4lJHM2Ybwt0dpC6b_0 2024-09-14T12:09:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6902584804991647318', time=2024-09-14T13:52:31.771234+0000, chain.objs.size()=1 2024-09-14T12:09:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.411+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.r6P5bbVhnyLU87EX-YxvSsTRVIlSYMD_0 2024-09-14T12:09:54.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.415+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47744 2024-09-14T12:09:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T12:09:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13794626664816162837', time=2024-09-14T13:52:31.876677+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.NXM1Us-glytKnEflH2ilxxk-ixweoxe_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17968639639687785901', time=2024-09-14T13:52:31.936426+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.c62VQLe2NgxhjwqHvQFTgaTScBUq_Pn_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12531609657671818900', time=2024-09-14T13:52:31.937104+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PNcuqkP0UaURfJb5KvlMhROCWnN1foK_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.977926323229023335', time=2024-09-14T13:52:32.203084+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ryV65izGMIPr57jHwntoYCRGWT1iX8p_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7278199255897844146', time=2024-09-14T13:53:03.093978+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.382__shadow_.aM65iZVNa5S8g2SFIynY4wBjwPO4LMH_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13388385614722619707', time=2024-09-14T13:53:32.118680+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.433__shadow_.gDqipAICvcARBD9VZU3cPzymaZ070Bl_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1513245278226051280', time=2024-09-14T13:53:52.546913+0000, chain.objs.size()=1 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.463__shadow_.uKppJHw1EwjOPl1vnExqDarmzqj_zMt_0 2024-09-14T12:09:54.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17792191920679083906', time=2024-09-14T13:54:07.730493+0000, chain.objs.size()=1 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.487__shadow_._GnQx5LZlG4fjelImX2dIivSGWowTW__0 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11245817684514362404', time=2024-09-14T13:54:10.799589+0000, chain.objs.size()=1 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.491__shadow_.VlJI0OqkC-_7wPwHKzUbdOUVGsR2o2z_0 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3316928190075660426', time=2024-09-14T13:54:34.849004+0000, chain.objs.size()=1 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.518__multipart_mymultipart.2~KAo9w_4BZpLbKi7sbP7kt-5k2uhih3l.1 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18286729756171119637', time=2024-09-14T13:56:08.524695+0000, chain.objs.size()=2 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~OAl6cEHB_PiaUxQaQGAOZ_2tqXvGmtU.1 2024-09-14T12:09:54.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.417+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.523__multipart_mymultipart.2~OAl6cEHB_PiaUxQaQGAOZ_2tqXvGmtU.2 2024-09-14T12:09:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15050417399508255668', time=2024-09-14T13:59:12.332020+0000, chain.objs.size()=1 2024-09-14T12:09:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.604__shadow_.wHXmteSMaQNpmigXOqS3Wf5tXcnJtAT_0 2024-09-14T12:09:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7549227415350917776', time=2024-09-14T14:03:52.764302+0000, chain.objs.size()=1 2024-09-14T12:09:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.665__shadow_.d9w_o5XjDwtx7OPPkPghTwI7-BbOifc_0 2024-09-14T12:09:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.420+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11717205168766583917', time=2024-09-14T14:06:35.552202+0000, chain.objs.size()=1 2024-09-14T12:09:54.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.420+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.765__shadow_.qjy-V_BdGaH1u6VDCvktmMinhbLi0_k_0 2024-09-14T12:09:54.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.424+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.426+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T12:09:54.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.427+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.428+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49145' 2024-09-14T12:09:54.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4553330528314198409', time=2024-09-14T13:46:31.484452+0000, chain.objs.size()=1 2024-09-14T12:09:54.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.148__shadow_.BhdNC_RX7ZXNiZUKdjMNyimoe3bExuD_0 2024-09-14T12:09:54.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15996554370167090892', time=2024-09-14T13:49:02.429479+0000, chain.objs.size()=1 2024-09-14T12:09:54.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.233__shadow_.0Do2Iu1DNTQxP97mUHoslS-IkVlZC2s_0 2024-09-14T12:09:54.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15581143448041156845', time=2024-09-14T13:49:04.385360+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.236__shadow_.anQldzTAxq7P1-2pTarQscfvf1bKMI5_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8875294161766522722', time=2024-09-14T13:49:13.347436+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.249__shadow_.755cBHLzawKXEiOXel1q5MSk3mZiaQh_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7378976835037344804', time=2024-09-14T13:49:16.544721+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.254__shadow_.5QzHHTMksAAbWQv2fvOp42HaGHitiPJ_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12568738540336162354', time=2024-09-14T13:49:58.995962+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0N_c_g8enJf5EUiDRGH4e4OLyfkZiUf_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13192478316062864080', time=2024-09-14T13:49:59.507971+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.49jyrD-D05SDx9EHc3ztnPY3CI-QJqY_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4972354257024963684', time=2024-09-14T13:50:00.626941+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.GycnsPcBPln8pqXb1tz8TMldmfWDNcL_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6657773659637963567', time=2024-09-14T13:50:00.778716+0000, chain.objs.size()=1 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TxsGQJJ9k-cmia8jm6VQSPStt3rAXed_0 2024-09-14T12:09:54.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11936619544261436110', time=2024-09-14T13:50:01.355748+0000, chain.objs.size()=1 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.H1fj9REE9nGJByMF9XN4bpw_gMVG1QO_0 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13210057933014735263', time=2024-09-14T13:50:01.980857+0000, chain.objs.size()=1 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.czh_tbBCt9AKnvPetoJubhIiVYqZVlt_0 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10112472061203727068', time=2024-09-14T13:50:03.446607+0000, chain.objs.size()=1 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.429+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.I6bITthYJNqz0pb0RUuuUO_TOGOV_t8_0 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.431+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17703748207594597951', time=2024-09-14T13:50:03.755041+0000, chain.objs.size()=1 2024-09-14T12:09:54.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.431+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mALSVsyUtdZR2LiSMYkq8rpcBQH2K-g_0 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5293494494171883622', time=2024-09-14T13:50:03.840929+0000, chain.objs.size()=1 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IWnzqV_rNwcg3CU-nHH8Wet9JJvPurV_0 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13223909729700013898', time=2024-09-14T13:50:04.019548+0000, chain.objs.size()=1 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hTb4MK08VG9wzfolXVEAEv3-lZypDmq_0 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4851141954786159377', time=2024-09-14T13:50:04.153571+0000, chain.objs.size()=1 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Z0H-Jn5z5MkQrl4ZvFK1OhvZcnNC4Pn_0 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8496185137060435035', time=2024-09-14T13:50:04.154388+0000, chain.objs.size()=1 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nEyWXIJWHxaQY8OA1LUhw9geFTKyehk_0 2024-09-14T12:09:54.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11759115480517338456', time=2024-09-14T13:50:04.155092+0000, chain.objs.size()=1 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DE378x3MMk0q_68cMOb4SDXJo-PL2bI_0 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10703743311571923579', time=2024-09-14T13:50:04.156154+0000, chain.objs.size()=1 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.432+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4ygW41yzEwlSRLZO3M_K3CTEfrclnBm_0 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.433+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7758094209225176949', time=2024-09-14T13:50:05.050647+0000, chain.objs.size()=1 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.433+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vYnzu3FmF1fg4KjtyknJWKZ60laZL_G_0 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.811255727103341132', time=2024-09-14T13:50:05.129118+0000, chain.objs.size()=1 2024-09-14T12:09:54.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.WMXCWDm1Mw2uu01rzhRZiG0CgUQDpoq_0 2024-09-14T12:09:54.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7669191339068801452', time=2024-09-14T13:50:05.188525+0000, chain.objs.size()=1 2024-09-14T12:09:54.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3uggPxls2CQHL9uRJiPUDVPDyI0z3dF_0 2024-09-14T12:09:54.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13414344213649981931', time=2024-09-14T13:50:05.431394+0000, chain.objs.size()=1 2024-09-14T12:09:54.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.caNejpUu0qBpJLy4Wv5732w-C8xFUSm_0 2024-09-14T12:09:54.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16213094359255426779', time=2024-09-14T13:50:05.432146+0000, chain.objs.size()=1 2024-09-14T12:09:54.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.434+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9-tCoeYThVPr1adkMjH_uPqYMk5IqjN_0 2024-09-14T12:09:54.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5379432389910150720', time=2024-09-14T13:50:05.620488+0000, chain.objs.size()=1 2024-09-14T12:09:54.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mc-1JDbTQqMF1nGpI2Xqvvne1UKx88C_0 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8978962467643469757', time=2024-09-14T13:50:05.653271+0000, chain.objs.size()=1 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yNaDM-4a2j2V3F2NY-CwsKopKe9kdhw_0 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6953365333004048901', time=2024-09-14T13:50:05.732838+0000, chain.objs.size()=1 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TY-5m46mhXs2CzPRotlkwtS0LdqOwMt_0 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.559314515170200221', time=2024-09-14T13:50:06.899547+0000, chain.objs.size()=1 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3CXX7vRgQct7OgB2XTxqPZ50EsAs6DO_0 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8644354559364799747', time=2024-09-14T13:50:06.996012+0000, chain.objs.size()=1 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.u2RidjGN8q4HJxtNcLySlKmD9w6iuJZ_0 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16041417600268410688', time=2024-09-14T13:50:07.108611+0000, chain.objs.size()=1 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.y2z5AauWVAWxqX1MTl4iu1UoR9ZBNVN_0 2024-09-14T12:09:54.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522480160045502070', time=2024-09-14T13:50:07.219793+0000, chain.objs.size()=1 2024-09-14T12:09:54.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.436+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XtyOoWtPHOsfJOIbzxXjs3F-fCj2BvF_0 2024-09-14T12:09:54.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2539952402815530392', time=2024-09-14T13:50:07.564619+0000, chain.objs.size()=1 2024-09-14T12:09:54.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.J7X58zM88XgTcBoi9sf5wSLRDuXQsx8_0 2024-09-14T12:09:54.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.379555127122723442', time=2024-09-14T13:50:07.706304+0000, chain.objs.size()=1 2024-09-14T12:09:54.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.1AKeHqFcAZvXGM7tBS7bpvbLAsDm5ft_0 2024-09-14T12:09:54.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.438+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11936557419220831273', time=2024-09-14T13:50:07.742397+0000, chain.objs.size()=1 2024-09-14T12:09:54.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.438+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SRjiRfPRBGzSnCi_rZipesPGRHJrGqZ_0 2024-09-14T12:09:54.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13570665032274330103', time=2024-09-14T13:50:08.918398+0000, chain.objs.size()=1 2024-09-14T12:09:54.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-wGyLTF0SnBkleLvLmVccerTP7pRv50_0 2024-09-14T12:09:54.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.439+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3658515315911967064', time=2024-09-14T13:50:09.076414+0000, chain.objs.size()=1 2024-09-14T12:09:54.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.439+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pI7vJ8gUS_Iq3prBadlUokueSblS0bV_0 2024-09-14T12:09:54.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6625441622965783285', time=2024-09-14T13:50:09.077125+0000, chain.objs.size()=1 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.suUUE0zrsvNxZBS-3ZYV2BlxogHrTdp_0 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8914381347946574065', time=2024-09-14T13:50:09.206816+0000, chain.objs.size()=1 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Uez-l3iC3hUCOiQbMFp8bR2xXYsBbcg_0 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.266466469055548476', time=2024-09-14T13:50:09.460266+0000, chain.objs.size()=1 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nUKTP04Lscw4UpmbQK0PLx2J3rLrk7q_0 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13430480768279865315', time=2024-09-14T13:50:09.666835+0000, chain.objs.size()=1 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.KOoC5NpQXdfxeXiMPoRWt8KGDmQPyIr_0 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13511578606021853975', time=2024-09-14T13:50:09.821992+0000, chain.objs.size()=1 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.eAjSdHZR2fnkgYULQQJaIxQ0hNEGIN__0 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11904796752961694336', time=2024-09-14T13:50:14.593216+0000, chain.objs.size()=1 2024-09-14T12:09:54.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.270__shadow_.CL3N8vkItKeffnsjmpaMV-_TPX-dAba_0 2024-09-14T12:09:54.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7870642410148329505', time=2024-09-14T13:50:31.678129+0000, chain.objs.size()=1 2024-09-14T12:09:54.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.440+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.nITiJXDL7dHwMzgQCe8J0Rs2j0EqinZ_0 2024-09-14T12:09:54.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.441+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5262781863968889687', time=2024-09-14T13:50:31.678714+0000, chain.objs.size()=1 2024-09-14T12:09:54.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.441+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.b2GN6GgQHd42vGtpIxBH6XBIV0myiYI_0 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16806804263893191378', time=2024-09-14T13:50:31.679295+0000, chain.objs.size()=1 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.paMp2xhg1LXlgFOdL0FLlQTaGKsDNke_0 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16037979823560534385', time=2024-09-14T13:50:31.680089+0000, chain.objs.size()=1 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.k0_If7y3RmWxYvaxkHth2em9L2xoew6_0 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9124735399702160583', time=2024-09-14T13:50:39.578962+0000, chain.objs.size()=1 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.305__shadow_.C7f35n9KgLtG2NW0PKIA-lkWwhmkpdL_0 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.381041495938846439', time=2024-09-14T13:51:30.969147+0000, chain.objs.size()=1 2024-09-14T12:09:54.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.444+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YXYOOJ3HfvgMJa7k2wWU7acrgE1y88z_0 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15531991719664939837', time=2024-09-14T13:51:30.969980+0000, chain.objs.size()=1 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.t36e36-OfnNz1KeDeaDbFJuTiFSwWIm_0 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13488616319986710779', time=2024-09-14T13:51:31.144675+0000, chain.objs.size()=1 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yFHk5klACb2jQP5XGWDFn40XUKqDh23_0 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5215826339208580714', time=2024-09-14T13:51:31.306087+0000, chain.objs.size()=1 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Bce4OjbiFCOqhNOmaSG4pl3RTs8RH7t_0 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2215889114754328715', time=2024-09-14T13:51:31.429432+0000, chain.objs.size()=1 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DJjTC9lsjvU_V0eTzuc93DsCf2qUrpE_0 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17662390016062842871', time=2024-09-14T13:51:31.521661+0000, chain.objs.size()=1 2024-09-14T12:09:54.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.445+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.35OK1ae0cAqk6QaeC8kLtMgInpHHbW-_0 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14038556566178903997', time=2024-09-14T13:51:31.689901+0000, chain.objs.size()=1 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.khhZxUkgLB1YO4ysoimVeGwedL4cNHQ_0 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7198663215777923267', time=2024-09-14T13:51:31.745573+0000, chain.objs.size()=1 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.dsaZgaVlQXcWcnROvSS3cpHN8g1EDlE_0 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3368032475256373095', time=2024-09-14T13:51:32.444547+0000, chain.objs.size()=1 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5PExqneILZKxf0Wpy1D3q7yrr1meN-d_0 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16305897429539757134', time=2024-09-14T13:51:32.759360+0000, chain.objs.size()=1 2024-09-14T12:09:54.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.446+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.JgK4mB4viFaQ-FEy9zMPHnJmZvTUau3_0 2024-09-14T12:09:54.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7775217684195811408', time=2024-09-14T13:51:32.820706+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OH7gmMzCog6wr_joQZoV_UKZYpbGMtN_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9769083459514794225', time=2024-09-14T13:51:32.910162+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2jE9hjpRxcZiXgUdgmy8W86mXldLdjc_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17937623312118212353', time=2024-09-14T13:51:33.317034+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.y2penezEKGKyJV_KEbZAfTeFKdnogq3_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7687316891438367454', time=2024-09-14T13:51:34.406160+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PKN4sSdYfwEwZnipgxwPQRzTN6sC_JS_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17212505374390304465', time=2024-09-14T13:51:34.497102+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BWjqisyjAI_CzDT4_EwRI5WOAx45q36_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4677574463385205848', time=2024-09-14T13:51:34.688464+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.s4TbjtMpvmy-GdaWrTsYgmLfvepYuFh_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.543989524584060938', time=2024-09-14T13:51:34.903844+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Y85yDGsm6n1kg_mCfAZ3XNWRo-X5o7E_0 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3010822453276069302', time=2024-09-14T13:51:35.777867+0000, chain.objs.size()=1 2024-09-14T12:09:54.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hcQLC12f-xZsTyZUWP3oF9wvigUEy0H_0 2024-09-14T12:09:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13548750307697729796', time=2024-09-14T13:51:36.094610+0000, chain.objs.size()=1 2024-09-14T12:09:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.8j8NYqBzxhYdIZIKZp6axBtBtz8ySQq_0 2024-09-14T12:09:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10312506988879428871', time=2024-09-14T13:51:36.218980+0000, chain.objs.size()=1 2024-09-14T12:09:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EF2h33TrJMy1b0PG8GVsi1v7hU5TRTW_0 2024-09-14T12:09:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4110693187418380498', time=2024-09-14T13:51:36.946020+0000, chain.objs.size()=1 2024-09-14T12:09:54.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.451+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EBicLSV6hD_OIiQ8YbZYvM88GS9sQar_0 2024-09-14T12:09:54.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3433683206946446274', time=2024-09-14T13:51:37.200481+0000, chain.objs.size()=1 2024-09-14T12:09:54.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.EouRD1NqE68iemvO4bbh-7Yvom8lr27_0 2024-09-14T12:09:54.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.453+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15201844202039943324', time=2024-09-14T13:51:37.300828+0000, chain.objs.size()=1 2024-09-14T12:09:54.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.453+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OWBrdMqFLjqMwpxnSS1U9DpRtrC3Zvt_0 2024-09-14T12:09:54.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14634328601684278129', time=2024-09-14T13:51:37.833658+0000, chain.objs.size()=1 2024-09-14T12:09:54.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZptwY_CQ-EqKW7NNecR724E2cPYeaHp_0 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5605214701253643579', time=2024-09-14T13:51:38.474089+0000, chain.objs.size()=1 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OufSAZiDaQtEetrAc7LFdtV_6ebc-0P_0 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15972463108783731124', time=2024-09-14T13:51:39.853111+0000, chain.objs.size()=1 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nEJ0229baNXHkWBPBOU-2q8KjsRJphF_0 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14250088975055623822', time=2024-09-14T13:51:40.093753+0000, chain.objs.size()=1 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cgBjVjdnmx9xqken142yhwqAhgdcCyP_0 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10550236506673839718', time=2024-09-14T13:51:40.569438+0000, chain.objs.size()=1 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.b132frLLyh_s7JXZ6e5UwarmdQQzAYs_0 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14931036981728492046', time=2024-09-14T13:51:40.711059+0000, chain.objs.size()=1 2024-09-14T12:09:54.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.454+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ktIn3oCV-s9XRDrn6YdjJ2cde1B_27M_0 2024-09-14T12:09:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.456+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18287567339330352286', time=2024-09-14T13:51:41.046846+0000, chain.objs.size()=1 2024-09-14T12:09:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.456+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.fa3TNT4WVVOuMMlQ30qRB1pznFy5lkL_0 2024-09-14T12:09:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.456+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17295861504281298296', time=2024-09-14T13:51:41.494970+0000, chain.objs.size()=1 2024-09-14T12:09:54.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.456+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.gNdapzWEq3AK4P3oLUFg9tFIvmzvwsw_0 2024-09-14T12:09:54.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.456+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1062072211444161505', time=2024-09-14T13:51:41.774525+0000, chain.objs.size()=1 2024-09-14T12:09:54.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.456+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.7VzuXmmPJuNlv_8-f4RNlUPwu25nOii_0 2024-09-14T12:09:54.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3235317447620444540', time=2024-09-14T13:52:21.238587+0000, chain.objs.size()=1 2024-09-14T12:09:54.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Rhu1zK1vG9w9nsFUg6BwGgxZRcqwhtV_0 2024-09-14T12:09:54.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13547926857238978340', time=2024-09-14T13:52:21.239421+0000, chain.objs.size()=1 2024-09-14T12:09:54.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.0oNfqg-RZeNe_P0fUdiF2TJfG6nXgHt_0 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.272650649732927291', time=2024-09-14T13:52:21.502566+0000, chain.objs.size()=1 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pgEZeWk_tCqe80o4qEmghJyhDmh-S4n_0 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13858209944132520756', time=2024-09-14T13:52:22.823676+0000, chain.objs.size()=1 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.z7uHkXP8tfCKwfoPX8NxZA4qZZZjkGW_0 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15068093233070423063', time=2024-09-14T13:52:22.824584+0000, chain.objs.size()=1 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VZRrHkXzcZXtSI0vqo81H0WHTWzUqfA_0 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7444998899620764831', time=2024-09-14T13:52:23.068238+0000, chain.objs.size()=1 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.q0Ezw2WMy-EkluwDzuCyuDibK1a3b9a_0 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15433761222092896043', time=2024-09-14T13:52:23.742762+0000, chain.objs.size()=1 2024-09-14T12:09:54.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.458+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.sTXtRSWbgunxoHyPeTOYqsBV2RZbNaO_0 2024-09-14T12:09:54.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.459+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12397263075156641377', time=2024-09-14T13:52:24.387995+0000, chain.objs.size()=1 2024-09-14T12:09:54.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.459+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gbCayp-oC_BZwzxuiwWfo0V9OzsekC4_0 2024-09-14T12:09:54.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5357184029663138721', time=2024-09-14T13:52:24.497625+0000, chain.objs.size()=1 2024-09-14T12:09:54.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.b4Pz_3VM0wL9mwb8oHaMQI85r95UCtV_0 2024-09-14T12:09:54.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2499920299256088201', time=2024-09-14T13:52:24.663516+0000, chain.objs.size()=1 2024-09-14T12:09:54.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ywcDxAW1Df2e4Hf61HbPgWCia6QGpV0_0 2024-09-14T12:09:54.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.460+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10640186957616262181', time=2024-09-14T13:52:24.939107+0000, chain.objs.size()=1 2024-09-14T12:09:54.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.460+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.hH0D5j2h0OWuQvUx2IwBwufouSA0wo-_0 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11741285894512721267', time=2024-09-14T13:52:25.077420+0000, chain.objs.size()=1 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mbyeCzvXR2CUp19B8gykkdRS5PjYk47_0 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15636514887489764359', time=2024-09-14T13:52:25.098563+0000, chain.objs.size()=1 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.YAxKE_bgC65CM8UMth3XlRlgF5CWU1b_0 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6566051769931767816', time=2024-09-14T13:52:25.166563+0000, chain.objs.size()=1 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.prNhrBnugH37Rp_j7wxw2rZ7GJvYemP_0 2024-09-14T12:09:54.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4604709055745277343', time=2024-09-14T13:52:25.299066+0000, chain.objs.size()=1 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FPT2Qo2-Xb6SG8gNXwUnI96iNabzQkh_0 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2148343806624490422', time=2024-09-14T13:52:25.859109+0000, chain.objs.size()=1 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KEm3GHScYFXhxBkCrmy0dzT79ltw5wZ_0 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17007228245635978185', time=2024-09-14T13:52:25.915511+0000, chain.objs.size()=1 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RZkvWfy47WM8EW5Ui36bAp1f9rNxGT3_0 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14656028329253009535', time=2024-09-14T13:52:26.412394+0000, chain.objs.size()=1 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.OhFt8LzFmhS8AW9ujCv4NucIxAYqBxk_0 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.462+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15769324664993179727', time=2024-09-14T13:52:27.422812+0000, chain.objs.size()=1 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.463+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MJLTLHUomhPY9SdiUiA100FdjjZOuNc_0 2024-09-14T12:09:54.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.463+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14365492524793760033', time=2024-09-14T13:52:27.638765+0000, chain.objs.size()=1 2024-09-14T12:09:54.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.463+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KqGrZajNCpKZKrZXoCKydpckQICVytI_0 2024-09-14T12:09:54.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.463+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15182368619215513936', time=2024-09-14T13:52:27.755710+0000, chain.objs.size()=1 2024-09-14T12:09:54.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.463+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Yd_3BYZuJnAn4Wa91-rRsjOUjYHeb1C_0 2024-09-14T12:09:54.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.467+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/49145 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15980770546781630470', time=2024-09-14T13:52:28.136800+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.2v_b7rbU44qKqee17tYSbm6LUWSMu1C_0 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10916883876162956484', time=2024-09-14T13:52:29.020364+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cRUzX0muw8xMs-yE5TVhqV_pKovH-Le_0 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4898124185862101858', time=2024-09-14T13:52:29.212107+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BM2apNoHA5iwEObHd8Bkut3GXjXMITy_0 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3771557895061922009', time=2024-09-14T13:52:29.995418+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ey95yAOGnSnXtziZWvQCkxbFYXkE3X9_0 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7397063053788613658', time=2024-09-14T13:52:30.716758+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FrDcCxiNI3oTuBUI2ne2zkwyzi7icxY_0 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10134296979458866562', time=2024-09-14T13:52:31.433241+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.IxXIhrQY87kFH-rJKQ9WIlDynJdETXZ_0 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9336426362832359917', time=2024-09-14T13:52:31.772885+0000, chain.objs.size()=1 2024-09-14T12:09:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Et1q1pAjp-rudhdHnjEpnUUgssKYV9z_0 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5641275060707539217', time=2024-09-14T13:52:31.814891+0000, chain.objs.size()=1 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pl9wLdXWqEOXIoTmN3dm7stTtMSOtkF_0 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15939162976759770765', time=2024-09-14T13:52:31.881619+0000, chain.objs.size()=1 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.4fVE_HqM3iQkpN2uwIa7bGLjTFf8Rpy_0 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14147286129041289829', time=2024-09-14T13:52:37.057560+0000, chain.objs.size()=1 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.333__shadow_.CmJKf9PArpswu7KynSqK7ouZ2tjQ0FA_0 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8085866591349021014', time=2024-09-14T13:52:38.177188+0000, chain.objs.size()=1 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.335__shadow_.KzTQ7GVYuIDIBMCR2JYDizHKgk7waOz_0 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3551905189966779070', time=2024-09-14T13:53:19.322613+0000, chain.objs.size()=1 2024-09-14T12:09:54.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.470+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.409__shadow_.A9rpBKH_VDQUVB0jbP5TsmMsogUKMSC_0 2024-09-14T12:09:54.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.472+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5717193846769207512', time=2024-09-14T13:53:37.746690+0000, chain.objs.size()=1 2024-09-14T12:09:54.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.472+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.442__shadow_.dMgSNYpdS9NdSGziywcVixo6xC_Crzj_0 2024-09-14T12:09:54.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.472+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3409866597986056100', time=2024-09-14T13:53:53.433522+0000, chain.objs.size()=1 2024-09-14T12:09:54.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.472+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.464__shadow_.WezDX_ZyVy2PXY8GAFvkYVveQ5abse-_0 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13991184703358237849', time=2024-09-14T13:53:54.081199+0000, chain.objs.size()=1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.465__shadow_.ct8I7jG3EjkRhkSsmpFATimksi8vsVk_0 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16654190825626124100', time=2024-09-14T13:53:54.956736+0000, chain.objs.size()=1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.466__shadow_.kqJ2S6kQbyzaXs8Jrnn7AryZ6A5C_F9_0 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13859934082051316266', time=2024-09-14T13:54:31.935014+0000, chain.objs.size()=1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.516__multipart_mymultipartcopy.2~vQt9lFIZ2w9TgdXw-NJuC-k1YAWUpKA.1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH', time=2024-09-14T13:55:14.352215+0000, chain.objs.size()=1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~iPHC8EAbVROwtuiLyQrMPf6sqX38mHH.1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg', time=2024-09-14T13:55:26.715280+0000, chain.objs.size()=1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg.2 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2118007184423329516', time=2024-09-14T13:55:37.694133+0000, chain.objs.size()=6 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg.1 2024-09-14T12:09:54.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.z7PmLshrqMqX3gQpxyN4KUzsKD03bfud.2 2024-09-14T12:09:54.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg.3 2024-09-14T12:09:54.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.474+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg.4 2024-09-14T12:09:54.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.476+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg.5 2024-09-14T12:09:54.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.476+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.522__multipart_mymultipart.2~Qoq84REFsYVIiwQskDqwmJyjQuV0HXg.6 2024-09-14T12:09:54.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8168698808439465541', time=2024-09-14T13:58:40.184910+0000, chain.objs.size()=1 2024-09-14T12:09:54.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:MrUZ-gUuHbj9hkTWft3UNYccPGWwsIC_.MEdPRfz32ax_h8m15jlMcq37CWDeceE_0 2024-09-14T12:09:54.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2007156127338295066', time=2024-09-14T13:58:59.256935+0000, chain.objs.size()=1 2024-09-14T12:09:54.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.583__shadow:-qR3YfMaNmo4Jgym.gaUUYfnrXrl40v_.Ta6GEqaImI3LnTT6O-KUdl9G14DSz-8_0 2024-09-14T12:09:54.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5416535676516594867', time=2024-09-14T13:59:01.266701+0000, chain.objs.size()=1 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.585__shadow:0Wi7DCA8LmUBUs5o5JBVnw9WAtAPZHt_.btZY7owH8_KU-uGnLQJjoV81J2njY-o_0 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1781676153993595071', time=2024-09-14T14:03:09.277573+0000, chain.objs.size()=1 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.638__shadow_.QPqNgef2QxaYdJ1urpUqB7zz1uoOInR_0 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5082589685860102106', time=2024-09-14T14:03:13.405105+0000, chain.objs.size()=1 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.643__shadow_.39TVi3AuwENuhxnPi2BrFTAjGoUb0h9_0 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2609987943880816927', time=2024-09-14T14:04:09.152036+0000, chain.objs.size()=1 2024-09-14T12:09:54.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.696__shadow:ufReGRcQw39Lo2rEUZTcryprM9cKeHW_.ekSLhWaAZpcLu7YP0Ksgs808wOAK1i__0 2024-09-14T12:09:54.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16977454917098690503', time=2024-09-14T14:05:17.821503+0000, chain.objs.size()=1 2024-09-14T12:09:54.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.478+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.748__shadow_.vuP_mKDJ5uMgTenNJ3M9F3HBStQOGa-_0 2024-09-14T12:09:54.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.482+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.484+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T12:09:54.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.486+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.487+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45250' 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10697185893168279299', time=2024-09-14T13:47:04.138311+0000, chain.objs.size()=1 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.171__shadow_.LJtlh_YqF5Cqu_aI_3-2NrWu2D3bo-c_0 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16896944562465660853', time=2024-09-14T13:47:13.254475+0000, chain.objs.size()=1 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.176__shadow_.95I7V0T33qr_lv71C3Od0wmM__N8lbI_0 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17564305988759212748', time=2024-09-14T13:47:29.332869+0000, chain.objs.size()=1 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.197__shadow_.lJ-NRCJtgYSzanG9_ysdFoo5K4smUpW_0 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12662550611560901530', time=2024-09-14T13:49:09.306613+0000, chain.objs.size()=1 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.243__shadow_.VeBBewJBLzprUux_41bQ7pMv0i7OcQL_0 2024-09-14T12:09:54.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3823945479268421542', time=2024-09-14T13:49:10.188389+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.244__shadow_.0HLczMOPHMMu7M4NuDLirlZIG2N4DF6_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569982144213616394', time=2024-09-14T13:49:12.731098+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.248__shadow_.C9I5_-kylQqIthP4kw2ul1DXpcq-_3r_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7729610177682441360', time=2024-09-14T13:49:20.834500+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.261__shadow_.-hQvDGZOHQvZTNUTICIol-3hIX8dy86_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15959033585850044950', time=2024-09-14T13:49:59.142856+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cSfRJaiqZBAUiXUwJHrHckLKg-zJnDp_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15100678728483602282', time=2024-09-14T13:49:59.143500+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.X6lxu9tplnSaOjhBX9pe1xs7PvbEPn-_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10718479792543870512', time=2024-09-14T13:49:59.521878+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7HDX2TMFZL2D64Wo26wTX6eQ3LaNRkm_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7113176254332311174', time=2024-09-14T13:49:59.586379+0000, chain.objs.size()=1 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aLVGzEgIQiMX6Y2qNP6O5mRZpc8Z6SC_0 2024-09-14T12:09:54.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12405366380351463549', time=2024-09-14T13:49:59.652190+0000, chain.objs.size()=1 2024-09-14T12:09:54.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.488+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.LA-95lpgizZKmXz752DgGxNnHcQNfVa_0 2024-09-14T12:09:54.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.490+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1155079657199120223', time=2024-09-14T13:49:59.709103+0000, chain.objs.size()=1 2024-09-14T12:09:54.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.490+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0nTvKejFYsBypZCV0usDfaP2VML91jO_0 2024-09-14T12:09:54.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6736277658285132194', time=2024-09-14T13:50:00.633085+0000, chain.objs.size()=1 2024-09-14T12:09:54.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5-UZflOek0WS_TzJy7IvHttHj7RiDEp_0 2024-09-14T12:09:54.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6063821171201527635', time=2024-09-14T13:50:00.779157+0000, chain.objs.size()=1 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BCSV_ZPhLUXkZ5VjK1THPJcAlxSfXM4_0 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13336780246818673577', time=2024-09-14T13:50:01.219294+0000, chain.objs.size()=1 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.meqilDfPD6_PimCXDqJ9HWRux84SriI_0 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10708956875732007301', time=2024-09-14T13:50:02.106407+0000, chain.objs.size()=1 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7ygDzmi-U3H1OZJEi7L7Ro3oqcm_mXb_0 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2017366143362664210', time=2024-09-14T13:50:02.273607+0000, chain.objs.size()=1 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._F2u7XP-j14aCJZuSZXGqVvJrBWB-aK_0 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6543089788841688946', time=2024-09-14T13:50:02.773429+0000, chain.objs.size()=1 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.S81ACpYP_kQA0rMOMAo0XocM0_zN3Tz_0 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8413870884194285002', time=2024-09-14T13:50:02.967818+0000, chain.objs.size()=1 2024-09-14T12:09:54.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.491+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qm92VJ_OR6ZcIStBC-Mk0Bh5TYb3lIR_0 2024-09-14T12:09:54.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.492+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5800922297403773377', time=2024-09-14T13:50:03.450531+0000, chain.objs.size()=1 2024-09-14T12:09:54.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OaseRp3wxP0IhgIlXUbaQ8oYDkHsTm9_0 2024-09-14T12:09:54.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.492+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11917145226314773539', time=2024-09-14T13:50:03.583613+0000, chain.objs.size()=1 2024-09-14T12:09:54.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oz8wGzw7s4GKzT0raK5YXwp6aV7Uxjy_0 2024-09-14T12:09:54.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.492+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10392465008543396956', time=2024-09-14T13:50:04.016756+0000, chain.objs.size()=1 2024-09-14T12:09:54.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.492+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0iSbw1CqIOqMA5F8ytCBbl7QIlloq50_0 2024-09-14T12:09:54.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.494+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15565017229330953750', time=2024-09-14T13:50:04.847560+0000, chain.objs.size()=1 2024-09-14T12:09:54.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.494+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.HyUHl4WUgBqFF1JnphPRZXx01gbFjQT_0 2024-09-14T12:09:54.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14005469872077483661', time=2024-09-14T13:50:05.278821+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.53L_kryMfYuJDL_dw5S_vDbQekfAgPd_0 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9778915307151857816', time=2024-09-14T13:50:05.402203+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yiNz0hq7Lg_yuSLegJ5UlhywMft7pwl_0 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2943020486629573908', time=2024-09-14T13:50:05.590080+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0en3iF01_KgnZuU1Nz44uaxnF23TwOR_0 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2250006531763256773', time=2024-09-14T13:50:05.871557+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-6bg1XqpANbPdU_LYig-nGefEBlR4lM_0 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17301503849119363875', time=2024-09-14T13:50:06.367256+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Kw4GV2IPDTarX7ImSiUASQ2pgHEyMw5_0 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13637932189702977671', time=2024-09-14T13:50:06.452482+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.45-hkEoS1sEmOTuIEy5MIxXFq0GyYcA_0 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13037636154580512182', time=2024-09-14T13:50:06.827619+0000, chain.objs.size()=1 2024-09-14T12:09:54.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.bGf90ntXDIyFnZoYnwKKJHv8UlLG1lY_0 2024-09-14T12:09:54.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10220328766064439273', time=2024-09-14T13:50:07.239588+0000, chain.objs.size()=1 2024-09-14T12:09:54.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.RlJUdbIxABQQy9DEU2P82LQbFcSp0B0_0 2024-09-14T12:09:54.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11189912290553087358', time=2024-09-14T13:50:07.945303+0000, chain.objs.size()=1 2024-09-14T12:09:54.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.495+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.nLE6Re6DWEEeqomzsxHGc-gYpOz-TvL_0 2024-09-14T12:09:54.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.496+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15029466670705053855', time=2024-09-14T13:50:09.187102+0000, chain.objs.size()=1 2024-09-14T12:09:54.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.496+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.yNgmewXHnIZ9Sd0W_zfThb0VAxmi7Q5_0 2024-09-14T12:09:54.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.498+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9939017393034072800', time=2024-09-14T13:50:09.346006+0000, chain.objs.size()=1 2024-09-14T12:09:54.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.498+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.mmrIi8rgOQQxN-trTjN5dnmcpunEu9E_0 2024-09-14T12:09:54.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.499+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11416517564872745648', time=2024-09-14T13:50:09.541947+0000, chain.objs.size()=1 2024-09-14T12:09:54.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.499+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.05s6QJ1IlZLR_GuMLajRK6Aq7HRdw3F_0 2024-09-14T12:09:54.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.499+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17281162263114706836', time=2024-09-14T13:50:09.654721+0000, chain.objs.size()=1 2024-09-14T12:09:54.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.499+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.aaE4bxM3sXobAMBlgtzkJ3L6VPUhC56_0 2024-09-14T12:09:54.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.500+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4298890456936289555', time=2024-09-14T13:50:09.819824+0000, chain.objs.size()=1 2024-09-14T12:09:54.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.500+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Tdmhm3ilFd3HhEcYzJjwxje7tMaVHL2_0 2024-09-14T12:09:54.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.500+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13690328780526377086', time=2024-09-14T13:50:09.820599+0000, chain.objs.size()=1 2024-09-14T12:09:54.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.500+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4_mtiJlvfL__kPPPfmnYYHmoPBmrJcW_0 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5418841355410595936', time=2024-09-14T13:50:09.854653+0000, chain.objs.size()=1 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.g2B3i5x9zHoFnMWhs5IieCLhY7ti9lc_0 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13066437676885253809', time=2024-09-14T13:50:09.883182+0000, chain.objs.size()=1 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.u787ETkSnoGSjsIfjec7l18upFp9HVB_0 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3253798546607544193', time=2024-09-14T13:50:18.240520+0000, chain.objs.size()=1 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.276__shadow_.sA4xaVHxQ31VYaFN58et-4hQHEyqDnk_0 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18372372192354528024', time=2024-09-14T13:50:18.241022+0000, chain.objs.size()=1 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.276__shadow_.YryZkOQhvcSlI6931H02CNvg3xXVw6z_0 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13536061184937776209', time=2024-09-14T13:50:22.001794+0000, chain.objs.size()=1 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.282__shadow_.JfxofKlGwTTJGbkSeQE_yAoDfDV7SL3_0 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.376642186640574427', time=2024-09-14T13:50:23.305216+0000, chain.objs.size()=1 2024-09-14T12:09:54.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.284__shadow_.gotJRWve1sxQvkHFZrlwPVzccNGtsP-_0 2024-09-14T12:09:54.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9866490949013179881', time=2024-09-14T13:50:25.925957+0000, chain.objs.size()=1 2024-09-14T12:09:54.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.501+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.288__shadow_.nstLBclTRYfSwbKDOrCamHeXxXdT357_0 2024-09-14T12:09:54.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.503+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18226721038604042275', time=2024-09-14T13:50:29.797493+0000, chain.objs.size()=1 2024-09-14T12:09:54.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.COMGCP12zKYK02fzHcY8tSPVxxOGwpl_0 2024-09-14T12:09:54.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.503+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13127796878029806946', time=2024-09-14T13:50:29.797992+0000, chain.objs.size()=1 2024-09-14T12:09:54.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.R2YoAF7pMyO1TE_nMmqvlvhWBqpzn0s_0 2024-09-14T12:09:54.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.503+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17456015136616886639', time=2024-09-14T13:50:31.761174+0000, chain.objs.size()=1 2024-09-14T12:09:54.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.503+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.wDv0e5aqxk7Ks_HJoGJJmZCHgXB1M1m_0 2024-09-14T12:09:54.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.504+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10898846272526959450', time=2024-09-14T13:50:31.771854+0000, chain.objs.size()=1 2024-09-14T12:09:54.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.504+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.DjPFN0m5TK89-TW0Y1uX8IIe5ck4VpL_0 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18146109622599694445', time=2024-09-14T13:50:33.042265+0000, chain.objs.size()=1 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.295__shadow_.UYY2m-GXM8GbmORCQ_Ff2TYcmvk2M3v_0 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12754977499895862163', time=2024-09-14T13:50:35.026596+0000, chain.objs.size()=1 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.298__shadow_.YvaQCdTNdAs96sb45awX7eLZf-tKdyn_0 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16577743479572909403', time=2024-09-14T13:50:49.323600+0000, chain.objs.size()=1 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.319__shadow:e4E2rNys6FSspMjYGhVtGsNWmLyybe9_._frvIG_qhNga7dSbzJsh4rM24HEU1nv_0 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2334623914440370164', time=2024-09-14T13:51:30.692224+0000, chain.objs.size()=1 2024-09-14T12:09:54.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.NFg1gIvRg3pnSc2xNk62nTvlwmXzJYF_0 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16026381405543224457', time=2024-09-14T13:51:30.994259+0000, chain.objs.size()=1 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.P_SL3knRDfcmjgGA-Pf95GDUJwOGXmW_0 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.118968434850341937', time=2024-09-14T13:51:31.670057+0000, chain.objs.size()=1 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.N_5hA0wGD02UuLCb0iIkiZfMoyKLPEy_0 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4080460729726692357', time=2024-09-14T13:51:32.395838+0000, chain.objs.size()=1 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hEIw2F0jB7SwccDTM3JBwJz4e-JXcZh_0 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11068292830818379257', time=2024-09-14T13:51:32.418219+0000, chain.objs.size()=1 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ICfMCGpUsdtqxisLweGmdZu4FxHj4sE_0 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6356077583088844721', time=2024-09-14T13:51:32.494674+0000, chain.objs.size()=1 2024-09-14T12:09:54.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.506+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZqKnuKVYw6Mnsp88tX6t-BL9o_i6GVQ_0 2024-09-14T12:09:54.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.508+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13747164134526371029', time=2024-09-14T13:51:32.638868+0000, chain.objs.size()=1 2024-09-14T12:09:54.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.508+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ESY5qNr_P1B9JBI3ixFJ6B-QKk_qSAq_0 2024-09-14T12:09:54.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.508+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2323324649678681301', time=2024-09-14T13:51:32.664248+0000, chain.objs.size()=1 2024-09-14T12:09:54.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.508+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5IXJel2WqS_wJcPjUGau0oMX7_pGfbf_0 2024-09-14T12:09:54.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.510+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1760298381840294684', time=2024-09-14T13:51:32.733340+0000, chain.objs.size()=1 2024-09-14T12:09:54.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.510+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9GaCd-NwabQfLxb3hCgZSq4uPUvqNhI_0 2024-09-14T12:09:54.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.510+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18423194813523325666', time=2024-09-14T13:51:32.893018+0000, chain.objs.size()=1 2024-09-14T12:09:54.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.510+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.xjK0PRuN4ICndKhQLgSNXpax0ahusKo_0 2024-09-14T12:09:54.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.511+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7509544853997742648', time=2024-09-14T13:51:32.967378+0000, chain.objs.size()=1 2024-09-14T12:09:54.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.511+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ASJ02tkM3IxzKtRj4wKT2m-tVazikZ6_0 2024-09-14T12:09:54.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.511+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6179242308968357110', time=2024-09-14T13:51:33.911061+0000, chain.objs.size()=1 2024-09-14T12:09:54.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.511+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rWnUu55wdOxsy7wrY6zQsET3EGiDxxT_0 2024-09-14T12:09:54.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12113284341205945963', time=2024-09-14T13:51:34.221802+0000, chain.objs.size()=1 2024-09-14T12:09:54.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kF-ybaC8WkEqjNjztBIZ6P3aaJIxdMC_0 2024-09-14T12:09:54.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5234850218935209729', time=2024-09-14T13:51:34.532173+0000, chain.objs.size()=1 2024-09-14T12:09:54.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lsKjols3l6Jx21V0qUp5WZ36C0s2i7P_0 2024-09-14T12:09:54.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5162033898860652705', time=2024-09-14T13:51:34.617034+0000, chain.objs.size()=1 2024-09-14T12:09:54.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.AXYj07IvoMN5MBe3DQk4F0wDAQr4I_g_0 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2523374605562553198', time=2024-09-14T13:51:34.654537+0000, chain.objs.size()=1 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Ja89vk1mdDPawgp1SDn6Naw4t0auzp5_0 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5681039424647986827', time=2024-09-14T13:51:34.851862+0000, chain.objs.size()=1 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S6P3A4Tr_Wq4CP7MKJ-AIlleTs_uNQ3_0 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2471678308194409336', time=2024-09-14T13:51:36.053674+0000, chain.objs.size()=1 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Q30O9xhtfh1E-zn2_ofRacgEqjBbM_Q_0 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11778658587198511523', time=2024-09-14T13:51:36.823088+0000, chain.objs.size()=1 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.512+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bAf0Nfo31irl2DkAfNdW7w8eLJ4epyG_0 2024-09-14T12:09:54.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.513+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.855676187708745035', time=2024-09-14T13:51:37.010364+0000, chain.objs.size()=1 2024-09-14T12:09:54.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.513+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.3BIl53sNbqraI_q2JKboFNHfecuICuZ_0 2024-09-14T12:09:54.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.513+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14439246499401142247', time=2024-09-14T13:51:37.768877+0000, chain.objs.size()=1 2024-09-14T12:09:54.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.513+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MWzdX9LGYTBlc-Hs_1t8TttbSW0LtW7_0 2024-09-14T12:09:54.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.514+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12712914949690494001', time=2024-09-14T13:51:38.291726+0000, chain.objs.size()=1 2024-09-14T12:09:54.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.514+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.cuNpCcypQB1ZDHcGjcGG7w1Nr8zdB-J_0 2024-09-14T12:09:54.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.515+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4659580585005915541', time=2024-09-14T13:51:38.431479+0000, chain.objs.size()=1 2024-09-14T12:09:54.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.515+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pbOZcDye7cvPR7sXuDuvnfUINn8gv6H_0 2024-09-14T12:09:54.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10358771016346320973', time=2024-09-14T13:51:38.896932+0000, chain.objs.size()=1 2024-09-14T12:09:54.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.rv_e5cFUHEOCUZzBhki7_XBVR1Qqdqh_0 2024-09-14T12:09:54.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13314886112476416634', time=2024-09-14T13:51:38.947235+0000, chain.objs.size()=1 2024-09-14T12:09:54.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bovOXlkbrj4Pj3qR9pU-BwZOU9RCbKc_0 2024-09-14T12:09:54.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7901324876559943796', time=2024-09-14T13:51:40.492407+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jzFLU87g2rinG_mjWkAZCk0OeEIUDDZ_0 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15896541258238899592', time=2024-09-14T13:51:40.633898+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.y-N2_HgqD3gO_KtaAeJT4oxDQYxRaKK_0 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12910327822262923804', time=2024-09-14T13:51:41.357059+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.516+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.vRcDFmrx-ly90gC-TLKHNthanfRhk1j_0 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4068118432584932788', time=2024-09-14T13:51:41.478788+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.L-VAD-YDSV-VuByy2tR93LHUDQ8YPrM_0 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5744389949275213181', time=2024-09-14T13:51:41.510817+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.4by67Idcv5rTpMANC7wQdWxrysMu6Vg_0 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9711510973836757161', time=2024-09-14T13:51:41.881322+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OzJOYldSAsEkGdC3Ml5EkvGnEja-li0_0 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16183088585269089571', time=2024-09-14T13:52:21.927064+0000, chain.objs.size()=1 2024-09-14T12:09:54.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VBavZgZ6AKjun3t_KoCYEnNxhhntx_3_0 2024-09-14T12:09:54.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16918674294910738381', time=2024-09-14T13:52:22.129991+0000, chain.objs.size()=1 2024-09-14T12:09:54.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.517+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zX36wgosCpDdPnmiDVZdO4elKBq_gQC_0 2024-09-14T12:09:54.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.518+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12919532634127685031', time=2024-09-14T13:52:22.796803+0000, chain.objs.size()=1 2024-09-14T12:09:54.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.518+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tPyNAsvS4JORc1dVWQw4LUZ8XJE_xsL_0 2024-09-14T12:09:54.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.519+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12248641981966966281', time=2024-09-14T13:52:22.931035+0000, chain.objs.size()=1 2024-09-14T12:09:54.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.519+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jyH8oiQjhMS2roZtoA_T6FzOH3t82Hh_0 2024-09-14T12:09:54.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.186271429766549169', time=2024-09-14T13:52:23.085872+0000, chain.objs.size()=1 2024-09-14T12:09:54.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.622-x0BebzKoB2MtcYmLxj6NIRxB7-8_0 2024-09-14T12:09:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8974493985208089356', time=2024-09-14T13:52:23.086439+0000, chain.objs.size()=1 2024-09-14T12:09:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Z6Sp-lQB6d55XrfnRRn2WsLwgAFlkxM_0 2024-09-14T12:09:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10428310239991896060', time=2024-09-14T13:52:23.292400+0000, chain.objs.size()=1 2024-09-14T12:09:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ulM-C833vX7sTCDwSXjfsmMnjG5I95z_0 2024-09-14T12:09:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16946627745664018101', time=2024-09-14T13:52:23.447076+0000, chain.objs.size()=1 2024-09-14T12:09:54.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-_gPk1M-IuMi_V1kdNoFkPi7Nfo95_-_0 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14538931552717615102', time=2024-09-14T13:52:23.752490+0000, chain.objs.size()=1 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.f1NMT07tpu2iid3dCWoeFnL7YKZZJWS_0 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.328178165219474745', time=2024-09-14T13:52:23.753650+0000, chain.objs.size()=1 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.eRwpPRcqM5eOPzJFkSLtzJp1p32uSCd_0 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7921318432198669490', time=2024-09-14T13:52:24.245965+0000, chain.objs.size()=1 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-W2JbyPA1cDuHst3I_hbIAHWmtkROMG_0 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2869361706422272278', time=2024-09-14T13:52:24.246815+0000, chain.objs.size()=1 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.kw1moCBJjC1oVjRr2B4fk3nOhx4Jp7M_0 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15040497862985194728', time=2024-09-14T13:52:25.775526+0000, chain.objs.size()=1 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.521+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8QF-8meUI36QDMaDmiFFy4tvGb7Hr_y_0 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.522+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8651710781364496402', time=2024-09-14T13:52:25.901537+0000, chain.objs.size()=1 2024-09-14T12:09:54.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.522+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.do9fY5PasMYaUIfZy4IXMh3_dBbyWqF_0 2024-09-14T12:09:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.524+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15023621425729187930', time=2024-09-14T13:52:26.108919+0000, chain.objs.size()=1 2024-09-14T12:09:54.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.9J8sRQxvnwJh0tPyrTYpkIX-8wfSWWJ_0 2024-09-14T12:09:54.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.524+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17029910529824540170', time=2024-09-14T13:52:26.474536+0000, chain.objs.size()=1 2024-09-14T12:09:54.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.524+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.h0H6Z0TlkblJ-DJWl_wbvGAVtYLMJrr_0 2024-09-14T12:09:54.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.527+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/45250 2024-09-14T12:09:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-14T12:09:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2636364802881458567', time=2024-09-14T13:52:27.481708+0000, chain.objs.size()=1 2024-09-14T12:09:54.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.HnY5lxic4KyIfS8DWam008WOCRXorXh_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3198928666627270706', time=2024-09-14T13:52:28.963924+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.MbkrLVMWg3v7VC-t5XblE-9-akJuR6s_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10907451409922673180', time=2024-09-14T13:52:29.240238+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UFVvhgHnQP1Mzzu31fEOXVTcSWINTzI_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18246822418093012646', time=2024-09-14T13:52:29.442597+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.J3ts-WZbanFPlL_XdKenlEphC_1wKFd_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2888578264184545359', time=2024-09-14T13:52:30.203251+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.N-lKNCkw-6jl7TyQa6gKHTfanVVBH0z_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12911214679820067344', time=2024-09-14T13:52:30.579807+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.m_-4ASaiz3BOaWBRRh9nAmGZLzUnkWX_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9868021000136034157', time=2024-09-14T13:52:30.874563+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.l3AiEUHQR8kN_T_HuNy6EC5NuDpUc1F_0 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12077021562654334645', time=2024-09-14T13:52:31.358881+0000, chain.objs.size()=1 2024-09-14T12:09:54.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BnDsffUGQ1AdY1bvQD_NPnI02rmPiyr_0 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17055968098457796158', time=2024-09-14T13:52:31.387807+0000, chain.objs.size()=1 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jMk8ZfO7KqKkKQpB-j_pVhDxpTtq83q_0 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2811841377087737225', time=2024-09-14T13:52:31.772975+0000, chain.objs.size()=1 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.TVGHxDiUzlfRylr-g5xaubTtSPK8MJ8_0 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4854919781748300483', time=2024-09-14T13:52:32.036582+0000, chain.objs.size()=1 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tbUBsGYT-rcHC1WNK1z_oKJTf6j7moB_0 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9352363659485194437', time=2024-09-14T13:52:32.174739+0000, chain.objs.size()=1 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.529+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pSdV6sQZaZLn5HlvW704ngYgy3qms9s_0 2024-09-14T12:09:54.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.532+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4787830259114623716', time=2024-09-14T13:52:44.084855+0000, chain.objs.size()=1 2024-09-14T12:09:54.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.532+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.346__shadow_.KO5-gs6wpE62eN-wfyFkAQQBeuTFzSl_0 2024-09-14T12:09:54.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.532+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6115277077368929065', time=2024-09-14T13:52:59.663837+0000, chain.objs.size()=1 2024-09-14T12:09:54.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.532+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.377__shadow_.EaXTErPZ41N9OWWojb-7lRb2Wb0ur79_0 2024-09-14T12:09:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17112547410273763011', time=2024-09-14T13:53:19.866778+0000, chain.objs.size()=1 2024-09-14T12:09:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.410__shadow_.LT7EUqXqXRj5bhwZzWO5clc3QxCH20t_0 2024-09-14T12:09:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6953099425202940729', time=2024-09-14T13:53:38.429802+0000, chain.objs.size()=1 2024-09-14T12:09:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.443__shadow_.6jGMoG0iVboTOxhNPZiv6YfoP0XgLv8_0 2024-09-14T12:09:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1517016216006739162', time=2024-09-14T13:53:46.510984+0000, chain.objs.size()=1 2024-09-14T12:09:54.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.456__shadow_.wDvZXmaoHOgIiTacqlFl47QxsiO-HEx_0 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11024361749058739965', time=2024-09-14T13:54:12.197139+0000, chain.objs.size()=1 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.495__shadow_.grjiJcueNnGS8CSLgN93LlS6MoLG7D-_0 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13251469217200189862', time=2024-09-14T13:54:17.598646+0000, chain.objs.size()=1 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.503__shadow:cl2ARxfpauRoDIjBPT2zPE7hlSXN4gW_.mVyB_4O5KFCXr9CJf6BJq8M6WMccC9-_0 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17555648920507527766', time=2024-09-14T13:54:17.602978+0000, chain.objs.size()=1 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.503__shadow:cl2ARxfpauRoDIjBPT2zPE7hlSXN4gW_.mVyB_4O5KFCXr9CJf6BJq8M6WMccC9-_0 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17641434279288601468', time=2024-09-14T13:56:28.772056+0000, chain.objs.size()=4 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.527__multipart_mymultipart.2~vaGvdcxCd21ZeNYk0D2bWl0-AWzelUh.1 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.527__multipart_mymultipart.2~vaGvdcxCd21ZeNYk0D2bWl0-AWzelUh.2 2024-09-14T12:09:54.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.533+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.527__multipart_mymultipart.2~vaGvdcxCd21ZeNYk0D2bWl0-AWzelUh.3 2024-09-14T12:09:54.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.535+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.527__multipart_mymultipart.2~vaGvdcxCd21ZeNYk0D2bWl0-AWzelUh.4 2024-09-14T12:09:54.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.535+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9411441676125896617', time=2024-09-14T13:57:31.019854+0000, chain.objs.size()=1 2024-09-14T12:09:54.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.535+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.556__shadow_.cQsamfIbfpeZh-a90tDgAPoETR7ZkPl_0 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12309040943316396415', time=2024-09-14T13:57:50.913563+0000, chain.objs.size()=1 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.566__shadow_.Yjbz2tXdxwUpgyCsg-pNRzvgfMAZaIl_0 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9475961426702330122', time=2024-09-14T13:58:02.183862+0000, chain.objs.size()=1 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:UL9MsQtQwHfpUGUXYD7STxzHfImtX2M_.snhl79k1pbp-N8xqhUJSY32AOkLrpC-_0 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11553621651787284046', time=2024-09-14T13:58:55.338157+0000, chain.objs.size()=1 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:PbTSEmIGejND.ZHLbTZUUToWIlazJvf_.4tMb8Y0aDRaiTIMlS8Kq7ZRTdI2u9vf_0 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2563555464330874246', time=2024-09-14T13:59:10.887109+0000, chain.objs.size()=1 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.602__shadow_.eRkLh6-jI_RPYJkoiV90C8sqUbfC1Q9_0 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.890650238353407499', time=2024-09-14T14:03:07.990669+0000, chain.objs.size()=1 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.636__shadow_.ZEurDIa9Hku11rpprO4y4NfNXyYoK6o_0 2024-09-14T12:09:54.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5229648599172645593', time=2024-09-14T14:03:28.719732+0000, chain.objs.size()=2 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.655__shadow_.MhHhVNh4deKq3VCldPA3V7yLOsxXRe4_0 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.655__shadow_.MhHhVNh4deKq3VCldPA3V7yLOsxXRe4_1 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5603161233402861448', time=2024-09-14T14:03:50.826893+0000, chain.objs.size()=1 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.663__shadow_.0uejelER4foYnYNv8Gq3kVRD3tD8Fdd_0 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3914072418240572904', time=2024-09-14T14:03:50.827730+0000, chain.objs.size()=1 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.663__shadow_.fyTQIsTm0Sz63zAZewBYhe8FzN_6HvD_0 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14221336804458792588', time=2024-09-14T14:03:53.972083+0000, chain.objs.size()=1 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.666__shadow_.klhT636ODfO0CcAvxoqz2fK3BTHh8oA_0 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2692832279316317733', time=2024-09-14T14:03:54.804609+0000, chain.objs.size()=1 2024-09-14T12:09:54.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.538+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.668__shadow_.QdFagT7jBzdcS4wl850X8AzhqhrUuyi_0 2024-09-14T12:09:54.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16184181959354796309', time=2024-09-14T14:04:06.647965+0000, chain.objs.size()=1 2024-09-14T12:09:54.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.692__shadow:0v21w3uX.r-3.wGFciWTkZ2QXLmS1XA_.2nU8RpLvNuHflI-qikynwf8FhWRe4d5_0 2024-09-14T12:09:54.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2761750944050956704', time=2024-09-14T14:04:07.800254+0000, chain.objs.size()=1 2024-09-14T12:09:54.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.694__shadow:tREuNHZQmAw3EYMD5Pc.FFOLnKoFc9F_.gbF9K0pj0w-oWREcTSJwpcHNtvg2ECf_0 2024-09-14T12:09:54.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12265481031240069543', time=2024-09-14T14:05:12.146354+0000, chain.objs.size()=1 2024-09-14T12:09:54.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.745__shadow_.Kgp-cZL7CdOW_uvktUdrVgtLIVzPK-i_0 2024-09-14T12:09:54.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2616985823217406931', time=2024-09-14T14:05:59.641611+0000, chain.objs.size()=1 2024-09-14T12:09:54.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.541+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.755__shadow_.ThByvTcGoUZUXU84VrjMmxmyT2CBmgB_0 2024-09-14T12:09:54.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.544+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.547+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T12:09:54.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.548+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.548+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44180' 2024-09-14T12:09:54.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7669001336818721824', time=2024-09-14T13:46:32.337715+0000, chain.objs.size()=1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.151__shadow_.ym98kVcBRpj4IFACFEj5pHYjOfv7QGQ_0 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7199095114626546074', time=2024-09-14T13:46:40.280149+0000, chain.objs.size()=2 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.158__shadow_.NpxLEGfBtGgLj4rI-G2XSrAX2puiXDO_0 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.158__shadow_.NpxLEGfBtGgLj4rI-G2XSrAX2puiXDO_1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5447611734663768157', time=2024-09-14T13:49:06.127794+0000, chain.objs.size()=1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.238__shadow_.3r7ProyHfwWniugN1xkxSWb86As3oR__0 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2745204884707157591', time=2024-09-14T13:49:08.456216+0000, chain.objs.size()=1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.242__shadow_.T_yN2UehDyOTpzB4ItQCOYR8CKGYigo_0 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1664630900289052208', time=2024-09-14T13:49:15.239626+0000, chain.objs.size()=1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.252__shadow_.Xc_-X9RLsVf3KtX60-GTeLp9JDkTFqT_0 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3694147562560521728', time=2024-09-14T13:49:15.913085+0000, chain.objs.size()=1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.253__shadow_.dWumTM_P773J6wkMLqzFhQeUkculzFD_0 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16895696686459863030', time=2024-09-14T13:49:58.852301+0000, chain.objs.size()=1 2024-09-14T12:09:54.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oQFnDX_LI-_QmT1w-yZNVWU9r7j5FRD_0 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6643134935034137647', time=2024-09-14T13:49:59.122478+0000, chain.objs.size()=1 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._2aFye6ohb7xcKWU0Js-GO3ZywdfhIG_0 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7183838317917308612', time=2024-09-14T13:49:59.615276+0000, chain.objs.size()=1 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZwAgp3d8FZ2sa0dmrKczj97KtgE5BRk_0 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5830450806594401347', time=2024-09-14T13:49:59.873748+0000, chain.objs.size()=1 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.udakdGfCaaishuIQsH5t6z-dlBSs1-Y_0 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7738719080029454348', time=2024-09-14T13:50:00.462386+0000, chain.objs.size()=1 2024-09-14T12:09:54.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.549+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Ic3Mm1j-iL3mm7ovmd3ArZ4KJNVsk_M_0 2024-09-14T12:09:54.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6217743386439756169', time=2024-09-14T13:50:00.627370+0000, chain.objs.size()=1 2024-09-14T12:09:54.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.p8xAgKOr_El7joWkzdOTgOa_om1h5kN_0 2024-09-14T12:09:54.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10766532282010643639', time=2024-09-14T13:50:00.706373+0000, chain.objs.size()=1 2024-09-14T12:09:54.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.-W23De5jB9O3eLNTmLC3I6yuGzAuqc9_0 2024-09-14T12:09:54.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12519763690834773497', time=2024-09-14T13:50:00.780514+0000, chain.objs.size()=1 2024-09-14T12:09:54.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.0Xd5Va_nlNl8rBkVcwPgfZE3gUZqp8X_0 2024-09-14T12:09:54.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10985791612267790138', time=2024-09-14T13:50:02.109870+0000, chain.objs.size()=1 2024-09-14T12:09:54.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.wQvfN6faQdNK-pdDxbo7nvcNAowb_D__0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1569964353666517085', time=2024-09-14T13:50:03.427643+0000, chain.objs.size()=1 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.140UI1MCUVBffD-XKUA8-heZjRSX45j_0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11386074308536591027', time=2024-09-14T13:50:04.417343+0000, chain.objs.size()=1 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.T3lNBGI9iktrneKDniQw4YVVAgw2EMH_0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1290543979340161028', time=2024-09-14T13:50:04.864834+0000, chain.objs.size()=1 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.m_JIwiVoYojwcccBNgJu2Gxy7Qte-qK_0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14502346363480476729', time=2024-09-14T13:50:05.007375+0000, chain.objs.size()=1 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.553+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YaJwy1zOZBaCh2rtMDIRG-2IQfWFTeV_0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.554+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13060255285075752343', time=2024-09-14T13:50:05.592028+0000, chain.objs.size()=1 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.554+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6a1WX4QHsGSATprLOxWPrc8CTownopV_0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.554+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8052824986167111866', time=2024-09-14T13:50:07.812587+0000, chain.objs.size()=1 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.554+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.7tdbFmwja-6Je4W0_EL5R42k-7tCX6z_0 2024-09-14T12:09:54.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.554+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6110115770484868645', time=2024-09-14T13:50:07.841475+0000, chain.objs.size()=1 2024-09-14T12:09:54.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.554+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YvtKU_VgnxnBS03vhNjs0YU-_WgV66L_0 2024-09-14T12:09:54.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.556+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4131960625293389845', time=2024-09-14T13:50:08.168088+0000, chain.objs.size()=1 2024-09-14T12:09:54.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.556+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.QzeqetxaRcnv3wrm1QWcdqyDxUPo4_s_0 2024-09-14T12:09:54.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.556+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5842414544503806529', time=2024-09-14T13:50:08.599306+0000, chain.objs.size()=1 2024-09-14T12:09:54.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.556+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3uF2ZiWPX53vzi8hIGOKixI2hcQPud5_0 2024-09-14T12:09:54.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12311150237588971540', time=2024-09-14T13:50:08.918192+0000, chain.objs.size()=1 2024-09-14T12:09:54.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tIzvGdaYvtORIKNkcvku7YNLvjqUp2o_0 2024-09-14T12:09:54.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2225910077723801651', time=2024-09-14T13:50:09.517721+0000, chain.objs.size()=1 2024-09-14T12:09:54.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oB66JLO-cf_1OsISgkU1kRQvABg-QvQ_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5544851233791700629', time=2024-09-14T13:50:18.241674+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.276__shadow_.h_AWdILrD2v5ZBVIeEJvPDf_ZIAjmo6_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8401892008554203429', time=2024-09-14T13:50:22.010833+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.282__shadow_.JhmdWfqP8Ed3ORUcmoYiCzAifHconxb_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11388826652492346537', time=2024-09-14T13:50:25.308628+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.287__shadow_.-R3HSc3d_W-d6iPu8RQSi72BYsvSBx8_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4446073650395049058', time=2024-09-14T13:50:29.792826+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.TkTYLf8IXl0R9BCHSd0WASU8lEV-_l6_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14583838368488128986', time=2024-09-14T13:50:31.746533+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.K-NBb6ic7sLQeOU6daIbFasFwz6cZZf_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11498291822307453860', time=2024-09-14T13:50:36.416352+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.300__shadow_.wwVJMpb9WnTS12ukhxQR_7WqBU15T6w_0 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2289465834674320309', time=2024-09-14T13:51:30.879879+0000, chain.objs.size()=1 2024-09-14T12:09:54.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.558+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._6lublFuKdVUGk9VUEBOUah1x0_9Z-j_0 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7408629897106763127', time=2024-09-14T13:51:30.945445+0000, chain.objs.size()=1 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.pwAdZUuG8ZQtmF_3hlh6K7VciQtkUv9_0 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16389543791969490268', time=2024-09-14T13:51:31.083567+0000, chain.objs.size()=1 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DruyF2DJ-hG94TRN3yvv8ax3RK52HzA_0 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1666407916111518743', time=2024-09-14T13:51:31.554954+0000, chain.objs.size()=1 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.DB3iveDl8tzVfbecttHARwoIkePtU_c_0 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18215645693714587722', time=2024-09-14T13:51:31.728400+0000, chain.objs.size()=1 2024-09-14T12:09:54.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.560+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.apTs3mQYTVyGWt6AfN4aZpBRBaxtRYN_0 2024-09-14T12:09:54.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.561+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1835319972277655503', time=2024-09-14T13:51:32.639381+0000, chain.objs.size()=1 2024-09-14T12:09:54.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.561+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zRcXr3FZh8uLtSxju7VHMuGBXxSFgY7_0 2024-09-14T12:09:54.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.561+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3038223962052903968', time=2024-09-14T13:51:34.219803+0000, chain.objs.size()=1 2024-09-14T12:09:54.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.561+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UlNcjZjUkvq4Km3TtpD_cdhohd28AL9_0 2024-09-14T12:09:54.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6015299558113262593', time=2024-09-14T13:51:35.612029+0000, chain.objs.size()=1 2024-09-14T12:09:54.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZsoinuzNu5R-HIyoPpeIWPQ3Gt30iel_0 2024-09-14T12:09:54.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.321896397826493898', time=2024-09-14T13:51:35.781211+0000, chain.objs.size()=1 2024-09-14T12:09:54.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Rf37XbynR0W-Zzwa3MHd27K_qXF9Y7g_0 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14631007569543528265', time=2024-09-14T13:51:36.174749+0000, chain.objs.size()=1 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.9-jFVQWskWEzCiFWgDl-4VInXLQAKeb_0 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14450043343546832236', time=2024-09-14T13:51:36.843014+0000, chain.objs.size()=1 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.p47YBWHGSUWRrRbl1tNf-DpLC5Bbjwy_0 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1324941381015649867', time=2024-09-14T13:51:36.843800+0000, chain.objs.size()=1 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.563+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0VDhcbp-86scekOBZmJhucodsbsP8Vk_0 2024-09-14T12:09:54.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9434041122631967774', time=2024-09-14T13:51:37.007042+0000, chain.objs.size()=1 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.UVOPnI4bgTbdCdkCPSUQni_P2SDkBXq_0 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11876962499221041575', time=2024-09-14T13:51:37.107091+0000, chain.objs.size()=1 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.zvEAkj2hD0rykA7EwBe1v35hUaaLy-H_0 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15187175987959880002', time=2024-09-14T13:51:37.267483+0000, chain.objs.size()=1 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OTbDCE4O9gIWUXJHTxpmcqfZewYfmsa_0 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5741077185011190561', time=2024-09-14T13:51:37.873809+0000, chain.objs.size()=1 2024-09-14T12:09:54.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.564+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.CzPeQmclQJXCQ5qEb6czlFnj2U6ANnW_0 2024-09-14T12:09:54.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.565+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3423079352223999648', time=2024-09-14T13:51:39.224065+0000, chain.objs.size()=1 2024-09-14T12:09:54.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.565+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.N2tPchpEr-_XovBg6f6BFMW7UQrZwiR_0 2024-09-14T12:09:54.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.566+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11614482188294113800', time=2024-09-14T13:51:40.077805+0000, chain.objs.size()=1 2024-09-14T12:09:54.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.566+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZSl3_PoWMNYRWmPXxlt0PW4l3WGWRkR_0 2024-09-14T12:09:54.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.566+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1682077958480461060', time=2024-09-14T13:51:40.112442+0000, chain.objs.size()=1 2024-09-14T12:09:54.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.566+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.WM1DGnvDxFACdwclRwVa6GmPyPNBtSI_0 2024-09-14T12:09:54.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.566+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1308802683180314389', time=2024-09-14T13:51:40.610018+0000, chain.objs.size()=1 2024-09-14T12:09:54.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.566+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.C8gEqKk3-u0agAU4yExT4pC7kV0i57n_0 2024-09-14T12:09:54.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15986434347296721972', time=2024-09-14T13:51:41.049154+0000, chain.objs.size()=1 2024-09-14T12:09:54.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.nAzXWeMtD73XlEPpuFrJcCCsYfXsN3b_0 2024-09-14T12:09:54.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13604379969043324195', time=2024-09-14T13:51:41.085804+0000, chain.objs.size()=1 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.S4bPVdz8QCQhHCdS6dv7O_MCppK4rc9_0 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.567+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4995212518138146754', time=2024-09-14T13:51:41.644286+0000, chain.objs.size()=1 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.567+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mTOauXldCSyn7OBUwiw535GLwMtLC_g_0 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1290637565262402315', time=2024-09-14T13:51:41.661378+0000, chain.objs.size()=1 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.tuVyB1z_nkZWAvaxbwayMuKT-Kf9E-V_0 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15279923216789930998', time=2024-09-14T13:52:21.115704+0000, chain.objs.size()=1 2024-09-14T12:09:54.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_._Vz3KsLAsx2NZpociJWN8UKLOlQ1Zde_0 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11924483430785669524', time=2024-09-14T13:52:21.406111+0000, chain.objs.size()=1 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.C9kP8cz8X3WaHizIggWURK7dc9oBSJp_0 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11452777377726214567', time=2024-09-14T13:52:21.503830+0000, chain.objs.size()=1 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.568+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cANZmomtj8CwNx2WB57HBL5Ol8_uYhq_0 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1930399951392434892', time=2024-09-14T13:52:22.878959+0000, chain.objs.size()=1 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iV-cQX36g7_0SBAQn6EefbjImRX1ICz_0 2024-09-14T12:09:54.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12373618405820003842', time=2024-09-14T13:52:22.909681+0000, chain.objs.size()=1 2024-09-14T12:09:54.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.HLLvVEOyM1XEcKbFHM4W7Y1DTgWZyye_0 2024-09-14T12:09:54.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.569+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18332510121438469820', time=2024-09-14T13:52:23.082027+0000, chain.objs.size()=1 2024-09-14T12:09:54.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.569+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xgemcqlKzVpS9ODhsZAIHhUfCUgrRE4_0 2024-09-14T12:09:54.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.571+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.219603252454711255', time=2024-09-14T13:52:23.351689+0000, chain.objs.size()=1 2024-09-14T12:09:54.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.571+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.BxEMtRflLAkC8yQaT3jG60XqwG65KoR_0 2024-09-14T12:09:54.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12502759769361874807', time=2024-09-14T13:52:23.572979+0000, chain.objs.size()=1 2024-09-14T12:09:54.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.--uSuNHStlB5p3y0t_jZlQqvXDTqgIy_0 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17067579100827760666', time=2024-09-14T13:52:24.424061+0000, chain.objs.size()=1 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3XY5juFefO7hZA-ftwVOnaqmUdAl8tz_0 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4812018707778501258', time=2024-09-14T13:52:24.806516+0000, chain.objs.size()=1 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.NNhONKpumfDYVSoTXZPmzFvC87HLVTN_0 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10399931708703898196', time=2024-09-14T13:52:24.897600+0000, chain.objs.size()=1 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.8MLPBylJ6OKHfK7lAhTR6vQICU-LduE_0 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4982527559381571534', time=2024-09-14T13:52:25.007737+0000, chain.objs.size()=1 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qwS8kcIhjhPcDqC688KCBqBMrhrcChM_0 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14407436910934185517', time=2024-09-14T13:52:25.008410+0000, chain.objs.size()=1 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qbUWmd5c9w32vZtSepOuf9gCm4CZ-bU_0 2024-09-14T12:09:54.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4031928971846304149', time=2024-09-14T13:52:25.111243+0000, chain.objs.size()=1 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.CcRxEKRK04Fg6-Y9hthG-AvRsVnm4x5_0 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14424174712003431188', time=2024-09-14T13:52:25.254716+0000, chain.objs.size()=1 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ACsqn5zWjIq26nMsNOkQL0uCK1w6KJm_0 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8068540534070653253', time=2024-09-14T13:52:25.255466+0000, chain.objs.size()=1 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qX17bd6dTC43w9a-EiIfdPE8MvvqVz2_0 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8834716683287003945', time=2024-09-14T13:52:25.919675+0000, chain.objs.size()=1 2024-09-14T12:09:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.572+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gLMpgzYTq8xYI6BexuAWnvxx2fTkTqn_0 2024-09-14T12:09:54.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.574+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1041295662107718422', time=2024-09-14T13:52:26.243051+0000, chain.objs.size()=1 2024-09-14T12:09:54.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.574+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tUZHeKwLky5F1A8vTww-tzjHAZ5a9q1_0 2024-09-14T12:09:54.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.575+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10368906705232494528', time=2024-09-14T13:52:26.323912+0000, chain.objs.size()=1 2024-09-14T12:09:54.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.575+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.G2ktZ1UeJ-Ss2MyUIqdhQ8GJTnWNm-L_0 2024-09-14T12:09:54.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.576+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15398726369267890984', time=2024-09-14T13:52:26.474456+0000, chain.objs.size()=1 2024-09-14T12:09:54.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.576+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KBUO3dw0RzaAPCOAF8KkxggJQsfmGfA_0 2024-09-14T12:09:54.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10090950986345181185', time=2024-09-14T13:52:26.793187+0000, chain.objs.size()=1 2024-09-14T12:09:54.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Vjw7pTxwpgjwUzuSDOJr7Noc6vBCYCh_0 2024-09-14T12:09:54.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6795858366126923938', time=2024-09-14T13:52:27.338667+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.q6a3_TmPL_WWICJMKeHrvLjxA1pEpAx_0 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10394068592229262405', time=2024-09-14T13:52:27.371234+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.F8iOrbxP0TxKh_xY8LvadTXdjO_3xgV_0 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8461712407511556315', time=2024-09-14T13:52:27.421667+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VThcD5YkPJ5X-kKEiNg6nbpaZsLJgDD_0 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6129512441257652095', time=2024-09-14T13:52:27.478894+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.J-bybNwwD2Rru9Dy0eO-mUfC-NnQiM0_0 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2970496612457148512', time=2024-09-14T13:52:27.577923+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.VSymIEDGyH6ux7iAkGoEfJvyVkuVNcy_0 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5846672045757148333', time=2024-09-14T13:52:27.759797+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.gxx-hBUeA8qZuVnPfGYFWt7FIUY0iwI_0 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9536540258394719436', time=2024-09-14T13:52:27.792334+0000, chain.objs.size()=1 2024-09-14T12:09:54.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.577+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5nNbeYs4LiA_uw22EFv6aNT3KemHa9U_0 2024-09-14T12:09:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.578+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1302004551450893339', time=2024-09-14T13:52:27.917701+0000, chain.objs.size()=1 2024-09-14T12:09:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.578+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3dWbp9z_0uqvvvb5viEhpc6RUHziuUi_0 2024-09-14T12:09:54.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9806417720532477593', time=2024-09-14T13:52:28.078939+0000, chain.objs.size()=1 2024-09-14T12:09:54.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.S2VbKB8YCvdqU65cpB7CABVy8n3oFVc_0 2024-09-14T12:09:54.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1077402781236477682', time=2024-09-14T13:52:28.271752+0000, chain.objs.size()=1 2024-09-14T12:09:54.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UZ4y1DtrSrXFBlwe-88xx3W4RK04QyY_0 2024-09-14T12:09:54.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.579+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4702225618939188129', time=2024-09-14T13:52:28.272617+0000, chain.objs.size()=1 2024-09-14T12:09:54.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.579+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cgW7VA4R2wbsm9zrRkm7goyUshAVHsX_0 2024-09-14T12:09:54.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.580+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15182464953938335063', time=2024-09-14T13:52:28.867177+0000, chain.objs.size()=1 2024-09-14T12:09:54.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.580+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PNO0hbguOomIG1FapfptRaVeOt7X8gy_0 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6663799105671858434', time=2024-09-14T13:52:28.981537+0000, chain.objs.size()=1 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.QmQad9VbNFqGc-o4cYoAHSHCnbEMgVF_0 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17518381771026501101', time=2024-09-14T13:52:30.508565+0000, chain.objs.size()=1 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.88tmlJ0pdaIwSoqUxpAp7VbffqyT8b4_0 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3713853561446055751', time=2024-09-14T13:52:31.587329+0000, chain.objs.size()=1 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ZrjC_Eab7sc5DLgZn4dzTPsw-KL6Xgk_0 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6066242995510045562', time=2024-09-14T13:52:31.945830+0000, chain.objs.size()=1 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.L6Mij65Ay9nfi8exb42TTqZWhV4je8F_0 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.100524255691047066', time=2024-09-14T13:52:31.946627+0000, chain.objs.size()=1 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.go37m5GwlRcNlrfAB6tpPqs1bnHiIoP_0 2024-09-14T12:09:54.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16433166058868970448', time=2024-09-14T13:54:12.706210+0000, chain.objs.size()=1 2024-09-14T12:09:54.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.581+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.496__shadow_.XT1IKDCaNhYnglJUkJpUAmQWcxvAl1O_0 2024-09-14T12:09:54.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.582+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13286576243220419345', time=2024-09-14T13:54:30.829491+0000, chain.objs.size()=1 2024-09-14T12:09:54.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.582+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.514__shadow_.54dAB_in4oDGZxh2ZqCn5ZeIytL8EwZ_0 2024-09-14T12:09:54.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.583+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.651900200426157939', time=2024-09-14T13:54:31.758762+0000, chain.objs.size()=1 2024-09-14T12:09:54.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.583+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.515__shadow_.juZstZ7Fjh6W35t7_0NT3txpNYCwqiu_0 2024-09-14T12:09:54.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.584+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1912532820637397904', time=2024-09-14T13:54:37.807946+0000, chain.objs.size()=2 2024-09-14T12:09:54.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.584+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.517__shadow_.GmnsWfKfCKf416lq1MKs04sEhpPUpYB_0 2024-09-14T12:09:54.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.584+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.517__shadow_.GmnsWfKfCKf416lq1MKs04sEhpPUpYB_1 2024-09-14T12:09:54.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.584+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17429477803497394121', time=2024-09-14T13:56:58.415707+0000, chain.objs.size()=4 2024-09-14T12:09:54.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.585+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.535__multipart_mymultipart.2~ZJNozVoCLNs6sDsPDy2IvOcgHcy0c-V.1 2024-09-14T12:09:54.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.585+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.535__multipart_mymultipart.2~ZJNozVoCLNs6sDsPDy2IvOcgHcy0c-V.2 2024-09-14T12:09:54.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.585+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.535__multipart_mymultipart.m-JJxiJZaHJk7OoYsO130E0rN5XKh84g.3 2024-09-14T12:09:54.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.585+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.535__multipart_mymultipart.2~ZJNozVoCLNs6sDsPDy2IvOcgHcy0c-V.4 2024-09-14T12:09:54.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.585+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8864735872708671044', time=2024-09-14T13:57:53.780893+0000, chain.objs.size()=1 2024-09-14T12:09:54.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.585+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:kqTsR90reYClBjiuoqnL2kUOu7Jt6eL_.0jDe16AWM1F7LDSSOSsvX1O0eamdX4m_0 2024-09-14T12:09:54.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.589+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/44180 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13172929501325470133', time=2024-09-14T13:58:07.130694+0000, chain.objs.size()=1 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.573__shadow_.0DtSbegRJbfxXT-nVX3LrmaU_KFAUMV_0 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8106940977523307473', time=2024-09-14T13:58:20.961284+0000, chain.objs.size()=1 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:Pzus-nx9WNDvYLZYPs9hg1uHhbDpSGr_.LrLt9Lh_0n-NZ36QO3LGf5epbfX8Qpn_0 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10555662076373661312', time=2024-09-14T13:58:29.578173+0000, chain.objs.size()=1 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:opLcspPO1z98GavDB.yaU5RJf72SD0l_.C1wRntwTKF0W-AsH7JRnu2A07DDvFtc_0 2024-09-14T12:09:54.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.664926480757266138', time=2024-09-14T13:58:33.526548+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:kDOBFfuny8H5FBQWo0Nwr4XO7mv8Qxd_.TGdtxXMuJwmJ445NNDk9nKYxmXj5J_v_0 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12686114281475436005', time=2024-09-14T13:58:55.407277+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:cuohG9xHWoB-.rbL8rdGlIMKs4WkcYg_.-rGXDjzLYshzGNdpT9SpTiRUSGOZhtC_0 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5539181235590318575', time=2024-09-14T13:58:57.482041+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:2a8-IHwbJ8WEXiLba2va5f4RcmBSvJE_.0C-z9Dlr_sE1OxrycfrjQVB9PlHu28T_0 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9350524275954571876', time=2024-09-14T13:58:57.748494+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:2a8-IHwbJ8WEXiLba2va5f4RcmBSvJE_.0C-z9Dlr_sE1OxrycfrjQVB9PlHu28T_0 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2969231470547708569', time=2024-09-14T13:59:03.632367+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.587__shadow:KzeFdXNRFhJd-cHO2.0DKtK6eyaZcOQ_.wQb1e1EXfwvcV4UFjCdDyA0pkEgOzok_0 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17706299380150400974', time=2024-09-14T14:03:07.401226+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.635__shadow_.7hv8BZnNVDOFxXw4plzmQ6zyvH3cwjv_0 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9409165338530584887', time=2024-09-14T14:03:08.557007+0000, chain.objs.size()=1 2024-09-14T12:09:54.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.637__shadow_.xGj8OE1S83z8llac0hy2RRztm4CP7Uq_0 2024-09-14T12:09:54.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16624312823621739486', time=2024-09-14T14:04:15.013413+0000, chain.objs.size()=1 2024-09-14T12:09:54.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.705__shadow:BkJt.tocmXJ4.bDB8OZgRt7jwwAHw2-_.6fFVrLnV9y8XbuMg71tMzK3PNBKrYuh_0 2024-09-14T12:09:54.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18375645287990166022', time=2024-09-14T14:05:06.160363+0000, chain.objs.size()=3 2024-09-14T12:09:54.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.592+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.743__multipart_mymultipart3.2~l9RU-0XLExFg-iPhKzEn9hcjyqXA9j6.1 2024-09-14T12:09:54.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.595+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.743__multipart_mymultipart3.2~l9RU-0XLExFg-iPhKzEn9hcjyqXA9j6.2 2024-09-14T12:09:54.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.595+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.743__multipart_mymultipart3.2~l9RU-0XLExFg-iPhKzEn9hcjyqXA9j6.3 2024-09-14T12:09:54.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.595+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10244264685855014027', time=2024-09-14T14:05:17.043901+0000, chain.objs.size()=1 2024-09-14T12:09:54.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.595+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.747__shadow_.GW9hQXrhOmzR6hp6vdBYaggsLb7SiET_0 2024-09-14T12:09:54.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.597+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.600+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T12:09:54.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.601+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.601+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50980' 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4463643006589755807', time=2024-09-14T13:47:19.600427+0000, chain.objs.size()=1 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.189__shadow_.tx1I491tZp431fYFupDHSrSKGCO1xvB_0 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13061811308069068395', time=2024-09-14T13:49:03.083842+0000, chain.objs.size()=1 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.234__shadow_.32ixQOjF99DE5kb5KT6jrMvFTJ6ONc7_0 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6394294028702669095', time=2024-09-14T13:49:03.084570+0000, chain.objs.size()=1 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.234__shadow_.weyJh0zLP7ogqslrNUlyp7DU0BZLxrF_0 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16067802282613202607', time=2024-09-14T13:49:03.725237+0000, chain.objs.size()=1 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.235__shadow_.NlTyg_1YhxioFBZYRKq_nyhTbW8Z67b_0 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12215309536503672825', time=2024-09-14T13:49:03.725900+0000, chain.objs.size()=1 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.235__shadow_.RJBVF93e9w0dmzY6enNEyQ7K0M_UaHV_0 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4090236100249342501', time=2024-09-14T13:49:10.190332+0000, chain.objs.size()=1 2024-09-14T12:09:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.244__shadow_.5BeWului68g_JYesNC5uH-Fd4kslLZ__0 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11676114132733700202', time=2024-09-14T13:49:17.803247+0000, chain.objs.size()=1 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.256__shadow_.W53CcWgKhIfpCszt3l6mvIHF97OPf26_0 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14806765191429125551', time=2024-09-14T13:49:58.814365+0000, chain.objs.size()=1 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.jlS2d7msxVBFORLk-x0ulzWTqVwO8QH_0 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10578628801292240859', time=2024-09-14T13:49:58.815161+0000, chain.objs.size()=1 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.4aK-1JMouudWy6vygSOb3_sqfaZu_kL_0 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10799015238572193014', time=2024-09-14T13:49:58.854532+0000, chain.objs.size()=1 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.29xqZtXo-zsSLlRqY0V1PZ9haaTWBT1_0 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15201921849213822445', time=2024-09-14T13:49:59.123441+0000, chain.objs.size()=1 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.e1Ut8ZdG6hL-fLK5ihCvCCgVfMgLmNe_0 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4068561532795918443', time=2024-09-14T13:49:59.823379+0000, chain.objs.size()=1 2024-09-14T12:09:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.602+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BuY9ezn1MRWPyhW_FhAW8NLWPVJ8I7-_0 2024-09-14T12:09:54.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.605+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12008867682961088882', time=2024-09-14T13:50:00.922777+0000, chain.objs.size()=1 2024-09-14T12:09:54.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.605+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TvACIucotBpk9gn9tRzFPl9-S6wz71U_0 2024-09-14T12:09:54.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5901008121549785998', time=2024-09-14T13:50:01.056331+0000, chain.objs.size()=1 2024-09-14T12:09:54.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.DBNa2kZYi71NBpcQDP9KoZbV3FE8hed_0 2024-09-14T12:09:54.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12772189318740132136', time=2024-09-14T13:50:01.057158+0000, chain.objs.size()=1 2024-09-14T12:09:54.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.traydBzh2r2jobXGVn15t9LX0a2RSud_0 2024-09-14T12:09:54.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13151163716642804447', time=2024-09-14T13:50:01.109940+0000, chain.objs.size()=1 2024-09-14T12:09:54.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.A_OKVmHLH6AAd0FTb8T6hfQZ0uOk0W-_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5288111591011079038', time=2024-09-14T13:50:01.155360+0000, chain.objs.size()=1 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.msAeSJnqO6NVfb-vWBTwoj32U0yd3Hc_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13166772961126421881', time=2024-09-14T13:50:01.216766+0000, chain.objs.size()=1 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.02H-azObL6ZK1AV3K1k-shQDXHs75Rq_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7567292320160190605', time=2024-09-14T13:50:01.264192+0000, chain.objs.size()=1 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dNmc0_-vX8eG7pR4_c0SpTILNl83Dng_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18110927399703602714', time=2024-09-14T13:50:01.443110+0000, chain.objs.size()=1 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cqy3WgfLvCyXSPH12bsFwVsdiHAh31r_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15761366878724053741', time=2024-09-14T13:50:02.599716+0000, chain.objs.size()=1 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.8zJPlAHhBPEpw1-pP1Sz8TeUmdfOrMi_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9670534184827989852', time=2024-09-14T13:50:02.708026+0000, chain.objs.size()=1 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.IxA-8PCd8VI4yKldJMcNWgDJewTNXKt_0 2024-09-14T12:09:54.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11372644798487907571', time=2024-09-14T13:50:02.875754+0000, chain.objs.size()=1 2024-09-14T12:09:54.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.606+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.PQGrv--lJFOcxGRBlUEARgmde6mp1ny_0 2024-09-14T12:09:54.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.607+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16681808201148494326', time=2024-09-14T13:50:03.017894+0000, chain.objs.size()=1 2024-09-14T12:09:54.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.607+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.dZTcXNet8ueZiUmgPhd9TeM2i66-CIW_0 2024-09-14T12:09:54.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.610+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2842849937148172272', time=2024-09-14T13:50:03.020479+0000, chain.objs.size()=1 2024-09-14T12:09:54.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.610+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_._Q9WhKUCx7cBzp_PsPY30RO3hilrwa__0 2024-09-14T12:09:54.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.610+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3794793560052232558', time=2024-09-14T13:50:03.451010+0000, chain.objs.size()=1 2024-09-14T12:09:54.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.610+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XfgDFJGE0lasARtPA0SEy2DtQmF2nbv_0 2024-09-14T12:09:54.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9850895755625026426', time=2024-09-14T13:50:04.015893+0000, chain.objs.size()=1 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Gnwl-UGkCXHFgqDIIVsLMkbVaxMWoX4_0 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13147822867367874299', time=2024-09-14T13:50:04.142841+0000, chain.objs.size()=1 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.iOf8ammN8FJxz0XotQ1ccxrboIJ447T_0 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11790988196907611574', time=2024-09-14T13:50:04.280726+0000, chain.objs.size()=1 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5VViczYv8t9AQA4lhXTIdFw8VjJJQNo_0 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17191696713479604479', time=2024-09-14T13:50:04.307880+0000, chain.objs.size()=1 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3Huxfamecb-vWxAeCFvnWzVnIJ3MRIr_0 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1569350452006985269', time=2024-09-14T13:50:04.316286+0000, chain.objs.size()=1 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9RbLJtyKJzIn3b8qHBxibxu3zLeBz4o_0 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3534365381230805148', time=2024-09-14T13:50:05.373210+0000, chain.objs.size()=1 2024-09-14T12:09:54.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.611+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.tC0uhPHb2dIGIcQoB86QDoflFLUGfRE_0 2024-09-14T12:09:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.612+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11269065826482321689', time=2024-09-14T13:50:05.803474+0000, chain.objs.size()=1 2024-09-14T12:09:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.612+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.FqJ6nbaukk4sLQKVFDc4TcG9xCasfw6_0 2024-09-14T12:09:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.612+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5961661377017874480', time=2024-09-14T13:50:06.368195+0000, chain.objs.size()=1 2024-09-14T12:09:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.612+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NYhOUWAsuknbo_8zXp5N-HinM_B49Zv_0 2024-09-14T12:09:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.612+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16793486361590550785', time=2024-09-14T13:50:06.765620+0000, chain.objs.size()=1 2024-09-14T12:09:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.612+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.I4Or9h8psCCmFbbSM1QdUCP6_4tbV_o_0 2024-09-14T12:09:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10480205866204586929', time=2024-09-14T13:50:07.709082+0000, chain.objs.size()=1 2024-09-14T12:09:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SkvwG6cN2iQIRW9-OoKWTCNGsClf7WY_0 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16258434568534895564', time=2024-09-14T13:50:07.982557+0000, chain.objs.size()=1 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OfMsPATk5r9POmxQ5AUR_6v9E0p8_Fp_0 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7631449396565103758', time=2024-09-14T13:50:08.005290+0000, chain.objs.size()=1 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3dYgHNTPz9S-Emt75z-zVXHfkx5c_BK_0 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10130808740785345665', time=2024-09-14T13:50:08.048185+0000, chain.objs.size()=1 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Y2jIr1qDkPbiUzB6DNMRptJvRnyagUq_0 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13269042967180823449', time=2024-09-14T13:50:08.359845+0000, chain.objs.size()=1 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XAuytcxNAcEbzS7YoJV-bb63vMruyci_0 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14733943197658371701', time=2024-09-14T13:50:09.347314+0000, chain.objs.size()=1 2024-09-14T12:09:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.614+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZrK8nlW7c-u6ROWA2oJoyAaExJMUaF9_0 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7288086820434160822', time=2024-09-14T13:50:09.501568+0000, chain.objs.size()=1 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Wa5JeDSFds0nKRWvMtQqLX4jOp_XDOd_0 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.974423522354930645', time=2024-09-14T13:50:09.865804+0000, chain.objs.size()=1 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.d_mY6gvFMHGbNmMUb_KbJCiy--S_B6q_0 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3047802685959056096', time=2024-09-14T13:50:16.373295+0000, chain.objs.size()=1 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.273__shadow_.-1n6gZIWKI3NDTLfiiJIa0suk-Kt_RO_0 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4206680320117051118', time=2024-09-14T13:50:18.896779+0000, chain.objs.size()=1 2024-09-14T12:09:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.616+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.277__shadow_.4-U3qQLF-pE3ABQ2vDUnhy3Kfu3DNzK_0 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15457799304922521366', time=2024-09-14T13:50:31.676916+0000, chain.objs.size()=1 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_.MQkXty2GWRu6p5v1C23r8uLItRQWN4D_0 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5463573124124184884', time=2024-09-14T13:51:30.845387+0000, chain.objs.size()=1 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.0lIhKHlF6C6vyAM5HURvA3WHFv7kGNv_0 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4172683191051030561', time=2024-09-14T13:51:31.148485+0000, chain.objs.size()=1 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.riUmknm4uCVwRFeIoHnJcmyam4Gt_Tn_0 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16849393063379601708', time=2024-09-14T13:51:32.396083+0000, chain.objs.size()=1 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.640n89H0liHvhbZ_hjVIRQQZBHlt03Z_0 2024-09-14T12:09:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18289766890899466548', time=2024-09-14T13:51:32.561407+0000, chain.objs.size()=1 2024-09-14T12:09:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.617+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.US7JF8JDv00cefZAe-WaKCBWwCMVSrn_0 2024-09-14T12:09:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.619+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17641693287170754151', time=2024-09-14T13:51:32.593957+0000, chain.objs.size()=1 2024-09-14T12:09:54.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.619+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.55AjY6OJc2G6ZCPLD1hbiDAdRHInubV_0 2024-09-14T12:09:54.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.619+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9829105783644758601', time=2024-09-14T13:51:32.619497+0000, chain.objs.size()=1 2024-09-14T12:09:54.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.619+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.R1_bwN_Hp-VH9rJ0Rc1igjMDTpRPqEX_0 2024-09-14T12:09:54.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15280140191645717112', time=2024-09-14T13:51:32.730374+0000, chain.objs.size()=1 2024-09-14T12:09:54.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.LwKxB5QZQMSz8y95jfNR898V8DEmEDY_0 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11956708262087735593', time=2024-09-14T13:51:33.079883+0000, chain.objs.size()=1 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_._o4GGOUSgEwcH7gdrq6sadAsjU4nrHV_0 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17173916799160465180', time=2024-09-14T13:51:33.090104+0000, chain.objs.size()=1 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RnTb9d3n-i22zLHsfP0rrNEpPNHXAIi_0 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12449095661493517625', time=2024-09-14T13:51:33.310529+0000, chain.objs.size()=1 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.620+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.e12xKqMfKO9dDEhhMjRWi8jP7vpi1Tw_0 2024-09-14T12:09:54.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17069579748757417615', time=2024-09-14T13:51:33.325868+0000, chain.objs.size()=1 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.udxN-2VdTj-GpK3lavegRJ4bVF0bhdM_0 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.28331896168160516', time=2024-09-14T13:51:35.497337+0000, chain.objs.size()=1 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.mMJ22HiDCZL7kP9XaoeEJpORZ5NGnsq_0 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4314936649042094799', time=2024-09-14T13:51:36.280332+0000, chain.objs.size()=1 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Fiz4YTwpJlfjIil78kZJgr_VA3BfwQN_0 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13765738046335548889', time=2024-09-14T13:51:36.365180+0000, chain.objs.size()=1 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.621+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.z0giDvMNdEdt_Df9Fz9-htnne75WsIh_0 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.622+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15995237196469158406', time=2024-09-14T13:51:37.344375+0000, chain.objs.size()=1 2024-09-14T12:09:54.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.622+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.PtZ4Ft87FKzPSXDAlA7OtMFexEUc8uw_0 2024-09-14T12:09:54.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.623+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12641643079729328618', time=2024-09-14T13:51:37.559619+0000, chain.objs.size()=1 2024-09-14T12:09:54.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.623+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.lWB8pdkAzQT77-8k-9AZhqPJy6Bb9EP_0 2024-09-14T12:09:54.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.624+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6382943810197731901', time=2024-09-14T13:51:37.765860+0000, chain.objs.size()=1 2024-09-14T12:09:54.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.624+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.jyxU-FeCPU4H3EgK7tfTDiG-DeNVFpT_0 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.625+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3551940827736796605', time=2024-09-14T13:51:38.583190+0000, chain.objs.size()=1 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.625+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.AT2oAS8AMfni12-MM50CQ6OWKfNLgPV_0 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.625+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16393511468709195645', time=2024-09-14T13:51:38.898592+0000, chain.objs.size()=1 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.625+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1XeXEk9ea9-cUDbmzPJgH6FMturFze9_0 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.625+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1579959434960530465', time=2024-09-14T13:51:39.053982+0000, chain.objs.size()=1 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.625+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.BMzpITlbudqvDFWvbJDU7Wrh4RvOmD9_0 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.626+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4549971526217939052', time=2024-09-14T13:51:39.164674+0000, chain.objs.size()=1 2024-09-14T12:09:54.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.626+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.ZuMe5Uh2wP5RbattogkSeBRgBJbNnVl_0 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17768984022869613841', time=2024-09-14T13:51:39.306573+0000, chain.objs.size()=1 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kAUs4ZNHF7hwvwZx2gGuEScqcHMh3sK_0 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.899464250233215433', time=2024-09-14T13:51:39.327361+0000, chain.objs.size()=1 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.I6VmWpbXZuFSroo0qwIz6mZFHJFt0_x_0 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4710082743272080193', time=2024-09-14T13:51:40.347064+0000, chain.objs.size()=1 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.x4xp8nZ8D29xKz6HE9Rz4W8grFAKQSN_0 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15868204478654725760', time=2024-09-14T13:51:40.551347+0000, chain.objs.size()=1 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2Bl4mKwDQOF1BKeye8JnDMe9KIeXza7_0 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12939525839723836886', time=2024-09-14T13:51:41.415371+0000, chain.objs.size()=1 2024-09-14T12:09:54.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.RWw2BH5AhQp5nxFWVXdVWQSgGehH2dh_0 2024-09-14T12:09:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7082049360554414468', time=2024-09-14T13:51:41.523449+0000, chain.objs.size()=1 2024-09-14T12:09:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Yre_epDwcEgl8OAtpyGzJ6M_ygnpzab_0 2024-09-14T12:09:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.825105228110652316', time=2024-09-14T13:51:41.554050+0000, chain.objs.size()=1 2024-09-14T12:09:54.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.627+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.OyzD8CcXchpIkessVov9r9d1mg-0B9J_0 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12129825594457008', time=2024-09-14T13:52:21.240817+0000, chain.objs.size()=1 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AQmfXAYpg1a_4iiqojHKMhXEIG2oACl_0 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13582088620132260848', time=2024-09-14T13:52:21.635031+0000, chain.objs.size()=1 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.dgm4FxMkKZU9L8y5sn09KKUigK07dKN_0 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10554743163077272647', time=2024-09-14T13:52:21.635816+0000, chain.objs.size()=1 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5MmAurdKBy5Quz4hVXurqppkmDT05CS_0 2024-09-14T12:09:54.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11066955760528749726', time=2024-09-14T13:52:22.128841+0000, chain.objs.size()=1 2024-09-14T12:09:54.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.629+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.-yUAs4cyQsXmicduAwONdHx9hmsx2_X_0 2024-09-14T12:09:54.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.630+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2040197287987627249', time=2024-09-14T13:52:22.722639+0000, chain.objs.size()=1 2024-09-14T12:09:54.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.630+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5598JpqtX2HFPP6O0zKo7Nl-Q7ryK-F_0 2024-09-14T12:09:54.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.630+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3573765468964394468', time=2024-09-14T13:52:23.035210+0000, chain.objs.size()=1 2024-09-14T12:09:54.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.630+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WNL8yfI4DRIm5lK7nGanGkjrj8L8kTS_0 2024-09-14T12:09:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10416890249197224090', time=2024-09-14T13:52:24.810678+0000, chain.objs.size()=1 2024-09-14T12:09:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zaLjd6XoMl827bS-FAUBd6GICZasFgL_0 2024-09-14T12:09:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5964637078200762420', time=2024-09-14T13:52:25.121587+0000, chain.objs.size()=1 2024-09-14T12:09:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.6z1BH6uh_q4HWTkDXs7cFBAIcOjndMY_0 2024-09-14T12:09:54.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18238686855293869155', time=2024-09-14T13:52:25.742206+0000, chain.objs.size()=1 2024-09-14T12:09:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5vVP5FwOfGbKriEzjcHc5w2H0nXCl5P_0 2024-09-14T12:09:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1814169223134760817', time=2024-09-14T13:52:25.743150+0000, chain.objs.size()=1 2024-09-14T12:09:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.31CR5O6e03S2Flu5O-Q2_WG9GdbHh-j_0 2024-09-14T12:09:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18021850779580559087', time=2024-09-14T13:52:25.778125+0000, chain.objs.size()=1 2024-09-14T12:09:54.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.632+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tW29yoNxS_ru6MPs4aqwMcTaY28YwCU_0 2024-09-14T12:09:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.634+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7215219207311300699', time=2024-09-14T13:52:25.843679+0000, chain.objs.size()=1 2024-09-14T12:09:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.634+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AG7_Mc1ecgQkIfPddvjjhCML8c2LZOt_0 2024-09-14T12:09:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.634+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4135305045861573332', time=2024-09-14T13:52:26.248181+0000, chain.objs.size()=1 2024-09-14T12:09:54.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.634+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.xYUb9XiyIMbv_b3GIqYFR_G809w8Up-_0 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12599645272367617500', time=2024-09-14T13:52:26.554093+0000, chain.objs.size()=1 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DK9VrAWt8UHsgg0ZVfccg5CuA5ogxrs_0 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7254159613982889945', time=2024-09-14T13:52:27.478850+0000, chain.objs.size()=1 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Yhoeb76VJon7ZXA337yKYpEdxsznZGK_0 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3430403546401923455', time=2024-09-14T13:52:27.641635+0000, chain.objs.size()=1 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.Z9sX33kSPayjJJoHm6hPxG_JLlhllpH_0 2024-09-14T12:09:54.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14886458138669661681', time=2024-09-14T13:52:27.699275+0000, chain.objs.size()=1 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.5NoEje36uCmfkWCup0sn78-sBwjmT9s_0 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9030901928635407262', time=2024-09-14T13:52:28.033165+0000, chain.objs.size()=1 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.635+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.RxR78R8fRR_20Z_Lp46N-FlfDWsZM4T_0 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8188392725487467792', time=2024-09-14T13:52:28.058286+0000, chain.objs.size()=1 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DXSUTg2b1RhDPtUiMSpi524cfpldZin_0 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11900669935700919394', time=2024-09-14T13:52:28.669949+0000, chain.objs.size()=1 2024-09-14T12:09:54.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.d-NWVxO6rVa58orX_iavMQPPv04X1Jm_0 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14116500870372975434', time=2024-09-14T13:52:28.733948+0000, chain.objs.size()=1 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.T2NFEf0viix2fDM-KgtBMPvmvokYvE3_0 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16484618889815739988', time=2024-09-14T13:52:29.021136+0000, chain.objs.size()=1 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.636+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.u1WRIRXyjtiXBjEjVtlPqsbcnX2ERX1_0 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.637+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17663604846331669930', time=2024-09-14T13:52:29.441362+0000, chain.objs.size()=1 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.637+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.zPsz5b9ec98_bsTr1-q3gO6Guogv1bJ_0 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.637+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.991149804231746424', time=2024-09-14T13:52:29.575903+0000, chain.objs.size()=1 2024-09-14T12:09:54.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.638+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.SHmEg06eB3iH-fEtKL6uZOTE5e_aypd_0 2024-09-14T12:09:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.640+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9783288676792158041', time=2024-09-14T13:52:30.138986+0000, chain.objs.size()=1 2024-09-14T12:09:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.640+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.pD67dPOlPjySbG-FWep7VCAK4ZHPlti_0 2024-09-14T12:09:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.640+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14492742898221605588', time=2024-09-14T13:52:30.354840+0000, chain.objs.size()=1 2024-09-14T12:09:54.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.640+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.3hLfEsBQ1XegvUIYs1QgC-td6jL2Qtl_0 2024-09-14T12:09:54.642 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.643+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/50980 2024-09-14T12:09:54.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-14T12:09:54.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6328288347400205005', time=2024-09-14T13:52:30.667263+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qQTCxDFRmt0qU0kn6hcS6sFWzsCr6Tb_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6938009061926311220', time=2024-09-14T13:52:30.722091+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.80bvIVMz_zNJfT5hkjqEEE_hFJ6McaI_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12548652053762833538', time=2024-09-14T13:52:55.384456+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.371__shadow_.nVL_u2Lq0aWrAul-uCJ9GBAR_KbDonc_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5636925423094745095', time=2024-09-14T13:52:58.035546+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.374__shadow_.nL6-cFvxYncH9e777lXLIZmXrNAQIkp_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3167546495175491372', time=2024-09-14T13:53:43.211126+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.451__shadow_.GYNKB5VVYnKyAeLPygJYQjjFtFH1IEB_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9432029732905061725', time=2024-09-14T13:53:44.822739+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.454__shadow_.BEUKbsIe6pMHtbYRos6RaHplxNcGS1k_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5217254671824961386', time=2024-09-14T13:53:48.246978+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.458__shadow_.5Zc-N9iXebGefxtBE_O5u0u_QSS94OY_0 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4584917420984162233', time=2024-09-14T13:53:55.197233+0000, chain.objs.size()=1 2024-09-14T12:09:54.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.466__shadow_.euw9cNUIRvZBn8gUXIIame-fmfWnvIL_0 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6837663373045448363', time=2024-09-14T13:54:02.556113+0000, chain.objs.size()=1 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.kFK-KxPSnuqeJDrw3RKpuqTB3yW5udt_0 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9812346818958548615', time=2024-09-14T13:54:02.570399+0000, chain.objs.size()=1 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.483__shadow_.dmQ_QF2rNKi-4TnmSsJWDGlxEvmqvRt_0 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6275403013391175067', time=2024-09-14T13:54:03.279852+0000, chain.objs.size()=1 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.484__shadow_.smoHK6Cq0_54H99161DD_WJC6_lwsuK_0 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.915128500793436009', time=2024-09-14T13:57:18.556329+0000, chain.objs.size()=1 2024-09-14T12:09:54.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.646+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.550__shadow_.Vu5o-mDQAxZHS2RREs2cPPxLAMHQKEp_0 2024-09-14T12:09:54.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.649+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8402966201165863971', time=2024-09-14T13:57:23.848005+0000, chain.objs.size()=2 2024-09-14T12:09:54.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.649+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.552__shadow_.BYYBHHniPm_gcmfo-FsEJKY3NBKI-a3_0 2024-09-14T12:09:54.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.649+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.552__shadow_.BYYBHHniPm_gcmfo-FsEJKY3NBKI-a3_1 2024-09-14T12:09:54.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.649+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10230927589193324520', time=2024-09-14T13:57:57.469345+0000, chain.objs.size()=1 2024-09-14T12:09:54.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.649+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:kVAxzy5VxuyhcNlUOQ5EB1z9iyZk86m_.cVy2tO8Epk_cGpF2pg0atJk7qOznUb3_0 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18370052554707582455', time=2024-09-14T13:58:02.630438+0000, chain.objs.size()=1 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:42q1o5krr8frbBnopJlN4SZ-yso3dcT_.2Glmwh-nj9-CNrgat5-ms0hjrD3-sx6_0 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14637338924869469335', time=2024-09-14T13:58:05.322473+0000, chain.objs.size()=1 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.571__shadow_.PAtclxV3EtCSblDKcV-w98EjShfEmaH_0 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13490568657746160234', time=2024-09-14T13:58:39.358633+0000, chain.objs.size()=1 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:nH-h59Ok2oD4-MZVagVbZYJ2Jb2N9dq_.5I3JHST-qCpth_9bs-iTx8gJpVLVXSg_0 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.330485957253921566', time=2024-09-14T13:58:55.361864+0000, chain.objs.size()=1 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.579__shadow:-6uQFga1mnEX4modhibp6vcy1NoYrn5_.t3f2ByuS1gpNnuwpccl1ztUa667brhZ_0 2024-09-14T12:09:54.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10104805018578448199', time=2024-09-14T13:58:57.512964+0000, chain.objs.size()=1 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.650+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:c-m7kAVL0lEvJm4Wkfqx.yzdQRR1NIn_.GkqPwxTjFBqUkZFYZYqe6X0AmRhHm_T_0 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.651+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3807099749121392191', time=2024-09-14T13:59:01.220728+0000, chain.objs.size()=1 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.651+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.585__shadow:mOINfsvOOoLCL2Te8kH9d42xGpwgGQd_.4Sl6uI55Bn4uu8g4y8o-xOoVQq76mqG_0 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.651+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2054129010344782444', time=2024-09-14T14:03:04.993120+0000, chain.objs.size()=1 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.651+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.631__shadow_.JQIMqAJAxAJHq2EInMl6A9PAP8TRl_4_0 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.651+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2851546895220771729', time=2024-09-14T14:03:06.774539+0000, chain.objs.size()=1 2024-09-14T12:09:54.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.651+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.634__shadow_.jm5aGWr7KHwBFcpVjoUKYPQXGCcZ77f_0 2024-09-14T12:09:54.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.653+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1157969426151381368', time=2024-09-14T14:03:11.915895+0000, chain.objs.size()=2 2024-09-14T12:09:54.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.653+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.642__shadow_.FRI9wAFBWCDRvIGw8pvBI9upawYSWxi_0 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.642__shadow_.FRI9wAFBWCDRvIGw8pvBI9upawYSWxi_1 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8615754421062555454', time=2024-09-14T14:03:27.225108+0000, chain.objs.size()=1 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.654__shadow_.vYMhdFHHhkKBArx6uWDBEKj8fiTL3FQ_0 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13508355766191817083', time=2024-09-14T14:03:49.770013+0000, chain.objs.size()=6 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.661__multipart_baz.2~bMHSG8p9tKT3b1GG3jEhDjPkc5UuW47.1 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.661__multipart_baz.2~bMHSG8p9tKT3b1GG3jEhDjPkc5UuW47.2 2024-09-14T12:09:54.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.661__multipart_baz.2~bMHSG8p9tKT3b1GG3jEhDjPkc5UuW47.3 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.661__multipart_baz.2~bMHSG8p9tKT3b1GG3jEhDjPkc5UuW47.4 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.661__multipart_baz.2~bMHSG8p9tKT3b1GG3jEhDjPkc5UuW47.5 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.661__multipart_baz.2~bMHSG8p9tKT3b1GG3jEhDjPkc5UuW47.6 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4840581481720363804', time=2024-09-14T14:04:07.195458+0000, chain.objs.size()=1 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.693__shadow:Vhry6raT7Wov7a2LyAV3wwLJgVLHBnV_.Q8rMEYxZ2X-10wASzQtGMRORTRReq0v_0 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17432392975232513803', time=2024-09-14T14:04:15.552990+0000, chain.objs.size()=1 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.706__shadow_.-mCi2Cc8NtwD0sWRcp33uzeNbKhpDb__0 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6463111335710910566', time=2024-09-14T14:04:42.341558+0000, chain.objs.size()=1 2024-09-14T12:09:54.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.656+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.719__shadow_.Wa_EjhHCeWquqfeT_a0ME9EAync8vf-_0 2024-09-14T12:09:54.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.660+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15194363603256493462', time=2024-09-14T14:05:07.159548+0000, chain.objs.size()=1 2024-09-14T12:09:54.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.660+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.744__shadow_.qPy6H9syur28zBUndxhDkWzsXBU73Xj_0 2024-09-14T12:09:54.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.662+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.664+0000 7f043792c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T12:09:54.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.666+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T12:09:54.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.666+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T12:09:54.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47353' 2024-09-14T12:09:54.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='_sgaF3MFd3FWtZNX1av8mT14ZbWwtVcD', time=2024-09-14T13:47:01.590028+0000, chain.objs.size()=2 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.165__shadow_.GfvI5EKBofgUX-flfUC80LWJPUcsCy0_0 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.165__shadow_.GfvI5EKBofgUX-flfUC80LWJPUcsCy0_1 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15379657218084229082', time=2024-09-14T13:49:01.129104+0000, chain.objs.size()=1 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.231__shadow_.qQr3kPWUBLtjeFcNB_iBxccLbdrQyiT_0 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8408431935566658024', time=2024-09-14T13:49:05.266693+0000, chain.objs.size()=1 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.237__shadow_.0GfoWZLrI3v1Qi3TU99UxQASGioMzXC_0 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5939392194606486999', time=2024-09-14T13:49:59.707652+0000, chain.objs.size()=1 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qfYtlTzmEvp4xGzImDjX0zbVfh2_3hp_0 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12350795956424375000', time=2024-09-14T13:49:59.750825+0000, chain.objs.size()=1 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.h5JeQK4flGukH4emvCDS0Oj7erV50bi_0 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8269303713510008216', time=2024-09-14T13:49:59.761727+0000, chain.objs.size()=1 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.hfKPVII5z3FsnSnylrk3hlCyFgNsXeY_0 2024-09-14T12:09:54.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17726334831375464245', time=2024-09-14T13:49:59.786717+0000, chain.objs.size()=1 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.XN-uXulE_E-Ukge6Oq5cJKPH95zvBbQ_0 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4178443227503922352', time=2024-09-14T13:50:00.487201+0000, chain.objs.size()=1 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.64IADi8GIRabLyUOiPqJ-aBP_j3OlmG_0 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1192761817585207303', time=2024-09-14T13:50:00.488241+0000, chain.objs.size()=1 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.vdNRhs9Rq57LZCn7Mf4VSu_klLIK_c8_0 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1080939727367789878', time=2024-09-14T13:50:01.219311+0000, chain.objs.size()=1 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.3xq0bKkg5zJcsfjWqOTDTenYIxk72IK_0 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14328878417315521562', time=2024-09-14T13:50:02.163487+0000, chain.objs.size()=1 2024-09-14T12:09:54.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.667+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.TUQFxexCvTalG1gWEH5xzu1WHeABslh_0 2024-09-14T12:09:54.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7212814563006406772', time=2024-09-14T13:50:02.251038+0000, chain.objs.size()=1 2024-09-14T12:09:54.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.ZFq7FeGSn2WP3IhYtVQaK92ic44Rtgg_0 2024-09-14T12:09:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2834951713951610694', time=2024-09-14T13:50:02.772665+0000, chain.objs.size()=1 2024-09-14T12:09:54.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.9uzlSOkHq3taslt4NiJ3Iwik9dyJQ4U_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15785088312611867408', time=2024-09-14T13:50:02.994124+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.pMmG1uTySus1KMvBlcP0MQJZX01hvDC_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7083018810978963582', time=2024-09-14T13:50:03.705158+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Pi1Rb16qQtRhitf4PWLUx5GNjmHsUPV_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9602159853475724568', time=2024-09-14T13:50:04.016236+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.YYibIfV8Sgq2qgVVaJwAolL8iL4a0Gv_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6110657073744086343', time=2024-09-14T13:50:04.016825+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.cdwoO02_jxUh1L4uPJT2xlymOF0nIfc_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2459054445825721966', time=2024-09-14T13:50:04.088286+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.r7zAYsUe91nIkmppDCKOKibqsQt8wkR_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8654963522990840866', time=2024-09-14T13:50:05.319918+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.S_MQGX0XURJkTV1BriKLrrMkeWmB-7m_0 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3923842982657209234', time=2024-09-14T13:50:05.430553+0000, chain.objs.size()=1 2024-09-14T12:09:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.n9W54jPb96AmzppvV-lttFklyZHXXhw_0 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10433399942768335295', time=2024-09-14T13:50:05.590274+0000, chain.objs.size()=1 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.T75aYl_hXZhPY_pK1nsdQRyvRrD-lkn_0 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17329008706355499166', time=2024-09-14T13:50:05.605907+0000, chain.objs.size()=1 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.671+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.SL3nP5qjHFRFIsAymXAA32POo0vGAqb_0 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.674+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9876932315261350715', time=2024-09-14T13:50:06.224117+0000, chain.objs.size()=1 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.674+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.oSjjBt1bJtXZQwmKPOX3g83XAhKt5w0_0 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12563446991844628390', time=2024-09-14T13:50:06.988040+0000, chain.objs.size()=1 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.Zgeu6CWsK3KzSeIwCf9bkr35XPBUt9W_0 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4087220223627979837', time=2024-09-14T13:50:07.556871+0000, chain.objs.size()=1 2024-09-14T12:09:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.qabmYq4N4Aa6QO_xPEDcTPOJ9OAwuIO_0 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3540068891176773073', time=2024-09-14T13:50:07.708718+0000, chain.objs.size()=1 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.NvbVmJetYPtCYQY4DE_-QhyDmQ6g_fp_0 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.63563165827098314', time=2024-09-14T13:50:08.575192+0000, chain.objs.size()=1 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.EL2CcK_i76c9D2rEzI79_0BpURwmLrT_0 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14182882501694777128', time=2024-09-14T13:50:08.920406+0000, chain.objs.size()=1 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.OXVdyASvaEJhtbhpaKUceBAm8HEpZxH_0 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3935126620058101616', time=2024-09-14T13:50:08.921063+0000, chain.objs.size()=1 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.iwq4yERs0gTbjUMOO6dXAuW5fXFEA0A_0 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8239745575255630205', time=2024-09-14T13:50:08.921776+0000, chain.objs.size()=1 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.xP2M01SxyUl55Xj5WPVERRjcxrNm5s1_0 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3010297374382774019', time=2024-09-14T13:50:08.922726+0000, chain.objs.size()=1 2024-09-14T12:09:54.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.6A5rKX4zlDqedMCHIgkUd0x8ThVAtQz_0 2024-09-14T12:09:54.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6623121171416149223', time=2024-09-14T13:50:09.187120+0000, chain.objs.size()=1 2024-09-14T12:09:54.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.zybm83uKN7DtqHloE0YDQ64IvJORF0I_0 2024-09-14T12:09:54.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8152719092210182912', time=2024-09-14T13:50:09.202056+0000, chain.objs.size()=1 2024-09-14T12:09:54.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.5WZAF4iwP3XHow2NkC2GCvaNghIfGKg_0 2024-09-14T12:09:54.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13657260140461265121', time=2024-09-14T13:50:09.456073+0000, chain.objs.size()=1 2024-09-14T12:09:54.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.769+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.90FrhEmVYrdo5IEHSw4xuSjkI-fwUmg_0 2024-09-14T12:09:54.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8605766780857628525', time=2024-09-14T13:50:09.609252+0000, chain.objs.size()=1 2024-09-14T12:09:54.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.kP5cmVhNeS3GlF6I1qLkDl6oiKeWWiS_0 2024-09-14T12:09:54.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.773+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6224440246342814645', time=2024-09-14T13:50:09.883270+0000, chain.objs.size()=1 2024-09-14T12:09:54.772 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.773+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.262__shadow_.BsVUF6aR01gok1xwsGSbMEUEYKbdl_5_0 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9524150817175498352', time=2024-09-14T13:50:15.209000+0000, chain.objs.size()=1 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.271__shadow_.4wzEy9bCPmZoYeVv-F0HcvFL-UiywtO_0 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13059564474982480432', time=2024-09-14T13:50:22.632039+0000, chain.objs.size()=1 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.283__shadow_.EgyNfHrZSVmW0TBxqo_HBVNn58mAL8h_0 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15957392929863859362', time=2024-09-14T13:50:27.175057+0000, chain.objs.size()=1 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.290__shadow_.dbXv_FbxOFcGN7CcHhDM9DECplbCy2r_0 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14563122277731956018', time=2024-09-14T13:50:29.854809+0000, chain.objs.size()=1 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.292__shadow_.rVj-qSdvRkAZ5cvNhf67m54Bdqf9AXZ_0 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16981966575030661663', time=2024-09-14T13:50:31.657662+0000, chain.objs.size()=1 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.293__shadow_._8dcEGu40GzN9Yiw3UU_CBvRjh4Wgqm_0 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.779+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10306641243864221802', time=2024-09-14T13:50:35.804606+0000, chain.objs.size()=1 2024-09-14T12:09:54.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.299__shadow_.vfBn4i-RRYrUhCUT6dATn7EH7LRW1y7_0 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3771431458825234375', time=2024-09-14T13:50:37.708332+0000, chain.objs.size()=1 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.302__shadow_.JnGr0m1scmXbrLMAS-e9IAsUfg7HZ6z_0 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.17958205540581148019', time=2024-09-14T13:50:50.601213+0000, chain.objs.size()=1 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.321__shadow_.NOe5W2LfgxP3XIDxUAT3r3KSbgOSBvE_0 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14714986296323388109', time=2024-09-14T13:51:30.693840+0000, chain.objs.size()=1 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.YO-Ai--fsiBTcLMIuohg_h3nmNLQhIy_0 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7604060006133325371', time=2024-09-14T13:51:30.840410+0000, chain.objs.size()=1 2024-09-14T12:09:54.780 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.780+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.5LIuKA4hZe1DtUYpAV0hsPa1KISzl6k_0 2024-09-14T12:09:54.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.782+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13470895861365113238', time=2024-09-14T13:51:31.553134+0000, chain.objs.size()=1 2024-09-14T12:09:54.781 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.782+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.kwlVAjUDVfDW0ipS9Dh6KymRVXdT0DL_0 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5366193324496640210', time=2024-09-14T13:51:31.737625+0000, chain.objs.size()=1 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.f-n8Gypz3Kaf3CjcSsE2YHZSi8BlgNV_0 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15604266906132798144', time=2024-09-14T13:51:33.339864+0000, chain.objs.size()=1 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.GWciVRzFawODnXAA5A7Cqigz531Kksy_0 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.287111015834129749', time=2024-09-14T13:51:34.410872+0000, chain.objs.size()=1 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.v1az-aYHyzPcl9PX1sa6Yi7ICejg7jF_0 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2511750327344771438', time=2024-09-14T13:51:34.442796+0000, chain.objs.size()=1 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yOsCbgfcWWojdvnO430WDTaErf7_Jyj_0 2024-09-14T12:09:54.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6787436754119923588', time=2024-09-14T13:51:35.613038+0000, chain.objs.size()=1 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Kzj4GmQZLSd4o0PXMD_P0Qwf9GfwjQX_0 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.18325859447827654015', time=2024-09-14T13:51:35.947978+0000, chain.objs.size()=1 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.783+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.-hrvvbE9IjntbU2xkGp0-di5JFdbIuj_0 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15256585771015633708', time=2024-09-14T13:51:36.094963+0000, chain.objs.size()=1 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.a8UQOwrqK_yk8GJkKupjADvLyUkhz2L_0 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.5034393874360579406', time=2024-09-14T13:51:37.063092+0000, chain.objs.size()=1 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.P2igEVNitfThYRzp1uIXCGDRgdEaUPS_0 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4828306540930295774', time=2024-09-14T13:51:37.268042+0000, chain.objs.size()=1 2024-09-14T12:09:54.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.1avvlNfsR1pTJ67em6bcLqBicuC3Ibq_0 2024-09-14T12:09:54.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16462980353124916364', time=2024-09-14T13:51:37.653322+0000, chain.objs.size()=1 2024-09-14T12:09:54.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.784+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.MjwFqgbOlb47fVYtNkxTPD8bSNY-LO3_0 2024-09-14T12:09:54.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.786+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3934078309121900630', time=2024-09-14T13:51:39.148910+0000, chain.objs.size()=1 2024-09-14T12:09:54.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.786+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.R38CST9OEg1rg4g4v09UdJFSdFuJeQm_0 2024-09-14T12:09:54.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.788+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4141931899397381267', time=2024-09-14T13:51:39.308039+0000, chain.objs.size()=1 2024-09-14T12:09:54.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.788+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2VlPQBT9829Ouyf1Lwco6c6BzHwhdbr_0 2024-09-14T12:09:54.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.788+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10675607797877705360', time=2024-09-14T13:51:39.847635+0000, chain.objs.size()=1 2024-09-14T12:09:54.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.788+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.yOgJVK-DxcP11BEKMh01pg4ThDR83Dk_0 2024-09-14T12:09:54.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.788+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8536608987652547098', time=2024-09-14T13:51:39.848399+0000, chain.objs.size()=1 2024-09-14T12:09:54.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.788+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.Esyi0gRIXyg9pm0CJHYCKuo95Ypfq7Z_0 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9032331152464475929', time=2024-09-14T13:51:40.257156+0000, chain.objs.size()=1 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.s6yn9MBpzlu_bVmu5fdUQpSrRL7bR4g_0 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14137083386600971802', time=2024-09-14T13:51:40.708981+0000, chain.objs.size()=1 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.bcjwaK5yb7qtzgHu-QrwGCB4oG5QjLy_0 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13845121034098201265', time=2024-09-14T13:51:40.757805+0000, chain.objs.size()=1 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.hL07GhqNR1KzKHDH3XAtaRoSvffHyZa_0 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13250704256063776314', time=2024-09-14T13:51:41.532083+0000, chain.objs.size()=1 2024-09-14T12:09:54.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.52dPGY3xVpLobVaPELpfW17mf3SEGtU_0 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13689144326651457712', time=2024-09-14T13:51:41.755474+0000, chain.objs.size()=1 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.323__shadow_.2GJRa6UX2N087FVoGma0dS2HXhZmFmp_0 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11704691964948755990', time=2024-09-14T13:52:21.238476+0000, chain.objs.size()=1 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.m-idPfUwd-CByh_PiEJEw4pBXOqPUbK_0 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4535945696095915685', time=2024-09-14T13:52:21.759689+0000, chain.objs.size()=1 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.iF9-xo515hN5MgdcC92alvKkeveNoVL_0 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.1027184526825217342', time=2024-09-14T13:52:21.969489+0000, chain.objs.size()=1 2024-09-14T12:09:54.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.789+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.jQy0PWmINMhOX1oG_uXIMp433S3TtFB_0 2024-09-14T12:09:54.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.792+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.179008855966623744', time=2024-09-14T13:52:22.130027+0000, chain.objs.size()=1 2024-09-14T12:09:54.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.792+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.siur6TuGTUM132HYp4l-DQkpQMKyLtN_0 2024-09-14T12:09:54.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.792+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10795883772738930819', time=2024-09-14T13:52:22.694654+0000, chain.objs.size()=1 2024-09-14T12:09:54.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.792+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.PrqZDyvTPzurnowKMRi4z2UPs6vv-yI_0 2024-09-14T12:09:54.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.792+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6495530966779085071', time=2024-09-14T13:52:22.916394+0000, chain.objs.size()=1 2024-09-14T12:09:54.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.792+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.WteEzTUp7aZvgduzp45FHyYFtAWpPdo_0 2024-09-14T12:09:54.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.794+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4588661199326621024', time=2024-09-14T13:52:23.026359+0000, chain.objs.size()=1 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.794+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UTP9aOVqarS1oDefeJmiC0LB9ni63wP_0 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6770350074422067637', time=2024-09-14T13:52:23.493008+0000, chain.objs.size()=1 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.FVIEwjzpQCg3g9WMkUS71l9ndBHoq-R_0 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8067831302718495508', time=2024-09-14T13:52:24.245972+0000, chain.objs.size()=1 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.JfK029pwTRdqB_OzxMYc1W1z7NEXf2i_0 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.2847202287054038533', time=2024-09-14T13:52:26.014015+0000, chain.objs.size()=1 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.mmvd_NxNhnbG7CJBnk4yDYv3yhsP3tU_0 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12263430426007391261', time=2024-09-14T13:52:26.325104+0000, chain.objs.size()=1 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cviLten_Ks_MpcshjWj2kK7XqmjDGD3_0 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15633073702698652339', time=2024-09-14T13:52:27.339274+0000, chain.objs.size()=1 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ls5X6GCt6GidlpVfvKZnQjIE_zZedO7_0 2024-09-14T12:09:54.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.6612724455997397165', time=2024-09-14T13:52:27.754284+0000, chain.objs.size()=1 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.tybujVLq9uDYhwcPe-AfpZ2bCE2wzuE_0 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.4531727586443383260', time=2024-09-14T13:52:28.203482+0000, chain.objs.size()=1 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.isPi2a0PEVLIERKD1Qtu_mXHz74PvKI_0 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16585542022240927274', time=2024-09-14T13:52:28.963617+0000, chain.objs.size()=1 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.AiIEBQ9CyCAv_-s0VUbwylDigP3ejIC_0 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8178852113271855055', time=2024-09-14T13:52:29.035848+0000, chain.objs.size()=1 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.ykxpJ55LngREqAJ1LgzLwx0815z32Ug_0 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16903136787679753412', time=2024-09-14T13:52:29.612008+0000, chain.objs.size()=1 2024-09-14T12:09:54.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.795+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KDP_UdumWrnKfs8QecaSk3rf8MrVujp_0 2024-09-14T12:09:54.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.797+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12266455085905606695', time=2024-09-14T13:52:29.675257+0000, chain.objs.size()=1 2024-09-14T12:09:54.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.797+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.rXynv2-DtiV1hzjyLu2DnGJXtQ3cj4I_0 2024-09-14T12:09:54.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16520036994161606045', time=2024-09-14T13:52:30.512681+0000, chain.objs.size()=1 2024-09-14T12:09:54.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.cU3JtjYVTFd2LBlbMwejj9teV0Kvzq6_0 2024-09-14T12:09:54.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.798+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.496669143791771365', time=2024-09-14T13:52:30.872446+0000, chain.objs.size()=1 2024-09-14T12:09:54.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.798+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.DfHeSau3vZLK7EKdNSE1yZFFX4h2q2H_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.177624806957084385', time=2024-09-14T13:52:30.958402+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.qwMT6AE9hz7w1TTXYitW5JnNo7rgN1Y_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9108223131278006231', time=2024-09-14T13:52:31.078947+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.LB-pMS8HcSWhepyISC7QmI0Fa0xqDeN_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13565935445996371697', time=2024-09-14T13:52:31.408820+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.XHR2AbPQI6C7MYnrURglHC7SASL-8dR_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13530301446987447385', time=2024-09-14T13:52:31.494294+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.UXzh6gsWqvY_vZUpq0O4L7aDMujh--g_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.16940742250087161597', time=2024-09-14T13:52:31.774521+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.324__shadow_.KRUAXUQt8uXgD6jmnfABCZQSCYYQQXB_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15535734980459789455', time=2024-09-14T13:53:39.146301+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.444__shadow_.KkqWyyob0-KsF4MlHuO1dus5ih7SP20_0 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.3310080633623296775', time=2024-09-14T13:53:54.328003+0000, chain.objs.size()=1 2024-09-14T12:09:54.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.465__shadow_.NO8YygMUTp0W5PYVj7z0D3YUsc95A56_0 2024-09-14T12:09:54.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.14574473095389519599', time=2024-09-14T13:54:13.902726+0000, chain.objs.size()=1 2024-09-14T12:09:54.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.799+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.497__shadow_.nrS8YxrQXSHpfP_JP2C_SUA0zoxt79c_0 2024-09-14T12:09:54.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.801+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11989205727162328630', time=2024-09-14T13:54:17.598611+0000, chain.objs.size()=1 2024-09-14T12:09:54.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.801+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.503__shadow:cl2ARxfpauRoDIjBPT2zPE7hlSXN4gW_.mVyB_4O5KFCXr9CJf6BJq8M6WMccC9-_0 2024-09-14T12:09:54.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.15621075003481889123', time=2024-09-14T13:54:27.148709+0000, chain.objs.size()=6 2024-09-14T12:09:54.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.1 2024-09-14T12:09:54.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.2 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.3 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.4 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.5 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.507__multipart_srcmultipart.2~lOYDXbAf76R4JmlrCdAQdDB0BrDJeUj.6 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.11404123281040003049', time=2024-09-14T13:54:28.266147+0000, chain.objs.size()=1 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.511__multipart_mymultipart.2~HMzC4X348fCjUZ62a45e0wq7hgbOXyW.1 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='2~_BVUhxvBx7QyZ-CZlQJAhYdEy5eaC5q', time=2024-09-14T13:56:38.918647+0000, chain.objs.size()=1 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.533__multipart_mymultipart.2~_BVUhxvBx7QyZ-CZlQJAhYdEy5eaC5q.1 2024-09-14T12:09:54.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.747122432118444501', time=2024-09-14T13:57:40.783447+0000, chain.objs.size()=1 2024-09-14T12:09:54.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.559__shadow_.RH-2HWSW3puQ8OnCPP1PAoNTB8ruT1F_0 2024-09-14T12:09:54.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7857620487095640443', time=2024-09-14T13:58:03.011296+0000, chain.objs.size()=1 2024-09-14T12:09:54.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.803+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.569__shadow:gFOxo2HrQlhymuk.XXnjx3vZp91hRq0_.Sk7a7WWnVEJTBz57cpSCRCwMjHiGD9u_0 2024-09-14T12:09:54.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.808+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 0/47353 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.13923866910016408994', time=2024-09-14T13:58:30.145051+0000, chain.objs.size()=1 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:dEccsWhYKabBaDRkqEW0ntyzYXAOOHY_.EEEODvwxe3GEiKJ--NbrD82gh_phyaq_0 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.10561845696553421894', time=2024-09-14T13:58:39.806020+0000, chain.objs.size()=1 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.577__shadow:L1ZVYcKNGFfRllUnS.3NKNxZbi6ZVr5_.BEU8PS7cOAPaBsttWq1YCrNTuviGzbL_0 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.9592414154966833525', time=2024-09-14T13:58:57.538953+0000, chain.objs.size()=1 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.580__shadow:2a8-IHwbJ8WEXiLba2va5f4RcmBSvJE_.0C-z9Dlr_sE1OxrycfrjQVB9PlHu28T_0 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.8950959355942197606', time=2024-09-14T14:03:20.884409+0000, chain.objs.size()=1 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.648__shadow_.TpUynzF6sYDNqRwpi9oxtK3vvGksA8Q_0 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.7651322088730817353', time=2024-09-14T14:03:56.532601+0000, chain.objs.size()=1 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.672__shadow_.SXBHqtb8h_4AbtDz1ZD54Qnu0rJq8Ng_0 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 20 garbage collection: RGWGC::process iterating over entry tag='ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.12623647796884758855', time=2024-09-14T14:07:18.762642+0000, chain.objs.size()=1 2024-09-14T12:09:54.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.810+0000 7f043792c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ee44e0ea-0921-4c74-bba9-e7ba41eeb320.4493.778__shadow_.FdAKGlnSvGwUmHBhkYUJAGIG6syNiuh_0 2024-09-14T12:09:54.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.813+0000 7f043792c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T12:09:54.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.816+0000 7f02e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T12:09:54.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.818+0000 7f043792c800 20 remove_watcher() i=0 2024-09-14T12:09:54.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.818+0000 7f043792c800 2 removed watcher, disabling cache 2024-09-14T12:09:54.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.819+0000 7f043792c800 20 remove_watcher() i=1 2024-09-14T12:09:54.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.820+0000 7f043792c800 20 remove_watcher() i=2 2024-09-14T12:09:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.821+0000 7f043792c800 20 remove_watcher() i=3 2024-09-14T12:09:54.820 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.822+0000 7f043792c800 20 remove_watcher() i=4 2024-09-14T12:09:54.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.823+0000 7f043792c800 20 remove_watcher() i=5 2024-09-14T12:09:54.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.824+0000 7f043792c800 20 remove_watcher() i=6 2024-09-14T12:09:54.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-09-14T12:09:54.825+0000 7f043792c800 20 remove_watcher() i=7 2024-09-14T12:09:54.836 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T12:09:54.846 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T12:09:54.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T12:09:54.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:09:55.221 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:09:55.233 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:09:55.235 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2035,"stamp":"2024-09-14T12:09:54.842626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292092642,"num_objects":2046,"num_object_clones":0,"num_object_copies":5796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2046,"num_whiteouts":0,"num_read":198051,"num_read_kb":2632166,"num_write":146214,"num_write_kb":2509925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14174,"ondisk_log_size":14174,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2242112,"kb_used_data":736128,"kb_used_omap":12,"kb_used_meta":1505459,"kb_avail":752732608,"statfs":{"total":773094113280,"available":770798190592,"internally_reserved":0,"allocated":753795072,"data_stored":736871533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1541590577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-436662693,"num_objects":-2668,"num_object_clones":0,"num_object_copies":-7978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2668,"num_whiteouts":0,"num_read":2983,"num_read_kb":2737,"num_write":2834,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005006"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.714132+0000","last_change":"2024-09-14T11:44:25.351991+0000","last_active":"2024-09-14T12:06:54.714132+0000","last_peered":"2024-09-14T12:06:54.714132+0000","last_clean":"2024-09-14T12:06:54.714132+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:06:54.714132+0000","last_undegraded":"2024-09-14T12:06:54.714132+0000","last_fullsized":"2024-09-14T12:06:54.714132+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:51.739360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.707626+0000","last_change":"2024-09-14T11:28:36.255342+0000","last_active":"2024-09-14T12:06:09.707626+0000","last_peered":"2024-09-14T12:06:09.707626+0000","last_clean":"2024-09-14T12:06:09.707626+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:06:09.707626+0000","last_undegraded":"2024-09-14T12:06:09.707626+0000","last_fullsized":"2024-09-14T12:06:09.707626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.129757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.673633+0000","last_change":"2024-09-14T11:28:33.234582+0000","last_active":"2024-09-14T12:06:04.673633+0000","last_peered":"2024-09-14T12:06:04.673633+0000","last_clean":"2024-09-14T12:06:04.673633+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:06:04.673633+0000","last_undegraded":"2024-09-14T12:06:04.673633+0000","last_fullsized":"2024-09-14T12:06:04.673633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.203877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.569061+0000","last_change":"2024-09-14T11:25:27.952561+0000","last_active":"2024-09-14T12:07:10.569061+0000","last_peered":"2024-09-14T12:07:10.569061+0000","last_clean":"2024-09-14T12:07:10.569061+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:07:10.569061+0000","last_undegraded":"2024-09-14T12:07:10.569061+0000","last_fullsized":"2024-09-14T12:07:10.569061+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:17.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.651197+0000","last_change":"2024-09-14T11:44:25.353765+0000","last_active":"2024-09-14T12:06:54.651197+0000","last_peered":"2024-09-14T12:06:54.651197+0000","last_clean":"2024-09-14T12:06:54.651197+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:06:54.651197+0000","last_undegraded":"2024-09-14T12:06:54.651197+0000","last_fullsized":"2024-09-14T12:06:54.651197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:11.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593518+0000","last_change":"2024-09-14T11:28:36.260521+0000","last_active":"2024-09-14T12:08:39.593518+0000","last_peered":"2024-09-14T12:08:39.593518+0000","last_clean":"2024-09-14T12:08:39.593518+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:08:39.593518+0000","last_undegraded":"2024-09-14T12:08:39.593518+0000","last_fullsized":"2024-09-14T12:08:39.593518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:16.049764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663945+0000","last_change":"2024-09-14T11:28:33.226443+0000","last_active":"2024-09-14T12:06:05.663945+0000","last_peered":"2024-09-14T12:06:05.663945+0000","last_clean":"2024-09-14T12:06:05.663945+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:06:05.663945+0000","last_undegraded":"2024-09-14T12:06:05.663945+0000","last_fullsized":"2024-09-14T12:06:05.663945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:38.075764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.657263+0000","last_change":"2024-09-14T11:25:27.951069+0000","last_active":"2024-09-14T12:07:34.657263+0000","last_peered":"2024-09-14T12:07:34.657263+0000","last_clean":"2024-09-14T12:07:34.657263+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:07:34.657263+0000","last_undegraded":"2024-09-14T12:07:34.657263+0000","last_fullsized":"2024-09-14T12:07:34.657263+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:28.986404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.578394+0000","last_change":"2024-09-14T11:44:25.347621+0000","last_active":"2024-09-14T12:06:10.578394+0000","last_peered":"2024-09-14T12:06:10.578394+0000","last_clean":"2024-09-14T12:06:10.578394+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:06:10.578394+0000","last_undegraded":"2024-09-14T12:06:10.578394+0000","last_fullsized":"2024-09-14T12:06:10.578394+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:39.883404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'11","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561213+0000","last_change":"2024-09-14T11:28:36.367262+0000","last_active":"2024-09-14T12:06:05.561213+0000","last_peered":"2024-09-14T12:06:05.561213+0000","last_clean":"2024-09-14T12:06:05.561213+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:06:05.561213+0000","last_undegraded":"2024-09-14T12:06:05.561213+0000","last_fullsized":"2024-09-14T12:06:05.561213+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:03.310942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":33792,"num_write":21,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.649550+0000","last_change":"2024-09-14T11:28:33.226810+0000","last_active":"2024-09-14T12:06:39.649550+0000","last_peered":"2024-09-14T12:06:39.649550+0000","last_clean":"2024-09-14T12:06:39.649550+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:06:39.649550+0000","last_undegraded":"2024-09-14T12:06:39.649550+0000","last_fullsized":"2024-09-14T12:06:39.649550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.798886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.557251+0000","last_change":"2024-09-14T11:25:27.940069+0000","last_active":"2024-09-14T12:05:30.557251+0000","last_peered":"2024-09-14T12:05:30.557251+0000","last_clean":"2024-09-14T12:05:30.557251+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:05:30.557251+0000","last_undegraded":"2024-09-14T12:05:30.557251+0000","last_fullsized":"2024-09-14T12:05:30.557251+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:45.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:19.675494+0000","last_change":"2024-09-14T11:44:25.356282+0000","last_active":"2024-09-14T12:06:19.675494+0000","last_peered":"2024-09-14T12:06:19.675494+0000","last_clean":"2024-09-14T12:06:19.675494+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:06:19.675494+0000","last_undegraded":"2024-09-14T12:06:19.675494+0000","last_fullsized":"2024-09-14T12:06:19.675494+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:56.126294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.127142+0000","last_change":"2024-09-14T11:28:36.366276+0000","last_active":"2024-09-14T12:09:53.127142+0000","last_peered":"2024-09-14T12:09:53.127142+0000","last_clean":"2024-09-14T12:09:53.127142+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:09:53.127142+0000","last_undegraded":"2024-09-14T12:09:53.127142+0000","last_fullsized":"2024-09-14T12:09:53.127142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:40.126728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589312+0000","last_change":"2024-09-14T11:28:33.228558+0000","last_active":"2024-09-14T12:08:09.589312+0000","last_peered":"2024-09-14T12:08:09.589312+0000","last_clean":"2024-09-14T12:08:09.589312+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:08:09.589312+0000","last_undegraded":"2024-09-14T12:08:09.589312+0000","last_fullsized":"2024-09-14T12:08:09.589312+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669719+0000","last_change":"2024-09-14T11:25:27.953674+0000","last_active":"2024-09-14T12:05:29.669719+0000","last_peered":"2024-09-14T12:05:29.669719+0000","last_clean":"2024-09-14T12:05:29.669719+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:05:29.669719+0000","last_undegraded":"2024-09-14T12:05:29.669719+0000","last_fullsized":"2024-09-14T12:05:29.669719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:04.652722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677327+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:06:34.677327+0000","last_peered":"2024-09-14T12:06:34.677327+0000","last_clean":"2024-09-14T12:06:34.677327+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:06:34.677327+0000","last_undegraded":"2024-09-14T12:06:34.677327+0000","last_fullsized":"2024-09-14T12:06:34.677327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.317315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:49.741974+0000","last_change":"2024-09-14T11:28:36.259291+0000","last_active":"2024-09-14T12:09:49.741974+0000","last_peered":"2024-09-14T12:09:49.741974+0000","last_clean":"2024-09-14T12:09:49.741974+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:09:49.741974+0000","last_undegraded":"2024-09-14T12:09:49.741974+0000","last_fullsized":"2024-09-14T12:09:49.741974+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:04.701036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569572+0000","last_change":"2024-09-14T11:28:33.231526+0000","last_active":"2024-09-14T12:07:15.569572+0000","last_peered":"2024-09-14T12:07:15.569572+0000","last_clean":"2024-09-14T12:07:15.569572+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:07:15.569572+0000","last_undegraded":"2024-09-14T12:07:15.569572+0000","last_fullsized":"2024-09-14T12:07:15.569572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:57.361260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669669+0000","last_change":"2024-09-14T11:25:27.952436+0000","last_active":"2024-09-14T12:05:29.669669+0000","last_peered":"2024-09-14T12:05:29.669669+0000","last_clean":"2024-09-14T12:05:29.669669+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:05:29.669669+0000","last_undegraded":"2024-09-14T12:05:29.669669+0000","last_fullsized":"2024-09-14T12:05:29.669669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:37.926867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671952+0000","last_change":"2024-09-14T11:44:25.349268+0000","last_active":"2024-09-14T12:07:20.671952+0000","last_peered":"2024-09-14T12:07:20.671952+0000","last_clean":"2024-09-14T12:07:20.671952+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:07:20.671952+0000","last_undegraded":"2024-09-14T12:07:20.671952+0000","last_fullsized":"2024-09-14T12:07:20.671952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:40.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587416+0000","last_change":"2024-09-14T11:28:36.259293+0000","last_active":"2024-09-14T12:07:15.587416+0000","last_peered":"2024-09-14T12:07:15.587416+0000","last_clean":"2024-09-14T12:07:15.587416+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:07:15.587416+0000","last_undegraded":"2024-09-14T12:07:15.587416+0000","last_fullsized":"2024-09-14T12:07:15.587416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:44.079464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582351+0000","last_change":"2024-09-14T11:28:33.230634+0000","last_active":"2024-09-14T12:07:24.582351+0000","last_peered":"2024-09-14T12:07:24.582351+0000","last_clean":"2024-09-14T12:07:24.582351+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:07:24.582351+0000","last_undegraded":"2024-09-14T12:07:24.582351+0000","last_fullsized":"2024-09-14T12:07:24.582351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.201670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.572739+0000","last_change":"2024-09-14T11:25:27.951325+0000","last_active":"2024-09-14T12:05:30.572739+0000","last_peered":"2024-09-14T12:05:30.572739+0000","last_clean":"2024-09-14T12:05:30.572739+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:05:30.572739+0000","last_undegraded":"2024-09-14T12:05:30.572739+0000","last_fullsized":"2024-09-14T12:05:30.572739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:34.624675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578552+0000","last_change":"2024-09-14T11:44:25.353198+0000","last_active":"2024-09-14T12:06:54.578552+0000","last_peered":"2024-09-14T12:06:54.578552+0000","last_clean":"2024-09-14T12:06:54.578552+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:06:54.578552+0000","last_undegraded":"2024-09-14T12:06:54.578552+0000","last_fullsized":"2024-09-14T12:06:54.578552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:09.499820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577573+0000","last_change":"2024-09-14T11:28:36.261093+0000","last_active":"2024-09-14T12:06:05.577573+0000","last_peered":"2024-09-14T12:06:05.577573+0000","last_clean":"2024-09-14T12:06:05.577573+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:06:05.577573+0000","last_undegraded":"2024-09-14T12:06:05.577573+0000","last_fullsized":"2024-09-14T12:06:05.577573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:33.800970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.592790+0000","last_change":"2024-09-14T11:28:33.231811+0000","last_active":"2024-09-14T12:08:34.592790+0000","last_peered":"2024-09-14T12:08:34.592790+0000","last_clean":"2024-09-14T12:08:34.592790+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:08:34.592790+0000","last_undegraded":"2024-09-14T12:08:34.592790+0000","last_fullsized":"2024-09-14T12:08:34.592790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:14.016741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566550+0000","last_change":"2024-09-14T11:25:27.947671+0000","last_active":"2024-09-14T12:06:50.566550+0000","last_peered":"2024-09-14T12:06:50.566550+0000","last_clean":"2024-09-14T12:06:50.566550+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:06:50.566550+0000","last_undegraded":"2024-09-14T12:06:50.566550+0000","last_fullsized":"2024-09-14T12:06:50.566550+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:21.104088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578614+0000","last_change":"2024-09-14T11:44:25.355575+0000","last_active":"2024-09-14T12:06:54.578614+0000","last_peered":"2024-09-14T12:06:54.578614+0000","last_clean":"2024-09-14T12:06:54.578614+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:06:54.578614+0000","last_undegraded":"2024-09-14T12:06:54.578614+0000","last_fullsized":"2024-09-14T12:06:54.578614+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.828628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674310+0000","last_change":"2024-09-14T11:28:36.254791+0000","last_active":"2024-09-14T12:06:09.674310+0000","last_peered":"2024-09-14T12:06:09.674310+0000","last_clean":"2024-09-14T12:06:09.674310+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:06:09.674310+0000","last_undegraded":"2024-09-14T12:06:09.674310+0000","last_fullsized":"2024-09-14T12:06:09.674310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:16.546392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561126+0000","last_change":"2024-09-14T11:28:33.230741+0000","last_active":"2024-09-14T12:06:05.561126+0000","last_peered":"2024-09-14T12:06:05.561126+0000","last_clean":"2024-09-14T12:06:05.561126+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:06:05.561126+0000","last_undegraded":"2024-09-14T12:06:05.561126+0000","last_fullsized":"2024-09-14T12:06:05.561126+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:45.191280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.667058+0000","last_change":"2024-09-14T11:25:27.942564+0000","last_active":"2024-09-14T12:06:35.667058+0000","last_peered":"2024-09-14T12:06:35.667058+0000","last_clean":"2024-09-14T12:06:35.667058+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:06:35.667058+0000","last_undegraded":"2024-09-14T12:06:35.667058+0000","last_fullsized":"2024-09-14T12:06:35.667058+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.091896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:25.659466+0000","last_change":"2024-09-14T11:44:25.351716+0000","last_active":"2024-09-14T12:05:25.659466+0000","last_peered":"2024-09-14T12:05:25.659466+0000","last_clean":"2024-09-14T12:05:25.659466+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:05:25.659466+0000","last_undegraded":"2024-09-14T12:05:25.659466+0000","last_fullsized":"2024-09-14T12:05:25.659466+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:06.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210853+0000","last_change":"2024-09-14T11:28:36.369321+0000","last_active":"2024-09-14T12:09:54.210853+0000","last_peered":"2024-09-14T12:09:54.210853+0000","last_clean":"2024-09-14T12:09:54.210853+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:09:54.210853+0000","last_undegraded":"2024-09-14T12:09:54.210853+0000","last_fullsized":"2024-09-14T12:09:54.210853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:22.989447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706081+0000","last_change":"2024-09-14T11:28:33.231360+0000","last_active":"2024-09-14T12:05:59.706081+0000","last_peered":"2024-09-14T12:05:59.706081+0000","last_clean":"2024-09-14T12:05:59.706081+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:05:59.706081+0000","last_undegraded":"2024-09-14T12:05:59.706081+0000","last_fullsized":"2024-09-14T12:05:59.706081+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.002852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564851+0000","last_change":"2024-09-14T11:25:27.949982+0000","last_active":"2024-09-14T12:06:35.564851+0000","last_peered":"2024-09-14T12:06:35.564851+0000","last_clean":"2024-09-14T12:06:35.564851+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:06:35.564851+0000","last_undegraded":"2024-09-14T12:06:35.564851+0000","last_fullsized":"2024-09-14T12:06:35.564851+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:12.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.641872+0000","last_change":"2024-09-14T11:44:25.346519+0000","last_active":"2024-09-14T12:05:24.641872+0000","last_peered":"2024-09-14T12:05:24.641872+0000","last_clean":"2024-09-14T12:05:24.641872+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:05:24.641872+0000","last_undegraded":"2024-09-14T12:05:24.641872+0000","last_fullsized":"2024-09-14T12:05:24.641872+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:51.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674369+0000","last_change":"2024-09-14T11:28:36.367601+0000","last_active":"2024-09-14T12:06:09.674369+0000","last_peered":"2024-09-14T12:06:09.674369+0000","last_clean":"2024-09-14T12:06:09.674369+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:06:09.674369+0000","last_undegraded":"2024-09-14T12:06:09.674369+0000","last_fullsized":"2024-09-14T12:06:09.674369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:47.572025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581225+0000","last_change":"2024-09-14T11:28:33.228389+0000","last_active":"2024-09-14T12:07:14.581225+0000","last_peered":"2024-09-14T12:07:14.581225+0000","last_clean":"2024-09-14T12:07:14.581225+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:07:14.581225+0000","last_undegraded":"2024-09-14T12:07:14.581225+0000","last_fullsized":"2024-09-14T12:07:14.581225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:11.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677357+0000","last_change":"2024-09-14T11:25:27.953781+0000","last_active":"2024-09-14T12:06:34.677357+0000","last_peered":"2024-09-14T12:06:34.677357+0000","last_clean":"2024-09-14T12:06:34.677357+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:06:34.677357+0000","last_undegraded":"2024-09-14T12:06:34.677357+0000","last_fullsized":"2024-09-14T12:06:34.677357+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.652754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.564302+0000","last_change":"2024-09-14T11:44:25.348811+0000","last_active":"2024-09-14T12:05:24.564302+0000","last_peered":"2024-09-14T12:05:24.564302+0000","last_clean":"2024-09-14T12:05:24.564302+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:05:24.564302+0000","last_undegraded":"2024-09-14T12:05:24.564302+0000","last_fullsized":"2024-09-14T12:05:24.564302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:32.650432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682708+0000","last_change":"2024-09-14T11:28:36.369256+0000","last_active":"2024-09-14T12:07:19.682708+0000","last_peered":"2024-09-14T12:07:19.682708+0000","last_clean":"2024-09-14T12:07:19.682708+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:07:19.682708+0000","last_undegraded":"2024-09-14T12:07:19.682708+0000","last_fullsized":"2024-09-14T12:07:19.682708+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:54.707659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653192+0000","last_change":"2024-09-14T11:28:33.233405+0000","last_active":"2024-09-14T12:07:14.653192+0000","last_peered":"2024-09-14T12:07:14.653192+0000","last_clean":"2024-09-14T12:07:14.653192+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:07:14.653192+0000","last_undegraded":"2024-09-14T12:07:14.653192+0000","last_fullsized":"2024-09-14T12:07:14.653192+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649083+0000","last_change":"2024-09-14T11:25:27.945742+0000","last_active":"2024-09-14T12:06:34.649083+0000","last_peered":"2024-09-14T12:06:34.649083+0000","last_clean":"2024-09-14T12:06:34.649083+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:06:34.649083+0000","last_undegraded":"2024-09-14T12:06:34.649083+0000","last_fullsized":"2024-09-14T12:06:34.649083+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:48.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.700955+0000","last_change":"2024-09-14T11:44:25.352981+0000","last_active":"2024-09-14T12:05:24.700955+0000","last_peered":"2024-09-14T12:05:24.700955+0000","last_clean":"2024-09-14T12:05:24.700955+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:05:24.700955+0000","last_undegraded":"2024-09-14T12:05:24.700955+0000","last_fullsized":"2024-09-14T12:05:24.700955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:28.913462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581671+0000","last_change":"2024-09-14T11:28:36.261453+0000","last_active":"2024-09-14T12:07:19.581671+0000","last_peered":"2024-09-14T12:07:19.581671+0000","last_clean":"2024-09-14T12:07:19.581671+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:07:19.581671+0000","last_undegraded":"2024-09-14T12:07:19.581671+0000","last_fullsized":"2024-09-14T12:07:19.581671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569744+0000","last_change":"2024-09-14T11:28:33.226734+0000","last_active":"2024-09-14T12:07:15.569744+0000","last_peered":"2024-09-14T12:07:15.569744+0000","last_clean":"2024-09-14T12:07:15.569744+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:07:15.569744+0000","last_undegraded":"2024-09-14T12:07:15.569744+0000","last_fullsized":"2024-09-14T12:07:15.569744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:19.563659+0000","last_change":"2024-09-14T11:25:27.950879+0000","last_active":"2024-09-14T12:05:19.563659+0000","last_peered":"2024-09-14T12:05:19.563659+0000","last_clean":"2024-09-14T12:05:19.563659+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:05:19.563659+0000","last_undegraded":"2024-09-14T12:05:19.563659+0000","last_fullsized":"2024-09-14T12:05:19.563659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:13.451590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674442+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:06:09.674442+0000","last_peered":"2024-09-14T12:06:09.674442+0000","last_clean":"2024-09-14T12:06:09.674442+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:06:09.674442+0000","last_undegraded":"2024-09-14T12:06:09.674442+0000","last_fullsized":"2024-09-14T12:06:09.674442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.648826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662808+0000","last_change":"2024-09-14T11:28:36.257731+0000","last_active":"2024-09-14T12:05:55.662808+0000","last_peered":"2024-09-14T12:05:55.662808+0000","last_clean":"2024-09-14T12:05:55.662808+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:05:55.662808+0000","last_undegraded":"2024-09-14T12:05:55.662808+0000","last_fullsized":"2024-09-14T12:05:55.662808+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:03.144550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.569273+0000","last_change":"2024-09-14T11:28:33.232810+0000","last_active":"2024-09-14T12:05:54.569273+0000","last_peered":"2024-09-14T12:05:54.569273+0000","last_clean":"2024-09-14T12:05:54.569273+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:05:54.569273+0000","last_undegraded":"2024-09-14T12:05:54.569273+0000","last_fullsized":"2024-09-14T12:05:54.569273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:44.564156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583435+0000","last_change":"2024-09-14T11:25:27.949859+0000","last_active":"2024-09-14T12:07:29.583435+0000","last_peered":"2024-09-14T12:07:29.583435+0000","last_clean":"2024-09-14T12:07:29.583435+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:07:29.583435+0000","last_undegraded":"2024-09-14T12:07:29.583435+0000","last_fullsized":"2024-09-14T12:07:29.583435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:45.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561924+0000","last_change":"2024-09-14T11:44:25.355586+0000","last_active":"2024-09-14T12:06:10.561924+0000","last_peered":"2024-09-14T12:06:10.561924+0000","last_clean":"2024-09-14T12:06:10.561924+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:06:10.561924+0000","last_undegraded":"2024-09-14T12:06:10.561924+0000","last_fullsized":"2024-09-14T12:06:10.561924+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:15.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662766+0000","last_change":"2024-09-14T11:28:36.261024+0000","last_active":"2024-09-14T12:05:55.662766+0000","last_peered":"2024-09-14T12:05:55.662766+0000","last_clean":"2024-09-14T12:05:55.662766+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:05:55.662766+0000","last_undegraded":"2024-09-14T12:05:55.662766+0000","last_fullsized":"2024-09-14T12:05:55.662766+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.672323+0000","last_change":"2024-09-14T11:28:33.229372+0000","last_active":"2024-09-14T12:05:54.672323+0000","last_peered":"2024-09-14T12:05:54.672323+0000","last_clean":"2024-09-14T12:05:54.672323+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:05:54.672323+0000","last_undegraded":"2024-09-14T12:05:54.672323+0000","last_fullsized":"2024-09-14T12:05:54.672323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:23.134165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571324+0000","last_change":"2024-09-14T11:25:27.945571+0000","last_active":"2024-09-14T12:07:30.571324+0000","last_peered":"2024-09-14T12:07:30.571324+0000","last_clean":"2024-09-14T12:07:30.571324+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:07:30.571324+0000","last_undegraded":"2024-09-14T12:07:30.571324+0000","last_fullsized":"2024-09-14T12:07:30.571324+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:07.890808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557794+0000","last_change":"2024-09-14T11:44:25.351774+0000","last_active":"2024-09-14T12:05:35.557794+0000","last_peered":"2024-09-14T12:05:35.557794+0000","last_clean":"2024-09-14T12:05:35.557794+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:05:35.557794+0000","last_undegraded":"2024-09-14T12:05:35.557794+0000","last_fullsized":"2024-09-14T12:05:35.557794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.350297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.406287+0000","last_change":"2024-09-14T11:28:36.257478+0000","last_active":"2024-09-14T12:09:53.406287+0000","last_peered":"2024-09-14T12:09:53.406287+0000","last_clean":"2024-09-14T12:09:53.406287+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:09:53.406287+0000","last_undegraded":"2024-09-14T12:09:53.406287+0000","last_fullsized":"2024-09-14T12:09:53.406287+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:23.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576285+0000","last_change":"2024-09-14T11:28:33.226764+0000","last_active":"2024-09-14T12:05:55.576285+0000","last_peered":"2024-09-14T12:05:55.576285+0000","last_clean":"2024-09-14T12:05:55.576285+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:05:55.576285+0000","last_undegraded":"2024-09-14T12:05:55.576285+0000","last_fullsized":"2024-09-14T12:05:55.576285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.256510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583059+0000","last_change":"2024-09-14T11:25:27.946060+0000","last_active":"2024-09-14T12:07:29.583059+0000","last_peered":"2024-09-14T12:07:29.583059+0000","last_clean":"2024-09-14T12:07:29.583059+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:07:29.583059+0000","last_undegraded":"2024-09-14T12:07:29.583059+0000","last_fullsized":"2024-09-14T12:07:29.583059+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:07.686737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674405+0000","last_change":"2024-09-14T11:44:25.350108+0000","last_active":"2024-09-14T12:06:09.674405+0000","last_peered":"2024-09-14T12:06:09.674405+0000","last_clean":"2024-09-14T12:06:09.674405+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:06:09.674405+0000","last_undegraded":"2024-09-14T12:06:09.674405+0000","last_fullsized":"2024-09-14T12:06:09.674405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:05.638059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576237+0000","last_change":"2024-09-14T11:28:36.254787+0000","last_active":"2024-09-14T12:05:55.576237+0000","last_peered":"2024-09-14T12:05:55.576237+0000","last_clean":"2024-09-14T12:05:55.576237+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:05:55.576237+0000","last_undegraded":"2024-09-14T12:05:55.576237+0000","last_fullsized":"2024-09-14T12:05:55.576237+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:50.371867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.726150+0000","last_change":"2024-09-14T11:28:33.230870+0000","last_active":"2024-09-14T12:08:14.726150+0000","last_peered":"2024-09-14T12:08:14.726150+0000","last_clean":"2024-09-14T12:08:14.726150+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:08:14.726150+0000","last_undegraded":"2024-09-14T12:08:14.726150+0000","last_fullsized":"2024-09-14T12:08:14.726150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.098373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.683991+0000","last_change":"2024-09-14T11:25:27.953081+0000","last_active":"2024-09-14T12:07:29.683991+0000","last_peered":"2024-09-14T12:07:29.683991+0000","last_clean":"2024-09-14T12:07:29.683991+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:07:29.683991+0000","last_undegraded":"2024-09-14T12:07:29.683991+0000","last_fullsized":"2024-09-14T12:07:29.683991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:37.718041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646069+0000","last_change":"2024-09-14T11:44:25.347178+0000","last_active":"2024-09-14T12:06:04.646069+0000","last_peered":"2024-09-14T12:06:04.646069+0000","last_clean":"2024-09-14T12:06:04.646069+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:06:04.646069+0000","last_undegraded":"2024-09-14T12:06:04.646069+0000","last_fullsized":"2024-09-14T12:06:04.646069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.558120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679683+0000","last_change":"2024-09-14T11:28:36.257470+0000","last_active":"2024-09-14T12:06:54.679683+0000","last_peered":"2024-09-14T12:06:54.679683+0000","last_clean":"2024-09-14T12:06:54.679683+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:06:54.679683+0000","last_undegraded":"2024-09-14T12:06:54.679683+0000","last_fullsized":"2024-09-14T12:06:54.679683+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.008987+0000","last_change":"2024-09-14T11:28:33.233762+0000","last_active":"2024-09-14T12:09:54.008987+0000","last_peered":"2024-09-14T12:09:54.008987+0000","last_clean":"2024-09-14T12:09:54.008987+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:09:54.008987+0000","last_undegraded":"2024-09-14T12:09:54.008987+0000","last_fullsized":"2024-09-14T12:09:54.008987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:03.013761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674471+0000","last_change":"2024-09-14T11:25:27.950690+0000","last_active":"2024-09-14T12:06:09.674471+0000","last_peered":"2024-09-14T12:06:09.674471+0000","last_clean":"2024-09-14T12:06:09.674471+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:06:09.674471+0000","last_undegraded":"2024-09-14T12:06:09.674471+0000","last_fullsized":"2024-09-14T12:06:09.674471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:51.496056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578529+0000","last_change":"2024-09-14T11:44:25.354265+0000","last_active":"2024-09-14T12:06:54.578529+0000","last_peered":"2024-09-14T12:06:54.578529+0000","last_clean":"2024-09-14T12:06:54.578529+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:06:54.578529+0000","last_undegraded":"2024-09-14T12:06:54.578529+0000","last_fullsized":"2024-09-14T12:06:54.578529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.737799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679648+0000","last_change":"2024-09-14T11:28:36.254946+0000","last_active":"2024-09-14T12:06:54.679648+0000","last_peered":"2024-09-14T12:06:54.679648+0000","last_clean":"2024-09-14T12:06:54.679648+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:06:54.679648+0000","last_undegraded":"2024-09-14T12:06:54.679648+0000","last_fullsized":"2024-09-14T12:06:54.679648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:55.651650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.876445+0000","last_change":"2024-09-14T11:28:33.228679+0000","last_active":"2024-09-14T12:09:52.876445+0000","last_peered":"2024-09-14T12:09:52.876445+0000","last_clean":"2024-09-14T12:09:52.876445+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:09:52.876445+0000","last_undegraded":"2024-09-14T12:09:52.876445+0000","last_fullsized":"2024-09-14T12:09:52.876445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706137+0000","last_change":"2024-09-14T11:25:27.949880+0000","last_active":"2024-09-14T12:05:59.706137+0000","last_peered":"2024-09-14T12:05:59.706137+0000","last_clean":"2024-09-14T12:05:59.706137+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:05:59.706137+0000","last_undegraded":"2024-09-14T12:05:59.706137+0000","last_fullsized":"2024-09-14T12:05:59.706137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.896653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577462+0000","last_change":"2024-09-14T11:44:25.340707+0000","last_active":"2024-09-14T12:06:05.577462+0000","last_peered":"2024-09-14T12:06:05.577462+0000","last_clean":"2024-09-14T12:06:05.577462+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:06:05.577462+0000","last_undegraded":"2024-09-14T12:06:05.577462+0000","last_fullsized":"2024-09-14T12:06:05.577462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:41.520475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669775+0000","last_change":"2024-09-14T11:28:36.367731+0000","last_active":"2024-09-14T12:07:00.669775+0000","last_peered":"2024-09-14T12:07:00.669775+0000","last_clean":"2024-09-14T12:07:00.669775+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:07:00.669775+0000","last_undegraded":"2024-09-14T12:07:00.669775+0000","last_fullsized":"2024-09-14T12:07:00.669775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:55.831862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566673+0000","last_change":"2024-09-14T11:28:33.231847+0000","last_active":"2024-09-14T12:06:50.566673+0000","last_peered":"2024-09-14T12:06:50.566673+0000","last_clean":"2024-09-14T12:06:50.566673+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:06:50.566673+0000","last_undegraded":"2024-09-14T12:06:50.566673+0000","last_fullsized":"2024-09-14T12:06:50.566673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:38.952131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.576926+0000","last_change":"2024-09-14T11:25:27.950496+0000","last_active":"2024-09-14T12:06:00.576926+0000","last_peered":"2024-09-14T12:06:00.576926+0000","last_clean":"2024-09-14T12:06:00.576926+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:06:00.576926+0000","last_undegraded":"2024-09-14T12:06:00.576926+0000","last_fullsized":"2024-09-14T12:06:00.576926+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.743937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570818+0000","last_change":"2024-09-14T11:44:25.347374+0000","last_active":"2024-09-14T12:06:04.570818+0000","last_peered":"2024-09-14T12:06:04.570818+0000","last_clean":"2024-09-14T12:06:04.570818+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:06:04.570818+0000","last_undegraded":"2024-09-14T12:06:04.570818+0000","last_fullsized":"2024-09-14T12:06:04.570818+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:02.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679699+0000","last_change":"2024-09-14T11:28:36.256404+0000","last_active":"2024-09-14T12:06:54.679699+0000","last_peered":"2024-09-14T12:06:54.679699+0000","last_clean":"2024-09-14T12:06:54.679699+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:06:54.679699+0000","last_undegraded":"2024-09-14T12:06:54.679699+0000","last_fullsized":"2024-09-14T12:06:54.679699+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:18.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669763+0000","last_change":"2024-09-14T11:28:33.227452+0000","last_active":"2024-09-14T12:07:00.669763+0000","last_peered":"2024-09-14T12:07:00.669763+0000","last_clean":"2024-09-14T12:07:00.669763+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:07:00.669763+0000","last_undegraded":"2024-09-14T12:07:00.669763+0000","last_fullsized":"2024-09-14T12:07:00.669763+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.149389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.645601+0000","last_change":"2024-09-14T11:25:27.954496+0000","last_active":"2024-09-14T12:05:59.645601+0000","last_peered":"2024-09-14T12:05:59.645601+0000","last_clean":"2024-09-14T12:05:59.645601+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:05:59.645601+0000","last_undegraded":"2024-09-14T12:05:59.645601+0000","last_fullsized":"2024-09-14T12:05:59.645601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:03.897519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679716+0000","last_change":"2024-09-14T11:44:25.355046+0000","last_active":"2024-09-14T12:06:54.679716+0000","last_peered":"2024-09-14T12:06:54.679716+0000","last_clean":"2024-09-14T12:06:54.679716+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:06:54.679716+0000","last_undegraded":"2024-09-14T12:06:54.679716+0000","last_fullsized":"2024-09-14T12:06:54.679716+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.119733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.955962+0000","last_change":"2024-09-14T11:28:36.260180+0000","last_active":"2024-09-14T12:09:52.955962+0000","last_peered":"2024-09-14T12:09:52.955962+0000","last_clean":"2024-09-14T12:09:52.955962+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:09:52.955962+0000","last_undegraded":"2024-09-14T12:09:52.955962+0000","last_fullsized":"2024-09-14T12:09:52.955962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:35.619938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571885+0000","last_change":"2024-09-14T11:28:33.230223+0000","last_active":"2024-09-14T12:07:35.571885+0000","last_peered":"2024-09-14T12:07:35.571885+0000","last_clean":"2024-09-14T12:07:35.571885+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:07:35.571885+0000","last_undegraded":"2024-09-14T12:07:35.571885+0000","last_fullsized":"2024-09-14T12:07:35.571885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:17.221998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.560556+0000","last_change":"2024-09-14T11:25:27.953095+0000","last_active":"2024-09-14T12:06:00.560556+0000","last_peered":"2024-09-14T12:06:00.560556+0000","last_clean":"2024-09-14T12:06:00.560556+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:06:00.560556+0000","last_undegraded":"2024-09-14T12:06:00.560556+0000","last_fullsized":"2024-09-14T12:06:00.560556+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:58.766336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579278+0000","last_change":"2024-09-14T11:44:25.354056+0000","last_active":"2024-09-14T12:06:59.579278+0000","last_peered":"2024-09-14T12:06:59.579278+0000","last_clean":"2024-09-14T12:06:59.579278+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:06:59.579278+0000","last_undegraded":"2024-09-14T12:06:59.579278+0000","last_fullsized":"2024-09-14T12:06:59.579278+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.958850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.131052+0000","last_change":"2024-09-14T11:28:36.365890+0000","last_active":"2024-09-14T12:09:53.131052+0000","last_peered":"2024-09-14T12:09:53.131052+0000","last_clean":"2024-09-14T12:09:53.131052+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:09:53.131052+0000","last_undegraded":"2024-09-14T12:09:53.131052+0000","last_fullsized":"2024-09-14T12:09:53.131052+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.017356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.673401+0000","last_change":"2024-09-14T11:28:33.228030+0000","last_active":"2024-09-14T12:07:35.673401+0000","last_peered":"2024-09-14T12:07:35.673401+0000","last_clean":"2024-09-14T12:07:35.673401+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:07:35.673401+0000","last_undegraded":"2024-09-14T12:07:35.673401+0000","last_fullsized":"2024-09-14T12:07:35.673401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:06.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577681+0000","last_change":"2024-09-14T11:25:27.950183+0000","last_active":"2024-09-14T12:06:49.577681+0000","last_peered":"2024-09-14T12:06:49.577681+0000","last_clean":"2024-09-14T12:06:49.577681+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:06:49.577681+0000","last_undegraded":"2024-09-14T12:06:49.577681+0000","last_fullsized":"2024-09-14T12:06:49.577681+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:47.768324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578564+0000","last_change":"2024-09-14T11:44:25.351682+0000","last_active":"2024-09-14T12:06:54.578564+0000","last_peered":"2024-09-14T12:06:54.578564+0000","last_clean":"2024-09-14T12:06:54.578564+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:06:54.578564+0000","last_undegraded":"2024-09-14T12:06:54.578564+0000","last_fullsized":"2024-09-14T12:06:54.578564+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:33.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.668722+0000","last_change":"2024-09-14T11:28:36.252721+0000","last_active":"2024-09-14T12:06:50.668722+0000","last_peered":"2024-09-14T12:06:50.668722+0000","last_clean":"2024-09-14T12:06:50.668722+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:06:50.668722+0000","last_undegraded":"2024-09-14T12:06:50.668722+0000","last_fullsized":"2024-09-14T12:06:50.668722+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:40.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":17937,"num_write":7,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557747+0000","last_change":"2024-09-14T11:28:33.228385+0000","last_active":"2024-09-14T12:05:35.557747+0000","last_peered":"2024-09-14T12:05:35.557747+0000","last_clean":"2024-09-14T12:05:35.557747+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:05:35.557747+0000","last_undegraded":"2024-09-14T12:05:35.557747+0000","last_fullsized":"2024-09-14T12:05:35.557747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:36.884948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.677912+0000","last_change":"2024-09-14T11:25:27.951396+0000","last_active":"2024-09-14T12:06:39.677912+0000","last_peered":"2024-09-14T12:06:39.677912+0000","last_clean":"2024-09-14T12:06:39.677912+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:06:39.677912+0000","last_undegraded":"2024-09-14T12:06:39.677912+0000","last_fullsized":"2024-09-14T12:06:39.677912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.372583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:55.567242+0000","last_change":"2024-09-14T11:44:25.356594+0000","last_active":"2024-09-14T12:06:55.567242+0000","last_peered":"2024-09-14T12:06:55.567242+0000","last_clean":"2024-09-14T12:06:55.567242+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:06:55.567242+0000","last_undegraded":"2024-09-14T12:06:55.567242+0000","last_fullsized":"2024-09-14T12:06:55.567242+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.437539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585586+0000","last_change":"2024-09-14T11:29:33.340403+0000","last_active":"2024-09-14T12:07:44.585586+0000","last_peered":"2024-09-14T12:07:44.585586+0000","last_clean":"2024-09-14T12:07:44.585586+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:07:44.585586+0000","last_undegraded":"2024-09-14T12:07:44.585586+0000","last_fullsized":"2024-09-14T12:07:44.585586+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:46.256090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577175+0000","last_change":"2024-09-14T11:28:33.230335+0000","last_active":"2024-09-14T12:06:49.577175+0000","last_peered":"2024-09-14T12:06:49.577175+0000","last_clean":"2024-09-14T12:06:49.577175+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:06:49.577175+0000","last_undegraded":"2024-09-14T12:06:49.577175+0000","last_fullsized":"2024-09-14T12:06:49.577175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:57.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582421+0000","last_change":"2024-09-14T11:25:27.949670+0000","last_active":"2024-09-14T12:06:40.582421+0000","last_peered":"2024-09-14T12:06:40.582421+0000","last_clean":"2024-09-14T12:06:40.582421+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:06:40.582421+0000","last_undegraded":"2024-09-14T12:06:40.582421+0000","last_fullsized":"2024-09-14T12:06:40.582421+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:26.893035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581926+0000","last_change":"2024-09-14T11:44:25.351860+0000","last_active":"2024-09-14T12:07:19.581926+0000","last_peered":"2024-09-14T12:07:19.581926+0000","last_clean":"2024-09-14T12:07:19.581926+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:07:19.581926+0000","last_undegraded":"2024-09-14T12:07:19.581926+0000","last_fullsized":"2024-09-14T12:07:19.581926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:01.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:15.562475+0000","last_change":"2024-09-14T11:28:36.252024+0000","last_active":"2024-09-14T12:06:15.562475+0000","last_peered":"2024-09-14T12:06:15.562475+0000","last_clean":"2024-09-14T12:06:15.562475+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:06:15.562475+0000","last_undegraded":"2024-09-14T12:06:15.562475+0000","last_fullsized":"2024-09-14T12:06:15.562475+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:46.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.405443+0000","last_change":"2024-09-14T11:28:33.229236+0000","last_active":"2024-09-14T12:09:53.405443+0000","last_peered":"2024-09-14T12:09:53.405443+0000","last_clean":"2024-09-14T12:09:53.405443+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:09:53.405443+0000","last_undegraded":"2024-09-14T12:09:53.405443+0000","last_fullsized":"2024-09-14T12:09:53.405443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:46.128928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565430+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:06:40.565430+0000","last_peered":"2024-09-14T12:06:40.565430+0000","last_clean":"2024-09-14T12:06:40.565430+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:06:40.565430+0000","last_undegraded":"2024-09-14T12:06:40.565430+0000","last_fullsized":"2024-09-14T12:06:40.565430+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:53.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717994+0000","last_change":"2024-09-14T11:44:25.350439+0000","last_active":"2024-09-14T12:07:19.717994+0000","last_peered":"2024-09-14T12:07:19.717994+0000","last_clean":"2024-09-14T12:07:19.717994+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:07:19.717994+0000","last_undegraded":"2024-09-14T12:07:19.717994+0000","last_fullsized":"2024-09-14T12:07:19.717994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:24.626683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561173+0000","last_change":"2024-09-14T11:28:36.365847+0000","last_active":"2024-09-14T12:06:05.561173+0000","last_peered":"2024-09-14T12:06:05.561173+0000","last_clean":"2024-09-14T12:06:05.561173+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:06:05.561173+0000","last_undegraded":"2024-09-14T12:06:05.561173+0000","last_fullsized":"2024-09-14T12:06:05.561173+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:26.254693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.661792+0000","last_change":"2024-09-14T11:28:33.228362+0000","last_active":"2024-09-14T12:08:14.661792+0000","last_peered":"2024-09-14T12:08:14.661792+0000","last_clean":"2024-09-14T12:08:14.661792+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:08:14.661792+0000","last_undegraded":"2024-09-14T12:08:14.661792+0000","last_fullsized":"2024-09-14T12:08:14.661792+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:47.879475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582495+0000","last_change":"2024-09-14T11:25:27.948331+0000","last_active":"2024-09-14T12:06:40.582495+0000","last_peered":"2024-09-14T12:06:40.582495+0000","last_clean":"2024-09-14T12:06:40.582495+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:06:40.582495+0000","last_undegraded":"2024-09-14T12:06:40.582495+0000","last_fullsized":"2024-09-14T12:06:40.582495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:11.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:30.666552+0000","last_change":"2024-09-14T11:44:25.351133+0000","last_active":"2024-09-14T12:06:30.666552+0000","last_peered":"2024-09-14T12:06:30.666552+0000","last_clean":"2024-09-14T12:06:30.666552+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:06:30.666552+0000","last_undegraded":"2024-09-14T12:06:30.666552+0000","last_fullsized":"2024-09-14T12:06:30.666552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:44.289131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584940+0000","last_change":"2024-09-14T11:28:36.367086+0000","last_active":"2024-09-14T12:07:39.584940+0000","last_peered":"2024-09-14T12:07:39.584940+0000","last_clean":"2024-09-14T12:07:39.584940+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:07:39.584940+0000","last_undegraded":"2024-09-14T12:07:39.584940+0000","last_fullsized":"2024-09-14T12:07:39.584940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.893706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.720510+0000","last_change":"2024-09-14T11:28:33.231027+0000","last_active":"2024-09-14T12:07:34.720510+0000","last_peered":"2024-09-14T12:07:34.720510+0000","last_clean":"2024-09-14T12:07:34.720510+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:07:34.720510+0000","last_undegraded":"2024-09-14T12:07:34.720510+0000","last_fullsized":"2024-09-14T12:07:34.720510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.425071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582020+0000","last_change":"2024-09-14T11:25:27.948199+0000","last_active":"2024-09-14T12:07:19.582020+0000","last_peered":"2024-09-14T12:07:19.582020+0000","last_clean":"2024-09-14T12:07:19.582020+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:07:19.582020+0000","last_undegraded":"2024-09-14T12:07:19.582020+0000","last_fullsized":"2024-09-14T12:07:19.582020+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:39.351483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581534+0000","last_change":"2024-09-14T11:44:25.354049+0000","last_active":"2024-09-14T12:07:19.581534+0000","last_peered":"2024-09-14T12:07:19.581534+0000","last_clean":"2024-09-14T12:07:19.581534+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:07:19.581534+0000","last_undegraded":"2024-09-14T12:07:19.581534+0000","last_fullsized":"2024-09-14T12:07:19.581534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:06.436515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584665+0000","last_change":"2024-09-14T11:28:36.260053+0000","last_active":"2024-09-14T12:07:39.584665+0000","last_peered":"2024-09-14T12:07:39.584665+0000","last_clean":"2024-09-14T12:07:39.584665+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:07:39.584665+0000","last_undegraded":"2024-09-14T12:07:39.584665+0000","last_fullsized":"2024-09-14T12:07:39.584665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.584214+0000","last_change":"2024-09-14T11:28:33.233002+0000","last_active":"2024-09-14T12:07:34.584214+0000","last_peered":"2024-09-14T12:07:34.584214+0000","last_clean":"2024-09-14T12:07:34.584214+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:07:34.584214+0000","last_undegraded":"2024-09-14T12:07:34.584214+0000","last_fullsized":"2024-09-14T12:07:34.584214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:57.509567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670809+0000","last_change":"2024-09-14T11:25:27.948445+0000","last_active":"2024-09-14T12:07:10.670809+0000","last_peered":"2024-09-14T12:07:10.670809+0000","last_clean":"2024-09-14T12:07:10.670809+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:07:10.670809+0000","last_undegraded":"2024-09-14T12:07:10.670809+0000","last_fullsized":"2024-09-14T12:07:10.670809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646115+0000","last_change":"2024-09-14T11:44:25.348388+0000","last_active":"2024-09-14T12:06:04.646115+0000","last_peered":"2024-09-14T12:06:04.646115+0000","last_clean":"2024-09-14T12:06:04.646115+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:06:04.646115+0000","last_undegraded":"2024-09-14T12:06:04.646115+0000","last_fullsized":"2024-09-14T12:06:04.646115+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:30.181019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663894+0000","last_change":"2024-09-14T11:28:36.257342+0000","last_active":"2024-09-14T12:06:05.663894+0000","last_peered":"2024-09-14T12:06:05.663894+0000","last_clean":"2024-09-14T12:06:05.663894+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:06:05.663894+0000","last_undegraded":"2024-09-14T12:06:05.663894+0000","last_fullsized":"2024-09-14T12:06:05.663894+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:31.845998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576072+0000","last_change":"2024-09-14T11:28:33.228459+0000","last_active":"2024-09-14T12:06:39.576072+0000","last_peered":"2024-09-14T12:06:39.576072+0000","last_clean":"2024-09-14T12:06:39.576072+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:06:39.576072+0000","last_undegraded":"2024-09-14T12:06:39.576072+0000","last_fullsized":"2024-09-14T12:06:39.576072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:32.489364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716392+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:07:09.716392+0000","last_peered":"2024-09-14T12:07:09.716392+0000","last_clean":"2024-09-14T12:07:09.716392+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:07:09.716392+0000","last_undegraded":"2024-09-14T12:07:09.716392+0000","last_fullsized":"2024-09-14T12:07:09.716392+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:20.912923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561205+0000","last_change":"2024-09-14T11:44:25.353177+0000","last_active":"2024-09-14T12:06:05.561205+0000","last_peered":"2024-09-14T12:06:05.561205+0000","last_clean":"2024-09-14T12:06:05.561205+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:06:05.561205+0000","last_undegraded":"2024-09-14T12:06:05.561205+0000","last_fullsized":"2024-09-14T12:06:05.561205+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:44.730416+0000","last_change":"2024-09-14T11:28:36.256678+0000","last_active":"2024-09-14T12:08:44.730416+0000","last_peered":"2024-09-14T12:08:44.730416+0000","last_clean":"2024-09-14T12:08:44.730416+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:08:44.730416+0000","last_undegraded":"2024-09-14T12:08:44.730416+0000","last_fullsized":"2024-09-14T12:08:44.730416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:25.852294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589335+0000","last_change":"2024-09-14T11:28:33.232601+0000","last_active":"2024-09-14T12:08:09.589335+0000","last_peered":"2024-09-14T12:08:09.589335+0000","last_clean":"2024-09-14T12:08:09.589335+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:08:09.589335+0000","last_undegraded":"2024-09-14T12:08:09.589335+0000","last_fullsized":"2024-09-14T12:08:09.589335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:05.331738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.579944+0000","last_change":"2024-09-14T11:25:27.949489+0000","last_active":"2024-09-14T12:07:09.579944+0000","last_peered":"2024-09-14T12:07:09.579944+0000","last_clean":"2024-09-14T12:07:09.579944+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:07:09.579944+0000","last_undegraded":"2024-09-14T12:07:09.579944+0000","last_fullsized":"2024-09-14T12:07:09.579944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:23.544881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570267+0000","last_change":"2024-09-14T11:44:25.353056+0000","last_active":"2024-09-14T12:07:20.570267+0000","last_peered":"2024-09-14T12:07:20.570267+0000","last_clean":"2024-09-14T12:07:20.570267+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:07:20.570267+0000","last_undegraded":"2024-09-14T12:07:20.570267+0000","last_fullsized":"2024-09-14T12:07:20.570267+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:07.137155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577542+0000","last_change":"2024-09-14T11:28:36.259431+0000","last_active":"2024-09-14T12:06:05.577542+0000","last_peered":"2024-09-14T12:06:05.577542+0000","last_clean":"2024-09-14T12:06:05.577542+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:06:05.577542+0000","last_undegraded":"2024-09-14T12:06:05.577542+0000","last_fullsized":"2024-09-14T12:06:05.577542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:17.716269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'7","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663916+0000","last_change":"2024-09-14T11:28:33.227906+0000","last_active":"2024-09-14T12:06:05.663916+0000","last_peered":"2024-09-14T12:06:05.663916+0000","last_clean":"2024-09-14T12:06:05.663916+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:06:05.663916+0000","last_undegraded":"2024-09-14T12:06:05.663916+0000","last_fullsized":"2024-09-14T12:06:05.663916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.498353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586665+0000","last_change":"2024-09-14T11:25:27.946605+0000","last_active":"2024-09-14T12:07:10.586665+0000","last_peered":"2024-09-14T12:07:10.586665+0000","last_clean":"2024-09-14T12:07:10.586665+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:07:10.586665+0000","last_undegraded":"2024-09-14T12:07:10.586665+0000","last_fullsized":"2024-09-14T12:07:10.586665+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.771354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582789+0000","last_change":"2024-09-14T11:44:25.355567+0000","last_active":"2024-09-14T12:07:24.582789+0000","last_peered":"2024-09-14T12:07:24.582789+0000","last_clean":"2024-09-14T12:07:24.582789+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:07:24.582789+0000","last_undegraded":"2024-09-14T12:07:24.582789+0000","last_fullsized":"2024-09-14T12:07:24.582789+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:15.391313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.589963+0000","last_change":"2024-09-14T11:28:36.260711+0000","last_active":"2024-09-14T12:08:14.589963+0000","last_peered":"2024-09-14T12:08:14.589963+0000","last_clean":"2024-09-14T12:08:14.589963+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:08:14.589963+0000","last_undegraded":"2024-09-14T12:08:14.589963+0000","last_fullsized":"2024-09-14T12:08:14.589963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:01.074793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577559+0000","last_change":"2024-09-14T11:28:33.228247+0000","last_active":"2024-09-14T12:06:05.577559+0000","last_peered":"2024-09-14T12:06:05.577559+0000","last_clean":"2024-09-14T12:06:05.577559+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:06:05.577559+0000","last_undegraded":"2024-09-14T12:06:05.577559+0000","last_fullsized":"2024-09-14T12:06:05.577559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:40.279213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584808+0000","last_change":"2024-09-14T11:25:27.949061+0000","last_active":"2024-09-14T12:07:39.584808+0000","last_peered":"2024-09-14T12:07:39.584808+0000","last_clean":"2024-09-14T12:07:39.584808+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:07:39.584808+0000","last_undegraded":"2024-09-14T12:07:39.584808+0000","last_fullsized":"2024-09-14T12:07:39.584808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'363","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596319+0000","last_change":"2024-09-14T11:10:56.613934+0000","last_active":"2024-09-14T12:09:54.596319+0000","last_peered":"2024-09-14T12:09:54.596319+0000","last_clean":"2024-09-14T12:09:54.596319+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:09:54.596319+0000","last_undegraded":"2024-09-14T12:09:54.596319+0000","last_fullsized":"2024-09-14T12:09:54.596319+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.319510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":753,"num_read_kb":12872,"num_write":1132,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706012+0000","last_change":"2024-09-14T11:10:58.598689+0000","last_active":"2024-09-14T12:05:59.706012+0000","last_peered":"2024-09-14T12:05:59.706012+0000","last_clean":"2024-09-14T12:05:59.706012+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:05:59.706012+0000","last_undegraded":"2024-09-14T12:05:59.706012+0000","last_fullsized":"2024-09-14T12:05:59.706012+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:53.624721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'281","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671392+0000","last_change":"2024-09-14T11:10:56.605326+0000","last_active":"2024-09-14T12:07:15.671392+0000","last_peered":"2024-09-14T12:07:15.671392+0000","last_clean":"2024-09-14T12:07:15.671392+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:07:15.671392+0000","last_undegraded":"2024-09-14T12:07:15.671392+0000","last_fullsized":"2024-09-14T12:07:15.671392+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:33.763107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6326560,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":616,"num_read_kb":30246,"num_write":1115,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.570100+0000","last_change":"2024-09-14T11:10:58.608424+0000","last_active":"2024-09-14T12:06:59.570100+0000","last_peered":"2024-09-14T12:06:59.570100+0000","last_clean":"2024-09-14T12:06:59.570100+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:06:59.570100+0000","last_undegraded":"2024-09-14T12:06:59.570100+0000","last_fullsized":"2024-09-14T12:06:59.570100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:41.148772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'283","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.759312+0000","last_change":"2024-09-14T11:10:56.604528+0000","last_active":"2024-09-14T12:07:18.759312+0000","last_peered":"2024-09-14T12:07:18.759312+0000","last_clean":"2024-09-14T12:07:18.759312+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:07:18.759312+0000","last_undegraded":"2024-09-14T12:07:18.759312+0000","last_fullsized":"2024-09-14T12:07:18.759312+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:47.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346234,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":524,"num_read_kb":3312,"num_write":1120,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570086+0000","last_change":"2024-09-14T11:10:58.615535+0000","last_active":"2024-09-14T12:05:59.570086+0000","last_peered":"2024-09-14T12:05:59.570086+0000","last_clean":"2024-09-14T12:05:59.570086+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:05:59.570086+0000","last_undegraded":"2024-09-14T12:05:59.570086+0000","last_fullsized":"2024-09-14T12:05:59.570086+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:23.713342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'368","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.641825+0000","last_change":"2024-09-14T11:10:56.622380+0000","last_active":"2024-09-14T12:09:54.641825+0000","last_peered":"2024-09-14T12:09:54.641825+0000","last_clean":"2024-09-14T12:09:54.641825+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:09:54.641825+0000","last_undegraded":"2024-09-14T12:09:54.641825+0000","last_fullsized":"2024-09-14T12:09:54.641825+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.100508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":685,"num_read_kb":5058,"num_write":1124,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.372308+0000","last_change":"2024-09-14T11:10:58.615687+0000","last_active":"2024-09-14T12:07:57.372308+0000","last_peered":"2024-09-14T12:07:57.372308+0000","last_clean":"2024-09-14T12:07:57.372308+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:07:57.372308+0000","last_undegraded":"2024-09-14T12:07:57.372308+0000","last_fullsized":"2024-09-14T12:07:57.372308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:15.535728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'329","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.518399+0000","last_change":"2024-09-14T11:10:56.606180+0000","last_active":"2024-09-14T12:09:54.518399+0000","last_peered":"2024-09-14T12:09:54.518399+0000","last_clean":"2024-09-14T12:09:54.518399+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:09:54.518399+0000","last_undegraded":"2024-09-14T12:09:54.518399+0000","last_fullsized":"2024-09-14T12:09:54.518399+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:57.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1084079,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":17822,"num_write":997,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'252","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586768+0000","last_change":"2024-09-14T11:10:58.607840+0000","last_active":"2024-09-14T12:07:10.586768+0000","last_peered":"2024-09-14T12:07:10.586768+0000","last_clean":"2024-09-14T12:07:10.586768+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:07:10.586768+0000","last_undegraded":"2024-09-14T12:07:10.586768+0000","last_fullsized":"2024-09-14T12:07:10.586768+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:18.282965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.620476+0000","last_change":"2024-09-14T11:10:56.622630+0000","last_active":"2024-09-14T12:09:54.620476+0000","last_peered":"2024-09-14T12:09:54.620476+0000","last_clean":"2024-09-14T12:09:54.620476+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:09:54.620476+0000","last_undegraded":"2024-09-14T12:09:54.620476+0000","last_fullsized":"2024-09-14T12:09:54.620476+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:13.408043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580767+0000","last_change":"2024-09-14T11:10:58.604181+0000","last_active":"2024-09-14T12:07:14.580767+0000","last_peered":"2024-09-14T12:07:14.580767+0000","last_clean":"2024-09-14T12:07:14.580767+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:07:14.580767+0000","last_undegraded":"2024-09-14T12:07:14.580767+0000","last_fullsized":"2024-09-14T12:07:14.580767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:47.312582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'342","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.517809+0000","last_change":"2024-09-14T11:11:32.791169+0000","last_active":"2024-09-14T12:09:54.517809+0000","last_peered":"2024-09-14T12:09:54.517809+0000","last_clean":"2024-09-14T12:09:54.517809+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:09:54.517809+0000","last_undegraded":"2024-09-14T12:09:54.517809+0000","last_fullsized":"2024-09-14T12:09:54.517809+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:51.316430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333000,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":619,"num_read_kb":84521,"num_write":1147,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.717225+0000","last_change":"2024-09-14T11:10:58.601531+0000","last_active":"2024-09-14T12:07:14.717225+0000","last_peered":"2024-09-14T12:07:14.717225+0000","last_clean":"2024-09-14T12:07:14.717225+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:07:14.717225+0000","last_undegraded":"2024-09-14T12:07:14.717225+0000","last_fullsized":"2024-09-14T12:07:14.717225+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.466412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.676169+0000","last_change":"2024-09-14T11:10:56.614815+0000","last_active":"2024-09-14T12:09:54.676169+0000","last_peered":"2024-09-14T12:09:54.676169+0000","last_clean":"2024-09-14T12:09:54.676169+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:09:54.676169+0000","last_undegraded":"2024-09-14T12:09:54.676169+0000","last_fullsized":"2024-09-14T12:09:54.676169+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:17.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653214+0000","last_change":"2024-09-14T11:10:58.612690+0000","last_active":"2024-09-14T12:07:14.653214+0000","last_peered":"2024-09-14T12:07:14.653214+0000","last_clean":"2024-09-14T12:07:14.653214+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:07:14.653214+0000","last_undegraded":"2024-09-14T12:07:14.653214+0000","last_fullsized":"2024-09-14T12:07:14.653214+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:43.860956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578450+0000","last_change":"2024-09-14T11:10:58.613992+0000","last_active":"2024-09-14T12:06:59.578450+0000","last_peered":"2024-09-14T12:06:59.578450+0000","last_clean":"2024-09-14T12:06:59.578450+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:06:59.578450+0000","last_undegraded":"2024-09-14T12:06:59.578450+0000","last_fullsized":"2024-09-14T12:06:59.578450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:16.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'371","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.537432+0000","last_change":"2024-09-14T11:10:56.611500+0000","last_active":"2024-09-14T12:09:54.537432+0000","last_peered":"2024-09-14T12:09:54.537432+0000","last_clean":"2024-09-14T12:09:54.537432+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:09:54.537432+0000","last_undegraded":"2024-09-14T12:09:54.537432+0000","last_fullsized":"2024-09-14T12:09:54.537432+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:25.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2484528,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":664,"num_read_kb":4801,"num_write":1278,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579198+0000","last_change":"2024-09-14T11:10:58.608218+0000","last_active":"2024-09-14T12:06:59.579198+0000","last_peered":"2024-09-14T12:06:59.579198+0000","last_clean":"2024-09-14T12:06:59.579198+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:06:59.579198+0000","last_undegraded":"2024-09-14T12:06:59.579198+0000","last_fullsized":"2024-09-14T12:06:59.579198+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:48.756943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'258","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.581808+0000","last_change":"2024-09-14T11:10:56.610804+0000","last_active":"2024-09-14T12:06:35.581808+0000","last_peered":"2024-09-14T12:06:35.581808+0000","last_clean":"2024-09-14T12:06:35.581808+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:06:35.581808+0000","last_undegraded":"2024-09-14T12:06:35.581808+0000","last_fullsized":"2024-09-14T12:06:35.581808+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:54.575624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107799,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":512,"num_read_kb":2774,"num_write":942,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716372+0000","last_change":"2024-09-14T11:10:58.603033+0000","last_active":"2024-09-14T12:07:09.716372+0000","last_peered":"2024-09-14T12:07:09.716372+0000","last_clean":"2024-09-14T12:07:09.716372+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:07:09.716372+0000","last_undegraded":"2024-09-14T12:07:09.716372+0000","last_fullsized":"2024-09-14T12:07:09.716372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:05.684294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'278","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.581781+0000","last_change":"2024-09-14T11:10:56.617586+0000","last_active":"2024-09-14T12:06:35.581781+0000","last_peered":"2024-09-14T12:06:35.581781+0000","last_clean":"2024-09-14T12:06:35.581781+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:06:35.581781+0000","last_undegraded":"2024-09-14T12:06:35.581781+0000","last_fullsized":"2024-09-14T12:06:35.581781+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:28.064756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22098512,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":675,"num_read_kb":52006,"num_write":1052,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:17.637379+0000","last_change":"2024-09-14T11:10:58.612342+0000","last_active":"2024-09-14T12:07:17.637379+0000","last_peered":"2024-09-14T12:07:17.637379+0000","last_clean":"2024-09-14T12:07:17.637379+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:07:17.637379+0000","last_undegraded":"2024-09-14T12:07:17.637379+0000","last_fullsized":"2024-09-14T12:07:17.637379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:26.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'368","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.586478+0000","last_change":"2024-09-14T11:10:56.622021+0000","last_active":"2024-09-14T12:09:54.586478+0000","last_peered":"2024-09-14T12:09:54.586478+0000","last_clean":"2024-09-14T12:09:54.586478+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:09:54.586478+0000","last_undegraded":"2024-09-14T12:09:54.586478+0000","last_fullsized":"2024-09-14T12:09:54.586478+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.040554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1059,"num_read_kb":40711,"num_write":1146,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649064+0000","last_change":"2024-09-14T11:10:58.606489+0000","last_active":"2024-09-14T12:06:34.649064+0000","last_peered":"2024-09-14T12:06:34.649064+0000","last_clean":"2024-09-14T12:06:34.649064+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:06:34.649064+0000","last_undegraded":"2024-09-14T12:06:34.649064+0000","last_fullsized":"2024-09-14T12:06:34.649064+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.112863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'335","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656611+0000","last_change":"2024-09-14T11:10:56.618036+0000","last_active":"2024-09-14T12:09:54.656611+0000","last_peered":"2024-09-14T12:09:54.656611+0000","last_clean":"2024-09-14T12:09:54.656611+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:09:54.656611+0000","last_undegraded":"2024-09-14T12:09:54.656611+0000","last_fullsized":"2024-09-14T12:09:54.656611+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.228155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254545,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":58308,"num_write":1136,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.575165+0000","last_change":"2024-09-14T11:10:58.599593+0000","last_active":"2024-09-14T12:06:34.575165+0000","last_peered":"2024-09-14T12:06:34.575165+0000","last_clean":"2024-09-14T12:06:34.575165+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:06:34.575165+0000","last_undegraded":"2024-09-14T12:06:34.575165+0000","last_fullsized":"2024-09-14T12:06:34.575165+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.706476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'339","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569624+0000","last_change":"2024-09-14T11:10:56.624205+0000","last_active":"2024-09-14T12:07:15.569624+0000","last_peered":"2024-09-14T12:07:15.569624+0000","last_clean":"2024-09-14T12:07:15.569624+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:07:15.569624+0000","last_undegraded":"2024-09-14T12:07:15.569624+0000","last_fullsized":"2024-09-14T12:07:15.569624+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:53.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8012533,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":558,"num_read_kb":94295,"num_write":1082,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'189","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.512796+0000","last_change":"2024-09-14T11:11:06.654536+0000","last_active":"2024-09-14T12:07:57.512796+0000","last_peered":"2024-09-14T12:07:57.512796+0000","last_clean":"2024-09-14T12:07:57.512796+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:07:57.512796+0000","last_undegraded":"2024-09-14T12:07:57.512796+0000","last_fullsized":"2024-09-14T12:07:57.512796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:45.779160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'122","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:51.635212+0000","last_change":"2024-09-14T11:11:32.678345+0000","last_active":"2024-09-14T12:06:51.635212+0000","last_peered":"2024-09-14T12:06:51.635212+0000","last_clean":"2024-09-14T12:06:51.635212+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:06:51.635212+0000","last_undegraded":"2024-09-14T12:06:51.635212+0000","last_fullsized":"2024-09-14T12:06:51.635212+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:14.964766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'484","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562045+0000","last_change":"2024-09-14T11:10:56.614109+0000","last_active":"2024-09-14T12:09:54.562045+0000","last_peered":"2024-09-14T12:09:54.562045+0000","last_clean":"2024-09-14T12:09:54.562045+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:09:54.562045+0000","last_undegraded":"2024-09-14T12:09:54.562045+0000","last_fullsized":"2024-09-14T12:09:54.562045+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079997,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":947,"num_read_kb":68364,"num_write":1399,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711914+0000","last_change":"2024-09-14T11:11:00.612390+0000","last_active":"2024-09-14T12:06:39.711914+0000","last_peered":"2024-09-14T12:06:39.711914+0000","last_clean":"2024-09-14T12:06:39.711914+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:06:39.711914+0000","last_undegraded":"2024-09-14T12:06:39.711914+0000","last_fullsized":"2024-09-14T12:06:39.711914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.711231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'316","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.583331+0000","last_change":"2024-09-14T11:11:02.616888+0000","last_active":"2024-09-14T12:09:05.583331+0000","last_peered":"2024-09-14T12:09:05.583331+0000","last_clean":"2024-09-14T12:09:05.583331+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:09:05.583331+0000","last_undegraded":"2024-09-14T12:09:05.583331+0000","last_fullsized":"2024-09-14T12:09:05.583331+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:38.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":925,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576286+0000","last_change":"2024-09-14T11:11:04.630024+0000","last_active":"2024-09-14T12:06:39.576286+0000","last_peered":"2024-09-14T12:06:39.576286+0000","last_clean":"2024-09-14T12:06:39.576286+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:06:39.576286+0000","last_undegraded":"2024-09-14T12:06:39.576286+0000","last_fullsized":"2024-09-14T12:06:39.576286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.568217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.875581+0000","last_change":"2024-09-14T11:11:06.647460+0000","last_active":"2024-09-14T12:09:13.875581+0000","last_peered":"2024-09-14T12:09:13.875581+0000","last_clean":"2024-09-14T12:09:13.875581+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:09:13.875581+0000","last_undegraded":"2024-09-14T12:09:13.875581+0000","last_fullsized":"2024-09-14T12:09:13.875581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:13.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.840018+0000","last_change":"2024-09-14T11:10:58.598908+0000","last_active":"2024-09-14T12:06:34.840018+0000","last_peered":"2024-09-14T12:06:34.840018+0000","last_clean":"2024-09-14T12:06:34.840018+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:06:34.840018+0000","last_undegraded":"2024-09-14T12:06:34.840018+0000","last_fullsized":"2024-09-14T12:06:34.840018+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:45.457809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'238","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567753+0000","last_change":"2024-09-14T11:10:56.623842+0000","last_active":"2024-09-14T12:07:00.567753+0000","last_peered":"2024-09-14T12:07:00.567753+0000","last_clean":"2024-09-14T12:07:00.567753+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:07:00.567753+0000","last_undegraded":"2024-09-14T12:07:00.567753+0000","last_fullsized":"2024-09-14T12:07:00.567753+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:59.906680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487303,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":778,"num_read_kb":44655,"num_write":954,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681915+0000","last_change":"2024-09-14T11:11:00.610829+0000","last_active":"2024-09-14T12:07:14.681915+0000","last_peered":"2024-09-14T12:07:14.681915+0000","last_clean":"2024-09-14T12:07:14.681915+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:07:14.681915+0000","last_undegraded":"2024-09-14T12:07:14.681915+0000","last_fullsized":"2024-09-14T12:07:14.681915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:59.756124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.887529+0000","last_change":"2024-09-14T11:11:02.616223+0000","last_active":"2024-09-14T12:07:04.887529+0000","last_peered":"2024-09-14T12:07:04.887529+0000","last_clean":"2024-09-14T12:07:04.887529+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:07:04.887529+0000","last_undegraded":"2024-09-14T12:07:04.887529+0000","last_fullsized":"2024-09-14T12:07:04.887529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.797468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575949+0000","last_change":"2024-09-14T11:11:04.636341+0000","last_active":"2024-09-14T12:06:39.575949+0000","last_peered":"2024-09-14T12:06:39.575949+0000","last_clean":"2024-09-14T12:06:39.575949+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:06:39.575949+0000","last_undegraded":"2024-09-14T12:06:39.575949+0000","last_fullsized":"2024-09-14T12:06:39.575949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:29.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'146","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561795+0000","last_change":"2024-09-14T11:11:06.647305+0000","last_active":"2024-09-14T12:06:10.561795+0000","last_peered":"2024-09-14T12:06:10.561795+0000","last_clean":"2024-09-14T12:06:10.561795+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:06:10.561795+0000","last_undegraded":"2024-09-14T12:06:10.561795+0000","last_fullsized":"2024-09-14T12:06:10.561795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:31.457028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564820+0000","last_change":"2024-09-14T11:10:58.615755+0000","last_active":"2024-09-14T12:06:35.564820+0000","last_peered":"2024-09-14T12:06:35.564820+0000","last_clean":"2024-09-14T12:06:35.564820+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:06:35.564820+0000","last_undegraded":"2024-09-14T12:06:35.564820+0000","last_fullsized":"2024-09-14T12:06:35.564820+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:50.889127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'397","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.573491+0000","last_change":"2024-09-14T11:10:56.614555+0000","last_active":"2024-09-14T12:09:54.573491+0000","last_peered":"2024-09-14T12:09:54.573491+0000","last_clean":"2024-09-14T12:09:54.573491+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:09:54.573491+0000","last_undegraded":"2024-09-14T12:09:54.573491+0000","last_fullsized":"2024-09-14T12:09:54.573491+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:18.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404659,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":624,"num_read_kb":37554,"num_write":1175,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.678008+0000","last_change":"2024-09-14T11:11:00.613697+0000","last_active":"2024-09-14T12:06:39.678008+0000","last_peered":"2024-09-14T12:06:39.678008+0000","last_clean":"2024-09-14T12:06:39.678008+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:06:39.678008+0000","last_undegraded":"2024-09-14T12:06:39.678008+0000","last_fullsized":"2024-09-14T12:06:39.678008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:02.212530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'117","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.652713+0000","last_change":"2024-09-14T11:11:02.616784+0000","last_active":"2024-09-14T12:07:09.652713+0000","last_peered":"2024-09-14T12:07:09.652713+0000","last_clean":"2024-09-14T12:07:09.652713+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:07:09.652713+0000","last_undegraded":"2024-09-14T12:07:09.652713+0000","last_fullsized":"2024-09-14T12:07:09.652713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:51.199047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'769","reported_seq":2412,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.530183+0000","last_change":"2024-09-14T11:11:04.634733+0000","last_active":"2024-09-14T12:09:52.530183+0000","last_peered":"2024-09-14T12:09:52.530183+0000","last_clean":"2024-09-14T12:09:52.530183+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:09:52.530183+0000","last_undegraded":"2024-09-14T12:09:52.530183+0000","last_fullsized":"2024-09-14T12:09:52.530183+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.929041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'217","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.572311+0000","last_change":"2024-09-14T11:11:06.650554+0000","last_active":"2024-09-14T12:07:57.572311+0000","last_peered":"2024-09-14T12:07:57.572311+0000","last_clean":"2024-09-14T12:07:57.572311+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:07:57.572311+0000","last_undegraded":"2024-09-14T12:07:57.572311+0000","last_fullsized":"2024-09-14T12:07:57.572311+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:31.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.883384+0000","last_change":"2024-09-14T11:10:58.602798+0000","last_active":"2024-09-14T12:07:04.883384+0000","last_peered":"2024-09-14T12:07:04.883384+0000","last_clean":"2024-09-14T12:07:04.883384+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:07:04.883384+0000","last_undegraded":"2024-09-14T12:07:04.883384+0000","last_fullsized":"2024-09-14T12:07:04.883384+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.362755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'350","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:01.028557+0000","last_change":"2024-09-14T11:10:56.612227+0000","last_active":"2024-09-14T12:07:01.028557+0000","last_peered":"2024-09-14T12:07:01.028557+0000","last_clean":"2024-09-14T12:07:01.028557+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:07:01.028557+0000","last_undegraded":"2024-09-14T12:07:01.028557+0000","last_fullsized":"2024-09-14T12:07:01.028557+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:54.163614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320165,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":932,"num_read_kb":6071,"num_write":1196,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711951+0000","last_change":"2024-09-14T11:11:00.611895+0000","last_active":"2024-09-14T12:06:39.711951+0000","last_peered":"2024-09-14T12:06:39.711951+0000","last_clean":"2024-09-14T12:06:39.711951+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:06:39.711951+0000","last_undegraded":"2024-09-14T12:06:39.711951+0000","last_fullsized":"2024-09-14T12:06:39.711951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:07.634034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.469446+0000","last_change":"2024-09-14T11:11:02.883054+0000","last_active":"2024-09-14T12:09:53.469446+0000","last_peered":"2024-09-14T12:09:53.469446+0000","last_clean":"2024-09-14T12:09:53.469446+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:09:53.469446+0000","last_undegraded":"2024-09-14T12:09:53.469446+0000","last_fullsized":"2024-09-14T12:09:53.469446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:16.798635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'791","reported_seq":2487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.146287+0000","last_change":"2024-09-14T11:11:04.639858+0000","last_active":"2024-09-14T12:09:54.146287+0000","last_peered":"2024-09-14T12:09:54.146287+0000","last_clean":"2024-09-14T12:09:54.146287+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:09:54.146287+0000","last_undegraded":"2024-09-14T12:09:54.146287+0000","last_fullsized":"2024-09-14T12:09:54.146287+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:13.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717940+0000","last_change":"2024-09-14T11:10:58.598011+0000","last_active":"2024-09-14T12:07:19.717940+0000","last_peered":"2024-09-14T12:07:19.717940+0000","last_clean":"2024-09-14T12:07:19.717940+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:07:19.717940+0000","last_undegraded":"2024-09-14T12:07:19.717940+0000","last_fullsized":"2024-09-14T12:07:19.717940+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:52.644545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'371","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.543142+0000","last_change":"2024-09-14T11:10:56.616170+0000","last_active":"2024-09-14T12:09:54.543142+0000","last_peered":"2024-09-14T12:09:54.543142+0000","last_clean":"2024-09-14T12:09:54.543142+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:09:54.543142+0000","last_undegraded":"2024-09-14T12:09:54.543142+0000","last_fullsized":"2024-09-14T12:09:54.543142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:36.161974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343370,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":30361,"num_write":1109,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582730+0000","last_change":"2024-09-14T11:11:00.603633+0000","last_active":"2024-09-14T12:07:24.582730+0000","last_peered":"2024-09-14T12:07:24.582730+0000","last_clean":"2024-09-14T12:07:24.582730+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:07:24.582730+0000","last_undegraded":"2024-09-14T12:07:24.582730+0000","last_fullsized":"2024-09-14T12:07:24.582730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:24.637144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'380","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.075411+0000","last_change":"2024-09-14T11:11:02.882354+0000","last_active":"2024-09-14T12:09:54.075411+0000","last_peered":"2024-09-14T12:09:54.075411+0000","last_clean":"2024-09-14T12:09:54.075411+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:09:54.075411+0000","last_undegraded":"2024-09-14T12:09:54.075411+0000","last_fullsized":"2024-09-14T12:09:54.075411+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:23.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671886+0000","last_change":"2024-09-14T11:11:04.630742+0000","last_active":"2024-09-14T12:07:20.671886+0000","last_peered":"2024-09-14T12:07:20.671886+0000","last_clean":"2024-09-14T12:07:20.671886+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:07:20.671886+0000","last_undegraded":"2024-09-14T12:07:20.671886+0000","last_fullsized":"2024-09-14T12:07:20.671886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:21.580563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'537","reported_seq":1354,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.874293+0000","last_change":"2024-09-14T11:11:06.650569+0000","last_active":"2024-09-14T12:09:14.874293+0000","last_peered":"2024-09-14T12:09:14.874293+0000","last_clean":"2024-09-14T12:09:14.874293+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:09:14.874293+0000","last_undegraded":"2024-09-14T12:09:14.874293+0000","last_fullsized":"2024-09-14T12:09:14.874293+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.704565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.881520+0000","last_change":"2024-09-14T11:10:58.600081+0000","last_active":"2024-09-14T12:09:13.881520+0000","last_peered":"2024-09-14T12:09:13.881520+0000","last_clean":"2024-09-14T12:09:13.881520+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:09:13.881520+0000","last_undegraded":"2024-09-14T12:09:13.881520+0000","last_fullsized":"2024-09-14T12:09:13.881520+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:49.242910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'382","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.567050+0000","last_change":"2024-09-14T11:10:56.608381+0000","last_active":"2024-09-14T12:09:54.567050+0000","last_peered":"2024-09-14T12:09:54.567050+0000","last_clean":"2024-09-14T12:09:54.567050+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:09:54.567050+0000","last_undegraded":"2024-09-14T12:09:54.567050+0000","last_fullsized":"2024-09-14T12:09:54.567050+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:44.373341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":57128,"num_write":1150,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656137+0000","last_change":"2024-09-14T11:11:00.610368+0000","last_active":"2024-09-14T12:07:24.656137+0000","last_peered":"2024-09-14T12:07:24.656137+0000","last_clean":"2024-09-14T12:07:24.656137+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:07:24.656137+0000","last_undegraded":"2024-09-14T12:07:24.656137+0000","last_fullsized":"2024-09-14T12:07:24.656137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:41.032264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'270","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.724302+0000","last_change":"2024-09-14T11:11:02.620109+0000","last_active":"2024-09-14T12:09:52.724302+0000","last_peered":"2024-09-14T12:09:52.724302+0000","last_clean":"2024-09-14T12:09:52.724302+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:09:52.724302+0000","last_undegraded":"2024-09-14T12:09:52.724302+0000","last_fullsized":"2024-09-14T12:09:52.724302+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:44.080763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.684553+0000","last_change":"2024-09-14T11:11:04.638763+0000","last_active":"2024-09-14T12:07:34.684553+0000","last_peered":"2024-09-14T12:07:34.684553+0000","last_clean":"2024-09-14T12:07:34.684553+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:07:34.684553+0000","last_undegraded":"2024-09-14T12:07:34.684553+0000","last_fullsized":"2024-09-14T12:07:34.684553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:07.104699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2496","reported_seq":4317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.077061+0000","last_change":"2024-09-14T11:11:06.650408+0000","last_active":"2024-09-14T12:09:04.077061+0000","last_peered":"2024-09-14T12:09:04.077061+0000","last_clean":"2024-09-14T12:09:04.077061+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:09:04.077061+0000","last_undegraded":"2024-09-14T12:09:04.077061+0000","last_fullsized":"2024-09-14T12:09:04.077061+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:25.723597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4177","reported_seq":4819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589584+0000","last_change":"2024-09-14T11:10:58.612551+0000","last_active":"2024-09-14T12:07:30.589584+0000","last_peered":"2024-09-14T12:07:30.589584+0000","last_clean":"2024-09-14T12:07:30.589584+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:07:30.589584+0000","last_undegraded":"2024-09-14T12:07:30.589584+0000","last_fullsized":"2024-09-14T12:07:30.589584+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":3000,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.250782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.568383+0000","last_change":"2024-09-14T11:10:56.609814+0000","last_active":"2024-09-14T12:09:54.568383+0000","last_peered":"2024-09-14T12:09:54.568383+0000","last_clean":"2024-09-14T12:09:54.568383+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:09:54.568383+0000","last_undegraded":"2024-09-14T12:09:54.568383+0000","last_fullsized":"2024-09-14T12:09:54.568383+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:46.610327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":622,"num_read_kb":21988,"num_write":1236,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655616+0000","last_change":"2024-09-14T11:11:00.609607+0000","last_active":"2024-09-14T12:07:19.655616+0000","last_peered":"2024-09-14T12:07:19.655616+0000","last_clean":"2024-09-14T12:07:19.655616+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:07:19.655616+0000","last_undegraded":"2024-09-14T12:07:19.655616+0000","last_fullsized":"2024-09-14T12:07:19.655616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:33.650477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'309","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.203620+0000","last_change":"2024-09-14T11:11:02.615273+0000","last_active":"2024-09-14T12:09:54.203620+0000","last_peered":"2024-09-14T12:09:54.203620+0000","last_clean":"2024-09-14T12:09:54.203620+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:09:54.203620+0000","last_undegraded":"2024-09-14T12:09:54.203620+0000","last_fullsized":"2024-09-14T12:09:54.203620+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:37.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'776","reported_seq":2790,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.436264+0000","last_change":"2024-09-14T11:11:04.634337+0000","last_active":"2024-09-14T12:09:18.436264+0000","last_peered":"2024-09-14T12:09:18.436264+0000","last_clean":"2024-09-14T12:09:18.436264+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:09:18.436264+0000","last_undegraded":"2024-09-14T12:09:18.436264+0000","last_fullsized":"2024-09-14T12:09:18.436264+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":701,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:25.363526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'154","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.869470+0000","last_change":"2024-09-14T11:11:06.648183+0000","last_active":"2024-09-14T12:09:13.869470+0000","last_peered":"2024-09-14T12:09:13.869470+0000","last_clean":"2024-09-14T12:09:13.869470+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:09:13.869470+0000","last_undegraded":"2024-09-14T12:09:13.869470+0000","last_fullsized":"2024-09-14T12:09:13.869470+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:52.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569651+0000","last_change":"2024-09-14T11:10:58.614518+0000","last_active":"2024-09-14T12:07:15.569651+0000","last_peered":"2024-09-14T12:07:15.569651+0000","last_clean":"2024-09-14T12:07:15.569651+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:07:15.569651+0000","last_undegraded":"2024-09-14T12:07:15.569651+0000","last_fullsized":"2024-09-14T12:07:15.569651+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:29.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'363","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.626569+0000","last_change":"2024-09-14T11:10:56.622559+0000","last_active":"2024-09-14T12:09:54.626569+0000","last_peered":"2024-09-14T12:09:54.626569+0000","last_clean":"2024-09-14T12:09:54.626569+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:09:54.626569+0000","last_undegraded":"2024-09-14T12:09:54.626569+0000","last_fullsized":"2024-09-14T12:09:54.626569+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:02.051757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":27518,"num_write":1081,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.656694+0000","last_change":"2024-09-14T11:11:00.617025+0000","last_active":"2024-09-14T12:07:29.656694+0000","last_peered":"2024-09-14T12:07:29.656694+0000","last_clean":"2024-09-14T12:07:29.656694+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:07:29.656694+0000","last_undegraded":"2024-09-14T12:07:29.656694+0000","last_fullsized":"2024-09-14T12:07:29.656694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.898496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'469","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.859881+0000","last_change":"2024-09-14T11:11:02.617234+0000","last_active":"2024-09-14T12:09:14.859881+0000","last_peered":"2024-09-14T12:09:14.859881+0000","last_clean":"2024-09-14T12:09:14.859881+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:09:14.859881+0000","last_undegraded":"2024-09-14T12:09:14.859881+0000","last_fullsized":"2024-09-14T12:09:14.859881+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:10.153711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":1773,"num_write":682,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656109+0000","last_change":"2024-09-14T11:11:04.629148+0000","last_active":"2024-09-14T12:07:24.656109+0000","last_peered":"2024-09-14T12:07:24.656109+0000","last_clean":"2024-09-14T12:07:24.656109+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:07:24.656109+0000","last_undegraded":"2024-09-14T12:07:24.656109+0000","last_fullsized":"2024-09-14T12:07:24.656109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.153280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'174","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.360071+0000","last_change":"2024-09-14T11:11:06.652430+0000","last_active":"2024-09-14T12:07:57.360071+0000","last_peered":"2024-09-14T12:07:57.360071+0000","last_clean":"2024-09-14T12:07:57.360071+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:07:57.360071+0000","last_undegraded":"2024-09-14T12:07:57.360071+0000","last_fullsized":"2024-09-14T12:07:57.360071+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:26.755770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580740+0000","last_change":"2024-09-14T11:10:58.612653+0000","last_active":"2024-09-14T12:07:14.580740+0000","last_peered":"2024-09-14T12:07:14.580740+0000","last_clean":"2024-09-14T12:07:14.580740+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:07:14.580740+0000","last_undegraded":"2024-09-14T12:07:14.580740+0000","last_fullsized":"2024-09-14T12:07:14.580740+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:48.760017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'301","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656443+0000","last_change":"2024-09-14T11:12:33.311513+0000","last_active":"2024-09-14T12:09:54.656443+0000","last_peered":"2024-09-14T12:09:54.656443+0000","last_clean":"2024-09-14T12:09:54.656443+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:09:54.656443+0000","last_undegraded":"2024-09-14T12:09:54.656443+0000","last_fullsized":"2024-09-14T12:09:54.656443+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:12.192936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079951,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":20886,"num_write":920,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655667+0000","last_change":"2024-09-14T11:11:00.613586+0000","last_active":"2024-09-14T12:07:19.655667+0000","last_peered":"2024-09-14T12:07:19.655667+0000","last_clean":"2024-09-14T12:07:19.655667+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:07:19.655667+0000","last_undegraded":"2024-09-14T12:07:19.655667+0000","last_fullsized":"2024-09-14T12:07:19.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.876699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.032254+0000","last_change":"2024-09-14T11:11:02.617188+0000","last_active":"2024-09-14T12:09:53.032254+0000","last_peered":"2024-09-14T12:09:53.032254+0000","last_clean":"2024-09-14T12:09:53.032254+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:09:53.032254+0000","last_undegraded":"2024-09-14T12:09:53.032254+0000","last_fullsized":"2024-09-14T12:09:53.032254+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:27.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571992+0000","last_change":"2024-09-14T11:11:04.638409+0000","last_active":"2024-09-14T12:07:35.571992+0000","last_peered":"2024-09-14T12:07:35.571992+0000","last_clean":"2024-09-14T12:07:35.571992+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:07:35.571992+0000","last_undegraded":"2024-09-14T12:07:35.571992+0000","last_fullsized":"2024-09-14T12:07:35.571992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.627071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'96","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.080423+0000","last_change":"2024-09-14T11:11:06.653079+0000","last_active":"2024-09-14T12:09:04.080423+0000","last_peered":"2024-09-14T12:09:04.080423+0000","last_clean":"2024-09-14T12:09:04.080423+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:09:04.080423+0000","last_undegraded":"2024-09-14T12:09:04.080423+0000","last_fullsized":"2024-09-14T12:09:04.080423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:58.237781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580780+0000","last_change":"2024-09-14T11:10:58.606197+0000","last_active":"2024-09-14T12:07:14.580780+0000","last_peered":"2024-09-14T12:07:14.580780+0000","last_clean":"2024-09-14T12:07:14.580780+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:07:14.580780+0000","last_undegraded":"2024-09-14T12:07:14.580780+0000","last_fullsized":"2024-09-14T12:07:14.580780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.386371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'291","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589566+0000","last_change":"2024-09-14T11:10:56.604612+0000","last_active":"2024-09-14T12:07:30.589566+0000","last_peered":"2024-09-14T12:07:30.589566+0000","last_clean":"2024-09-14T12:07:30.589566+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:07:30.589566+0000","last_undegraded":"2024-09-14T12:07:30.589566+0000","last_fullsized":"2024-09-14T12:07:30.589566+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:22.350680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12615080,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":632,"num_read_kb":12874,"num_write":1098,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"37'5","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.801177+0000","last_change":"2024-09-14T11:11:00.609637+0000","last_active":"2024-09-14T12:09:14.801177+0000","last_peered":"2024-09-14T12:09:14.801177+0000","last_clean":"2024-09-14T12:09:14.801177+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:09:14.801177+0000","last_undegraded":"2024-09-14T12:09:14.801177+0000","last_fullsized":"2024-09-14T12:09:14.801177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:16.269070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.665700+0000","last_change":"2024-09-14T11:11:02.621512+0000","last_active":"2024-09-14T12:09:54.665700+0000","last_peered":"2024-09-14T12:09:54.665700+0000","last_clean":"2024-09-14T12:09:54.665700+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:09:54.665700+0000","last_undegraded":"2024-09-14T12:09:54.665700+0000","last_fullsized":"2024-09-14T12:09:54.665700+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:59.728870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'737","reported_seq":2478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.117272+0000","last_change":"2024-09-14T11:11:04.632093+0000","last_active":"2024-09-14T12:09:54.117272+0000","last_peered":"2024-09-14T12:09:54.117272+0000","last_clean":"2024-09-14T12:09:54.117272+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:09:54.117272+0000","last_undegraded":"2024-09-14T12:09:54.117272+0000","last_fullsized":"2024-09-14T12:09:54.117272+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:57.296761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.523143+0000","last_change":"2024-09-14T11:11:06.644785+0000","last_active":"2024-09-14T12:07:55.523143+0000","last_peered":"2024-09-14T12:07:55.523143+0000","last_clean":"2024-09-14T12:07:55.523143+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:07:55.523143+0000","last_undegraded":"2024-09-14T12:07:55.523143+0000","last_fullsized":"2024-09-14T12:07:55.523143+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:20.927650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":716,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580793+0000","last_change":"2024-09-14T11:10:58.604051+0000","last_active":"2024-09-14T12:07:14.580793+0000","last_peered":"2024-09-14T12:07:14.580793+0000","last_clean":"2024-09-14T12:07:14.580793+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:07:14.580793+0000","last_undegraded":"2024-09-14T12:07:14.580793+0000","last_fullsized":"2024-09-14T12:07:14.580793+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:21.106777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'306","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.500861+0000","last_change":"2024-09-14T11:10:56.614986+0000","last_active":"2024-09-14T12:09:54.500861+0000","last_peered":"2024-09-14T12:09:54.500861+0000","last_clean":"2024-09-14T12:09:54.500861+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:54.500861+0000","last_undegraded":"2024-09-14T12:09:54.500861+0000","last_fullsized":"2024-09-14T12:09:54.500861+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:02.927242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":37577,"num_write":937,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.939893+0000","last_change":"2024-09-14T11:11:00.612934+0000","last_active":"2024-09-14T12:09:51.939893+0000","last_peered":"2024-09-14T12:09:51.939893+0000","last_clean":"2024-09-14T12:09:51.939893+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:09:51.939893+0000","last_undegraded":"2024-09-14T12:09:51.939893+0000","last_fullsized":"2024-09-14T12:09:51.939893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:31.596836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'90","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682622+0000","last_change":"2024-09-14T11:11:02.882134+0000","last_active":"2024-09-14T12:07:19.682622+0000","last_peered":"2024-09-14T12:07:19.682622+0000","last_clean":"2024-09-14T12:07:19.682622+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:07:19.682622+0000","last_undegraded":"2024-09-14T12:07:19.682622+0000","last_fullsized":"2024-09-14T12:07:19.682622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.534285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'771","reported_seq":2468,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.430883+0000","last_change":"2024-09-14T11:11:04.634705+0000","last_active":"2024-09-14T12:09:18.430883+0000","last_peered":"2024-09-14T12:09:18.430883+0000","last_clean":"2024-09-14T12:09:18.430883+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:09:18.430883+0000","last_undegraded":"2024-09-14T12:09:18.430883+0000","last_fullsized":"2024-09-14T12:09:18.430883+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:03.937654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'114","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582391+0000","last_change":"2024-09-14T11:11:06.646677+0000","last_active":"2024-09-14T12:07:24.582391+0000","last_peered":"2024-09-14T12:07:24.582391+0000","last_clean":"2024-09-14T12:07:24.582391+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:07:24.582391+0000","last_undegraded":"2024-09-14T12:07:24.582391+0000","last_fullsized":"2024-09-14T12:07:24.582391+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:35.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'141","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672466+0000","last_change":"2024-09-14T11:10:58.604050+0000","last_active":"2024-09-14T12:07:25.672466+0000","last_peered":"2024-09-14T12:07:25.672466+0000","last_clean":"2024-09-14T12:07:25.672466+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:07:25.672466+0000","last_undegraded":"2024-09-14T12:07:25.672466+0000","last_fullsized":"2024-09-14T12:07:25.672466+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:01.910346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.606683+0000","last_change":"2024-09-14T11:10:56.621625+0000","last_active":"2024-09-14T12:09:54.606683+0000","last_peered":"2024-09-14T12:09:54.606683+0000","last_clean":"2024-09-14T12:09:54.606683+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:09:54.606683+0000","last_undegraded":"2024-09-14T12:09:54.606683+0000","last_fullsized":"2024-09-14T12:09:54.606683+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.662417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581695+0000","last_change":"2024-09-14T11:11:00.612752+0000","last_active":"2024-09-14T12:07:19.581695+0000","last_peered":"2024-09-14T12:07:19.581695+0000","last_clean":"2024-09-14T12:07:19.581695+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:07:19.581695+0000","last_undegraded":"2024-09-14T12:07:19.581695+0000","last_fullsized":"2024-09-14T12:07:19.581695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.297030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'355","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.860007+0000","last_change":"2024-09-14T11:11:02.616725+0000","last_active":"2024-09-14T12:09:53.860007+0000","last_peered":"2024-09-14T12:09:53.860007+0000","last_clean":"2024-09-14T12:09:53.860007+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:09:53.860007+0000","last_undegraded":"2024-09-14T12:09:53.860007+0000","last_fullsized":"2024-09-14T12:09:53.860007+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:01.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.588143+0000","last_change":"2024-09-14T11:11:04.635198+0000","last_active":"2024-09-14T12:07:20.588143+0000","last_peered":"2024-09-14T12:07:20.588143+0000","last_clean":"2024-09-14T12:07:20.588143+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:07:20.588143+0000","last_undegraded":"2024-09-14T12:07:20.588143+0000","last_fullsized":"2024-09-14T12:07:20.588143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:55.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'136","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672420+0000","last_change":"2024-09-14T11:11:06.646340+0000","last_active":"2024-09-14T12:07:25.672420+0000","last_peered":"2024-09-14T12:07:25.672420+0000","last_clean":"2024-09-14T12:07:25.672420+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:07:25.672420+0000","last_undegraded":"2024-09-14T12:07:25.672420+0000","last_fullsized":"2024-09-14T12:07:25.672420+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:44.114108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'105","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:55.202777+0000","last_change":"2024-09-14T11:10:58.606027+0000","last_active":"2024-09-14T12:08:55.202777+0000","last_peered":"2024-09-14T12:08:55.202777+0000","last_clean":"2024-09-14T12:08:55.202777+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:08:55.202777+0000","last_undegraded":"2024-09-14T12:08:55.202777+0000","last_fullsized":"2024-09-14T12:08:55.202777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:25.981163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578466+0000","last_change":"2024-09-14T11:10:40.558361+0000","last_active":"2024-09-14T12:06:54.578466+0000","last_peered":"2024-09-14T12:06:54.578466+0000","last_clean":"2024-09-14T12:06:54.578466+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:06:54.578466+0000","last_undegraded":"2024-09-14T12:06:54.578466+0000","last_fullsized":"2024-09-14T12:06:54.578466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_clean_scrub_stamp":"2024-09-14T11:10:39.523268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:36.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715535+0000","last_change":"2024-09-14T11:10:49.566289+0000","last_active":"2024-09-14T12:07:04.715535+0000","last_peered":"2024-09-14T12:07:04.715535+0000","last_clean":"2024-09-14T12:07:04.715535+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:07:04.715535+0000","last_undegraded":"2024-09-14T12:07:04.715535+0000","last_fullsized":"2024-09-14T12:07:04.715535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:43.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'316","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.558033+0000","last_change":"2024-09-14T11:10:56.613702+0000","last_active":"2024-09-14T12:09:54.558033+0000","last_peered":"2024-09-14T12:09:54.558033+0000","last_clean":"2024-09-14T12:09:54.558033+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:09:54.558033+0000","last_undegraded":"2024-09-14T12:09:54.558033+0000","last_fullsized":"2024-09-14T12:09:54.558033+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.052677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079939,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":21923,"num_write":1074,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582005+0000","last_change":"2024-09-14T11:11:00.610291+0000","last_active":"2024-09-14T12:07:19.582005+0000","last_peered":"2024-09-14T12:07:19.582005+0000","last_clean":"2024-09-14T12:07:19.582005+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:07:19.582005+0000","last_undegraded":"2024-09-14T12:07:19.582005+0000","last_fullsized":"2024-09-14T12:07:19.582005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:59.638567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'762","reported_seq":1474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.547865+0000","last_change":"2024-09-14T11:11:02.621281+0000","last_active":"2024-09-14T12:09:54.547865+0000","last_peered":"2024-09-14T12:09:54.547865+0000","last_clean":"2024-09-14T12:09:54.547865+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:09:54.547865+0000","last_undegraded":"2024-09-14T12:09:54.547865+0000","last_fullsized":"2024-09-14T12:09:54.547865+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:39.469737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.570862+0000","last_change":"2024-09-14T11:11:04.632962+0000","last_active":"2024-09-14T12:07:25.570862+0000","last_peered":"2024-09-14T12:07:25.570862+0000","last_clean":"2024-09-14T12:07:25.570862+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:07:25.570862+0000","last_undegraded":"2024-09-14T12:07:25.570862+0000","last_fullsized":"2024-09-14T12:07:25.570862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'182","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.397769+0000","last_change":"2024-09-14T11:11:06.647490+0000","last_active":"2024-09-14T12:07:57.397769+0000","last_peered":"2024-09-14T12:07:57.397769+0000","last_clean":"2024-09-14T12:07:57.397769+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:07:57.397769+0000","last_undegraded":"2024-09-14T12:07:57.397769+0000","last_fullsized":"2024-09-14T12:07:57.397769+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:49.491579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570300+0000","last_change":"2024-09-14T11:10:58.611939+0000","last_active":"2024-09-14T12:07:20.570300+0000","last_peered":"2024-09-14T12:07:20.570300+0000","last_clean":"2024-09-14T12:07:20.570300+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:07:20.570300+0000","last_undegraded":"2024-09-14T12:07:20.570300+0000","last_fullsized":"2024-09-14T12:07:20.570300+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:08.887333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579159+0000","last_change":"2024-09-14T11:10:49.784961+0000","last_active":"2024-09-14T12:06:59.579159+0000","last_peered":"2024-09-14T12:06:59.579159+0000","last_clean":"2024-09-14T12:06:59.579159+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:06:59.579159+0000","last_undegraded":"2024-09-14T12:06:59.579159+0000","last_fullsized":"2024-09-14T12:06:59.579159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:46.921965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'287","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569607+0000","last_change":"2024-09-14T11:11:33.134121+0000","last_active":"2024-09-14T12:07:15.569607+0000","last_peered":"2024-09-14T12:07:15.569607+0000","last_clean":"2024-09-14T12:07:15.569607+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:07:15.569607+0000","last_undegraded":"2024-09-14T12:07:15.569607+0000","last_fullsized":"2024-09-14T12:07:15.569607+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:48.763975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327439,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":560,"num_read_kb":48298,"num_write":1126,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.718904+0000","last_change":"2024-09-14T11:11:00.610424+0000","last_active":"2024-09-14T12:07:24.718904+0000","last_peered":"2024-09-14T12:07:24.718904+0000","last_clean":"2024-09-14T12:07:24.718904+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:07:24.718904+0000","last_undegraded":"2024-09-14T12:07:24.718904+0000","last_fullsized":"2024-09-14T12:07:24.718904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:04.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1258","reported_seq":2879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.392206+0000","last_change":"2024-09-14T11:11:02.616425+0000","last_active":"2024-09-14T12:09:18.392206+0000","last_peered":"2024-09-14T12:09:18.392206+0000","last_clean":"2024-09-14T12:09:18.392206+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:09:18.392206+0000","last_undegraded":"2024-09-14T12:09:18.392206+0000","last_fullsized":"2024-09-14T12:09:18.392206+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:08.009826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162865,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1989,"num_read_kb":3399,"num_write":1118,"num_write_kb":950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583514+0000","last_change":"2024-09-14T11:11:04.638084+0000","last_active":"2024-09-14T12:07:29.583514+0000","last_peered":"2024-09-14T12:07:29.583514+0000","last_clean":"2024-09-14T12:07:29.583514+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:07:29.583514+0000","last_undegraded":"2024-09-14T12:07:29.583514+0000","last_fullsized":"2024-09-14T12:07:29.583514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.322127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'220","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:40.673987+0000","last_change":"2024-09-14T11:11:06.643093+0000","last_active":"2024-09-14T12:07:40.673987+0000","last_peered":"2024-09-14T12:07:40.673987+0000","last_clean":"2024-09-14T12:07:40.673987+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:07:40.673987+0000","last_undegraded":"2024-09-14T12:07:40.673987+0000","last_fullsized":"2024-09-14T12:07:40.673987+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:50.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671975+0000","last_change":"2024-09-14T11:10:58.601798+0000","last_active":"2024-09-14T12:07:20.671975+0000","last_peered":"2024-09-14T12:07:20.671975+0000","last_clean":"2024-09-14T12:07:20.671975+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:07:20.671975+0000","last_undegraded":"2024-09-14T12:07:20.671975+0000","last_fullsized":"2024-09-14T12:07:20.671975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.795951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.652217+0000","last_change":"2024-09-14T11:10:50.167984+0000","last_active":"2024-09-14T12:07:04.652217+0000","last_peered":"2024-09-14T12:07:04.652217+0000","last_clean":"2024-09-14T12:07:04.652217+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:07:04.652217+0000","last_undegraded":"2024-09-14T12:07:04.652217+0000","last_fullsized":"2024-09-14T12:07:04.652217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:56.618404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'307","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670759+0000","last_change":"2024-09-14T11:10:56.605398+0000","last_active":"2024-09-14T12:07:10.670759+0000","last_peered":"2024-09-14T12:07:10.670759+0000","last_clean":"2024-09-14T12:07:10.670759+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:07:10.670759+0000","last_undegraded":"2024-09-14T12:07:10.670759+0000","last_fullsized":"2024-09-14T12:07:10.670759+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:37.462380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5921611,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":582,"num_read_kb":34638,"num_write":1151,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656189+0000","last_change":"2024-09-14T11:11:00.611993+0000","last_active":"2024-09-14T12:07:24.656189+0000","last_peered":"2024-09-14T12:07:24.656189+0000","last_clean":"2024-09-14T12:07:24.656189+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:07:24.656189+0000","last_undegraded":"2024-09-14T12:07:24.656189+0000","last_fullsized":"2024-09-14T12:07:24.656189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:06.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.035888+0000","last_change":"2024-09-14T11:11:02.887250+0000","last_active":"2024-09-14T12:09:15.035888+0000","last_peered":"2024-09-14T12:09:15.035888+0000","last_clean":"2024-09-14T12:09:15.035888+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:09:15.035888+0000","last_undegraded":"2024-09-14T12:09:15.035888+0000","last_fullsized":"2024-09-14T12:09:15.035888+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:22.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570276+0000","last_change":"2024-09-14T11:11:04.635365+0000","last_active":"2024-09-14T12:07:20.570276+0000","last_peered":"2024-09-14T12:07:20.570276+0000","last_clean":"2024-09-14T12:07:20.570276+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:07:20.570276+0000","last_undegraded":"2024-09-14T12:07:20.570276+0000","last_fullsized":"2024-09-14T12:07:20.570276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:48.407204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'240","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.650870+0000","last_change":"2024-09-14T11:11:06.650013+0000","last_active":"2024-09-14T12:07:57.650870+0000","last_peered":"2024-09-14T12:07:57.650870+0000","last_clean":"2024-09-14T12:07:57.650870+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:07:57.650870+0000","last_undegraded":"2024-09-14T12:07:57.650870+0000","last_fullsized":"2024-09-14T12:07:57.650870+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.193259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671361+0000","last_change":"2024-09-14T11:10:58.611132+0000","last_active":"2024-09-14T12:07:15.671361+0000","last_peered":"2024-09-14T12:07:15.671361+0000","last_clean":"2024-09-14T12:07:15.671361+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:07:15.671361+0000","last_undegraded":"2024-09-14T12:07:15.671361+0000","last_fullsized":"2024-09-14T12:07:15.671361+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:47.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715494+0000","last_change":"2024-09-14T11:10:49.566261+0000","last_active":"2024-09-14T12:07:04.715494+0000","last_peered":"2024-09-14T12:07:04.715494+0000","last_clean":"2024-09-14T12:07:04.715494+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:07:04.715494+0000","last_undegraded":"2024-09-14T12:07:04.715494+0000","last_fullsized":"2024-09-14T12:07:04.715494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:49.383472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'315","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562262+0000","last_change":"2024-09-14T11:10:56.606302+0000","last_active":"2024-09-14T12:09:54.562262+0000","last_peered":"2024-09-14T12:09:54.562262+0000","last_clean":"2024-09-14T12:09:54.562262+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:09:54.562262+0000","last_undegraded":"2024-09-14T12:09:54.562262+0000","last_fullsized":"2024-09-14T12:09:54.562262+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.821812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454581,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":658,"num_read_kb":8841,"num_write":1004,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.814661+0000","last_change":"2024-09-14T11:11:00.607385+0000","last_active":"2024-09-14T12:09:14.814661+0000","last_peered":"2024-09-14T12:09:14.814661+0000","last_clean":"2024-09-14T12:09:14.814661+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:09:14.814661+0000","last_undegraded":"2024-09-14T12:09:14.814661+0000","last_fullsized":"2024-09-14T12:09:14.814661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:18.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'141","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.049855+0000","last_change":"2024-09-14T11:11:02.619842+0000","last_active":"2024-09-14T12:09:15.049855+0000","last_peered":"2024-09-14T12:09:15.049855+0000","last_clean":"2024-09-14T12:09:15.049855+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:09:15.049855+0000","last_undegraded":"2024-09-14T12:09:15.049855+0000","last_fullsized":"2024-09-14T12:09:15.049855+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:29.586585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.588952+0000","last_change":"2024-09-14T11:11:04.632880+0000","last_active":"2024-09-14T12:07:25.588952+0000","last_peered":"2024-09-14T12:07:25.588952+0000","last_clean":"2024-09-14T12:07:25.588952+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:07:25.588952+0000","last_undegraded":"2024-09-14T12:07:25.588952+0000","last_fullsized":"2024-09-14T12:07:25.588952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:41.973457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.719671+0000","last_change":"2024-09-14T11:11:06.652421+0000","last_active":"2024-09-14T12:07:29.719671+0000","last_peered":"2024-09-14T12:07:29.719671+0000","last_clean":"2024-09-14T12:07:29.719671+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:07:29.719671+0000","last_undegraded":"2024-09-14T12:07:29.719671+0000","last_fullsized":"2024-09-14T12:07:29.719671+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:13.461185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:49.658858+0000","last_change":"2024-09-14T11:11:32.676598+0000","last_active":"2024-09-14T12:07:49.658858+0000","last_peered":"2024-09-14T12:07:49.658858+0000","last_clean":"2024-09-14T12:07:49.658858+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:07:49.658858+0000","last_undegraded":"2024-09-14T12:07:49.658858+0000","last_fullsized":"2024-09-14T12:07:49.658858+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:34.343713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.650599+0000","last_change":"2024-09-14T11:10:56.607551+0000","last_active":"2024-09-14T12:09:54.650599+0000","last_peered":"2024-09-14T12:09:54.650599+0000","last_clean":"2024-09-14T12:09:54.650599+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:09:54.650599+0000","last_undegraded":"2024-09-14T12:09:54.650599+0000","last_fullsized":"2024-09-14T12:09:54.650599+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:34.558354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.670214+0000","last_change":"2024-09-14T11:10:49.565862+0000","last_active":"2024-09-14T12:07:05.670214+0000","last_peered":"2024-09-14T12:07:05.670214+0000","last_clean":"2024-09-14T12:07:05.670214+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:07:05.670214+0000","last_undegraded":"2024-09-14T12:07:05.670214+0000","last_fullsized":"2024-09-14T12:07:05.670214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:23.143257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569681+0000","last_change":"2024-09-14T11:11:00.604266+0000","last_active":"2024-09-14T12:07:15.569681+0000","last_peered":"2024-09-14T12:07:15.569681+0000","last_clean":"2024-09-14T12:07:15.569681+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:07:15.569681+0000","last_undegraded":"2024-09-14T12:07:15.569681+0000","last_fullsized":"2024-09-14T12:07:15.569681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:23.466098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'581","reported_seq":1244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.865130+0000","last_change":"2024-09-14T11:11:02.621799+0000","last_active":"2024-09-14T12:09:14.865130+0000","last_peered":"2024-09-14T12:09:14.865130+0000","last_clean":"2024-09-14T12:09:14.865130+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:09:14.865130+0000","last_undegraded":"2024-09-14T12:09:14.865130+0000","last_fullsized":"2024-09-14T12:09:14.865130+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:35.213739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1643,"num_read_kb":2634,"num_write":2206,"num_write_kb":2061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581595+0000","last_change":"2024-09-14T11:11:04.637891+0000","last_active":"2024-09-14T12:07:19.581595+0000","last_peered":"2024-09-14T12:07:19.581595+0000","last_clean":"2024-09-14T12:07:19.581595+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:07:19.581595+0000","last_undegraded":"2024-09-14T12:07:19.581595+0000","last_fullsized":"2024-09-14T12:07:19.581595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.595704+0000","last_change":"2024-09-14T11:11:06.644529+0000","last_active":"2024-09-14T12:07:54.595704+0000","last_peered":"2024-09-14T12:07:54.595704+0000","last_clean":"2024-09-14T12:07:54.595704+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:07:54.595704+0000","last_undegraded":"2024-09-14T12:07:54.595704+0000","last_fullsized":"2024-09-14T12:07:54.595704+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:27.041637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569674+0000","last_change":"2024-09-14T11:10:58.610011+0000","last_active":"2024-09-14T12:07:15.569674+0000","last_peered":"2024-09-14T12:07:15.569674+0000","last_clean":"2024-09-14T12:07:15.569674+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:07:15.569674+0000","last_undegraded":"2024-09-14T12:07:15.569674+0000","last_fullsized":"2024-09-14T12:07:15.569674+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:35.811227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'311","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.055366+0000","last_change":"2024-09-14T11:10:56.602134+0000","last_active":"2024-09-14T12:09:13.055366+0000","last_peered":"2024-09-14T12:09:13.055366+0000","last_clean":"2024-09-14T12:09:13.055366+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:09:13.055366+0000","last_undegraded":"2024-09-14T12:09:13.055366+0000","last_fullsized":"2024-09-14T12:09:13.055366+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:30.985152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10693503,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":604,"num_read_kb":35559,"num_write":1115,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581198+0000","last_change":"2024-09-14T11:10:49.784939+0000","last_active":"2024-09-14T12:07:14.581198+0000","last_peered":"2024-09-14T12:07:14.581198+0000","last_clean":"2024-09-14T12:07:14.581198+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:07:14.581198+0000","last_undegraded":"2024-09-14T12:07:14.581198+0000","last_fullsized":"2024-09-14T12:07:14.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:20.447651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587487+0000","last_change":"2024-09-14T11:11:00.605387+0000","last_active":"2024-09-14T12:07:15.587487+0000","last_peered":"2024-09-14T12:07:15.587487+0000","last_clean":"2024-09-14T12:07:15.587487+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:07:15.587487+0000","last_undegraded":"2024-09-14T12:07:15.587487+0000","last_fullsized":"2024-09-14T12:07:15.587487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:46.178240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'169","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.885619+0000","last_change":"2024-09-14T11:11:02.887280+0000","last_active":"2024-09-14T12:09:13.885619+0000","last_peered":"2024-09-14T12:09:13.885619+0000","last_clean":"2024-09-14T12:09:13.885619+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:09:13.885619+0000","last_undegraded":"2024-09-14T12:09:13.885619+0000","last_fullsized":"2024-09-14T12:09:13.885619+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.345916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.358863+0000","last_change":"2024-09-14T11:11:04.632716+0000","last_active":"2024-09-14T12:09:53.358863+0000","last_peered":"2024-09-14T12:09:53.358863+0000","last_clean":"2024-09-14T12:09:53.358863+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:09:53.358863+0000","last_undegraded":"2024-09-14T12:09:53.358863+0000","last_fullsized":"2024-09-14T12:09:53.358863+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:21.258508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'121","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.871748+0000","last_change":"2024-09-14T11:11:06.651630+0000","last_active":"2024-09-14T12:09:14.871748+0000","last_peered":"2024-09-14T12:09:14.871748+0000","last_clean":"2024-09-14T12:09:14.871748+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:09:14.871748+0000","last_undegraded":"2024-09-14T12:09:14.871748+0000","last_fullsized":"2024-09-14T12:09:14.871748+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:46.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681248+0000","last_change":"2024-09-14T11:10:58.608290+0000","last_active":"2024-09-14T12:07:09.681248+0000","last_peered":"2024-09-14T12:07:09.681248+0000","last_clean":"2024-09-14T12:07:09.681248+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:07:09.681248+0000","last_undegraded":"2024-09-14T12:07:09.681248+0000","last_fullsized":"2024-09-14T12:07:09.681248+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:31.554400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.635141+0000","last_change":"2024-09-14T11:10:56.620615+0000","last_active":"2024-09-14T12:09:54.635141+0000","last_peered":"2024-09-14T12:09:54.635141+0000","last_clean":"2024-09-14T12:09:54.635141+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:09:54.635141+0000","last_undegraded":"2024-09-14T12:09:54.635141+0000","last_fullsized":"2024-09-14T12:09:54.635141+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:20.532731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670837+0000","last_change":"2024-09-14T11:10:49.565917+0000","last_active":"2024-09-14T12:07:10.670837+0000","last_peered":"2024-09-14T12:07:10.670837+0000","last_clean":"2024-09-14T12:07:10.670837+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:07:10.670837+0000","last_undegraded":"2024-09-14T12:07:10.670837+0000","last_fullsized":"2024-09-14T12:07:10.670837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.682606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581576+0000","last_change":"2024-09-14T11:11:00.610462+0000","last_active":"2024-09-14T12:07:19.581576+0000","last_peered":"2024-09-14T12:07:19.581576+0000","last_clean":"2024-09-14T12:07:19.581576+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:07:19.581576+0000","last_undegraded":"2024-09-14T12:07:19.581576+0000","last_fullsized":"2024-09-14T12:07:19.581576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:57.985170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'120","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581610+0000","last_change":"2024-09-14T11:11:02.618565+0000","last_active":"2024-09-14T12:07:19.581610+0000","last_peered":"2024-09-14T12:07:19.581610+0000","last_clean":"2024-09-14T12:07:19.581610+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:07:19.581610+0000","last_undegraded":"2024-09-14T12:07:19.581610+0000","last_fullsized":"2024-09-14T12:07:19.581610+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:49.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'791","reported_seq":6721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.146146+0000","last_change":"2024-09-14T11:11:04.641546+0000","last_active":"2024-09-14T12:09:54.146146+0000","last_peered":"2024-09-14T12:09:54.146146+0000","last_clean":"2024-09-14T12:09:54.146146+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:09:54.146146+0000","last_undegraded":"2024-09-14T12:09:54.146146+0000","last_fullsized":"2024-09-14T12:09:54.146146+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:25.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'211","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.574448+0000","last_change":"2024-09-14T11:11:06.651293+0000","last_active":"2024-09-14T12:07:56.574448+0000","last_peered":"2024-09-14T12:07:56.574448+0000","last_clean":"2024-09-14T12:07:56.574448+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:07:56.574448+0000","last_undegraded":"2024-09-14T12:07:56.574448+0000","last_fullsized":"2024-09-14T12:07:56.574448+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580636+0000","last_change":"2024-09-14T11:10:58.600988+0000","last_active":"2024-09-14T12:07:14.580636+0000","last_peered":"2024-09-14T12:07:14.580636+0000","last_clean":"2024-09-14T12:07:14.580636+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:07:14.580636+0000","last_undegraded":"2024-09-14T12:07:14.580636+0000","last_fullsized":"2024-09-14T12:07:14.580636+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:34.213245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.631818+0000","last_change":"2024-09-14T11:11:32.791407+0000","last_active":"2024-09-14T12:09:54.631818+0000","last_peered":"2024-09-14T12:09:54.631818+0000","last_clean":"2024-09-14T12:09:54.631818+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:09:54.631818+0000","last_undegraded":"2024-09-14T12:09:54.631818+0000","last_fullsized":"2024-09-14T12:09:54.631818+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:37.633694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324752,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":749,"num_read_kb":5404,"num_write":1186,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586795+0000","last_change":"2024-09-14T11:10:49.566365+0000","last_active":"2024-09-14T12:07:10.586795+0000","last_peered":"2024-09-14T12:07:10.586795+0000","last_clean":"2024-09-14T12:07:10.586795+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:07:10.586795+0000","last_undegraded":"2024-09-14T12:07:10.586795+0000","last_fullsized":"2024-09-14T12:07:10.586795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:17.078627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681822+0000","last_change":"2024-09-14T11:11:00.612749+0000","last_active":"2024-09-14T12:07:14.681822+0000","last_peered":"2024-09-14T12:07:14.681822+0000","last_clean":"2024-09-14T12:07:14.681822+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:07:14.681822+0000","last_undegraded":"2024-09-14T12:07:14.681822+0000","last_fullsized":"2024-09-14T12:07:14.681822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:08.731984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'795","reported_seq":1517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.736663+0000","last_change":"2024-09-14T11:11:02.882288+0000","last_active":"2024-09-14T12:09:53.736663+0000","last_peered":"2024-09-14T12:09:53.736663+0000","last_clean":"2024-09-14T12:09:53.736663+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:09:53.736663+0000","last_undegraded":"2024-09-14T12:09:53.736663+0000","last_fullsized":"2024-09-14T12:09:53.736663+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:52.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682515+0000","last_change":"2024-09-14T11:11:04.636384+0000","last_active":"2024-09-14T12:07:19.682515+0000","last_peered":"2024-09-14T12:07:19.682515+0000","last_clean":"2024-09-14T12:07:19.682515+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:07:19.682515+0000","last_undegraded":"2024-09-14T12:07:19.682515+0000","last_fullsized":"2024-09-14T12:07:19.682515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:19.200941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'147","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.868910+0000","last_change":"2024-09-14T11:11:06.645842+0000","last_active":"2024-09-14T12:09:14.868910+0000","last_peered":"2024-09-14T12:09:14.868910+0000","last_clean":"2024-09-14T12:09:14.868910+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:09:14.868910+0000","last_undegraded":"2024-09-14T12:09:14.868910+0000","last_fullsized":"2024-09-14T12:09:14.868910+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:49.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'133","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.592187+0000","last_change":"2024-09-14T11:11:06.646108+0000","last_active":"2024-09-14T12:07:57.592187+0000","last_peered":"2024-09-14T12:07:57.592187+0000","last_clean":"2024-09-14T12:07:57.592187+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:07:57.592187+0000","last_undegraded":"2024-09-14T12:07:57.592187+0000","last_fullsized":"2024-09-14T12:07:57.592187+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:15.069138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578521+0000","last_change":"2024-09-14T11:10:58.604359+0000","last_active":"2024-09-14T12:06:59.578521+0000","last_peered":"2024-09-14T12:06:59.578521+0000","last_clean":"2024-09-14T12:06:59.578521+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:06:59.578521+0000","last_undegraded":"2024-09-14T12:06:59.578521+0000","last_fullsized":"2024-09-14T12:06:59.578521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:16.978960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'347","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.420886+0000","last_change":"2024-09-14T11:10:56.615808+0000","last_active":"2024-09-14T12:09:54.420886+0000","last_peered":"2024-09-14T12:09:54.420886+0000","last_clean":"2024-09-14T12:09:54.420886+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:09:54.420886+0000","last_undegraded":"2024-09-14T12:09:54.420886+0000","last_fullsized":"2024-09-14T12:09:54.420886+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:43.217150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":636,"num_read_kb":5106,"num_write":1230,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669712+0000","last_change":"2024-09-14T11:11:00.610690+0000","last_active":"2024-09-14T12:07:00.669712+0000","last_peered":"2024-09-14T12:07:00.669712+0000","last_clean":"2024-09-14T12:07:00.669712+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:07:00.669712+0000","last_undegraded":"2024-09-14T12:07:00.669712+0000","last_fullsized":"2024-09-14T12:07:00.669712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:39.467881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'323","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.143808+0000","last_change":"2024-09-14T11:11:02.622367+0000","last_active":"2024-09-14T12:09:54.143808+0000","last_peered":"2024-09-14T12:09:54.143808+0000","last_clean":"2024-09-14T12:09:54.143808+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:09:54.143808+0000","last_undegraded":"2024-09-14T12:09:54.143808+0000","last_fullsized":"2024-09-14T12:09:54.143808+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:39.564835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680693+0000","last_change":"2024-09-14T11:11:04.639827+0000","last_active":"2024-09-14T12:07:04.680693+0000","last_peered":"2024-09-14T12:07:04.680693+0000","last_clean":"2024-09-14T12:07:04.680693+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:07:04.680693+0000","last_undegraded":"2024-09-14T12:07:04.680693+0000","last_fullsized":"2024-09-14T12:07:04.680693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:10.987465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'132","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682683+0000","last_change":"2024-09-14T11:11:06.649975+0000","last_active":"2024-09-14T12:07:19.682683+0000","last_peered":"2024-09-14T12:07:19.682683+0000","last_clean":"2024-09-14T12:07:19.682683+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:07:19.682683+0000","last_undegraded":"2024-09-14T12:07:19.682683+0000","last_fullsized":"2024-09-14T12:07:19.682683+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:50.322032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669720+0000","last_change":"2024-09-14T11:10:58.609253+0000","last_active":"2024-09-14T12:07:00.669720+0000","last_peered":"2024-09-14T12:07:00.669720+0000","last_clean":"2024-09-14T12:07:00.669720+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:07:00.669720+0000","last_undegraded":"2024-09-14T12:07:00.669720+0000","last_fullsized":"2024-09-14T12:07:00.669720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.292062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'340","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.577295+0000","last_change":"2024-09-14T11:10:56.618778+0000","last_active":"2024-09-14T12:09:54.577295+0000","last_peered":"2024-09-14T12:09:54.577295+0000","last_clean":"2024-09-14T12:09:54.577295+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:09:54.577295+0000","last_undegraded":"2024-09-14T12:09:54.577295+0000","last_fullsized":"2024-09-14T12:09:54.577295+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:10.981915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324726,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":667,"num_read_kb":33434,"num_write":1022,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680772+0000","last_change":"2024-09-14T11:11:00.611300+0000","last_active":"2024-09-14T12:07:04.680772+0000","last_peered":"2024-09-14T12:07:04.680772+0000","last_clean":"2024-09-14T12:07:04.680772+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:07:04.680772+0000","last_undegraded":"2024-09-14T12:07:04.680772+0000","last_fullsized":"2024-09-14T12:07:04.680772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:08.169880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568300+0000","last_change":"2024-09-14T11:11:02.616318+0000","last_active":"2024-09-14T12:07:05.568300+0000","last_peered":"2024-09-14T12:07:05.568300+0000","last_clean":"2024-09-14T12:07:05.568300+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:07:05.568300+0000","last_undegraded":"2024-09-14T12:07:05.568300+0000","last_fullsized":"2024-09-14T12:07:05.568300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:14.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579853+0000","last_change":"2024-09-14T11:11:04.630959+0000","last_active":"2024-09-14T12:07:04.579853+0000","last_peered":"2024-09-14T12:07:04.579853+0000","last_clean":"2024-09-14T12:07:04.579853+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:07:04.579853+0000","last_undegraded":"2024-09-14T12:07:04.579853+0000","last_fullsized":"2024-09-14T12:07:04.579853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:47.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'253","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.593628+0000","last_change":"2024-09-14T11:11:06.642887+0000","last_active":"2024-09-14T12:07:56.593628+0000","last_peered":"2024-09-14T12:07:56.593628+0000","last_clean":"2024-09-14T12:07:56.593628+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:07:56.593628+0000","last_undegraded":"2024-09-14T12:07:56.593628+0000","last_fullsized":"2024-09-14T12:07:56.593628+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:46.857547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680183+0000","last_change":"2024-09-14T11:10:58.605181+0000","last_active":"2024-09-14T12:06:59.680183+0000","last_peered":"2024-09-14T12:06:59.680183+0000","last_clean":"2024-09-14T12:06:59.680183+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:06:59.680183+0000","last_undegraded":"2024-09-14T12:06:59.680183+0000","last_fullsized":"2024-09-14T12:06:59.680183+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:43.046442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1250,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.611356+0000","last_change":"2024-09-14T11:10:56.600738+0000","last_active":"2024-09-14T12:09:54.611356+0000","last_peered":"2024-09-14T12:09:54.611356+0000","last_clean":"2024-09-14T12:09:54.611356+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:09:54.611356+0000","last_undegraded":"2024-09-14T12:09:54.611356+0000","last_fullsized":"2024-09-14T12:09:54.611356+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:28.803066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579817+0000","last_change":"2024-09-14T11:11:00.608611+0000","last_active":"2024-09-14T12:07:04.579817+0000","last_peered":"2024-09-14T12:07:04.579817+0000","last_clean":"2024-09-14T12:07:04.579817+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:04.579817+0000","last_undegraded":"2024-09-14T12:07:04.579817+0000","last_fullsized":"2024-09-14T12:07:04.579817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:32.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'307","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.395477+0000","last_change":"2024-09-14T11:11:02.621487+0000","last_active":"2024-09-14T12:09:53.395477+0000","last_peered":"2024-09-14T12:09:53.395477+0000","last_clean":"2024-09-14T12:09:53.395477+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:09:53.395477+0000","last_undegraded":"2024-09-14T12:09:53.395477+0000","last_fullsized":"2024-09-14T12:09:53.395477+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:57.571157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.585970+0000","last_change":"2024-09-14T11:11:04.632741+0000","last_active":"2024-09-14T12:07:05.585970+0000","last_peered":"2024-09-14T12:07:05.585970+0000","last_clean":"2024-09-14T12:07:05.585970+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:07:05.585970+0000","last_undegraded":"2024-09-14T12:07:05.585970+0000","last_fullsized":"2024-09-14T12:07:05.585970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:33.615718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'110","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.940177+0000","last_change":"2024-09-14T11:11:06.646134+0000","last_active":"2024-09-14T12:07:55.940177+0000","last_peered":"2024-09-14T12:07:55.940177+0000","last_clean":"2024-09-14T12:07:55.940177+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:07:55.940177+0000","last_undegraded":"2024-09-14T12:07:55.940177+0000","last_fullsized":"2024-09-14T12:07:55.940177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:44.141877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'143","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680151+0000","last_change":"2024-09-14T11:10:58.610261+0000","last_active":"2024-09-14T12:06:59.680151+0000","last_peered":"2024-09-14T12:06:59.680151+0000","last_clean":"2024-09-14T12:06:59.680151+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:06:59.680151+0000","last_undegraded":"2024-09-14T12:06:59.680151+0000","last_fullsized":"2024-09-14T12:06:59.680151+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:38.951705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'302","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564862+0000","last_change":"2024-09-14T11:10:56.623865+0000","last_active":"2024-09-14T12:06:35.564862+0000","last_peered":"2024-09-14T12:06:35.564862+0000","last_clean":"2024-09-14T12:06:35.564862+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:06:35.564862+0000","last_undegraded":"2024-09-14T12:06:35.564862+0000","last_fullsized":"2024-09-14T12:06:35.564862+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:27.676587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16810913,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":646,"num_read_kb":71289,"num_write":1117,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.585298+0000","last_change":"2024-09-14T11:11:00.608657+0000","last_active":"2024-09-14T12:07:00.585298+0000","last_peered":"2024-09-14T12:07:00.585298+0000","last_clean":"2024-09-14T12:07:00.585298+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:07:00.585298+0000","last_undegraded":"2024-09-14T12:07:00.585298+0000","last_fullsized":"2024-09-14T12:07:00.585298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:34.927234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'265","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.192042+0000","last_change":"2024-09-14T11:11:02.615297+0000","last_active":"2024-09-14T12:09:53.192042+0000","last_peered":"2024-09-14T12:09:53.192042+0000","last_clean":"2024-09-14T12:09:53.192042+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:09:53.192042+0000","last_undegraded":"2024-09-14T12:09:53.192042+0000","last_fullsized":"2024-09-14T12:09:53.192042+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:52.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568346+0000","last_change":"2024-09-14T11:11:04.634007+0000","last_active":"2024-09-14T12:07:05.568346+0000","last_peered":"2024-09-14T12:07:05.568346+0000","last_clean":"2024-09-14T12:07:05.568346+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:07:05.568346+0000","last_undegraded":"2024-09-14T12:07:05.568346+0000","last_fullsized":"2024-09-14T12:07:05.568346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.560589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587539+0000","last_change":"2024-09-14T11:10:58.606214+0000","last_active":"2024-09-14T12:07:15.587539+0000","last_peered":"2024-09-14T12:07:15.587539+0000","last_clean":"2024-09-14T12:07:15.587539+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:07:15.587539+0000","last_undegraded":"2024-09-14T12:07:15.587539+0000","last_fullsized":"2024-09-14T12:07:15.587539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.749986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'372","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.502822+0000","last_change":"2024-09-14T11:10:56.622004+0000","last_active":"2024-09-14T12:09:54.502822+0000","last_peered":"2024-09-14T12:09:54.502822+0000","last_clean":"2024-09-14T12:09:54.502822+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:09:54.502822+0000","last_undegraded":"2024-09-14T12:09:54.502822+0000","last_fullsized":"2024-09-14T12:09:54.502822+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:22.080952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":694,"num_read_kb":6455,"num_write":1237,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569728+0000","last_change":"2024-09-14T11:11:00.603297+0000","last_active":"2024-09-14T12:07:15.569728+0000","last_peered":"2024-09-14T12:07:15.569728+0000","last_clean":"2024-09-14T12:07:15.569728+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:07:15.569728+0000","last_undegraded":"2024-09-14T12:07:15.569728+0000","last_fullsized":"2024-09-14T12:07:15.569728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:28.255243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'491","reported_seq":1114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.837882+0000","last_change":"2024-09-14T11:11:02.615607+0000","last_active":"2024-09-14T12:09:14.837882+0000","last_peered":"2024-09-14T12:09:14.837882+0000","last_clean":"2024-09-14T12:09:14.837882+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:09:14.837882+0000","last_undegraded":"2024-09-14T12:09:14.837882+0000","last_fullsized":"2024-09-14T12:09:14.837882+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:23.294326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117410,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":1917,"num_write":776,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706944+0000","last_change":"2024-09-14T11:11:04.636718+0000","last_active":"2024-09-14T12:06:04.706944+0000","last_peered":"2024-09-14T12:06:04.706944+0000","last_clean":"2024-09-14T12:06:04.706944+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:06:04.706944+0000","last_undegraded":"2024-09-14T12:06:04.706944+0000","last_fullsized":"2024-09-14T12:06:04.706944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.511083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'174","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681293+0000","last_change":"2024-09-14T11:11:06.650082+0000","last_active":"2024-09-14T12:07:09.681293+0000","last_peered":"2024-09-14T12:07:09.681293+0000","last_clean":"2024-09-14T12:07:09.681293+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:07:09.681293+0000","last_undegraded":"2024-09-14T12:07:09.681293+0000","last_fullsized":"2024-09-14T12:07:09.681293+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:16.276250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569715+0000","last_change":"2024-09-14T11:10:58.606571+0000","last_active":"2024-09-14T12:07:15.569715+0000","last_peered":"2024-09-14T12:07:15.569715+0000","last_clean":"2024-09-14T12:07:15.569715+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:07:15.569715+0000","last_undegraded":"2024-09-14T12:07:15.569715+0000","last_fullsized":"2024-09-14T12:07:15.569715+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:01.887992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'267","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.186938+0000","last_change":"2024-09-14T11:10:56.607042+0000","last_active":"2024-09-14T12:07:13.186938+0000","last_peered":"2024-09-14T12:07:13.186938+0000","last_clean":"2024-09-14T12:07:13.186938+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:07:13.186938+0000","last_undegraded":"2024-09-14T12:07:13.186938+0000","last_fullsized":"2024-09-14T12:07:13.186938+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:10.108123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6642266,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":406,"num_read_kb":4513,"num_write":918,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587550+0000","last_change":"2024-09-14T11:11:00.608589+0000","last_active":"2024-09-14T12:07:15.587550+0000","last_peered":"2024-09-14T12:07:15.587550+0000","last_clean":"2024-09-14T12:07:15.587550+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:15.587550+0000","last_undegraded":"2024-09-14T12:07:15.587550+0000","last_fullsized":"2024-09-14T12:07:15.587550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:24.982876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'312","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.256716+0000","last_change":"2024-09-14T11:11:02.611238+0000","last_active":"2024-09-14T12:09:53.256716+0000","last_peered":"2024-09-14T12:09:53.256716+0000","last_clean":"2024-09-14T12:09:53.256716+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:09:53.256716+0000","last_undegraded":"2024-09-14T12:09:53.256716+0000","last_fullsized":"2024-09-14T12:09:53.256716+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.446639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663956+0000","last_change":"2024-09-14T11:11:04.630801+0000","last_active":"2024-09-14T12:06:05.663956+0000","last_peered":"2024-09-14T12:06:05.663956+0000","last_clean":"2024-09-14T12:06:05.663956+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:06:05.663956+0000","last_undegraded":"2024-09-14T12:06:05.663956+0000","last_fullsized":"2024-09-14T12:06:05.663956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:37.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'187","reported_seq":714,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586739+0000","last_change":"2024-09-14T11:11:06.647146+0000","last_active":"2024-09-14T12:07:10.586739+0000","last_peered":"2024-09-14T12:07:10.586739+0000","last_clean":"2024-09-14T12:07:10.586739+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:07:10.586739+0000","last_undegraded":"2024-09-14T12:07:10.586739+0000","last_fullsized":"2024-09-14T12:07:10.586739+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.672972+0000","last_change":"2024-09-14T11:10:58.603000+0000","last_active":"2024-09-14T12:05:59.672972+0000","last_peered":"2024-09-14T12:05:59.672972+0000","last_clean":"2024-09-14T12:05:59.672972+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:05:59.672972+0000","last_undegraded":"2024-09-14T12:05:59.672972+0000","last_fullsized":"2024-09-14T12:05:59.672972+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:38.408009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'342","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.645387+0000","last_change":"2024-09-14T11:11:32.679317+0000","last_active":"2024-09-14T12:09:54.645387+0000","last_peered":"2024-09-14T12:09:54.645387+0000","last_clean":"2024-09-14T12:09:54.645387+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:09:54.645387+0000","last_undegraded":"2024-09-14T12:09:54.645387+0000","last_fullsized":"2024-09-14T12:09:54.645387+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:20.868051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1710980,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":125002,"num_write":1055,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570899+0000","last_change":"2024-09-14T11:11:00.610641+0000","last_active":"2024-09-14T12:06:04.570899+0000","last_peered":"2024-09-14T12:06:04.570899+0000","last_clean":"2024-09-14T12:06:04.570899+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:06:04.570899+0000","last_undegraded":"2024-09-14T12:06:04.570899+0000","last_fullsized":"2024-09-14T12:06:04.570899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:34.052721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'303","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.373148+0000","last_change":"2024-09-14T11:11:02.882152+0000","last_active":"2024-09-14T12:09:54.373148+0000","last_peered":"2024-09-14T12:09:54.373148+0000","last_clean":"2024-09-14T12:09:54.373148+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:09:54.373148+0000","last_undegraded":"2024-09-14T12:09:54.373148+0000","last_fullsized":"2024-09-14T12:09:54.373148+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:00.329236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671401+0000","last_change":"2024-09-14T11:11:04.637717+0000","last_active":"2024-09-14T12:07:15.671401+0000","last_peered":"2024-09-14T12:07:15.671401+0000","last_clean":"2024-09-14T12:07:15.671401+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:07:15.671401+0000","last_undegraded":"2024-09-14T12:07:15.671401+0000","last_fullsized":"2024-09-14T12:07:15.671401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:00.714105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'131","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.877188+0000","last_change":"2024-09-14T11:11:06.644460+0000","last_active":"2024-09-14T12:09:14.877188+0000","last_peered":"2024-09-14T12:09:14.877188+0000","last_clean":"2024-09-14T12:09:14.877188+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:09:14.877188+0000","last_undegraded":"2024-09-14T12:09:14.877188+0000","last_fullsized":"2024-09-14T12:09:14.877188+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:22.358502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.587198+0000","last_change":"2024-09-14T11:10:58.609393+0000","last_active":"2024-09-14T12:07:56.587198+0000","last_peered":"2024-09-14T12:07:56.587198+0000","last_clean":"2024-09-14T12:07:56.587198+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:07:56.587198+0000","last_undegraded":"2024-09-14T12:07:56.587198+0000","last_fullsized":"2024-09-14T12:07:56.587198+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:50.454872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'358","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:38.705575+0000","last_change":"2024-09-14T11:10:56.610767+0000","last_active":"2024-09-14T12:07:38.705575+0000","last_peered":"2024-09-14T12:07:38.705575+0000","last_clean":"2024-09-14T12:07:38.705575+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:07:38.705575+0000","last_undegraded":"2024-09-14T12:07:38.705575+0000","last_fullsized":"2024-09-14T12:07:38.705575+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:42.529391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17393926,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":854,"num_read_kb":75270,"num_write":1229,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.663411+0000","last_change":"2024-09-14T11:11:00.608561+0000","last_active":"2024-09-14T12:06:00.663411+0000","last_peered":"2024-09-14T12:06:00.663411+0000","last_clean":"2024-09-14T12:06:00.663411+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:06:00.663411+0000","last_undegraded":"2024-09-14T12:06:00.663411+0000","last_fullsized":"2024-09-14T12:06:00.663411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:50.035124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'107","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580809+0000","last_change":"2024-09-14T11:11:02.882216+0000","last_active":"2024-09-14T12:07:14.580809+0000","last_peered":"2024-09-14T12:07:14.580809+0000","last_clean":"2024-09-14T12:07:14.580809+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:07:14.580809+0000","last_undegraded":"2024-09-14T12:07:14.580809+0000","last_fullsized":"2024-09-14T12:07:14.580809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.190894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.396781+0000","last_change":"2024-09-14T11:11:04.634837+0000","last_active":"2024-09-14T12:09:18.396781+0000","last_peered":"2024-09-14T12:09:18.396781+0000","last_clean":"2024-09-14T12:09:18.396781+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:09:18.396781+0000","last_undegraded":"2024-09-14T12:09:18.396781+0000","last_fullsized":"2024-09-14T12:09:18.396781+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:02.919719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.505956+0000","last_change":"2024-09-14T11:11:06.646662+0000","last_active":"2024-09-14T12:07:57.505956+0000","last_peered":"2024-09-14T12:07:57.505956+0000","last_clean":"2024-09-14T12:07:57.505956+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:07:57.505956+0000","last_undegraded":"2024-09-14T12:07:57.505956+0000","last_fullsized":"2024-09-14T12:07:57.505956+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:39.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570113+0000","last_change":"2024-09-14T11:10:58.612211+0000","last_active":"2024-09-14T12:05:59.570113+0000","last_peered":"2024-09-14T12:05:59.570113+0000","last_clean":"2024-09-14T12:05:59.570113+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:05:59.570113+0000","last_undegraded":"2024-09-14T12:05:59.570113+0000","last_fullsized":"2024-09-14T12:05:59.570113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.689101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'294","reported_seq":952,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.565631+0000","last_change":"2024-09-14T11:10:56.602145+0000","last_active":"2024-09-14T12:09:54.565631+0000","last_peered":"2024-09-14T12:09:54.565631+0000","last_clean":"2024-09-14T12:09:54.565631+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:09:54.565631+0000","last_undegraded":"2024-09-14T12:09:54.565631+0000","last_fullsized":"2024-09-14T12:09:54.565631+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:25.629525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":114075,"num_write":993,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570893+0000","last_change":"2024-09-14T11:11:00.608599+0000","last_active":"2024-09-14T12:06:04.570893+0000","last_peered":"2024-09-14T12:06:04.570893+0000","last_clean":"2024-09-14T12:06:04.570893+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:06:04.570893+0000","last_undegraded":"2024-09-14T12:06:04.570893+0000","last_fullsized":"2024-09-14T12:06:04.570893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:59.368073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'298","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.668526+0000","last_change":"2024-09-14T11:11:02.616575+0000","last_active":"2024-09-14T12:09:54.668526+0000","last_peered":"2024-09-14T12:09:54.668526+0000","last_clean":"2024-09-14T12:09:54.668526+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:09:54.668526+0000","last_undegraded":"2024-09-14T12:09:54.668526+0000","last_fullsized":"2024-09-14T12:09:54.668526+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:12.984482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49540,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":948,"num_write":377,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565340+0000","last_change":"2024-09-14T11:11:04.635106+0000","last_active":"2024-09-14T12:06:40.565340+0000","last_peered":"2024-09-14T12:06:40.565340+0000","last_clean":"2024-09-14T12:06:40.565340+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:06:40.565340+0000","last_undegraded":"2024-09-14T12:06:40.565340+0000","last_fullsized":"2024-09-14T12:06:40.565340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:25.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'100","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.598806+0000","last_change":"2024-09-14T11:11:06.649099+0000","last_active":"2024-09-14T12:07:54.598806+0000","last_peered":"2024-09-14T12:07:54.598806+0000","last_clean":"2024-09-14T12:07:54.598806+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:07:54.598806+0000","last_undegraded":"2024-09-14T12:07:54.598806+0000","last_fullsized":"2024-09-14T12:07:54.598806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:17.632657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.837677+0000","last_change":"2024-09-14T11:10:58.612093+0000","last_active":"2024-09-14T12:07:18.837677+0000","last_peered":"2024-09-14T12:07:18.837677+0000","last_clean":"2024-09-14T12:07:18.837677+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:07:18.837677+0000","last_undegraded":"2024-09-14T12:07:18.837677+0000","last_fullsized":"2024-09-14T12:07:18.837677+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:49.500728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'360","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.577389+0000","last_change":"2024-09-14T11:12:32.771972+0000","last_active":"2024-09-14T12:09:54.577389+0000","last_peered":"2024-09-14T12:09:54.577389+0000","last_clean":"2024-09-14T12:09:54.577389+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:09:54.577389+0000","last_undegraded":"2024-09-14T12:09:54.577389+0000","last_fullsized":"2024-09-14T12:09:54.577389+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:36.488962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":11549,"num_write":1064,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706910+0000","last_change":"2024-09-14T11:11:00.610742+0000","last_active":"2024-09-14T12:06:04.706910+0000","last_peered":"2024-09-14T12:06:04.706910+0000","last_clean":"2024-09-14T12:06:04.706910+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:06:04.706910+0000","last_undegraded":"2024-09-14T12:06:04.706910+0000","last_fullsized":"2024-09-14T12:06:04.706910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:51.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'271","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.583233+0000","last_change":"2024-09-14T11:11:02.617754+0000","last_active":"2024-09-14T12:09:05.583233+0000","last_peered":"2024-09-14T12:09:05.583233+0000","last_clean":"2024-09-14T12:09:05.583233+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:09:05.583233+0000","last_undegraded":"2024-09-14T12:09:05.583233+0000","last_fullsized":"2024-09-14T12:09:05.583233+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:03.531301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51932,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":881,"num_write":358,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.583943+0000","last_change":"2024-09-14T11:11:04.629288+0000","last_active":"2024-09-14T12:06:50.583943+0000","last_peered":"2024-09-14T12:06:50.583943+0000","last_clean":"2024-09-14T12:06:50.583943+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:06:50.583943+0000","last_undegraded":"2024-09-14T12:06:50.583943+0000","last_fullsized":"2024-09-14T12:06:50.583943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:29.995583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'105","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.593163+0000","last_change":"2024-09-14T11:11:06.648742+0000","last_active":"2024-09-14T12:07:54.593163+0000","last_peered":"2024-09-14T12:07:54.593163+0000","last_clean":"2024-09-14T12:07:54.593163+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:07:54.593163+0000","last_undegraded":"2024-09-14T12:07:54.593163+0000","last_fullsized":"2024-09-14T12:07:54.593163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:19.341185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'440","reported_seq":1196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.845766+0000","last_change":"2024-09-14T11:10:58.608774+0000","last_active":"2024-09-14T12:07:13.845766+0000","last_peered":"2024-09-14T12:07:13.845766+0000","last_clean":"2024-09-14T12:07:13.845766+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:07:13.845766+0000","last_undegraded":"2024-09-14T12:07:13.845766+0000","last_fullsized":"2024-09-14T12:07:13.845766+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.214663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'349","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.623791+0000","last_change":"2024-09-14T11:10:56.619597+0000","last_active":"2024-09-14T12:09:54.623791+0000","last_peered":"2024-09-14T12:09:54.623791+0000","last_clean":"2024-09-14T12:09:54.623791+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:09:54.623791+0000","last_undegraded":"2024-09-14T12:09:54.623791+0000","last_fullsized":"2024-09-14T12:09:54.623791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:58.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1479,"num_write":1089,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575841+0000","last_change":"2024-09-14T11:11:00.613471+0000","last_active":"2024-09-14T12:06:39.575841+0000","last_peered":"2024-09-14T12:06:39.575841+0000","last_clean":"2024-09-14T12:06:39.575841+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:06:39.575841+0000","last_undegraded":"2024-09-14T12:06:39.575841+0000","last_fullsized":"2024-09-14T12:06:39.575841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:51.522567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'237","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.260926+0000","last_change":"2024-09-14T11:11:02.620023+0000","last_active":"2024-09-14T12:09:54.260926+0000","last_peered":"2024-09-14T12:09:54.260926+0000","last_clean":"2024-09-14T12:09:54.260926+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:09:54.260926+0000","last_undegraded":"2024-09-14T12:09:54.260926+0000","last_fullsized":"2024-09-14T12:09:54.260926+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.942166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570865+0000","last_change":"2024-09-14T11:11:04.636920+0000","last_active":"2024-09-14T12:06:04.570865+0000","last_peered":"2024-09-14T12:06:04.570865+0000","last_clean":"2024-09-14T12:06:04.570865+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:06:04.570865+0000","last_undegraded":"2024-09-14T12:06:04.570865+0000","last_fullsized":"2024-09-14T12:06:04.570865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:04.328783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'210","reported_seq":1682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.573850+0000","last_change":"2024-09-14T11:11:06.646323+0000","last_active":"2024-09-14T12:07:54.573850+0000","last_peered":"2024-09-14T12:07:54.573850+0000","last_clean":"2024-09-14T12:07:54.573850+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:07:54.573850+0000","last_undegraded":"2024-09-14T12:07:54.573850+0000","last_fullsized":"2024-09-14T12:07:54.573850+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:54.472116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.626310+0000","last_change":"2024-09-14T11:10:58.603025+0000","last_active":"2024-09-14T12:06:35.626310+0000","last_peered":"2024-09-14T12:06:35.626310+0000","last_clean":"2024-09-14T12:06:35.626310+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:06:35.626310+0000","last_undegraded":"2024-09-14T12:06:35.626310+0000","last_fullsized":"2024-09-14T12:06:35.626310+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:50.041412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'278","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:08.840725+0000","last_change":"2024-09-14T11:10:56.609202+0000","last_active":"2024-09-14T12:09:08.840725+0000","last_peered":"2024-09-14T12:09:08.840725+0000","last_clean":"2024-09-14T12:09:08.840725+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:09:08.840725+0000","last_undegraded":"2024-09-14T12:09:08.840725+0000","last_fullsized":"2024-09-14T12:09:08.840725+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:20.975464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1756754,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":539,"num_read_kb":4572,"num_write":1015,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:45.668134+0000","last_change":"2024-09-14T11:11:00.612948+0000","last_active":"2024-09-14T12:06:45.668134+0000","last_peered":"2024-09-14T12:06:45.668134+0000","last_clean":"2024-09-14T12:06:45.668134+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:06:45.668134+0000","last_undegraded":"2024-09-14T12:06:45.668134+0000","last_fullsized":"2024-09-14T12:06:45.668134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:59.559655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.427158+0000","last_change":"2024-09-14T11:11:02.615915+0000","last_active":"2024-09-14T12:09:54.427158+0000","last_peered":"2024-09-14T12:09:54.427158+0000","last_clean":"2024-09-14T12:09:54.427158+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:09:54.427158+0000","last_undegraded":"2024-09-14T12:09:54.427158+0000","last_fullsized":"2024-09-14T12:09:54.427158+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:13.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561147+0000","last_change":"2024-09-14T11:11:04.638367+0000","last_active":"2024-09-14T12:06:05.561147+0000","last_peered":"2024-09-14T12:06:05.561147+0000","last_clean":"2024-09-14T12:06:05.561147+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:06:05.561147+0000","last_undegraded":"2024-09-14T12:06:05.561147+0000","last_fullsized":"2024-09-14T12:06:05.561147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:16.944434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.887875+0000","last_change":"2024-09-14T11:11:06.650184+0000","last_active":"2024-09-14T12:09:13.887875+0000","last_peered":"2024-09-14T12:09:13.887875+0000","last_clean":"2024-09-14T12:09:13.887875+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:09:13.887875+0000","last_undegraded":"2024-09-14T12:09:13.887875+0000","last_fullsized":"2024-09-14T12:09:13.887875+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:56.510761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671963+0000","last_change":"2024-09-14T11:10:58.608289+0000","last_active":"2024-09-14T12:07:20.671963+0000","last_peered":"2024-09-14T12:07:20.671963+0000","last_clean":"2024-09-14T12:07:20.671963+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:07:20.671963+0000","last_undegraded":"2024-09-14T12:07:20.671963+0000","last_fullsized":"2024-09-14T12:07:20.671963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:55.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'252","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587445+0000","last_change":"2024-09-14T11:10:56.618556+0000","last_active":"2024-09-14T12:07:15.587445+0000","last_peered":"2024-09-14T12:07:15.587445+0000","last_clean":"2024-09-14T12:07:15.587445+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:07:15.587445+0000","last_undegraded":"2024-09-14T12:07:15.587445+0000","last_fullsized":"2024-09-14T12:07:15.587445+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:36.853534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10686081,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":476,"num_read_kb":25535,"num_write":953,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'180","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671944+0000","last_change":"2024-09-14T11:10:58.609726+0000","last_active":"2024-09-14T12:07:20.671944+0000","last_peered":"2024-09-14T12:07:20.671944+0000","last_clean":"2024-09-14T12:07:20.671944+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:07:20.671944+0000","last_undegraded":"2024-09-14T12:07:20.671944+0000","last_fullsized":"2024-09-14T12:07:20.671944+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:49.028498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'352","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.672330+0000","last_change":"2024-09-14T11:10:56.612746+0000","last_active":"2024-09-14T12:09:54.672330+0000","last_peered":"2024-09-14T12:09:54.672330+0000","last_clean":"2024-09-14T12:09:54.672330+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:09:54.672330+0000","last_undegraded":"2024-09-14T12:09:54.672330+0000","last_fullsized":"2024-09-14T12:09:54.672330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:46.452349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":941,"num_read_kb":26386,"num_write":1245,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.718057+0000","last_change":"2024-09-14T11:10:58.599992+0000","last_active":"2024-09-14T12:07:19.718057+0000","last_peered":"2024-09-14T12:07:19.718057+0000","last_clean":"2024-09-14T12:07:19.718057+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:07:19.718057+0000","last_undegraded":"2024-09-14T12:07:19.718057+0000","last_fullsized":"2024-09-14T12:07:19.718057+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:35.235270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.642419+0000","last_change":"2024-09-14T11:10:56.622668+0000","last_active":"2024-09-14T12:09:54.642419+0000","last_peered":"2024-09-14T12:09:54.642419+0000","last_clean":"2024-09-14T12:09:54.642419+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:09:54.642419+0000","last_undegraded":"2024-09-14T12:09:54.642419+0000","last_fullsized":"2024-09-14T12:09:54.642419+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.252105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":18057,"num_write":1028,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671901+0000","last_change":"2024-09-14T11:10:58.599162+0000","last_active":"2024-09-14T12:07:20.671901+0000","last_peered":"2024-09-14T12:07:20.671901+0000","last_clean":"2024-09-14T12:07:20.671901+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:07:20.671901+0000","last_undegraded":"2024-09-14T12:07:20.671901+0000","last_fullsized":"2024-09-14T12:07:20.671901+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'287","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571357+0000","last_change":"2024-09-14T11:11:32.790442+0000","last_active":"2024-09-14T12:07:30.571357+0000","last_peered":"2024-09-14T12:07:30.571357+0000","last_clean":"2024-09-14T12:07:30.571357+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:07:30.571357+0000","last_undegraded":"2024-09-14T12:07:30.571357+0000","last_fullsized":"2024-09-14T12:07:30.571357+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:26.523306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293379,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":553,"num_read_kb":9884,"num_write":1118,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.683406+0000","last_change":"2024-09-14T11:10:58.603379+0000","last_active":"2024-09-14T12:07:24.683406+0000","last_peered":"2024-09-14T12:07:24.683406+0000","last_clean":"2024-09-14T12:07:24.683406+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:07:24.683406+0000","last_undegraded":"2024-09-14T12:07:24.683406+0000","last_fullsized":"2024-09-14T12:07:24.683406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:08.757768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'372","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615634+0000","last_change":"2024-09-14T11:10:56.619064+0000","last_active":"2024-09-14T12:09:54.615634+0000","last_peered":"2024-09-14T12:09:54.615634+0000","last_clean":"2024-09-14T12:09:54.615634+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:09:54.615634+0000","last_undegraded":"2024-09-14T12:09:54.615634+0000","last_fullsized":"2024-09-14T12:09:54.615634+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:51.621055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":11859,"num_write":1345,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'247","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580693+0000","last_change":"2024-09-14T11:10:58.604356+0000","last_active":"2024-09-14T12:07:14.580693+0000","last_peered":"2024-09-14T12:07:14.580693+0000","last_clean":"2024-09-14T12:07:14.580693+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:07:14.580693+0000","last_undegraded":"2024-09-14T12:07:14.580693+0000","last_fullsized":"2024-09-14T12:07:14.580693+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:09.830102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'250","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671924+0000","last_change":"2024-09-14T11:10:56.607620+0000","last_active":"2024-09-14T12:07:20.671924+0000","last_peered":"2024-09-14T12:07:20.671924+0000","last_clean":"2024-09-14T12:07:20.671924+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:07:20.671924+0000","last_undegraded":"2024-09-14T12:07:20.671924+0000","last_fullsized":"2024-09-14T12:07:20.671924+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:01.270486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16157880,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":421,"num_read_kb":36459,"num_write":904,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681847+0000","last_change":"2024-09-14T11:10:58.610796+0000","last_active":"2024-09-14T12:07:14.681847+0000","last_peered":"2024-09-14T12:07:14.681847+0000","last_clean":"2024-09-14T12:07:14.681847+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:07:14.681847+0000","last_undegraded":"2024-09-14T12:07:14.681847+0000","last_fullsized":"2024-09-14T12:07:14.681847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.802576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'379","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.625105+0000","last_change":"2024-09-14T11:11:32.791047+0000","last_active":"2024-09-14T12:09:54.625105+0000","last_peered":"2024-09-14T12:09:54.625105+0000","last_clean":"2024-09-14T12:09:54.625105+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:09:54.625105+0000","last_undegraded":"2024-09-14T12:09:54.625105+0000","last_fullsized":"2024-09-14T12:09:54.625105+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:03.370176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":760,"num_read_kb":129855,"num_write":1252,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587458+0000","last_change":"2024-09-14T11:10:58.607143+0000","last_active":"2024-09-14T12:07:15.587458+0000","last_peered":"2024-09-14T12:07:15.587458+0000","last_clean":"2024-09-14T12:07:15.587458+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:07:15.587458+0000","last_undegraded":"2024-09-14T12:07:15.587458+0000","last_fullsized":"2024-09-14T12:07:15.587458+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:11.437478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'358","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.573515+0000","last_change":"2024-09-14T11:10:56.620202+0000","last_active":"2024-09-14T12:09:54.573515+0000","last_peered":"2024-09-14T12:09:54.573515+0000","last_clean":"2024-09-14T12:09:54.573515+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:09:54.573515+0000","last_undegraded":"2024-09-14T12:09:54.573515+0000","last_fullsized":"2024-09-14T12:09:54.573515+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:43.014580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":615,"num_read_kb":2365,"num_write":1154,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567847+0000","last_change":"2024-09-14T11:10:58.614201+0000","last_active":"2024-09-14T12:07:00.567847+0000","last_peered":"2024-09-14T12:07:00.567847+0000","last_clean":"2024-09-14T12:07:00.567847+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:07:00.567847+0000","last_undegraded":"2024-09-14T12:07:00.567847+0000","last_fullsized":"2024-09-14T12:07:00.567847+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:57.400806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'343","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.590033+0000","last_change":"2024-09-14T11:10:56.606394+0000","last_active":"2024-09-14T12:09:54.590033+0000","last_peered":"2024-09-14T12:09:54.590033+0000","last_clean":"2024-09-14T12:09:54.590033+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:09:54.590033+0000","last_undegraded":"2024-09-14T12:09:54.590033+0000","last_fullsized":"2024-09-14T12:09:54.590033+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.783451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306752,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":15479,"num_write":1160,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578562+0000","last_change":"2024-09-14T11:10:58.609097+0000","last_active":"2024-09-14T12:06:59.578562+0000","last_peered":"2024-09-14T12:06:59.578562+0000","last_clean":"2024-09-14T12:06:59.578562+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:06:59.578562+0000","last_undegraded":"2024-09-14T12:06:59.578562+0000","last_fullsized":"2024-09-14T12:06:59.578562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:56.920723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'355","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.564692+0000","last_change":"2024-09-14T11:11:32.791033+0000","last_active":"2024-09-14T12:09:54.564692+0000","last_peered":"2024-09-14T12:09:54.564692+0000","last_clean":"2024-09-14T12:09:54.564692+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:09:54.564692+0000","last_undegraded":"2024-09-14T12:09:54.564692+0000","last_fullsized":"2024-09-14T12:09:54.564692+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:01.149980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":4745,"num_write":1095,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'455","reported_seq":1139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655648+0000","last_change":"2024-09-14T11:10:58.607355+0000","last_active":"2024-09-14T12:07:19.655648+0000","last_peered":"2024-09-14T12:07:19.655648+0000","last_clean":"2024-09-14T12:07:19.655648+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:07:19.655648+0000","last_undegraded":"2024-09-14T12:07:19.655648+0000","last_fullsized":"2024-09-14T12:07:19.655648+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:29.211083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'549","reported_seq":1351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596614+0000","last_change":"2024-09-14T11:10:56.609284+0000","last_active":"2024-09-14T12:09:54.596614+0000","last_peered":"2024-09-14T12:09:54.596614+0000","last_clean":"2024-09-14T12:09:54.596614+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:09:54.596614+0000","last_undegraded":"2024-09-14T12:09:54.596614+0000","last_fullsized":"2024-09-14T12:09:54.596614+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:15.856244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1369,"num_read_kb":53619,"num_write":1731,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'707","reported_seq":1554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580728+0000","last_change":"2024-09-14T11:10:58.605938+0000","last_active":"2024-09-14T12:07:14.580728+0000","last_peered":"2024-09-14T12:07:14.580728+0000","last_clean":"2024-09-14T12:07:14.580728+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:07:14.580728+0000","last_undegraded":"2024-09-14T12:07:14.580728+0000","last_fullsized":"2024-09-14T12:07:14.580728+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.944096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'259","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569666+0000","last_change":"2024-09-14T11:10:56.612040+0000","last_active":"2024-09-14T12:07:15.569666+0000","last_peered":"2024-09-14T12:07:15.569666+0000","last_clean":"2024-09-14T12:07:15.569666+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:07:15.569666+0000","last_undegraded":"2024-09-14T12:07:15.569666+0000","last_fullsized":"2024-09-14T12:07:15.569666+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:34.021658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10994990,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":411,"num_read_kb":10603,"num_write":968,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":709,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581159+0000","last_change":"2024-09-14T11:10:58.613360+0000","last_active":"2024-09-14T12:07:14.581159+0000","last_peered":"2024-09-14T12:07:14.581159+0000","last_clean":"2024-09-14T12:07:14.581159+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:07:14.581159+0000","last_undegraded":"2024-09-14T12:07:14.581159+0000","last_fullsized":"2024-09-14T12:07:14.581159+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.266610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'285","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.891742+0000","last_change":"2024-09-14T11:10:56.618547+0000","last_active":"2024-09-14T12:07:15.891742+0000","last_peered":"2024-09-14T12:07:15.891742+0000","last_clean":"2024-09-14T12:07:15.891742+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:07:15.891742+0000","last_undegraded":"2024-09-14T12:07:15.891742+0000","last_fullsized":"2024-09-14T12:07:15.891742+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:44.204258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8203715,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":513,"num_read_kb":12529,"num_write":1078,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569633+0000","last_change":"2024-09-14T11:10:58.613749+0000","last_active":"2024-09-14T12:07:15.569633+0000","last_peered":"2024-09-14T12:07:15.569633+0000","last_clean":"2024-09-14T12:07:15.569633+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:07:15.569633+0000","last_undegraded":"2024-09-14T12:07:15.569633+0000","last_fullsized":"2024-09-14T12:07:15.569633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.466116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'394","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.563678+0000","last_change":"2024-09-14T11:10:56.605577+0000","last_active":"2024-09-14T12:09:54.563678+0000","last_peered":"2024-09-14T12:09:54.563678+0000","last_clean":"2024-09-14T12:09:54.563678+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:09:54.563678+0000","last_undegraded":"2024-09-14T12:09:54.563678+0000","last_fullsized":"2024-09-14T12:09:54.563678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:17.688717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1373288,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":13605,"num_write":1183,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.093054+0000","last_change":"2024-09-14T11:10:58.609288+0000","last_active":"2024-09-14T12:07:54.093054+0000","last_peered":"2024-09-14T12:07:54.093054+0000","last_clean":"2024-09-14T12:07:54.093054+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:07:54.093054+0000","last_undegraded":"2024-09-14T12:07:54.093054+0000","last_fullsized":"2024-09-14T12:07:54.093054+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:13.226950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'340","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562409+0000","last_change":"2024-09-14T11:10:56.610961+0000","last_active":"2024-09-14T12:09:54.562409+0000","last_peered":"2024-09-14T12:09:54.562409+0000","last_clean":"2024-09-14T12:09:54.562409+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:09:54.562409+0000","last_undegraded":"2024-09-14T12:09:54.562409+0000","last_fullsized":"2024-09-14T12:09:54.562409+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:29.522513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":673,"num_read_kb":59967,"num_write":1132,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'392","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583376+0000","last_change":"2024-09-14T11:10:58.613428+0000","last_active":"2024-09-14T12:07:29.583376+0000","last_peered":"2024-09-14T12:07:29.583376+0000","last_clean":"2024-09-14T12:07:29.583376+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:07:29.583376+0000","last_undegraded":"2024-09-14T12:07:29.583376+0000","last_fullsized":"2024-09-14T12:07:29.583376+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:14.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'329","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.655584+0000","last_change":"2024-09-14T11:10:56.608905+0000","last_active":"2024-09-14T12:09:54.655584+0000","last_peered":"2024-09-14T12:09:54.655584+0000","last_clean":"2024-09-14T12:09:54.655584+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:09:54.655584+0000","last_undegraded":"2024-09-14T12:09:54.655584+0000","last_fullsized":"2024-09-14T12:09:54.655584+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":654,"num_read_kb":22222,"num_write":1086,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615279+0000","last_change":"2024-09-14T11:10:56.602252+0000","last_active":"2024-09-14T12:09:54.615279+0000","last_peered":"2024-09-14T12:09:54.615279+0000","last_clean":"2024-09-14T12:09:54.615279+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:09:54.615279+0000","last_undegraded":"2024-09-14T12:09:54.615279+0000","last_fullsized":"2024-09-14T12:09:54.615279+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.972236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":41589,"num_write":1191,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566728+0000","last_change":"2024-09-14T11:10:58.614921+0000","last_active":"2024-09-14T12:06:50.566728+0000","last_peered":"2024-09-14T12:06:50.566728+0000","last_clean":"2024-09-14T12:06:50.566728+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:06:50.566728+0000","last_undegraded":"2024-09-14T12:06:50.566728+0000","last_fullsized":"2024-09-14T12:06:50.566728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:23.537706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'398","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669683+0000","last_change":"2024-09-14T11:11:32.677927+0000","last_active":"2024-09-14T12:07:00.669683+0000","last_peered":"2024-09-14T12:07:00.669683+0000","last_clean":"2024-09-14T12:07:00.669683+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:07:00.669683+0000","last_undegraded":"2024-09-14T12:07:00.669683+0000","last_fullsized":"2024-09-14T12:07:00.669683+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:06.109677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12071265,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":867,"num_read_kb":7347,"num_write":1267,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.782731+0000","last_change":"2024-09-14T11:10:58.606955+0000","last_active":"2024-09-14T12:07:10.782731+0000","last_peered":"2024-09-14T12:07:10.782731+0000","last_clean":"2024-09-14T12:07:10.782731+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:07:10.782731+0000","last_undegraded":"2024-09-14T12:07:10.782731+0000","last_fullsized":"2024-09-14T12:07:10.782731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:23.557773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1690,"ondisk_log_size":1690,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1725357,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17932,"num_read_kb":36290,"num_write":15168,"num_write_kb":11953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":1032028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2127,"ondisk_log_size":2127,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2406,"num_read_kb":2867,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215307921,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":42970,"num_read_kb":2049061,"num_write":72058,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":371613696,"data_stored":371613696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4145,"ondisk_log_size":4145,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":33557639,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":224799,"num_write":157,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51384320,"data_stored":51383431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":40894464,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":133,"num_read_kb":204319,"num_write":155,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101711872,"data_stored":101711872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510155,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449416,"kb_used_data":171128,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93922424,"statfs":{"total":96636764160,"available":96176562176,"internally_reserved":0,"allocated":175235072,"data_stored":173145974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":284948934},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510155,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296052,"kb_used_data":152484,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94075788,"statfs":{"total":96636764160,"available":96333606912,"internally_reserved":0,"allocated":156143616,"data_stored":154018295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510155,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398252,"kb_used_data":168540,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93973588,"statfs":{"total":96636764160,"available":96228954112,"internally_reserved":0,"allocated":172584960,"data_stored":170429111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542859,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319680,"kb_used_data":35736,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94052160,"statfs":{"total":96636764160,"available":96309411840,"internally_reserved":0,"allocated":36593664,"data_stored":34448679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":290650571},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542860,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181044,"kb_used_data":51208,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94190796,"statfs":{"total":96636764160,"available":96451375104,"internally_reserved":0,"allocated":52436992,"data_stored":50256323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542858,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146192,"kb_used_data":56652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94225648,"statfs":{"total":96636764160,"available":96487063552,"internally_reserved":0,"allocated":58011648,"data_stored":55972975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542860,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344924,"kb_used_data":75020,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94026916,"statfs":{"total":96636764160,"available":96283561984,"internally_reserved":0,"allocated":76820480,"data_stored":74679404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542860,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106552,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94265288,"statfs":{"total":96636764160,"available":96527654912,"internally_reserved":0,"allocated":25968640,"data_stored":23920772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112685056,"data_stored":112685056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103116800,"data_stored":103116800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3244032,"data_stored":3244032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2568192,"data_stored":2568192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12972032,"data_stored":12972032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":5115904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":120254464,"data_stored":120254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11657216,"data_stored":11657216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":339374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":376771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":38629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":274020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38797312,"data_stored":38797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":9440391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:09:55.252 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:09:55.598 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:09:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:09:55.613 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2035,"stamp":"2024-09-14T12:09:54.842626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292092642,"num_objects":2046,"num_object_clones":0,"num_object_copies":5796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2046,"num_whiteouts":0,"num_read":198051,"num_read_kb":2632166,"num_write":146214,"num_write_kb":2509925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14174,"ondisk_log_size":14174,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2242112,"kb_used_data":736128,"kb_used_omap":12,"kb_used_meta":1505459,"kb_avail":752732608,"statfs":{"total":773094113280,"available":770798190592,"internally_reserved":0,"allocated":753795072,"data_stored":736871533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1541590577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-436662693,"num_objects":-2668,"num_object_clones":0,"num_object_copies":-7978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2668,"num_whiteouts":0,"num_read":2983,"num_read_kb":2737,"num_write":2834,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005006"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.714132+0000","last_change":"2024-09-14T11:44:25.351991+0000","last_active":"2024-09-14T12:06:54.714132+0000","last_peered":"2024-09-14T12:06:54.714132+0000","last_clean":"2024-09-14T12:06:54.714132+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:06:54.714132+0000","last_undegraded":"2024-09-14T12:06:54.714132+0000","last_fullsized":"2024-09-14T12:06:54.714132+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:51.739360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.707626+0000","last_change":"2024-09-14T11:28:36.255342+0000","last_active":"2024-09-14T12:06:09.707626+0000","last_peered":"2024-09-14T12:06:09.707626+0000","last_clean":"2024-09-14T12:06:09.707626+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:06:09.707626+0000","last_undegraded":"2024-09-14T12:06:09.707626+0000","last_fullsized":"2024-09-14T12:06:09.707626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.129757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.673633+0000","last_change":"2024-09-14T11:28:33.234582+0000","last_active":"2024-09-14T12:06:04.673633+0000","last_peered":"2024-09-14T12:06:04.673633+0000","last_clean":"2024-09-14T12:06:04.673633+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:06:04.673633+0000","last_undegraded":"2024-09-14T12:06:04.673633+0000","last_fullsized":"2024-09-14T12:06:04.673633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.203877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.569061+0000","last_change":"2024-09-14T11:25:27.952561+0000","last_active":"2024-09-14T12:07:10.569061+0000","last_peered":"2024-09-14T12:07:10.569061+0000","last_clean":"2024-09-14T12:07:10.569061+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:07:10.569061+0000","last_undegraded":"2024-09-14T12:07:10.569061+0000","last_fullsized":"2024-09-14T12:07:10.569061+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:17.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.651197+0000","last_change":"2024-09-14T11:44:25.353765+0000","last_active":"2024-09-14T12:06:54.651197+0000","last_peered":"2024-09-14T12:06:54.651197+0000","last_clean":"2024-09-14T12:06:54.651197+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:06:54.651197+0000","last_undegraded":"2024-09-14T12:06:54.651197+0000","last_fullsized":"2024-09-14T12:06:54.651197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:11.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593518+0000","last_change":"2024-09-14T11:28:36.260521+0000","last_active":"2024-09-14T12:08:39.593518+0000","last_peered":"2024-09-14T12:08:39.593518+0000","last_clean":"2024-09-14T12:08:39.593518+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:08:39.593518+0000","last_undegraded":"2024-09-14T12:08:39.593518+0000","last_fullsized":"2024-09-14T12:08:39.593518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:16.049764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663945+0000","last_change":"2024-09-14T11:28:33.226443+0000","last_active":"2024-09-14T12:06:05.663945+0000","last_peered":"2024-09-14T12:06:05.663945+0000","last_clean":"2024-09-14T12:06:05.663945+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:06:05.663945+0000","last_undegraded":"2024-09-14T12:06:05.663945+0000","last_fullsized":"2024-09-14T12:06:05.663945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:38.075764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.657263+0000","last_change":"2024-09-14T11:25:27.951069+0000","last_active":"2024-09-14T12:07:34.657263+0000","last_peered":"2024-09-14T12:07:34.657263+0000","last_clean":"2024-09-14T12:07:34.657263+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:07:34.657263+0000","last_undegraded":"2024-09-14T12:07:34.657263+0000","last_fullsized":"2024-09-14T12:07:34.657263+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:28.986404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.578394+0000","last_change":"2024-09-14T11:44:25.347621+0000","last_active":"2024-09-14T12:06:10.578394+0000","last_peered":"2024-09-14T12:06:10.578394+0000","last_clean":"2024-09-14T12:06:10.578394+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:06:10.578394+0000","last_undegraded":"2024-09-14T12:06:10.578394+0000","last_fullsized":"2024-09-14T12:06:10.578394+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:39.883404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'11","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561213+0000","last_change":"2024-09-14T11:28:36.367262+0000","last_active":"2024-09-14T12:06:05.561213+0000","last_peered":"2024-09-14T12:06:05.561213+0000","last_clean":"2024-09-14T12:06:05.561213+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:06:05.561213+0000","last_undegraded":"2024-09-14T12:06:05.561213+0000","last_fullsized":"2024-09-14T12:06:05.561213+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:03.310942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":33792,"num_write":21,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.649550+0000","last_change":"2024-09-14T11:28:33.226810+0000","last_active":"2024-09-14T12:06:39.649550+0000","last_peered":"2024-09-14T12:06:39.649550+0000","last_clean":"2024-09-14T12:06:39.649550+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:06:39.649550+0000","last_undegraded":"2024-09-14T12:06:39.649550+0000","last_fullsized":"2024-09-14T12:06:39.649550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.798886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.557251+0000","last_change":"2024-09-14T11:25:27.940069+0000","last_active":"2024-09-14T12:05:30.557251+0000","last_peered":"2024-09-14T12:05:30.557251+0000","last_clean":"2024-09-14T12:05:30.557251+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:05:30.557251+0000","last_undegraded":"2024-09-14T12:05:30.557251+0000","last_fullsized":"2024-09-14T12:05:30.557251+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:45.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:19.675494+0000","last_change":"2024-09-14T11:44:25.356282+0000","last_active":"2024-09-14T12:06:19.675494+0000","last_peered":"2024-09-14T12:06:19.675494+0000","last_clean":"2024-09-14T12:06:19.675494+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:06:19.675494+0000","last_undegraded":"2024-09-14T12:06:19.675494+0000","last_fullsized":"2024-09-14T12:06:19.675494+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:56.126294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.127142+0000","last_change":"2024-09-14T11:28:36.366276+0000","last_active":"2024-09-14T12:09:53.127142+0000","last_peered":"2024-09-14T12:09:53.127142+0000","last_clean":"2024-09-14T12:09:53.127142+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:09:53.127142+0000","last_undegraded":"2024-09-14T12:09:53.127142+0000","last_fullsized":"2024-09-14T12:09:53.127142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:40.126728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589312+0000","last_change":"2024-09-14T11:28:33.228558+0000","last_active":"2024-09-14T12:08:09.589312+0000","last_peered":"2024-09-14T12:08:09.589312+0000","last_clean":"2024-09-14T12:08:09.589312+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:08:09.589312+0000","last_undegraded":"2024-09-14T12:08:09.589312+0000","last_fullsized":"2024-09-14T12:08:09.589312+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669719+0000","last_change":"2024-09-14T11:25:27.953674+0000","last_active":"2024-09-14T12:05:29.669719+0000","last_peered":"2024-09-14T12:05:29.669719+0000","last_clean":"2024-09-14T12:05:29.669719+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:05:29.669719+0000","last_undegraded":"2024-09-14T12:05:29.669719+0000","last_fullsized":"2024-09-14T12:05:29.669719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:04.652722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677327+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:06:34.677327+0000","last_peered":"2024-09-14T12:06:34.677327+0000","last_clean":"2024-09-14T12:06:34.677327+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:06:34.677327+0000","last_undegraded":"2024-09-14T12:06:34.677327+0000","last_fullsized":"2024-09-14T12:06:34.677327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.317315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:49.741974+0000","last_change":"2024-09-14T11:28:36.259291+0000","last_active":"2024-09-14T12:09:49.741974+0000","last_peered":"2024-09-14T12:09:49.741974+0000","last_clean":"2024-09-14T12:09:49.741974+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:09:49.741974+0000","last_undegraded":"2024-09-14T12:09:49.741974+0000","last_fullsized":"2024-09-14T12:09:49.741974+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:04.701036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569572+0000","last_change":"2024-09-14T11:28:33.231526+0000","last_active":"2024-09-14T12:07:15.569572+0000","last_peered":"2024-09-14T12:07:15.569572+0000","last_clean":"2024-09-14T12:07:15.569572+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:07:15.569572+0000","last_undegraded":"2024-09-14T12:07:15.569572+0000","last_fullsized":"2024-09-14T12:07:15.569572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:57.361260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669669+0000","last_change":"2024-09-14T11:25:27.952436+0000","last_active":"2024-09-14T12:05:29.669669+0000","last_peered":"2024-09-14T12:05:29.669669+0000","last_clean":"2024-09-14T12:05:29.669669+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:05:29.669669+0000","last_undegraded":"2024-09-14T12:05:29.669669+0000","last_fullsized":"2024-09-14T12:05:29.669669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:37.926867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671952+0000","last_change":"2024-09-14T11:44:25.349268+0000","last_active":"2024-09-14T12:07:20.671952+0000","last_peered":"2024-09-14T12:07:20.671952+0000","last_clean":"2024-09-14T12:07:20.671952+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:07:20.671952+0000","last_undegraded":"2024-09-14T12:07:20.671952+0000","last_fullsized":"2024-09-14T12:07:20.671952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:40.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587416+0000","last_change":"2024-09-14T11:28:36.259293+0000","last_active":"2024-09-14T12:07:15.587416+0000","last_peered":"2024-09-14T12:07:15.587416+0000","last_clean":"2024-09-14T12:07:15.587416+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:07:15.587416+0000","last_undegraded":"2024-09-14T12:07:15.587416+0000","last_fullsized":"2024-09-14T12:07:15.587416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:44.079464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582351+0000","last_change":"2024-09-14T11:28:33.230634+0000","last_active":"2024-09-14T12:07:24.582351+0000","last_peered":"2024-09-14T12:07:24.582351+0000","last_clean":"2024-09-14T12:07:24.582351+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:07:24.582351+0000","last_undegraded":"2024-09-14T12:07:24.582351+0000","last_fullsized":"2024-09-14T12:07:24.582351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.201670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.572739+0000","last_change":"2024-09-14T11:25:27.951325+0000","last_active":"2024-09-14T12:05:30.572739+0000","last_peered":"2024-09-14T12:05:30.572739+0000","last_clean":"2024-09-14T12:05:30.572739+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:05:30.572739+0000","last_undegraded":"2024-09-14T12:05:30.572739+0000","last_fullsized":"2024-09-14T12:05:30.572739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:34.624675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578552+0000","last_change":"2024-09-14T11:44:25.353198+0000","last_active":"2024-09-14T12:06:54.578552+0000","last_peered":"2024-09-14T12:06:54.578552+0000","last_clean":"2024-09-14T12:06:54.578552+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:06:54.578552+0000","last_undegraded":"2024-09-14T12:06:54.578552+0000","last_fullsized":"2024-09-14T12:06:54.578552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:09.499820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577573+0000","last_change":"2024-09-14T11:28:36.261093+0000","last_active":"2024-09-14T12:06:05.577573+0000","last_peered":"2024-09-14T12:06:05.577573+0000","last_clean":"2024-09-14T12:06:05.577573+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:06:05.577573+0000","last_undegraded":"2024-09-14T12:06:05.577573+0000","last_fullsized":"2024-09-14T12:06:05.577573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:33.800970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.592790+0000","last_change":"2024-09-14T11:28:33.231811+0000","last_active":"2024-09-14T12:08:34.592790+0000","last_peered":"2024-09-14T12:08:34.592790+0000","last_clean":"2024-09-14T12:08:34.592790+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:08:34.592790+0000","last_undegraded":"2024-09-14T12:08:34.592790+0000","last_fullsized":"2024-09-14T12:08:34.592790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:14.016741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566550+0000","last_change":"2024-09-14T11:25:27.947671+0000","last_active":"2024-09-14T12:06:50.566550+0000","last_peered":"2024-09-14T12:06:50.566550+0000","last_clean":"2024-09-14T12:06:50.566550+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:06:50.566550+0000","last_undegraded":"2024-09-14T12:06:50.566550+0000","last_fullsized":"2024-09-14T12:06:50.566550+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:21.104088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578614+0000","last_change":"2024-09-14T11:44:25.355575+0000","last_active":"2024-09-14T12:06:54.578614+0000","last_peered":"2024-09-14T12:06:54.578614+0000","last_clean":"2024-09-14T12:06:54.578614+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:06:54.578614+0000","last_undegraded":"2024-09-14T12:06:54.578614+0000","last_fullsized":"2024-09-14T12:06:54.578614+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.828628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674310+0000","last_change":"2024-09-14T11:28:36.254791+0000","last_active":"2024-09-14T12:06:09.674310+0000","last_peered":"2024-09-14T12:06:09.674310+0000","last_clean":"2024-09-14T12:06:09.674310+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:06:09.674310+0000","last_undegraded":"2024-09-14T12:06:09.674310+0000","last_fullsized":"2024-09-14T12:06:09.674310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:16.546392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561126+0000","last_change":"2024-09-14T11:28:33.230741+0000","last_active":"2024-09-14T12:06:05.561126+0000","last_peered":"2024-09-14T12:06:05.561126+0000","last_clean":"2024-09-14T12:06:05.561126+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:06:05.561126+0000","last_undegraded":"2024-09-14T12:06:05.561126+0000","last_fullsized":"2024-09-14T12:06:05.561126+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:45.191280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.667058+0000","last_change":"2024-09-14T11:25:27.942564+0000","last_active":"2024-09-14T12:06:35.667058+0000","last_peered":"2024-09-14T12:06:35.667058+0000","last_clean":"2024-09-14T12:06:35.667058+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:06:35.667058+0000","last_undegraded":"2024-09-14T12:06:35.667058+0000","last_fullsized":"2024-09-14T12:06:35.667058+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.091896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:25.659466+0000","last_change":"2024-09-14T11:44:25.351716+0000","last_active":"2024-09-14T12:05:25.659466+0000","last_peered":"2024-09-14T12:05:25.659466+0000","last_clean":"2024-09-14T12:05:25.659466+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:05:25.659466+0000","last_undegraded":"2024-09-14T12:05:25.659466+0000","last_fullsized":"2024-09-14T12:05:25.659466+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:06.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210853+0000","last_change":"2024-09-14T11:28:36.369321+0000","last_active":"2024-09-14T12:09:54.210853+0000","last_peered":"2024-09-14T12:09:54.210853+0000","last_clean":"2024-09-14T12:09:54.210853+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:09:54.210853+0000","last_undegraded":"2024-09-14T12:09:54.210853+0000","last_fullsized":"2024-09-14T12:09:54.210853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:22.989447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706081+0000","last_change":"2024-09-14T11:28:33.231360+0000","last_active":"2024-09-14T12:05:59.706081+0000","last_peered":"2024-09-14T12:05:59.706081+0000","last_clean":"2024-09-14T12:05:59.706081+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:05:59.706081+0000","last_undegraded":"2024-09-14T12:05:59.706081+0000","last_fullsized":"2024-09-14T12:05:59.706081+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.002852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564851+0000","last_change":"2024-09-14T11:25:27.949982+0000","last_active":"2024-09-14T12:06:35.564851+0000","last_peered":"2024-09-14T12:06:35.564851+0000","last_clean":"2024-09-14T12:06:35.564851+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:06:35.564851+0000","last_undegraded":"2024-09-14T12:06:35.564851+0000","last_fullsized":"2024-09-14T12:06:35.564851+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:12.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.641872+0000","last_change":"2024-09-14T11:44:25.346519+0000","last_active":"2024-09-14T12:05:24.641872+0000","last_peered":"2024-09-14T12:05:24.641872+0000","last_clean":"2024-09-14T12:05:24.641872+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:05:24.641872+0000","last_undegraded":"2024-09-14T12:05:24.641872+0000","last_fullsized":"2024-09-14T12:05:24.641872+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:51.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674369+0000","last_change":"2024-09-14T11:28:36.367601+0000","last_active":"2024-09-14T12:06:09.674369+0000","last_peered":"2024-09-14T12:06:09.674369+0000","last_clean":"2024-09-14T12:06:09.674369+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:06:09.674369+0000","last_undegraded":"2024-09-14T12:06:09.674369+0000","last_fullsized":"2024-09-14T12:06:09.674369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:47.572025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581225+0000","last_change":"2024-09-14T11:28:33.228389+0000","last_active":"2024-09-14T12:07:14.581225+0000","last_peered":"2024-09-14T12:07:14.581225+0000","last_clean":"2024-09-14T12:07:14.581225+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:07:14.581225+0000","last_undegraded":"2024-09-14T12:07:14.581225+0000","last_fullsized":"2024-09-14T12:07:14.581225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:11.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677357+0000","last_change":"2024-09-14T11:25:27.953781+0000","last_active":"2024-09-14T12:06:34.677357+0000","last_peered":"2024-09-14T12:06:34.677357+0000","last_clean":"2024-09-14T12:06:34.677357+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:06:34.677357+0000","last_undegraded":"2024-09-14T12:06:34.677357+0000","last_fullsized":"2024-09-14T12:06:34.677357+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.652754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.564302+0000","last_change":"2024-09-14T11:44:25.348811+0000","last_active":"2024-09-14T12:05:24.564302+0000","last_peered":"2024-09-14T12:05:24.564302+0000","last_clean":"2024-09-14T12:05:24.564302+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:05:24.564302+0000","last_undegraded":"2024-09-14T12:05:24.564302+0000","last_fullsized":"2024-09-14T12:05:24.564302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:32.650432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682708+0000","last_change":"2024-09-14T11:28:36.369256+0000","last_active":"2024-09-14T12:07:19.682708+0000","last_peered":"2024-09-14T12:07:19.682708+0000","last_clean":"2024-09-14T12:07:19.682708+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:07:19.682708+0000","last_undegraded":"2024-09-14T12:07:19.682708+0000","last_fullsized":"2024-09-14T12:07:19.682708+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:54.707659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653192+0000","last_change":"2024-09-14T11:28:33.233405+0000","last_active":"2024-09-14T12:07:14.653192+0000","last_peered":"2024-09-14T12:07:14.653192+0000","last_clean":"2024-09-14T12:07:14.653192+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:07:14.653192+0000","last_undegraded":"2024-09-14T12:07:14.653192+0000","last_fullsized":"2024-09-14T12:07:14.653192+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649083+0000","last_change":"2024-09-14T11:25:27.945742+0000","last_active":"2024-09-14T12:06:34.649083+0000","last_peered":"2024-09-14T12:06:34.649083+0000","last_clean":"2024-09-14T12:06:34.649083+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:06:34.649083+0000","last_undegraded":"2024-09-14T12:06:34.649083+0000","last_fullsized":"2024-09-14T12:06:34.649083+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:48.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.700955+0000","last_change":"2024-09-14T11:44:25.352981+0000","last_active":"2024-09-14T12:05:24.700955+0000","last_peered":"2024-09-14T12:05:24.700955+0000","last_clean":"2024-09-14T12:05:24.700955+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:05:24.700955+0000","last_undegraded":"2024-09-14T12:05:24.700955+0000","last_fullsized":"2024-09-14T12:05:24.700955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:28.913462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581671+0000","last_change":"2024-09-14T11:28:36.261453+0000","last_active":"2024-09-14T12:07:19.581671+0000","last_peered":"2024-09-14T12:07:19.581671+0000","last_clean":"2024-09-14T12:07:19.581671+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:07:19.581671+0000","last_undegraded":"2024-09-14T12:07:19.581671+0000","last_fullsized":"2024-09-14T12:07:19.581671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569744+0000","last_change":"2024-09-14T11:28:33.226734+0000","last_active":"2024-09-14T12:07:15.569744+0000","last_peered":"2024-09-14T12:07:15.569744+0000","last_clean":"2024-09-14T12:07:15.569744+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:07:15.569744+0000","last_undegraded":"2024-09-14T12:07:15.569744+0000","last_fullsized":"2024-09-14T12:07:15.569744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:19.563659+0000","last_change":"2024-09-14T11:25:27.950879+0000","last_active":"2024-09-14T12:05:19.563659+0000","last_peered":"2024-09-14T12:05:19.563659+0000","last_clean":"2024-09-14T12:05:19.563659+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:05:19.563659+0000","last_undegraded":"2024-09-14T12:05:19.563659+0000","last_fullsized":"2024-09-14T12:05:19.563659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:13.451590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674442+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:06:09.674442+0000","last_peered":"2024-09-14T12:06:09.674442+0000","last_clean":"2024-09-14T12:06:09.674442+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:06:09.674442+0000","last_undegraded":"2024-09-14T12:06:09.674442+0000","last_fullsized":"2024-09-14T12:06:09.674442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.648826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662808+0000","last_change":"2024-09-14T11:28:36.257731+0000","last_active":"2024-09-14T12:05:55.662808+0000","last_peered":"2024-09-14T12:05:55.662808+0000","last_clean":"2024-09-14T12:05:55.662808+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:05:55.662808+0000","last_undegraded":"2024-09-14T12:05:55.662808+0000","last_fullsized":"2024-09-14T12:05:55.662808+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:03.144550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.569273+0000","last_change":"2024-09-14T11:28:33.232810+0000","last_active":"2024-09-14T12:05:54.569273+0000","last_peered":"2024-09-14T12:05:54.569273+0000","last_clean":"2024-09-14T12:05:54.569273+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:05:54.569273+0000","last_undegraded":"2024-09-14T12:05:54.569273+0000","last_fullsized":"2024-09-14T12:05:54.569273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:44.564156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583435+0000","last_change":"2024-09-14T11:25:27.949859+0000","last_active":"2024-09-14T12:07:29.583435+0000","last_peered":"2024-09-14T12:07:29.583435+0000","last_clean":"2024-09-14T12:07:29.583435+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:07:29.583435+0000","last_undegraded":"2024-09-14T12:07:29.583435+0000","last_fullsized":"2024-09-14T12:07:29.583435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:45.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561924+0000","last_change":"2024-09-14T11:44:25.355586+0000","last_active":"2024-09-14T12:06:10.561924+0000","last_peered":"2024-09-14T12:06:10.561924+0000","last_clean":"2024-09-14T12:06:10.561924+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:06:10.561924+0000","last_undegraded":"2024-09-14T12:06:10.561924+0000","last_fullsized":"2024-09-14T12:06:10.561924+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:15.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662766+0000","last_change":"2024-09-14T11:28:36.261024+0000","last_active":"2024-09-14T12:05:55.662766+0000","last_peered":"2024-09-14T12:05:55.662766+0000","last_clean":"2024-09-14T12:05:55.662766+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:05:55.662766+0000","last_undegraded":"2024-09-14T12:05:55.662766+0000","last_fullsized":"2024-09-14T12:05:55.662766+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.672323+0000","last_change":"2024-09-14T11:28:33.229372+0000","last_active":"2024-09-14T12:05:54.672323+0000","last_peered":"2024-09-14T12:05:54.672323+0000","last_clean":"2024-09-14T12:05:54.672323+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:05:54.672323+0000","last_undegraded":"2024-09-14T12:05:54.672323+0000","last_fullsized":"2024-09-14T12:05:54.672323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:23.134165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571324+0000","last_change":"2024-09-14T11:25:27.945571+0000","last_active":"2024-09-14T12:07:30.571324+0000","last_peered":"2024-09-14T12:07:30.571324+0000","last_clean":"2024-09-14T12:07:30.571324+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:07:30.571324+0000","last_undegraded":"2024-09-14T12:07:30.571324+0000","last_fullsized":"2024-09-14T12:07:30.571324+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:07.890808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557794+0000","last_change":"2024-09-14T11:44:25.351774+0000","last_active":"2024-09-14T12:05:35.557794+0000","last_peered":"2024-09-14T12:05:35.557794+0000","last_clean":"2024-09-14T12:05:35.557794+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:05:35.557794+0000","last_undegraded":"2024-09-14T12:05:35.557794+0000","last_fullsized":"2024-09-14T12:05:35.557794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.350297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.406287+0000","last_change":"2024-09-14T11:28:36.257478+0000","last_active":"2024-09-14T12:09:53.406287+0000","last_peered":"2024-09-14T12:09:53.406287+0000","last_clean":"2024-09-14T12:09:53.406287+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:09:53.406287+0000","last_undegraded":"2024-09-14T12:09:53.406287+0000","last_fullsized":"2024-09-14T12:09:53.406287+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:23.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576285+0000","last_change":"2024-09-14T11:28:33.226764+0000","last_active":"2024-09-14T12:05:55.576285+0000","last_peered":"2024-09-14T12:05:55.576285+0000","last_clean":"2024-09-14T12:05:55.576285+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:05:55.576285+0000","last_undegraded":"2024-09-14T12:05:55.576285+0000","last_fullsized":"2024-09-14T12:05:55.576285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.256510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583059+0000","last_change":"2024-09-14T11:25:27.946060+0000","last_active":"2024-09-14T12:07:29.583059+0000","last_peered":"2024-09-14T12:07:29.583059+0000","last_clean":"2024-09-14T12:07:29.583059+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:07:29.583059+0000","last_undegraded":"2024-09-14T12:07:29.583059+0000","last_fullsized":"2024-09-14T12:07:29.583059+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:07.686737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674405+0000","last_change":"2024-09-14T11:44:25.350108+0000","last_active":"2024-09-14T12:06:09.674405+0000","last_peered":"2024-09-14T12:06:09.674405+0000","last_clean":"2024-09-14T12:06:09.674405+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:06:09.674405+0000","last_undegraded":"2024-09-14T12:06:09.674405+0000","last_fullsized":"2024-09-14T12:06:09.674405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:05.638059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576237+0000","last_change":"2024-09-14T11:28:36.254787+0000","last_active":"2024-09-14T12:05:55.576237+0000","last_peered":"2024-09-14T12:05:55.576237+0000","last_clean":"2024-09-14T12:05:55.576237+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:05:55.576237+0000","last_undegraded":"2024-09-14T12:05:55.576237+0000","last_fullsized":"2024-09-14T12:05:55.576237+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:50.371867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.726150+0000","last_change":"2024-09-14T11:28:33.230870+0000","last_active":"2024-09-14T12:08:14.726150+0000","last_peered":"2024-09-14T12:08:14.726150+0000","last_clean":"2024-09-14T12:08:14.726150+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:08:14.726150+0000","last_undegraded":"2024-09-14T12:08:14.726150+0000","last_fullsized":"2024-09-14T12:08:14.726150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.098373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.683991+0000","last_change":"2024-09-14T11:25:27.953081+0000","last_active":"2024-09-14T12:07:29.683991+0000","last_peered":"2024-09-14T12:07:29.683991+0000","last_clean":"2024-09-14T12:07:29.683991+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:07:29.683991+0000","last_undegraded":"2024-09-14T12:07:29.683991+0000","last_fullsized":"2024-09-14T12:07:29.683991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:37.718041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646069+0000","last_change":"2024-09-14T11:44:25.347178+0000","last_active":"2024-09-14T12:06:04.646069+0000","last_peered":"2024-09-14T12:06:04.646069+0000","last_clean":"2024-09-14T12:06:04.646069+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:06:04.646069+0000","last_undegraded":"2024-09-14T12:06:04.646069+0000","last_fullsized":"2024-09-14T12:06:04.646069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.558120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679683+0000","last_change":"2024-09-14T11:28:36.257470+0000","last_active":"2024-09-14T12:06:54.679683+0000","last_peered":"2024-09-14T12:06:54.679683+0000","last_clean":"2024-09-14T12:06:54.679683+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:06:54.679683+0000","last_undegraded":"2024-09-14T12:06:54.679683+0000","last_fullsized":"2024-09-14T12:06:54.679683+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.008987+0000","last_change":"2024-09-14T11:28:33.233762+0000","last_active":"2024-09-14T12:09:54.008987+0000","last_peered":"2024-09-14T12:09:54.008987+0000","last_clean":"2024-09-14T12:09:54.008987+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:09:54.008987+0000","last_undegraded":"2024-09-14T12:09:54.008987+0000","last_fullsized":"2024-09-14T12:09:54.008987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:03.013761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674471+0000","last_change":"2024-09-14T11:25:27.950690+0000","last_active":"2024-09-14T12:06:09.674471+0000","last_peered":"2024-09-14T12:06:09.674471+0000","last_clean":"2024-09-14T12:06:09.674471+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:06:09.674471+0000","last_undegraded":"2024-09-14T12:06:09.674471+0000","last_fullsized":"2024-09-14T12:06:09.674471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:51.496056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578529+0000","last_change":"2024-09-14T11:44:25.354265+0000","last_active":"2024-09-14T12:06:54.578529+0000","last_peered":"2024-09-14T12:06:54.578529+0000","last_clean":"2024-09-14T12:06:54.578529+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:06:54.578529+0000","last_undegraded":"2024-09-14T12:06:54.578529+0000","last_fullsized":"2024-09-14T12:06:54.578529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.737799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679648+0000","last_change":"2024-09-14T11:28:36.254946+0000","last_active":"2024-09-14T12:06:54.679648+0000","last_peered":"2024-09-14T12:06:54.679648+0000","last_clean":"2024-09-14T12:06:54.679648+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:06:54.679648+0000","last_undegraded":"2024-09-14T12:06:54.679648+0000","last_fullsized":"2024-09-14T12:06:54.679648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:55.651650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.876445+0000","last_change":"2024-09-14T11:28:33.228679+0000","last_active":"2024-09-14T12:09:52.876445+0000","last_peered":"2024-09-14T12:09:52.876445+0000","last_clean":"2024-09-14T12:09:52.876445+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:09:52.876445+0000","last_undegraded":"2024-09-14T12:09:52.876445+0000","last_fullsized":"2024-09-14T12:09:52.876445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706137+0000","last_change":"2024-09-14T11:25:27.949880+0000","last_active":"2024-09-14T12:05:59.706137+0000","last_peered":"2024-09-14T12:05:59.706137+0000","last_clean":"2024-09-14T12:05:59.706137+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:05:59.706137+0000","last_undegraded":"2024-09-14T12:05:59.706137+0000","last_fullsized":"2024-09-14T12:05:59.706137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.896653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577462+0000","last_change":"2024-09-14T11:44:25.340707+0000","last_active":"2024-09-14T12:06:05.577462+0000","last_peered":"2024-09-14T12:06:05.577462+0000","last_clean":"2024-09-14T12:06:05.577462+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:06:05.577462+0000","last_undegraded":"2024-09-14T12:06:05.577462+0000","last_fullsized":"2024-09-14T12:06:05.577462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:41.520475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669775+0000","last_change":"2024-09-14T11:28:36.367731+0000","last_active":"2024-09-14T12:07:00.669775+0000","last_peered":"2024-09-14T12:07:00.669775+0000","last_clean":"2024-09-14T12:07:00.669775+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:07:00.669775+0000","last_undegraded":"2024-09-14T12:07:00.669775+0000","last_fullsized":"2024-09-14T12:07:00.669775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:55.831862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566673+0000","last_change":"2024-09-14T11:28:33.231847+0000","last_active":"2024-09-14T12:06:50.566673+0000","last_peered":"2024-09-14T12:06:50.566673+0000","last_clean":"2024-09-14T12:06:50.566673+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:06:50.566673+0000","last_undegraded":"2024-09-14T12:06:50.566673+0000","last_fullsized":"2024-09-14T12:06:50.566673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:38.952131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.576926+0000","last_change":"2024-09-14T11:25:27.950496+0000","last_active":"2024-09-14T12:06:00.576926+0000","last_peered":"2024-09-14T12:06:00.576926+0000","last_clean":"2024-09-14T12:06:00.576926+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:06:00.576926+0000","last_undegraded":"2024-09-14T12:06:00.576926+0000","last_fullsized":"2024-09-14T12:06:00.576926+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.743937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570818+0000","last_change":"2024-09-14T11:44:25.347374+0000","last_active":"2024-09-14T12:06:04.570818+0000","last_peered":"2024-09-14T12:06:04.570818+0000","last_clean":"2024-09-14T12:06:04.570818+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:06:04.570818+0000","last_undegraded":"2024-09-14T12:06:04.570818+0000","last_fullsized":"2024-09-14T12:06:04.570818+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:02.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679699+0000","last_change":"2024-09-14T11:28:36.256404+0000","last_active":"2024-09-14T12:06:54.679699+0000","last_peered":"2024-09-14T12:06:54.679699+0000","last_clean":"2024-09-14T12:06:54.679699+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:06:54.679699+0000","last_undegraded":"2024-09-14T12:06:54.679699+0000","last_fullsized":"2024-09-14T12:06:54.679699+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:18.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669763+0000","last_change":"2024-09-14T11:28:33.227452+0000","last_active":"2024-09-14T12:07:00.669763+0000","last_peered":"2024-09-14T12:07:00.669763+0000","last_clean":"2024-09-14T12:07:00.669763+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:07:00.669763+0000","last_undegraded":"2024-09-14T12:07:00.669763+0000","last_fullsized":"2024-09-14T12:07:00.669763+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.149389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.645601+0000","last_change":"2024-09-14T11:25:27.954496+0000","last_active":"2024-09-14T12:05:59.645601+0000","last_peered":"2024-09-14T12:05:59.645601+0000","last_clean":"2024-09-14T12:05:59.645601+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:05:59.645601+0000","last_undegraded":"2024-09-14T12:05:59.645601+0000","last_fullsized":"2024-09-14T12:05:59.645601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:03.897519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679716+0000","last_change":"2024-09-14T11:44:25.355046+0000","last_active":"2024-09-14T12:06:54.679716+0000","last_peered":"2024-09-14T12:06:54.679716+0000","last_clean":"2024-09-14T12:06:54.679716+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:06:54.679716+0000","last_undegraded":"2024-09-14T12:06:54.679716+0000","last_fullsized":"2024-09-14T12:06:54.679716+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.119733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.955962+0000","last_change":"2024-09-14T11:28:36.260180+0000","last_active":"2024-09-14T12:09:52.955962+0000","last_peered":"2024-09-14T12:09:52.955962+0000","last_clean":"2024-09-14T12:09:52.955962+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:09:52.955962+0000","last_undegraded":"2024-09-14T12:09:52.955962+0000","last_fullsized":"2024-09-14T12:09:52.955962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:35.619938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571885+0000","last_change":"2024-09-14T11:28:33.230223+0000","last_active":"2024-09-14T12:07:35.571885+0000","last_peered":"2024-09-14T12:07:35.571885+0000","last_clean":"2024-09-14T12:07:35.571885+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:07:35.571885+0000","last_undegraded":"2024-09-14T12:07:35.571885+0000","last_fullsized":"2024-09-14T12:07:35.571885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:17.221998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.560556+0000","last_change":"2024-09-14T11:25:27.953095+0000","last_active":"2024-09-14T12:06:00.560556+0000","last_peered":"2024-09-14T12:06:00.560556+0000","last_clean":"2024-09-14T12:06:00.560556+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:06:00.560556+0000","last_undegraded":"2024-09-14T12:06:00.560556+0000","last_fullsized":"2024-09-14T12:06:00.560556+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:58.766336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579278+0000","last_change":"2024-09-14T11:44:25.354056+0000","last_active":"2024-09-14T12:06:59.579278+0000","last_peered":"2024-09-14T12:06:59.579278+0000","last_clean":"2024-09-14T12:06:59.579278+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:06:59.579278+0000","last_undegraded":"2024-09-14T12:06:59.579278+0000","last_fullsized":"2024-09-14T12:06:59.579278+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.958850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.131052+0000","last_change":"2024-09-14T11:28:36.365890+0000","last_active":"2024-09-14T12:09:53.131052+0000","last_peered":"2024-09-14T12:09:53.131052+0000","last_clean":"2024-09-14T12:09:53.131052+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:09:53.131052+0000","last_undegraded":"2024-09-14T12:09:53.131052+0000","last_fullsized":"2024-09-14T12:09:53.131052+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.017356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.673401+0000","last_change":"2024-09-14T11:28:33.228030+0000","last_active":"2024-09-14T12:07:35.673401+0000","last_peered":"2024-09-14T12:07:35.673401+0000","last_clean":"2024-09-14T12:07:35.673401+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:07:35.673401+0000","last_undegraded":"2024-09-14T12:07:35.673401+0000","last_fullsized":"2024-09-14T12:07:35.673401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:06.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577681+0000","last_change":"2024-09-14T11:25:27.950183+0000","last_active":"2024-09-14T12:06:49.577681+0000","last_peered":"2024-09-14T12:06:49.577681+0000","last_clean":"2024-09-14T12:06:49.577681+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:06:49.577681+0000","last_undegraded":"2024-09-14T12:06:49.577681+0000","last_fullsized":"2024-09-14T12:06:49.577681+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:47.768324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578564+0000","last_change":"2024-09-14T11:44:25.351682+0000","last_active":"2024-09-14T12:06:54.578564+0000","last_peered":"2024-09-14T12:06:54.578564+0000","last_clean":"2024-09-14T12:06:54.578564+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:06:54.578564+0000","last_undegraded":"2024-09-14T12:06:54.578564+0000","last_fullsized":"2024-09-14T12:06:54.578564+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:33.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.668722+0000","last_change":"2024-09-14T11:28:36.252721+0000","last_active":"2024-09-14T12:06:50.668722+0000","last_peered":"2024-09-14T12:06:50.668722+0000","last_clean":"2024-09-14T12:06:50.668722+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:06:50.668722+0000","last_undegraded":"2024-09-14T12:06:50.668722+0000","last_fullsized":"2024-09-14T12:06:50.668722+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:40.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":17937,"num_write":7,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557747+0000","last_change":"2024-09-14T11:28:33.228385+0000","last_active":"2024-09-14T12:05:35.557747+0000","last_peered":"2024-09-14T12:05:35.557747+0000","last_clean":"2024-09-14T12:05:35.557747+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:05:35.557747+0000","last_undegraded":"2024-09-14T12:05:35.557747+0000","last_fullsized":"2024-09-14T12:05:35.557747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:36.884948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.677912+0000","last_change":"2024-09-14T11:25:27.951396+0000","last_active":"2024-09-14T12:06:39.677912+0000","last_peered":"2024-09-14T12:06:39.677912+0000","last_clean":"2024-09-14T12:06:39.677912+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:06:39.677912+0000","last_undegraded":"2024-09-14T12:06:39.677912+0000","last_fullsized":"2024-09-14T12:06:39.677912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.372583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:55.567242+0000","last_change":"2024-09-14T11:44:25.356594+0000","last_active":"2024-09-14T12:06:55.567242+0000","last_peered":"2024-09-14T12:06:55.567242+0000","last_clean":"2024-09-14T12:06:55.567242+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:06:55.567242+0000","last_undegraded":"2024-09-14T12:06:55.567242+0000","last_fullsized":"2024-09-14T12:06:55.567242+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.437539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585586+0000","last_change":"2024-09-14T11:29:33.340403+0000","last_active":"2024-09-14T12:07:44.585586+0000","last_peered":"2024-09-14T12:07:44.585586+0000","last_clean":"2024-09-14T12:07:44.585586+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:07:44.585586+0000","last_undegraded":"2024-09-14T12:07:44.585586+0000","last_fullsized":"2024-09-14T12:07:44.585586+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:46.256090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577175+0000","last_change":"2024-09-14T11:28:33.230335+0000","last_active":"2024-09-14T12:06:49.577175+0000","last_peered":"2024-09-14T12:06:49.577175+0000","last_clean":"2024-09-14T12:06:49.577175+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:06:49.577175+0000","last_undegraded":"2024-09-14T12:06:49.577175+0000","last_fullsized":"2024-09-14T12:06:49.577175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:57.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582421+0000","last_change":"2024-09-14T11:25:27.949670+0000","last_active":"2024-09-14T12:06:40.582421+0000","last_peered":"2024-09-14T12:06:40.582421+0000","last_clean":"2024-09-14T12:06:40.582421+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:06:40.582421+0000","last_undegraded":"2024-09-14T12:06:40.582421+0000","last_fullsized":"2024-09-14T12:06:40.582421+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:26.893035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581926+0000","last_change":"2024-09-14T11:44:25.351860+0000","last_active":"2024-09-14T12:07:19.581926+0000","last_peered":"2024-09-14T12:07:19.581926+0000","last_clean":"2024-09-14T12:07:19.581926+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:07:19.581926+0000","last_undegraded":"2024-09-14T12:07:19.581926+0000","last_fullsized":"2024-09-14T12:07:19.581926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:01.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:15.562475+0000","last_change":"2024-09-14T11:28:36.252024+0000","last_active":"2024-09-14T12:06:15.562475+0000","last_peered":"2024-09-14T12:06:15.562475+0000","last_clean":"2024-09-14T12:06:15.562475+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:06:15.562475+0000","last_undegraded":"2024-09-14T12:06:15.562475+0000","last_fullsized":"2024-09-14T12:06:15.562475+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:46.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.405443+0000","last_change":"2024-09-14T11:28:33.229236+0000","last_active":"2024-09-14T12:09:53.405443+0000","last_peered":"2024-09-14T12:09:53.405443+0000","last_clean":"2024-09-14T12:09:53.405443+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:09:53.405443+0000","last_undegraded":"2024-09-14T12:09:53.405443+0000","last_fullsized":"2024-09-14T12:09:53.405443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:46.128928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565430+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:06:40.565430+0000","last_peered":"2024-09-14T12:06:40.565430+0000","last_clean":"2024-09-14T12:06:40.565430+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:06:40.565430+0000","last_undegraded":"2024-09-14T12:06:40.565430+0000","last_fullsized":"2024-09-14T12:06:40.565430+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:53.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717994+0000","last_change":"2024-09-14T11:44:25.350439+0000","last_active":"2024-09-14T12:07:19.717994+0000","last_peered":"2024-09-14T12:07:19.717994+0000","last_clean":"2024-09-14T12:07:19.717994+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:07:19.717994+0000","last_undegraded":"2024-09-14T12:07:19.717994+0000","last_fullsized":"2024-09-14T12:07:19.717994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:24.626683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561173+0000","last_change":"2024-09-14T11:28:36.365847+0000","last_active":"2024-09-14T12:06:05.561173+0000","last_peered":"2024-09-14T12:06:05.561173+0000","last_clean":"2024-09-14T12:06:05.561173+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:06:05.561173+0000","last_undegraded":"2024-09-14T12:06:05.561173+0000","last_fullsized":"2024-09-14T12:06:05.561173+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:26.254693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.661792+0000","last_change":"2024-09-14T11:28:33.228362+0000","last_active":"2024-09-14T12:08:14.661792+0000","last_peered":"2024-09-14T12:08:14.661792+0000","last_clean":"2024-09-14T12:08:14.661792+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:08:14.661792+0000","last_undegraded":"2024-09-14T12:08:14.661792+0000","last_fullsized":"2024-09-14T12:08:14.661792+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:47.879475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582495+0000","last_change":"2024-09-14T11:25:27.948331+0000","last_active":"2024-09-14T12:06:40.582495+0000","last_peered":"2024-09-14T12:06:40.582495+0000","last_clean":"2024-09-14T12:06:40.582495+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:06:40.582495+0000","last_undegraded":"2024-09-14T12:06:40.582495+0000","last_fullsized":"2024-09-14T12:06:40.582495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:11.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:30.666552+0000","last_change":"2024-09-14T11:44:25.351133+0000","last_active":"2024-09-14T12:06:30.666552+0000","last_peered":"2024-09-14T12:06:30.666552+0000","last_clean":"2024-09-14T12:06:30.666552+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:06:30.666552+0000","last_undegraded":"2024-09-14T12:06:30.666552+0000","last_fullsized":"2024-09-14T12:06:30.666552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:44.289131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584940+0000","last_change":"2024-09-14T11:28:36.367086+0000","last_active":"2024-09-14T12:07:39.584940+0000","last_peered":"2024-09-14T12:07:39.584940+0000","last_clean":"2024-09-14T12:07:39.584940+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:07:39.584940+0000","last_undegraded":"2024-09-14T12:07:39.584940+0000","last_fullsized":"2024-09-14T12:07:39.584940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.893706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.720510+0000","last_change":"2024-09-14T11:28:33.231027+0000","last_active":"2024-09-14T12:07:34.720510+0000","last_peered":"2024-09-14T12:07:34.720510+0000","last_clean":"2024-09-14T12:07:34.720510+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:07:34.720510+0000","last_undegraded":"2024-09-14T12:07:34.720510+0000","last_fullsized":"2024-09-14T12:07:34.720510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.425071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582020+0000","last_change":"2024-09-14T11:25:27.948199+0000","last_active":"2024-09-14T12:07:19.582020+0000","last_peered":"2024-09-14T12:07:19.582020+0000","last_clean":"2024-09-14T12:07:19.582020+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:07:19.582020+0000","last_undegraded":"2024-09-14T12:07:19.582020+0000","last_fullsized":"2024-09-14T12:07:19.582020+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:39.351483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581534+0000","last_change":"2024-09-14T11:44:25.354049+0000","last_active":"2024-09-14T12:07:19.581534+0000","last_peered":"2024-09-14T12:07:19.581534+0000","last_clean":"2024-09-14T12:07:19.581534+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:07:19.581534+0000","last_undegraded":"2024-09-14T12:07:19.581534+0000","last_fullsized":"2024-09-14T12:07:19.581534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:06.436515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584665+0000","last_change":"2024-09-14T11:28:36.260053+0000","last_active":"2024-09-14T12:07:39.584665+0000","last_peered":"2024-09-14T12:07:39.584665+0000","last_clean":"2024-09-14T12:07:39.584665+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:07:39.584665+0000","last_undegraded":"2024-09-14T12:07:39.584665+0000","last_fullsized":"2024-09-14T12:07:39.584665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.584214+0000","last_change":"2024-09-14T11:28:33.233002+0000","last_active":"2024-09-14T12:07:34.584214+0000","last_peered":"2024-09-14T12:07:34.584214+0000","last_clean":"2024-09-14T12:07:34.584214+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:07:34.584214+0000","last_undegraded":"2024-09-14T12:07:34.584214+0000","last_fullsized":"2024-09-14T12:07:34.584214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:57.509567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670809+0000","last_change":"2024-09-14T11:25:27.948445+0000","last_active":"2024-09-14T12:07:10.670809+0000","last_peered":"2024-09-14T12:07:10.670809+0000","last_clean":"2024-09-14T12:07:10.670809+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:07:10.670809+0000","last_undegraded":"2024-09-14T12:07:10.670809+0000","last_fullsized":"2024-09-14T12:07:10.670809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646115+0000","last_change":"2024-09-14T11:44:25.348388+0000","last_active":"2024-09-14T12:06:04.646115+0000","last_peered":"2024-09-14T12:06:04.646115+0000","last_clean":"2024-09-14T12:06:04.646115+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:06:04.646115+0000","last_undegraded":"2024-09-14T12:06:04.646115+0000","last_fullsized":"2024-09-14T12:06:04.646115+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:30.181019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663894+0000","last_change":"2024-09-14T11:28:36.257342+0000","last_active":"2024-09-14T12:06:05.663894+0000","last_peered":"2024-09-14T12:06:05.663894+0000","last_clean":"2024-09-14T12:06:05.663894+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:06:05.663894+0000","last_undegraded":"2024-09-14T12:06:05.663894+0000","last_fullsized":"2024-09-14T12:06:05.663894+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:31.845998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576072+0000","last_change":"2024-09-14T11:28:33.228459+0000","last_active":"2024-09-14T12:06:39.576072+0000","last_peered":"2024-09-14T12:06:39.576072+0000","last_clean":"2024-09-14T12:06:39.576072+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:06:39.576072+0000","last_undegraded":"2024-09-14T12:06:39.576072+0000","last_fullsized":"2024-09-14T12:06:39.576072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:32.489364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716392+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:07:09.716392+0000","last_peered":"2024-09-14T12:07:09.716392+0000","last_clean":"2024-09-14T12:07:09.716392+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:07:09.716392+0000","last_undegraded":"2024-09-14T12:07:09.716392+0000","last_fullsized":"2024-09-14T12:07:09.716392+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:20.912923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561205+0000","last_change":"2024-09-14T11:44:25.353177+0000","last_active":"2024-09-14T12:06:05.561205+0000","last_peered":"2024-09-14T12:06:05.561205+0000","last_clean":"2024-09-14T12:06:05.561205+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:06:05.561205+0000","last_undegraded":"2024-09-14T12:06:05.561205+0000","last_fullsized":"2024-09-14T12:06:05.561205+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:44.730416+0000","last_change":"2024-09-14T11:28:36.256678+0000","last_active":"2024-09-14T12:08:44.730416+0000","last_peered":"2024-09-14T12:08:44.730416+0000","last_clean":"2024-09-14T12:08:44.730416+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:08:44.730416+0000","last_undegraded":"2024-09-14T12:08:44.730416+0000","last_fullsized":"2024-09-14T12:08:44.730416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:25.852294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589335+0000","last_change":"2024-09-14T11:28:33.232601+0000","last_active":"2024-09-14T12:08:09.589335+0000","last_peered":"2024-09-14T12:08:09.589335+0000","last_clean":"2024-09-14T12:08:09.589335+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:08:09.589335+0000","last_undegraded":"2024-09-14T12:08:09.589335+0000","last_fullsized":"2024-09-14T12:08:09.589335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:05.331738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.579944+0000","last_change":"2024-09-14T11:25:27.949489+0000","last_active":"2024-09-14T12:07:09.579944+0000","last_peered":"2024-09-14T12:07:09.579944+0000","last_clean":"2024-09-14T12:07:09.579944+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:07:09.579944+0000","last_undegraded":"2024-09-14T12:07:09.579944+0000","last_fullsized":"2024-09-14T12:07:09.579944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:23.544881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570267+0000","last_change":"2024-09-14T11:44:25.353056+0000","last_active":"2024-09-14T12:07:20.570267+0000","last_peered":"2024-09-14T12:07:20.570267+0000","last_clean":"2024-09-14T12:07:20.570267+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:07:20.570267+0000","last_undegraded":"2024-09-14T12:07:20.570267+0000","last_fullsized":"2024-09-14T12:07:20.570267+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:07.137155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577542+0000","last_change":"2024-09-14T11:28:36.259431+0000","last_active":"2024-09-14T12:06:05.577542+0000","last_peered":"2024-09-14T12:06:05.577542+0000","last_clean":"2024-09-14T12:06:05.577542+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:06:05.577542+0000","last_undegraded":"2024-09-14T12:06:05.577542+0000","last_fullsized":"2024-09-14T12:06:05.577542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:17.716269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'7","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663916+0000","last_change":"2024-09-14T11:28:33.227906+0000","last_active":"2024-09-14T12:06:05.663916+0000","last_peered":"2024-09-14T12:06:05.663916+0000","last_clean":"2024-09-14T12:06:05.663916+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:06:05.663916+0000","last_undegraded":"2024-09-14T12:06:05.663916+0000","last_fullsized":"2024-09-14T12:06:05.663916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.498353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586665+0000","last_change":"2024-09-14T11:25:27.946605+0000","last_active":"2024-09-14T12:07:10.586665+0000","last_peered":"2024-09-14T12:07:10.586665+0000","last_clean":"2024-09-14T12:07:10.586665+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:07:10.586665+0000","last_undegraded":"2024-09-14T12:07:10.586665+0000","last_fullsized":"2024-09-14T12:07:10.586665+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.771354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582789+0000","last_change":"2024-09-14T11:44:25.355567+0000","last_active":"2024-09-14T12:07:24.582789+0000","last_peered":"2024-09-14T12:07:24.582789+0000","last_clean":"2024-09-14T12:07:24.582789+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:07:24.582789+0000","last_undegraded":"2024-09-14T12:07:24.582789+0000","last_fullsized":"2024-09-14T12:07:24.582789+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:15.391313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.589963+0000","last_change":"2024-09-14T11:28:36.260711+0000","last_active":"2024-09-14T12:08:14.589963+0000","last_peered":"2024-09-14T12:08:14.589963+0000","last_clean":"2024-09-14T12:08:14.589963+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:08:14.589963+0000","last_undegraded":"2024-09-14T12:08:14.589963+0000","last_fullsized":"2024-09-14T12:08:14.589963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:01.074793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577559+0000","last_change":"2024-09-14T11:28:33.228247+0000","last_active":"2024-09-14T12:06:05.577559+0000","last_peered":"2024-09-14T12:06:05.577559+0000","last_clean":"2024-09-14T12:06:05.577559+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:06:05.577559+0000","last_undegraded":"2024-09-14T12:06:05.577559+0000","last_fullsized":"2024-09-14T12:06:05.577559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:40.279213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584808+0000","last_change":"2024-09-14T11:25:27.949061+0000","last_active":"2024-09-14T12:07:39.584808+0000","last_peered":"2024-09-14T12:07:39.584808+0000","last_clean":"2024-09-14T12:07:39.584808+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:07:39.584808+0000","last_undegraded":"2024-09-14T12:07:39.584808+0000","last_fullsized":"2024-09-14T12:07:39.584808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'363","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596319+0000","last_change":"2024-09-14T11:10:56.613934+0000","last_active":"2024-09-14T12:09:54.596319+0000","last_peered":"2024-09-14T12:09:54.596319+0000","last_clean":"2024-09-14T12:09:54.596319+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:09:54.596319+0000","last_undegraded":"2024-09-14T12:09:54.596319+0000","last_fullsized":"2024-09-14T12:09:54.596319+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.319510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":753,"num_read_kb":12872,"num_write":1132,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706012+0000","last_change":"2024-09-14T11:10:58.598689+0000","last_active":"2024-09-14T12:05:59.706012+0000","last_peered":"2024-09-14T12:05:59.706012+0000","last_clean":"2024-09-14T12:05:59.706012+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:05:59.706012+0000","last_undegraded":"2024-09-14T12:05:59.706012+0000","last_fullsized":"2024-09-14T12:05:59.706012+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:53.624721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'281","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671392+0000","last_change":"2024-09-14T11:10:56.605326+0000","last_active":"2024-09-14T12:07:15.671392+0000","last_peered":"2024-09-14T12:07:15.671392+0000","last_clean":"2024-09-14T12:07:15.671392+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:07:15.671392+0000","last_undegraded":"2024-09-14T12:07:15.671392+0000","last_fullsized":"2024-09-14T12:07:15.671392+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:33.763107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6326560,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":616,"num_read_kb":30246,"num_write":1115,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.570100+0000","last_change":"2024-09-14T11:10:58.608424+0000","last_active":"2024-09-14T12:06:59.570100+0000","last_peered":"2024-09-14T12:06:59.570100+0000","last_clean":"2024-09-14T12:06:59.570100+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:06:59.570100+0000","last_undegraded":"2024-09-14T12:06:59.570100+0000","last_fullsized":"2024-09-14T12:06:59.570100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:41.148772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'283","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.759312+0000","last_change":"2024-09-14T11:10:56.604528+0000","last_active":"2024-09-14T12:07:18.759312+0000","last_peered":"2024-09-14T12:07:18.759312+0000","last_clean":"2024-09-14T12:07:18.759312+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:07:18.759312+0000","last_undegraded":"2024-09-14T12:07:18.759312+0000","last_fullsized":"2024-09-14T12:07:18.759312+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:47.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346234,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":524,"num_read_kb":3312,"num_write":1120,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570086+0000","last_change":"2024-09-14T11:10:58.615535+0000","last_active":"2024-09-14T12:05:59.570086+0000","last_peered":"2024-09-14T12:05:59.570086+0000","last_clean":"2024-09-14T12:05:59.570086+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:05:59.570086+0000","last_undegraded":"2024-09-14T12:05:59.570086+0000","last_fullsized":"2024-09-14T12:05:59.570086+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:23.713342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'368","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.641825+0000","last_change":"2024-09-14T11:10:56.622380+0000","last_active":"2024-09-14T12:09:54.641825+0000","last_peered":"2024-09-14T12:09:54.641825+0000","last_clean":"2024-09-14T12:09:54.641825+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:09:54.641825+0000","last_undegraded":"2024-09-14T12:09:54.641825+0000","last_fullsized":"2024-09-14T12:09:54.641825+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.100508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":685,"num_read_kb":5058,"num_write":1124,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.372308+0000","last_change":"2024-09-14T11:10:58.615687+0000","last_active":"2024-09-14T12:07:57.372308+0000","last_peered":"2024-09-14T12:07:57.372308+0000","last_clean":"2024-09-14T12:07:57.372308+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:07:57.372308+0000","last_undegraded":"2024-09-14T12:07:57.372308+0000","last_fullsized":"2024-09-14T12:07:57.372308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:15.535728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'329","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.518399+0000","last_change":"2024-09-14T11:10:56.606180+0000","last_active":"2024-09-14T12:09:54.518399+0000","last_peered":"2024-09-14T12:09:54.518399+0000","last_clean":"2024-09-14T12:09:54.518399+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:09:54.518399+0000","last_undegraded":"2024-09-14T12:09:54.518399+0000","last_fullsized":"2024-09-14T12:09:54.518399+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:57.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1084079,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":17822,"num_write":997,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'252","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586768+0000","last_change":"2024-09-14T11:10:58.607840+0000","last_active":"2024-09-14T12:07:10.586768+0000","last_peered":"2024-09-14T12:07:10.586768+0000","last_clean":"2024-09-14T12:07:10.586768+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:07:10.586768+0000","last_undegraded":"2024-09-14T12:07:10.586768+0000","last_fullsized":"2024-09-14T12:07:10.586768+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:18.282965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.620476+0000","last_change":"2024-09-14T11:10:56.622630+0000","last_active":"2024-09-14T12:09:54.620476+0000","last_peered":"2024-09-14T12:09:54.620476+0000","last_clean":"2024-09-14T12:09:54.620476+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:09:54.620476+0000","last_undegraded":"2024-09-14T12:09:54.620476+0000","last_fullsized":"2024-09-14T12:09:54.620476+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:13.408043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580767+0000","last_change":"2024-09-14T11:10:58.604181+0000","last_active":"2024-09-14T12:07:14.580767+0000","last_peered":"2024-09-14T12:07:14.580767+0000","last_clean":"2024-09-14T12:07:14.580767+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:07:14.580767+0000","last_undegraded":"2024-09-14T12:07:14.580767+0000","last_fullsized":"2024-09-14T12:07:14.580767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:47.312582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'342","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.517809+0000","last_change":"2024-09-14T11:11:32.791169+0000","last_active":"2024-09-14T12:09:54.517809+0000","last_peered":"2024-09-14T12:09:54.517809+0000","last_clean":"2024-09-14T12:09:54.517809+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:09:54.517809+0000","last_undegraded":"2024-09-14T12:09:54.517809+0000","last_fullsized":"2024-09-14T12:09:54.517809+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:51.316430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333000,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":619,"num_read_kb":84521,"num_write":1147,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.717225+0000","last_change":"2024-09-14T11:10:58.601531+0000","last_active":"2024-09-14T12:07:14.717225+0000","last_peered":"2024-09-14T12:07:14.717225+0000","last_clean":"2024-09-14T12:07:14.717225+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:07:14.717225+0000","last_undegraded":"2024-09-14T12:07:14.717225+0000","last_fullsized":"2024-09-14T12:07:14.717225+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.466412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.676169+0000","last_change":"2024-09-14T11:10:56.614815+0000","last_active":"2024-09-14T12:09:54.676169+0000","last_peered":"2024-09-14T12:09:54.676169+0000","last_clean":"2024-09-14T12:09:54.676169+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:09:54.676169+0000","last_undegraded":"2024-09-14T12:09:54.676169+0000","last_fullsized":"2024-09-14T12:09:54.676169+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:17.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653214+0000","last_change":"2024-09-14T11:10:58.612690+0000","last_active":"2024-09-14T12:07:14.653214+0000","last_peered":"2024-09-14T12:07:14.653214+0000","last_clean":"2024-09-14T12:07:14.653214+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:07:14.653214+0000","last_undegraded":"2024-09-14T12:07:14.653214+0000","last_fullsized":"2024-09-14T12:07:14.653214+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:43.860956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578450+0000","last_change":"2024-09-14T11:10:58.613992+0000","last_active":"2024-09-14T12:06:59.578450+0000","last_peered":"2024-09-14T12:06:59.578450+0000","last_clean":"2024-09-14T12:06:59.578450+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:06:59.578450+0000","last_undegraded":"2024-09-14T12:06:59.578450+0000","last_fullsized":"2024-09-14T12:06:59.578450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:16.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'371","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.537432+0000","last_change":"2024-09-14T11:10:56.611500+0000","last_active":"2024-09-14T12:09:54.537432+0000","last_peered":"2024-09-14T12:09:54.537432+0000","last_clean":"2024-09-14T12:09:54.537432+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:09:54.537432+0000","last_undegraded":"2024-09-14T12:09:54.537432+0000","last_fullsized":"2024-09-14T12:09:54.537432+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:25.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2484528,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":664,"num_read_kb":4801,"num_write":1278,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579198+0000","last_change":"2024-09-14T11:10:58.608218+0000","last_active":"2024-09-14T12:06:59.579198+0000","last_peered":"2024-09-14T12:06:59.579198+0000","last_clean":"2024-09-14T12:06:59.579198+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:06:59.579198+0000","last_undegraded":"2024-09-14T12:06:59.579198+0000","last_fullsized":"2024-09-14T12:06:59.579198+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:48.756943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'258","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.581808+0000","last_change":"2024-09-14T11:10:56.610804+0000","last_active":"2024-09-14T12:06:35.581808+0000","last_peered":"2024-09-14T12:06:35.581808+0000","last_clean":"2024-09-14T12:06:35.581808+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:06:35.581808+0000","last_undegraded":"2024-09-14T12:06:35.581808+0000","last_fullsized":"2024-09-14T12:06:35.581808+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:54.575624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107799,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":512,"num_read_kb":2774,"num_write":942,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716372+0000","last_change":"2024-09-14T11:10:58.603033+0000","last_active":"2024-09-14T12:07:09.716372+0000","last_peered":"2024-09-14T12:07:09.716372+0000","last_clean":"2024-09-14T12:07:09.716372+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:07:09.716372+0000","last_undegraded":"2024-09-14T12:07:09.716372+0000","last_fullsized":"2024-09-14T12:07:09.716372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:05.684294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'278","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.581781+0000","last_change":"2024-09-14T11:10:56.617586+0000","last_active":"2024-09-14T12:06:35.581781+0000","last_peered":"2024-09-14T12:06:35.581781+0000","last_clean":"2024-09-14T12:06:35.581781+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:06:35.581781+0000","last_undegraded":"2024-09-14T12:06:35.581781+0000","last_fullsized":"2024-09-14T12:06:35.581781+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:28.064756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22098512,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":675,"num_read_kb":52006,"num_write":1052,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:17.637379+0000","last_change":"2024-09-14T11:10:58.612342+0000","last_active":"2024-09-14T12:07:17.637379+0000","last_peered":"2024-09-14T12:07:17.637379+0000","last_clean":"2024-09-14T12:07:17.637379+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:07:17.637379+0000","last_undegraded":"2024-09-14T12:07:17.637379+0000","last_fullsized":"2024-09-14T12:07:17.637379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:26.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'368","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.586478+0000","last_change":"2024-09-14T11:10:56.622021+0000","last_active":"2024-09-14T12:09:54.586478+0000","last_peered":"2024-09-14T12:09:54.586478+0000","last_clean":"2024-09-14T12:09:54.586478+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:09:54.586478+0000","last_undegraded":"2024-09-14T12:09:54.586478+0000","last_fullsized":"2024-09-14T12:09:54.586478+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.040554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1059,"num_read_kb":40711,"num_write":1146,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649064+0000","last_change":"2024-09-14T11:10:58.606489+0000","last_active":"2024-09-14T12:06:34.649064+0000","last_peered":"2024-09-14T12:06:34.649064+0000","last_clean":"2024-09-14T12:06:34.649064+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:06:34.649064+0000","last_undegraded":"2024-09-14T12:06:34.649064+0000","last_fullsized":"2024-09-14T12:06:34.649064+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.112863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'335","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656611+0000","last_change":"2024-09-14T11:10:56.618036+0000","last_active":"2024-09-14T12:09:54.656611+0000","last_peered":"2024-09-14T12:09:54.656611+0000","last_clean":"2024-09-14T12:09:54.656611+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:09:54.656611+0000","last_undegraded":"2024-09-14T12:09:54.656611+0000","last_fullsized":"2024-09-14T12:09:54.656611+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.228155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254545,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":58308,"num_write":1136,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.575165+0000","last_change":"2024-09-14T11:10:58.599593+0000","last_active":"2024-09-14T12:06:34.575165+0000","last_peered":"2024-09-14T12:06:34.575165+0000","last_clean":"2024-09-14T12:06:34.575165+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:06:34.575165+0000","last_undegraded":"2024-09-14T12:06:34.575165+0000","last_fullsized":"2024-09-14T12:06:34.575165+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.706476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'339","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569624+0000","last_change":"2024-09-14T11:10:56.624205+0000","last_active":"2024-09-14T12:07:15.569624+0000","last_peered":"2024-09-14T12:07:15.569624+0000","last_clean":"2024-09-14T12:07:15.569624+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:07:15.569624+0000","last_undegraded":"2024-09-14T12:07:15.569624+0000","last_fullsized":"2024-09-14T12:07:15.569624+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:53.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8012533,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":558,"num_read_kb":94295,"num_write":1082,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'189","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.512796+0000","last_change":"2024-09-14T11:11:06.654536+0000","last_active":"2024-09-14T12:07:57.512796+0000","last_peered":"2024-09-14T12:07:57.512796+0000","last_clean":"2024-09-14T12:07:57.512796+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:07:57.512796+0000","last_undegraded":"2024-09-14T12:07:57.512796+0000","last_fullsized":"2024-09-14T12:07:57.512796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:45.779160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'122","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:51.635212+0000","last_change":"2024-09-14T11:11:32.678345+0000","last_active":"2024-09-14T12:06:51.635212+0000","last_peered":"2024-09-14T12:06:51.635212+0000","last_clean":"2024-09-14T12:06:51.635212+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:06:51.635212+0000","last_undegraded":"2024-09-14T12:06:51.635212+0000","last_fullsized":"2024-09-14T12:06:51.635212+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:14.964766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'484","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562045+0000","last_change":"2024-09-14T11:10:56.614109+0000","last_active":"2024-09-14T12:09:54.562045+0000","last_peered":"2024-09-14T12:09:54.562045+0000","last_clean":"2024-09-14T12:09:54.562045+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:09:54.562045+0000","last_undegraded":"2024-09-14T12:09:54.562045+0000","last_fullsized":"2024-09-14T12:09:54.562045+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079997,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":947,"num_read_kb":68364,"num_write":1399,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711914+0000","last_change":"2024-09-14T11:11:00.612390+0000","last_active":"2024-09-14T12:06:39.711914+0000","last_peered":"2024-09-14T12:06:39.711914+0000","last_clean":"2024-09-14T12:06:39.711914+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:06:39.711914+0000","last_undegraded":"2024-09-14T12:06:39.711914+0000","last_fullsized":"2024-09-14T12:06:39.711914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.711231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'316","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.583331+0000","last_change":"2024-09-14T11:11:02.616888+0000","last_active":"2024-09-14T12:09:05.583331+0000","last_peered":"2024-09-14T12:09:05.583331+0000","last_clean":"2024-09-14T12:09:05.583331+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:09:05.583331+0000","last_undegraded":"2024-09-14T12:09:05.583331+0000","last_fullsized":"2024-09-14T12:09:05.583331+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:38.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":925,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576286+0000","last_change":"2024-09-14T11:11:04.630024+0000","last_active":"2024-09-14T12:06:39.576286+0000","last_peered":"2024-09-14T12:06:39.576286+0000","last_clean":"2024-09-14T12:06:39.576286+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:06:39.576286+0000","last_undegraded":"2024-09-14T12:06:39.576286+0000","last_fullsized":"2024-09-14T12:06:39.576286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.568217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.875581+0000","last_change":"2024-09-14T11:11:06.647460+0000","last_active":"2024-09-14T12:09:13.875581+0000","last_peered":"2024-09-14T12:09:13.875581+0000","last_clean":"2024-09-14T12:09:13.875581+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:09:13.875581+0000","last_undegraded":"2024-09-14T12:09:13.875581+0000","last_fullsized":"2024-09-14T12:09:13.875581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:13.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.840018+0000","last_change":"2024-09-14T11:10:58.598908+0000","last_active":"2024-09-14T12:06:34.840018+0000","last_peered":"2024-09-14T12:06:34.840018+0000","last_clean":"2024-09-14T12:06:34.840018+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:06:34.840018+0000","last_undegraded":"2024-09-14T12:06:34.840018+0000","last_fullsized":"2024-09-14T12:06:34.840018+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:45.457809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'238","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567753+0000","last_change":"2024-09-14T11:10:56.623842+0000","last_active":"2024-09-14T12:07:00.567753+0000","last_peered":"2024-09-14T12:07:00.567753+0000","last_clean":"2024-09-14T12:07:00.567753+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:07:00.567753+0000","last_undegraded":"2024-09-14T12:07:00.567753+0000","last_fullsized":"2024-09-14T12:07:00.567753+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:59.906680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487303,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":778,"num_read_kb":44655,"num_write":954,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681915+0000","last_change":"2024-09-14T11:11:00.610829+0000","last_active":"2024-09-14T12:07:14.681915+0000","last_peered":"2024-09-14T12:07:14.681915+0000","last_clean":"2024-09-14T12:07:14.681915+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:07:14.681915+0000","last_undegraded":"2024-09-14T12:07:14.681915+0000","last_fullsized":"2024-09-14T12:07:14.681915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:59.756124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.887529+0000","last_change":"2024-09-14T11:11:02.616223+0000","last_active":"2024-09-14T12:07:04.887529+0000","last_peered":"2024-09-14T12:07:04.887529+0000","last_clean":"2024-09-14T12:07:04.887529+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:07:04.887529+0000","last_undegraded":"2024-09-14T12:07:04.887529+0000","last_fullsized":"2024-09-14T12:07:04.887529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.797468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575949+0000","last_change":"2024-09-14T11:11:04.636341+0000","last_active":"2024-09-14T12:06:39.575949+0000","last_peered":"2024-09-14T12:06:39.575949+0000","last_clean":"2024-09-14T12:06:39.575949+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:06:39.575949+0000","last_undegraded":"2024-09-14T12:06:39.575949+0000","last_fullsized":"2024-09-14T12:06:39.575949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:29.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'146","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561795+0000","last_change":"2024-09-14T11:11:06.647305+0000","last_active":"2024-09-14T12:06:10.561795+0000","last_peered":"2024-09-14T12:06:10.561795+0000","last_clean":"2024-09-14T12:06:10.561795+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:06:10.561795+0000","last_undegraded":"2024-09-14T12:06:10.561795+0000","last_fullsized":"2024-09-14T12:06:10.561795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:31.457028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564820+0000","last_change":"2024-09-14T11:10:58.615755+0000","last_active":"2024-09-14T12:06:35.564820+0000","last_peered":"2024-09-14T12:06:35.564820+0000","last_clean":"2024-09-14T12:06:35.564820+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:06:35.564820+0000","last_undegraded":"2024-09-14T12:06:35.564820+0000","last_fullsized":"2024-09-14T12:06:35.564820+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:50.889127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'397","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.573491+0000","last_change":"2024-09-14T11:10:56.614555+0000","last_active":"2024-09-14T12:09:54.573491+0000","last_peered":"2024-09-14T12:09:54.573491+0000","last_clean":"2024-09-14T12:09:54.573491+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:09:54.573491+0000","last_undegraded":"2024-09-14T12:09:54.573491+0000","last_fullsized":"2024-09-14T12:09:54.573491+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:18.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404659,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":624,"num_read_kb":37554,"num_write":1175,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.678008+0000","last_change":"2024-09-14T11:11:00.613697+0000","last_active":"2024-09-14T12:06:39.678008+0000","last_peered":"2024-09-14T12:06:39.678008+0000","last_clean":"2024-09-14T12:06:39.678008+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:06:39.678008+0000","last_undegraded":"2024-09-14T12:06:39.678008+0000","last_fullsized":"2024-09-14T12:06:39.678008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:02.212530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'117","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.652713+0000","last_change":"2024-09-14T11:11:02.616784+0000","last_active":"2024-09-14T12:07:09.652713+0000","last_peered":"2024-09-14T12:07:09.652713+0000","last_clean":"2024-09-14T12:07:09.652713+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:07:09.652713+0000","last_undegraded":"2024-09-14T12:07:09.652713+0000","last_fullsized":"2024-09-14T12:07:09.652713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:51.199047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'769","reported_seq":2412,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.530183+0000","last_change":"2024-09-14T11:11:04.634733+0000","last_active":"2024-09-14T12:09:52.530183+0000","last_peered":"2024-09-14T12:09:52.530183+0000","last_clean":"2024-09-14T12:09:52.530183+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:09:52.530183+0000","last_undegraded":"2024-09-14T12:09:52.530183+0000","last_fullsized":"2024-09-14T12:09:52.530183+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.929041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'217","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.572311+0000","last_change":"2024-09-14T11:11:06.650554+0000","last_active":"2024-09-14T12:07:57.572311+0000","last_peered":"2024-09-14T12:07:57.572311+0000","last_clean":"2024-09-14T12:07:57.572311+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:07:57.572311+0000","last_undegraded":"2024-09-14T12:07:57.572311+0000","last_fullsized":"2024-09-14T12:07:57.572311+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:31.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.883384+0000","last_change":"2024-09-14T11:10:58.602798+0000","last_active":"2024-09-14T12:07:04.883384+0000","last_peered":"2024-09-14T12:07:04.883384+0000","last_clean":"2024-09-14T12:07:04.883384+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:07:04.883384+0000","last_undegraded":"2024-09-14T12:07:04.883384+0000","last_fullsized":"2024-09-14T12:07:04.883384+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.362755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'350","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:01.028557+0000","last_change":"2024-09-14T11:10:56.612227+0000","last_active":"2024-09-14T12:07:01.028557+0000","last_peered":"2024-09-14T12:07:01.028557+0000","last_clean":"2024-09-14T12:07:01.028557+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:07:01.028557+0000","last_undegraded":"2024-09-14T12:07:01.028557+0000","last_fullsized":"2024-09-14T12:07:01.028557+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:54.163614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320165,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":932,"num_read_kb":6071,"num_write":1196,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711951+0000","last_change":"2024-09-14T11:11:00.611895+0000","last_active":"2024-09-14T12:06:39.711951+0000","last_peered":"2024-09-14T12:06:39.711951+0000","last_clean":"2024-09-14T12:06:39.711951+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:06:39.711951+0000","last_undegraded":"2024-09-14T12:06:39.711951+0000","last_fullsized":"2024-09-14T12:06:39.711951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:07.634034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.469446+0000","last_change":"2024-09-14T11:11:02.883054+0000","last_active":"2024-09-14T12:09:53.469446+0000","last_peered":"2024-09-14T12:09:53.469446+0000","last_clean":"2024-09-14T12:09:53.469446+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:09:53.469446+0000","last_undegraded":"2024-09-14T12:09:53.469446+0000","last_fullsized":"2024-09-14T12:09:53.469446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:16.798635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'791","reported_seq":2487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.146287+0000","last_change":"2024-09-14T11:11:04.639858+0000","last_active":"2024-09-14T12:09:54.146287+0000","last_peered":"2024-09-14T12:09:54.146287+0000","last_clean":"2024-09-14T12:09:54.146287+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:09:54.146287+0000","last_undegraded":"2024-09-14T12:09:54.146287+0000","last_fullsized":"2024-09-14T12:09:54.146287+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:13.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717940+0000","last_change":"2024-09-14T11:10:58.598011+0000","last_active":"2024-09-14T12:07:19.717940+0000","last_peered":"2024-09-14T12:07:19.717940+0000","last_clean":"2024-09-14T12:07:19.717940+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:07:19.717940+0000","last_undegraded":"2024-09-14T12:07:19.717940+0000","last_fullsized":"2024-09-14T12:07:19.717940+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:52.644545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'371","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.543142+0000","last_change":"2024-09-14T11:10:56.616170+0000","last_active":"2024-09-14T12:09:54.543142+0000","last_peered":"2024-09-14T12:09:54.543142+0000","last_clean":"2024-09-14T12:09:54.543142+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:09:54.543142+0000","last_undegraded":"2024-09-14T12:09:54.543142+0000","last_fullsized":"2024-09-14T12:09:54.543142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:36.161974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343370,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":30361,"num_write":1109,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582730+0000","last_change":"2024-09-14T11:11:00.603633+0000","last_active":"2024-09-14T12:07:24.582730+0000","last_peered":"2024-09-14T12:07:24.582730+0000","last_clean":"2024-09-14T12:07:24.582730+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:07:24.582730+0000","last_undegraded":"2024-09-14T12:07:24.582730+0000","last_fullsized":"2024-09-14T12:07:24.582730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:24.637144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'380","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.075411+0000","last_change":"2024-09-14T11:11:02.882354+0000","last_active":"2024-09-14T12:09:54.075411+0000","last_peered":"2024-09-14T12:09:54.075411+0000","last_clean":"2024-09-14T12:09:54.075411+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:09:54.075411+0000","last_undegraded":"2024-09-14T12:09:54.075411+0000","last_fullsized":"2024-09-14T12:09:54.075411+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:23.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671886+0000","last_change":"2024-09-14T11:11:04.630742+0000","last_active":"2024-09-14T12:07:20.671886+0000","last_peered":"2024-09-14T12:07:20.671886+0000","last_clean":"2024-09-14T12:07:20.671886+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:07:20.671886+0000","last_undegraded":"2024-09-14T12:07:20.671886+0000","last_fullsized":"2024-09-14T12:07:20.671886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:21.580563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'537","reported_seq":1354,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.874293+0000","last_change":"2024-09-14T11:11:06.650569+0000","last_active":"2024-09-14T12:09:14.874293+0000","last_peered":"2024-09-14T12:09:14.874293+0000","last_clean":"2024-09-14T12:09:14.874293+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:09:14.874293+0000","last_undegraded":"2024-09-14T12:09:14.874293+0000","last_fullsized":"2024-09-14T12:09:14.874293+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.704565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.881520+0000","last_change":"2024-09-14T11:10:58.600081+0000","last_active":"2024-09-14T12:09:13.881520+0000","last_peered":"2024-09-14T12:09:13.881520+0000","last_clean":"2024-09-14T12:09:13.881520+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:09:13.881520+0000","last_undegraded":"2024-09-14T12:09:13.881520+0000","last_fullsized":"2024-09-14T12:09:13.881520+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:49.242910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'382","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.567050+0000","last_change":"2024-09-14T11:10:56.608381+0000","last_active":"2024-09-14T12:09:54.567050+0000","last_peered":"2024-09-14T12:09:54.567050+0000","last_clean":"2024-09-14T12:09:54.567050+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:09:54.567050+0000","last_undegraded":"2024-09-14T12:09:54.567050+0000","last_fullsized":"2024-09-14T12:09:54.567050+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:44.373341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":57128,"num_write":1150,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656137+0000","last_change":"2024-09-14T11:11:00.610368+0000","last_active":"2024-09-14T12:07:24.656137+0000","last_peered":"2024-09-14T12:07:24.656137+0000","last_clean":"2024-09-14T12:07:24.656137+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:07:24.656137+0000","last_undegraded":"2024-09-14T12:07:24.656137+0000","last_fullsized":"2024-09-14T12:07:24.656137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:41.032264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'270","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.724302+0000","last_change":"2024-09-14T11:11:02.620109+0000","last_active":"2024-09-14T12:09:52.724302+0000","last_peered":"2024-09-14T12:09:52.724302+0000","last_clean":"2024-09-14T12:09:52.724302+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:09:52.724302+0000","last_undegraded":"2024-09-14T12:09:52.724302+0000","last_fullsized":"2024-09-14T12:09:52.724302+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:44.080763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.684553+0000","last_change":"2024-09-14T11:11:04.638763+0000","last_active":"2024-09-14T12:07:34.684553+0000","last_peered":"2024-09-14T12:07:34.684553+0000","last_clean":"2024-09-14T12:07:34.684553+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:07:34.684553+0000","last_undegraded":"2024-09-14T12:07:34.684553+0000","last_fullsized":"2024-09-14T12:07:34.684553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:07.104699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2496","reported_seq":4317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.077061+0000","last_change":"2024-09-14T11:11:06.650408+0000","last_active":"2024-09-14T12:09:04.077061+0000","last_peered":"2024-09-14T12:09:04.077061+0000","last_clean":"2024-09-14T12:09:04.077061+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:09:04.077061+0000","last_undegraded":"2024-09-14T12:09:04.077061+0000","last_fullsized":"2024-09-14T12:09:04.077061+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:25.723597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4177","reported_seq":4819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589584+0000","last_change":"2024-09-14T11:10:58.612551+0000","last_active":"2024-09-14T12:07:30.589584+0000","last_peered":"2024-09-14T12:07:30.589584+0000","last_clean":"2024-09-14T12:07:30.589584+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:07:30.589584+0000","last_undegraded":"2024-09-14T12:07:30.589584+0000","last_fullsized":"2024-09-14T12:07:30.589584+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":3000,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.250782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.568383+0000","last_change":"2024-09-14T11:10:56.609814+0000","last_active":"2024-09-14T12:09:54.568383+0000","last_peered":"2024-09-14T12:09:54.568383+0000","last_clean":"2024-09-14T12:09:54.568383+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:09:54.568383+0000","last_undegraded":"2024-09-14T12:09:54.568383+0000","last_fullsized":"2024-09-14T12:09:54.568383+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:46.610327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":622,"num_read_kb":21988,"num_write":1236,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655616+0000","last_change":"2024-09-14T11:11:00.609607+0000","last_active":"2024-09-14T12:07:19.655616+0000","last_peered":"2024-09-14T12:07:19.655616+0000","last_clean":"2024-09-14T12:07:19.655616+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:07:19.655616+0000","last_undegraded":"2024-09-14T12:07:19.655616+0000","last_fullsized":"2024-09-14T12:07:19.655616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:33.650477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'309","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.203620+0000","last_change":"2024-09-14T11:11:02.615273+0000","last_active":"2024-09-14T12:09:54.203620+0000","last_peered":"2024-09-14T12:09:54.203620+0000","last_clean":"2024-09-14T12:09:54.203620+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:09:54.203620+0000","last_undegraded":"2024-09-14T12:09:54.203620+0000","last_fullsized":"2024-09-14T12:09:54.203620+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:37.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'776","reported_seq":2790,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.436264+0000","last_change":"2024-09-14T11:11:04.634337+0000","last_active":"2024-09-14T12:09:18.436264+0000","last_peered":"2024-09-14T12:09:18.436264+0000","last_clean":"2024-09-14T12:09:18.436264+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:09:18.436264+0000","last_undegraded":"2024-09-14T12:09:18.436264+0000","last_fullsized":"2024-09-14T12:09:18.436264+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":701,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:25.363526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'154","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.869470+0000","last_change":"2024-09-14T11:11:06.648183+0000","last_active":"2024-09-14T12:09:13.869470+0000","last_peered":"2024-09-14T12:09:13.869470+0000","last_clean":"2024-09-14T12:09:13.869470+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:09:13.869470+0000","last_undegraded":"2024-09-14T12:09:13.869470+0000","last_fullsized":"2024-09-14T12:09:13.869470+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:52.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569651+0000","last_change":"2024-09-14T11:10:58.614518+0000","last_active":"2024-09-14T12:07:15.569651+0000","last_peered":"2024-09-14T12:07:15.569651+0000","last_clean":"2024-09-14T12:07:15.569651+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:07:15.569651+0000","last_undegraded":"2024-09-14T12:07:15.569651+0000","last_fullsized":"2024-09-14T12:07:15.569651+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:29.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'363","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.626569+0000","last_change":"2024-09-14T11:10:56.622559+0000","last_active":"2024-09-14T12:09:54.626569+0000","last_peered":"2024-09-14T12:09:54.626569+0000","last_clean":"2024-09-14T12:09:54.626569+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:09:54.626569+0000","last_undegraded":"2024-09-14T12:09:54.626569+0000","last_fullsized":"2024-09-14T12:09:54.626569+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:02.051757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":27518,"num_write":1081,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.656694+0000","last_change":"2024-09-14T11:11:00.617025+0000","last_active":"2024-09-14T12:07:29.656694+0000","last_peered":"2024-09-14T12:07:29.656694+0000","last_clean":"2024-09-14T12:07:29.656694+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:07:29.656694+0000","last_undegraded":"2024-09-14T12:07:29.656694+0000","last_fullsized":"2024-09-14T12:07:29.656694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.898496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'469","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.859881+0000","last_change":"2024-09-14T11:11:02.617234+0000","last_active":"2024-09-14T12:09:14.859881+0000","last_peered":"2024-09-14T12:09:14.859881+0000","last_clean":"2024-09-14T12:09:14.859881+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:09:14.859881+0000","last_undegraded":"2024-09-14T12:09:14.859881+0000","last_fullsized":"2024-09-14T12:09:14.859881+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:10.153711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":1773,"num_write":682,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656109+0000","last_change":"2024-09-14T11:11:04.629148+0000","last_active":"2024-09-14T12:07:24.656109+0000","last_peered":"2024-09-14T12:07:24.656109+0000","last_clean":"2024-09-14T12:07:24.656109+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:07:24.656109+0000","last_undegraded":"2024-09-14T12:07:24.656109+0000","last_fullsized":"2024-09-14T12:07:24.656109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.153280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'174","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.360071+0000","last_change":"2024-09-14T11:11:06.652430+0000","last_active":"2024-09-14T12:07:57.360071+0000","last_peered":"2024-09-14T12:07:57.360071+0000","last_clean":"2024-09-14T12:07:57.360071+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:07:57.360071+0000","last_undegraded":"2024-09-14T12:07:57.360071+0000","last_fullsized":"2024-09-14T12:07:57.360071+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:26.755770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580740+0000","last_change":"2024-09-14T11:10:58.612653+0000","last_active":"2024-09-14T12:07:14.580740+0000","last_peered":"2024-09-14T12:07:14.580740+0000","last_clean":"2024-09-14T12:07:14.580740+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:07:14.580740+0000","last_undegraded":"2024-09-14T12:07:14.580740+0000","last_fullsized":"2024-09-14T12:07:14.580740+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:48.760017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'301","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656443+0000","last_change":"2024-09-14T11:12:33.311513+0000","last_active":"2024-09-14T12:09:54.656443+0000","last_peered":"2024-09-14T12:09:54.656443+0000","last_clean":"2024-09-14T12:09:54.656443+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:09:54.656443+0000","last_undegraded":"2024-09-14T12:09:54.656443+0000","last_fullsized":"2024-09-14T12:09:54.656443+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:12.192936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079951,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":20886,"num_write":920,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655667+0000","last_change":"2024-09-14T11:11:00.613586+0000","last_active":"2024-09-14T12:07:19.655667+0000","last_peered":"2024-09-14T12:07:19.655667+0000","last_clean":"2024-09-14T12:07:19.655667+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:07:19.655667+0000","last_undegraded":"2024-09-14T12:07:19.655667+0000","last_fullsized":"2024-09-14T12:07:19.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.876699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.032254+0000","last_change":"2024-09-14T11:11:02.617188+0000","last_active":"2024-09-14T12:09:53.032254+0000","last_peered":"2024-09-14T12:09:53.032254+0000","last_clean":"2024-09-14T12:09:53.032254+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:09:53.032254+0000","last_undegraded":"2024-09-14T12:09:53.032254+0000","last_fullsized":"2024-09-14T12:09:53.032254+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:27.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571992+0000","last_change":"2024-09-14T11:11:04.638409+0000","last_active":"2024-09-14T12:07:35.571992+0000","last_peered":"2024-09-14T12:07:35.571992+0000","last_clean":"2024-09-14T12:07:35.571992+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:07:35.571992+0000","last_undegraded":"2024-09-14T12:07:35.571992+0000","last_fullsized":"2024-09-14T12:07:35.571992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.627071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'96","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.080423+0000","last_change":"2024-09-14T11:11:06.653079+0000","last_active":"2024-09-14T12:09:04.080423+0000","last_peered":"2024-09-14T12:09:04.080423+0000","last_clean":"2024-09-14T12:09:04.080423+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:09:04.080423+0000","last_undegraded":"2024-09-14T12:09:04.080423+0000","last_fullsized":"2024-09-14T12:09:04.080423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:58.237781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580780+0000","last_change":"2024-09-14T11:10:58.606197+0000","last_active":"2024-09-14T12:07:14.580780+0000","last_peered":"2024-09-14T12:07:14.580780+0000","last_clean":"2024-09-14T12:07:14.580780+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:07:14.580780+0000","last_undegraded":"2024-09-14T12:07:14.580780+0000","last_fullsized":"2024-09-14T12:07:14.580780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.386371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'291","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589566+0000","last_change":"2024-09-14T11:10:56.604612+0000","last_active":"2024-09-14T12:07:30.589566+0000","last_peered":"2024-09-14T12:07:30.589566+0000","last_clean":"2024-09-14T12:07:30.589566+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:07:30.589566+0000","last_undegraded":"2024-09-14T12:07:30.589566+0000","last_fullsized":"2024-09-14T12:07:30.589566+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:22.350680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12615080,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":632,"num_read_kb":12874,"num_write":1098,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"37'5","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.801177+0000","last_change":"2024-09-14T11:11:00.609637+0000","last_active":"2024-09-14T12:09:14.801177+0000","last_peered":"2024-09-14T12:09:14.801177+0000","last_clean":"2024-09-14T12:09:14.801177+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:09:14.801177+0000","last_undegraded":"2024-09-14T12:09:14.801177+0000","last_fullsized":"2024-09-14T12:09:14.801177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:16.269070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.665700+0000","last_change":"2024-09-14T11:11:02.621512+0000","last_active":"2024-09-14T12:09:54.665700+0000","last_peered":"2024-09-14T12:09:54.665700+0000","last_clean":"2024-09-14T12:09:54.665700+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:09:54.665700+0000","last_undegraded":"2024-09-14T12:09:54.665700+0000","last_fullsized":"2024-09-14T12:09:54.665700+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:59.728870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'737","reported_seq":2478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.117272+0000","last_change":"2024-09-14T11:11:04.632093+0000","last_active":"2024-09-14T12:09:54.117272+0000","last_peered":"2024-09-14T12:09:54.117272+0000","last_clean":"2024-09-14T12:09:54.117272+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:09:54.117272+0000","last_undegraded":"2024-09-14T12:09:54.117272+0000","last_fullsized":"2024-09-14T12:09:54.117272+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:57.296761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.523143+0000","last_change":"2024-09-14T11:11:06.644785+0000","last_active":"2024-09-14T12:07:55.523143+0000","last_peered":"2024-09-14T12:07:55.523143+0000","last_clean":"2024-09-14T12:07:55.523143+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:07:55.523143+0000","last_undegraded":"2024-09-14T12:07:55.523143+0000","last_fullsized":"2024-09-14T12:07:55.523143+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:20.927650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":716,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580793+0000","last_change":"2024-09-14T11:10:58.604051+0000","last_active":"2024-09-14T12:07:14.580793+0000","last_peered":"2024-09-14T12:07:14.580793+0000","last_clean":"2024-09-14T12:07:14.580793+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:07:14.580793+0000","last_undegraded":"2024-09-14T12:07:14.580793+0000","last_fullsized":"2024-09-14T12:07:14.580793+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:21.106777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'306","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.500861+0000","last_change":"2024-09-14T11:10:56.614986+0000","last_active":"2024-09-14T12:09:54.500861+0000","last_peered":"2024-09-14T12:09:54.500861+0000","last_clean":"2024-09-14T12:09:54.500861+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:54.500861+0000","last_undegraded":"2024-09-14T12:09:54.500861+0000","last_fullsized":"2024-09-14T12:09:54.500861+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:02.927242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":37577,"num_write":937,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.939893+0000","last_change":"2024-09-14T11:11:00.612934+0000","last_active":"2024-09-14T12:09:51.939893+0000","last_peered":"2024-09-14T12:09:51.939893+0000","last_clean":"2024-09-14T12:09:51.939893+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:09:51.939893+0000","last_undegraded":"2024-09-14T12:09:51.939893+0000","last_fullsized":"2024-09-14T12:09:51.939893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:31.596836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'90","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682622+0000","last_change":"2024-09-14T11:11:02.882134+0000","last_active":"2024-09-14T12:07:19.682622+0000","last_peered":"2024-09-14T12:07:19.682622+0000","last_clean":"2024-09-14T12:07:19.682622+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:07:19.682622+0000","last_undegraded":"2024-09-14T12:07:19.682622+0000","last_fullsized":"2024-09-14T12:07:19.682622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.534285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'771","reported_seq":2468,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.430883+0000","last_change":"2024-09-14T11:11:04.634705+0000","last_active":"2024-09-14T12:09:18.430883+0000","last_peered":"2024-09-14T12:09:18.430883+0000","last_clean":"2024-09-14T12:09:18.430883+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:09:18.430883+0000","last_undegraded":"2024-09-14T12:09:18.430883+0000","last_fullsized":"2024-09-14T12:09:18.430883+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:03.937654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'114","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582391+0000","last_change":"2024-09-14T11:11:06.646677+0000","last_active":"2024-09-14T12:07:24.582391+0000","last_peered":"2024-09-14T12:07:24.582391+0000","last_clean":"2024-09-14T12:07:24.582391+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:07:24.582391+0000","last_undegraded":"2024-09-14T12:07:24.582391+0000","last_fullsized":"2024-09-14T12:07:24.582391+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:35.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'141","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672466+0000","last_change":"2024-09-14T11:10:58.604050+0000","last_active":"2024-09-14T12:07:25.672466+0000","last_peered":"2024-09-14T12:07:25.672466+0000","last_clean":"2024-09-14T12:07:25.672466+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:07:25.672466+0000","last_undegraded":"2024-09-14T12:07:25.672466+0000","last_fullsized":"2024-09-14T12:07:25.672466+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:01.910346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.606683+0000","last_change":"2024-09-14T11:10:56.621625+0000","last_active":"2024-09-14T12:09:54.606683+0000","last_peered":"2024-09-14T12:09:54.606683+0000","last_clean":"2024-09-14T12:09:54.606683+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:09:54.606683+0000","last_undegraded":"2024-09-14T12:09:54.606683+0000","last_fullsized":"2024-09-14T12:09:54.606683+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.662417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581695+0000","last_change":"2024-09-14T11:11:00.612752+0000","last_active":"2024-09-14T12:07:19.581695+0000","last_peered":"2024-09-14T12:07:19.581695+0000","last_clean":"2024-09-14T12:07:19.581695+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:07:19.581695+0000","last_undegraded":"2024-09-14T12:07:19.581695+0000","last_fullsized":"2024-09-14T12:07:19.581695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.297030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'355","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.860007+0000","last_change":"2024-09-14T11:11:02.616725+0000","last_active":"2024-09-14T12:09:53.860007+0000","last_peered":"2024-09-14T12:09:53.860007+0000","last_clean":"2024-09-14T12:09:53.860007+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:09:53.860007+0000","last_undegraded":"2024-09-14T12:09:53.860007+0000","last_fullsized":"2024-09-14T12:09:53.860007+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:01.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.588143+0000","last_change":"2024-09-14T11:11:04.635198+0000","last_active":"2024-09-14T12:07:20.588143+0000","last_peered":"2024-09-14T12:07:20.588143+0000","last_clean":"2024-09-14T12:07:20.588143+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:07:20.588143+0000","last_undegraded":"2024-09-14T12:07:20.588143+0000","last_fullsized":"2024-09-14T12:07:20.588143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:55.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'136","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672420+0000","last_change":"2024-09-14T11:11:06.646340+0000","last_active":"2024-09-14T12:07:25.672420+0000","last_peered":"2024-09-14T12:07:25.672420+0000","last_clean":"2024-09-14T12:07:25.672420+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:07:25.672420+0000","last_undegraded":"2024-09-14T12:07:25.672420+0000","last_fullsized":"2024-09-14T12:07:25.672420+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:44.114108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'105","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:55.202777+0000","last_change":"2024-09-14T11:10:58.606027+0000","last_active":"2024-09-14T12:08:55.202777+0000","last_peered":"2024-09-14T12:08:55.202777+0000","last_clean":"2024-09-14T12:08:55.202777+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:08:55.202777+0000","last_undegraded":"2024-09-14T12:08:55.202777+0000","last_fullsized":"2024-09-14T12:08:55.202777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:25.981163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578466+0000","last_change":"2024-09-14T11:10:40.558361+0000","last_active":"2024-09-14T12:06:54.578466+0000","last_peered":"2024-09-14T12:06:54.578466+0000","last_clean":"2024-09-14T12:06:54.578466+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:06:54.578466+0000","last_undegraded":"2024-09-14T12:06:54.578466+0000","last_fullsized":"2024-09-14T12:06:54.578466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_clean_scrub_stamp":"2024-09-14T11:10:39.523268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:36.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715535+0000","last_change":"2024-09-14T11:10:49.566289+0000","last_active":"2024-09-14T12:07:04.715535+0000","last_peered":"2024-09-14T12:07:04.715535+0000","last_clean":"2024-09-14T12:07:04.715535+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:07:04.715535+0000","last_undegraded":"2024-09-14T12:07:04.715535+0000","last_fullsized":"2024-09-14T12:07:04.715535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:43.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'316","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.558033+0000","last_change":"2024-09-14T11:10:56.613702+0000","last_active":"2024-09-14T12:09:54.558033+0000","last_peered":"2024-09-14T12:09:54.558033+0000","last_clean":"2024-09-14T12:09:54.558033+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:09:54.558033+0000","last_undegraded":"2024-09-14T12:09:54.558033+0000","last_fullsized":"2024-09-14T12:09:54.558033+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.052677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079939,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":21923,"num_write":1074,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582005+0000","last_change":"2024-09-14T11:11:00.610291+0000","last_active":"2024-09-14T12:07:19.582005+0000","last_peered":"2024-09-14T12:07:19.582005+0000","last_clean":"2024-09-14T12:07:19.582005+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:07:19.582005+0000","last_undegraded":"2024-09-14T12:07:19.582005+0000","last_fullsized":"2024-09-14T12:07:19.582005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:59.638567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'762","reported_seq":1474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.547865+0000","last_change":"2024-09-14T11:11:02.621281+0000","last_active":"2024-09-14T12:09:54.547865+0000","last_peered":"2024-09-14T12:09:54.547865+0000","last_clean":"2024-09-14T12:09:54.547865+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:09:54.547865+0000","last_undegraded":"2024-09-14T12:09:54.547865+0000","last_fullsized":"2024-09-14T12:09:54.547865+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:39.469737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.570862+0000","last_change":"2024-09-14T11:11:04.632962+0000","last_active":"2024-09-14T12:07:25.570862+0000","last_peered":"2024-09-14T12:07:25.570862+0000","last_clean":"2024-09-14T12:07:25.570862+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:07:25.570862+0000","last_undegraded":"2024-09-14T12:07:25.570862+0000","last_fullsized":"2024-09-14T12:07:25.570862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'182","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.397769+0000","last_change":"2024-09-14T11:11:06.647490+0000","last_active":"2024-09-14T12:07:57.397769+0000","last_peered":"2024-09-14T12:07:57.397769+0000","last_clean":"2024-09-14T12:07:57.397769+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:07:57.397769+0000","last_undegraded":"2024-09-14T12:07:57.397769+0000","last_fullsized":"2024-09-14T12:07:57.397769+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:49.491579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570300+0000","last_change":"2024-09-14T11:10:58.611939+0000","last_active":"2024-09-14T12:07:20.570300+0000","last_peered":"2024-09-14T12:07:20.570300+0000","last_clean":"2024-09-14T12:07:20.570300+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:07:20.570300+0000","last_undegraded":"2024-09-14T12:07:20.570300+0000","last_fullsized":"2024-09-14T12:07:20.570300+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:08.887333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579159+0000","last_change":"2024-09-14T11:10:49.784961+0000","last_active":"2024-09-14T12:06:59.579159+0000","last_peered":"2024-09-14T12:06:59.579159+0000","last_clean":"2024-09-14T12:06:59.579159+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:06:59.579159+0000","last_undegraded":"2024-09-14T12:06:59.579159+0000","last_fullsized":"2024-09-14T12:06:59.579159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:46.921965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'287","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569607+0000","last_change":"2024-09-14T11:11:33.134121+0000","last_active":"2024-09-14T12:07:15.569607+0000","last_peered":"2024-09-14T12:07:15.569607+0000","last_clean":"2024-09-14T12:07:15.569607+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:07:15.569607+0000","last_undegraded":"2024-09-14T12:07:15.569607+0000","last_fullsized":"2024-09-14T12:07:15.569607+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:48.763975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327439,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":560,"num_read_kb":48298,"num_write":1126,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.718904+0000","last_change":"2024-09-14T11:11:00.610424+0000","last_active":"2024-09-14T12:07:24.718904+0000","last_peered":"2024-09-14T12:07:24.718904+0000","last_clean":"2024-09-14T12:07:24.718904+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:07:24.718904+0000","last_undegraded":"2024-09-14T12:07:24.718904+0000","last_fullsized":"2024-09-14T12:07:24.718904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:04.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1258","reported_seq":2879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.392206+0000","last_change":"2024-09-14T11:11:02.616425+0000","last_active":"2024-09-14T12:09:18.392206+0000","last_peered":"2024-09-14T12:09:18.392206+0000","last_clean":"2024-09-14T12:09:18.392206+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:09:18.392206+0000","last_undegraded":"2024-09-14T12:09:18.392206+0000","last_fullsized":"2024-09-14T12:09:18.392206+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:08.009826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162865,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1989,"num_read_kb":3399,"num_write":1118,"num_write_kb":950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583514+0000","last_change":"2024-09-14T11:11:04.638084+0000","last_active":"2024-09-14T12:07:29.583514+0000","last_peered":"2024-09-14T12:07:29.583514+0000","last_clean":"2024-09-14T12:07:29.583514+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:07:29.583514+0000","last_undegraded":"2024-09-14T12:07:29.583514+0000","last_fullsized":"2024-09-14T12:07:29.583514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.322127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'220","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:40.673987+0000","last_change":"2024-09-14T11:11:06.643093+0000","last_active":"2024-09-14T12:07:40.673987+0000","last_peered":"2024-09-14T12:07:40.673987+0000","last_clean":"2024-09-14T12:07:40.673987+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:07:40.673987+0000","last_undegraded":"2024-09-14T12:07:40.673987+0000","last_fullsized":"2024-09-14T12:07:40.673987+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:50.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671975+0000","last_change":"2024-09-14T11:10:58.601798+0000","last_active":"2024-09-14T12:07:20.671975+0000","last_peered":"2024-09-14T12:07:20.671975+0000","last_clean":"2024-09-14T12:07:20.671975+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:07:20.671975+0000","last_undegraded":"2024-09-14T12:07:20.671975+0000","last_fullsized":"2024-09-14T12:07:20.671975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.795951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.652217+0000","last_change":"2024-09-14T11:10:50.167984+0000","last_active":"2024-09-14T12:07:04.652217+0000","last_peered":"2024-09-14T12:07:04.652217+0000","last_clean":"2024-09-14T12:07:04.652217+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:07:04.652217+0000","last_undegraded":"2024-09-14T12:07:04.652217+0000","last_fullsized":"2024-09-14T12:07:04.652217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:56.618404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'307","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670759+0000","last_change":"2024-09-14T11:10:56.605398+0000","last_active":"2024-09-14T12:07:10.670759+0000","last_peered":"2024-09-14T12:07:10.670759+0000","last_clean":"2024-09-14T12:07:10.670759+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:07:10.670759+0000","last_undegraded":"2024-09-14T12:07:10.670759+0000","last_fullsized":"2024-09-14T12:07:10.670759+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:37.462380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5921611,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":582,"num_read_kb":34638,"num_write":1151,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656189+0000","last_change":"2024-09-14T11:11:00.611993+0000","last_active":"2024-09-14T12:07:24.656189+0000","last_peered":"2024-09-14T12:07:24.656189+0000","last_clean":"2024-09-14T12:07:24.656189+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:07:24.656189+0000","last_undegraded":"2024-09-14T12:07:24.656189+0000","last_fullsized":"2024-09-14T12:07:24.656189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:06.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.035888+0000","last_change":"2024-09-14T11:11:02.887250+0000","last_active":"2024-09-14T12:09:15.035888+0000","last_peered":"2024-09-14T12:09:15.035888+0000","last_clean":"2024-09-14T12:09:15.035888+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:09:15.035888+0000","last_undegraded":"2024-09-14T12:09:15.035888+0000","last_fullsized":"2024-09-14T12:09:15.035888+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:22.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570276+0000","last_change":"2024-09-14T11:11:04.635365+0000","last_active":"2024-09-14T12:07:20.570276+0000","last_peered":"2024-09-14T12:07:20.570276+0000","last_clean":"2024-09-14T12:07:20.570276+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:07:20.570276+0000","last_undegraded":"2024-09-14T12:07:20.570276+0000","last_fullsized":"2024-09-14T12:07:20.570276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:48.407204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'240","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.650870+0000","last_change":"2024-09-14T11:11:06.650013+0000","last_active":"2024-09-14T12:07:57.650870+0000","last_peered":"2024-09-14T12:07:57.650870+0000","last_clean":"2024-09-14T12:07:57.650870+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:07:57.650870+0000","last_undegraded":"2024-09-14T12:07:57.650870+0000","last_fullsized":"2024-09-14T12:07:57.650870+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.193259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671361+0000","last_change":"2024-09-14T11:10:58.611132+0000","last_active":"2024-09-14T12:07:15.671361+0000","last_peered":"2024-09-14T12:07:15.671361+0000","last_clean":"2024-09-14T12:07:15.671361+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:07:15.671361+0000","last_undegraded":"2024-09-14T12:07:15.671361+0000","last_fullsized":"2024-09-14T12:07:15.671361+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:47.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715494+0000","last_change":"2024-09-14T11:10:49.566261+0000","last_active":"2024-09-14T12:07:04.715494+0000","last_peered":"2024-09-14T12:07:04.715494+0000","last_clean":"2024-09-14T12:07:04.715494+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:07:04.715494+0000","last_undegraded":"2024-09-14T12:07:04.715494+0000","last_fullsized":"2024-09-14T12:07:04.715494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:49.383472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'315","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562262+0000","last_change":"2024-09-14T11:10:56.606302+0000","last_active":"2024-09-14T12:09:54.562262+0000","last_peered":"2024-09-14T12:09:54.562262+0000","last_clean":"2024-09-14T12:09:54.562262+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:09:54.562262+0000","last_undegraded":"2024-09-14T12:09:54.562262+0000","last_fullsized":"2024-09-14T12:09:54.562262+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.821812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454581,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":658,"num_read_kb":8841,"num_write":1004,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.814661+0000","last_change":"2024-09-14T11:11:00.607385+0000","last_active":"2024-09-14T12:09:14.814661+0000","last_peered":"2024-09-14T12:09:14.814661+0000","last_clean":"2024-09-14T12:09:14.814661+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:09:14.814661+0000","last_undegraded":"2024-09-14T12:09:14.814661+0000","last_fullsized":"2024-09-14T12:09:14.814661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:18.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'141","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.049855+0000","last_change":"2024-09-14T11:11:02.619842+0000","last_active":"2024-09-14T12:09:15.049855+0000","last_peered":"2024-09-14T12:09:15.049855+0000","last_clean":"2024-09-14T12:09:15.049855+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:09:15.049855+0000","last_undegraded":"2024-09-14T12:09:15.049855+0000","last_fullsized":"2024-09-14T12:09:15.049855+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:29.586585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.588952+0000","last_change":"2024-09-14T11:11:04.632880+0000","last_active":"2024-09-14T12:07:25.588952+0000","last_peered":"2024-09-14T12:07:25.588952+0000","last_clean":"2024-09-14T12:07:25.588952+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:07:25.588952+0000","last_undegraded":"2024-09-14T12:07:25.588952+0000","last_fullsized":"2024-09-14T12:07:25.588952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:41.973457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.719671+0000","last_change":"2024-09-14T11:11:06.652421+0000","last_active":"2024-09-14T12:07:29.719671+0000","last_peered":"2024-09-14T12:07:29.719671+0000","last_clean":"2024-09-14T12:07:29.719671+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:07:29.719671+0000","last_undegraded":"2024-09-14T12:07:29.719671+0000","last_fullsized":"2024-09-14T12:07:29.719671+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:13.461185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:49.658858+0000","last_change":"2024-09-14T11:11:32.676598+0000","last_active":"2024-09-14T12:07:49.658858+0000","last_peered":"2024-09-14T12:07:49.658858+0000","last_clean":"2024-09-14T12:07:49.658858+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:07:49.658858+0000","last_undegraded":"2024-09-14T12:07:49.658858+0000","last_fullsized":"2024-09-14T12:07:49.658858+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:34.343713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.650599+0000","last_change":"2024-09-14T11:10:56.607551+0000","last_active":"2024-09-14T12:09:54.650599+0000","last_peered":"2024-09-14T12:09:54.650599+0000","last_clean":"2024-09-14T12:09:54.650599+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:09:54.650599+0000","last_undegraded":"2024-09-14T12:09:54.650599+0000","last_fullsized":"2024-09-14T12:09:54.650599+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:34.558354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.670214+0000","last_change":"2024-09-14T11:10:49.565862+0000","last_active":"2024-09-14T12:07:05.670214+0000","last_peered":"2024-09-14T12:07:05.670214+0000","last_clean":"2024-09-14T12:07:05.670214+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:07:05.670214+0000","last_undegraded":"2024-09-14T12:07:05.670214+0000","last_fullsized":"2024-09-14T12:07:05.670214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:23.143257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569681+0000","last_change":"2024-09-14T11:11:00.604266+0000","last_active":"2024-09-14T12:07:15.569681+0000","last_peered":"2024-09-14T12:07:15.569681+0000","last_clean":"2024-09-14T12:07:15.569681+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:07:15.569681+0000","last_undegraded":"2024-09-14T12:07:15.569681+0000","last_fullsized":"2024-09-14T12:07:15.569681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:23.466098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'581","reported_seq":1244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.865130+0000","last_change":"2024-09-14T11:11:02.621799+0000","last_active":"2024-09-14T12:09:14.865130+0000","last_peered":"2024-09-14T12:09:14.865130+0000","last_clean":"2024-09-14T12:09:14.865130+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:09:14.865130+0000","last_undegraded":"2024-09-14T12:09:14.865130+0000","last_fullsized":"2024-09-14T12:09:14.865130+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:35.213739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1643,"num_read_kb":2634,"num_write":2206,"num_write_kb":2061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581595+0000","last_change":"2024-09-14T11:11:04.637891+0000","last_active":"2024-09-14T12:07:19.581595+0000","last_peered":"2024-09-14T12:07:19.581595+0000","last_clean":"2024-09-14T12:07:19.581595+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:07:19.581595+0000","last_undegraded":"2024-09-14T12:07:19.581595+0000","last_fullsized":"2024-09-14T12:07:19.581595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.595704+0000","last_change":"2024-09-14T11:11:06.644529+0000","last_active":"2024-09-14T12:07:54.595704+0000","last_peered":"2024-09-14T12:07:54.595704+0000","last_clean":"2024-09-14T12:07:54.595704+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:07:54.595704+0000","last_undegraded":"2024-09-14T12:07:54.595704+0000","last_fullsized":"2024-09-14T12:07:54.595704+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:27.041637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569674+0000","last_change":"2024-09-14T11:10:58.610011+0000","last_active":"2024-09-14T12:07:15.569674+0000","last_peered":"2024-09-14T12:07:15.569674+0000","last_clean":"2024-09-14T12:07:15.569674+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:07:15.569674+0000","last_undegraded":"2024-09-14T12:07:15.569674+0000","last_fullsized":"2024-09-14T12:07:15.569674+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:35.811227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'311","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.055366+0000","last_change":"2024-09-14T11:10:56.602134+0000","last_active":"2024-09-14T12:09:13.055366+0000","last_peered":"2024-09-14T12:09:13.055366+0000","last_clean":"2024-09-14T12:09:13.055366+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:09:13.055366+0000","last_undegraded":"2024-09-14T12:09:13.055366+0000","last_fullsized":"2024-09-14T12:09:13.055366+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:30.985152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10693503,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":604,"num_read_kb":35559,"num_write":1115,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581198+0000","last_change":"2024-09-14T11:10:49.784939+0000","last_active":"2024-09-14T12:07:14.581198+0000","last_peered":"2024-09-14T12:07:14.581198+0000","last_clean":"2024-09-14T12:07:14.581198+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:07:14.581198+0000","last_undegraded":"2024-09-14T12:07:14.581198+0000","last_fullsized":"2024-09-14T12:07:14.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:20.447651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587487+0000","last_change":"2024-09-14T11:11:00.605387+0000","last_active":"2024-09-14T12:07:15.587487+0000","last_peered":"2024-09-14T12:07:15.587487+0000","last_clean":"2024-09-14T12:07:15.587487+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:07:15.587487+0000","last_undegraded":"2024-09-14T12:07:15.587487+0000","last_fullsized":"2024-09-14T12:07:15.587487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:46.178240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'169","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.885619+0000","last_change":"2024-09-14T11:11:02.887280+0000","last_active":"2024-09-14T12:09:13.885619+0000","last_peered":"2024-09-14T12:09:13.885619+0000","last_clean":"2024-09-14T12:09:13.885619+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:09:13.885619+0000","last_undegraded":"2024-09-14T12:09:13.885619+0000","last_fullsized":"2024-09-14T12:09:13.885619+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.345916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.358863+0000","last_change":"2024-09-14T11:11:04.632716+0000","last_active":"2024-09-14T12:09:53.358863+0000","last_peered":"2024-09-14T12:09:53.358863+0000","last_clean":"2024-09-14T12:09:53.358863+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:09:53.358863+0000","last_undegraded":"2024-09-14T12:09:53.358863+0000","last_fullsized":"2024-09-14T12:09:53.358863+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:21.258508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'121","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.871748+0000","last_change":"2024-09-14T11:11:06.651630+0000","last_active":"2024-09-14T12:09:14.871748+0000","last_peered":"2024-09-14T12:09:14.871748+0000","last_clean":"2024-09-14T12:09:14.871748+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:09:14.871748+0000","last_undegraded":"2024-09-14T12:09:14.871748+0000","last_fullsized":"2024-09-14T12:09:14.871748+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:46.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681248+0000","last_change":"2024-09-14T11:10:58.608290+0000","last_active":"2024-09-14T12:07:09.681248+0000","last_peered":"2024-09-14T12:07:09.681248+0000","last_clean":"2024-09-14T12:07:09.681248+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:07:09.681248+0000","last_undegraded":"2024-09-14T12:07:09.681248+0000","last_fullsized":"2024-09-14T12:07:09.681248+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:31.554400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.635141+0000","last_change":"2024-09-14T11:10:56.620615+0000","last_active":"2024-09-14T12:09:54.635141+0000","last_peered":"2024-09-14T12:09:54.635141+0000","last_clean":"2024-09-14T12:09:54.635141+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:09:54.635141+0000","last_undegraded":"2024-09-14T12:09:54.635141+0000","last_fullsized":"2024-09-14T12:09:54.635141+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:20.532731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670837+0000","last_change":"2024-09-14T11:10:49.565917+0000","last_active":"2024-09-14T12:07:10.670837+0000","last_peered":"2024-09-14T12:07:10.670837+0000","last_clean":"2024-09-14T12:07:10.670837+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:07:10.670837+0000","last_undegraded":"2024-09-14T12:07:10.670837+0000","last_fullsized":"2024-09-14T12:07:10.670837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.682606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581576+0000","last_change":"2024-09-14T11:11:00.610462+0000","last_active":"2024-09-14T12:07:19.581576+0000","last_peered":"2024-09-14T12:07:19.581576+0000","last_clean":"2024-09-14T12:07:19.581576+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:07:19.581576+0000","last_undegraded":"2024-09-14T12:07:19.581576+0000","last_fullsized":"2024-09-14T12:07:19.581576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:57.985170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'120","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581610+0000","last_change":"2024-09-14T11:11:02.618565+0000","last_active":"2024-09-14T12:07:19.581610+0000","last_peered":"2024-09-14T12:07:19.581610+0000","last_clean":"2024-09-14T12:07:19.581610+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:07:19.581610+0000","last_undegraded":"2024-09-14T12:07:19.581610+0000","last_fullsized":"2024-09-14T12:07:19.581610+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:49.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'791","reported_seq":6721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.146146+0000","last_change":"2024-09-14T11:11:04.641546+0000","last_active":"2024-09-14T12:09:54.146146+0000","last_peered":"2024-09-14T12:09:54.146146+0000","last_clean":"2024-09-14T12:09:54.146146+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:09:54.146146+0000","last_undegraded":"2024-09-14T12:09:54.146146+0000","last_fullsized":"2024-09-14T12:09:54.146146+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:25.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'211","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.574448+0000","last_change":"2024-09-14T11:11:06.651293+0000","last_active":"2024-09-14T12:07:56.574448+0000","last_peered":"2024-09-14T12:07:56.574448+0000","last_clean":"2024-09-14T12:07:56.574448+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:07:56.574448+0000","last_undegraded":"2024-09-14T12:07:56.574448+0000","last_fullsized":"2024-09-14T12:07:56.574448+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580636+0000","last_change":"2024-09-14T11:10:58.600988+0000","last_active":"2024-09-14T12:07:14.580636+0000","last_peered":"2024-09-14T12:07:14.580636+0000","last_clean":"2024-09-14T12:07:14.580636+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:07:14.580636+0000","last_undegraded":"2024-09-14T12:07:14.580636+0000","last_fullsized":"2024-09-14T12:07:14.580636+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:34.213245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.631818+0000","last_change":"2024-09-14T11:11:32.791407+0000","last_active":"2024-09-14T12:09:54.631818+0000","last_peered":"2024-09-14T12:09:54.631818+0000","last_clean":"2024-09-14T12:09:54.631818+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:09:54.631818+0000","last_undegraded":"2024-09-14T12:09:54.631818+0000","last_fullsized":"2024-09-14T12:09:54.631818+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:37.633694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324752,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":749,"num_read_kb":5404,"num_write":1186,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586795+0000","last_change":"2024-09-14T11:10:49.566365+0000","last_active":"2024-09-14T12:07:10.586795+0000","last_peered":"2024-09-14T12:07:10.586795+0000","last_clean":"2024-09-14T12:07:10.586795+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:07:10.586795+0000","last_undegraded":"2024-09-14T12:07:10.586795+0000","last_fullsized":"2024-09-14T12:07:10.586795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:17.078627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681822+0000","last_change":"2024-09-14T11:11:00.612749+0000","last_active":"2024-09-14T12:07:14.681822+0000","last_peered":"2024-09-14T12:07:14.681822+0000","last_clean":"2024-09-14T12:07:14.681822+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:07:14.681822+0000","last_undegraded":"2024-09-14T12:07:14.681822+0000","last_fullsized":"2024-09-14T12:07:14.681822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:08.731984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'795","reported_seq":1517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.736663+0000","last_change":"2024-09-14T11:11:02.882288+0000","last_active":"2024-09-14T12:09:53.736663+0000","last_peered":"2024-09-14T12:09:53.736663+0000","last_clean":"2024-09-14T12:09:53.736663+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:09:53.736663+0000","last_undegraded":"2024-09-14T12:09:53.736663+0000","last_fullsized":"2024-09-14T12:09:53.736663+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:52.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682515+0000","last_change":"2024-09-14T11:11:04.636384+0000","last_active":"2024-09-14T12:07:19.682515+0000","last_peered":"2024-09-14T12:07:19.682515+0000","last_clean":"2024-09-14T12:07:19.682515+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:07:19.682515+0000","last_undegraded":"2024-09-14T12:07:19.682515+0000","last_fullsized":"2024-09-14T12:07:19.682515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:19.200941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'147","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.868910+0000","last_change":"2024-09-14T11:11:06.645842+0000","last_active":"2024-09-14T12:09:14.868910+0000","last_peered":"2024-09-14T12:09:14.868910+0000","last_clean":"2024-09-14T12:09:14.868910+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:09:14.868910+0000","last_undegraded":"2024-09-14T12:09:14.868910+0000","last_fullsized":"2024-09-14T12:09:14.868910+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:49.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'133","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.592187+0000","last_change":"2024-09-14T11:11:06.646108+0000","last_active":"2024-09-14T12:07:57.592187+0000","last_peered":"2024-09-14T12:07:57.592187+0000","last_clean":"2024-09-14T12:07:57.592187+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:07:57.592187+0000","last_undegraded":"2024-09-14T12:07:57.592187+0000","last_fullsized":"2024-09-14T12:07:57.592187+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:15.069138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578521+0000","last_change":"2024-09-14T11:10:58.604359+0000","last_active":"2024-09-14T12:06:59.578521+0000","last_peered":"2024-09-14T12:06:59.578521+0000","last_clean":"2024-09-14T12:06:59.578521+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:06:59.578521+0000","last_undegraded":"2024-09-14T12:06:59.578521+0000","last_fullsized":"2024-09-14T12:06:59.578521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:16.978960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'347","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.420886+0000","last_change":"2024-09-14T11:10:56.615808+0000","last_active":"2024-09-14T12:09:54.420886+0000","last_peered":"2024-09-14T12:09:54.420886+0000","last_clean":"2024-09-14T12:09:54.420886+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:09:54.420886+0000","last_undegraded":"2024-09-14T12:09:54.420886+0000","last_fullsized":"2024-09-14T12:09:54.420886+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:43.217150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":636,"num_read_kb":5106,"num_write":1230,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669712+0000","last_change":"2024-09-14T11:11:00.610690+0000","last_active":"2024-09-14T12:07:00.669712+0000","last_peered":"2024-09-14T12:07:00.669712+0000","last_clean":"2024-09-14T12:07:00.669712+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:07:00.669712+0000","last_undegraded":"2024-09-14T12:07:00.669712+0000","last_fullsized":"2024-09-14T12:07:00.669712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:39.467881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'323","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.143808+0000","last_change":"2024-09-14T11:11:02.622367+0000","last_active":"2024-09-14T12:09:54.143808+0000","last_peered":"2024-09-14T12:09:54.143808+0000","last_clean":"2024-09-14T12:09:54.143808+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:09:54.143808+0000","last_undegraded":"2024-09-14T12:09:54.143808+0000","last_fullsized":"2024-09-14T12:09:54.143808+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:39.564835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680693+0000","last_change":"2024-09-14T11:11:04.639827+0000","last_active":"2024-09-14T12:07:04.680693+0000","last_peered":"2024-09-14T12:07:04.680693+0000","last_clean":"2024-09-14T12:07:04.680693+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:07:04.680693+0000","last_undegraded":"2024-09-14T12:07:04.680693+0000","last_fullsized":"2024-09-14T12:07:04.680693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:10.987465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'132","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682683+0000","last_change":"2024-09-14T11:11:06.649975+0000","last_active":"2024-09-14T12:07:19.682683+0000","last_peered":"2024-09-14T12:07:19.682683+0000","last_clean":"2024-09-14T12:07:19.682683+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:07:19.682683+0000","last_undegraded":"2024-09-14T12:07:19.682683+0000","last_fullsized":"2024-09-14T12:07:19.682683+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:50.322032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669720+0000","last_change":"2024-09-14T11:10:58.609253+0000","last_active":"2024-09-14T12:07:00.669720+0000","last_peered":"2024-09-14T12:07:00.669720+0000","last_clean":"2024-09-14T12:07:00.669720+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:07:00.669720+0000","last_undegraded":"2024-09-14T12:07:00.669720+0000","last_fullsized":"2024-09-14T12:07:00.669720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.292062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'340","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.577295+0000","last_change":"2024-09-14T11:10:56.618778+0000","last_active":"2024-09-14T12:09:54.577295+0000","last_peered":"2024-09-14T12:09:54.577295+0000","last_clean":"2024-09-14T12:09:54.577295+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:09:54.577295+0000","last_undegraded":"2024-09-14T12:09:54.577295+0000","last_fullsized":"2024-09-14T12:09:54.577295+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:10.981915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324726,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":667,"num_read_kb":33434,"num_write":1022,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680772+0000","last_change":"2024-09-14T11:11:00.611300+0000","last_active":"2024-09-14T12:07:04.680772+0000","last_peered":"2024-09-14T12:07:04.680772+0000","last_clean":"2024-09-14T12:07:04.680772+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:07:04.680772+0000","last_undegraded":"2024-09-14T12:07:04.680772+0000","last_fullsized":"2024-09-14T12:07:04.680772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:08.169880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568300+0000","last_change":"2024-09-14T11:11:02.616318+0000","last_active":"2024-09-14T12:07:05.568300+0000","last_peered":"2024-09-14T12:07:05.568300+0000","last_clean":"2024-09-14T12:07:05.568300+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:07:05.568300+0000","last_undegraded":"2024-09-14T12:07:05.568300+0000","last_fullsized":"2024-09-14T12:07:05.568300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:14.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579853+0000","last_change":"2024-09-14T11:11:04.630959+0000","last_active":"2024-09-14T12:07:04.579853+0000","last_peered":"2024-09-14T12:07:04.579853+0000","last_clean":"2024-09-14T12:07:04.579853+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:07:04.579853+0000","last_undegraded":"2024-09-14T12:07:04.579853+0000","last_fullsized":"2024-09-14T12:07:04.579853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:47.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'253","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.593628+0000","last_change":"2024-09-14T11:11:06.642887+0000","last_active":"2024-09-14T12:07:56.593628+0000","last_peered":"2024-09-14T12:07:56.593628+0000","last_clean":"2024-09-14T12:07:56.593628+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:07:56.593628+0000","last_undegraded":"2024-09-14T12:07:56.593628+0000","last_fullsized":"2024-09-14T12:07:56.593628+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:46.857547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680183+0000","last_change":"2024-09-14T11:10:58.605181+0000","last_active":"2024-09-14T12:06:59.680183+0000","last_peered":"2024-09-14T12:06:59.680183+0000","last_clean":"2024-09-14T12:06:59.680183+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:06:59.680183+0000","last_undegraded":"2024-09-14T12:06:59.680183+0000","last_fullsized":"2024-09-14T12:06:59.680183+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:43.046442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1250,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.611356+0000","last_change":"2024-09-14T11:10:56.600738+0000","last_active":"2024-09-14T12:09:54.611356+0000","last_peered":"2024-09-14T12:09:54.611356+0000","last_clean":"2024-09-14T12:09:54.611356+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:09:54.611356+0000","last_undegraded":"2024-09-14T12:09:54.611356+0000","last_fullsized":"2024-09-14T12:09:54.611356+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:28.803066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579817+0000","last_change":"2024-09-14T11:11:00.608611+0000","last_active":"2024-09-14T12:07:04.579817+0000","last_peered":"2024-09-14T12:07:04.579817+0000","last_clean":"2024-09-14T12:07:04.579817+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:04.579817+0000","last_undegraded":"2024-09-14T12:07:04.579817+0000","last_fullsized":"2024-09-14T12:07:04.579817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:32.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'307","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.395477+0000","last_change":"2024-09-14T11:11:02.621487+0000","last_active":"2024-09-14T12:09:53.395477+0000","last_peered":"2024-09-14T12:09:53.395477+0000","last_clean":"2024-09-14T12:09:53.395477+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:09:53.395477+0000","last_undegraded":"2024-09-14T12:09:53.395477+0000","last_fullsized":"2024-09-14T12:09:53.395477+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:57.571157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.585970+0000","last_change":"2024-09-14T11:11:04.632741+0000","last_active":"2024-09-14T12:07:05.585970+0000","last_peered":"2024-09-14T12:07:05.585970+0000","last_clean":"2024-09-14T12:07:05.585970+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:07:05.585970+0000","last_undegraded":"2024-09-14T12:07:05.585970+0000","last_fullsized":"2024-09-14T12:07:05.585970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:33.615718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'110","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.940177+0000","last_change":"2024-09-14T11:11:06.646134+0000","last_active":"2024-09-14T12:07:55.940177+0000","last_peered":"2024-09-14T12:07:55.940177+0000","last_clean":"2024-09-14T12:07:55.940177+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:07:55.940177+0000","last_undegraded":"2024-09-14T12:07:55.940177+0000","last_fullsized":"2024-09-14T12:07:55.940177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:44.141877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'143","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680151+0000","last_change":"2024-09-14T11:10:58.610261+0000","last_active":"2024-09-14T12:06:59.680151+0000","last_peered":"2024-09-14T12:06:59.680151+0000","last_clean":"2024-09-14T12:06:59.680151+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:06:59.680151+0000","last_undegraded":"2024-09-14T12:06:59.680151+0000","last_fullsized":"2024-09-14T12:06:59.680151+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:38.951705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'302","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564862+0000","last_change":"2024-09-14T11:10:56.623865+0000","last_active":"2024-09-14T12:06:35.564862+0000","last_peered":"2024-09-14T12:06:35.564862+0000","last_clean":"2024-09-14T12:06:35.564862+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:06:35.564862+0000","last_undegraded":"2024-09-14T12:06:35.564862+0000","last_fullsized":"2024-09-14T12:06:35.564862+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:27.676587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16810913,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":646,"num_read_kb":71289,"num_write":1117,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.585298+0000","last_change":"2024-09-14T11:11:00.608657+0000","last_active":"2024-09-14T12:07:00.585298+0000","last_peered":"2024-09-14T12:07:00.585298+0000","last_clean":"2024-09-14T12:07:00.585298+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:07:00.585298+0000","last_undegraded":"2024-09-14T12:07:00.585298+0000","last_fullsized":"2024-09-14T12:07:00.585298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:34.927234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'265","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.192042+0000","last_change":"2024-09-14T11:11:02.615297+0000","last_active":"2024-09-14T12:09:53.192042+0000","last_peered":"2024-09-14T12:09:53.192042+0000","last_clean":"2024-09-14T12:09:53.192042+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:09:53.192042+0000","last_undegraded":"2024-09-14T12:09:53.192042+0000","last_fullsized":"2024-09-14T12:09:53.192042+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:52.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568346+0000","last_change":"2024-09-14T11:11:04.634007+0000","last_active":"2024-09-14T12:07:05.568346+0000","last_peered":"2024-09-14T12:07:05.568346+0000","last_clean":"2024-09-14T12:07:05.568346+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:07:05.568346+0000","last_undegraded":"2024-09-14T12:07:05.568346+0000","last_fullsized":"2024-09-14T12:07:05.568346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.560589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587539+0000","last_change":"2024-09-14T11:10:58.606214+0000","last_active":"2024-09-14T12:07:15.587539+0000","last_peered":"2024-09-14T12:07:15.587539+0000","last_clean":"2024-09-14T12:07:15.587539+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:07:15.587539+0000","last_undegraded":"2024-09-14T12:07:15.587539+0000","last_fullsized":"2024-09-14T12:07:15.587539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.749986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'372","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.502822+0000","last_change":"2024-09-14T11:10:56.622004+0000","last_active":"2024-09-14T12:09:54.502822+0000","last_peered":"2024-09-14T12:09:54.502822+0000","last_clean":"2024-09-14T12:09:54.502822+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:09:54.502822+0000","last_undegraded":"2024-09-14T12:09:54.502822+0000","last_fullsized":"2024-09-14T12:09:54.502822+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:22.080952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":694,"num_read_kb":6455,"num_write":1237,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569728+0000","last_change":"2024-09-14T11:11:00.603297+0000","last_active":"2024-09-14T12:07:15.569728+0000","last_peered":"2024-09-14T12:07:15.569728+0000","last_clean":"2024-09-14T12:07:15.569728+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:07:15.569728+0000","last_undegraded":"2024-09-14T12:07:15.569728+0000","last_fullsized":"2024-09-14T12:07:15.569728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:28.255243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'491","reported_seq":1114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.837882+0000","last_change":"2024-09-14T11:11:02.615607+0000","last_active":"2024-09-14T12:09:14.837882+0000","last_peered":"2024-09-14T12:09:14.837882+0000","last_clean":"2024-09-14T12:09:14.837882+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:09:14.837882+0000","last_undegraded":"2024-09-14T12:09:14.837882+0000","last_fullsized":"2024-09-14T12:09:14.837882+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:23.294326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117410,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":1917,"num_write":776,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706944+0000","last_change":"2024-09-14T11:11:04.636718+0000","last_active":"2024-09-14T12:06:04.706944+0000","last_peered":"2024-09-14T12:06:04.706944+0000","last_clean":"2024-09-14T12:06:04.706944+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:06:04.706944+0000","last_undegraded":"2024-09-14T12:06:04.706944+0000","last_fullsized":"2024-09-14T12:06:04.706944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.511083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'174","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681293+0000","last_change":"2024-09-14T11:11:06.650082+0000","last_active":"2024-09-14T12:07:09.681293+0000","last_peered":"2024-09-14T12:07:09.681293+0000","last_clean":"2024-09-14T12:07:09.681293+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:07:09.681293+0000","last_undegraded":"2024-09-14T12:07:09.681293+0000","last_fullsized":"2024-09-14T12:07:09.681293+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:16.276250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569715+0000","last_change":"2024-09-14T11:10:58.606571+0000","last_active":"2024-09-14T12:07:15.569715+0000","last_peered":"2024-09-14T12:07:15.569715+0000","last_clean":"2024-09-14T12:07:15.569715+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:07:15.569715+0000","last_undegraded":"2024-09-14T12:07:15.569715+0000","last_fullsized":"2024-09-14T12:07:15.569715+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:01.887992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'267","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.186938+0000","last_change":"2024-09-14T11:10:56.607042+0000","last_active":"2024-09-14T12:07:13.186938+0000","last_peered":"2024-09-14T12:07:13.186938+0000","last_clean":"2024-09-14T12:07:13.186938+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:07:13.186938+0000","last_undegraded":"2024-09-14T12:07:13.186938+0000","last_fullsized":"2024-09-14T12:07:13.186938+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:10.108123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6642266,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":406,"num_read_kb":4513,"num_write":918,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587550+0000","last_change":"2024-09-14T11:11:00.608589+0000","last_active":"2024-09-14T12:07:15.587550+0000","last_peered":"2024-09-14T12:07:15.587550+0000","last_clean":"2024-09-14T12:07:15.587550+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:15.587550+0000","last_undegraded":"2024-09-14T12:07:15.587550+0000","last_fullsized":"2024-09-14T12:07:15.587550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:24.982876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'312","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.256716+0000","last_change":"2024-09-14T11:11:02.611238+0000","last_active":"2024-09-14T12:09:53.256716+0000","last_peered":"2024-09-14T12:09:53.256716+0000","last_clean":"2024-09-14T12:09:53.256716+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:09:53.256716+0000","last_undegraded":"2024-09-14T12:09:53.256716+0000","last_fullsized":"2024-09-14T12:09:53.256716+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.446639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663956+0000","last_change":"2024-09-14T11:11:04.630801+0000","last_active":"2024-09-14T12:06:05.663956+0000","last_peered":"2024-09-14T12:06:05.663956+0000","last_clean":"2024-09-14T12:06:05.663956+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:06:05.663956+0000","last_undegraded":"2024-09-14T12:06:05.663956+0000","last_fullsized":"2024-09-14T12:06:05.663956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:37.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'187","reported_seq":714,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586739+0000","last_change":"2024-09-14T11:11:06.647146+0000","last_active":"2024-09-14T12:07:10.586739+0000","last_peered":"2024-09-14T12:07:10.586739+0000","last_clean":"2024-09-14T12:07:10.586739+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:07:10.586739+0000","last_undegraded":"2024-09-14T12:07:10.586739+0000","last_fullsized":"2024-09-14T12:07:10.586739+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.672972+0000","last_change":"2024-09-14T11:10:58.603000+0000","last_active":"2024-09-14T12:05:59.672972+0000","last_peered":"2024-09-14T12:05:59.672972+0000","last_clean":"2024-09-14T12:05:59.672972+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:05:59.672972+0000","last_undegraded":"2024-09-14T12:05:59.672972+0000","last_fullsized":"2024-09-14T12:05:59.672972+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:38.408009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'342","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.645387+0000","last_change":"2024-09-14T11:11:32.679317+0000","last_active":"2024-09-14T12:09:54.645387+0000","last_peered":"2024-09-14T12:09:54.645387+0000","last_clean":"2024-09-14T12:09:54.645387+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:09:54.645387+0000","last_undegraded":"2024-09-14T12:09:54.645387+0000","last_fullsized":"2024-09-14T12:09:54.645387+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:20.868051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1710980,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":125002,"num_write":1055,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570899+0000","last_change":"2024-09-14T11:11:00.610641+0000","last_active":"2024-09-14T12:06:04.570899+0000","last_peered":"2024-09-14T12:06:04.570899+0000","last_clean":"2024-09-14T12:06:04.570899+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:06:04.570899+0000","last_undegraded":"2024-09-14T12:06:04.570899+0000","last_fullsized":"2024-09-14T12:06:04.570899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:34.052721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'303","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.373148+0000","last_change":"2024-09-14T11:11:02.882152+0000","last_active":"2024-09-14T12:09:54.373148+0000","last_peered":"2024-09-14T12:09:54.373148+0000","last_clean":"2024-09-14T12:09:54.373148+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:09:54.373148+0000","last_undegraded":"2024-09-14T12:09:54.373148+0000","last_fullsized":"2024-09-14T12:09:54.373148+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:00.329236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671401+0000","last_change":"2024-09-14T11:11:04.637717+0000","last_active":"2024-09-14T12:07:15.671401+0000","last_peered":"2024-09-14T12:07:15.671401+0000","last_clean":"2024-09-14T12:07:15.671401+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:07:15.671401+0000","last_undegraded":"2024-09-14T12:07:15.671401+0000","last_fullsized":"2024-09-14T12:07:15.671401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:00.714105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'131","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.877188+0000","last_change":"2024-09-14T11:11:06.644460+0000","last_active":"2024-09-14T12:09:14.877188+0000","last_peered":"2024-09-14T12:09:14.877188+0000","last_clean":"2024-09-14T12:09:14.877188+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:09:14.877188+0000","last_undegraded":"2024-09-14T12:09:14.877188+0000","last_fullsized":"2024-09-14T12:09:14.877188+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:22.358502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.587198+0000","last_change":"2024-09-14T11:10:58.609393+0000","last_active":"2024-09-14T12:07:56.587198+0000","last_peered":"2024-09-14T12:07:56.587198+0000","last_clean":"2024-09-14T12:07:56.587198+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:07:56.587198+0000","last_undegraded":"2024-09-14T12:07:56.587198+0000","last_fullsized":"2024-09-14T12:07:56.587198+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:50.454872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'358","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:38.705575+0000","last_change":"2024-09-14T11:10:56.610767+0000","last_active":"2024-09-14T12:07:38.705575+0000","last_peered":"2024-09-14T12:07:38.705575+0000","last_clean":"2024-09-14T12:07:38.705575+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:07:38.705575+0000","last_undegraded":"2024-09-14T12:07:38.705575+0000","last_fullsized":"2024-09-14T12:07:38.705575+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:42.529391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17393926,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":854,"num_read_kb":75270,"num_write":1229,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.663411+0000","last_change":"2024-09-14T11:11:00.608561+0000","last_active":"2024-09-14T12:06:00.663411+0000","last_peered":"2024-09-14T12:06:00.663411+0000","last_clean":"2024-09-14T12:06:00.663411+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:06:00.663411+0000","last_undegraded":"2024-09-14T12:06:00.663411+0000","last_fullsized":"2024-09-14T12:06:00.663411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:50.035124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'107","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580809+0000","last_change":"2024-09-14T11:11:02.882216+0000","last_active":"2024-09-14T12:07:14.580809+0000","last_peered":"2024-09-14T12:07:14.580809+0000","last_clean":"2024-09-14T12:07:14.580809+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:07:14.580809+0000","last_undegraded":"2024-09-14T12:07:14.580809+0000","last_fullsized":"2024-09-14T12:07:14.580809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.190894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.396781+0000","last_change":"2024-09-14T11:11:04.634837+0000","last_active":"2024-09-14T12:09:18.396781+0000","last_peered":"2024-09-14T12:09:18.396781+0000","last_clean":"2024-09-14T12:09:18.396781+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:09:18.396781+0000","last_undegraded":"2024-09-14T12:09:18.396781+0000","last_fullsized":"2024-09-14T12:09:18.396781+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:02.919719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.505956+0000","last_change":"2024-09-14T11:11:06.646662+0000","last_active":"2024-09-14T12:07:57.505956+0000","last_peered":"2024-09-14T12:07:57.505956+0000","last_clean":"2024-09-14T12:07:57.505956+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:07:57.505956+0000","last_undegraded":"2024-09-14T12:07:57.505956+0000","last_fullsized":"2024-09-14T12:07:57.505956+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:39.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570113+0000","last_change":"2024-09-14T11:10:58.612211+0000","last_active":"2024-09-14T12:05:59.570113+0000","last_peered":"2024-09-14T12:05:59.570113+0000","last_clean":"2024-09-14T12:05:59.570113+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:05:59.570113+0000","last_undegraded":"2024-09-14T12:05:59.570113+0000","last_fullsized":"2024-09-14T12:05:59.570113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.689101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'294","reported_seq":952,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.565631+0000","last_change":"2024-09-14T11:10:56.602145+0000","last_active":"2024-09-14T12:09:54.565631+0000","last_peered":"2024-09-14T12:09:54.565631+0000","last_clean":"2024-09-14T12:09:54.565631+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:09:54.565631+0000","last_undegraded":"2024-09-14T12:09:54.565631+0000","last_fullsized":"2024-09-14T12:09:54.565631+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:25.629525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":114075,"num_write":993,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570893+0000","last_change":"2024-09-14T11:11:00.608599+0000","last_active":"2024-09-14T12:06:04.570893+0000","last_peered":"2024-09-14T12:06:04.570893+0000","last_clean":"2024-09-14T12:06:04.570893+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:06:04.570893+0000","last_undegraded":"2024-09-14T12:06:04.570893+0000","last_fullsized":"2024-09-14T12:06:04.570893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:59.368073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'298","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.668526+0000","last_change":"2024-09-14T11:11:02.616575+0000","last_active":"2024-09-14T12:09:54.668526+0000","last_peered":"2024-09-14T12:09:54.668526+0000","last_clean":"2024-09-14T12:09:54.668526+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:09:54.668526+0000","last_undegraded":"2024-09-14T12:09:54.668526+0000","last_fullsized":"2024-09-14T12:09:54.668526+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:12.984482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49540,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":948,"num_write":377,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565340+0000","last_change":"2024-09-14T11:11:04.635106+0000","last_active":"2024-09-14T12:06:40.565340+0000","last_peered":"2024-09-14T12:06:40.565340+0000","last_clean":"2024-09-14T12:06:40.565340+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:06:40.565340+0000","last_undegraded":"2024-09-14T12:06:40.565340+0000","last_fullsized":"2024-09-14T12:06:40.565340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:25.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'100","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.598806+0000","last_change":"2024-09-14T11:11:06.649099+0000","last_active":"2024-09-14T12:07:54.598806+0000","last_peered":"2024-09-14T12:07:54.598806+0000","last_clean":"2024-09-14T12:07:54.598806+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:07:54.598806+0000","last_undegraded":"2024-09-14T12:07:54.598806+0000","last_fullsized":"2024-09-14T12:07:54.598806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:17.632657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.837677+0000","last_change":"2024-09-14T11:10:58.612093+0000","last_active":"2024-09-14T12:07:18.837677+0000","last_peered":"2024-09-14T12:07:18.837677+0000","last_clean":"2024-09-14T12:07:18.837677+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:07:18.837677+0000","last_undegraded":"2024-09-14T12:07:18.837677+0000","last_fullsized":"2024-09-14T12:07:18.837677+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:49.500728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'360","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.577389+0000","last_change":"2024-09-14T11:12:32.771972+0000","last_active":"2024-09-14T12:09:54.577389+0000","last_peered":"2024-09-14T12:09:54.577389+0000","last_clean":"2024-09-14T12:09:54.577389+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:09:54.577389+0000","last_undegraded":"2024-09-14T12:09:54.577389+0000","last_fullsized":"2024-09-14T12:09:54.577389+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:36.488962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":11549,"num_write":1064,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706910+0000","last_change":"2024-09-14T11:11:00.610742+0000","last_active":"2024-09-14T12:06:04.706910+0000","last_peered":"2024-09-14T12:06:04.706910+0000","last_clean":"2024-09-14T12:06:04.706910+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:06:04.706910+0000","last_undegraded":"2024-09-14T12:06:04.706910+0000","last_fullsized":"2024-09-14T12:06:04.706910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:51.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'271","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.583233+0000","last_change":"2024-09-14T11:11:02.617754+0000","last_active":"2024-09-14T12:09:05.583233+0000","last_peered":"2024-09-14T12:09:05.583233+0000","last_clean":"2024-09-14T12:09:05.583233+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:09:05.583233+0000","last_undegraded":"2024-09-14T12:09:05.583233+0000","last_fullsized":"2024-09-14T12:09:05.583233+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:03.531301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51932,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":881,"num_write":358,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.583943+0000","last_change":"2024-09-14T11:11:04.629288+0000","last_active":"2024-09-14T12:06:50.583943+0000","last_peered":"2024-09-14T12:06:50.583943+0000","last_clean":"2024-09-14T12:06:50.583943+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:06:50.583943+0000","last_undegraded":"2024-09-14T12:06:50.583943+0000","last_fullsized":"2024-09-14T12:06:50.583943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:29.995583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'105","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.593163+0000","last_change":"2024-09-14T11:11:06.648742+0000","last_active":"2024-09-14T12:07:54.593163+0000","last_peered":"2024-09-14T12:07:54.593163+0000","last_clean":"2024-09-14T12:07:54.593163+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:07:54.593163+0000","last_undegraded":"2024-09-14T12:07:54.593163+0000","last_fullsized":"2024-09-14T12:07:54.593163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:19.341185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'440","reported_seq":1196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.845766+0000","last_change":"2024-09-14T11:10:58.608774+0000","last_active":"2024-09-14T12:07:13.845766+0000","last_peered":"2024-09-14T12:07:13.845766+0000","last_clean":"2024-09-14T12:07:13.845766+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:07:13.845766+0000","last_undegraded":"2024-09-14T12:07:13.845766+0000","last_fullsized":"2024-09-14T12:07:13.845766+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.214663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'349","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.623791+0000","last_change":"2024-09-14T11:10:56.619597+0000","last_active":"2024-09-14T12:09:54.623791+0000","last_peered":"2024-09-14T12:09:54.623791+0000","last_clean":"2024-09-14T12:09:54.623791+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:09:54.623791+0000","last_undegraded":"2024-09-14T12:09:54.623791+0000","last_fullsized":"2024-09-14T12:09:54.623791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:58.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1479,"num_write":1089,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575841+0000","last_change":"2024-09-14T11:11:00.613471+0000","last_active":"2024-09-14T12:06:39.575841+0000","last_peered":"2024-09-14T12:06:39.575841+0000","last_clean":"2024-09-14T12:06:39.575841+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:06:39.575841+0000","last_undegraded":"2024-09-14T12:06:39.575841+0000","last_fullsized":"2024-09-14T12:06:39.575841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:51.522567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'237","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.260926+0000","last_change":"2024-09-14T11:11:02.620023+0000","last_active":"2024-09-14T12:09:54.260926+0000","last_peered":"2024-09-14T12:09:54.260926+0000","last_clean":"2024-09-14T12:09:54.260926+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:09:54.260926+0000","last_undegraded":"2024-09-14T12:09:54.260926+0000","last_fullsized":"2024-09-14T12:09:54.260926+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.942166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570865+0000","last_change":"2024-09-14T11:11:04.636920+0000","last_active":"2024-09-14T12:06:04.570865+0000","last_peered":"2024-09-14T12:06:04.570865+0000","last_clean":"2024-09-14T12:06:04.570865+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:06:04.570865+0000","last_undegraded":"2024-09-14T12:06:04.570865+0000","last_fullsized":"2024-09-14T12:06:04.570865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:04.328783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'210","reported_seq":1682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.573850+0000","last_change":"2024-09-14T11:11:06.646323+0000","last_active":"2024-09-14T12:07:54.573850+0000","last_peered":"2024-09-14T12:07:54.573850+0000","last_clean":"2024-09-14T12:07:54.573850+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:07:54.573850+0000","last_undegraded":"2024-09-14T12:07:54.573850+0000","last_fullsized":"2024-09-14T12:07:54.573850+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:54.472116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.626310+0000","last_change":"2024-09-14T11:10:58.603025+0000","last_active":"2024-09-14T12:06:35.626310+0000","last_peered":"2024-09-14T12:06:35.626310+0000","last_clean":"2024-09-14T12:06:35.626310+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:06:35.626310+0000","last_undegraded":"2024-09-14T12:06:35.626310+0000","last_fullsized":"2024-09-14T12:06:35.626310+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:50.041412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'278","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:08.840725+0000","last_change":"2024-09-14T11:10:56.609202+0000","last_active":"2024-09-14T12:09:08.840725+0000","last_peered":"2024-09-14T12:09:08.840725+0000","last_clean":"2024-09-14T12:09:08.840725+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:09:08.840725+0000","last_undegraded":"2024-09-14T12:09:08.840725+0000","last_fullsized":"2024-09-14T12:09:08.840725+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:20.975464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1756754,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":539,"num_read_kb":4572,"num_write":1015,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:45.668134+0000","last_change":"2024-09-14T11:11:00.612948+0000","last_active":"2024-09-14T12:06:45.668134+0000","last_peered":"2024-09-14T12:06:45.668134+0000","last_clean":"2024-09-14T12:06:45.668134+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:06:45.668134+0000","last_undegraded":"2024-09-14T12:06:45.668134+0000","last_fullsized":"2024-09-14T12:06:45.668134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:59.559655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.427158+0000","last_change":"2024-09-14T11:11:02.615915+0000","last_active":"2024-09-14T12:09:54.427158+0000","last_peered":"2024-09-14T12:09:54.427158+0000","last_clean":"2024-09-14T12:09:54.427158+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:09:54.427158+0000","last_undegraded":"2024-09-14T12:09:54.427158+0000","last_fullsized":"2024-09-14T12:09:54.427158+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:13.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561147+0000","last_change":"2024-09-14T11:11:04.638367+0000","last_active":"2024-09-14T12:06:05.561147+0000","last_peered":"2024-09-14T12:06:05.561147+0000","last_clean":"2024-09-14T12:06:05.561147+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:06:05.561147+0000","last_undegraded":"2024-09-14T12:06:05.561147+0000","last_fullsized":"2024-09-14T12:06:05.561147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:16.944434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.887875+0000","last_change":"2024-09-14T11:11:06.650184+0000","last_active":"2024-09-14T12:09:13.887875+0000","last_peered":"2024-09-14T12:09:13.887875+0000","last_clean":"2024-09-14T12:09:13.887875+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:09:13.887875+0000","last_undegraded":"2024-09-14T12:09:13.887875+0000","last_fullsized":"2024-09-14T12:09:13.887875+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:56.510761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671963+0000","last_change":"2024-09-14T11:10:58.608289+0000","last_active":"2024-09-14T12:07:20.671963+0000","last_peered":"2024-09-14T12:07:20.671963+0000","last_clean":"2024-09-14T12:07:20.671963+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:07:20.671963+0000","last_undegraded":"2024-09-14T12:07:20.671963+0000","last_fullsized":"2024-09-14T12:07:20.671963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:55.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'252","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587445+0000","last_change":"2024-09-14T11:10:56.618556+0000","last_active":"2024-09-14T12:07:15.587445+0000","last_peered":"2024-09-14T12:07:15.587445+0000","last_clean":"2024-09-14T12:07:15.587445+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:07:15.587445+0000","last_undegraded":"2024-09-14T12:07:15.587445+0000","last_fullsized":"2024-09-14T12:07:15.587445+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:36.853534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10686081,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":476,"num_read_kb":25535,"num_write":953,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'180","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671944+0000","last_change":"2024-09-14T11:10:58.609726+0000","last_active":"2024-09-14T12:07:20.671944+0000","last_peered":"2024-09-14T12:07:20.671944+0000","last_clean":"2024-09-14T12:07:20.671944+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:07:20.671944+0000","last_undegraded":"2024-09-14T12:07:20.671944+0000","last_fullsized":"2024-09-14T12:07:20.671944+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:49.028498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'352","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.672330+0000","last_change":"2024-09-14T11:10:56.612746+0000","last_active":"2024-09-14T12:09:54.672330+0000","last_peered":"2024-09-14T12:09:54.672330+0000","last_clean":"2024-09-14T12:09:54.672330+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:09:54.672330+0000","last_undegraded":"2024-09-14T12:09:54.672330+0000","last_fullsized":"2024-09-14T12:09:54.672330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:46.452349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":941,"num_read_kb":26386,"num_write":1245,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.718057+0000","last_change":"2024-09-14T11:10:58.599992+0000","last_active":"2024-09-14T12:07:19.718057+0000","last_peered":"2024-09-14T12:07:19.718057+0000","last_clean":"2024-09-14T12:07:19.718057+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:07:19.718057+0000","last_undegraded":"2024-09-14T12:07:19.718057+0000","last_fullsized":"2024-09-14T12:07:19.718057+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:35.235270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.642419+0000","last_change":"2024-09-14T11:10:56.622668+0000","last_active":"2024-09-14T12:09:54.642419+0000","last_peered":"2024-09-14T12:09:54.642419+0000","last_clean":"2024-09-14T12:09:54.642419+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:09:54.642419+0000","last_undegraded":"2024-09-14T12:09:54.642419+0000","last_fullsized":"2024-09-14T12:09:54.642419+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.252105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":18057,"num_write":1028,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671901+0000","last_change":"2024-09-14T11:10:58.599162+0000","last_active":"2024-09-14T12:07:20.671901+0000","last_peered":"2024-09-14T12:07:20.671901+0000","last_clean":"2024-09-14T12:07:20.671901+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:07:20.671901+0000","last_undegraded":"2024-09-14T12:07:20.671901+0000","last_fullsized":"2024-09-14T12:07:20.671901+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'287","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571357+0000","last_change":"2024-09-14T11:11:32.790442+0000","last_active":"2024-09-14T12:07:30.571357+0000","last_peered":"2024-09-14T12:07:30.571357+0000","last_clean":"2024-09-14T12:07:30.571357+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:07:30.571357+0000","last_undegraded":"2024-09-14T12:07:30.571357+0000","last_fullsized":"2024-09-14T12:07:30.571357+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:26.523306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293379,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":553,"num_read_kb":9884,"num_write":1118,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.683406+0000","last_change":"2024-09-14T11:10:58.603379+0000","last_active":"2024-09-14T12:07:24.683406+0000","last_peered":"2024-09-14T12:07:24.683406+0000","last_clean":"2024-09-14T12:07:24.683406+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:07:24.683406+0000","last_undegraded":"2024-09-14T12:07:24.683406+0000","last_fullsized":"2024-09-14T12:07:24.683406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:08.757768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'372","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615634+0000","last_change":"2024-09-14T11:10:56.619064+0000","last_active":"2024-09-14T12:09:54.615634+0000","last_peered":"2024-09-14T12:09:54.615634+0000","last_clean":"2024-09-14T12:09:54.615634+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:09:54.615634+0000","last_undegraded":"2024-09-14T12:09:54.615634+0000","last_fullsized":"2024-09-14T12:09:54.615634+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:51.621055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":11859,"num_write":1345,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'247","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580693+0000","last_change":"2024-09-14T11:10:58.604356+0000","last_active":"2024-09-14T12:07:14.580693+0000","last_peered":"2024-09-14T12:07:14.580693+0000","last_clean":"2024-09-14T12:07:14.580693+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:07:14.580693+0000","last_undegraded":"2024-09-14T12:07:14.580693+0000","last_fullsized":"2024-09-14T12:07:14.580693+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:09.830102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'250","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671924+0000","last_change":"2024-09-14T11:10:56.607620+0000","last_active":"2024-09-14T12:07:20.671924+0000","last_peered":"2024-09-14T12:07:20.671924+0000","last_clean":"2024-09-14T12:07:20.671924+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:07:20.671924+0000","last_undegraded":"2024-09-14T12:07:20.671924+0000","last_fullsized":"2024-09-14T12:07:20.671924+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:01.270486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16157880,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":421,"num_read_kb":36459,"num_write":904,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681847+0000","last_change":"2024-09-14T11:10:58.610796+0000","last_active":"2024-09-14T12:07:14.681847+0000","last_peered":"2024-09-14T12:07:14.681847+0000","last_clean":"2024-09-14T12:07:14.681847+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:07:14.681847+0000","last_undegraded":"2024-09-14T12:07:14.681847+0000","last_fullsized":"2024-09-14T12:07:14.681847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.802576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'379","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.625105+0000","last_change":"2024-09-14T11:11:32.791047+0000","last_active":"2024-09-14T12:09:54.625105+0000","last_peered":"2024-09-14T12:09:54.625105+0000","last_clean":"2024-09-14T12:09:54.625105+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:09:54.625105+0000","last_undegraded":"2024-09-14T12:09:54.625105+0000","last_fullsized":"2024-09-14T12:09:54.625105+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:03.370176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":760,"num_read_kb":129855,"num_write":1252,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587458+0000","last_change":"2024-09-14T11:10:58.607143+0000","last_active":"2024-09-14T12:07:15.587458+0000","last_peered":"2024-09-14T12:07:15.587458+0000","last_clean":"2024-09-14T12:07:15.587458+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:07:15.587458+0000","last_undegraded":"2024-09-14T12:07:15.587458+0000","last_fullsized":"2024-09-14T12:07:15.587458+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:11.437478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'358","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.573515+0000","last_change":"2024-09-14T11:10:56.620202+0000","last_active":"2024-09-14T12:09:54.573515+0000","last_peered":"2024-09-14T12:09:54.573515+0000","last_clean":"2024-09-14T12:09:54.573515+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:09:54.573515+0000","last_undegraded":"2024-09-14T12:09:54.573515+0000","last_fullsized":"2024-09-14T12:09:54.573515+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:43.014580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":615,"num_read_kb":2365,"num_write":1154,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567847+0000","last_change":"2024-09-14T11:10:58.614201+0000","last_active":"2024-09-14T12:07:00.567847+0000","last_peered":"2024-09-14T12:07:00.567847+0000","last_clean":"2024-09-14T12:07:00.567847+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:07:00.567847+0000","last_undegraded":"2024-09-14T12:07:00.567847+0000","last_fullsized":"2024-09-14T12:07:00.567847+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:57.400806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'343","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.590033+0000","last_change":"2024-09-14T11:10:56.606394+0000","last_active":"2024-09-14T12:09:54.590033+0000","last_peered":"2024-09-14T12:09:54.590033+0000","last_clean":"2024-09-14T12:09:54.590033+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:09:54.590033+0000","last_undegraded":"2024-09-14T12:09:54.590033+0000","last_fullsized":"2024-09-14T12:09:54.590033+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.783451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306752,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":15479,"num_write":1160,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578562+0000","last_change":"2024-09-14T11:10:58.609097+0000","last_active":"2024-09-14T12:06:59.578562+0000","last_peered":"2024-09-14T12:06:59.578562+0000","last_clean":"2024-09-14T12:06:59.578562+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:06:59.578562+0000","last_undegraded":"2024-09-14T12:06:59.578562+0000","last_fullsized":"2024-09-14T12:06:59.578562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:56.920723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'355","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.564692+0000","last_change":"2024-09-14T11:11:32.791033+0000","last_active":"2024-09-14T12:09:54.564692+0000","last_peered":"2024-09-14T12:09:54.564692+0000","last_clean":"2024-09-14T12:09:54.564692+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:09:54.564692+0000","last_undegraded":"2024-09-14T12:09:54.564692+0000","last_fullsized":"2024-09-14T12:09:54.564692+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:01.149980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":4745,"num_write":1095,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'455","reported_seq":1139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655648+0000","last_change":"2024-09-14T11:10:58.607355+0000","last_active":"2024-09-14T12:07:19.655648+0000","last_peered":"2024-09-14T12:07:19.655648+0000","last_clean":"2024-09-14T12:07:19.655648+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:07:19.655648+0000","last_undegraded":"2024-09-14T12:07:19.655648+0000","last_fullsized":"2024-09-14T12:07:19.655648+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:29.211083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'549","reported_seq":1351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596614+0000","last_change":"2024-09-14T11:10:56.609284+0000","last_active":"2024-09-14T12:09:54.596614+0000","last_peered":"2024-09-14T12:09:54.596614+0000","last_clean":"2024-09-14T12:09:54.596614+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:09:54.596614+0000","last_undegraded":"2024-09-14T12:09:54.596614+0000","last_fullsized":"2024-09-14T12:09:54.596614+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:15.856244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1369,"num_read_kb":53619,"num_write":1731,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'707","reported_seq":1554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580728+0000","last_change":"2024-09-14T11:10:58.605938+0000","last_active":"2024-09-14T12:07:14.580728+0000","last_peered":"2024-09-14T12:07:14.580728+0000","last_clean":"2024-09-14T12:07:14.580728+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:07:14.580728+0000","last_undegraded":"2024-09-14T12:07:14.580728+0000","last_fullsized":"2024-09-14T12:07:14.580728+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.944096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'259","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569666+0000","last_change":"2024-09-14T11:10:56.612040+0000","last_active":"2024-09-14T12:07:15.569666+0000","last_peered":"2024-09-14T12:07:15.569666+0000","last_clean":"2024-09-14T12:07:15.569666+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:07:15.569666+0000","last_undegraded":"2024-09-14T12:07:15.569666+0000","last_fullsized":"2024-09-14T12:07:15.569666+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:34.021658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10994990,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":411,"num_read_kb":10603,"num_write":968,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":709,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581159+0000","last_change":"2024-09-14T11:10:58.613360+0000","last_active":"2024-09-14T12:07:14.581159+0000","last_peered":"2024-09-14T12:07:14.581159+0000","last_clean":"2024-09-14T12:07:14.581159+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:07:14.581159+0000","last_undegraded":"2024-09-14T12:07:14.581159+0000","last_fullsized":"2024-09-14T12:07:14.581159+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.266610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'285","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.891742+0000","last_change":"2024-09-14T11:10:56.618547+0000","last_active":"2024-09-14T12:07:15.891742+0000","last_peered":"2024-09-14T12:07:15.891742+0000","last_clean":"2024-09-14T12:07:15.891742+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:07:15.891742+0000","last_undegraded":"2024-09-14T12:07:15.891742+0000","last_fullsized":"2024-09-14T12:07:15.891742+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:44.204258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8203715,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":513,"num_read_kb":12529,"num_write":1078,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569633+0000","last_change":"2024-09-14T11:10:58.613749+0000","last_active":"2024-09-14T12:07:15.569633+0000","last_peered":"2024-09-14T12:07:15.569633+0000","last_clean":"2024-09-14T12:07:15.569633+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:07:15.569633+0000","last_undegraded":"2024-09-14T12:07:15.569633+0000","last_fullsized":"2024-09-14T12:07:15.569633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.466116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'394","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.563678+0000","last_change":"2024-09-14T11:10:56.605577+0000","last_active":"2024-09-14T12:09:54.563678+0000","last_peered":"2024-09-14T12:09:54.563678+0000","last_clean":"2024-09-14T12:09:54.563678+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:09:54.563678+0000","last_undegraded":"2024-09-14T12:09:54.563678+0000","last_fullsized":"2024-09-14T12:09:54.563678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:17.688717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1373288,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":13605,"num_write":1183,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.093054+0000","last_change":"2024-09-14T11:10:58.609288+0000","last_active":"2024-09-14T12:07:54.093054+0000","last_peered":"2024-09-14T12:07:54.093054+0000","last_clean":"2024-09-14T12:07:54.093054+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:07:54.093054+0000","last_undegraded":"2024-09-14T12:07:54.093054+0000","last_fullsized":"2024-09-14T12:07:54.093054+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:13.226950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'340","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562409+0000","last_change":"2024-09-14T11:10:56.610961+0000","last_active":"2024-09-14T12:09:54.562409+0000","last_peered":"2024-09-14T12:09:54.562409+0000","last_clean":"2024-09-14T12:09:54.562409+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:09:54.562409+0000","last_undegraded":"2024-09-14T12:09:54.562409+0000","last_fullsized":"2024-09-14T12:09:54.562409+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:29.522513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":673,"num_read_kb":59967,"num_write":1132,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'392","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583376+0000","last_change":"2024-09-14T11:10:58.613428+0000","last_active":"2024-09-14T12:07:29.583376+0000","last_peered":"2024-09-14T12:07:29.583376+0000","last_clean":"2024-09-14T12:07:29.583376+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:07:29.583376+0000","last_undegraded":"2024-09-14T12:07:29.583376+0000","last_fullsized":"2024-09-14T12:07:29.583376+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:14.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'329","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.655584+0000","last_change":"2024-09-14T11:10:56.608905+0000","last_active":"2024-09-14T12:09:54.655584+0000","last_peered":"2024-09-14T12:09:54.655584+0000","last_clean":"2024-09-14T12:09:54.655584+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:09:54.655584+0000","last_undegraded":"2024-09-14T12:09:54.655584+0000","last_fullsized":"2024-09-14T12:09:54.655584+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":654,"num_read_kb":22222,"num_write":1086,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615279+0000","last_change":"2024-09-14T11:10:56.602252+0000","last_active":"2024-09-14T12:09:54.615279+0000","last_peered":"2024-09-14T12:09:54.615279+0000","last_clean":"2024-09-14T12:09:54.615279+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:09:54.615279+0000","last_undegraded":"2024-09-14T12:09:54.615279+0000","last_fullsized":"2024-09-14T12:09:54.615279+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.972236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":41589,"num_write":1191,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566728+0000","last_change":"2024-09-14T11:10:58.614921+0000","last_active":"2024-09-14T12:06:50.566728+0000","last_peered":"2024-09-14T12:06:50.566728+0000","last_clean":"2024-09-14T12:06:50.566728+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:06:50.566728+0000","last_undegraded":"2024-09-14T12:06:50.566728+0000","last_fullsized":"2024-09-14T12:06:50.566728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:23.537706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'398","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669683+0000","last_change":"2024-09-14T11:11:32.677927+0000","last_active":"2024-09-14T12:07:00.669683+0000","last_peered":"2024-09-14T12:07:00.669683+0000","last_clean":"2024-09-14T12:07:00.669683+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:07:00.669683+0000","last_undegraded":"2024-09-14T12:07:00.669683+0000","last_fullsized":"2024-09-14T12:07:00.669683+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:06.109677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12071265,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":867,"num_read_kb":7347,"num_write":1267,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.782731+0000","last_change":"2024-09-14T11:10:58.606955+0000","last_active":"2024-09-14T12:07:10.782731+0000","last_peered":"2024-09-14T12:07:10.782731+0000","last_clean":"2024-09-14T12:07:10.782731+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:07:10.782731+0000","last_undegraded":"2024-09-14T12:07:10.782731+0000","last_fullsized":"2024-09-14T12:07:10.782731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:23.557773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1690,"ondisk_log_size":1690,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1725357,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17932,"num_read_kb":36290,"num_write":15168,"num_write_kb":11953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":1032028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2127,"ondisk_log_size":2127,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2406,"num_read_kb":2867,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215307921,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":42970,"num_read_kb":2049061,"num_write":72058,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":371613696,"data_stored":371613696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4145,"ondisk_log_size":4145,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":33557639,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":224799,"num_write":157,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51384320,"data_stored":51383431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":40894464,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":133,"num_read_kb":204319,"num_write":155,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101711872,"data_stored":101711872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510155,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449416,"kb_used_data":171128,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93922424,"statfs":{"total":96636764160,"available":96176562176,"internally_reserved":0,"allocated":175235072,"data_stored":173145974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":284948934},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510155,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296052,"kb_used_data":152484,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94075788,"statfs":{"total":96636764160,"available":96333606912,"internally_reserved":0,"allocated":156143616,"data_stored":154018295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510155,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398252,"kb_used_data":168540,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93973588,"statfs":{"total":96636764160,"available":96228954112,"internally_reserved":0,"allocated":172584960,"data_stored":170429111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542859,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319680,"kb_used_data":35736,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94052160,"statfs":{"total":96636764160,"available":96309411840,"internally_reserved":0,"allocated":36593664,"data_stored":34448679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":290650571},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542860,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181044,"kb_used_data":51208,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94190796,"statfs":{"total":96636764160,"available":96451375104,"internally_reserved":0,"allocated":52436992,"data_stored":50256323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542858,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146192,"kb_used_data":56652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94225648,"statfs":{"total":96636764160,"available":96487063552,"internally_reserved":0,"allocated":58011648,"data_stored":55972975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542860,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344924,"kb_used_data":75020,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94026916,"statfs":{"total":96636764160,"available":96283561984,"internally_reserved":0,"allocated":76820480,"data_stored":74679404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542860,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106552,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94265288,"statfs":{"total":96636764160,"available":96527654912,"internally_reserved":0,"allocated":25968640,"data_stored":23920772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112685056,"data_stored":112685056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103116800,"data_stored":103116800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3244032,"data_stored":3244032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2568192,"data_stored":2568192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12972032,"data_stored":12972032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":5115904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":120254464,"data_stored":120254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11657216,"data_stored":11657216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":339374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":376771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":38629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":274020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38797312,"data_stored":38797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":9440391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:09:55.626 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T12:09:55.626 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:09:55.987 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:09:56.004 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:09:56.007 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2035,"stamp":"2024-09-14T12:09:54.842626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292092642,"num_objects":2046,"num_object_clones":0,"num_object_copies":5796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2046,"num_whiteouts":0,"num_read":198051,"num_read_kb":2632166,"num_write":146214,"num_write_kb":2509925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14174,"ondisk_log_size":14174,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2242112,"kb_used_data":736128,"kb_used_omap":12,"kb_used_meta":1505459,"kb_avail":752732608,"statfs":{"total":773094113280,"available":770798190592,"internally_reserved":0,"allocated":753795072,"data_stored":736871533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1541590577},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-436662693,"num_objects":-2668,"num_object_clones":0,"num_object_copies":-7978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2668,"num_whiteouts":0,"num_read":2983,"num_read_kb":2737,"num_write":2834,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005006"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.714132+0000","last_change":"2024-09-14T11:44:25.351991+0000","last_active":"2024-09-14T12:06:54.714132+0000","last_peered":"2024-09-14T12:06:54.714132+0000","last_clean":"2024-09-14T12:06:54.714132+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:06:54.714132+0000","last_undegraded":"2024-09-14T12:06:54.714132+0000","last_fullsized":"2024-09-14T12:06:54.714132+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:51.739360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.707626+0000","last_change":"2024-09-14T11:28:36.255342+0000","last_active":"2024-09-14T12:06:09.707626+0000","last_peered":"2024-09-14T12:06:09.707626+0000","last_clean":"2024-09-14T12:06:09.707626+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:06:09.707626+0000","last_undegraded":"2024-09-14T12:06:09.707626+0000","last_fullsized":"2024-09-14T12:06:09.707626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.129757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.673633+0000","last_change":"2024-09-14T11:28:33.234582+0000","last_active":"2024-09-14T12:06:04.673633+0000","last_peered":"2024-09-14T12:06:04.673633+0000","last_clean":"2024-09-14T12:06:04.673633+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:06:04.673633+0000","last_undegraded":"2024-09-14T12:06:04.673633+0000","last_fullsized":"2024-09-14T12:06:04.673633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.203877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.569061+0000","last_change":"2024-09-14T11:25:27.952561+0000","last_active":"2024-09-14T12:07:10.569061+0000","last_peered":"2024-09-14T12:07:10.569061+0000","last_clean":"2024-09-14T12:07:10.569061+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:07:10.569061+0000","last_undegraded":"2024-09-14T12:07:10.569061+0000","last_fullsized":"2024-09-14T12:07:10.569061+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:17.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.651197+0000","last_change":"2024-09-14T11:44:25.353765+0000","last_active":"2024-09-14T12:06:54.651197+0000","last_peered":"2024-09-14T12:06:54.651197+0000","last_clean":"2024-09-14T12:06:54.651197+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:06:54.651197+0000","last_undegraded":"2024-09-14T12:06:54.651197+0000","last_fullsized":"2024-09-14T12:06:54.651197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:11.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593518+0000","last_change":"2024-09-14T11:28:36.260521+0000","last_active":"2024-09-14T12:08:39.593518+0000","last_peered":"2024-09-14T12:08:39.593518+0000","last_clean":"2024-09-14T12:08:39.593518+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:08:39.593518+0000","last_undegraded":"2024-09-14T12:08:39.593518+0000","last_fullsized":"2024-09-14T12:08:39.593518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:16.049764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663945+0000","last_change":"2024-09-14T11:28:33.226443+0000","last_active":"2024-09-14T12:06:05.663945+0000","last_peered":"2024-09-14T12:06:05.663945+0000","last_clean":"2024-09-14T12:06:05.663945+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:06:05.663945+0000","last_undegraded":"2024-09-14T12:06:05.663945+0000","last_fullsized":"2024-09-14T12:06:05.663945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:38.075764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.657263+0000","last_change":"2024-09-14T11:25:27.951069+0000","last_active":"2024-09-14T12:07:34.657263+0000","last_peered":"2024-09-14T12:07:34.657263+0000","last_clean":"2024-09-14T12:07:34.657263+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:07:34.657263+0000","last_undegraded":"2024-09-14T12:07:34.657263+0000","last_fullsized":"2024-09-14T12:07:34.657263+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:28.986404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.578394+0000","last_change":"2024-09-14T11:44:25.347621+0000","last_active":"2024-09-14T12:06:10.578394+0000","last_peered":"2024-09-14T12:06:10.578394+0000","last_clean":"2024-09-14T12:06:10.578394+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:06:10.578394+0000","last_undegraded":"2024-09-14T12:06:10.578394+0000","last_fullsized":"2024-09-14T12:06:10.578394+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:39.883404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'11","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561213+0000","last_change":"2024-09-14T11:28:36.367262+0000","last_active":"2024-09-14T12:06:05.561213+0000","last_peered":"2024-09-14T12:06:05.561213+0000","last_clean":"2024-09-14T12:06:05.561213+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:06:05.561213+0000","last_undegraded":"2024-09-14T12:06:05.561213+0000","last_fullsized":"2024-09-14T12:06:05.561213+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:03.310942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17825792,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":33792,"num_write":21,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.649550+0000","last_change":"2024-09-14T11:28:33.226810+0000","last_active":"2024-09-14T12:06:39.649550+0000","last_peered":"2024-09-14T12:06:39.649550+0000","last_clean":"2024-09-14T12:06:39.649550+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:06:39.649550+0000","last_undegraded":"2024-09-14T12:06:39.649550+0000","last_fullsized":"2024-09-14T12:06:39.649550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.798886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.557251+0000","last_change":"2024-09-14T11:25:27.940069+0000","last_active":"2024-09-14T12:05:30.557251+0000","last_peered":"2024-09-14T12:05:30.557251+0000","last_clean":"2024-09-14T12:05:30.557251+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:05:30.557251+0000","last_undegraded":"2024-09-14T12:05:30.557251+0000","last_fullsized":"2024-09-14T12:05:30.557251+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:45.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:19.675494+0000","last_change":"2024-09-14T11:44:25.356282+0000","last_active":"2024-09-14T12:06:19.675494+0000","last_peered":"2024-09-14T12:06:19.675494+0000","last_clean":"2024-09-14T12:06:19.675494+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:06:19.675494+0000","last_undegraded":"2024-09-14T12:06:19.675494+0000","last_fullsized":"2024-09-14T12:06:19.675494+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:56.126294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.127142+0000","last_change":"2024-09-14T11:28:36.366276+0000","last_active":"2024-09-14T12:09:53.127142+0000","last_peered":"2024-09-14T12:09:53.127142+0000","last_clean":"2024-09-14T12:09:53.127142+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:09:53.127142+0000","last_undegraded":"2024-09-14T12:09:53.127142+0000","last_fullsized":"2024-09-14T12:09:53.127142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:40.126728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589312+0000","last_change":"2024-09-14T11:28:33.228558+0000","last_active":"2024-09-14T12:08:09.589312+0000","last_peered":"2024-09-14T12:08:09.589312+0000","last_clean":"2024-09-14T12:08:09.589312+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:08:09.589312+0000","last_undegraded":"2024-09-14T12:08:09.589312+0000","last_fullsized":"2024-09-14T12:08:09.589312+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669719+0000","last_change":"2024-09-14T11:25:27.953674+0000","last_active":"2024-09-14T12:05:29.669719+0000","last_peered":"2024-09-14T12:05:29.669719+0000","last_clean":"2024-09-14T12:05:29.669719+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:05:29.669719+0000","last_undegraded":"2024-09-14T12:05:29.669719+0000","last_fullsized":"2024-09-14T12:05:29.669719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:04.652722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677327+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:06:34.677327+0000","last_peered":"2024-09-14T12:06:34.677327+0000","last_clean":"2024-09-14T12:06:34.677327+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:06:34.677327+0000","last_undegraded":"2024-09-14T12:06:34.677327+0000","last_fullsized":"2024-09-14T12:06:34.677327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.317315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:49.741974+0000","last_change":"2024-09-14T11:28:36.259291+0000","last_active":"2024-09-14T12:09:49.741974+0000","last_peered":"2024-09-14T12:09:49.741974+0000","last_clean":"2024-09-14T12:09:49.741974+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:09:49.741974+0000","last_undegraded":"2024-09-14T12:09:49.741974+0000","last_fullsized":"2024-09-14T12:09:49.741974+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:04.701036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569572+0000","last_change":"2024-09-14T11:28:33.231526+0000","last_active":"2024-09-14T12:07:15.569572+0000","last_peered":"2024-09-14T12:07:15.569572+0000","last_clean":"2024-09-14T12:07:15.569572+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:07:15.569572+0000","last_undegraded":"2024-09-14T12:07:15.569572+0000","last_fullsized":"2024-09-14T12:07:15.569572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:57.361260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669669+0000","last_change":"2024-09-14T11:25:27.952436+0000","last_active":"2024-09-14T12:05:29.669669+0000","last_peered":"2024-09-14T12:05:29.669669+0000","last_clean":"2024-09-14T12:05:29.669669+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:05:29.669669+0000","last_undegraded":"2024-09-14T12:05:29.669669+0000","last_fullsized":"2024-09-14T12:05:29.669669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:37.926867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671952+0000","last_change":"2024-09-14T11:44:25.349268+0000","last_active":"2024-09-14T12:07:20.671952+0000","last_peered":"2024-09-14T12:07:20.671952+0000","last_clean":"2024-09-14T12:07:20.671952+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:07:20.671952+0000","last_undegraded":"2024-09-14T12:07:20.671952+0000","last_fullsized":"2024-09-14T12:07:20.671952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:40.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587416+0000","last_change":"2024-09-14T11:28:36.259293+0000","last_active":"2024-09-14T12:07:15.587416+0000","last_peered":"2024-09-14T12:07:15.587416+0000","last_clean":"2024-09-14T12:07:15.587416+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:07:15.587416+0000","last_undegraded":"2024-09-14T12:07:15.587416+0000","last_fullsized":"2024-09-14T12:07:15.587416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:44.079464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582351+0000","last_change":"2024-09-14T11:28:33.230634+0000","last_active":"2024-09-14T12:07:24.582351+0000","last_peered":"2024-09-14T12:07:24.582351+0000","last_clean":"2024-09-14T12:07:24.582351+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:07:24.582351+0000","last_undegraded":"2024-09-14T12:07:24.582351+0000","last_fullsized":"2024-09-14T12:07:24.582351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.201670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.572739+0000","last_change":"2024-09-14T11:25:27.951325+0000","last_active":"2024-09-14T12:05:30.572739+0000","last_peered":"2024-09-14T12:05:30.572739+0000","last_clean":"2024-09-14T12:05:30.572739+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:05:30.572739+0000","last_undegraded":"2024-09-14T12:05:30.572739+0000","last_fullsized":"2024-09-14T12:05:30.572739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:34.624675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578552+0000","last_change":"2024-09-14T11:44:25.353198+0000","last_active":"2024-09-14T12:06:54.578552+0000","last_peered":"2024-09-14T12:06:54.578552+0000","last_clean":"2024-09-14T12:06:54.578552+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:06:54.578552+0000","last_undegraded":"2024-09-14T12:06:54.578552+0000","last_fullsized":"2024-09-14T12:06:54.578552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:09.499820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577573+0000","last_change":"2024-09-14T11:28:36.261093+0000","last_active":"2024-09-14T12:06:05.577573+0000","last_peered":"2024-09-14T12:06:05.577573+0000","last_clean":"2024-09-14T12:06:05.577573+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:06:05.577573+0000","last_undegraded":"2024-09-14T12:06:05.577573+0000","last_fullsized":"2024-09-14T12:06:05.577573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:33.800970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.592790+0000","last_change":"2024-09-14T11:28:33.231811+0000","last_active":"2024-09-14T12:08:34.592790+0000","last_peered":"2024-09-14T12:08:34.592790+0000","last_clean":"2024-09-14T12:08:34.592790+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:08:34.592790+0000","last_undegraded":"2024-09-14T12:08:34.592790+0000","last_fullsized":"2024-09-14T12:08:34.592790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:14.016741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566550+0000","last_change":"2024-09-14T11:25:27.947671+0000","last_active":"2024-09-14T12:06:50.566550+0000","last_peered":"2024-09-14T12:06:50.566550+0000","last_clean":"2024-09-14T12:06:50.566550+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:06:50.566550+0000","last_undegraded":"2024-09-14T12:06:50.566550+0000","last_fullsized":"2024-09-14T12:06:50.566550+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:21.104088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578614+0000","last_change":"2024-09-14T11:44:25.355575+0000","last_active":"2024-09-14T12:06:54.578614+0000","last_peered":"2024-09-14T12:06:54.578614+0000","last_clean":"2024-09-14T12:06:54.578614+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:06:54.578614+0000","last_undegraded":"2024-09-14T12:06:54.578614+0000","last_fullsized":"2024-09-14T12:06:54.578614+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.828628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674310+0000","last_change":"2024-09-14T11:28:36.254791+0000","last_active":"2024-09-14T12:06:09.674310+0000","last_peered":"2024-09-14T12:06:09.674310+0000","last_clean":"2024-09-14T12:06:09.674310+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:06:09.674310+0000","last_undegraded":"2024-09-14T12:06:09.674310+0000","last_fullsized":"2024-09-14T12:06:09.674310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:16.546392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561126+0000","last_change":"2024-09-14T11:28:33.230741+0000","last_active":"2024-09-14T12:06:05.561126+0000","last_peered":"2024-09-14T12:06:05.561126+0000","last_clean":"2024-09-14T12:06:05.561126+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:06:05.561126+0000","last_undegraded":"2024-09-14T12:06:05.561126+0000","last_fullsized":"2024-09-14T12:06:05.561126+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:45.191280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.667058+0000","last_change":"2024-09-14T11:25:27.942564+0000","last_active":"2024-09-14T12:06:35.667058+0000","last_peered":"2024-09-14T12:06:35.667058+0000","last_clean":"2024-09-14T12:06:35.667058+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:06:35.667058+0000","last_undegraded":"2024-09-14T12:06:35.667058+0000","last_fullsized":"2024-09-14T12:06:35.667058+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.091896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:25.659466+0000","last_change":"2024-09-14T11:44:25.351716+0000","last_active":"2024-09-14T12:05:25.659466+0000","last_peered":"2024-09-14T12:05:25.659466+0000","last_clean":"2024-09-14T12:05:25.659466+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:05:25.659466+0000","last_undegraded":"2024-09-14T12:05:25.659466+0000","last_fullsized":"2024-09-14T12:05:25.659466+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:06.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210853+0000","last_change":"2024-09-14T11:28:36.369321+0000","last_active":"2024-09-14T12:09:54.210853+0000","last_peered":"2024-09-14T12:09:54.210853+0000","last_clean":"2024-09-14T12:09:54.210853+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:09:54.210853+0000","last_undegraded":"2024-09-14T12:09:54.210853+0000","last_fullsized":"2024-09-14T12:09:54.210853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:22.989447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706081+0000","last_change":"2024-09-14T11:28:33.231360+0000","last_active":"2024-09-14T12:05:59.706081+0000","last_peered":"2024-09-14T12:05:59.706081+0000","last_clean":"2024-09-14T12:05:59.706081+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:05:59.706081+0000","last_undegraded":"2024-09-14T12:05:59.706081+0000","last_fullsized":"2024-09-14T12:05:59.706081+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.002852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564851+0000","last_change":"2024-09-14T11:25:27.949982+0000","last_active":"2024-09-14T12:06:35.564851+0000","last_peered":"2024-09-14T12:06:35.564851+0000","last_clean":"2024-09-14T12:06:35.564851+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:06:35.564851+0000","last_undegraded":"2024-09-14T12:06:35.564851+0000","last_fullsized":"2024-09-14T12:06:35.564851+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:12.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.641872+0000","last_change":"2024-09-14T11:44:25.346519+0000","last_active":"2024-09-14T12:05:24.641872+0000","last_peered":"2024-09-14T12:05:24.641872+0000","last_clean":"2024-09-14T12:05:24.641872+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:05:24.641872+0000","last_undegraded":"2024-09-14T12:05:24.641872+0000","last_fullsized":"2024-09-14T12:05:24.641872+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:51.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674369+0000","last_change":"2024-09-14T11:28:36.367601+0000","last_active":"2024-09-14T12:06:09.674369+0000","last_peered":"2024-09-14T12:06:09.674369+0000","last_clean":"2024-09-14T12:06:09.674369+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:06:09.674369+0000","last_undegraded":"2024-09-14T12:06:09.674369+0000","last_fullsized":"2024-09-14T12:06:09.674369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:47.572025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581225+0000","last_change":"2024-09-14T11:28:33.228389+0000","last_active":"2024-09-14T12:07:14.581225+0000","last_peered":"2024-09-14T12:07:14.581225+0000","last_clean":"2024-09-14T12:07:14.581225+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:07:14.581225+0000","last_undegraded":"2024-09-14T12:07:14.581225+0000","last_fullsized":"2024-09-14T12:07:14.581225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:11.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677357+0000","last_change":"2024-09-14T11:25:27.953781+0000","last_active":"2024-09-14T12:06:34.677357+0000","last_peered":"2024-09-14T12:06:34.677357+0000","last_clean":"2024-09-14T12:06:34.677357+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:06:34.677357+0000","last_undegraded":"2024-09-14T12:06:34.677357+0000","last_fullsized":"2024-09-14T12:06:34.677357+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.652754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.564302+0000","last_change":"2024-09-14T11:44:25.348811+0000","last_active":"2024-09-14T12:05:24.564302+0000","last_peered":"2024-09-14T12:05:24.564302+0000","last_clean":"2024-09-14T12:05:24.564302+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:05:24.564302+0000","last_undegraded":"2024-09-14T12:05:24.564302+0000","last_fullsized":"2024-09-14T12:05:24.564302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:32.650432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682708+0000","last_change":"2024-09-14T11:28:36.369256+0000","last_active":"2024-09-14T12:07:19.682708+0000","last_peered":"2024-09-14T12:07:19.682708+0000","last_clean":"2024-09-14T12:07:19.682708+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:07:19.682708+0000","last_undegraded":"2024-09-14T12:07:19.682708+0000","last_fullsized":"2024-09-14T12:07:19.682708+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:54.707659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653192+0000","last_change":"2024-09-14T11:28:33.233405+0000","last_active":"2024-09-14T12:07:14.653192+0000","last_peered":"2024-09-14T12:07:14.653192+0000","last_clean":"2024-09-14T12:07:14.653192+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:07:14.653192+0000","last_undegraded":"2024-09-14T12:07:14.653192+0000","last_fullsized":"2024-09-14T12:07:14.653192+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649083+0000","last_change":"2024-09-14T11:25:27.945742+0000","last_active":"2024-09-14T12:06:34.649083+0000","last_peered":"2024-09-14T12:06:34.649083+0000","last_clean":"2024-09-14T12:06:34.649083+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:06:34.649083+0000","last_undegraded":"2024-09-14T12:06:34.649083+0000","last_fullsized":"2024-09-14T12:06:34.649083+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:48.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.700955+0000","last_change":"2024-09-14T11:44:25.352981+0000","last_active":"2024-09-14T12:05:24.700955+0000","last_peered":"2024-09-14T12:05:24.700955+0000","last_clean":"2024-09-14T12:05:24.700955+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:05:24.700955+0000","last_undegraded":"2024-09-14T12:05:24.700955+0000","last_fullsized":"2024-09-14T12:05:24.700955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:28.913462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581671+0000","last_change":"2024-09-14T11:28:36.261453+0000","last_active":"2024-09-14T12:07:19.581671+0000","last_peered":"2024-09-14T12:07:19.581671+0000","last_clean":"2024-09-14T12:07:19.581671+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:07:19.581671+0000","last_undegraded":"2024-09-14T12:07:19.581671+0000","last_fullsized":"2024-09-14T12:07:19.581671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'1","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569744+0000","last_change":"2024-09-14T11:28:33.226734+0000","last_active":"2024-09-14T12:07:15.569744+0000","last_peered":"2024-09-14T12:07:15.569744+0000","last_clean":"2024-09-14T12:07:15.569744+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:07:15.569744+0000","last_undegraded":"2024-09-14T12:07:15.569744+0000","last_fullsized":"2024-09-14T12:07:15.569744+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:19.563659+0000","last_change":"2024-09-14T11:25:27.950879+0000","last_active":"2024-09-14T12:05:19.563659+0000","last_peered":"2024-09-14T12:05:19.563659+0000","last_clean":"2024-09-14T12:05:19.563659+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:05:19.563659+0000","last_undegraded":"2024-09-14T12:05:19.563659+0000","last_fullsized":"2024-09-14T12:05:19.563659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:13.451590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674442+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:06:09.674442+0000","last_peered":"2024-09-14T12:06:09.674442+0000","last_clean":"2024-09-14T12:06:09.674442+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:06:09.674442+0000","last_undegraded":"2024-09-14T12:06:09.674442+0000","last_fullsized":"2024-09-14T12:06:09.674442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.648826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662808+0000","last_change":"2024-09-14T11:28:36.257731+0000","last_active":"2024-09-14T12:05:55.662808+0000","last_peered":"2024-09-14T12:05:55.662808+0000","last_clean":"2024-09-14T12:05:55.662808+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:05:55.662808+0000","last_undegraded":"2024-09-14T12:05:55.662808+0000","last_fullsized":"2024-09-14T12:05:55.662808+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:03.144550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.569273+0000","last_change":"2024-09-14T11:28:33.232810+0000","last_active":"2024-09-14T12:05:54.569273+0000","last_peered":"2024-09-14T12:05:54.569273+0000","last_clean":"2024-09-14T12:05:54.569273+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:05:54.569273+0000","last_undegraded":"2024-09-14T12:05:54.569273+0000","last_fullsized":"2024-09-14T12:05:54.569273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:44.564156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583435+0000","last_change":"2024-09-14T11:25:27.949859+0000","last_active":"2024-09-14T12:07:29.583435+0000","last_peered":"2024-09-14T12:07:29.583435+0000","last_clean":"2024-09-14T12:07:29.583435+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:07:29.583435+0000","last_undegraded":"2024-09-14T12:07:29.583435+0000","last_fullsized":"2024-09-14T12:07:29.583435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:45.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561924+0000","last_change":"2024-09-14T11:44:25.355586+0000","last_active":"2024-09-14T12:06:10.561924+0000","last_peered":"2024-09-14T12:06:10.561924+0000","last_clean":"2024-09-14T12:06:10.561924+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:06:10.561924+0000","last_undegraded":"2024-09-14T12:06:10.561924+0000","last_fullsized":"2024-09-14T12:06:10.561924+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:15.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662766+0000","last_change":"2024-09-14T11:28:36.261024+0000","last_active":"2024-09-14T12:05:55.662766+0000","last_peered":"2024-09-14T12:05:55.662766+0000","last_clean":"2024-09-14T12:05:55.662766+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:05:55.662766+0000","last_undegraded":"2024-09-14T12:05:55.662766+0000","last_fullsized":"2024-09-14T12:05:55.662766+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.672323+0000","last_change":"2024-09-14T11:28:33.229372+0000","last_active":"2024-09-14T12:05:54.672323+0000","last_peered":"2024-09-14T12:05:54.672323+0000","last_clean":"2024-09-14T12:05:54.672323+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:05:54.672323+0000","last_undegraded":"2024-09-14T12:05:54.672323+0000","last_fullsized":"2024-09-14T12:05:54.672323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:23.134165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571324+0000","last_change":"2024-09-14T11:25:27.945571+0000","last_active":"2024-09-14T12:07:30.571324+0000","last_peered":"2024-09-14T12:07:30.571324+0000","last_clean":"2024-09-14T12:07:30.571324+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:07:30.571324+0000","last_undegraded":"2024-09-14T12:07:30.571324+0000","last_fullsized":"2024-09-14T12:07:30.571324+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:07.890808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557794+0000","last_change":"2024-09-14T11:44:25.351774+0000","last_active":"2024-09-14T12:05:35.557794+0000","last_peered":"2024-09-14T12:05:35.557794+0000","last_clean":"2024-09-14T12:05:35.557794+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:05:35.557794+0000","last_undegraded":"2024-09-14T12:05:35.557794+0000","last_fullsized":"2024-09-14T12:05:35.557794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.350297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.406287+0000","last_change":"2024-09-14T11:28:36.257478+0000","last_active":"2024-09-14T12:09:53.406287+0000","last_peered":"2024-09-14T12:09:53.406287+0000","last_clean":"2024-09-14T12:09:53.406287+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:09:53.406287+0000","last_undegraded":"2024-09-14T12:09:53.406287+0000","last_fullsized":"2024-09-14T12:09:53.406287+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:23.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576285+0000","last_change":"2024-09-14T11:28:33.226764+0000","last_active":"2024-09-14T12:05:55.576285+0000","last_peered":"2024-09-14T12:05:55.576285+0000","last_clean":"2024-09-14T12:05:55.576285+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:05:55.576285+0000","last_undegraded":"2024-09-14T12:05:55.576285+0000","last_fullsized":"2024-09-14T12:05:55.576285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.256510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583059+0000","last_change":"2024-09-14T11:25:27.946060+0000","last_active":"2024-09-14T12:07:29.583059+0000","last_peered":"2024-09-14T12:07:29.583059+0000","last_clean":"2024-09-14T12:07:29.583059+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:07:29.583059+0000","last_undegraded":"2024-09-14T12:07:29.583059+0000","last_fullsized":"2024-09-14T12:07:29.583059+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:07.686737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674405+0000","last_change":"2024-09-14T11:44:25.350108+0000","last_active":"2024-09-14T12:06:09.674405+0000","last_peered":"2024-09-14T12:06:09.674405+0000","last_clean":"2024-09-14T12:06:09.674405+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:06:09.674405+0000","last_undegraded":"2024-09-14T12:06:09.674405+0000","last_fullsized":"2024-09-14T12:06:09.674405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:05.638059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576237+0000","last_change":"2024-09-14T11:28:36.254787+0000","last_active":"2024-09-14T12:05:55.576237+0000","last_peered":"2024-09-14T12:05:55.576237+0000","last_clean":"2024-09-14T12:05:55.576237+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:05:55.576237+0000","last_undegraded":"2024-09-14T12:05:55.576237+0000","last_fullsized":"2024-09-14T12:05:55.576237+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:50.371867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.726150+0000","last_change":"2024-09-14T11:28:33.230870+0000","last_active":"2024-09-14T12:08:14.726150+0000","last_peered":"2024-09-14T12:08:14.726150+0000","last_clean":"2024-09-14T12:08:14.726150+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:08:14.726150+0000","last_undegraded":"2024-09-14T12:08:14.726150+0000","last_fullsized":"2024-09-14T12:08:14.726150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.098373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.683991+0000","last_change":"2024-09-14T11:25:27.953081+0000","last_active":"2024-09-14T12:07:29.683991+0000","last_peered":"2024-09-14T12:07:29.683991+0000","last_clean":"2024-09-14T12:07:29.683991+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:07:29.683991+0000","last_undegraded":"2024-09-14T12:07:29.683991+0000","last_fullsized":"2024-09-14T12:07:29.683991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:37.718041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646069+0000","last_change":"2024-09-14T11:44:25.347178+0000","last_active":"2024-09-14T12:06:04.646069+0000","last_peered":"2024-09-14T12:06:04.646069+0000","last_clean":"2024-09-14T12:06:04.646069+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:06:04.646069+0000","last_undegraded":"2024-09-14T12:06:04.646069+0000","last_fullsized":"2024-09-14T12:06:04.646069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.558120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679683+0000","last_change":"2024-09-14T11:28:36.257470+0000","last_active":"2024-09-14T12:06:54.679683+0000","last_peered":"2024-09-14T12:06:54.679683+0000","last_clean":"2024-09-14T12:06:54.679683+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:06:54.679683+0000","last_undegraded":"2024-09-14T12:06:54.679683+0000","last_fullsized":"2024-09-14T12:06:54.679683+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.008987+0000","last_change":"2024-09-14T11:28:33.233762+0000","last_active":"2024-09-14T12:09:54.008987+0000","last_peered":"2024-09-14T12:09:54.008987+0000","last_clean":"2024-09-14T12:09:54.008987+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:09:54.008987+0000","last_undegraded":"2024-09-14T12:09:54.008987+0000","last_fullsized":"2024-09-14T12:09:54.008987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:03.013761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674471+0000","last_change":"2024-09-14T11:25:27.950690+0000","last_active":"2024-09-14T12:06:09.674471+0000","last_peered":"2024-09-14T12:06:09.674471+0000","last_clean":"2024-09-14T12:06:09.674471+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:06:09.674471+0000","last_undegraded":"2024-09-14T12:06:09.674471+0000","last_fullsized":"2024-09-14T12:06:09.674471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:51.496056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578529+0000","last_change":"2024-09-14T11:44:25.354265+0000","last_active":"2024-09-14T12:06:54.578529+0000","last_peered":"2024-09-14T12:06:54.578529+0000","last_clean":"2024-09-14T12:06:54.578529+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:06:54.578529+0000","last_undegraded":"2024-09-14T12:06:54.578529+0000","last_fullsized":"2024-09-14T12:06:54.578529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.737799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679648+0000","last_change":"2024-09-14T11:28:36.254946+0000","last_active":"2024-09-14T12:06:54.679648+0000","last_peered":"2024-09-14T12:06:54.679648+0000","last_clean":"2024-09-14T12:06:54.679648+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:06:54.679648+0000","last_undegraded":"2024-09-14T12:06:54.679648+0000","last_fullsized":"2024-09-14T12:06:54.679648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:55.651650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.876445+0000","last_change":"2024-09-14T11:28:33.228679+0000","last_active":"2024-09-14T12:09:52.876445+0000","last_peered":"2024-09-14T12:09:52.876445+0000","last_clean":"2024-09-14T12:09:52.876445+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:09:52.876445+0000","last_undegraded":"2024-09-14T12:09:52.876445+0000","last_fullsized":"2024-09-14T12:09:52.876445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706137+0000","last_change":"2024-09-14T11:25:27.949880+0000","last_active":"2024-09-14T12:05:59.706137+0000","last_peered":"2024-09-14T12:05:59.706137+0000","last_clean":"2024-09-14T12:05:59.706137+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:05:59.706137+0000","last_undegraded":"2024-09-14T12:05:59.706137+0000","last_fullsized":"2024-09-14T12:05:59.706137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.896653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577462+0000","last_change":"2024-09-14T11:44:25.340707+0000","last_active":"2024-09-14T12:06:05.577462+0000","last_peered":"2024-09-14T12:06:05.577462+0000","last_clean":"2024-09-14T12:06:05.577462+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:06:05.577462+0000","last_undegraded":"2024-09-14T12:06:05.577462+0000","last_fullsized":"2024-09-14T12:06:05.577462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:41.520475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669775+0000","last_change":"2024-09-14T11:28:36.367731+0000","last_active":"2024-09-14T12:07:00.669775+0000","last_peered":"2024-09-14T12:07:00.669775+0000","last_clean":"2024-09-14T12:07:00.669775+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:07:00.669775+0000","last_undegraded":"2024-09-14T12:07:00.669775+0000","last_fullsized":"2024-09-14T12:07:00.669775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:55.831862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566673+0000","last_change":"2024-09-14T11:28:33.231847+0000","last_active":"2024-09-14T12:06:50.566673+0000","last_peered":"2024-09-14T12:06:50.566673+0000","last_clean":"2024-09-14T12:06:50.566673+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:06:50.566673+0000","last_undegraded":"2024-09-14T12:06:50.566673+0000","last_fullsized":"2024-09-14T12:06:50.566673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:38.952131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.576926+0000","last_change":"2024-09-14T11:25:27.950496+0000","last_active":"2024-09-14T12:06:00.576926+0000","last_peered":"2024-09-14T12:06:00.576926+0000","last_clean":"2024-09-14T12:06:00.576926+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:06:00.576926+0000","last_undegraded":"2024-09-14T12:06:00.576926+0000","last_fullsized":"2024-09-14T12:06:00.576926+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.743937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570818+0000","last_change":"2024-09-14T11:44:25.347374+0000","last_active":"2024-09-14T12:06:04.570818+0000","last_peered":"2024-09-14T12:06:04.570818+0000","last_clean":"2024-09-14T12:06:04.570818+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:06:04.570818+0000","last_undegraded":"2024-09-14T12:06:04.570818+0000","last_fullsized":"2024-09-14T12:06:04.570818+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:02.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679699+0000","last_change":"2024-09-14T11:28:36.256404+0000","last_active":"2024-09-14T12:06:54.679699+0000","last_peered":"2024-09-14T12:06:54.679699+0000","last_clean":"2024-09-14T12:06:54.679699+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:06:54.679699+0000","last_undegraded":"2024-09-14T12:06:54.679699+0000","last_fullsized":"2024-09-14T12:06:54.679699+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:18.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669763+0000","last_change":"2024-09-14T11:28:33.227452+0000","last_active":"2024-09-14T12:07:00.669763+0000","last_peered":"2024-09-14T12:07:00.669763+0000","last_clean":"2024-09-14T12:07:00.669763+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:07:00.669763+0000","last_undegraded":"2024-09-14T12:07:00.669763+0000","last_fullsized":"2024-09-14T12:07:00.669763+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.149389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.645601+0000","last_change":"2024-09-14T11:25:27.954496+0000","last_active":"2024-09-14T12:05:59.645601+0000","last_peered":"2024-09-14T12:05:59.645601+0000","last_clean":"2024-09-14T12:05:59.645601+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:05:59.645601+0000","last_undegraded":"2024-09-14T12:05:59.645601+0000","last_fullsized":"2024-09-14T12:05:59.645601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:03.897519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679716+0000","last_change":"2024-09-14T11:44:25.355046+0000","last_active":"2024-09-14T12:06:54.679716+0000","last_peered":"2024-09-14T12:06:54.679716+0000","last_clean":"2024-09-14T12:06:54.679716+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:06:54.679716+0000","last_undegraded":"2024-09-14T12:06:54.679716+0000","last_fullsized":"2024-09-14T12:06:54.679716+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.119733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.955962+0000","last_change":"2024-09-14T11:28:36.260180+0000","last_active":"2024-09-14T12:09:52.955962+0000","last_peered":"2024-09-14T12:09:52.955962+0000","last_clean":"2024-09-14T12:09:52.955962+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:09:52.955962+0000","last_undegraded":"2024-09-14T12:09:52.955962+0000","last_fullsized":"2024-09-14T12:09:52.955962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:35.619938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571885+0000","last_change":"2024-09-14T11:28:33.230223+0000","last_active":"2024-09-14T12:07:35.571885+0000","last_peered":"2024-09-14T12:07:35.571885+0000","last_clean":"2024-09-14T12:07:35.571885+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:07:35.571885+0000","last_undegraded":"2024-09-14T12:07:35.571885+0000","last_fullsized":"2024-09-14T12:07:35.571885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:17.221998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.560556+0000","last_change":"2024-09-14T11:25:27.953095+0000","last_active":"2024-09-14T12:06:00.560556+0000","last_peered":"2024-09-14T12:06:00.560556+0000","last_clean":"2024-09-14T12:06:00.560556+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:06:00.560556+0000","last_undegraded":"2024-09-14T12:06:00.560556+0000","last_fullsized":"2024-09-14T12:06:00.560556+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:58.766336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579278+0000","last_change":"2024-09-14T11:44:25.354056+0000","last_active":"2024-09-14T12:06:59.579278+0000","last_peered":"2024-09-14T12:06:59.579278+0000","last_clean":"2024-09-14T12:06:59.579278+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:06:59.579278+0000","last_undegraded":"2024-09-14T12:06:59.579278+0000","last_fullsized":"2024-09-14T12:06:59.579278+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.958850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.131052+0000","last_change":"2024-09-14T11:28:36.365890+0000","last_active":"2024-09-14T12:09:53.131052+0000","last_peered":"2024-09-14T12:09:53.131052+0000","last_clean":"2024-09-14T12:09:53.131052+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:09:53.131052+0000","last_undegraded":"2024-09-14T12:09:53.131052+0000","last_fullsized":"2024-09-14T12:09:53.131052+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.017356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.673401+0000","last_change":"2024-09-14T11:28:33.228030+0000","last_active":"2024-09-14T12:07:35.673401+0000","last_peered":"2024-09-14T12:07:35.673401+0000","last_clean":"2024-09-14T12:07:35.673401+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:07:35.673401+0000","last_undegraded":"2024-09-14T12:07:35.673401+0000","last_fullsized":"2024-09-14T12:07:35.673401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:06.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577681+0000","last_change":"2024-09-14T11:25:27.950183+0000","last_active":"2024-09-14T12:06:49.577681+0000","last_peered":"2024-09-14T12:06:49.577681+0000","last_clean":"2024-09-14T12:06:49.577681+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:06:49.577681+0000","last_undegraded":"2024-09-14T12:06:49.577681+0000","last_fullsized":"2024-09-14T12:06:49.577681+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:47.768324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578564+0000","last_change":"2024-09-14T11:44:25.351682+0000","last_active":"2024-09-14T12:06:54.578564+0000","last_peered":"2024-09-14T12:06:54.578564+0000","last_clean":"2024-09-14T12:06:54.578564+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:06:54.578564+0000","last_undegraded":"2024-09-14T12:06:54.578564+0000","last_fullsized":"2024-09-14T12:06:54.578564+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:33.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.668722+0000","last_change":"2024-09-14T11:28:36.252721+0000","last_active":"2024-09-14T12:06:50.668722+0000","last_peered":"2024-09-14T12:06:50.668722+0000","last_clean":"2024-09-14T12:06:50.668722+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:06:50.668722+0000","last_undegraded":"2024-09-14T12:06:50.668722+0000","last_fullsized":"2024-09-14T12:06:50.668722+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:40.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":17937,"num_write":7,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557747+0000","last_change":"2024-09-14T11:28:33.228385+0000","last_active":"2024-09-14T12:05:35.557747+0000","last_peered":"2024-09-14T12:05:35.557747+0000","last_clean":"2024-09-14T12:05:35.557747+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:05:35.557747+0000","last_undegraded":"2024-09-14T12:05:35.557747+0000","last_fullsized":"2024-09-14T12:05:35.557747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:36.884948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.677912+0000","last_change":"2024-09-14T11:25:27.951396+0000","last_active":"2024-09-14T12:06:39.677912+0000","last_peered":"2024-09-14T12:06:39.677912+0000","last_clean":"2024-09-14T12:06:39.677912+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:06:39.677912+0000","last_undegraded":"2024-09-14T12:06:39.677912+0000","last_fullsized":"2024-09-14T12:06:39.677912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.372583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:55.567242+0000","last_change":"2024-09-14T11:44:25.356594+0000","last_active":"2024-09-14T12:06:55.567242+0000","last_peered":"2024-09-14T12:06:55.567242+0000","last_clean":"2024-09-14T12:06:55.567242+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:06:55.567242+0000","last_undegraded":"2024-09-14T12:06:55.567242+0000","last_fullsized":"2024-09-14T12:06:55.567242+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.437539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585586+0000","last_change":"2024-09-14T11:29:33.340403+0000","last_active":"2024-09-14T12:07:44.585586+0000","last_peered":"2024-09-14T12:07:44.585586+0000","last_clean":"2024-09-14T12:07:44.585586+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:07:44.585586+0000","last_undegraded":"2024-09-14T12:07:44.585586+0000","last_fullsized":"2024-09-14T12:07:44.585586+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:46.256090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577175+0000","last_change":"2024-09-14T11:28:33.230335+0000","last_active":"2024-09-14T12:06:49.577175+0000","last_peered":"2024-09-14T12:06:49.577175+0000","last_clean":"2024-09-14T12:06:49.577175+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:06:49.577175+0000","last_undegraded":"2024-09-14T12:06:49.577175+0000","last_fullsized":"2024-09-14T12:06:49.577175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:57.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582421+0000","last_change":"2024-09-14T11:25:27.949670+0000","last_active":"2024-09-14T12:06:40.582421+0000","last_peered":"2024-09-14T12:06:40.582421+0000","last_clean":"2024-09-14T12:06:40.582421+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:06:40.582421+0000","last_undegraded":"2024-09-14T12:06:40.582421+0000","last_fullsized":"2024-09-14T12:06:40.582421+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:26.893035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581926+0000","last_change":"2024-09-14T11:44:25.351860+0000","last_active":"2024-09-14T12:07:19.581926+0000","last_peered":"2024-09-14T12:07:19.581926+0000","last_clean":"2024-09-14T12:07:19.581926+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:07:19.581926+0000","last_undegraded":"2024-09-14T12:07:19.581926+0000","last_fullsized":"2024-09-14T12:07:19.581926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:01.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:15.562475+0000","last_change":"2024-09-14T11:28:36.252024+0000","last_active":"2024-09-14T12:06:15.562475+0000","last_peered":"2024-09-14T12:06:15.562475+0000","last_clean":"2024-09-14T12:06:15.562475+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:06:15.562475+0000","last_undegraded":"2024-09-14T12:06:15.562475+0000","last_fullsized":"2024-09-14T12:06:15.562475+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:46.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.405443+0000","last_change":"2024-09-14T11:28:33.229236+0000","last_active":"2024-09-14T12:09:53.405443+0000","last_peered":"2024-09-14T12:09:53.405443+0000","last_clean":"2024-09-14T12:09:53.405443+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:09:53.405443+0000","last_undegraded":"2024-09-14T12:09:53.405443+0000","last_fullsized":"2024-09-14T12:09:53.405443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:46.128928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565430+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:06:40.565430+0000","last_peered":"2024-09-14T12:06:40.565430+0000","last_clean":"2024-09-14T12:06:40.565430+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:06:40.565430+0000","last_undegraded":"2024-09-14T12:06:40.565430+0000","last_fullsized":"2024-09-14T12:06:40.565430+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:53.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717994+0000","last_change":"2024-09-14T11:44:25.350439+0000","last_active":"2024-09-14T12:07:19.717994+0000","last_peered":"2024-09-14T12:07:19.717994+0000","last_clean":"2024-09-14T12:07:19.717994+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:07:19.717994+0000","last_undegraded":"2024-09-14T12:07:19.717994+0000","last_fullsized":"2024-09-14T12:07:19.717994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:24.626683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561173+0000","last_change":"2024-09-14T11:28:36.365847+0000","last_active":"2024-09-14T12:06:05.561173+0000","last_peered":"2024-09-14T12:06:05.561173+0000","last_clean":"2024-09-14T12:06:05.561173+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:06:05.561173+0000","last_undegraded":"2024-09-14T12:06:05.561173+0000","last_fullsized":"2024-09-14T12:06:05.561173+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:26.254693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.661792+0000","last_change":"2024-09-14T11:28:33.228362+0000","last_active":"2024-09-14T12:08:14.661792+0000","last_peered":"2024-09-14T12:08:14.661792+0000","last_clean":"2024-09-14T12:08:14.661792+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:08:14.661792+0000","last_undegraded":"2024-09-14T12:08:14.661792+0000","last_fullsized":"2024-09-14T12:08:14.661792+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:47.879475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582495+0000","last_change":"2024-09-14T11:25:27.948331+0000","last_active":"2024-09-14T12:06:40.582495+0000","last_peered":"2024-09-14T12:06:40.582495+0000","last_clean":"2024-09-14T12:06:40.582495+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:06:40.582495+0000","last_undegraded":"2024-09-14T12:06:40.582495+0000","last_fullsized":"2024-09-14T12:06:40.582495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:11.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:30.666552+0000","last_change":"2024-09-14T11:44:25.351133+0000","last_active":"2024-09-14T12:06:30.666552+0000","last_peered":"2024-09-14T12:06:30.666552+0000","last_clean":"2024-09-14T12:06:30.666552+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:06:30.666552+0000","last_undegraded":"2024-09-14T12:06:30.666552+0000","last_fullsized":"2024-09-14T12:06:30.666552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:44.289131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584940+0000","last_change":"2024-09-14T11:28:36.367086+0000","last_active":"2024-09-14T12:07:39.584940+0000","last_peered":"2024-09-14T12:07:39.584940+0000","last_clean":"2024-09-14T12:07:39.584940+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:07:39.584940+0000","last_undegraded":"2024-09-14T12:07:39.584940+0000","last_fullsized":"2024-09-14T12:07:39.584940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.893706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.720510+0000","last_change":"2024-09-14T11:28:33.231027+0000","last_active":"2024-09-14T12:07:34.720510+0000","last_peered":"2024-09-14T12:07:34.720510+0000","last_clean":"2024-09-14T12:07:34.720510+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:07:34.720510+0000","last_undegraded":"2024-09-14T12:07:34.720510+0000","last_fullsized":"2024-09-14T12:07:34.720510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.425071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582020+0000","last_change":"2024-09-14T11:25:27.948199+0000","last_active":"2024-09-14T12:07:19.582020+0000","last_peered":"2024-09-14T12:07:19.582020+0000","last_clean":"2024-09-14T12:07:19.582020+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:07:19.582020+0000","last_undegraded":"2024-09-14T12:07:19.582020+0000","last_fullsized":"2024-09-14T12:07:19.582020+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:39.351483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581534+0000","last_change":"2024-09-14T11:44:25.354049+0000","last_active":"2024-09-14T12:07:19.581534+0000","last_peered":"2024-09-14T12:07:19.581534+0000","last_clean":"2024-09-14T12:07:19.581534+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:07:19.581534+0000","last_undegraded":"2024-09-14T12:07:19.581534+0000","last_fullsized":"2024-09-14T12:07:19.581534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:06.436515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584665+0000","last_change":"2024-09-14T11:28:36.260053+0000","last_active":"2024-09-14T12:07:39.584665+0000","last_peered":"2024-09-14T12:07:39.584665+0000","last_clean":"2024-09-14T12:07:39.584665+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:07:39.584665+0000","last_undegraded":"2024-09-14T12:07:39.584665+0000","last_fullsized":"2024-09-14T12:07:39.584665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.584214+0000","last_change":"2024-09-14T11:28:33.233002+0000","last_active":"2024-09-14T12:07:34.584214+0000","last_peered":"2024-09-14T12:07:34.584214+0000","last_clean":"2024-09-14T12:07:34.584214+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:07:34.584214+0000","last_undegraded":"2024-09-14T12:07:34.584214+0000","last_fullsized":"2024-09-14T12:07:34.584214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:57.509567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670809+0000","last_change":"2024-09-14T11:25:27.948445+0000","last_active":"2024-09-14T12:07:10.670809+0000","last_peered":"2024-09-14T12:07:10.670809+0000","last_clean":"2024-09-14T12:07:10.670809+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:07:10.670809+0000","last_undegraded":"2024-09-14T12:07:10.670809+0000","last_fullsized":"2024-09-14T12:07:10.670809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646115+0000","last_change":"2024-09-14T11:44:25.348388+0000","last_active":"2024-09-14T12:06:04.646115+0000","last_peered":"2024-09-14T12:06:04.646115+0000","last_clean":"2024-09-14T12:06:04.646115+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:06:04.646115+0000","last_undegraded":"2024-09-14T12:06:04.646115+0000","last_fullsized":"2024-09-14T12:06:04.646115+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:30.181019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663894+0000","last_change":"2024-09-14T11:28:36.257342+0000","last_active":"2024-09-14T12:06:05.663894+0000","last_peered":"2024-09-14T12:06:05.663894+0000","last_clean":"2024-09-14T12:06:05.663894+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:06:05.663894+0000","last_undegraded":"2024-09-14T12:06:05.663894+0000","last_fullsized":"2024-09-14T12:06:05.663894+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:31.845998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576072+0000","last_change":"2024-09-14T11:28:33.228459+0000","last_active":"2024-09-14T12:06:39.576072+0000","last_peered":"2024-09-14T12:06:39.576072+0000","last_clean":"2024-09-14T12:06:39.576072+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:06:39.576072+0000","last_undegraded":"2024-09-14T12:06:39.576072+0000","last_fullsized":"2024-09-14T12:06:39.576072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:32.489364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716392+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:07:09.716392+0000","last_peered":"2024-09-14T12:07:09.716392+0000","last_clean":"2024-09-14T12:07:09.716392+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:07:09.716392+0000","last_undegraded":"2024-09-14T12:07:09.716392+0000","last_fullsized":"2024-09-14T12:07:09.716392+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:20.912923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561205+0000","last_change":"2024-09-14T11:44:25.353177+0000","last_active":"2024-09-14T12:06:05.561205+0000","last_peered":"2024-09-14T12:06:05.561205+0000","last_clean":"2024-09-14T12:06:05.561205+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:06:05.561205+0000","last_undegraded":"2024-09-14T12:06:05.561205+0000","last_fullsized":"2024-09-14T12:06:05.561205+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:44.730416+0000","last_change":"2024-09-14T11:28:36.256678+0000","last_active":"2024-09-14T12:08:44.730416+0000","last_peered":"2024-09-14T12:08:44.730416+0000","last_clean":"2024-09-14T12:08:44.730416+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:08:44.730416+0000","last_undegraded":"2024-09-14T12:08:44.730416+0000","last_fullsized":"2024-09-14T12:08:44.730416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:25.852294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589335+0000","last_change":"2024-09-14T11:28:33.232601+0000","last_active":"2024-09-14T12:08:09.589335+0000","last_peered":"2024-09-14T12:08:09.589335+0000","last_clean":"2024-09-14T12:08:09.589335+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:08:09.589335+0000","last_undegraded":"2024-09-14T12:08:09.589335+0000","last_fullsized":"2024-09-14T12:08:09.589335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:05.331738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.579944+0000","last_change":"2024-09-14T11:25:27.949489+0000","last_active":"2024-09-14T12:07:09.579944+0000","last_peered":"2024-09-14T12:07:09.579944+0000","last_clean":"2024-09-14T12:07:09.579944+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:07:09.579944+0000","last_undegraded":"2024-09-14T12:07:09.579944+0000","last_fullsized":"2024-09-14T12:07:09.579944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:23.544881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570267+0000","last_change":"2024-09-14T11:44:25.353056+0000","last_active":"2024-09-14T12:07:20.570267+0000","last_peered":"2024-09-14T12:07:20.570267+0000","last_clean":"2024-09-14T12:07:20.570267+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:07:20.570267+0000","last_undegraded":"2024-09-14T12:07:20.570267+0000","last_fullsized":"2024-09-14T12:07:20.570267+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:07.137155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'7","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577542+0000","last_change":"2024-09-14T11:28:36.259431+0000","last_active":"2024-09-14T12:06:05.577542+0000","last_peered":"2024-09-14T12:06:05.577542+0000","last_clean":"2024-09-14T12:06:05.577542+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:06:05.577542+0000","last_undegraded":"2024-09-14T12:06:05.577542+0000","last_fullsized":"2024-09-14T12:06:05.577542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:17.716269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'7","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663916+0000","last_change":"2024-09-14T11:28:33.227906+0000","last_active":"2024-09-14T12:06:05.663916+0000","last_peered":"2024-09-14T12:06:05.663916+0000","last_clean":"2024-09-14T12:06:05.663916+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:06:05.663916+0000","last_undegraded":"2024-09-14T12:06:05.663916+0000","last_fullsized":"2024-09-14T12:06:05.663916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.498353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586665+0000","last_change":"2024-09-14T11:25:27.946605+0000","last_active":"2024-09-14T12:07:10.586665+0000","last_peered":"2024-09-14T12:07:10.586665+0000","last_clean":"2024-09-14T12:07:10.586665+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:07:10.586665+0000","last_undegraded":"2024-09-14T12:07:10.586665+0000","last_fullsized":"2024-09-14T12:07:10.586665+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.771354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582789+0000","last_change":"2024-09-14T11:44:25.355567+0000","last_active":"2024-09-14T12:07:24.582789+0000","last_peered":"2024-09-14T12:07:24.582789+0000","last_clean":"2024-09-14T12:07:24.582789+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:07:24.582789+0000","last_undegraded":"2024-09-14T12:07:24.582789+0000","last_fullsized":"2024-09-14T12:07:24.582789+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:15.391313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.589963+0000","last_change":"2024-09-14T11:28:36.260711+0000","last_active":"2024-09-14T12:08:14.589963+0000","last_peered":"2024-09-14T12:08:14.589963+0000","last_clean":"2024-09-14T12:08:14.589963+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:08:14.589963+0000","last_undegraded":"2024-09-14T12:08:14.589963+0000","last_fullsized":"2024-09-14T12:08:14.589963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:01.074793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577559+0000","last_change":"2024-09-14T11:28:33.228247+0000","last_active":"2024-09-14T12:06:05.577559+0000","last_peered":"2024-09-14T12:06:05.577559+0000","last_clean":"2024-09-14T12:06:05.577559+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:06:05.577559+0000","last_undegraded":"2024-09-14T12:06:05.577559+0000","last_fullsized":"2024-09-14T12:06:05.577559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:40.279213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584808+0000","last_change":"2024-09-14T11:25:27.949061+0000","last_active":"2024-09-14T12:07:39.584808+0000","last_peered":"2024-09-14T12:07:39.584808+0000","last_clean":"2024-09-14T12:07:39.584808+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:07:39.584808+0000","last_undegraded":"2024-09-14T12:07:39.584808+0000","last_fullsized":"2024-09-14T12:07:39.584808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'363","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596319+0000","last_change":"2024-09-14T11:10:56.613934+0000","last_active":"2024-09-14T12:09:54.596319+0000","last_peered":"2024-09-14T12:09:54.596319+0000","last_clean":"2024-09-14T12:09:54.596319+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:09:54.596319+0000","last_undegraded":"2024-09-14T12:09:54.596319+0000","last_fullsized":"2024-09-14T12:09:54.596319+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.319510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":753,"num_read_kb":12872,"num_write":1132,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706012+0000","last_change":"2024-09-14T11:10:58.598689+0000","last_active":"2024-09-14T12:05:59.706012+0000","last_peered":"2024-09-14T12:05:59.706012+0000","last_clean":"2024-09-14T12:05:59.706012+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:05:59.706012+0000","last_undegraded":"2024-09-14T12:05:59.706012+0000","last_fullsized":"2024-09-14T12:05:59.706012+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:53.624721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'281","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671392+0000","last_change":"2024-09-14T11:10:56.605326+0000","last_active":"2024-09-14T12:07:15.671392+0000","last_peered":"2024-09-14T12:07:15.671392+0000","last_clean":"2024-09-14T12:07:15.671392+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:07:15.671392+0000","last_undegraded":"2024-09-14T12:07:15.671392+0000","last_fullsized":"2024-09-14T12:07:15.671392+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:33.763107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6326560,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":616,"num_read_kb":30246,"num_write":1115,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.570100+0000","last_change":"2024-09-14T11:10:58.608424+0000","last_active":"2024-09-14T12:06:59.570100+0000","last_peered":"2024-09-14T12:06:59.570100+0000","last_clean":"2024-09-14T12:06:59.570100+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:06:59.570100+0000","last_undegraded":"2024-09-14T12:06:59.570100+0000","last_fullsized":"2024-09-14T12:06:59.570100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:41.148772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'283","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.759312+0000","last_change":"2024-09-14T11:10:56.604528+0000","last_active":"2024-09-14T12:07:18.759312+0000","last_peered":"2024-09-14T12:07:18.759312+0000","last_clean":"2024-09-14T12:07:18.759312+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:07:18.759312+0000","last_undegraded":"2024-09-14T12:07:18.759312+0000","last_fullsized":"2024-09-14T12:07:18.759312+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:47.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6346234,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":524,"num_read_kb":3312,"num_write":1120,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570086+0000","last_change":"2024-09-14T11:10:58.615535+0000","last_active":"2024-09-14T12:05:59.570086+0000","last_peered":"2024-09-14T12:05:59.570086+0000","last_clean":"2024-09-14T12:05:59.570086+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:05:59.570086+0000","last_undegraded":"2024-09-14T12:05:59.570086+0000","last_fullsized":"2024-09-14T12:05:59.570086+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:23.713342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'368","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.641825+0000","last_change":"2024-09-14T11:10:56.622380+0000","last_active":"2024-09-14T12:09:54.641825+0000","last_peered":"2024-09-14T12:09:54.641825+0000","last_clean":"2024-09-14T12:09:54.641825+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:09:54.641825+0000","last_undegraded":"2024-09-14T12:09:54.641825+0000","last_fullsized":"2024-09-14T12:09:54.641825+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.100508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":685,"num_read_kb":5058,"num_write":1124,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.372308+0000","last_change":"2024-09-14T11:10:58.615687+0000","last_active":"2024-09-14T12:07:57.372308+0000","last_peered":"2024-09-14T12:07:57.372308+0000","last_clean":"2024-09-14T12:07:57.372308+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:07:57.372308+0000","last_undegraded":"2024-09-14T12:07:57.372308+0000","last_fullsized":"2024-09-14T12:07:57.372308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:15.535728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'329","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.518399+0000","last_change":"2024-09-14T11:10:56.606180+0000","last_active":"2024-09-14T12:09:54.518399+0000","last_peered":"2024-09-14T12:09:54.518399+0000","last_clean":"2024-09-14T12:09:54.518399+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:09:54.518399+0000","last_undegraded":"2024-09-14T12:09:54.518399+0000","last_fullsized":"2024-09-14T12:09:54.518399+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:57.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1084079,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":17822,"num_write":997,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'252","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586768+0000","last_change":"2024-09-14T11:10:58.607840+0000","last_active":"2024-09-14T12:07:10.586768+0000","last_peered":"2024-09-14T12:07:10.586768+0000","last_clean":"2024-09-14T12:07:10.586768+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:07:10.586768+0000","last_undegraded":"2024-09-14T12:07:10.586768+0000","last_fullsized":"2024-09-14T12:07:10.586768+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:18.282965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.620476+0000","last_change":"2024-09-14T11:10:56.622630+0000","last_active":"2024-09-14T12:09:54.620476+0000","last_peered":"2024-09-14T12:09:54.620476+0000","last_clean":"2024-09-14T12:09:54.620476+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:09:54.620476+0000","last_undegraded":"2024-09-14T12:09:54.620476+0000","last_fullsized":"2024-09-14T12:09:54.620476+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:13.408043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580767+0000","last_change":"2024-09-14T11:10:58.604181+0000","last_active":"2024-09-14T12:07:14.580767+0000","last_peered":"2024-09-14T12:07:14.580767+0000","last_clean":"2024-09-14T12:07:14.580767+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:07:14.580767+0000","last_undegraded":"2024-09-14T12:07:14.580767+0000","last_fullsized":"2024-09-14T12:07:14.580767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:47.312582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'342","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.517809+0000","last_change":"2024-09-14T11:11:32.791169+0000","last_active":"2024-09-14T12:09:54.517809+0000","last_peered":"2024-09-14T12:09:54.517809+0000","last_clean":"2024-09-14T12:09:54.517809+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:09:54.517809+0000","last_undegraded":"2024-09-14T12:09:54.517809+0000","last_fullsized":"2024-09-14T12:09:54.517809+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:51.316430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333000,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":619,"num_read_kb":84521,"num_write":1147,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.717225+0000","last_change":"2024-09-14T11:10:58.601531+0000","last_active":"2024-09-14T12:07:14.717225+0000","last_peered":"2024-09-14T12:07:14.717225+0000","last_clean":"2024-09-14T12:07:14.717225+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:07:14.717225+0000","last_undegraded":"2024-09-14T12:07:14.717225+0000","last_fullsized":"2024-09-14T12:07:14.717225+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.466412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.676169+0000","last_change":"2024-09-14T11:10:56.614815+0000","last_active":"2024-09-14T12:09:54.676169+0000","last_peered":"2024-09-14T12:09:54.676169+0000","last_clean":"2024-09-14T12:09:54.676169+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:09:54.676169+0000","last_undegraded":"2024-09-14T12:09:54.676169+0000","last_fullsized":"2024-09-14T12:09:54.676169+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:17.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653214+0000","last_change":"2024-09-14T11:10:58.612690+0000","last_active":"2024-09-14T12:07:14.653214+0000","last_peered":"2024-09-14T12:07:14.653214+0000","last_clean":"2024-09-14T12:07:14.653214+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:07:14.653214+0000","last_undegraded":"2024-09-14T12:07:14.653214+0000","last_fullsized":"2024-09-14T12:07:14.653214+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:43.860956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578450+0000","last_change":"2024-09-14T11:10:58.613992+0000","last_active":"2024-09-14T12:06:59.578450+0000","last_peered":"2024-09-14T12:06:59.578450+0000","last_clean":"2024-09-14T12:06:59.578450+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:06:59.578450+0000","last_undegraded":"2024-09-14T12:06:59.578450+0000","last_fullsized":"2024-09-14T12:06:59.578450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:16.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'371","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.537432+0000","last_change":"2024-09-14T11:10:56.611500+0000","last_active":"2024-09-14T12:09:54.537432+0000","last_peered":"2024-09-14T12:09:54.537432+0000","last_clean":"2024-09-14T12:09:54.537432+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:09:54.537432+0000","last_undegraded":"2024-09-14T12:09:54.537432+0000","last_fullsized":"2024-09-14T12:09:54.537432+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:25.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2484528,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":664,"num_read_kb":4801,"num_write":1278,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579198+0000","last_change":"2024-09-14T11:10:58.608218+0000","last_active":"2024-09-14T12:06:59.579198+0000","last_peered":"2024-09-14T12:06:59.579198+0000","last_clean":"2024-09-14T12:06:59.579198+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:06:59.579198+0000","last_undegraded":"2024-09-14T12:06:59.579198+0000","last_fullsized":"2024-09-14T12:06:59.579198+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:48.756943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'258","reported_seq":879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.581808+0000","last_change":"2024-09-14T11:10:56.610804+0000","last_active":"2024-09-14T12:06:35.581808+0000","last_peered":"2024-09-14T12:06:35.581808+0000","last_clean":"2024-09-14T12:06:35.581808+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:06:35.581808+0000","last_undegraded":"2024-09-14T12:06:35.581808+0000","last_fullsized":"2024-09-14T12:06:35.581808+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:54.575624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107799,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":512,"num_read_kb":2774,"num_write":942,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716372+0000","last_change":"2024-09-14T11:10:58.603033+0000","last_active":"2024-09-14T12:07:09.716372+0000","last_peered":"2024-09-14T12:07:09.716372+0000","last_clean":"2024-09-14T12:07:09.716372+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:07:09.716372+0000","last_undegraded":"2024-09-14T12:07:09.716372+0000","last_fullsized":"2024-09-14T12:07:09.716372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:05.684294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'278","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.581781+0000","last_change":"2024-09-14T11:10:56.617586+0000","last_active":"2024-09-14T12:06:35.581781+0000","last_peered":"2024-09-14T12:06:35.581781+0000","last_clean":"2024-09-14T12:06:35.581781+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:06:35.581781+0000","last_undegraded":"2024-09-14T12:06:35.581781+0000","last_fullsized":"2024-09-14T12:06:35.581781+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:28.064756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22098512,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":675,"num_read_kb":52006,"num_write":1052,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:17.637379+0000","last_change":"2024-09-14T11:10:58.612342+0000","last_active":"2024-09-14T12:07:17.637379+0000","last_peered":"2024-09-14T12:07:17.637379+0000","last_clean":"2024-09-14T12:07:17.637379+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:07:17.637379+0000","last_undegraded":"2024-09-14T12:07:17.637379+0000","last_fullsized":"2024-09-14T12:07:17.637379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:26.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'368","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.586478+0000","last_change":"2024-09-14T11:10:56.622021+0000","last_active":"2024-09-14T12:09:54.586478+0000","last_peered":"2024-09-14T12:09:54.586478+0000","last_clean":"2024-09-14T12:09:54.586478+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:09:54.586478+0000","last_undegraded":"2024-09-14T12:09:54.586478+0000","last_fullsized":"2024-09-14T12:09:54.586478+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.040554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1059,"num_read_kb":40711,"num_write":1146,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649064+0000","last_change":"2024-09-14T11:10:58.606489+0000","last_active":"2024-09-14T12:06:34.649064+0000","last_peered":"2024-09-14T12:06:34.649064+0000","last_clean":"2024-09-14T12:06:34.649064+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:06:34.649064+0000","last_undegraded":"2024-09-14T12:06:34.649064+0000","last_fullsized":"2024-09-14T12:06:34.649064+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.112863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'335","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656611+0000","last_change":"2024-09-14T11:10:56.618036+0000","last_active":"2024-09-14T12:09:54.656611+0000","last_peered":"2024-09-14T12:09:54.656611+0000","last_clean":"2024-09-14T12:09:54.656611+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:09:54.656611+0000","last_undegraded":"2024-09-14T12:09:54.656611+0000","last_fullsized":"2024-09-14T12:09:54.656611+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.228155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254545,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":601,"num_read_kb":58308,"num_write":1136,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.575165+0000","last_change":"2024-09-14T11:10:58.599593+0000","last_active":"2024-09-14T12:06:34.575165+0000","last_peered":"2024-09-14T12:06:34.575165+0000","last_clean":"2024-09-14T12:06:34.575165+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:06:34.575165+0000","last_undegraded":"2024-09-14T12:06:34.575165+0000","last_fullsized":"2024-09-14T12:06:34.575165+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.706476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'339","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569624+0000","last_change":"2024-09-14T11:10:56.624205+0000","last_active":"2024-09-14T12:07:15.569624+0000","last_peered":"2024-09-14T12:07:15.569624+0000","last_clean":"2024-09-14T12:07:15.569624+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:07:15.569624+0000","last_undegraded":"2024-09-14T12:07:15.569624+0000","last_fullsized":"2024-09-14T12:07:15.569624+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:53.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8012533,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":558,"num_read_kb":94295,"num_write":1082,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'189","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.512796+0000","last_change":"2024-09-14T11:11:06.654536+0000","last_active":"2024-09-14T12:07:57.512796+0000","last_peered":"2024-09-14T12:07:57.512796+0000","last_clean":"2024-09-14T12:07:57.512796+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:07:57.512796+0000","last_undegraded":"2024-09-14T12:07:57.512796+0000","last_fullsized":"2024-09-14T12:07:57.512796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:45.779160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'122","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:51.635212+0000","last_change":"2024-09-14T11:11:32.678345+0000","last_active":"2024-09-14T12:06:51.635212+0000","last_peered":"2024-09-14T12:06:51.635212+0000","last_clean":"2024-09-14T12:06:51.635212+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:06:51.635212+0000","last_undegraded":"2024-09-14T12:06:51.635212+0000","last_fullsized":"2024-09-14T12:06:51.635212+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:14.964766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'484","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562045+0000","last_change":"2024-09-14T11:10:56.614109+0000","last_active":"2024-09-14T12:09:54.562045+0000","last_peered":"2024-09-14T12:09:54.562045+0000","last_clean":"2024-09-14T12:09:54.562045+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:09:54.562045+0000","last_undegraded":"2024-09-14T12:09:54.562045+0000","last_fullsized":"2024-09-14T12:09:54.562045+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079997,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":947,"num_read_kb":68364,"num_write":1399,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711914+0000","last_change":"2024-09-14T11:11:00.612390+0000","last_active":"2024-09-14T12:06:39.711914+0000","last_peered":"2024-09-14T12:06:39.711914+0000","last_clean":"2024-09-14T12:06:39.711914+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:06:39.711914+0000","last_undegraded":"2024-09-14T12:06:39.711914+0000","last_fullsized":"2024-09-14T12:06:39.711914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.711231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'316","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.583331+0000","last_change":"2024-09-14T11:11:02.616888+0000","last_active":"2024-09-14T12:09:05.583331+0000","last_peered":"2024-09-14T12:09:05.583331+0000","last_clean":"2024-09-14T12:09:05.583331+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:09:05.583331+0000","last_undegraded":"2024-09-14T12:09:05.583331+0000","last_fullsized":"2024-09-14T12:09:05.583331+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:38.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48050,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":925,"num_write":390,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576286+0000","last_change":"2024-09-14T11:11:04.630024+0000","last_active":"2024-09-14T12:06:39.576286+0000","last_peered":"2024-09-14T12:06:39.576286+0000","last_clean":"2024-09-14T12:06:39.576286+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:06:39.576286+0000","last_undegraded":"2024-09-14T12:06:39.576286+0000","last_fullsized":"2024-09-14T12:06:39.576286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.568217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.875581+0000","last_change":"2024-09-14T11:11:06.647460+0000","last_active":"2024-09-14T12:09:13.875581+0000","last_peered":"2024-09-14T12:09:13.875581+0000","last_clean":"2024-09-14T12:09:13.875581+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:09:13.875581+0000","last_undegraded":"2024-09-14T12:09:13.875581+0000","last_fullsized":"2024-09-14T12:09:13.875581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:13.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.840018+0000","last_change":"2024-09-14T11:10:58.598908+0000","last_active":"2024-09-14T12:06:34.840018+0000","last_peered":"2024-09-14T12:06:34.840018+0000","last_clean":"2024-09-14T12:06:34.840018+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:06:34.840018+0000","last_undegraded":"2024-09-14T12:06:34.840018+0000","last_fullsized":"2024-09-14T12:06:34.840018+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:45.457809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'238","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567753+0000","last_change":"2024-09-14T11:10:56.623842+0000","last_active":"2024-09-14T12:07:00.567753+0000","last_peered":"2024-09-14T12:07:00.567753+0000","last_clean":"2024-09-14T12:07:00.567753+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:07:00.567753+0000","last_undegraded":"2024-09-14T12:07:00.567753+0000","last_fullsized":"2024-09-14T12:07:00.567753+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:59.906680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487303,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":778,"num_read_kb":44655,"num_write":954,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681915+0000","last_change":"2024-09-14T11:11:00.610829+0000","last_active":"2024-09-14T12:07:14.681915+0000","last_peered":"2024-09-14T12:07:14.681915+0000","last_clean":"2024-09-14T12:07:14.681915+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:07:14.681915+0000","last_undegraded":"2024-09-14T12:07:14.681915+0000","last_fullsized":"2024-09-14T12:07:14.681915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:59.756124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.887529+0000","last_change":"2024-09-14T11:11:02.616223+0000","last_active":"2024-09-14T12:07:04.887529+0000","last_peered":"2024-09-14T12:07:04.887529+0000","last_clean":"2024-09-14T12:07:04.887529+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:07:04.887529+0000","last_undegraded":"2024-09-14T12:07:04.887529+0000","last_fullsized":"2024-09-14T12:07:04.887529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.797468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575949+0000","last_change":"2024-09-14T11:11:04.636341+0000","last_active":"2024-09-14T12:06:39.575949+0000","last_peered":"2024-09-14T12:06:39.575949+0000","last_clean":"2024-09-14T12:06:39.575949+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:06:39.575949+0000","last_undegraded":"2024-09-14T12:06:39.575949+0000","last_fullsized":"2024-09-14T12:06:39.575949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:29.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'146","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561795+0000","last_change":"2024-09-14T11:11:06.647305+0000","last_active":"2024-09-14T12:06:10.561795+0000","last_peered":"2024-09-14T12:06:10.561795+0000","last_clean":"2024-09-14T12:06:10.561795+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:06:10.561795+0000","last_undegraded":"2024-09-14T12:06:10.561795+0000","last_fullsized":"2024-09-14T12:06:10.561795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:31.457028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564820+0000","last_change":"2024-09-14T11:10:58.615755+0000","last_active":"2024-09-14T12:06:35.564820+0000","last_peered":"2024-09-14T12:06:35.564820+0000","last_clean":"2024-09-14T12:06:35.564820+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:06:35.564820+0000","last_undegraded":"2024-09-14T12:06:35.564820+0000","last_fullsized":"2024-09-14T12:06:35.564820+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:50.889127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'397","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.573491+0000","last_change":"2024-09-14T11:10:56.614555+0000","last_active":"2024-09-14T12:09:54.573491+0000","last_peered":"2024-09-14T12:09:54.573491+0000","last_clean":"2024-09-14T12:09:54.573491+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:09:54.573491+0000","last_undegraded":"2024-09-14T12:09:54.573491+0000","last_fullsized":"2024-09-14T12:09:54.573491+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:18.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404659,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":624,"num_read_kb":37554,"num_write":1175,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.678008+0000","last_change":"2024-09-14T11:11:00.613697+0000","last_active":"2024-09-14T12:06:39.678008+0000","last_peered":"2024-09-14T12:06:39.678008+0000","last_clean":"2024-09-14T12:06:39.678008+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:06:39.678008+0000","last_undegraded":"2024-09-14T12:06:39.678008+0000","last_fullsized":"2024-09-14T12:06:39.678008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:02.212530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'117","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.652713+0000","last_change":"2024-09-14T11:11:02.616784+0000","last_active":"2024-09-14T12:07:09.652713+0000","last_peered":"2024-09-14T12:07:09.652713+0000","last_clean":"2024-09-14T12:07:09.652713+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:07:09.652713+0000","last_undegraded":"2024-09-14T12:07:09.652713+0000","last_fullsized":"2024-09-14T12:07:09.652713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:51.199047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'769","reported_seq":2412,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.530183+0000","last_change":"2024-09-14T11:11:04.634733+0000","last_active":"2024-09-14T12:09:52.530183+0000","last_peered":"2024-09-14T12:09:52.530183+0000","last_clean":"2024-09-14T12:09:52.530183+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:09:52.530183+0000","last_undegraded":"2024-09-14T12:09:52.530183+0000","last_fullsized":"2024-09-14T12:09:52.530183+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.929041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'217","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.572311+0000","last_change":"2024-09-14T11:11:06.650554+0000","last_active":"2024-09-14T12:07:57.572311+0000","last_peered":"2024-09-14T12:07:57.572311+0000","last_clean":"2024-09-14T12:07:57.572311+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:07:57.572311+0000","last_undegraded":"2024-09-14T12:07:57.572311+0000","last_fullsized":"2024-09-14T12:07:57.572311+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:31.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.883384+0000","last_change":"2024-09-14T11:10:58.602798+0000","last_active":"2024-09-14T12:07:04.883384+0000","last_peered":"2024-09-14T12:07:04.883384+0000","last_clean":"2024-09-14T12:07:04.883384+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:07:04.883384+0000","last_undegraded":"2024-09-14T12:07:04.883384+0000","last_fullsized":"2024-09-14T12:07:04.883384+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.362755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'350","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:01.028557+0000","last_change":"2024-09-14T11:10:56.612227+0000","last_active":"2024-09-14T12:07:01.028557+0000","last_peered":"2024-09-14T12:07:01.028557+0000","last_clean":"2024-09-14T12:07:01.028557+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:07:01.028557+0000","last_undegraded":"2024-09-14T12:07:01.028557+0000","last_fullsized":"2024-09-14T12:07:01.028557+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:54.163614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320165,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":932,"num_read_kb":6071,"num_write":1196,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711951+0000","last_change":"2024-09-14T11:11:00.611895+0000","last_active":"2024-09-14T12:06:39.711951+0000","last_peered":"2024-09-14T12:06:39.711951+0000","last_clean":"2024-09-14T12:06:39.711951+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:06:39.711951+0000","last_undegraded":"2024-09-14T12:06:39.711951+0000","last_fullsized":"2024-09-14T12:06:39.711951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:07.634034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.469446+0000","last_change":"2024-09-14T11:11:02.883054+0000","last_active":"2024-09-14T12:09:53.469446+0000","last_peered":"2024-09-14T12:09:53.469446+0000","last_clean":"2024-09-14T12:09:53.469446+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:09:53.469446+0000","last_undegraded":"2024-09-14T12:09:53.469446+0000","last_fullsized":"2024-09-14T12:09:53.469446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:16.798635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'791","reported_seq":2487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.146287+0000","last_change":"2024-09-14T11:11:04.639858+0000","last_active":"2024-09-14T12:09:54.146287+0000","last_peered":"2024-09-14T12:09:54.146287+0000","last_clean":"2024-09-14T12:09:54.146287+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:09:54.146287+0000","last_undegraded":"2024-09-14T12:09:54.146287+0000","last_fullsized":"2024-09-14T12:09:54.146287+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:13.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717940+0000","last_change":"2024-09-14T11:10:58.598011+0000","last_active":"2024-09-14T12:07:19.717940+0000","last_peered":"2024-09-14T12:07:19.717940+0000","last_clean":"2024-09-14T12:07:19.717940+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:07:19.717940+0000","last_undegraded":"2024-09-14T12:07:19.717940+0000","last_fullsized":"2024-09-14T12:07:19.717940+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:52.644545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'371","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.543142+0000","last_change":"2024-09-14T11:10:56.616170+0000","last_active":"2024-09-14T12:09:54.543142+0000","last_peered":"2024-09-14T12:09:54.543142+0000","last_clean":"2024-09-14T12:09:54.543142+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:09:54.543142+0000","last_undegraded":"2024-09-14T12:09:54.543142+0000","last_fullsized":"2024-09-14T12:09:54.543142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:36.161974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343370,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":30361,"num_write":1109,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582730+0000","last_change":"2024-09-14T11:11:00.603633+0000","last_active":"2024-09-14T12:07:24.582730+0000","last_peered":"2024-09-14T12:07:24.582730+0000","last_clean":"2024-09-14T12:07:24.582730+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:07:24.582730+0000","last_undegraded":"2024-09-14T12:07:24.582730+0000","last_fullsized":"2024-09-14T12:07:24.582730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:24.637144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'380","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.075411+0000","last_change":"2024-09-14T11:11:02.882354+0000","last_active":"2024-09-14T12:09:54.075411+0000","last_peered":"2024-09-14T12:09:54.075411+0000","last_clean":"2024-09-14T12:09:54.075411+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:09:54.075411+0000","last_undegraded":"2024-09-14T12:09:54.075411+0000","last_fullsized":"2024-09-14T12:09:54.075411+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:23.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671886+0000","last_change":"2024-09-14T11:11:04.630742+0000","last_active":"2024-09-14T12:07:20.671886+0000","last_peered":"2024-09-14T12:07:20.671886+0000","last_clean":"2024-09-14T12:07:20.671886+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:07:20.671886+0000","last_undegraded":"2024-09-14T12:07:20.671886+0000","last_fullsized":"2024-09-14T12:07:20.671886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:21.580563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'537","reported_seq":1354,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.874293+0000","last_change":"2024-09-14T11:11:06.650569+0000","last_active":"2024-09-14T12:09:14.874293+0000","last_peered":"2024-09-14T12:09:14.874293+0000","last_clean":"2024-09-14T12:09:14.874293+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:09:14.874293+0000","last_undegraded":"2024-09-14T12:09:14.874293+0000","last_fullsized":"2024-09-14T12:09:14.874293+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.704565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.881520+0000","last_change":"2024-09-14T11:10:58.600081+0000","last_active":"2024-09-14T12:09:13.881520+0000","last_peered":"2024-09-14T12:09:13.881520+0000","last_clean":"2024-09-14T12:09:13.881520+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:09:13.881520+0000","last_undegraded":"2024-09-14T12:09:13.881520+0000","last_fullsized":"2024-09-14T12:09:13.881520+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:49.242910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'382","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.567050+0000","last_change":"2024-09-14T11:10:56.608381+0000","last_active":"2024-09-14T12:09:54.567050+0000","last_peered":"2024-09-14T12:09:54.567050+0000","last_clean":"2024-09-14T12:09:54.567050+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:09:54.567050+0000","last_undegraded":"2024-09-14T12:09:54.567050+0000","last_fullsized":"2024-09-14T12:09:54.567050+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:44.373341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":914,"num_read_kb":57128,"num_write":1150,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656137+0000","last_change":"2024-09-14T11:11:00.610368+0000","last_active":"2024-09-14T12:07:24.656137+0000","last_peered":"2024-09-14T12:07:24.656137+0000","last_clean":"2024-09-14T12:07:24.656137+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:07:24.656137+0000","last_undegraded":"2024-09-14T12:07:24.656137+0000","last_fullsized":"2024-09-14T12:07:24.656137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:41.032264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'270","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.724302+0000","last_change":"2024-09-14T11:11:02.620109+0000","last_active":"2024-09-14T12:09:52.724302+0000","last_peered":"2024-09-14T12:09:52.724302+0000","last_clean":"2024-09-14T12:09:52.724302+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:09:52.724302+0000","last_undegraded":"2024-09-14T12:09:52.724302+0000","last_fullsized":"2024-09-14T12:09:52.724302+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:44.080763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.684553+0000","last_change":"2024-09-14T11:11:04.638763+0000","last_active":"2024-09-14T12:07:34.684553+0000","last_peered":"2024-09-14T12:07:34.684553+0000","last_clean":"2024-09-14T12:07:34.684553+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:07:34.684553+0000","last_undegraded":"2024-09-14T12:07:34.684553+0000","last_fullsized":"2024-09-14T12:07:34.684553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:07.104699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2496","reported_seq":4317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.077061+0000","last_change":"2024-09-14T11:11:06.650408+0000","last_active":"2024-09-14T12:09:04.077061+0000","last_peered":"2024-09-14T12:09:04.077061+0000","last_clean":"2024-09-14T12:09:04.077061+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:09:04.077061+0000","last_undegraded":"2024-09-14T12:09:04.077061+0000","last_fullsized":"2024-09-14T12:09:04.077061+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:25.723597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4177","reported_seq":4819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589584+0000","last_change":"2024-09-14T11:10:58.612551+0000","last_active":"2024-09-14T12:07:30.589584+0000","last_peered":"2024-09-14T12:07:30.589584+0000","last_clean":"2024-09-14T12:07:30.589584+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:07:30.589584+0000","last_undegraded":"2024-09-14T12:07:30.589584+0000","last_fullsized":"2024-09-14T12:07:30.589584+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":3000,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.250782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'355","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.568383+0000","last_change":"2024-09-14T11:10:56.609814+0000","last_active":"2024-09-14T12:09:54.568383+0000","last_peered":"2024-09-14T12:09:54.568383+0000","last_clean":"2024-09-14T12:09:54.568383+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:09:54.568383+0000","last_undegraded":"2024-09-14T12:09:54.568383+0000","last_fullsized":"2024-09-14T12:09:54.568383+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:46.610327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":622,"num_read_kb":21988,"num_write":1236,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655616+0000","last_change":"2024-09-14T11:11:00.609607+0000","last_active":"2024-09-14T12:07:19.655616+0000","last_peered":"2024-09-14T12:07:19.655616+0000","last_clean":"2024-09-14T12:07:19.655616+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:07:19.655616+0000","last_undegraded":"2024-09-14T12:07:19.655616+0000","last_fullsized":"2024-09-14T12:07:19.655616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:33.650477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'309","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.203620+0000","last_change":"2024-09-14T11:11:02.615273+0000","last_active":"2024-09-14T12:09:54.203620+0000","last_peered":"2024-09-14T12:09:54.203620+0000","last_clean":"2024-09-14T12:09:54.203620+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:09:54.203620+0000","last_undegraded":"2024-09-14T12:09:54.203620+0000","last_fullsized":"2024-09-14T12:09:54.203620+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:37.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'776","reported_seq":2790,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.436264+0000","last_change":"2024-09-14T11:11:04.634337+0000","last_active":"2024-09-14T12:09:18.436264+0000","last_peered":"2024-09-14T12:09:18.436264+0000","last_clean":"2024-09-14T12:09:18.436264+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:09:18.436264+0000","last_undegraded":"2024-09-14T12:09:18.436264+0000","last_fullsized":"2024-09-14T12:09:18.436264+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":701,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:25.363526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'154","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.869470+0000","last_change":"2024-09-14T11:11:06.648183+0000","last_active":"2024-09-14T12:09:13.869470+0000","last_peered":"2024-09-14T12:09:13.869470+0000","last_clean":"2024-09-14T12:09:13.869470+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:09:13.869470+0000","last_undegraded":"2024-09-14T12:09:13.869470+0000","last_fullsized":"2024-09-14T12:09:13.869470+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:52.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569651+0000","last_change":"2024-09-14T11:10:58.614518+0000","last_active":"2024-09-14T12:07:15.569651+0000","last_peered":"2024-09-14T12:07:15.569651+0000","last_clean":"2024-09-14T12:07:15.569651+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:07:15.569651+0000","last_undegraded":"2024-09-14T12:07:15.569651+0000","last_fullsized":"2024-09-14T12:07:15.569651+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:29.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'363","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.626569+0000","last_change":"2024-09-14T11:10:56.622559+0000","last_active":"2024-09-14T12:09:54.626569+0000","last_peered":"2024-09-14T12:09:54.626569+0000","last_clean":"2024-09-14T12:09:54.626569+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:09:54.626569+0000","last_undegraded":"2024-09-14T12:09:54.626569+0000","last_fullsized":"2024-09-14T12:09:54.626569+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:02.051757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":27518,"num_write":1081,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.656694+0000","last_change":"2024-09-14T11:11:00.617025+0000","last_active":"2024-09-14T12:07:29.656694+0000","last_peered":"2024-09-14T12:07:29.656694+0000","last_clean":"2024-09-14T12:07:29.656694+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:07:29.656694+0000","last_undegraded":"2024-09-14T12:07:29.656694+0000","last_fullsized":"2024-09-14T12:07:29.656694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.898496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'469","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.859881+0000","last_change":"2024-09-14T11:11:02.617234+0000","last_active":"2024-09-14T12:09:14.859881+0000","last_peered":"2024-09-14T12:09:14.859881+0000","last_clean":"2024-09-14T12:09:14.859881+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:09:14.859881+0000","last_undegraded":"2024-09-14T12:09:14.859881+0000","last_fullsized":"2024-09-14T12:09:14.859881+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:10.153711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":1773,"num_write":682,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656109+0000","last_change":"2024-09-14T11:11:04.629148+0000","last_active":"2024-09-14T12:07:24.656109+0000","last_peered":"2024-09-14T12:07:24.656109+0000","last_clean":"2024-09-14T12:07:24.656109+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:07:24.656109+0000","last_undegraded":"2024-09-14T12:07:24.656109+0000","last_fullsized":"2024-09-14T12:07:24.656109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.153280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'174","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.360071+0000","last_change":"2024-09-14T11:11:06.652430+0000","last_active":"2024-09-14T12:07:57.360071+0000","last_peered":"2024-09-14T12:07:57.360071+0000","last_clean":"2024-09-14T12:07:57.360071+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:07:57.360071+0000","last_undegraded":"2024-09-14T12:07:57.360071+0000","last_fullsized":"2024-09-14T12:07:57.360071+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:26.755770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580740+0000","last_change":"2024-09-14T11:10:58.612653+0000","last_active":"2024-09-14T12:07:14.580740+0000","last_peered":"2024-09-14T12:07:14.580740+0000","last_clean":"2024-09-14T12:07:14.580740+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:07:14.580740+0000","last_undegraded":"2024-09-14T12:07:14.580740+0000","last_fullsized":"2024-09-14T12:07:14.580740+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:48.760017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'301","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656443+0000","last_change":"2024-09-14T11:12:33.311513+0000","last_active":"2024-09-14T12:09:54.656443+0000","last_peered":"2024-09-14T12:09:54.656443+0000","last_clean":"2024-09-14T12:09:54.656443+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:09:54.656443+0000","last_undegraded":"2024-09-14T12:09:54.656443+0000","last_fullsized":"2024-09-14T12:09:54.656443+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:12.192936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079951,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":20886,"num_write":920,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655667+0000","last_change":"2024-09-14T11:11:00.613586+0000","last_active":"2024-09-14T12:07:19.655667+0000","last_peered":"2024-09-14T12:07:19.655667+0000","last_clean":"2024-09-14T12:07:19.655667+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:07:19.655667+0000","last_undegraded":"2024-09-14T12:07:19.655667+0000","last_fullsized":"2024-09-14T12:07:19.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.876699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.032254+0000","last_change":"2024-09-14T11:11:02.617188+0000","last_active":"2024-09-14T12:09:53.032254+0000","last_peered":"2024-09-14T12:09:53.032254+0000","last_clean":"2024-09-14T12:09:53.032254+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:09:53.032254+0000","last_undegraded":"2024-09-14T12:09:53.032254+0000","last_fullsized":"2024-09-14T12:09:53.032254+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:27.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571992+0000","last_change":"2024-09-14T11:11:04.638409+0000","last_active":"2024-09-14T12:07:35.571992+0000","last_peered":"2024-09-14T12:07:35.571992+0000","last_clean":"2024-09-14T12:07:35.571992+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:07:35.571992+0000","last_undegraded":"2024-09-14T12:07:35.571992+0000","last_fullsized":"2024-09-14T12:07:35.571992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.627071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'96","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.080423+0000","last_change":"2024-09-14T11:11:06.653079+0000","last_active":"2024-09-14T12:09:04.080423+0000","last_peered":"2024-09-14T12:09:04.080423+0000","last_clean":"2024-09-14T12:09:04.080423+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:09:04.080423+0000","last_undegraded":"2024-09-14T12:09:04.080423+0000","last_fullsized":"2024-09-14T12:09:04.080423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:58.237781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580780+0000","last_change":"2024-09-14T11:10:58.606197+0000","last_active":"2024-09-14T12:07:14.580780+0000","last_peered":"2024-09-14T12:07:14.580780+0000","last_clean":"2024-09-14T12:07:14.580780+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:07:14.580780+0000","last_undegraded":"2024-09-14T12:07:14.580780+0000","last_fullsized":"2024-09-14T12:07:14.580780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.386371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'291","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589566+0000","last_change":"2024-09-14T11:10:56.604612+0000","last_active":"2024-09-14T12:07:30.589566+0000","last_peered":"2024-09-14T12:07:30.589566+0000","last_clean":"2024-09-14T12:07:30.589566+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:07:30.589566+0000","last_undegraded":"2024-09-14T12:07:30.589566+0000","last_fullsized":"2024-09-14T12:07:30.589566+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:22.350680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12615080,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":632,"num_read_kb":12874,"num_write":1098,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"37'5","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.801177+0000","last_change":"2024-09-14T11:11:00.609637+0000","last_active":"2024-09-14T12:09:14.801177+0000","last_peered":"2024-09-14T12:09:14.801177+0000","last_clean":"2024-09-14T12:09:14.801177+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:09:14.801177+0000","last_undegraded":"2024-09-14T12:09:14.801177+0000","last_fullsized":"2024-09-14T12:09:14.801177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:16.269070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.665700+0000","last_change":"2024-09-14T11:11:02.621512+0000","last_active":"2024-09-14T12:09:54.665700+0000","last_peered":"2024-09-14T12:09:54.665700+0000","last_clean":"2024-09-14T12:09:54.665700+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:09:54.665700+0000","last_undegraded":"2024-09-14T12:09:54.665700+0000","last_fullsized":"2024-09-14T12:09:54.665700+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:59.728870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'737","reported_seq":2478,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.117272+0000","last_change":"2024-09-14T11:11:04.632093+0000","last_active":"2024-09-14T12:09:54.117272+0000","last_peered":"2024-09-14T12:09:54.117272+0000","last_clean":"2024-09-14T12:09:54.117272+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:09:54.117272+0000","last_undegraded":"2024-09-14T12:09:54.117272+0000","last_fullsized":"2024-09-14T12:09:54.117272+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:57.296761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.523143+0000","last_change":"2024-09-14T11:11:06.644785+0000","last_active":"2024-09-14T12:07:55.523143+0000","last_peered":"2024-09-14T12:07:55.523143+0000","last_clean":"2024-09-14T12:07:55.523143+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:07:55.523143+0000","last_undegraded":"2024-09-14T12:07:55.523143+0000","last_fullsized":"2024-09-14T12:07:55.523143+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:20.927650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":716,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580793+0000","last_change":"2024-09-14T11:10:58.604051+0000","last_active":"2024-09-14T12:07:14.580793+0000","last_peered":"2024-09-14T12:07:14.580793+0000","last_clean":"2024-09-14T12:07:14.580793+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:07:14.580793+0000","last_undegraded":"2024-09-14T12:07:14.580793+0000","last_fullsized":"2024-09-14T12:07:14.580793+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:21.106777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'306","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.500861+0000","last_change":"2024-09-14T11:10:56.614986+0000","last_active":"2024-09-14T12:09:54.500861+0000","last_peered":"2024-09-14T12:09:54.500861+0000","last_clean":"2024-09-14T12:09:54.500861+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:54.500861+0000","last_undegraded":"2024-09-14T12:09:54.500861+0000","last_fullsized":"2024-09-14T12:09:54.500861+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:02.927242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":467,"num_read_kb":37577,"num_write":937,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.939893+0000","last_change":"2024-09-14T11:11:00.612934+0000","last_active":"2024-09-14T12:09:51.939893+0000","last_peered":"2024-09-14T12:09:51.939893+0000","last_clean":"2024-09-14T12:09:51.939893+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:09:51.939893+0000","last_undegraded":"2024-09-14T12:09:51.939893+0000","last_fullsized":"2024-09-14T12:09:51.939893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:31.596836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'90","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682622+0000","last_change":"2024-09-14T11:11:02.882134+0000","last_active":"2024-09-14T12:07:19.682622+0000","last_peered":"2024-09-14T12:07:19.682622+0000","last_clean":"2024-09-14T12:07:19.682622+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:07:19.682622+0000","last_undegraded":"2024-09-14T12:07:19.682622+0000","last_fullsized":"2024-09-14T12:07:19.682622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.534285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'771","reported_seq":2468,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.430883+0000","last_change":"2024-09-14T11:11:04.634705+0000","last_active":"2024-09-14T12:09:18.430883+0000","last_peered":"2024-09-14T12:09:18.430883+0000","last_clean":"2024-09-14T12:09:18.430883+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:09:18.430883+0000","last_undegraded":"2024-09-14T12:09:18.430883+0000","last_fullsized":"2024-09-14T12:09:18.430883+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:03.937654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'114","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582391+0000","last_change":"2024-09-14T11:11:06.646677+0000","last_active":"2024-09-14T12:07:24.582391+0000","last_peered":"2024-09-14T12:07:24.582391+0000","last_clean":"2024-09-14T12:07:24.582391+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:07:24.582391+0000","last_undegraded":"2024-09-14T12:07:24.582391+0000","last_fullsized":"2024-09-14T12:07:24.582391+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:35.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'141","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672466+0000","last_change":"2024-09-14T11:10:58.604050+0000","last_active":"2024-09-14T12:07:25.672466+0000","last_peered":"2024-09-14T12:07:25.672466+0000","last_clean":"2024-09-14T12:07:25.672466+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:07:25.672466+0000","last_undegraded":"2024-09-14T12:07:25.672466+0000","last_fullsized":"2024-09-14T12:07:25.672466+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:01.910346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.606683+0000","last_change":"2024-09-14T11:10:56.621625+0000","last_active":"2024-09-14T12:09:54.606683+0000","last_peered":"2024-09-14T12:09:54.606683+0000","last_clean":"2024-09-14T12:09:54.606683+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:09:54.606683+0000","last_undegraded":"2024-09-14T12:09:54.606683+0000","last_fullsized":"2024-09-14T12:09:54.606683+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.662417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581695+0000","last_change":"2024-09-14T11:11:00.612752+0000","last_active":"2024-09-14T12:07:19.581695+0000","last_peered":"2024-09-14T12:07:19.581695+0000","last_clean":"2024-09-14T12:07:19.581695+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:07:19.581695+0000","last_undegraded":"2024-09-14T12:07:19.581695+0000","last_fullsized":"2024-09-14T12:07:19.581695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.297030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'355","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.860007+0000","last_change":"2024-09-14T11:11:02.616725+0000","last_active":"2024-09-14T12:09:53.860007+0000","last_peered":"2024-09-14T12:09:53.860007+0000","last_clean":"2024-09-14T12:09:53.860007+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:09:53.860007+0000","last_undegraded":"2024-09-14T12:09:53.860007+0000","last_fullsized":"2024-09-14T12:09:53.860007+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:01.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.588143+0000","last_change":"2024-09-14T11:11:04.635198+0000","last_active":"2024-09-14T12:07:20.588143+0000","last_peered":"2024-09-14T12:07:20.588143+0000","last_clean":"2024-09-14T12:07:20.588143+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:07:20.588143+0000","last_undegraded":"2024-09-14T12:07:20.588143+0000","last_fullsized":"2024-09-14T12:07:20.588143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:55.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'136","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672420+0000","last_change":"2024-09-14T11:11:06.646340+0000","last_active":"2024-09-14T12:07:25.672420+0000","last_peered":"2024-09-14T12:07:25.672420+0000","last_clean":"2024-09-14T12:07:25.672420+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:07:25.672420+0000","last_undegraded":"2024-09-14T12:07:25.672420+0000","last_fullsized":"2024-09-14T12:07:25.672420+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:44.114108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'105","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:55.202777+0000","last_change":"2024-09-14T11:10:58.606027+0000","last_active":"2024-09-14T12:08:55.202777+0000","last_peered":"2024-09-14T12:08:55.202777+0000","last_clean":"2024-09-14T12:08:55.202777+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:08:55.202777+0000","last_undegraded":"2024-09-14T12:08:55.202777+0000","last_fullsized":"2024-09-14T12:08:55.202777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:25.981163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578466+0000","last_change":"2024-09-14T11:10:40.558361+0000","last_active":"2024-09-14T12:06:54.578466+0000","last_peered":"2024-09-14T12:06:54.578466+0000","last_clean":"2024-09-14T12:06:54.578466+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:06:54.578466+0000","last_undegraded":"2024-09-14T12:06:54.578466+0000","last_fullsized":"2024-09-14T12:06:54.578466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_clean_scrub_stamp":"2024-09-14T11:10:39.523268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:36.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715535+0000","last_change":"2024-09-14T11:10:49.566289+0000","last_active":"2024-09-14T12:07:04.715535+0000","last_peered":"2024-09-14T12:07:04.715535+0000","last_clean":"2024-09-14T12:07:04.715535+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:07:04.715535+0000","last_undegraded":"2024-09-14T12:07:04.715535+0000","last_fullsized":"2024-09-14T12:07:04.715535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:43.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'316","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.558033+0000","last_change":"2024-09-14T11:10:56.613702+0000","last_active":"2024-09-14T12:09:54.558033+0000","last_peered":"2024-09-14T12:09:54.558033+0000","last_clean":"2024-09-14T12:09:54.558033+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:09:54.558033+0000","last_undegraded":"2024-09-14T12:09:54.558033+0000","last_fullsized":"2024-09-14T12:09:54.558033+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.052677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079939,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":21923,"num_write":1074,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582005+0000","last_change":"2024-09-14T11:11:00.610291+0000","last_active":"2024-09-14T12:07:19.582005+0000","last_peered":"2024-09-14T12:07:19.582005+0000","last_clean":"2024-09-14T12:07:19.582005+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:07:19.582005+0000","last_undegraded":"2024-09-14T12:07:19.582005+0000","last_fullsized":"2024-09-14T12:07:19.582005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:59.638567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'762","reported_seq":1474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.547865+0000","last_change":"2024-09-14T11:11:02.621281+0000","last_active":"2024-09-14T12:09:54.547865+0000","last_peered":"2024-09-14T12:09:54.547865+0000","last_clean":"2024-09-14T12:09:54.547865+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:09:54.547865+0000","last_undegraded":"2024-09-14T12:09:54.547865+0000","last_fullsized":"2024-09-14T12:09:54.547865+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:39.469737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.570862+0000","last_change":"2024-09-14T11:11:04.632962+0000","last_active":"2024-09-14T12:07:25.570862+0000","last_peered":"2024-09-14T12:07:25.570862+0000","last_clean":"2024-09-14T12:07:25.570862+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:07:25.570862+0000","last_undegraded":"2024-09-14T12:07:25.570862+0000","last_fullsized":"2024-09-14T12:07:25.570862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'182","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.397769+0000","last_change":"2024-09-14T11:11:06.647490+0000","last_active":"2024-09-14T12:07:57.397769+0000","last_peered":"2024-09-14T12:07:57.397769+0000","last_clean":"2024-09-14T12:07:57.397769+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:07:57.397769+0000","last_undegraded":"2024-09-14T12:07:57.397769+0000","last_fullsized":"2024-09-14T12:07:57.397769+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:49.491579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570300+0000","last_change":"2024-09-14T11:10:58.611939+0000","last_active":"2024-09-14T12:07:20.570300+0000","last_peered":"2024-09-14T12:07:20.570300+0000","last_clean":"2024-09-14T12:07:20.570300+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:07:20.570300+0000","last_undegraded":"2024-09-14T12:07:20.570300+0000","last_fullsized":"2024-09-14T12:07:20.570300+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:08.887333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579159+0000","last_change":"2024-09-14T11:10:49.784961+0000","last_active":"2024-09-14T12:06:59.579159+0000","last_peered":"2024-09-14T12:06:59.579159+0000","last_clean":"2024-09-14T12:06:59.579159+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:06:59.579159+0000","last_undegraded":"2024-09-14T12:06:59.579159+0000","last_fullsized":"2024-09-14T12:06:59.579159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:46.921965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'287","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569607+0000","last_change":"2024-09-14T11:11:33.134121+0000","last_active":"2024-09-14T12:07:15.569607+0000","last_peered":"2024-09-14T12:07:15.569607+0000","last_clean":"2024-09-14T12:07:15.569607+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:07:15.569607+0000","last_undegraded":"2024-09-14T12:07:15.569607+0000","last_fullsized":"2024-09-14T12:07:15.569607+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:48.763975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327439,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":560,"num_read_kb":48298,"num_write":1126,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.718904+0000","last_change":"2024-09-14T11:11:00.610424+0000","last_active":"2024-09-14T12:07:24.718904+0000","last_peered":"2024-09-14T12:07:24.718904+0000","last_clean":"2024-09-14T12:07:24.718904+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:07:24.718904+0000","last_undegraded":"2024-09-14T12:07:24.718904+0000","last_fullsized":"2024-09-14T12:07:24.718904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:04.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1258","reported_seq":2879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.392206+0000","last_change":"2024-09-14T11:11:02.616425+0000","last_active":"2024-09-14T12:09:18.392206+0000","last_peered":"2024-09-14T12:09:18.392206+0000","last_clean":"2024-09-14T12:09:18.392206+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:09:18.392206+0000","last_undegraded":"2024-09-14T12:09:18.392206+0000","last_fullsized":"2024-09-14T12:09:18.392206+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:08.009826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162865,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1989,"num_read_kb":3399,"num_write":1118,"num_write_kb":950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583514+0000","last_change":"2024-09-14T11:11:04.638084+0000","last_active":"2024-09-14T12:07:29.583514+0000","last_peered":"2024-09-14T12:07:29.583514+0000","last_clean":"2024-09-14T12:07:29.583514+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:07:29.583514+0000","last_undegraded":"2024-09-14T12:07:29.583514+0000","last_fullsized":"2024-09-14T12:07:29.583514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.322127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'220","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:40.673987+0000","last_change":"2024-09-14T11:11:06.643093+0000","last_active":"2024-09-14T12:07:40.673987+0000","last_peered":"2024-09-14T12:07:40.673987+0000","last_clean":"2024-09-14T12:07:40.673987+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:07:40.673987+0000","last_undegraded":"2024-09-14T12:07:40.673987+0000","last_fullsized":"2024-09-14T12:07:40.673987+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:50.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671975+0000","last_change":"2024-09-14T11:10:58.601798+0000","last_active":"2024-09-14T12:07:20.671975+0000","last_peered":"2024-09-14T12:07:20.671975+0000","last_clean":"2024-09-14T12:07:20.671975+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:07:20.671975+0000","last_undegraded":"2024-09-14T12:07:20.671975+0000","last_fullsized":"2024-09-14T12:07:20.671975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.795951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.652217+0000","last_change":"2024-09-14T11:10:50.167984+0000","last_active":"2024-09-14T12:07:04.652217+0000","last_peered":"2024-09-14T12:07:04.652217+0000","last_clean":"2024-09-14T12:07:04.652217+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:07:04.652217+0000","last_undegraded":"2024-09-14T12:07:04.652217+0000","last_fullsized":"2024-09-14T12:07:04.652217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:56.618404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'307","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670759+0000","last_change":"2024-09-14T11:10:56.605398+0000","last_active":"2024-09-14T12:07:10.670759+0000","last_peered":"2024-09-14T12:07:10.670759+0000","last_clean":"2024-09-14T12:07:10.670759+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:07:10.670759+0000","last_undegraded":"2024-09-14T12:07:10.670759+0000","last_fullsized":"2024-09-14T12:07:10.670759+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:37.462380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5921611,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":582,"num_read_kb":34638,"num_write":1151,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656189+0000","last_change":"2024-09-14T11:11:00.611993+0000","last_active":"2024-09-14T12:07:24.656189+0000","last_peered":"2024-09-14T12:07:24.656189+0000","last_clean":"2024-09-14T12:07:24.656189+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:07:24.656189+0000","last_undegraded":"2024-09-14T12:07:24.656189+0000","last_fullsized":"2024-09-14T12:07:24.656189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:06.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.035888+0000","last_change":"2024-09-14T11:11:02.887250+0000","last_active":"2024-09-14T12:09:15.035888+0000","last_peered":"2024-09-14T12:09:15.035888+0000","last_clean":"2024-09-14T12:09:15.035888+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:09:15.035888+0000","last_undegraded":"2024-09-14T12:09:15.035888+0000","last_fullsized":"2024-09-14T12:09:15.035888+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:22.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570276+0000","last_change":"2024-09-14T11:11:04.635365+0000","last_active":"2024-09-14T12:07:20.570276+0000","last_peered":"2024-09-14T12:07:20.570276+0000","last_clean":"2024-09-14T12:07:20.570276+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:07:20.570276+0000","last_undegraded":"2024-09-14T12:07:20.570276+0000","last_fullsized":"2024-09-14T12:07:20.570276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:48.407204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'240","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.650870+0000","last_change":"2024-09-14T11:11:06.650013+0000","last_active":"2024-09-14T12:07:57.650870+0000","last_peered":"2024-09-14T12:07:57.650870+0000","last_clean":"2024-09-14T12:07:57.650870+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:07:57.650870+0000","last_undegraded":"2024-09-14T12:07:57.650870+0000","last_fullsized":"2024-09-14T12:07:57.650870+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.193259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671361+0000","last_change":"2024-09-14T11:10:58.611132+0000","last_active":"2024-09-14T12:07:15.671361+0000","last_peered":"2024-09-14T12:07:15.671361+0000","last_clean":"2024-09-14T12:07:15.671361+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:07:15.671361+0000","last_undegraded":"2024-09-14T12:07:15.671361+0000","last_fullsized":"2024-09-14T12:07:15.671361+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:47.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715494+0000","last_change":"2024-09-14T11:10:49.566261+0000","last_active":"2024-09-14T12:07:04.715494+0000","last_peered":"2024-09-14T12:07:04.715494+0000","last_clean":"2024-09-14T12:07:04.715494+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:07:04.715494+0000","last_undegraded":"2024-09-14T12:07:04.715494+0000","last_fullsized":"2024-09-14T12:07:04.715494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:49.383472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'315","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562262+0000","last_change":"2024-09-14T11:10:56.606302+0000","last_active":"2024-09-14T12:09:54.562262+0000","last_peered":"2024-09-14T12:09:54.562262+0000","last_clean":"2024-09-14T12:09:54.562262+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:09:54.562262+0000","last_undegraded":"2024-09-14T12:09:54.562262+0000","last_fullsized":"2024-09-14T12:09:54.562262+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.821812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":454581,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":658,"num_read_kb":8841,"num_write":1004,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.814661+0000","last_change":"2024-09-14T11:11:00.607385+0000","last_active":"2024-09-14T12:09:14.814661+0000","last_peered":"2024-09-14T12:09:14.814661+0000","last_clean":"2024-09-14T12:09:14.814661+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:09:14.814661+0000","last_undegraded":"2024-09-14T12:09:14.814661+0000","last_fullsized":"2024-09-14T12:09:14.814661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:18.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'141","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.049855+0000","last_change":"2024-09-14T11:11:02.619842+0000","last_active":"2024-09-14T12:09:15.049855+0000","last_peered":"2024-09-14T12:09:15.049855+0000","last_clean":"2024-09-14T12:09:15.049855+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:09:15.049855+0000","last_undegraded":"2024-09-14T12:09:15.049855+0000","last_fullsized":"2024-09-14T12:09:15.049855+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:29.586585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.588952+0000","last_change":"2024-09-14T11:11:04.632880+0000","last_active":"2024-09-14T12:07:25.588952+0000","last_peered":"2024-09-14T12:07:25.588952+0000","last_clean":"2024-09-14T12:07:25.588952+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:07:25.588952+0000","last_undegraded":"2024-09-14T12:07:25.588952+0000","last_fullsized":"2024-09-14T12:07:25.588952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:41.973457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.719671+0000","last_change":"2024-09-14T11:11:06.652421+0000","last_active":"2024-09-14T12:07:29.719671+0000","last_peered":"2024-09-14T12:07:29.719671+0000","last_clean":"2024-09-14T12:07:29.719671+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:07:29.719671+0000","last_undegraded":"2024-09-14T12:07:29.719671+0000","last_fullsized":"2024-09-14T12:07:29.719671+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:13.461185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:49.658858+0000","last_change":"2024-09-14T11:11:32.676598+0000","last_active":"2024-09-14T12:07:49.658858+0000","last_peered":"2024-09-14T12:07:49.658858+0000","last_clean":"2024-09-14T12:07:49.658858+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:07:49.658858+0000","last_undegraded":"2024-09-14T12:07:49.658858+0000","last_fullsized":"2024-09-14T12:07:49.658858+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:34.343713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.650599+0000","last_change":"2024-09-14T11:10:56.607551+0000","last_active":"2024-09-14T12:09:54.650599+0000","last_peered":"2024-09-14T12:09:54.650599+0000","last_clean":"2024-09-14T12:09:54.650599+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:09:54.650599+0000","last_undegraded":"2024-09-14T12:09:54.650599+0000","last_fullsized":"2024-09-14T12:09:54.650599+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:34.558354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.670214+0000","last_change":"2024-09-14T11:10:49.565862+0000","last_active":"2024-09-14T12:07:05.670214+0000","last_peered":"2024-09-14T12:07:05.670214+0000","last_clean":"2024-09-14T12:07:05.670214+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:07:05.670214+0000","last_undegraded":"2024-09-14T12:07:05.670214+0000","last_fullsized":"2024-09-14T12:07:05.670214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:23.143257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569681+0000","last_change":"2024-09-14T11:11:00.604266+0000","last_active":"2024-09-14T12:07:15.569681+0000","last_peered":"2024-09-14T12:07:15.569681+0000","last_clean":"2024-09-14T12:07:15.569681+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:07:15.569681+0000","last_undegraded":"2024-09-14T12:07:15.569681+0000","last_fullsized":"2024-09-14T12:07:15.569681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:23.466098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'581","reported_seq":1244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.865130+0000","last_change":"2024-09-14T11:11:02.621799+0000","last_active":"2024-09-14T12:09:14.865130+0000","last_peered":"2024-09-14T12:09:14.865130+0000","last_clean":"2024-09-14T12:09:14.865130+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:09:14.865130+0000","last_undegraded":"2024-09-14T12:09:14.865130+0000","last_fullsized":"2024-09-14T12:09:14.865130+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:35.213739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1643,"num_read_kb":2634,"num_write":2206,"num_write_kb":2061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581595+0000","last_change":"2024-09-14T11:11:04.637891+0000","last_active":"2024-09-14T12:07:19.581595+0000","last_peered":"2024-09-14T12:07:19.581595+0000","last_clean":"2024-09-14T12:07:19.581595+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:07:19.581595+0000","last_undegraded":"2024-09-14T12:07:19.581595+0000","last_fullsized":"2024-09-14T12:07:19.581595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.595704+0000","last_change":"2024-09-14T11:11:06.644529+0000","last_active":"2024-09-14T12:07:54.595704+0000","last_peered":"2024-09-14T12:07:54.595704+0000","last_clean":"2024-09-14T12:07:54.595704+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:07:54.595704+0000","last_undegraded":"2024-09-14T12:07:54.595704+0000","last_fullsized":"2024-09-14T12:07:54.595704+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:27.041637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569674+0000","last_change":"2024-09-14T11:10:58.610011+0000","last_active":"2024-09-14T12:07:15.569674+0000","last_peered":"2024-09-14T12:07:15.569674+0000","last_clean":"2024-09-14T12:07:15.569674+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:07:15.569674+0000","last_undegraded":"2024-09-14T12:07:15.569674+0000","last_fullsized":"2024-09-14T12:07:15.569674+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:35.811227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'311","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.055366+0000","last_change":"2024-09-14T11:10:56.602134+0000","last_active":"2024-09-14T12:09:13.055366+0000","last_peered":"2024-09-14T12:09:13.055366+0000","last_clean":"2024-09-14T12:09:13.055366+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:09:13.055366+0000","last_undegraded":"2024-09-14T12:09:13.055366+0000","last_fullsized":"2024-09-14T12:09:13.055366+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:30.985152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10693503,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":604,"num_read_kb":35559,"num_write":1115,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581198+0000","last_change":"2024-09-14T11:10:49.784939+0000","last_active":"2024-09-14T12:07:14.581198+0000","last_peered":"2024-09-14T12:07:14.581198+0000","last_clean":"2024-09-14T12:07:14.581198+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:07:14.581198+0000","last_undegraded":"2024-09-14T12:07:14.581198+0000","last_fullsized":"2024-09-14T12:07:14.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:20.447651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587487+0000","last_change":"2024-09-14T11:11:00.605387+0000","last_active":"2024-09-14T12:07:15.587487+0000","last_peered":"2024-09-14T12:07:15.587487+0000","last_clean":"2024-09-14T12:07:15.587487+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:07:15.587487+0000","last_undegraded":"2024-09-14T12:07:15.587487+0000","last_fullsized":"2024-09-14T12:07:15.587487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:46.178240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'169","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.885619+0000","last_change":"2024-09-14T11:11:02.887280+0000","last_active":"2024-09-14T12:09:13.885619+0000","last_peered":"2024-09-14T12:09:13.885619+0000","last_clean":"2024-09-14T12:09:13.885619+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:09:13.885619+0000","last_undegraded":"2024-09-14T12:09:13.885619+0000","last_fullsized":"2024-09-14T12:09:13.885619+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.345916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.358863+0000","last_change":"2024-09-14T11:11:04.632716+0000","last_active":"2024-09-14T12:09:53.358863+0000","last_peered":"2024-09-14T12:09:53.358863+0000","last_clean":"2024-09-14T12:09:53.358863+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:09:53.358863+0000","last_undegraded":"2024-09-14T12:09:53.358863+0000","last_fullsized":"2024-09-14T12:09:53.358863+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:21.258508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'121","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.871748+0000","last_change":"2024-09-14T11:11:06.651630+0000","last_active":"2024-09-14T12:09:14.871748+0000","last_peered":"2024-09-14T12:09:14.871748+0000","last_clean":"2024-09-14T12:09:14.871748+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:09:14.871748+0000","last_undegraded":"2024-09-14T12:09:14.871748+0000","last_fullsized":"2024-09-14T12:09:14.871748+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:46.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681248+0000","last_change":"2024-09-14T11:10:58.608290+0000","last_active":"2024-09-14T12:07:09.681248+0000","last_peered":"2024-09-14T12:07:09.681248+0000","last_clean":"2024-09-14T12:07:09.681248+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:07:09.681248+0000","last_undegraded":"2024-09-14T12:07:09.681248+0000","last_fullsized":"2024-09-14T12:07:09.681248+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:31.554400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.635141+0000","last_change":"2024-09-14T11:10:56.620615+0000","last_active":"2024-09-14T12:09:54.635141+0000","last_peered":"2024-09-14T12:09:54.635141+0000","last_clean":"2024-09-14T12:09:54.635141+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:09:54.635141+0000","last_undegraded":"2024-09-14T12:09:54.635141+0000","last_fullsized":"2024-09-14T12:09:54.635141+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:20.532731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670837+0000","last_change":"2024-09-14T11:10:49.565917+0000","last_active":"2024-09-14T12:07:10.670837+0000","last_peered":"2024-09-14T12:07:10.670837+0000","last_clean":"2024-09-14T12:07:10.670837+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:07:10.670837+0000","last_undegraded":"2024-09-14T12:07:10.670837+0000","last_fullsized":"2024-09-14T12:07:10.670837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.682606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581576+0000","last_change":"2024-09-14T11:11:00.610462+0000","last_active":"2024-09-14T12:07:19.581576+0000","last_peered":"2024-09-14T12:07:19.581576+0000","last_clean":"2024-09-14T12:07:19.581576+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:07:19.581576+0000","last_undegraded":"2024-09-14T12:07:19.581576+0000","last_fullsized":"2024-09-14T12:07:19.581576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:57.985170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'120","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581610+0000","last_change":"2024-09-14T11:11:02.618565+0000","last_active":"2024-09-14T12:07:19.581610+0000","last_peered":"2024-09-14T12:07:19.581610+0000","last_clean":"2024-09-14T12:07:19.581610+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:07:19.581610+0000","last_undegraded":"2024-09-14T12:07:19.581610+0000","last_fullsized":"2024-09-14T12:07:19.581610+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:49.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'791","reported_seq":6721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.146146+0000","last_change":"2024-09-14T11:11:04.641546+0000","last_active":"2024-09-14T12:09:54.146146+0000","last_peered":"2024-09-14T12:09:54.146146+0000","last_clean":"2024-09-14T12:09:54.146146+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:09:54.146146+0000","last_undegraded":"2024-09-14T12:09:54.146146+0000","last_fullsized":"2024-09-14T12:09:54.146146+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:25.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'211","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.574448+0000","last_change":"2024-09-14T11:11:06.651293+0000","last_active":"2024-09-14T12:07:56.574448+0000","last_peered":"2024-09-14T12:07:56.574448+0000","last_clean":"2024-09-14T12:07:56.574448+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:07:56.574448+0000","last_undegraded":"2024-09-14T12:07:56.574448+0000","last_fullsized":"2024-09-14T12:07:56.574448+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580636+0000","last_change":"2024-09-14T11:10:58.600988+0000","last_active":"2024-09-14T12:07:14.580636+0000","last_peered":"2024-09-14T12:07:14.580636+0000","last_clean":"2024-09-14T12:07:14.580636+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:07:14.580636+0000","last_undegraded":"2024-09-14T12:07:14.580636+0000","last_fullsized":"2024-09-14T12:07:14.580636+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:34.213245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'374","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.631818+0000","last_change":"2024-09-14T11:11:32.791407+0000","last_active":"2024-09-14T12:09:54.631818+0000","last_peered":"2024-09-14T12:09:54.631818+0000","last_clean":"2024-09-14T12:09:54.631818+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:09:54.631818+0000","last_undegraded":"2024-09-14T12:09:54.631818+0000","last_fullsized":"2024-09-14T12:09:54.631818+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:37.633694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324752,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":749,"num_read_kb":5404,"num_write":1186,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586795+0000","last_change":"2024-09-14T11:10:49.566365+0000","last_active":"2024-09-14T12:07:10.586795+0000","last_peered":"2024-09-14T12:07:10.586795+0000","last_clean":"2024-09-14T12:07:10.586795+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:07:10.586795+0000","last_undegraded":"2024-09-14T12:07:10.586795+0000","last_fullsized":"2024-09-14T12:07:10.586795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:17.078627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681822+0000","last_change":"2024-09-14T11:11:00.612749+0000","last_active":"2024-09-14T12:07:14.681822+0000","last_peered":"2024-09-14T12:07:14.681822+0000","last_clean":"2024-09-14T12:07:14.681822+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:07:14.681822+0000","last_undegraded":"2024-09-14T12:07:14.681822+0000","last_fullsized":"2024-09-14T12:07:14.681822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:08.731984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'795","reported_seq":1517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.736663+0000","last_change":"2024-09-14T11:11:02.882288+0000","last_active":"2024-09-14T12:09:53.736663+0000","last_peered":"2024-09-14T12:09:53.736663+0000","last_clean":"2024-09-14T12:09:53.736663+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:09:53.736663+0000","last_undegraded":"2024-09-14T12:09:53.736663+0000","last_fullsized":"2024-09-14T12:09:53.736663+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:52.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682515+0000","last_change":"2024-09-14T11:11:04.636384+0000","last_active":"2024-09-14T12:07:19.682515+0000","last_peered":"2024-09-14T12:07:19.682515+0000","last_clean":"2024-09-14T12:07:19.682515+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:07:19.682515+0000","last_undegraded":"2024-09-14T12:07:19.682515+0000","last_fullsized":"2024-09-14T12:07:19.682515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:19.200941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'147","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.868910+0000","last_change":"2024-09-14T11:11:06.645842+0000","last_active":"2024-09-14T12:09:14.868910+0000","last_peered":"2024-09-14T12:09:14.868910+0000","last_clean":"2024-09-14T12:09:14.868910+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:09:14.868910+0000","last_undegraded":"2024-09-14T12:09:14.868910+0000","last_fullsized":"2024-09-14T12:09:14.868910+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:49.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'133","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.592187+0000","last_change":"2024-09-14T11:11:06.646108+0000","last_active":"2024-09-14T12:07:57.592187+0000","last_peered":"2024-09-14T12:07:57.592187+0000","last_clean":"2024-09-14T12:07:57.592187+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:07:57.592187+0000","last_undegraded":"2024-09-14T12:07:57.592187+0000","last_fullsized":"2024-09-14T12:07:57.592187+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:15.069138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578521+0000","last_change":"2024-09-14T11:10:58.604359+0000","last_active":"2024-09-14T12:06:59.578521+0000","last_peered":"2024-09-14T12:06:59.578521+0000","last_clean":"2024-09-14T12:06:59.578521+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:06:59.578521+0000","last_undegraded":"2024-09-14T12:06:59.578521+0000","last_fullsized":"2024-09-14T12:06:59.578521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:16.978960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'347","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.420886+0000","last_change":"2024-09-14T11:10:56.615808+0000","last_active":"2024-09-14T12:09:54.420886+0000","last_peered":"2024-09-14T12:09:54.420886+0000","last_clean":"2024-09-14T12:09:54.420886+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:09:54.420886+0000","last_undegraded":"2024-09-14T12:09:54.420886+0000","last_fullsized":"2024-09-14T12:09:54.420886+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:43.217150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":636,"num_read_kb":5106,"num_write":1230,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669712+0000","last_change":"2024-09-14T11:11:00.610690+0000","last_active":"2024-09-14T12:07:00.669712+0000","last_peered":"2024-09-14T12:07:00.669712+0000","last_clean":"2024-09-14T12:07:00.669712+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:07:00.669712+0000","last_undegraded":"2024-09-14T12:07:00.669712+0000","last_fullsized":"2024-09-14T12:07:00.669712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:39.467881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'323","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.143808+0000","last_change":"2024-09-14T11:11:02.622367+0000","last_active":"2024-09-14T12:09:54.143808+0000","last_peered":"2024-09-14T12:09:54.143808+0000","last_clean":"2024-09-14T12:09:54.143808+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:09:54.143808+0000","last_undegraded":"2024-09-14T12:09:54.143808+0000","last_fullsized":"2024-09-14T12:09:54.143808+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:39.564835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680693+0000","last_change":"2024-09-14T11:11:04.639827+0000","last_active":"2024-09-14T12:07:04.680693+0000","last_peered":"2024-09-14T12:07:04.680693+0000","last_clean":"2024-09-14T12:07:04.680693+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:07:04.680693+0000","last_undegraded":"2024-09-14T12:07:04.680693+0000","last_fullsized":"2024-09-14T12:07:04.680693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:10.987465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'132","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682683+0000","last_change":"2024-09-14T11:11:06.649975+0000","last_active":"2024-09-14T12:07:19.682683+0000","last_peered":"2024-09-14T12:07:19.682683+0000","last_clean":"2024-09-14T12:07:19.682683+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:07:19.682683+0000","last_undegraded":"2024-09-14T12:07:19.682683+0000","last_fullsized":"2024-09-14T12:07:19.682683+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:50.322032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669720+0000","last_change":"2024-09-14T11:10:58.609253+0000","last_active":"2024-09-14T12:07:00.669720+0000","last_peered":"2024-09-14T12:07:00.669720+0000","last_clean":"2024-09-14T12:07:00.669720+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:07:00.669720+0000","last_undegraded":"2024-09-14T12:07:00.669720+0000","last_fullsized":"2024-09-14T12:07:00.669720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.292062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'340","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.577295+0000","last_change":"2024-09-14T11:10:56.618778+0000","last_active":"2024-09-14T12:09:54.577295+0000","last_peered":"2024-09-14T12:09:54.577295+0000","last_clean":"2024-09-14T12:09:54.577295+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:09:54.577295+0000","last_undegraded":"2024-09-14T12:09:54.577295+0000","last_fullsized":"2024-09-14T12:09:54.577295+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:10.981915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":324726,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":667,"num_read_kb":33434,"num_write":1022,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680772+0000","last_change":"2024-09-14T11:11:00.611300+0000","last_active":"2024-09-14T12:07:04.680772+0000","last_peered":"2024-09-14T12:07:04.680772+0000","last_clean":"2024-09-14T12:07:04.680772+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:07:04.680772+0000","last_undegraded":"2024-09-14T12:07:04.680772+0000","last_fullsized":"2024-09-14T12:07:04.680772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:08.169880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568300+0000","last_change":"2024-09-14T11:11:02.616318+0000","last_active":"2024-09-14T12:07:05.568300+0000","last_peered":"2024-09-14T12:07:05.568300+0000","last_clean":"2024-09-14T12:07:05.568300+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:07:05.568300+0000","last_undegraded":"2024-09-14T12:07:05.568300+0000","last_fullsized":"2024-09-14T12:07:05.568300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:14.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579853+0000","last_change":"2024-09-14T11:11:04.630959+0000","last_active":"2024-09-14T12:07:04.579853+0000","last_peered":"2024-09-14T12:07:04.579853+0000","last_clean":"2024-09-14T12:07:04.579853+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:07:04.579853+0000","last_undegraded":"2024-09-14T12:07:04.579853+0000","last_fullsized":"2024-09-14T12:07:04.579853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:47.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'253","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.593628+0000","last_change":"2024-09-14T11:11:06.642887+0000","last_active":"2024-09-14T12:07:56.593628+0000","last_peered":"2024-09-14T12:07:56.593628+0000","last_clean":"2024-09-14T12:07:56.593628+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:07:56.593628+0000","last_undegraded":"2024-09-14T12:07:56.593628+0000","last_fullsized":"2024-09-14T12:07:56.593628+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:46.857547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680183+0000","last_change":"2024-09-14T11:10:58.605181+0000","last_active":"2024-09-14T12:06:59.680183+0000","last_peered":"2024-09-14T12:06:59.680183+0000","last_clean":"2024-09-14T12:06:59.680183+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:06:59.680183+0000","last_undegraded":"2024-09-14T12:06:59.680183+0000","last_fullsized":"2024-09-14T12:06:59.680183+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:43.046442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1250,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.611356+0000","last_change":"2024-09-14T11:10:56.600738+0000","last_active":"2024-09-14T12:09:54.611356+0000","last_peered":"2024-09-14T12:09:54.611356+0000","last_clean":"2024-09-14T12:09:54.611356+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:09:54.611356+0000","last_undegraded":"2024-09-14T12:09:54.611356+0000","last_fullsized":"2024-09-14T12:09:54.611356+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:28.803066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579817+0000","last_change":"2024-09-14T11:11:00.608611+0000","last_active":"2024-09-14T12:07:04.579817+0000","last_peered":"2024-09-14T12:07:04.579817+0000","last_clean":"2024-09-14T12:07:04.579817+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:04.579817+0000","last_undegraded":"2024-09-14T12:07:04.579817+0000","last_fullsized":"2024-09-14T12:07:04.579817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:32.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'307","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.395477+0000","last_change":"2024-09-14T11:11:02.621487+0000","last_active":"2024-09-14T12:09:53.395477+0000","last_peered":"2024-09-14T12:09:53.395477+0000","last_clean":"2024-09-14T12:09:53.395477+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:09:53.395477+0000","last_undegraded":"2024-09-14T12:09:53.395477+0000","last_fullsized":"2024-09-14T12:09:53.395477+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:57.571157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.585970+0000","last_change":"2024-09-14T11:11:04.632741+0000","last_active":"2024-09-14T12:07:05.585970+0000","last_peered":"2024-09-14T12:07:05.585970+0000","last_clean":"2024-09-14T12:07:05.585970+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:07:05.585970+0000","last_undegraded":"2024-09-14T12:07:05.585970+0000","last_fullsized":"2024-09-14T12:07:05.585970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:33.615718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'110","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.940177+0000","last_change":"2024-09-14T11:11:06.646134+0000","last_active":"2024-09-14T12:07:55.940177+0000","last_peered":"2024-09-14T12:07:55.940177+0000","last_clean":"2024-09-14T12:07:55.940177+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:07:55.940177+0000","last_undegraded":"2024-09-14T12:07:55.940177+0000","last_fullsized":"2024-09-14T12:07:55.940177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:44.141877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'143","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680151+0000","last_change":"2024-09-14T11:10:58.610261+0000","last_active":"2024-09-14T12:06:59.680151+0000","last_peered":"2024-09-14T12:06:59.680151+0000","last_clean":"2024-09-14T12:06:59.680151+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:06:59.680151+0000","last_undegraded":"2024-09-14T12:06:59.680151+0000","last_fullsized":"2024-09-14T12:06:59.680151+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:38.951705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'302","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564862+0000","last_change":"2024-09-14T11:10:56.623865+0000","last_active":"2024-09-14T12:06:35.564862+0000","last_peered":"2024-09-14T12:06:35.564862+0000","last_clean":"2024-09-14T12:06:35.564862+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:06:35.564862+0000","last_undegraded":"2024-09-14T12:06:35.564862+0000","last_fullsized":"2024-09-14T12:06:35.564862+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:27.676587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16810913,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":646,"num_read_kb":71289,"num_write":1117,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.585298+0000","last_change":"2024-09-14T11:11:00.608657+0000","last_active":"2024-09-14T12:07:00.585298+0000","last_peered":"2024-09-14T12:07:00.585298+0000","last_clean":"2024-09-14T12:07:00.585298+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:07:00.585298+0000","last_undegraded":"2024-09-14T12:07:00.585298+0000","last_fullsized":"2024-09-14T12:07:00.585298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:34.927234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'265","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.192042+0000","last_change":"2024-09-14T11:11:02.615297+0000","last_active":"2024-09-14T12:09:53.192042+0000","last_peered":"2024-09-14T12:09:53.192042+0000","last_clean":"2024-09-14T12:09:53.192042+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:09:53.192042+0000","last_undegraded":"2024-09-14T12:09:53.192042+0000","last_fullsized":"2024-09-14T12:09:53.192042+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:52.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568346+0000","last_change":"2024-09-14T11:11:04.634007+0000","last_active":"2024-09-14T12:07:05.568346+0000","last_peered":"2024-09-14T12:07:05.568346+0000","last_clean":"2024-09-14T12:07:05.568346+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:07:05.568346+0000","last_undegraded":"2024-09-14T12:07:05.568346+0000","last_fullsized":"2024-09-14T12:07:05.568346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.560589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587539+0000","last_change":"2024-09-14T11:10:58.606214+0000","last_active":"2024-09-14T12:07:15.587539+0000","last_peered":"2024-09-14T12:07:15.587539+0000","last_clean":"2024-09-14T12:07:15.587539+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:07:15.587539+0000","last_undegraded":"2024-09-14T12:07:15.587539+0000","last_fullsized":"2024-09-14T12:07:15.587539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.749986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'372","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.502822+0000","last_change":"2024-09-14T11:10:56.622004+0000","last_active":"2024-09-14T12:09:54.502822+0000","last_peered":"2024-09-14T12:09:54.502822+0000","last_clean":"2024-09-14T12:09:54.502822+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:09:54.502822+0000","last_undegraded":"2024-09-14T12:09:54.502822+0000","last_fullsized":"2024-09-14T12:09:54.502822+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:22.080952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":694,"num_read_kb":6455,"num_write":1237,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569728+0000","last_change":"2024-09-14T11:11:00.603297+0000","last_active":"2024-09-14T12:07:15.569728+0000","last_peered":"2024-09-14T12:07:15.569728+0000","last_clean":"2024-09-14T12:07:15.569728+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:07:15.569728+0000","last_undegraded":"2024-09-14T12:07:15.569728+0000","last_fullsized":"2024-09-14T12:07:15.569728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:28.255243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'491","reported_seq":1114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.837882+0000","last_change":"2024-09-14T11:11:02.615607+0000","last_active":"2024-09-14T12:09:14.837882+0000","last_peered":"2024-09-14T12:09:14.837882+0000","last_clean":"2024-09-14T12:09:14.837882+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:09:14.837882+0000","last_undegraded":"2024-09-14T12:09:14.837882+0000","last_fullsized":"2024-09-14T12:09:14.837882+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:23.294326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117410,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":886,"num_read_kb":1917,"num_write":776,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706944+0000","last_change":"2024-09-14T11:11:04.636718+0000","last_active":"2024-09-14T12:06:04.706944+0000","last_peered":"2024-09-14T12:06:04.706944+0000","last_clean":"2024-09-14T12:06:04.706944+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:06:04.706944+0000","last_undegraded":"2024-09-14T12:06:04.706944+0000","last_fullsized":"2024-09-14T12:06:04.706944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.511083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'174","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681293+0000","last_change":"2024-09-14T11:11:06.650082+0000","last_active":"2024-09-14T12:07:09.681293+0000","last_peered":"2024-09-14T12:07:09.681293+0000","last_clean":"2024-09-14T12:07:09.681293+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:07:09.681293+0000","last_undegraded":"2024-09-14T12:07:09.681293+0000","last_fullsized":"2024-09-14T12:07:09.681293+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:16.276250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569715+0000","last_change":"2024-09-14T11:10:58.606571+0000","last_active":"2024-09-14T12:07:15.569715+0000","last_peered":"2024-09-14T12:07:15.569715+0000","last_clean":"2024-09-14T12:07:15.569715+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:07:15.569715+0000","last_undegraded":"2024-09-14T12:07:15.569715+0000","last_fullsized":"2024-09-14T12:07:15.569715+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:01.887992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'267","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.186938+0000","last_change":"2024-09-14T11:10:56.607042+0000","last_active":"2024-09-14T12:07:13.186938+0000","last_peered":"2024-09-14T12:07:13.186938+0000","last_clean":"2024-09-14T12:07:13.186938+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:07:13.186938+0000","last_undegraded":"2024-09-14T12:07:13.186938+0000","last_fullsized":"2024-09-14T12:07:13.186938+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:10.108123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6642266,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":406,"num_read_kb":4513,"num_write":918,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587550+0000","last_change":"2024-09-14T11:11:00.608589+0000","last_active":"2024-09-14T12:07:15.587550+0000","last_peered":"2024-09-14T12:07:15.587550+0000","last_clean":"2024-09-14T12:07:15.587550+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:15.587550+0000","last_undegraded":"2024-09-14T12:07:15.587550+0000","last_fullsized":"2024-09-14T12:07:15.587550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:24.982876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'312","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.256716+0000","last_change":"2024-09-14T11:11:02.611238+0000","last_active":"2024-09-14T12:09:53.256716+0000","last_peered":"2024-09-14T12:09:53.256716+0000","last_clean":"2024-09-14T12:09:53.256716+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:09:53.256716+0000","last_undegraded":"2024-09-14T12:09:53.256716+0000","last_fullsized":"2024-09-14T12:09:53.256716+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.446639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663956+0000","last_change":"2024-09-14T11:11:04.630801+0000","last_active":"2024-09-14T12:06:05.663956+0000","last_peered":"2024-09-14T12:06:05.663956+0000","last_clean":"2024-09-14T12:06:05.663956+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:06:05.663956+0000","last_undegraded":"2024-09-14T12:06:05.663956+0000","last_fullsized":"2024-09-14T12:06:05.663956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:37.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'187","reported_seq":714,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586739+0000","last_change":"2024-09-14T11:11:06.647146+0000","last_active":"2024-09-14T12:07:10.586739+0000","last_peered":"2024-09-14T12:07:10.586739+0000","last_clean":"2024-09-14T12:07:10.586739+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:07:10.586739+0000","last_undegraded":"2024-09-14T12:07:10.586739+0000","last_fullsized":"2024-09-14T12:07:10.586739+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.672972+0000","last_change":"2024-09-14T11:10:58.603000+0000","last_active":"2024-09-14T12:05:59.672972+0000","last_peered":"2024-09-14T12:05:59.672972+0000","last_clean":"2024-09-14T12:05:59.672972+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:05:59.672972+0000","last_undegraded":"2024-09-14T12:05:59.672972+0000","last_fullsized":"2024-09-14T12:05:59.672972+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:38.408009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'342","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.645387+0000","last_change":"2024-09-14T11:11:32.679317+0000","last_active":"2024-09-14T12:09:54.645387+0000","last_peered":"2024-09-14T12:09:54.645387+0000","last_clean":"2024-09-14T12:09:54.645387+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:09:54.645387+0000","last_undegraded":"2024-09-14T12:09:54.645387+0000","last_fullsized":"2024-09-14T12:09:54.645387+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:20.868051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1710980,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":125002,"num_write":1055,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570899+0000","last_change":"2024-09-14T11:11:00.610641+0000","last_active":"2024-09-14T12:06:04.570899+0000","last_peered":"2024-09-14T12:06:04.570899+0000","last_clean":"2024-09-14T12:06:04.570899+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:06:04.570899+0000","last_undegraded":"2024-09-14T12:06:04.570899+0000","last_fullsized":"2024-09-14T12:06:04.570899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:34.052721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'303","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.373148+0000","last_change":"2024-09-14T11:11:02.882152+0000","last_active":"2024-09-14T12:09:54.373148+0000","last_peered":"2024-09-14T12:09:54.373148+0000","last_clean":"2024-09-14T12:09:54.373148+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:09:54.373148+0000","last_undegraded":"2024-09-14T12:09:54.373148+0000","last_fullsized":"2024-09-14T12:09:54.373148+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:00.329236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671401+0000","last_change":"2024-09-14T11:11:04.637717+0000","last_active":"2024-09-14T12:07:15.671401+0000","last_peered":"2024-09-14T12:07:15.671401+0000","last_clean":"2024-09-14T12:07:15.671401+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:07:15.671401+0000","last_undegraded":"2024-09-14T12:07:15.671401+0000","last_fullsized":"2024-09-14T12:07:15.671401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:00.714105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'131","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.877188+0000","last_change":"2024-09-14T11:11:06.644460+0000","last_active":"2024-09-14T12:09:14.877188+0000","last_peered":"2024-09-14T12:09:14.877188+0000","last_clean":"2024-09-14T12:09:14.877188+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:09:14.877188+0000","last_undegraded":"2024-09-14T12:09:14.877188+0000","last_fullsized":"2024-09-14T12:09:14.877188+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:22.358502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.587198+0000","last_change":"2024-09-14T11:10:58.609393+0000","last_active":"2024-09-14T12:07:56.587198+0000","last_peered":"2024-09-14T12:07:56.587198+0000","last_clean":"2024-09-14T12:07:56.587198+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:07:56.587198+0000","last_undegraded":"2024-09-14T12:07:56.587198+0000","last_fullsized":"2024-09-14T12:07:56.587198+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:50.454872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'358","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:38.705575+0000","last_change":"2024-09-14T11:10:56.610767+0000","last_active":"2024-09-14T12:07:38.705575+0000","last_peered":"2024-09-14T12:07:38.705575+0000","last_clean":"2024-09-14T12:07:38.705575+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:07:38.705575+0000","last_undegraded":"2024-09-14T12:07:38.705575+0000","last_fullsized":"2024-09-14T12:07:38.705575+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:42.529391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17393926,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":854,"num_read_kb":75270,"num_write":1229,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.663411+0000","last_change":"2024-09-14T11:11:00.608561+0000","last_active":"2024-09-14T12:06:00.663411+0000","last_peered":"2024-09-14T12:06:00.663411+0000","last_clean":"2024-09-14T12:06:00.663411+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:06:00.663411+0000","last_undegraded":"2024-09-14T12:06:00.663411+0000","last_fullsized":"2024-09-14T12:06:00.663411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:50.035124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'107","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580809+0000","last_change":"2024-09-14T11:11:02.882216+0000","last_active":"2024-09-14T12:07:14.580809+0000","last_peered":"2024-09-14T12:07:14.580809+0000","last_clean":"2024-09-14T12:07:14.580809+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:07:14.580809+0000","last_undegraded":"2024-09-14T12:07:14.580809+0000","last_fullsized":"2024-09-14T12:07:14.580809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.190894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'773","reported_seq":2365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:18.396781+0000","last_change":"2024-09-14T11:11:04.634837+0000","last_active":"2024-09-14T12:09:18.396781+0000","last_peered":"2024-09-14T12:09:18.396781+0000","last_clean":"2024-09-14T12:09:18.396781+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:09:18.396781+0000","last_undegraded":"2024-09-14T12:09:18.396781+0000","last_fullsized":"2024-09-14T12:09:18.396781+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:02.919719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.505956+0000","last_change":"2024-09-14T11:11:06.646662+0000","last_active":"2024-09-14T12:07:57.505956+0000","last_peered":"2024-09-14T12:07:57.505956+0000","last_clean":"2024-09-14T12:07:57.505956+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:07:57.505956+0000","last_undegraded":"2024-09-14T12:07:57.505956+0000","last_fullsized":"2024-09-14T12:07:57.505956+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:39.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570113+0000","last_change":"2024-09-14T11:10:58.612211+0000","last_active":"2024-09-14T12:05:59.570113+0000","last_peered":"2024-09-14T12:05:59.570113+0000","last_clean":"2024-09-14T12:05:59.570113+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:05:59.570113+0000","last_undegraded":"2024-09-14T12:05:59.570113+0000","last_fullsized":"2024-09-14T12:05:59.570113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.689101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'294","reported_seq":952,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.565631+0000","last_change":"2024-09-14T11:10:56.602145+0000","last_active":"2024-09-14T12:09:54.565631+0000","last_peered":"2024-09-14T12:09:54.565631+0000","last_clean":"2024-09-14T12:09:54.565631+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:09:54.565631+0000","last_undegraded":"2024-09-14T12:09:54.565631+0000","last_fullsized":"2024-09-14T12:09:54.565631+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:25.629525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":114075,"num_write":993,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570893+0000","last_change":"2024-09-14T11:11:00.608599+0000","last_active":"2024-09-14T12:06:04.570893+0000","last_peered":"2024-09-14T12:06:04.570893+0000","last_clean":"2024-09-14T12:06:04.570893+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:06:04.570893+0000","last_undegraded":"2024-09-14T12:06:04.570893+0000","last_fullsized":"2024-09-14T12:06:04.570893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:59.368073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'298","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.668526+0000","last_change":"2024-09-14T11:11:02.616575+0000","last_active":"2024-09-14T12:09:54.668526+0000","last_peered":"2024-09-14T12:09:54.668526+0000","last_clean":"2024-09-14T12:09:54.668526+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:09:54.668526+0000","last_undegraded":"2024-09-14T12:09:54.668526+0000","last_fullsized":"2024-09-14T12:09:54.668526+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:12.984482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49540,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":948,"num_write":377,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565340+0000","last_change":"2024-09-14T11:11:04.635106+0000","last_active":"2024-09-14T12:06:40.565340+0000","last_peered":"2024-09-14T12:06:40.565340+0000","last_clean":"2024-09-14T12:06:40.565340+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:06:40.565340+0000","last_undegraded":"2024-09-14T12:06:40.565340+0000","last_fullsized":"2024-09-14T12:06:40.565340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:25.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'100","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.598806+0000","last_change":"2024-09-14T11:11:06.649099+0000","last_active":"2024-09-14T12:07:54.598806+0000","last_peered":"2024-09-14T12:07:54.598806+0000","last_clean":"2024-09-14T12:07:54.598806+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:07:54.598806+0000","last_undegraded":"2024-09-14T12:07:54.598806+0000","last_fullsized":"2024-09-14T12:07:54.598806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:17.632657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.837677+0000","last_change":"2024-09-14T11:10:58.612093+0000","last_active":"2024-09-14T12:07:18.837677+0000","last_peered":"2024-09-14T12:07:18.837677+0000","last_clean":"2024-09-14T12:07:18.837677+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:07:18.837677+0000","last_undegraded":"2024-09-14T12:07:18.837677+0000","last_fullsized":"2024-09-14T12:07:18.837677+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:49.500728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'360","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.577389+0000","last_change":"2024-09-14T11:12:32.771972+0000","last_active":"2024-09-14T12:09:54.577389+0000","last_peered":"2024-09-14T12:09:54.577389+0000","last_clean":"2024-09-14T12:09:54.577389+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:09:54.577389+0000","last_undegraded":"2024-09-14T12:09:54.577389+0000","last_fullsized":"2024-09-14T12:09:54.577389+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:36.488962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":11549,"num_write":1064,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706910+0000","last_change":"2024-09-14T11:11:00.610742+0000","last_active":"2024-09-14T12:06:04.706910+0000","last_peered":"2024-09-14T12:06:04.706910+0000","last_clean":"2024-09-14T12:06:04.706910+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:06:04.706910+0000","last_undegraded":"2024-09-14T12:06:04.706910+0000","last_fullsized":"2024-09-14T12:06:04.706910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:51.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'271","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.583233+0000","last_change":"2024-09-14T11:11:02.617754+0000","last_active":"2024-09-14T12:09:05.583233+0000","last_peered":"2024-09-14T12:09:05.583233+0000","last_clean":"2024-09-14T12:09:05.583233+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:09:05.583233+0000","last_undegraded":"2024-09-14T12:09:05.583233+0000","last_fullsized":"2024-09-14T12:09:05.583233+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:03.531301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51932,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":881,"num_write":358,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.583943+0000","last_change":"2024-09-14T11:11:04.629288+0000","last_active":"2024-09-14T12:06:50.583943+0000","last_peered":"2024-09-14T12:06:50.583943+0000","last_clean":"2024-09-14T12:06:50.583943+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:06:50.583943+0000","last_undegraded":"2024-09-14T12:06:50.583943+0000","last_fullsized":"2024-09-14T12:06:50.583943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:29.995583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'105","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.593163+0000","last_change":"2024-09-14T11:11:06.648742+0000","last_active":"2024-09-14T12:07:54.593163+0000","last_peered":"2024-09-14T12:07:54.593163+0000","last_clean":"2024-09-14T12:07:54.593163+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:07:54.593163+0000","last_undegraded":"2024-09-14T12:07:54.593163+0000","last_fullsized":"2024-09-14T12:07:54.593163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:19.341185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'440","reported_seq":1196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.845766+0000","last_change":"2024-09-14T11:10:58.608774+0000","last_active":"2024-09-14T12:07:13.845766+0000","last_peered":"2024-09-14T12:07:13.845766+0000","last_clean":"2024-09-14T12:07:13.845766+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:07:13.845766+0000","last_undegraded":"2024-09-14T12:07:13.845766+0000","last_fullsized":"2024-09-14T12:07:13.845766+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.214663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'349","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.623791+0000","last_change":"2024-09-14T11:10:56.619597+0000","last_active":"2024-09-14T12:09:54.623791+0000","last_peered":"2024-09-14T12:09:54.623791+0000","last_clean":"2024-09-14T12:09:54.623791+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:09:54.623791+0000","last_undegraded":"2024-09-14T12:09:54.623791+0000","last_fullsized":"2024-09-14T12:09:54.623791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:58.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":527,"num_read_kb":1479,"num_write":1089,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575841+0000","last_change":"2024-09-14T11:11:00.613471+0000","last_active":"2024-09-14T12:06:39.575841+0000","last_peered":"2024-09-14T12:06:39.575841+0000","last_clean":"2024-09-14T12:06:39.575841+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:06:39.575841+0000","last_undegraded":"2024-09-14T12:06:39.575841+0000","last_fullsized":"2024-09-14T12:06:39.575841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:51.522567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'237","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.260926+0000","last_change":"2024-09-14T11:11:02.620023+0000","last_active":"2024-09-14T12:09:54.260926+0000","last_peered":"2024-09-14T12:09:54.260926+0000","last_clean":"2024-09-14T12:09:54.260926+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:09:54.260926+0000","last_undegraded":"2024-09-14T12:09:54.260926+0000","last_fullsized":"2024-09-14T12:09:54.260926+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.942166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570865+0000","last_change":"2024-09-14T11:11:04.636920+0000","last_active":"2024-09-14T12:06:04.570865+0000","last_peered":"2024-09-14T12:06:04.570865+0000","last_clean":"2024-09-14T12:06:04.570865+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:06:04.570865+0000","last_undegraded":"2024-09-14T12:06:04.570865+0000","last_fullsized":"2024-09-14T12:06:04.570865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:04.328783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'210","reported_seq":1682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.573850+0000","last_change":"2024-09-14T11:11:06.646323+0000","last_active":"2024-09-14T12:07:54.573850+0000","last_peered":"2024-09-14T12:07:54.573850+0000","last_clean":"2024-09-14T12:07:54.573850+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:07:54.573850+0000","last_undegraded":"2024-09-14T12:07:54.573850+0000","last_fullsized":"2024-09-14T12:07:54.573850+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:54.472116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.626310+0000","last_change":"2024-09-14T11:10:58.603025+0000","last_active":"2024-09-14T12:06:35.626310+0000","last_peered":"2024-09-14T12:06:35.626310+0000","last_clean":"2024-09-14T12:06:35.626310+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:06:35.626310+0000","last_undegraded":"2024-09-14T12:06:35.626310+0000","last_fullsized":"2024-09-14T12:06:35.626310+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:50.041412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'278","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:08.840725+0000","last_change":"2024-09-14T11:10:56.609202+0000","last_active":"2024-09-14T12:09:08.840725+0000","last_peered":"2024-09-14T12:09:08.840725+0000","last_clean":"2024-09-14T12:09:08.840725+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:09:08.840725+0000","last_undegraded":"2024-09-14T12:09:08.840725+0000","last_fullsized":"2024-09-14T12:09:08.840725+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:20.975464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1756754,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":539,"num_read_kb":4572,"num_write":1015,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:45.668134+0000","last_change":"2024-09-14T11:11:00.612948+0000","last_active":"2024-09-14T12:06:45.668134+0000","last_peered":"2024-09-14T12:06:45.668134+0000","last_clean":"2024-09-14T12:06:45.668134+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:06:45.668134+0000","last_undegraded":"2024-09-14T12:06:45.668134+0000","last_fullsized":"2024-09-14T12:06:45.668134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:59.559655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.427158+0000","last_change":"2024-09-14T11:11:02.615915+0000","last_active":"2024-09-14T12:09:54.427158+0000","last_peered":"2024-09-14T12:09:54.427158+0000","last_clean":"2024-09-14T12:09:54.427158+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:09:54.427158+0000","last_undegraded":"2024-09-14T12:09:54.427158+0000","last_fullsized":"2024-09-14T12:09:54.427158+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:13.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561147+0000","last_change":"2024-09-14T11:11:04.638367+0000","last_active":"2024-09-14T12:06:05.561147+0000","last_peered":"2024-09-14T12:06:05.561147+0000","last_clean":"2024-09-14T12:06:05.561147+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:06:05.561147+0000","last_undegraded":"2024-09-14T12:06:05.561147+0000","last_fullsized":"2024-09-14T12:06:05.561147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:16.944434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.887875+0000","last_change":"2024-09-14T11:11:06.650184+0000","last_active":"2024-09-14T12:09:13.887875+0000","last_peered":"2024-09-14T12:09:13.887875+0000","last_clean":"2024-09-14T12:09:13.887875+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:09:13.887875+0000","last_undegraded":"2024-09-14T12:09:13.887875+0000","last_fullsized":"2024-09-14T12:09:13.887875+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:56.510761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671963+0000","last_change":"2024-09-14T11:10:58.608289+0000","last_active":"2024-09-14T12:07:20.671963+0000","last_peered":"2024-09-14T12:07:20.671963+0000","last_clean":"2024-09-14T12:07:20.671963+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:07:20.671963+0000","last_undegraded":"2024-09-14T12:07:20.671963+0000","last_fullsized":"2024-09-14T12:07:20.671963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:55.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'252","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587445+0000","last_change":"2024-09-14T11:10:56.618556+0000","last_active":"2024-09-14T12:07:15.587445+0000","last_peered":"2024-09-14T12:07:15.587445+0000","last_clean":"2024-09-14T12:07:15.587445+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:07:15.587445+0000","last_undegraded":"2024-09-14T12:07:15.587445+0000","last_fullsized":"2024-09-14T12:07:15.587445+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:36.853534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10686081,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":476,"num_read_kb":25535,"num_write":953,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'180","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671944+0000","last_change":"2024-09-14T11:10:58.609726+0000","last_active":"2024-09-14T12:07:20.671944+0000","last_peered":"2024-09-14T12:07:20.671944+0000","last_clean":"2024-09-14T12:07:20.671944+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:07:20.671944+0000","last_undegraded":"2024-09-14T12:07:20.671944+0000","last_fullsized":"2024-09-14T12:07:20.671944+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:49.028498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'352","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.672330+0000","last_change":"2024-09-14T11:10:56.612746+0000","last_active":"2024-09-14T12:09:54.672330+0000","last_peered":"2024-09-14T12:09:54.672330+0000","last_clean":"2024-09-14T12:09:54.672330+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:09:54.672330+0000","last_undegraded":"2024-09-14T12:09:54.672330+0000","last_fullsized":"2024-09-14T12:09:54.672330+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:46.452349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":941,"num_read_kb":26386,"num_write":1245,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.718057+0000","last_change":"2024-09-14T11:10:58.599992+0000","last_active":"2024-09-14T12:07:19.718057+0000","last_peered":"2024-09-14T12:07:19.718057+0000","last_clean":"2024-09-14T12:07:19.718057+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:07:19.718057+0000","last_undegraded":"2024-09-14T12:07:19.718057+0000","last_fullsized":"2024-09-14T12:07:19.718057+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:35.235270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.642419+0000","last_change":"2024-09-14T11:10:56.622668+0000","last_active":"2024-09-14T12:09:54.642419+0000","last_peered":"2024-09-14T12:09:54.642419+0000","last_clean":"2024-09-14T12:09:54.642419+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:09:54.642419+0000","last_undegraded":"2024-09-14T12:09:54.642419+0000","last_fullsized":"2024-09-14T12:09:54.642419+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.252105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":585,"num_read_kb":18057,"num_write":1028,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671901+0000","last_change":"2024-09-14T11:10:58.599162+0000","last_active":"2024-09-14T12:07:20.671901+0000","last_peered":"2024-09-14T12:07:20.671901+0000","last_clean":"2024-09-14T12:07:20.671901+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:07:20.671901+0000","last_undegraded":"2024-09-14T12:07:20.671901+0000","last_fullsized":"2024-09-14T12:07:20.671901+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'287","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571357+0000","last_change":"2024-09-14T11:11:32.790442+0000","last_active":"2024-09-14T12:07:30.571357+0000","last_peered":"2024-09-14T12:07:30.571357+0000","last_clean":"2024-09-14T12:07:30.571357+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:07:30.571357+0000","last_undegraded":"2024-09-14T12:07:30.571357+0000","last_fullsized":"2024-09-14T12:07:30.571357+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:26.523306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293379,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":553,"num_read_kb":9884,"num_write":1118,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.683406+0000","last_change":"2024-09-14T11:10:58.603379+0000","last_active":"2024-09-14T12:07:24.683406+0000","last_peered":"2024-09-14T12:07:24.683406+0000","last_clean":"2024-09-14T12:07:24.683406+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:07:24.683406+0000","last_undegraded":"2024-09-14T12:07:24.683406+0000","last_fullsized":"2024-09-14T12:07:24.683406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:08.757768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'372","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615634+0000","last_change":"2024-09-14T11:10:56.619064+0000","last_active":"2024-09-14T12:09:54.615634+0000","last_peered":"2024-09-14T12:09:54.615634+0000","last_clean":"2024-09-14T12:09:54.615634+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:09:54.615634+0000","last_undegraded":"2024-09-14T12:09:54.615634+0000","last_fullsized":"2024-09-14T12:09:54.615634+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:51.621055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":691,"num_read_kb":11859,"num_write":1345,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'247","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580693+0000","last_change":"2024-09-14T11:10:58.604356+0000","last_active":"2024-09-14T12:07:14.580693+0000","last_peered":"2024-09-14T12:07:14.580693+0000","last_clean":"2024-09-14T12:07:14.580693+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:07:14.580693+0000","last_undegraded":"2024-09-14T12:07:14.580693+0000","last_fullsized":"2024-09-14T12:07:14.580693+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:09.830102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'250","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671924+0000","last_change":"2024-09-14T11:10:56.607620+0000","last_active":"2024-09-14T12:07:20.671924+0000","last_peered":"2024-09-14T12:07:20.671924+0000","last_clean":"2024-09-14T12:07:20.671924+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:07:20.671924+0000","last_undegraded":"2024-09-14T12:07:20.671924+0000","last_fullsized":"2024-09-14T12:07:20.671924+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:01.270486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16157880,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":421,"num_read_kb":36459,"num_write":904,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681847+0000","last_change":"2024-09-14T11:10:58.610796+0000","last_active":"2024-09-14T12:07:14.681847+0000","last_peered":"2024-09-14T12:07:14.681847+0000","last_clean":"2024-09-14T12:07:14.681847+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:07:14.681847+0000","last_undegraded":"2024-09-14T12:07:14.681847+0000","last_fullsized":"2024-09-14T12:07:14.681847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.802576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'379","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.625105+0000","last_change":"2024-09-14T11:11:32.791047+0000","last_active":"2024-09-14T12:09:54.625105+0000","last_peered":"2024-09-14T12:09:54.625105+0000","last_clean":"2024-09-14T12:09:54.625105+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:09:54.625105+0000","last_undegraded":"2024-09-14T12:09:54.625105+0000","last_fullsized":"2024-09-14T12:09:54.625105+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:03.370176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":760,"num_read_kb":129855,"num_write":1252,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587458+0000","last_change":"2024-09-14T11:10:58.607143+0000","last_active":"2024-09-14T12:07:15.587458+0000","last_peered":"2024-09-14T12:07:15.587458+0000","last_clean":"2024-09-14T12:07:15.587458+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:07:15.587458+0000","last_undegraded":"2024-09-14T12:07:15.587458+0000","last_fullsized":"2024-09-14T12:07:15.587458+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:11.437478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'358","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.573515+0000","last_change":"2024-09-14T11:10:56.620202+0000","last_active":"2024-09-14T12:09:54.573515+0000","last_peered":"2024-09-14T12:09:54.573515+0000","last_clean":"2024-09-14T12:09:54.573515+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:09:54.573515+0000","last_undegraded":"2024-09-14T12:09:54.573515+0000","last_fullsized":"2024-09-14T12:09:54.573515+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:43.014580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":615,"num_read_kb":2365,"num_write":1154,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567847+0000","last_change":"2024-09-14T11:10:58.614201+0000","last_active":"2024-09-14T12:07:00.567847+0000","last_peered":"2024-09-14T12:07:00.567847+0000","last_clean":"2024-09-14T12:07:00.567847+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:07:00.567847+0000","last_undegraded":"2024-09-14T12:07:00.567847+0000","last_fullsized":"2024-09-14T12:07:00.567847+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:57.400806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'343","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.590033+0000","last_change":"2024-09-14T11:10:56.606394+0000","last_active":"2024-09-14T12:09:54.590033+0000","last_peered":"2024-09-14T12:09:54.590033+0000","last_clean":"2024-09-14T12:09:54.590033+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:09:54.590033+0000","last_undegraded":"2024-09-14T12:09:54.590033+0000","last_fullsized":"2024-09-14T12:09:54.590033+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.783451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306752,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":643,"num_read_kb":15479,"num_write":1160,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578562+0000","last_change":"2024-09-14T11:10:58.609097+0000","last_active":"2024-09-14T12:06:59.578562+0000","last_peered":"2024-09-14T12:06:59.578562+0000","last_clean":"2024-09-14T12:06:59.578562+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:06:59.578562+0000","last_undegraded":"2024-09-14T12:06:59.578562+0000","last_fullsized":"2024-09-14T12:06:59.578562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:56.920723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'355","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.564692+0000","last_change":"2024-09-14T11:11:32.791033+0000","last_active":"2024-09-14T12:09:54.564692+0000","last_peered":"2024-09-14T12:09:54.564692+0000","last_clean":"2024-09-14T12:09:54.564692+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:09:54.564692+0000","last_undegraded":"2024-09-14T12:09:54.564692+0000","last_fullsized":"2024-09-14T12:09:54.564692+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:01.149980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":4745,"num_write":1095,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'455","reported_seq":1139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655648+0000","last_change":"2024-09-14T11:10:58.607355+0000","last_active":"2024-09-14T12:07:19.655648+0000","last_peered":"2024-09-14T12:07:19.655648+0000","last_clean":"2024-09-14T12:07:19.655648+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:07:19.655648+0000","last_undegraded":"2024-09-14T12:07:19.655648+0000","last_fullsized":"2024-09-14T12:07:19.655648+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:29.211083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'549","reported_seq":1351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596614+0000","last_change":"2024-09-14T11:10:56.609284+0000","last_active":"2024-09-14T12:09:54.596614+0000","last_peered":"2024-09-14T12:09:54.596614+0000","last_clean":"2024-09-14T12:09:54.596614+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:09:54.596614+0000","last_undegraded":"2024-09-14T12:09:54.596614+0000","last_fullsized":"2024-09-14T12:09:54.596614+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:15.856244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1369,"num_read_kb":53619,"num_write":1731,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'707","reported_seq":1554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580728+0000","last_change":"2024-09-14T11:10:58.605938+0000","last_active":"2024-09-14T12:07:14.580728+0000","last_peered":"2024-09-14T12:07:14.580728+0000","last_clean":"2024-09-14T12:07:14.580728+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:07:14.580728+0000","last_undegraded":"2024-09-14T12:07:14.580728+0000","last_fullsized":"2024-09-14T12:07:14.580728+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.944096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'259","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569666+0000","last_change":"2024-09-14T11:10:56.612040+0000","last_active":"2024-09-14T12:07:15.569666+0000","last_peered":"2024-09-14T12:07:15.569666+0000","last_clean":"2024-09-14T12:07:15.569666+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:07:15.569666+0000","last_undegraded":"2024-09-14T12:07:15.569666+0000","last_fullsized":"2024-09-14T12:07:15.569666+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:34.021658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10994990,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":411,"num_read_kb":10603,"num_write":968,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":709,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581159+0000","last_change":"2024-09-14T11:10:58.613360+0000","last_active":"2024-09-14T12:07:14.581159+0000","last_peered":"2024-09-14T12:07:14.581159+0000","last_clean":"2024-09-14T12:07:14.581159+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:07:14.581159+0000","last_undegraded":"2024-09-14T12:07:14.581159+0000","last_fullsized":"2024-09-14T12:07:14.581159+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.266610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'285","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.891742+0000","last_change":"2024-09-14T11:10:56.618547+0000","last_active":"2024-09-14T12:07:15.891742+0000","last_peered":"2024-09-14T12:07:15.891742+0000","last_clean":"2024-09-14T12:07:15.891742+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:07:15.891742+0000","last_undegraded":"2024-09-14T12:07:15.891742+0000","last_fullsized":"2024-09-14T12:07:15.891742+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:44.204258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8203715,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":513,"num_read_kb":12529,"num_write":1078,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569633+0000","last_change":"2024-09-14T11:10:58.613749+0000","last_active":"2024-09-14T12:07:15.569633+0000","last_peered":"2024-09-14T12:07:15.569633+0000","last_clean":"2024-09-14T12:07:15.569633+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:07:15.569633+0000","last_undegraded":"2024-09-14T12:07:15.569633+0000","last_fullsized":"2024-09-14T12:07:15.569633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.466116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'394","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.563678+0000","last_change":"2024-09-14T11:10:56.605577+0000","last_active":"2024-09-14T12:09:54.563678+0000","last_peered":"2024-09-14T12:09:54.563678+0000","last_clean":"2024-09-14T12:09:54.563678+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:09:54.563678+0000","last_undegraded":"2024-09-14T12:09:54.563678+0000","last_fullsized":"2024-09-14T12:09:54.563678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:17.688717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1373288,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":575,"num_read_kb":13605,"num_write":1183,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.093054+0000","last_change":"2024-09-14T11:10:58.609288+0000","last_active":"2024-09-14T12:07:54.093054+0000","last_peered":"2024-09-14T12:07:54.093054+0000","last_clean":"2024-09-14T12:07:54.093054+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:07:54.093054+0000","last_undegraded":"2024-09-14T12:07:54.093054+0000","last_fullsized":"2024-09-14T12:07:54.093054+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:13.226950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'340","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.562409+0000","last_change":"2024-09-14T11:10:56.610961+0000","last_active":"2024-09-14T12:09:54.562409+0000","last_peered":"2024-09-14T12:09:54.562409+0000","last_clean":"2024-09-14T12:09:54.562409+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:09:54.562409+0000","last_undegraded":"2024-09-14T12:09:54.562409+0000","last_fullsized":"2024-09-14T12:09:54.562409+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:29.522513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":673,"num_read_kb":59967,"num_write":1132,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'392","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583376+0000","last_change":"2024-09-14T11:10:58.613428+0000","last_active":"2024-09-14T12:07:29.583376+0000","last_peered":"2024-09-14T12:07:29.583376+0000","last_clean":"2024-09-14T12:07:29.583376+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:07:29.583376+0000","last_undegraded":"2024-09-14T12:07:29.583376+0000","last_fullsized":"2024-09-14T12:07:29.583376+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:14.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'329","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.655584+0000","last_change":"2024-09-14T11:10:56.608905+0000","last_active":"2024-09-14T12:09:54.655584+0000","last_peered":"2024-09-14T12:09:54.655584+0000","last_clean":"2024-09-14T12:09:54.655584+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:09:54.655584+0000","last_undegraded":"2024-09-14T12:09:54.655584+0000","last_fullsized":"2024-09-14T12:09:54.655584+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079955,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":654,"num_read_kb":22222,"num_write":1086,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615279+0000","last_change":"2024-09-14T11:10:56.602252+0000","last_active":"2024-09-14T12:09:54.615279+0000","last_peered":"2024-09-14T12:09:54.615279+0000","last_clean":"2024-09-14T12:09:54.615279+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:09:54.615279+0000","last_undegraded":"2024-09-14T12:09:54.615279+0000","last_fullsized":"2024-09-14T12:09:54.615279+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.972236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":41589,"num_write":1191,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566728+0000","last_change":"2024-09-14T11:10:58.614921+0000","last_active":"2024-09-14T12:06:50.566728+0000","last_peered":"2024-09-14T12:06:50.566728+0000","last_clean":"2024-09-14T12:06:50.566728+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:06:50.566728+0000","last_undegraded":"2024-09-14T12:06:50.566728+0000","last_fullsized":"2024-09-14T12:06:50.566728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:23.537706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'398","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669683+0000","last_change":"2024-09-14T11:11:32.677927+0000","last_active":"2024-09-14T12:07:00.669683+0000","last_peered":"2024-09-14T12:07:00.669683+0000","last_clean":"2024-09-14T12:07:00.669683+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:07:00.669683+0000","last_undegraded":"2024-09-14T12:07:00.669683+0000","last_fullsized":"2024-09-14T12:07:00.669683+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:06.109677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12071265,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":867,"num_read_kb":7347,"num_write":1267,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.782731+0000","last_change":"2024-09-14T11:10:58.606955+0000","last_active":"2024-09-14T12:07:10.782731+0000","last_peered":"2024-09-14T12:07:10.782731+0000","last_clean":"2024-09-14T12:07:10.782731+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:07:10.782731+0000","last_undegraded":"2024-09-14T12:07:10.782731+0000","last_fullsized":"2024-09-14T12:07:10.782731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:23.557773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1690,"ondisk_log_size":1690,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1725357,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":17932,"num_read_kb":36290,"num_write":15168,"num_write_kb":11953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1400832,"data_stored":1032028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2127,"ondisk_log_size":2127,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2406,"num_read_kb":2867,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":215307921,"num_objects":1704,"num_object_clones":0,"num_object_copies":5112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1704,"num_whiteouts":0,"num_read":42970,"num_read_kb":2049061,"num_write":72058,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":371613696,"data_stored":371613696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4145,"ondisk_log_size":4145,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":33557639,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":142,"num_read_kb":224799,"num_write":157,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51384320,"data_stored":51383431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":40894464,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":133,"num_read_kb":204319,"num_write":155,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101711872,"data_stored":101711872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510155,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449416,"kb_used_data":171128,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93922424,"statfs":{"total":96636764160,"available":96176562176,"internally_reserved":0,"allocated":175235072,"data_stored":173145974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":284948934},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510155,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296052,"kb_used_data":152484,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94075788,"statfs":{"total":96636764160,"available":96333606912,"internally_reserved":0,"allocated":156143616,"data_stored":154018295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510155,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398252,"kb_used_data":168540,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93973588,"statfs":{"total":96636764160,"available":96228954112,"internally_reserved":0,"allocated":172584960,"data_stored":170429111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542859,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319680,"kb_used_data":35736,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94052160,"statfs":{"total":96636764160,"available":96309411840,"internally_reserved":0,"allocated":36593664,"data_stored":34448679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":290650571},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542860,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181044,"kb_used_data":51208,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94190796,"statfs":{"total":96636764160,"available":96451375104,"internally_reserved":0,"allocated":52436992,"data_stored":50256323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542858,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146192,"kb_used_data":56652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94225648,"statfs":{"total":96636764160,"available":96487063552,"internally_reserved":0,"allocated":58011648,"data_stored":55972975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542860,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344924,"kb_used_data":75020,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94026916,"statfs":{"total":96636764160,"available":96283561984,"internally_reserved":0,"allocated":76820480,"data_stored":74679404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276363719},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542860,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106552,"kb_used_data":25360,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94265288,"statfs":{"total":96636764160,"available":96527654912,"internally_reserved":0,"allocated":25968640,"data_stored":23920772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112685056,"data_stored":112685056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103116800,"data_stored":103116800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3244032,"data_stored":3244032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2568192,"data_stored":2568192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12972032,"data_stored":12972032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5115904,"data_stored":5115904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":120254464,"data_stored":120254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11657216,"data_stored":11657216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":339374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":376771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":38629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":274020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38797312,"data_stored":38797312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9441280,"data_stored":9440391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:09:56.020 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T12:09:56.348 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:09:56.349 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":265,"fsid":"7fcb1d8c-c737-420b-b643-4fde3e2bec1a","created":"2024-09-14T11:10:27.131165+0000","modified":"2024-09-14T11:44:26.340516+0000","last_up_change":"2024-09-14T11:10:39.523268+0000","last_in_change":"2024-09-14T11:10:29.737584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:39.465616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:10:45.809466+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:10:54.584857+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:10:56.946934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:10:58.765445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:11:00.671179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:11:02.622932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:11:04.697908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:25:26.009318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:28:31.426220+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:28:35.000355+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:44:23.751838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8416495-1130-4d7b-aa59-50071b3432ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6817","nonce":3465733102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6819","nonce":3465733102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6823","nonce":3465733102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":3465733102},{"type":"v1","addr":"172.21.15.28:6821","nonce":3465733102}]},"public_addr":"172.21.15.28:6817/3465733102","cluster_addr":"172.21.15.28:6819/3465733102","heartbeat_back_addr":"172.21.15.28:6823/3465733102","heartbeat_front_addr":"172.21.15.28:6821/3465733102","state":["exists","up"]},{"osd":1,"uuid":"3bc6d9cd-3aee-46ff-b4fc-e07fa79112d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6809","nonce":2721762421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6811","nonce":2721762421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6815","nonce":2721762421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":2721762421},{"type":"v1","addr":"172.21.15.28:6813","nonce":2721762421}]},"public_addr":"172.21.15.28:6809/2721762421","cluster_addr":"172.21.15.28:6811/2721762421","heartbeat_back_addr":"172.21.15.28:6815/2721762421","heartbeat_front_addr":"172.21.15.28:6813/2721762421","state":["exists","up"]},{"osd":2,"uuid":"45921141-8cae-40d2-aa64-f56528d3172d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6801","nonce":1746144465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6803","nonce":1746144465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6807","nonce":1746144465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":1746144465},{"type":"v1","addr":"172.21.15.28:6805","nonce":1746144465}]},"public_addr":"172.21.15.28:6801/1746144465","cluster_addr":"172.21.15.28:6803/1746144465","heartbeat_back_addr":"172.21.15.28:6807/1746144465","heartbeat_front_addr":"172.21.15.28:6805/1746144465","state":["exists","up"]},{"osd":3,"uuid":"b641f1d9-0605-4c4b-a240-59434cb273fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6824","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6825","nonce":1073830879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6827","nonce":1073830879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6831","nonce":1073830879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":1073830879},{"type":"v1","addr":"172.21.15.28:6829","nonce":1073830879}]},"public_addr":"172.21.15.28:6825/1073830879","cluster_addr":"172.21.15.28:6827/1073830879","heartbeat_back_addr":"172.21.15.28:6831/1073830879","heartbeat_front_addr":"172.21.15.28:6829/1073830879","state":["exists","up"]},{"osd":4,"uuid":"f81bd758-4121-4351-aea4-5bad6cf7d6b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6809","nonce":1365453965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6811","nonce":1365453965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6815","nonce":1365453965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1365453965},{"type":"v1","addr":"172.21.15.204:6813","nonce":1365453965}]},"public_addr":"172.21.15.204:6809/1365453965","cluster_addr":"172.21.15.204:6811/1365453965","heartbeat_back_addr":"172.21.15.204:6815/1365453965","heartbeat_front_addr":"172.21.15.204:6813/1365453965","state":["exists","up"]},{"osd":5,"uuid":"215f1f2d-0b18-4059-93f7-04e871599192","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6817","nonce":3569450741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6819","nonce":3569450741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6823","nonce":3569450741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":3569450741},{"type":"v1","addr":"172.21.15.204:6821","nonce":3569450741}]},"public_addr":"172.21.15.204:6817/3569450741","cluster_addr":"172.21.15.204:6819/3569450741","heartbeat_back_addr":"172.21.15.204:6823/3569450741","heartbeat_front_addr":"172.21.15.204:6821/3569450741","state":["exists","up"]},{"osd":6,"uuid":"a4cf560d-90ac-457e-b597-2497b8f0b72e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6825","nonce":2343506808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6827","nonce":2343506808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6831","nonce":2343506808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2343506808},{"type":"v1","addr":"172.21.15.204:6829","nonce":2343506808}]},"public_addr":"172.21.15.204:6825/2343506808","cluster_addr":"172.21.15.204:6827/2343506808","heartbeat_back_addr":"172.21.15.204:6831/2343506808","heartbeat_front_addr":"172.21.15.204:6829/2343506808","state":["exists","up"]},{"osd":7,"uuid":"78d4478d-f8b6-47cf-856e-aa3e4018d402","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6801","nonce":410575023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6803","nonce":410575023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6807","nonce":410575023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":410575023},{"type":"v1","addr":"172.21.15.204:6805","nonce":410575023}]},"public_addr":"172.21.15.204:6801/410575023","cluster_addr":"172.21.15.204:6803/410575023","heartbeat_back_addr":"172.21.15.204:6807/410575023","heartbeat_front_addr":"172.21.15.204:6805/410575023","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.613894+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.527572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.173448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.053011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.066609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.178584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:36.847197+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:35.785567+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1","mappings":[{"from":4,"to":1}]},{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":6,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.39","mappings":[{"from":0,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"67.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T12:09:57.362 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T12:09:57.363 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:09:57.519 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:09:57.519 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:09:57.519 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:09:57.530 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T12:09:57.845 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T12:09:57.858 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T12:09:57.858 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:09:57.999 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:09:58.000 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:09:58.000 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:09:58.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T12:09:58.321 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T12:09:58.334 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T12:09:58.334 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:09:58.475 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:09:58.475 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:09:58.476 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:09:58.486 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T12:09:58.802 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T12:09:58.816 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T12:09:58.816 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:09:58.960 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:09:58.960 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:09:58.960 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:09:58.970 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T12:09:59.283 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T12:09:59.297 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T12:09:59.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:09:59.440 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:09:59.440 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:09:59.440 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:09:59.451 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T12:09:59.766 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T12:09:59.779 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T12:09:59.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:09:59.922 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:09:59.922 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:09:59.922 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:09:59.933 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T12:10:00.252 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T12:10:00.265 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T12:10:00.266 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:10:00.408 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:10:00.408 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:10:00.409 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:10:00.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T12:10:00.735 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T12:10:00.748 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T12:10:00.748 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T12:10:00.890 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-09-14T12:10:00.890 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T12:10:00.890 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-09-14T12:10:00.901 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T12:10:01.217 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T12:10:01.231 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:10:01.566 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:10:01.579 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:10:01.581 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2038,"stamp":"2024-09-14T12:10:00.844988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34933529,"num_objects":607,"num_object_clones":0,"num_object_copies":1495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":607,"num_whiteouts":0,"num_read":199663,"num_read_kb":2633567,"num_write":147738,"num_write_kb":2509949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13905,"ondisk_log_size":13905,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1640908,"kb_used_data":84628,"kb_used_omap":12,"kb_used_meta":1555443,"kb_avail":753333812,"statfs":{"total":773094113280,"available":771413823488,"internally_reserved":0,"allocated":86659072,"data_stored":69922534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1592774193},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-693821806,"num_objects":-4107,"num_object_clones":0,"num_object_copies":-12279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4107,"num_whiteouts":0,"num_read":4595,"num_read_kb":4138,"num_write":4358,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004659"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.714132+0000","last_change":"2024-09-14T11:44:25.351991+0000","last_active":"2024-09-14T12:06:54.714132+0000","last_peered":"2024-09-14T12:06:54.714132+0000","last_clean":"2024-09-14T12:06:54.714132+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:06:54.714132+0000","last_undegraded":"2024-09-14T12:06:54.714132+0000","last_fullsized":"2024-09-14T12:06:54.714132+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:51.739360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.707626+0000","last_change":"2024-09-14T11:28:36.255342+0000","last_active":"2024-09-14T12:06:09.707626+0000","last_peered":"2024-09-14T12:06:09.707626+0000","last_clean":"2024-09-14T12:06:09.707626+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:06:09.707626+0000","last_undegraded":"2024-09-14T12:06:09.707626+0000","last_fullsized":"2024-09-14T12:06:09.707626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.129757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.673633+0000","last_change":"2024-09-14T11:28:33.234582+0000","last_active":"2024-09-14T12:06:04.673633+0000","last_peered":"2024-09-14T12:06:04.673633+0000","last_clean":"2024-09-14T12:06:04.673633+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:06:04.673633+0000","last_undegraded":"2024-09-14T12:06:04.673633+0000","last_fullsized":"2024-09-14T12:06:04.673633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.203877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.569061+0000","last_change":"2024-09-14T11:25:27.952561+0000","last_active":"2024-09-14T12:07:10.569061+0000","last_peered":"2024-09-14T12:07:10.569061+0000","last_clean":"2024-09-14T12:07:10.569061+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:07:10.569061+0000","last_undegraded":"2024-09-14T12:07:10.569061+0000","last_fullsized":"2024-09-14T12:07:10.569061+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:17.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.651197+0000","last_change":"2024-09-14T11:44:25.353765+0000","last_active":"2024-09-14T12:06:54.651197+0000","last_peered":"2024-09-14T12:06:54.651197+0000","last_clean":"2024-09-14T12:06:54.651197+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:06:54.651197+0000","last_undegraded":"2024-09-14T12:06:54.651197+0000","last_fullsized":"2024-09-14T12:06:54.651197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:11.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593518+0000","last_change":"2024-09-14T11:28:36.260521+0000","last_active":"2024-09-14T12:08:39.593518+0000","last_peered":"2024-09-14T12:08:39.593518+0000","last_clean":"2024-09-14T12:08:39.593518+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:08:39.593518+0000","last_undegraded":"2024-09-14T12:08:39.593518+0000","last_fullsized":"2024-09-14T12:08:39.593518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:16.049764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:35.680475+0000","last_change":"2024-09-14T11:28:33.226443+0000","last_active":"2024-09-14T12:08:35.680475+0000","last_peered":"2024-09-14T12:08:35.680475+0000","last_clean":"2024-09-14T12:08:35.680475+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:08:35.680475+0000","last_undegraded":"2024-09-14T12:08:35.680475+0000","last_fullsized":"2024-09-14T12:08:35.680475+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:38.075764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.657263+0000","last_change":"2024-09-14T11:25:27.951069+0000","last_active":"2024-09-14T12:07:34.657263+0000","last_peered":"2024-09-14T12:07:34.657263+0000","last_clean":"2024-09-14T12:07:34.657263+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:07:34.657263+0000","last_undegraded":"2024-09-14T12:07:34.657263+0000","last_fullsized":"2024-09-14T12:07:34.657263+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:28.986404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.578394+0000","last_change":"2024-09-14T11:44:25.347621+0000","last_active":"2024-09-14T12:06:10.578394+0000","last_peered":"2024-09-14T12:06:10.578394+0000","last_clean":"2024-09-14T12:06:10.578394+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:06:10.578394+0000","last_undegraded":"2024-09-14T12:06:10.578394+0000","last_fullsized":"2024-09-14T12:06:10.578394+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:39.883404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'14","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.334551+0000","last_change":"2024-09-14T11:28:36.367262+0000","last_active":"2024-09-14T12:09:53.334551+0000","last_peered":"2024-09-14T12:09:53.334551+0000","last_clean":"2024-09-14T12:09:53.334551+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:09:53.334551+0000","last_undegraded":"2024-09-14T12:09:53.334551+0000","last_fullsized":"2024-09-14T12:09:53.334551+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:03.310942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":33792,"num_write":24,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.649550+0000","last_change":"2024-09-14T11:28:33.226810+0000","last_active":"2024-09-14T12:06:39.649550+0000","last_peered":"2024-09-14T12:06:39.649550+0000","last_clean":"2024-09-14T12:06:39.649550+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:06:39.649550+0000","last_undegraded":"2024-09-14T12:06:39.649550+0000","last_fullsized":"2024-09-14T12:06:39.649550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.798886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.557251+0000","last_change":"2024-09-14T11:25:27.940069+0000","last_active":"2024-09-14T12:05:30.557251+0000","last_peered":"2024-09-14T12:05:30.557251+0000","last_clean":"2024-09-14T12:05:30.557251+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:05:30.557251+0000","last_undegraded":"2024-09-14T12:05:30.557251+0000","last_fullsized":"2024-09-14T12:05:30.557251+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:45.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:19.675494+0000","last_change":"2024-09-14T11:44:25.356282+0000","last_active":"2024-09-14T12:06:19.675494+0000","last_peered":"2024-09-14T12:06:19.675494+0000","last_clean":"2024-09-14T12:06:19.675494+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:06:19.675494+0000","last_undegraded":"2024-09-14T12:06:19.675494+0000","last_fullsized":"2024-09-14T12:06:19.675494+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:56.126294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.127142+0000","last_change":"2024-09-14T11:28:36.366276+0000","last_active":"2024-09-14T12:09:53.127142+0000","last_peered":"2024-09-14T12:09:53.127142+0000","last_clean":"2024-09-14T12:09:53.127142+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:09:53.127142+0000","last_undegraded":"2024-09-14T12:09:53.127142+0000","last_fullsized":"2024-09-14T12:09:53.127142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:40.126728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589312+0000","last_change":"2024-09-14T11:28:33.228558+0000","last_active":"2024-09-14T12:08:09.589312+0000","last_peered":"2024-09-14T12:08:09.589312+0000","last_clean":"2024-09-14T12:08:09.589312+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:08:09.589312+0000","last_undegraded":"2024-09-14T12:08:09.589312+0000","last_fullsized":"2024-09-14T12:08:09.589312+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.967321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669719+0000","last_change":"2024-09-14T11:25:27.953674+0000","last_active":"2024-09-14T12:05:29.669719+0000","last_peered":"2024-09-14T12:05:29.669719+0000","last_clean":"2024-09-14T12:05:29.669719+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:05:29.669719+0000","last_undegraded":"2024-09-14T12:05:29.669719+0000","last_fullsized":"2024-09-14T12:05:29.669719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:04.652722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677327+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:06:34.677327+0000","last_peered":"2024-09-14T12:06:34.677327+0000","last_clean":"2024-09-14T12:06:34.677327+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:06:34.677327+0000","last_undegraded":"2024-09-14T12:06:34.677327+0000","last_fullsized":"2024-09-14T12:06:34.677327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.317315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:49.741974+0000","last_change":"2024-09-14T11:28:36.259291+0000","last_active":"2024-09-14T12:09:49.741974+0000","last_peered":"2024-09-14T12:09:49.741974+0000","last_clean":"2024-09-14T12:09:49.741974+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:09:49.741974+0000","last_undegraded":"2024-09-14T12:09:49.741974+0000","last_fullsized":"2024-09-14T12:09:49.741974+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:04.701036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569572+0000","last_change":"2024-09-14T11:28:33.231526+0000","last_active":"2024-09-14T12:07:15.569572+0000","last_peered":"2024-09-14T12:07:15.569572+0000","last_clean":"2024-09-14T12:07:15.569572+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:07:15.569572+0000","last_undegraded":"2024-09-14T12:07:15.569572+0000","last_fullsized":"2024-09-14T12:07:15.569572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:57.361260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669669+0000","last_change":"2024-09-14T11:25:27.952436+0000","last_active":"2024-09-14T12:05:29.669669+0000","last_peered":"2024-09-14T12:05:29.669669+0000","last_clean":"2024-09-14T12:05:29.669669+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:05:29.669669+0000","last_undegraded":"2024-09-14T12:05:29.669669+0000","last_fullsized":"2024-09-14T12:05:29.669669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:37.926867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671952+0000","last_change":"2024-09-14T11:44:25.349268+0000","last_active":"2024-09-14T12:07:20.671952+0000","last_peered":"2024-09-14T12:07:20.671952+0000","last_clean":"2024-09-14T12:07:20.671952+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:07:20.671952+0000","last_undegraded":"2024-09-14T12:07:20.671952+0000","last_fullsized":"2024-09-14T12:07:20.671952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:40.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587416+0000","last_change":"2024-09-14T11:28:36.259293+0000","last_active":"2024-09-14T12:07:15.587416+0000","last_peered":"2024-09-14T12:07:15.587416+0000","last_clean":"2024-09-14T12:07:15.587416+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:07:15.587416+0000","last_undegraded":"2024-09-14T12:07:15.587416+0000","last_fullsized":"2024-09-14T12:07:15.587416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:44.079464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582351+0000","last_change":"2024-09-14T11:28:33.230634+0000","last_active":"2024-09-14T12:07:24.582351+0000","last_peered":"2024-09-14T12:07:24.582351+0000","last_clean":"2024-09-14T12:07:24.582351+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:07:24.582351+0000","last_undegraded":"2024-09-14T12:07:24.582351+0000","last_fullsized":"2024-09-14T12:07:24.582351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.201670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.572739+0000","last_change":"2024-09-14T11:25:27.951325+0000","last_active":"2024-09-14T12:05:30.572739+0000","last_peered":"2024-09-14T12:05:30.572739+0000","last_clean":"2024-09-14T12:05:30.572739+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:05:30.572739+0000","last_undegraded":"2024-09-14T12:05:30.572739+0000","last_fullsized":"2024-09-14T12:05:30.572739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:34.624675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578552+0000","last_change":"2024-09-14T11:44:25.353198+0000","last_active":"2024-09-14T12:06:54.578552+0000","last_peered":"2024-09-14T12:06:54.578552+0000","last_clean":"2024-09-14T12:06:54.578552+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:06:54.578552+0000","last_undegraded":"2024-09-14T12:06:54.578552+0000","last_fullsized":"2024-09-14T12:06:54.578552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:09.499820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577573+0000","last_change":"2024-09-14T11:28:36.261093+0000","last_active":"2024-09-14T12:06:05.577573+0000","last_peered":"2024-09-14T12:06:05.577573+0000","last_clean":"2024-09-14T12:06:05.577573+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:06:05.577573+0000","last_undegraded":"2024-09-14T12:06:05.577573+0000","last_fullsized":"2024-09-14T12:06:05.577573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:33.800970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.592790+0000","last_change":"2024-09-14T11:28:33.231811+0000","last_active":"2024-09-14T12:08:34.592790+0000","last_peered":"2024-09-14T12:08:34.592790+0000","last_clean":"2024-09-14T12:08:34.592790+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:08:34.592790+0000","last_undegraded":"2024-09-14T12:08:34.592790+0000","last_fullsized":"2024-09-14T12:08:34.592790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:14.016741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566550+0000","last_change":"2024-09-14T11:25:27.947671+0000","last_active":"2024-09-14T12:06:50.566550+0000","last_peered":"2024-09-14T12:06:50.566550+0000","last_clean":"2024-09-14T12:06:50.566550+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:06:50.566550+0000","last_undegraded":"2024-09-14T12:06:50.566550+0000","last_fullsized":"2024-09-14T12:06:50.566550+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:21.104088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578614+0000","last_change":"2024-09-14T11:44:25.355575+0000","last_active":"2024-09-14T12:06:54.578614+0000","last_peered":"2024-09-14T12:06:54.578614+0000","last_clean":"2024-09-14T12:06:54.578614+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:06:54.578614+0000","last_undegraded":"2024-09-14T12:06:54.578614+0000","last_fullsized":"2024-09-14T12:06:54.578614+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.828628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674310+0000","last_change":"2024-09-14T11:28:36.254791+0000","last_active":"2024-09-14T12:06:09.674310+0000","last_peered":"2024-09-14T12:06:09.674310+0000","last_clean":"2024-09-14T12:06:09.674310+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:06:09.674310+0000","last_undegraded":"2024-09-14T12:06:09.674310+0000","last_fullsized":"2024-09-14T12:06:09.674310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:16.546392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561126+0000","last_change":"2024-09-14T11:28:33.230741+0000","last_active":"2024-09-14T12:06:05.561126+0000","last_peered":"2024-09-14T12:06:05.561126+0000","last_clean":"2024-09-14T12:06:05.561126+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:06:05.561126+0000","last_undegraded":"2024-09-14T12:06:05.561126+0000","last_fullsized":"2024-09-14T12:06:05.561126+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:45.191280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.667058+0000","last_change":"2024-09-14T11:25:27.942564+0000","last_active":"2024-09-14T12:06:35.667058+0000","last_peered":"2024-09-14T12:06:35.667058+0000","last_clean":"2024-09-14T12:06:35.667058+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:06:35.667058+0000","last_undegraded":"2024-09-14T12:06:35.667058+0000","last_fullsized":"2024-09-14T12:06:35.667058+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.091896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:25.659466+0000","last_change":"2024-09-14T11:44:25.351716+0000","last_active":"2024-09-14T12:05:25.659466+0000","last_peered":"2024-09-14T12:05:25.659466+0000","last_clean":"2024-09-14T12:05:25.659466+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:05:25.659466+0000","last_undegraded":"2024-09-14T12:05:25.659466+0000","last_fullsized":"2024-09-14T12:05:25.659466+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:06.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210853+0000","last_change":"2024-09-14T11:28:36.369321+0000","last_active":"2024-09-14T12:09:54.210853+0000","last_peered":"2024-09-14T12:09:54.210853+0000","last_clean":"2024-09-14T12:09:54.210853+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:09:54.210853+0000","last_undegraded":"2024-09-14T12:09:54.210853+0000","last_fullsized":"2024-09-14T12:09:54.210853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:22.989447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706081+0000","last_change":"2024-09-14T11:28:33.231360+0000","last_active":"2024-09-14T12:05:59.706081+0000","last_peered":"2024-09-14T12:05:59.706081+0000","last_clean":"2024-09-14T12:05:59.706081+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:05:59.706081+0000","last_undegraded":"2024-09-14T12:05:59.706081+0000","last_fullsized":"2024-09-14T12:05:59.706081+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.002852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564851+0000","last_change":"2024-09-14T11:25:27.949982+0000","last_active":"2024-09-14T12:06:35.564851+0000","last_peered":"2024-09-14T12:06:35.564851+0000","last_clean":"2024-09-14T12:06:35.564851+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:06:35.564851+0000","last_undegraded":"2024-09-14T12:06:35.564851+0000","last_fullsized":"2024-09-14T12:06:35.564851+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:12.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.641872+0000","last_change":"2024-09-14T11:44:25.346519+0000","last_active":"2024-09-14T12:05:24.641872+0000","last_peered":"2024-09-14T12:05:24.641872+0000","last_clean":"2024-09-14T12:05:24.641872+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:05:24.641872+0000","last_undegraded":"2024-09-14T12:05:24.641872+0000","last_fullsized":"2024-09-14T12:05:24.641872+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:51.127961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674369+0000","last_change":"2024-09-14T11:28:36.367601+0000","last_active":"2024-09-14T12:06:09.674369+0000","last_peered":"2024-09-14T12:06:09.674369+0000","last_clean":"2024-09-14T12:06:09.674369+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:06:09.674369+0000","last_undegraded":"2024-09-14T12:06:09.674369+0000","last_fullsized":"2024-09-14T12:06:09.674369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:47.572025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581225+0000","last_change":"2024-09-14T11:28:33.228389+0000","last_active":"2024-09-14T12:07:14.581225+0000","last_peered":"2024-09-14T12:07:14.581225+0000","last_clean":"2024-09-14T12:07:14.581225+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:07:14.581225+0000","last_undegraded":"2024-09-14T12:07:14.581225+0000","last_fullsized":"2024-09-14T12:07:14.581225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:11.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677357+0000","last_change":"2024-09-14T11:25:27.953781+0000","last_active":"2024-09-14T12:06:34.677357+0000","last_peered":"2024-09-14T12:06:34.677357+0000","last_clean":"2024-09-14T12:06:34.677357+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:06:34.677357+0000","last_undegraded":"2024-09-14T12:06:34.677357+0000","last_fullsized":"2024-09-14T12:06:34.677357+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.652754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.564302+0000","last_change":"2024-09-14T11:44:25.348811+0000","last_active":"2024-09-14T12:05:24.564302+0000","last_peered":"2024-09-14T12:05:24.564302+0000","last_clean":"2024-09-14T12:05:24.564302+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:05:24.564302+0000","last_undegraded":"2024-09-14T12:05:24.564302+0000","last_fullsized":"2024-09-14T12:05:24.564302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:32.650432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682708+0000","last_change":"2024-09-14T11:28:36.369256+0000","last_active":"2024-09-14T12:07:19.682708+0000","last_peered":"2024-09-14T12:07:19.682708+0000","last_clean":"2024-09-14T12:07:19.682708+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:07:19.682708+0000","last_undegraded":"2024-09-14T12:07:19.682708+0000","last_fullsized":"2024-09-14T12:07:19.682708+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:54.707659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653192+0000","last_change":"2024-09-14T11:28:33.233405+0000","last_active":"2024-09-14T12:07:14.653192+0000","last_peered":"2024-09-14T12:07:14.653192+0000","last_clean":"2024-09-14T12:07:14.653192+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:07:14.653192+0000","last_undegraded":"2024-09-14T12:07:14.653192+0000","last_fullsized":"2024-09-14T12:07:14.653192+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649083+0000","last_change":"2024-09-14T11:25:27.945742+0000","last_active":"2024-09-14T12:06:34.649083+0000","last_peered":"2024-09-14T12:06:34.649083+0000","last_clean":"2024-09-14T12:06:34.649083+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:06:34.649083+0000","last_undegraded":"2024-09-14T12:06:34.649083+0000","last_fullsized":"2024-09-14T12:06:34.649083+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:48.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:24.700955+0000","last_change":"2024-09-14T11:44:25.352981+0000","last_active":"2024-09-14T12:05:24.700955+0000","last_peered":"2024-09-14T12:05:24.700955+0000","last_clean":"2024-09-14T12:05:24.700955+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:05:24.700955+0000","last_undegraded":"2024-09-14T12:05:24.700955+0000","last_fullsized":"2024-09-14T12:05:24.700955+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:28.913462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581671+0000","last_change":"2024-09-14T11:28:36.261453+0000","last_active":"2024-09-14T12:07:19.581671+0000","last_peered":"2024-09-14T12:07:19.581671+0000","last_clean":"2024-09-14T12:07:19.581671+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:07:19.581671+0000","last_undegraded":"2024-09-14T12:07:19.581671+0000","last_fullsized":"2024-09-14T12:07:19.581671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:40.588548+0000","last_change":"2024-09-14T11:28:33.226734+0000","last_active":"2024-09-14T12:09:40.588548+0000","last_peered":"2024-09-14T12:09:40.588548+0000","last_clean":"2024-09-14T12:09:40.588548+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:09:40.588548+0000","last_undegraded":"2024-09-14T12:09:40.588548+0000","last_fullsized":"2024-09-14T12:09:40.588548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584878+0000","last_change":"2024-09-14T11:25:27.950879+0000","last_active":"2024-09-14T12:07:39.584878+0000","last_peered":"2024-09-14T12:07:39.584878+0000","last_clean":"2024-09-14T12:07:39.584878+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:07:39.584878+0000","last_undegraded":"2024-09-14T12:07:39.584878+0000","last_fullsized":"2024-09-14T12:07:39.584878+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:13.451590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674442+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:06:09.674442+0000","last_peered":"2024-09-14T12:06:09.674442+0000","last_clean":"2024-09-14T12:06:09.674442+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:06:09.674442+0000","last_undegraded":"2024-09-14T12:06:09.674442+0000","last_fullsized":"2024-09-14T12:06:09.674442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.648826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662808+0000","last_change":"2024-09-14T11:28:36.257731+0000","last_active":"2024-09-14T12:05:55.662808+0000","last_peered":"2024-09-14T12:05:55.662808+0000","last_clean":"2024-09-14T12:05:55.662808+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:05:55.662808+0000","last_undegraded":"2024-09-14T12:05:55.662808+0000","last_fullsized":"2024-09-14T12:05:55.662808+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:03.144550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.569273+0000","last_change":"2024-09-14T11:28:33.232810+0000","last_active":"2024-09-14T12:05:54.569273+0000","last_peered":"2024-09-14T12:05:54.569273+0000","last_clean":"2024-09-14T12:05:54.569273+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:05:54.569273+0000","last_undegraded":"2024-09-14T12:05:54.569273+0000","last_fullsized":"2024-09-14T12:05:54.569273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:44.564156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583435+0000","last_change":"2024-09-14T11:25:27.949859+0000","last_active":"2024-09-14T12:07:29.583435+0000","last_peered":"2024-09-14T12:07:29.583435+0000","last_clean":"2024-09-14T12:07:29.583435+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:07:29.583435+0000","last_undegraded":"2024-09-14T12:07:29.583435+0000","last_fullsized":"2024-09-14T12:07:29.583435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:45.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561924+0000","last_change":"2024-09-14T11:44:25.355586+0000","last_active":"2024-09-14T12:06:10.561924+0000","last_peered":"2024-09-14T12:06:10.561924+0000","last_clean":"2024-09-14T12:06:10.561924+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:06:10.561924+0000","last_undegraded":"2024-09-14T12:06:10.561924+0000","last_fullsized":"2024-09-14T12:06:10.561924+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:15.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662766+0000","last_change":"2024-09-14T11:28:36.261024+0000","last_active":"2024-09-14T12:05:55.662766+0000","last_peered":"2024-09-14T12:05:55.662766+0000","last_clean":"2024-09-14T12:05:55.662766+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:05:55.662766+0000","last_undegraded":"2024-09-14T12:05:55.662766+0000","last_fullsized":"2024-09-14T12:05:55.662766+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.672323+0000","last_change":"2024-09-14T11:28:33.229372+0000","last_active":"2024-09-14T12:05:54.672323+0000","last_peered":"2024-09-14T12:05:54.672323+0000","last_clean":"2024-09-14T12:05:54.672323+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:05:54.672323+0000","last_undegraded":"2024-09-14T12:05:54.672323+0000","last_fullsized":"2024-09-14T12:05:54.672323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:23.134165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571324+0000","last_change":"2024-09-14T11:25:27.945571+0000","last_active":"2024-09-14T12:07:30.571324+0000","last_peered":"2024-09-14T12:07:30.571324+0000","last_clean":"2024-09-14T12:07:30.571324+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:07:30.571324+0000","last_undegraded":"2024-09-14T12:07:30.571324+0000","last_fullsized":"2024-09-14T12:07:30.571324+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:07.890808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:35.557794+0000","last_change":"2024-09-14T11:44:25.351774+0000","last_active":"2024-09-14T12:05:35.557794+0000","last_peered":"2024-09-14T12:05:35.557794+0000","last_clean":"2024-09-14T12:05:35.557794+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:05:35.557794+0000","last_undegraded":"2024-09-14T12:05:35.557794+0000","last_fullsized":"2024-09-14T12:05:35.557794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:35.350297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.406287+0000","last_change":"2024-09-14T11:28:36.257478+0000","last_active":"2024-09-14T12:09:53.406287+0000","last_peered":"2024-09-14T12:09:53.406287+0000","last_clean":"2024-09-14T12:09:53.406287+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:09:53.406287+0000","last_undegraded":"2024-09-14T12:09:53.406287+0000","last_fullsized":"2024-09-14T12:09:53.406287+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:23.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:15.596168+0000","last_change":"2024-09-14T11:28:33.226764+0000","last_active":"2024-09-14T12:08:15.596168+0000","last_peered":"2024-09-14T12:08:15.596168+0000","last_clean":"2024-09-14T12:08:15.596168+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:08:15.596168+0000","last_undegraded":"2024-09-14T12:08:15.596168+0000","last_fullsized":"2024-09-14T12:08:15.596168+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.256510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583059+0000","last_change":"2024-09-14T11:25:27.946060+0000","last_active":"2024-09-14T12:07:29.583059+0000","last_peered":"2024-09-14T12:07:29.583059+0000","last_clean":"2024-09-14T12:07:29.583059+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:07:29.583059+0000","last_undegraded":"2024-09-14T12:07:29.583059+0000","last_fullsized":"2024-09-14T12:07:29.583059+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:07.686737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674405+0000","last_change":"2024-09-14T11:44:25.350108+0000","last_active":"2024-09-14T12:06:09.674405+0000","last_peered":"2024-09-14T12:06:09.674405+0000","last_clean":"2024-09-14T12:06:09.674405+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:06:09.674405+0000","last_undegraded":"2024-09-14T12:06:09.674405+0000","last_fullsized":"2024-09-14T12:06:09.674405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:05.638059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576237+0000","last_change":"2024-09-14T11:28:36.254787+0000","last_active":"2024-09-14T12:05:55.576237+0000","last_peered":"2024-09-14T12:05:55.576237+0000","last_clean":"2024-09-14T12:05:55.576237+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:05:55.576237+0000","last_undegraded":"2024-09-14T12:05:55.576237+0000","last_fullsized":"2024-09-14T12:05:55.576237+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:50.371867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.726150+0000","last_change":"2024-09-14T11:28:33.230870+0000","last_active":"2024-09-14T12:08:14.726150+0000","last_peered":"2024-09-14T12:08:14.726150+0000","last_clean":"2024-09-14T12:08:14.726150+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:08:14.726150+0000","last_undegraded":"2024-09-14T12:08:14.726150+0000","last_fullsized":"2024-09-14T12:08:14.726150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.098373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.683991+0000","last_change":"2024-09-14T11:25:27.953081+0000","last_active":"2024-09-14T12:07:29.683991+0000","last_peered":"2024-09-14T12:07:29.683991+0000","last_clean":"2024-09-14T12:07:29.683991+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:07:29.683991+0000","last_undegraded":"2024-09-14T12:07:29.683991+0000","last_fullsized":"2024-09-14T12:07:29.683991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:37.718041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646069+0000","last_change":"2024-09-14T11:44:25.347178+0000","last_active":"2024-09-14T12:06:04.646069+0000","last_peered":"2024-09-14T12:06:04.646069+0000","last_clean":"2024-09-14T12:06:04.646069+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:06:04.646069+0000","last_undegraded":"2024-09-14T12:06:04.646069+0000","last_fullsized":"2024-09-14T12:06:04.646069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.558120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679683+0000","last_change":"2024-09-14T11:28:36.257470+0000","last_active":"2024-09-14T12:06:54.679683+0000","last_peered":"2024-09-14T12:06:54.679683+0000","last_clean":"2024-09-14T12:06:54.679683+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:06:54.679683+0000","last_undegraded":"2024-09-14T12:06:54.679683+0000","last_fullsized":"2024-09-14T12:06:54.679683+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.008987+0000","last_change":"2024-09-14T11:28:33.233762+0000","last_active":"2024-09-14T12:09:54.008987+0000","last_peered":"2024-09-14T12:09:54.008987+0000","last_clean":"2024-09-14T12:09:54.008987+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:09:54.008987+0000","last_undegraded":"2024-09-14T12:09:54.008987+0000","last_fullsized":"2024-09-14T12:09:54.008987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:03.013761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674471+0000","last_change":"2024-09-14T11:25:27.950690+0000","last_active":"2024-09-14T12:06:09.674471+0000","last_peered":"2024-09-14T12:06:09.674471+0000","last_clean":"2024-09-14T12:06:09.674471+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:06:09.674471+0000","last_undegraded":"2024-09-14T12:06:09.674471+0000","last_fullsized":"2024-09-14T12:06:09.674471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:51.496056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578529+0000","last_change":"2024-09-14T11:44:25.354265+0000","last_active":"2024-09-14T12:06:54.578529+0000","last_peered":"2024-09-14T12:06:54.578529+0000","last_clean":"2024-09-14T12:06:54.578529+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:06:54.578529+0000","last_undegraded":"2024-09-14T12:06:54.578529+0000","last_fullsized":"2024-09-14T12:06:54.578529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.737799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679648+0000","last_change":"2024-09-14T11:28:36.254946+0000","last_active":"2024-09-14T12:06:54.679648+0000","last_peered":"2024-09-14T12:06:54.679648+0000","last_clean":"2024-09-14T12:06:54.679648+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:06:54.679648+0000","last_undegraded":"2024-09-14T12:06:54.679648+0000","last_fullsized":"2024-09-14T12:06:54.679648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:55.651650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.876445+0000","last_change":"2024-09-14T11:28:33.228679+0000","last_active":"2024-09-14T12:09:52.876445+0000","last_peered":"2024-09-14T12:09:52.876445+0000","last_clean":"2024-09-14T12:09:52.876445+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:09:52.876445+0000","last_undegraded":"2024-09-14T12:09:52.876445+0000","last_fullsized":"2024-09-14T12:09:52.876445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706137+0000","last_change":"2024-09-14T11:25:27.949880+0000","last_active":"2024-09-14T12:05:59.706137+0000","last_peered":"2024-09-14T12:05:59.706137+0000","last_clean":"2024-09-14T12:05:59.706137+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:05:59.706137+0000","last_undegraded":"2024-09-14T12:05:59.706137+0000","last_fullsized":"2024-09-14T12:05:59.706137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.896653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577462+0000","last_change":"2024-09-14T11:44:25.340707+0000","last_active":"2024-09-14T12:06:05.577462+0000","last_peered":"2024-09-14T12:06:05.577462+0000","last_clean":"2024-09-14T12:06:05.577462+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:06:05.577462+0000","last_undegraded":"2024-09-14T12:06:05.577462+0000","last_fullsized":"2024-09-14T12:06:05.577462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:41.520475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669775+0000","last_change":"2024-09-14T11:28:36.367731+0000","last_active":"2024-09-14T12:07:00.669775+0000","last_peered":"2024-09-14T12:07:00.669775+0000","last_clean":"2024-09-14T12:07:00.669775+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:07:00.669775+0000","last_undegraded":"2024-09-14T12:07:00.669775+0000","last_fullsized":"2024-09-14T12:07:00.669775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:55.831862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566673+0000","last_change":"2024-09-14T11:28:33.231847+0000","last_active":"2024-09-14T12:06:50.566673+0000","last_peered":"2024-09-14T12:06:50.566673+0000","last_clean":"2024-09-14T12:06:50.566673+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:06:50.566673+0000","last_undegraded":"2024-09-14T12:06:50.566673+0000","last_fullsized":"2024-09-14T12:06:50.566673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:38.952131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.576926+0000","last_change":"2024-09-14T11:25:27.950496+0000","last_active":"2024-09-14T12:06:00.576926+0000","last_peered":"2024-09-14T12:06:00.576926+0000","last_clean":"2024-09-14T12:06:00.576926+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:06:00.576926+0000","last_undegraded":"2024-09-14T12:06:00.576926+0000","last_fullsized":"2024-09-14T12:06:00.576926+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.743937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570818+0000","last_change":"2024-09-14T11:44:25.347374+0000","last_active":"2024-09-14T12:06:04.570818+0000","last_peered":"2024-09-14T12:06:04.570818+0000","last_clean":"2024-09-14T12:06:04.570818+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:06:04.570818+0000","last_undegraded":"2024-09-14T12:06:04.570818+0000","last_fullsized":"2024-09-14T12:06:04.570818+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:02.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679699+0000","last_change":"2024-09-14T11:28:36.256404+0000","last_active":"2024-09-14T12:06:54.679699+0000","last_peered":"2024-09-14T12:06:54.679699+0000","last_clean":"2024-09-14T12:06:54.679699+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:06:54.679699+0000","last_undegraded":"2024-09-14T12:06:54.679699+0000","last_fullsized":"2024-09-14T12:06:54.679699+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:18.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.335330+0000","last_change":"2024-09-14T11:28:33.227452+0000","last_active":"2024-09-14T12:09:53.335330+0000","last_peered":"2024-09-14T12:09:53.335330+0000","last_clean":"2024-09-14T12:09:53.335330+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:09:53.335330+0000","last_undegraded":"2024-09-14T12:09:53.335330+0000","last_fullsized":"2024-09-14T12:09:53.335330+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.149389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.645601+0000","last_change":"2024-09-14T11:25:27.954496+0000","last_active":"2024-09-14T12:05:59.645601+0000","last_peered":"2024-09-14T12:05:59.645601+0000","last_clean":"2024-09-14T12:05:59.645601+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:05:59.645601+0000","last_undegraded":"2024-09-14T12:05:59.645601+0000","last_fullsized":"2024-09-14T12:05:59.645601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:03.897519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679716+0000","last_change":"2024-09-14T11:44:25.355046+0000","last_active":"2024-09-14T12:06:54.679716+0000","last_peered":"2024-09-14T12:06:54.679716+0000","last_clean":"2024-09-14T12:06:54.679716+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:06:54.679716+0000","last_undegraded":"2024-09-14T12:06:54.679716+0000","last_fullsized":"2024-09-14T12:06:54.679716+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.119733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.955962+0000","last_change":"2024-09-14T11:28:36.260180+0000","last_active":"2024-09-14T12:09:52.955962+0000","last_peered":"2024-09-14T12:09:52.955962+0000","last_clean":"2024-09-14T12:09:52.955962+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:09:52.955962+0000","last_undegraded":"2024-09-14T12:09:52.955962+0000","last_fullsized":"2024-09-14T12:09:52.955962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:35.619938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571885+0000","last_change":"2024-09-14T11:28:33.230223+0000","last_active":"2024-09-14T12:07:35.571885+0000","last_peered":"2024-09-14T12:07:35.571885+0000","last_clean":"2024-09-14T12:07:35.571885+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:07:35.571885+0000","last_undegraded":"2024-09-14T12:07:35.571885+0000","last_fullsized":"2024-09-14T12:07:35.571885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:17.221998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.560556+0000","last_change":"2024-09-14T11:25:27.953095+0000","last_active":"2024-09-14T12:06:00.560556+0000","last_peered":"2024-09-14T12:06:00.560556+0000","last_clean":"2024-09-14T12:06:00.560556+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:06:00.560556+0000","last_undegraded":"2024-09-14T12:06:00.560556+0000","last_fullsized":"2024-09-14T12:06:00.560556+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:58.766336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579278+0000","last_change":"2024-09-14T11:44:25.354056+0000","last_active":"2024-09-14T12:06:59.579278+0000","last_peered":"2024-09-14T12:06:59.579278+0000","last_clean":"2024-09-14T12:06:59.579278+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:06:59.579278+0000","last_undegraded":"2024-09-14T12:06:59.579278+0000","last_fullsized":"2024-09-14T12:06:59.579278+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.958850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.131052+0000","last_change":"2024-09-14T11:28:36.365890+0000","last_active":"2024-09-14T12:09:53.131052+0000","last_peered":"2024-09-14T12:09:53.131052+0000","last_clean":"2024-09-14T12:09:53.131052+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:09:53.131052+0000","last_undegraded":"2024-09-14T12:09:53.131052+0000","last_fullsized":"2024-09-14T12:09:53.131052+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.017356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.673401+0000","last_change":"2024-09-14T11:28:33.228030+0000","last_active":"2024-09-14T12:07:35.673401+0000","last_peered":"2024-09-14T12:07:35.673401+0000","last_clean":"2024-09-14T12:07:35.673401+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:07:35.673401+0000","last_undegraded":"2024-09-14T12:07:35.673401+0000","last_fullsized":"2024-09-14T12:07:35.673401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:06.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577681+0000","last_change":"2024-09-14T11:25:27.950183+0000","last_active":"2024-09-14T12:06:49.577681+0000","last_peered":"2024-09-14T12:06:49.577681+0000","last_clean":"2024-09-14T12:06:49.577681+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:06:49.577681+0000","last_undegraded":"2024-09-14T12:06:49.577681+0000","last_fullsized":"2024-09-14T12:06:49.577681+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:47.768324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578564+0000","last_change":"2024-09-14T11:44:25.351682+0000","last_active":"2024-09-14T12:06:54.578564+0000","last_peered":"2024-09-14T12:06:54.578564+0000","last_clean":"2024-09-14T12:06:54.578564+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:06:54.578564+0000","last_undegraded":"2024-09-14T12:06:54.578564+0000","last_fullsized":"2024-09-14T12:06:54.578564+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:33.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.684181+0000","last_change":"2024-09-14T11:28:36.252721+0000","last_active":"2024-09-14T12:09:05.684181+0000","last_peered":"2024-09-14T12:09:05.684181+0000","last_clean":"2024-09-14T12:09:05.684181+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:09:05.684181+0000","last_undegraded":"2024-09-14T12:09:05.684181+0000","last_fullsized":"2024-09-14T12:09:05.684181+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:40.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17937,"num_write":8,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.082484+0000","last_change":"2024-09-14T11:28:33.228385+0000","last_active":"2024-09-14T12:09:54.082484+0000","last_peered":"2024-09-14T12:09:54.082484+0000","last_clean":"2024-09-14T12:09:54.082484+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:09:54.082484+0000","last_undegraded":"2024-09-14T12:09:54.082484+0000","last_fullsized":"2024-09-14T12:09:54.082484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:36.884948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.677912+0000","last_change":"2024-09-14T11:25:27.951396+0000","last_active":"2024-09-14T12:06:39.677912+0000","last_peered":"2024-09-14T12:06:39.677912+0000","last_clean":"2024-09-14T12:06:39.677912+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:06:39.677912+0000","last_undegraded":"2024-09-14T12:06:39.677912+0000","last_fullsized":"2024-09-14T12:06:39.677912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.372583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:55.567242+0000","last_change":"2024-09-14T11:44:25.356594+0000","last_active":"2024-09-14T12:06:55.567242+0000","last_peered":"2024-09-14T12:06:55.567242+0000","last_clean":"2024-09-14T12:06:55.567242+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:06:55.567242+0000","last_undegraded":"2024-09-14T12:06:55.567242+0000","last_fullsized":"2024-09-14T12:06:55.567242+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.437539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585586+0000","last_change":"2024-09-14T11:29:33.340403+0000","last_active":"2024-09-14T12:07:44.585586+0000","last_peered":"2024-09-14T12:07:44.585586+0000","last_clean":"2024-09-14T12:07:44.585586+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:07:44.585586+0000","last_undegraded":"2024-09-14T12:07:44.585586+0000","last_fullsized":"2024-09-14T12:07:44.585586+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:46.256090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577175+0000","last_change":"2024-09-14T11:28:33.230335+0000","last_active":"2024-09-14T12:06:49.577175+0000","last_peered":"2024-09-14T12:06:49.577175+0000","last_clean":"2024-09-14T12:06:49.577175+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:06:49.577175+0000","last_undegraded":"2024-09-14T12:06:49.577175+0000","last_fullsized":"2024-09-14T12:06:49.577175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:57.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582421+0000","last_change":"2024-09-14T11:25:27.949670+0000","last_active":"2024-09-14T12:06:40.582421+0000","last_peered":"2024-09-14T12:06:40.582421+0000","last_clean":"2024-09-14T12:06:40.582421+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:06:40.582421+0000","last_undegraded":"2024-09-14T12:06:40.582421+0000","last_fullsized":"2024-09-14T12:06:40.582421+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:26.893035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581926+0000","last_change":"2024-09-14T11:44:25.351860+0000","last_active":"2024-09-14T12:07:19.581926+0000","last_peered":"2024-09-14T12:07:19.581926+0000","last_clean":"2024-09-14T12:07:19.581926+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:07:19.581926+0000","last_undegraded":"2024-09-14T12:07:19.581926+0000","last_fullsized":"2024-09-14T12:07:19.581926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:01.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:15.562475+0000","last_change":"2024-09-14T11:28:36.252024+0000","last_active":"2024-09-14T12:06:15.562475+0000","last_peered":"2024-09-14T12:06:15.562475+0000","last_clean":"2024-09-14T12:06:15.562475+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:06:15.562475+0000","last_undegraded":"2024-09-14T12:06:15.562475+0000","last_fullsized":"2024-09-14T12:06:15.562475+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:46.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.405443+0000","last_change":"2024-09-14T11:28:33.229236+0000","last_active":"2024-09-14T12:09:53.405443+0000","last_peered":"2024-09-14T12:09:53.405443+0000","last_clean":"2024-09-14T12:09:53.405443+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:09:53.405443+0000","last_undegraded":"2024-09-14T12:09:53.405443+0000","last_fullsized":"2024-09-14T12:09:53.405443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:46.128928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565430+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:06:40.565430+0000","last_peered":"2024-09-14T12:06:40.565430+0000","last_clean":"2024-09-14T12:06:40.565430+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:06:40.565430+0000","last_undegraded":"2024-09-14T12:06:40.565430+0000","last_fullsized":"2024-09-14T12:06:40.565430+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:53.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717994+0000","last_change":"2024-09-14T11:44:25.350439+0000","last_active":"2024-09-14T12:07:19.717994+0000","last_peered":"2024-09-14T12:07:19.717994+0000","last_clean":"2024-09-14T12:07:19.717994+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:07:19.717994+0000","last_undegraded":"2024-09-14T12:07:19.717994+0000","last_fullsized":"2024-09-14T12:07:19.717994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:24.626683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:10.576144+0000","last_change":"2024-09-14T11:28:36.365847+0000","last_active":"2024-09-14T12:08:10.576144+0000","last_peered":"2024-09-14T12:08:10.576144+0000","last_clean":"2024-09-14T12:08:10.576144+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:08:10.576144+0000","last_undegraded":"2024-09-14T12:08:10.576144+0000","last_fullsized":"2024-09-14T12:08:10.576144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:26.254693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.661792+0000","last_change":"2024-09-14T11:28:33.228362+0000","last_active":"2024-09-14T12:08:14.661792+0000","last_peered":"2024-09-14T12:08:14.661792+0000","last_clean":"2024-09-14T12:08:14.661792+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:08:14.661792+0000","last_undegraded":"2024-09-14T12:08:14.661792+0000","last_fullsized":"2024-09-14T12:08:14.661792+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:47.879475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582495+0000","last_change":"2024-09-14T11:25:27.948331+0000","last_active":"2024-09-14T12:06:40.582495+0000","last_peered":"2024-09-14T12:06:40.582495+0000","last_clean":"2024-09-14T12:06:40.582495+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:06:40.582495+0000","last_undegraded":"2024-09-14T12:06:40.582495+0000","last_fullsized":"2024-09-14T12:06:40.582495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:11.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:30.666552+0000","last_change":"2024-09-14T11:44:25.351133+0000","last_active":"2024-09-14T12:06:30.666552+0000","last_peered":"2024-09-14T12:06:30.666552+0000","last_clean":"2024-09-14T12:06:30.666552+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:06:30.666552+0000","last_undegraded":"2024-09-14T12:06:30.666552+0000","last_fullsized":"2024-09-14T12:06:30.666552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:44.289131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584940+0000","last_change":"2024-09-14T11:28:36.367086+0000","last_active":"2024-09-14T12:07:39.584940+0000","last_peered":"2024-09-14T12:07:39.584940+0000","last_clean":"2024-09-14T12:07:39.584940+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:07:39.584940+0000","last_undegraded":"2024-09-14T12:07:39.584940+0000","last_fullsized":"2024-09-14T12:07:39.584940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.893706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.720510+0000","last_change":"2024-09-14T11:28:33.231027+0000","last_active":"2024-09-14T12:07:34.720510+0000","last_peered":"2024-09-14T12:07:34.720510+0000","last_clean":"2024-09-14T12:07:34.720510+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:07:34.720510+0000","last_undegraded":"2024-09-14T12:07:34.720510+0000","last_fullsized":"2024-09-14T12:07:34.720510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.425071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582020+0000","last_change":"2024-09-14T11:25:27.948199+0000","last_active":"2024-09-14T12:07:19.582020+0000","last_peered":"2024-09-14T12:07:19.582020+0000","last_clean":"2024-09-14T12:07:19.582020+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:07:19.582020+0000","last_undegraded":"2024-09-14T12:07:19.582020+0000","last_fullsized":"2024-09-14T12:07:19.582020+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:39.351483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581534+0000","last_change":"2024-09-14T11:44:25.354049+0000","last_active":"2024-09-14T12:07:19.581534+0000","last_peered":"2024-09-14T12:07:19.581534+0000","last_clean":"2024-09-14T12:07:19.581534+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:07:19.581534+0000","last_undegraded":"2024-09-14T12:07:19.581534+0000","last_fullsized":"2024-09-14T12:07:19.581534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:06.436515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584665+0000","last_change":"2024-09-14T11:28:36.260053+0000","last_active":"2024-09-14T12:07:39.584665+0000","last_peered":"2024-09-14T12:07:39.584665+0000","last_clean":"2024-09-14T12:07:39.584665+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:07:39.584665+0000","last_undegraded":"2024-09-14T12:07:39.584665+0000","last_fullsized":"2024-09-14T12:07:39.584665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.584214+0000","last_change":"2024-09-14T11:28:33.233002+0000","last_active":"2024-09-14T12:07:34.584214+0000","last_peered":"2024-09-14T12:07:34.584214+0000","last_clean":"2024-09-14T12:07:34.584214+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:07:34.584214+0000","last_undegraded":"2024-09-14T12:07:34.584214+0000","last_fullsized":"2024-09-14T12:07:34.584214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:57.509567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670809+0000","last_change":"2024-09-14T11:25:27.948445+0000","last_active":"2024-09-14T12:07:10.670809+0000","last_peered":"2024-09-14T12:07:10.670809+0000","last_clean":"2024-09-14T12:07:10.670809+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:07:10.670809+0000","last_undegraded":"2024-09-14T12:07:10.670809+0000","last_fullsized":"2024-09-14T12:07:10.670809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646115+0000","last_change":"2024-09-14T11:44:25.348388+0000","last_active":"2024-09-14T12:06:04.646115+0000","last_peered":"2024-09-14T12:06:04.646115+0000","last_clean":"2024-09-14T12:06:04.646115+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:06:04.646115+0000","last_undegraded":"2024-09-14T12:06:04.646115+0000","last_fullsized":"2024-09-14T12:06:04.646115+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:30.181019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:10.677755+0000","last_change":"2024-09-14T11:28:36.257342+0000","last_active":"2024-09-14T12:08:10.677755+0000","last_peered":"2024-09-14T12:08:10.677755+0000","last_clean":"2024-09-14T12:08:10.677755+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:08:10.677755+0000","last_undegraded":"2024-09-14T12:08:10.677755+0000","last_fullsized":"2024-09-14T12:08:10.677755+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:31.845998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576072+0000","last_change":"2024-09-14T11:28:33.228459+0000","last_active":"2024-09-14T12:06:39.576072+0000","last_peered":"2024-09-14T12:06:39.576072+0000","last_clean":"2024-09-14T12:06:39.576072+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:06:39.576072+0000","last_undegraded":"2024-09-14T12:06:39.576072+0000","last_fullsized":"2024-09-14T12:06:39.576072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:32.489364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716392+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:07:09.716392+0000","last_peered":"2024-09-14T12:07:09.716392+0000","last_clean":"2024-09-14T12:07:09.716392+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:07:09.716392+0000","last_undegraded":"2024-09-14T12:07:09.716392+0000","last_fullsized":"2024-09-14T12:07:09.716392+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:20.912923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561205+0000","last_change":"2024-09-14T11:44:25.353177+0000","last_active":"2024-09-14T12:06:05.561205+0000","last_peered":"2024-09-14T12:06:05.561205+0000","last_clean":"2024-09-14T12:06:05.561205+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:06:05.561205+0000","last_undegraded":"2024-09-14T12:06:05.561205+0000","last_fullsized":"2024-09-14T12:06:05.561205+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:44.730416+0000","last_change":"2024-09-14T11:28:36.256678+0000","last_active":"2024-09-14T12:08:44.730416+0000","last_peered":"2024-09-14T12:08:44.730416+0000","last_clean":"2024-09-14T12:08:44.730416+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:08:44.730416+0000","last_undegraded":"2024-09-14T12:08:44.730416+0000","last_fullsized":"2024-09-14T12:08:44.730416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:25.852294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:09.589335+0000","last_change":"2024-09-14T11:28:33.232601+0000","last_active":"2024-09-14T12:08:09.589335+0000","last_peered":"2024-09-14T12:08:09.589335+0000","last_clean":"2024-09-14T12:08:09.589335+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:08:09.589335+0000","last_undegraded":"2024-09-14T12:08:09.589335+0000","last_fullsized":"2024-09-14T12:08:09.589335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:05.331738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.579944+0000","last_change":"2024-09-14T11:25:27.949489+0000","last_active":"2024-09-14T12:07:09.579944+0000","last_peered":"2024-09-14T12:07:09.579944+0000","last_clean":"2024-09-14T12:07:09.579944+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:07:09.579944+0000","last_undegraded":"2024-09-14T12:07:09.579944+0000","last_fullsized":"2024-09-14T12:07:09.579944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:23.544881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570267+0000","last_change":"2024-09-14T11:44:25.353056+0000","last_active":"2024-09-14T12:07:20.570267+0000","last_peered":"2024-09-14T12:07:20.570267+0000","last_clean":"2024-09-14T12:07:20.570267+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:07:20.570267+0000","last_undegraded":"2024-09-14T12:07:20.570267+0000","last_fullsized":"2024-09-14T12:07:20.570267+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:07.137155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'8","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:10.595335+0000","last_change":"2024-09-14T11:28:36.259431+0000","last_active":"2024-09-14T12:08:10.595335+0000","last_peered":"2024-09-14T12:08:10.595335+0000","last_clean":"2024-09-14T12:08:10.595335+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:08:10.595335+0000","last_undegraded":"2024-09-14T12:08:10.595335+0000","last_fullsized":"2024-09-14T12:08:10.595335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:17.716269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'9","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.545056+0000","last_change":"2024-09-14T11:28:33.227906+0000","last_active":"2024-09-14T12:09:53.545056+0000","last_peered":"2024-09-14T12:09:53.545056+0000","last_clean":"2024-09-14T12:09:53.545056+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:09:53.545056+0000","last_undegraded":"2024-09-14T12:09:53.545056+0000","last_fullsized":"2024-09-14T12:09:53.545056+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.498353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586665+0000","last_change":"2024-09-14T11:25:27.946605+0000","last_active":"2024-09-14T12:07:10.586665+0000","last_peered":"2024-09-14T12:07:10.586665+0000","last_clean":"2024-09-14T12:07:10.586665+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:07:10.586665+0000","last_undegraded":"2024-09-14T12:07:10.586665+0000","last_fullsized":"2024-09-14T12:07:10.586665+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.771354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582789+0000","last_change":"2024-09-14T11:44:25.355567+0000","last_active":"2024-09-14T12:07:24.582789+0000","last_peered":"2024-09-14T12:07:24.582789+0000","last_clean":"2024-09-14T12:07:24.582789+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:07:24.582789+0000","last_undegraded":"2024-09-14T12:07:24.582789+0000","last_fullsized":"2024-09-14T12:07:24.582789+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:15.391313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.589963+0000","last_change":"2024-09-14T11:28:36.260711+0000","last_active":"2024-09-14T12:08:14.589963+0000","last_peered":"2024-09-14T12:08:14.589963+0000","last_clean":"2024-09-14T12:08:14.589963+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:08:14.589963+0000","last_undegraded":"2024-09-14T12:08:14.589963+0000","last_fullsized":"2024-09-14T12:08:14.589963+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:01.074793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577559+0000","last_change":"2024-09-14T11:28:33.228247+0000","last_active":"2024-09-14T12:06:05.577559+0000","last_peered":"2024-09-14T12:06:05.577559+0000","last_clean":"2024-09-14T12:06:05.577559+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:06:05.577559+0000","last_undegraded":"2024-09-14T12:06:05.577559+0000","last_fullsized":"2024-09-14T12:06:05.577559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:40.279213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584808+0000","last_change":"2024-09-14T11:25:27.949061+0000","last_active":"2024-09-14T12:07:39.584808+0000","last_peered":"2024-09-14T12:07:39.584808+0000","last_clean":"2024-09-14T12:07:39.584808+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:07:39.584808+0000","last_undegraded":"2024-09-14T12:07:39.584808+0000","last_fullsized":"2024-09-14T12:07:39.584808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'367","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.799208+0000","last_change":"2024-09-14T11:10:56.613934+0000","last_active":"2024-09-14T12:09:54.799208+0000","last_peered":"2024-09-14T12:09:54.799208+0000","last_clean":"2024-09-14T12:09:54.799208+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:09:54.799208+0000","last_undegraded":"2024-09-14T12:09:54.799208+0000","last_fullsized":"2024-09-14T12:09:54.799208+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:28.319510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":757,"num_read_kb":12872,"num_write":1136,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":786,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706012+0000","last_change":"2024-09-14T11:10:58.598689+0000","last_active":"2024-09-14T12:05:59.706012+0000","last_peered":"2024-09-14T12:05:59.706012+0000","last_clean":"2024-09-14T12:05:59.706012+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:05:59.706012+0000","last_undegraded":"2024-09-14T12:05:59.706012+0000","last_fullsized":"2024-09-14T12:05:59.706012+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:53.624721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'341","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.612793+0000","last_change":"2024-09-14T11:10:56.605326+0000","last_active":"2024-09-14T12:09:54.612793+0000","last_peered":"2024-09-14T12:09:54.612793+0000","last_clean":"2024-09-14T12:09:54.612793+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:09:54.612793+0000","last_undegraded":"2024-09-14T12:09:54.612793+0000","last_fullsized":"2024-09-14T12:09:54.612793+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:33.763107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":30246,"num_write":1175,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.570100+0000","last_change":"2024-09-14T11:10:58.608424+0000","last_active":"2024-09-14T12:06:59.570100+0000","last_peered":"2024-09-14T12:06:59.570100+0000","last_clean":"2024-09-14T12:06:59.570100+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:06:59.570100+0000","last_undegraded":"2024-09-14T12:06:59.570100+0000","last_fullsized":"2024-09-14T12:06:59.570100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:41.148772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'341","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.793719+0000","last_change":"2024-09-14T11:10:56.604528+0000","last_active":"2024-09-14T12:09:54.793719+0000","last_peered":"2024-09-14T12:09:54.793719+0000","last_clean":"2024-09-14T12:09:54.793719+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:09:54.793719+0000","last_undegraded":"2024-09-14T12:09:54.793719+0000","last_fullsized":"2024-09-14T12:09:54.793719+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:47.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":3312,"num_write":1178,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":807,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570086+0000","last_change":"2024-09-14T11:10:58.615535+0000","last_active":"2024-09-14T12:05:59.570086+0000","last_peered":"2024-09-14T12:05:59.570086+0000","last_clean":"2024-09-14T12:05:59.570086+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:05:59.570086+0000","last_undegraded":"2024-09-14T12:05:59.570086+0000","last_fullsized":"2024-09-14T12:05:59.570086+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:23.713342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'370","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.788683+0000","last_change":"2024-09-14T11:10:56.622380+0000","last_active":"2024-09-14T12:09:54.788683+0000","last_peered":"2024-09-14T12:09:54.788683+0000","last_clean":"2024-09-14T12:09:54.788683+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:09:54.788683+0000","last_undegraded":"2024-09-14T12:09:54.788683+0000","last_fullsized":"2024-09-14T12:09:54.788683+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:24.100508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5058,"num_write":1126,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.372308+0000","last_change":"2024-09-14T11:10:58.615687+0000","last_active":"2024-09-14T12:07:57.372308+0000","last_peered":"2024-09-14T12:07:57.372308+0000","last_clean":"2024-09-14T12:07:57.372308+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:07:57.372308+0000","last_undegraded":"2024-09-14T12:07:57.372308+0000","last_fullsized":"2024-09-14T12:07:57.372308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:15.535728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'332","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.628148+0000","last_change":"2024-09-14T11:10:56.606180+0000","last_active":"2024-09-14T12:09:54.628148+0000","last_peered":"2024-09-14T12:09:54.628148+0000","last_clean":"2024-09-14T12:09:54.628148+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:09:54.628148+0000","last_undegraded":"2024-09-14T12:09:54.628148+0000","last_fullsized":"2024-09-14T12:09:54.628148+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:57.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":17822,"num_write":1000,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'252","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586768+0000","last_change":"2024-09-14T11:10:58.607840+0000","last_active":"2024-09-14T12:07:10.586768+0000","last_peered":"2024-09-14T12:07:10.586768+0000","last_clean":"2024-09-14T12:07:10.586768+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:07:10.586768+0000","last_undegraded":"2024-09-14T12:07:10.586768+0000","last_fullsized":"2024-09-14T12:07:10.586768+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:18.282965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.620476+0000","last_change":"2024-09-14T11:10:56.622630+0000","last_active":"2024-09-14T12:09:54.620476+0000","last_peered":"2024-09-14T12:09:54.620476+0000","last_clean":"2024-09-14T12:09:54.620476+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:09:54.620476+0000","last_undegraded":"2024-09-14T12:09:54.620476+0000","last_fullsized":"2024-09-14T12:09:54.620476+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:13.408043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580767+0000","last_change":"2024-09-14T11:10:58.604181+0000","last_active":"2024-09-14T12:07:14.580767+0000","last_peered":"2024-09-14T12:07:14.580767+0000","last_clean":"2024-09-14T12:07:14.580767+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:07:14.580767+0000","last_undegraded":"2024-09-14T12:07:14.580767+0000","last_fullsized":"2024-09-14T12:07:14.580767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:47.312582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'350","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.664150+0000","last_change":"2024-09-14T11:11:32.791169+0000","last_active":"2024-09-14T12:09:54.664150+0000","last_peered":"2024-09-14T12:09:54.664150+0000","last_clean":"2024-09-14T12:09:54.664150+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:09:54.664150+0000","last_undegraded":"2024-09-14T12:09:54.664150+0000","last_fullsized":"2024-09-14T12:09:54.664150+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:51.316430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":627,"num_read_kb":84521,"num_write":1155,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.717225+0000","last_change":"2024-09-14T11:10:58.601531+0000","last_active":"2024-09-14T12:07:14.717225+0000","last_peered":"2024-09-14T12:07:14.717225+0000","last_clean":"2024-09-14T12:07:14.717225+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:07:14.717225+0000","last_undegraded":"2024-09-14T12:07:14.717225+0000","last_fullsized":"2024-09-14T12:07:14.717225+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.466412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.676169+0000","last_change":"2024-09-14T11:10:56.614815+0000","last_active":"2024-09-14T12:09:54.676169+0000","last_peered":"2024-09-14T12:09:54.676169+0000","last_clean":"2024-09-14T12:09:54.676169+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:09:54.676169+0000","last_undegraded":"2024-09-14T12:09:54.676169+0000","last_fullsized":"2024-09-14T12:09:54.676169+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:17.495958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653214+0000","last_change":"2024-09-14T11:10:58.612690+0000","last_active":"2024-09-14T12:07:14.653214+0000","last_peered":"2024-09-14T12:07:14.653214+0000","last_clean":"2024-09-14T12:07:14.653214+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:07:14.653214+0000","last_undegraded":"2024-09-14T12:07:14.653214+0000","last_fullsized":"2024-09-14T12:07:14.653214+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:43.860956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578450+0000","last_change":"2024-09-14T11:10:58.613992+0000","last_active":"2024-09-14T12:06:59.578450+0000","last_peered":"2024-09-14T12:06:59.578450+0000","last_clean":"2024-09-14T12:06:59.578450+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:06:59.578450+0000","last_undegraded":"2024-09-14T12:06:59.578450+0000","last_fullsized":"2024-09-14T12:06:59.578450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:16.941594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'376","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.792989+0000","last_change":"2024-09-14T11:10:56.611500+0000","last_active":"2024-09-14T12:09:54.792989+0000","last_peered":"2024-09-14T12:09:54.792989+0000","last_clean":"2024-09-14T12:09:54.792989+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:09:54.792989+0000","last_undegraded":"2024-09-14T12:09:54.792989+0000","last_fullsized":"2024-09-14T12:09:54.792989+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:25.416890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159838,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":4801,"num_write":1283,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579198+0000","last_change":"2024-09-14T11:10:58.608218+0000","last_active":"2024-09-14T12:06:59.579198+0000","last_peered":"2024-09-14T12:06:59.579198+0000","last_clean":"2024-09-14T12:06:59.579198+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:06:59.579198+0000","last_undegraded":"2024-09-14T12:06:59.579198+0000","last_fullsized":"2024-09-14T12:06:59.579198+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:48.756943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'314","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.649163+0000","last_change":"2024-09-14T11:10:56.610804+0000","last_active":"2024-09-14T12:09:54.649163+0000","last_peered":"2024-09-14T12:09:54.649163+0000","last_clean":"2024-09-14T12:09:54.649163+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:09:54.649163+0000","last_undegraded":"2024-09-14T12:09:54.649163+0000","last_fullsized":"2024-09-14T12:09:54.649163+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:54.575624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":568,"num_read_kb":2774,"num_write":998,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716372+0000","last_change":"2024-09-14T11:10:58.603033+0000","last_active":"2024-09-14T12:07:09.716372+0000","last_peered":"2024-09-14T12:07:09.716372+0000","last_clean":"2024-09-14T12:07:09.716372+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:07:09.716372+0000","last_undegraded":"2024-09-14T12:07:09.716372+0000","last_fullsized":"2024-09-14T12:07:09.716372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:05.684294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'334","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.631814+0000","last_change":"2024-09-14T11:10:56.617586+0000","last_active":"2024-09-14T12:09:54.631814+0000","last_peered":"2024-09-14T12:09:54.631814+0000","last_clean":"2024-09-14T12:09:54.631814+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:09:54.631814+0000","last_undegraded":"2024-09-14T12:09:54.631814+0000","last_fullsized":"2024-09-14T12:09:54.631814+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:28.064756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":52006,"num_write":1108,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:17.637379+0000","last_change":"2024-09-14T11:10:58.612342+0000","last_active":"2024-09-14T12:07:17.637379+0000","last_peered":"2024-09-14T12:07:17.637379+0000","last_clean":"2024-09-14T12:07:17.637379+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:07:17.637379+0000","last_undegraded":"2024-09-14T12:07:17.637379+0000","last_fullsized":"2024-09-14T12:07:17.637379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:26.730612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'371","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.671963+0000","last_change":"2024-09-14T11:10:56.622021+0000","last_active":"2024-09-14T12:09:54.671963+0000","last_peered":"2024-09-14T12:09:54.671963+0000","last_clean":"2024-09-14T12:09:54.671963+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:09:54.671963+0000","last_undegraded":"2024-09-14T12:09:54.671963+0000","last_fullsized":"2024-09-14T12:09:54.671963+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:59.040554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1062,"num_read_kb":40711,"num_write":1149,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":694,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649064+0000","last_change":"2024-09-14T11:10:58.606489+0000","last_active":"2024-09-14T12:06:34.649064+0000","last_peered":"2024-09-14T12:06:34.649064+0000","last_clean":"2024-09-14T12:06:34.649064+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:06:34.649064+0000","last_undegraded":"2024-09-14T12:06:34.649064+0000","last_fullsized":"2024-09-14T12:06:34.649064+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.112863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'337","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.788944+0000","last_change":"2024-09-14T11:10:56.618036+0000","last_active":"2024-09-14T12:09:54.788944+0000","last_peered":"2024-09-14T12:09:54.788944+0000","last_clean":"2024-09-14T12:09:54.788944+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:09:54.788944+0000","last_undegraded":"2024-09-14T12:09:54.788944+0000","last_fullsized":"2024-09-14T12:09:54.788944+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.228155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254516,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":58308,"num_write":1138,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.575165+0000","last_change":"2024-09-14T11:10:58.599593+0000","last_active":"2024-09-14T12:06:34.575165+0000","last_peered":"2024-09-14T12:06:34.575165+0000","last_clean":"2024-09-14T12:06:34.575165+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:06:34.575165+0000","last_undegraded":"2024-09-14T12:06:34.575165+0000","last_fullsized":"2024-09-14T12:06:34.575165+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.706476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'412","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.784118+0000","last_change":"2024-09-14T11:10:56.624205+0000","last_active":"2024-09-14T12:09:54.784118+0000","last_peered":"2024-09-14T12:09:54.784118+0000","last_clean":"2024-09-14T12:09:54.784118+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:09:54.784118+0000","last_undegraded":"2024-09-14T12:09:54.784118+0000","last_fullsized":"2024-09-14T12:09:54.784118+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:53.380556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":94295,"num_write":1155,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'189","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.512796+0000","last_change":"2024-09-14T11:11:06.654536+0000","last_active":"2024-09-14T12:07:57.512796+0000","last_peered":"2024-09-14T12:07:57.512796+0000","last_clean":"2024-09-14T12:07:57.512796+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:07:57.512796+0000","last_undegraded":"2024-09-14T12:07:57.512796+0000","last_fullsized":"2024-09-14T12:07:57.512796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:45.779160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'122","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.657726+0000","last_change":"2024-09-14T11:11:32.678345+0000","last_active":"2024-09-14T12:07:39.657726+0000","last_peered":"2024-09-14T12:07:39.657726+0000","last_clean":"2024-09-14T12:07:39.657726+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:07:39.657726+0000","last_undegraded":"2024-09-14T12:07:39.657726+0000","last_fullsized":"2024-09-14T12:07:39.657726+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'488","reported_seq":1222,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.628065+0000","last_change":"2024-09-14T11:10:56.614109+0000","last_active":"2024-09-14T12:09:54.628065+0000","last_peered":"2024-09-14T12:09:54.628065+0000","last_clean":"2024-09-14T12:09:54.628065+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:09:54.628065+0000","last_undegraded":"2024-09-14T12:09:54.628065+0000","last_fullsized":"2024-09-14T12:09:54.628065+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:14.548683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":951,"num_read_kb":68364,"num_write":1403,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711914+0000","last_change":"2024-09-14T11:11:00.612390+0000","last_active":"2024-09-14T12:06:39.711914+0000","last_peered":"2024-09-14T12:06:39.711914+0000","last_clean":"2024-09-14T12:06:39.711914+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:06:39.711914+0000","last_undegraded":"2024-09-14T12:06:39.711914+0000","last_fullsized":"2024-09-14T12:06:39.711914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.711231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'321","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.790438+0000","last_change":"2024-09-14T11:11:02.616888+0000","last_active":"2024-09-14T12:09:53.790438+0000","last_peered":"2024-09-14T12:09:53.790438+0000","last_clean":"2024-09-14T12:09:53.790438+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:09:53.790438+0000","last_undegraded":"2024-09-14T12:09:53.790438+0000","last_fullsized":"2024-09-14T12:09:53.790438+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:38.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1030,"num_write":396,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576286+0000","last_change":"2024-09-14T11:11:04.630024+0000","last_active":"2024-09-14T12:06:39.576286+0000","last_peered":"2024-09-14T12:06:39.576286+0000","last_clean":"2024-09-14T12:06:39.576286+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:06:39.576286+0000","last_undegraded":"2024-09-14T12:06:39.576286+0000","last_fullsized":"2024-09-14T12:06:39.576286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.568217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.875581+0000","last_change":"2024-09-14T11:11:06.647460+0000","last_active":"2024-09-14T12:09:13.875581+0000","last_peered":"2024-09-14T12:09:13.875581+0000","last_clean":"2024-09-14T12:09:13.875581+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:09:13.875581+0000","last_undegraded":"2024-09-14T12:09:13.875581+0000","last_fullsized":"2024-09-14T12:09:13.875581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:13.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.840018+0000","last_change":"2024-09-14T11:10:58.598908+0000","last_active":"2024-09-14T12:06:34.840018+0000","last_peered":"2024-09-14T12:06:34.840018+0000","last_clean":"2024-09-14T12:06:34.840018+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:06:34.840018+0000","last_undegraded":"2024-09-14T12:06:34.840018+0000","last_fullsized":"2024-09-14T12:06:34.840018+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:45.457809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'285","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.047316+0000","last_change":"2024-09-14T12:09:59.047316+0000","last_active":"2024-09-14T12:09:59.047316+0000","last_peered":"2024-09-14T12:09:59.047316+0000","last_clean":"2024-09-14T12:09:59.047316+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:09:59.047316+0000","last_undegraded":"2024-09-14T12:09:59.047316+0000","last_fullsized":"2024-09-14T12:09:59.047316+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'285","last_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_deep_scrub":"265'285","last_deep_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.047215+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:06.088837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":825,"num_read_kb":44655,"num_write":1001,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681915+0000","last_change":"2024-09-14T11:11:00.610829+0000","last_active":"2024-09-14T12:07:14.681915+0000","last_peered":"2024-09-14T12:07:14.681915+0000","last_clean":"2024-09-14T12:07:14.681915+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:07:14.681915+0000","last_undegraded":"2024-09-14T12:07:14.681915+0000","last_fullsized":"2024-09-14T12:07:14.681915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:59.756124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.887529+0000","last_change":"2024-09-14T11:11:02.616223+0000","last_active":"2024-09-14T12:07:04.887529+0000","last_peered":"2024-09-14T12:07:04.887529+0000","last_clean":"2024-09-14T12:07:04.887529+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:07:04.887529+0000","last_undegraded":"2024-09-14T12:07:04.887529+0000","last_fullsized":"2024-09-14T12:07:04.887529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.797468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575949+0000","last_change":"2024-09-14T11:11:04.636341+0000","last_active":"2024-09-14T12:06:39.575949+0000","last_peered":"2024-09-14T12:06:39.575949+0000","last_clean":"2024-09-14T12:06:39.575949+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:06:39.575949+0000","last_undegraded":"2024-09-14T12:06:39.575949+0000","last_fullsized":"2024-09-14T12:06:39.575949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:29.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'146","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561795+0000","last_change":"2024-09-14T11:11:06.647305+0000","last_active":"2024-09-14T12:06:10.561795+0000","last_peered":"2024-09-14T12:06:10.561795+0000","last_clean":"2024-09-14T12:06:10.561795+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:06:10.561795+0000","last_undegraded":"2024-09-14T12:06:10.561795+0000","last_fullsized":"2024-09-14T12:06:10.561795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:31.457028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564820+0000","last_change":"2024-09-14T11:10:58.615755+0000","last_active":"2024-09-14T12:06:35.564820+0000","last_peered":"2024-09-14T12:06:35.564820+0000","last_clean":"2024-09-14T12:06:35.564820+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:06:35.564820+0000","last_undegraded":"2024-09-14T12:06:35.564820+0000","last_fullsized":"2024-09-14T12:06:35.564820+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:50.889127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'405","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.807704+0000","last_change":"2024-09-14T11:10:56.614555+0000","last_active":"2024-09-14T12:09:54.807704+0000","last_peered":"2024-09-14T12:09:54.807704+0000","last_clean":"2024-09-14T12:09:54.807704+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:09:54.807704+0000","last_undegraded":"2024-09-14T12:09:54.807704+0000","last_fullsized":"2024-09-14T12:09:54.807704+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:18.411468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":632,"num_read_kb":37555,"num_write":1183,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.678008+0000","last_change":"2024-09-14T11:11:00.613697+0000","last_active":"2024-09-14T12:06:39.678008+0000","last_peered":"2024-09-14T12:06:39.678008+0000","last_clean":"2024-09-14T12:06:39.678008+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:06:39.678008+0000","last_undegraded":"2024-09-14T12:06:39.678008+0000","last_fullsized":"2024-09-14T12:06:39.678008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:02.212530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'117","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.652713+0000","last_change":"2024-09-14T11:11:02.616784+0000","last_active":"2024-09-14T12:07:09.652713+0000","last_peered":"2024-09-14T12:07:09.652713+0000","last_clean":"2024-09-14T12:07:09.652713+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:07:09.652713+0000","last_undegraded":"2024-09-14T12:07:09.652713+0000","last_fullsized":"2024-09-14T12:07:09.652713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:51.199047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'770","reported_seq":2413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.141834+0000","last_change":"2024-09-14T11:11:04.634733+0000","last_active":"2024-09-14T12:09:54.141834+0000","last_peered":"2024-09-14T12:09:54.141834+0000","last_clean":"2024-09-14T12:09:54.141834+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:09:54.141834+0000","last_undegraded":"2024-09-14T12:09:54.141834+0000","last_fullsized":"2024-09-14T12:09:54.141834+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.929041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'217","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.572311+0000","last_change":"2024-09-14T11:11:06.650554+0000","last_active":"2024-09-14T12:07:57.572311+0000","last_peered":"2024-09-14T12:07:57.572311+0000","last_clean":"2024-09-14T12:07:57.572311+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:07:57.572311+0000","last_undegraded":"2024-09-14T12:07:57.572311+0000","last_fullsized":"2024-09-14T12:07:57.572311+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:31.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.883384+0000","last_change":"2024-09-14T11:10:58.602798+0000","last_active":"2024-09-14T12:07:04.883384+0000","last_peered":"2024-09-14T12:07:04.883384+0000","last_clean":"2024-09-14T12:07:04.883384+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:07:04.883384+0000","last_undegraded":"2024-09-14T12:07:04.883384+0000","last_fullsized":"2024-09-14T12:07:04.883384+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.362755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'422","reported_seq":1122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.563351+0000","last_change":"2024-09-14T11:10:56.612227+0000","last_active":"2024-09-14T12:09:54.563351+0000","last_peered":"2024-09-14T12:09:54.563351+0000","last_clean":"2024-09-14T12:09:54.563351+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:09:54.563351+0000","last_undegraded":"2024-09-14T12:09:54.563351+0000","last_fullsized":"2024-09-14T12:09:54.563351+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:54.163614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1004,"num_read_kb":6071,"num_write":1268,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711951+0000","last_change":"2024-09-14T11:11:00.611895+0000","last_active":"2024-09-14T12:06:39.711951+0000","last_peered":"2024-09-14T12:06:39.711951+0000","last_clean":"2024-09-14T12:06:39.711951+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:06:39.711951+0000","last_undegraded":"2024-09-14T12:06:39.711951+0000","last_fullsized":"2024-09-14T12:06:39.711951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:07.634034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.469446+0000","last_change":"2024-09-14T11:11:02.883054+0000","last_active":"2024-09-14T12:09:53.469446+0000","last_peered":"2024-09-14T12:09:53.469446+0000","last_clean":"2024-09-14T12:09:53.469446+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:09:53.469446+0000","last_undegraded":"2024-09-14T12:09:53.469446+0000","last_fullsized":"2024-09-14T12:09:53.469446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:16.798635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'792","reported_seq":2488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.288675+0000","last_change":"2024-09-14T11:11:04.639858+0000","last_active":"2024-09-14T12:09:54.288675+0000","last_peered":"2024-09-14T12:09:54.288675+0000","last_clean":"2024-09-14T12:09:54.288675+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:09:54.288675+0000","last_undegraded":"2024-09-14T12:09:54.288675+0000","last_fullsized":"2024-09-14T12:09:54.288675+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:13.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717940+0000","last_change":"2024-09-14T11:10:58.598011+0000","last_active":"2024-09-14T12:07:19.717940+0000","last_peered":"2024-09-14T12:07:19.717940+0000","last_clean":"2024-09-14T12:07:19.717940+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:07:19.717940+0000","last_undegraded":"2024-09-14T12:07:19.717940+0000","last_fullsized":"2024-09-14T12:07:19.717940+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:52.644545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'373","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.621836+0000","last_change":"2024-09-14T11:10:56.616170+0000","last_active":"2024-09-14T12:09:54.621836+0000","last_peered":"2024-09-14T12:09:54.621836+0000","last_clean":"2024-09-14T12:09:54.621836+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:09:54.621836+0000","last_undegraded":"2024-09-14T12:09:54.621836+0000","last_fullsized":"2024-09-14T12:09:54.621836+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:36.161974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343358,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":30361,"num_write":1111,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582730+0000","last_change":"2024-09-14T11:11:00.603633+0000","last_active":"2024-09-14T12:07:24.582730+0000","last_peered":"2024-09-14T12:07:24.582730+0000","last_clean":"2024-09-14T12:07:24.582730+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:07:24.582730+0000","last_undegraded":"2024-09-14T12:07:24.582730+0000","last_fullsized":"2024-09-14T12:07:24.582730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:24.637144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'380","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.075411+0000","last_change":"2024-09-14T11:11:02.882354+0000","last_active":"2024-09-14T12:09:54.075411+0000","last_peered":"2024-09-14T12:09:54.075411+0000","last_clean":"2024-09-14T12:09:54.075411+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:09:54.075411+0000","last_undegraded":"2024-09-14T12:09:54.075411+0000","last_fullsized":"2024-09-14T12:09:54.075411+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:23.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671886+0000","last_change":"2024-09-14T11:11:04.630742+0000","last_active":"2024-09-14T12:07:20.671886+0000","last_peered":"2024-09-14T12:07:20.671886+0000","last_clean":"2024-09-14T12:07:20.671886+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:07:20.671886+0000","last_undegraded":"2024-09-14T12:07:20.671886+0000","last_fullsized":"2024-09-14T12:07:20.671886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:21.580563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'537","reported_seq":1354,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.874293+0000","last_change":"2024-09-14T11:11:06.650569+0000","last_active":"2024-09-14T12:09:14.874293+0000","last_peered":"2024-09-14T12:09:14.874293+0000","last_clean":"2024-09-14T12:09:14.874293+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:09:14.874293+0000","last_undegraded":"2024-09-14T12:09:14.874293+0000","last_fullsized":"2024-09-14T12:09:14.874293+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.704565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.881520+0000","last_change":"2024-09-14T11:10:58.600081+0000","last_active":"2024-09-14T12:09:13.881520+0000","last_peered":"2024-09-14T12:09:13.881520+0000","last_clean":"2024-09-14T12:09:13.881520+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:09:13.881520+0000","last_undegraded":"2024-09-14T12:09:13.881520+0000","last_fullsized":"2024-09-14T12:09:13.881520+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:49.242910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'384","reported_seq":1126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.656497+0000","last_change":"2024-09-14T11:10:56.608381+0000","last_active":"2024-09-14T12:09:54.656497+0000","last_peered":"2024-09-14T12:09:54.656497+0000","last_clean":"2024-09-14T12:09:54.656497+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:09:54.656497+0000","last_undegraded":"2024-09-14T12:09:54.656497+0000","last_fullsized":"2024-09-14T12:09:54.656497+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:44.373341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":916,"num_read_kb":57128,"num_write":1152,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656137+0000","last_change":"2024-09-14T11:11:00.610368+0000","last_active":"2024-09-14T12:07:24.656137+0000","last_peered":"2024-09-14T12:07:24.656137+0000","last_clean":"2024-09-14T12:07:24.656137+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:07:24.656137+0000","last_undegraded":"2024-09-14T12:07:24.656137+0000","last_fullsized":"2024-09-14T12:07:24.656137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:41.032264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'270","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.724302+0000","last_change":"2024-09-14T11:11:02.620109+0000","last_active":"2024-09-14T12:09:52.724302+0000","last_peered":"2024-09-14T12:09:52.724302+0000","last_clean":"2024-09-14T12:09:52.724302+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:09:52.724302+0000","last_undegraded":"2024-09-14T12:09:52.724302+0000","last_fullsized":"2024-09-14T12:09:52.724302+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:44.080763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.684553+0000","last_change":"2024-09-14T11:11:04.638763+0000","last_active":"2024-09-14T12:07:34.684553+0000","last_peered":"2024-09-14T12:07:34.684553+0000","last_clean":"2024-09-14T12:07:34.684553+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:07:34.684553+0000","last_undegraded":"2024-09-14T12:07:34.684553+0000","last_fullsized":"2024-09-14T12:07:34.684553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:07.104699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2496","reported_seq":4317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.077061+0000","last_change":"2024-09-14T11:11:06.650408+0000","last_active":"2024-09-14T12:09:04.077061+0000","last_peered":"2024-09-14T12:09:04.077061+0000","last_clean":"2024-09-14T12:09:04.077061+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:09:04.077061+0000","last_undegraded":"2024-09-14T12:09:04.077061+0000","last_fullsized":"2024-09-14T12:09:04.077061+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:25.723597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4177","reported_seq":4819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.589584+0000","last_change":"2024-09-14T11:10:58.612551+0000","last_active":"2024-09-14T12:07:30.589584+0000","last_peered":"2024-09-14T12:07:30.589584+0000","last_clean":"2024-09-14T12:07:30.589584+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:07:30.589584+0000","last_undegraded":"2024-09-14T12:07:30.589584+0000","last_fullsized":"2024-09-14T12:07:30.589584+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":3000,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.250782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'356","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.583133+0000","last_change":"2024-09-14T11:10:56.609814+0000","last_active":"2024-09-14T12:09:54.583133+0000","last_peered":"2024-09-14T12:09:54.583133+0000","last_clean":"2024-09-14T12:09:54.583133+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:09:54.583133+0000","last_undegraded":"2024-09-14T12:09:54.583133+0000","last_fullsized":"2024-09-14T12:09:54.583133+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:46.610327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":21988,"num_write":1237,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655616+0000","last_change":"2024-09-14T11:11:00.609607+0000","last_active":"2024-09-14T12:07:19.655616+0000","last_peered":"2024-09-14T12:07:19.655616+0000","last_clean":"2024-09-14T12:07:19.655616+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:07:19.655616+0000","last_undegraded":"2024-09-14T12:07:19.655616+0000","last_fullsized":"2024-09-14T12:07:19.655616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:33.650477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'309","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.203620+0000","last_change":"2024-09-14T11:11:02.615273+0000","last_active":"2024-09-14T12:09:54.203620+0000","last_peered":"2024-09-14T12:09:54.203620+0000","last_clean":"2024-09-14T12:09:54.203620+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:09:54.203620+0000","last_undegraded":"2024-09-14T12:09:54.203620+0000","last_fullsized":"2024-09-14T12:09:54.203620+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:37.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'780","reported_seq":2794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.506949+0000","last_change":"2024-09-14T11:11:04.634337+0000","last_active":"2024-09-14T12:09:54.506949+0000","last_peered":"2024-09-14T12:09:54.506949+0000","last_clean":"2024-09-14T12:09:54.506949+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:09:54.506949+0000","last_undegraded":"2024-09-14T12:09:54.506949+0000","last_fullsized":"2024-09-14T12:09:54.506949+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":701,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:25.363526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'154","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.869470+0000","last_change":"2024-09-14T11:11:06.648183+0000","last_active":"2024-09-14T12:09:13.869470+0000","last_peered":"2024-09-14T12:09:13.869470+0000","last_clean":"2024-09-14T12:09:13.869470+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:09:13.869470+0000","last_undegraded":"2024-09-14T12:09:13.869470+0000","last_fullsized":"2024-09-14T12:09:13.869470+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:52.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569651+0000","last_change":"2024-09-14T11:10:58.614518+0000","last_active":"2024-09-14T12:07:15.569651+0000","last_peered":"2024-09-14T12:07:15.569651+0000","last_clean":"2024-09-14T12:07:15.569651+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:07:15.569651+0000","last_undegraded":"2024-09-14T12:07:15.569651+0000","last_fullsized":"2024-09-14T12:07:15.569651+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:29.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'364","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.630145+0000","last_change":"2024-09-14T11:10:56.622559+0000","last_active":"2024-09-14T12:09:54.630145+0000","last_peered":"2024-09-14T12:09:54.630145+0000","last_clean":"2024-09-14T12:09:54.630145+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:09:54.630145+0000","last_undegraded":"2024-09-14T12:09:54.630145+0000","last_fullsized":"2024-09-14T12:09:54.630145+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:02.051757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":27518,"num_write":1082,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.656694+0000","last_change":"2024-09-14T11:11:00.617025+0000","last_active":"2024-09-14T12:07:29.656694+0000","last_peered":"2024-09-14T12:07:29.656694+0000","last_clean":"2024-09-14T12:07:29.656694+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:07:29.656694+0000","last_undegraded":"2024-09-14T12:07:29.656694+0000","last_fullsized":"2024-09-14T12:07:29.656694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.898496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'479","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.312377+0000","last_change":"2024-09-14T11:11:02.617234+0000","last_active":"2024-09-14T12:09:54.312377+0000","last_peered":"2024-09-14T12:09:54.312377+0000","last_clean":"2024-09-14T12:09:54.312377+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:09:54.312377+0000","last_undegraded":"2024-09-14T12:09:54.312377+0000","last_fullsized":"2024-09-14T12:09:54.312377+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:10.153711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100274,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":841,"num_read_kb":1995,"num_write":694,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656109+0000","last_change":"2024-09-14T11:11:04.629148+0000","last_active":"2024-09-14T12:07:24.656109+0000","last_peered":"2024-09-14T12:07:24.656109+0000","last_clean":"2024-09-14T12:07:24.656109+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:07:24.656109+0000","last_undegraded":"2024-09-14T12:07:24.656109+0000","last_fullsized":"2024-09-14T12:07:24.656109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.153280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'174","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.360071+0000","last_change":"2024-09-14T11:11:06.652430+0000","last_active":"2024-09-14T12:07:57.360071+0000","last_peered":"2024-09-14T12:07:57.360071+0000","last_clean":"2024-09-14T12:07:57.360071+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:07:57.360071+0000","last_undegraded":"2024-09-14T12:07:57.360071+0000","last_fullsized":"2024-09-14T12:07:57.360071+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:26.755770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580740+0000","last_change":"2024-09-14T11:10:58.612653+0000","last_active":"2024-09-14T12:07:14.580740+0000","last_peered":"2024-09-14T12:07:14.580740+0000","last_clean":"2024-09-14T12:07:14.580740+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:07:14.580740+0000","last_undegraded":"2024-09-14T12:07:14.580740+0000","last_fullsized":"2024-09-14T12:07:14.580740+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:48.760017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'302","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.661467+0000","last_change":"2024-09-14T11:12:33.311513+0000","last_active":"2024-09-14T12:09:54.661467+0000","last_peered":"2024-09-14T12:09:54.661467+0000","last_clean":"2024-09-14T12:09:54.661467+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:09:54.661467+0000","last_undegraded":"2024-09-14T12:09:54.661467+0000","last_fullsized":"2024-09-14T12:09:54.661467+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:12.192936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":20886,"num_write":921,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655667+0000","last_change":"2024-09-14T11:11:00.613586+0000","last_active":"2024-09-14T12:07:19.655667+0000","last_peered":"2024-09-14T12:07:19.655667+0000","last_clean":"2024-09-14T12:07:19.655667+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:07:19.655667+0000","last_undegraded":"2024-09-14T12:07:19.655667+0000","last_fullsized":"2024-09-14T12:07:19.655667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:39.876699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.032254+0000","last_change":"2024-09-14T11:11:02.617188+0000","last_active":"2024-09-14T12:09:53.032254+0000","last_peered":"2024-09-14T12:09:53.032254+0000","last_clean":"2024-09-14T12:09:53.032254+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:09:53.032254+0000","last_undegraded":"2024-09-14T12:09:53.032254+0000","last_fullsized":"2024-09-14T12:09:53.032254+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:27.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571992+0000","last_change":"2024-09-14T11:11:04.638409+0000","last_active":"2024-09-14T12:07:35.571992+0000","last_peered":"2024-09-14T12:07:35.571992+0000","last_clean":"2024-09-14T12:07:35.571992+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:07:35.571992+0000","last_undegraded":"2024-09-14T12:07:35.571992+0000","last_fullsized":"2024-09-14T12:07:35.571992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.627071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'96","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.080423+0000","last_change":"2024-09-14T11:11:06.653079+0000","last_active":"2024-09-14T12:09:04.080423+0000","last_peered":"2024-09-14T12:09:04.080423+0000","last_clean":"2024-09-14T12:09:04.080423+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:09:04.080423+0000","last_undegraded":"2024-09-14T12:09:04.080423+0000","last_fullsized":"2024-09-14T12:09:04.080423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:58.237781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580780+0000","last_change":"2024-09-14T11:10:58.606197+0000","last_active":"2024-09-14T12:07:14.580780+0000","last_peered":"2024-09-14T12:07:14.580780+0000","last_clean":"2024-09-14T12:07:14.580780+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:07:14.580780+0000","last_undegraded":"2024-09-14T12:07:14.580780+0000","last_fullsized":"2024-09-14T12:07:14.580780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:29.386371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'354","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.635662+0000","last_change":"2024-09-14T11:10:56.604612+0000","last_active":"2024-09-14T12:09:54.635662+0000","last_peered":"2024-09-14T12:09:54.635662+0000","last_clean":"2024-09-14T12:09:54.635662+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:09:54.635662+0000","last_undegraded":"2024-09-14T12:09:54.635662+0000","last_fullsized":"2024-09-14T12:09:54.635662+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:22.350680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":12874,"num_write":1161,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"37'5","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.927739+0000","last_change":"2024-09-14T11:11:00.609637+0000","last_active":"2024-09-14T12:09:51.927739+0000","last_peered":"2024-09-14T12:09:51.927739+0000","last_clean":"2024-09-14T12:09:51.927739+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:09:51.927739+0000","last_undegraded":"2024-09-14T12:09:51.927739+0000","last_fullsized":"2024-09-14T12:09:51.927739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:16.269070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.665700+0000","last_change":"2024-09-14T11:11:02.621512+0000","last_active":"2024-09-14T12:09:54.665700+0000","last_peered":"2024-09-14T12:09:54.665700+0000","last_clean":"2024-09-14T12:09:54.665700+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:09:54.665700+0000","last_undegraded":"2024-09-14T12:09:54.665700+0000","last_fullsized":"2024-09-14T12:09:54.665700+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:59.728870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'738","reported_seq":2479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.645010+0000","last_change":"2024-09-14T11:11:04.632093+0000","last_active":"2024-09-14T12:09:54.645010+0000","last_peered":"2024-09-14T12:09:54.645010+0000","last_clean":"2024-09-14T12:09:54.645010+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:09:54.645010+0000","last_undegraded":"2024-09-14T12:09:54.645010+0000","last_fullsized":"2024-09-14T12:09:54.645010+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:57.296761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.523143+0000","last_change":"2024-09-14T11:11:06.644785+0000","last_active":"2024-09-14T12:07:55.523143+0000","last_peered":"2024-09-14T12:07:55.523143+0000","last_clean":"2024-09-14T12:07:55.523143+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:07:55.523143+0000","last_undegraded":"2024-09-14T12:07:55.523143+0000","last_fullsized":"2024-09-14T12:07:55.523143+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:20.927650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":716,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580793+0000","last_change":"2024-09-14T11:10:58.604051+0000","last_active":"2024-09-14T12:07:14.580793+0000","last_peered":"2024-09-14T12:07:14.580793+0000","last_clean":"2024-09-14T12:07:14.580793+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:07:14.580793+0000","last_undegraded":"2024-09-14T12:07:14.580793+0000","last_fullsized":"2024-09-14T12:07:14.580793+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:21.106777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'309","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.643980+0000","last_change":"2024-09-14T11:10:56.614986+0000","last_active":"2024-09-14T12:09:54.643980+0000","last_peered":"2024-09-14T12:09:54.643980+0000","last_clean":"2024-09-14T12:09:54.643980+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:54.643980+0000","last_undegraded":"2024-09-14T12:09:54.643980+0000","last_fullsized":"2024-09-14T12:09:54.643980+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:02.927242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":37578,"num_write":940,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.939893+0000","last_change":"2024-09-14T11:11:00.612934+0000","last_active":"2024-09-14T12:09:51.939893+0000","last_peered":"2024-09-14T12:09:51.939893+0000","last_clean":"2024-09-14T12:09:51.939893+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:09:51.939893+0000","last_undegraded":"2024-09-14T12:09:51.939893+0000","last_fullsized":"2024-09-14T12:09:51.939893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:31.596836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'90","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682622+0000","last_change":"2024-09-14T11:11:02.882134+0000","last_active":"2024-09-14T12:07:19.682622+0000","last_peered":"2024-09-14T12:07:19.682622+0000","last_clean":"2024-09-14T12:07:19.682622+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:07:19.682622+0000","last_undegraded":"2024-09-14T12:07:19.682622+0000","last_fullsized":"2024-09-14T12:07:19.682622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.534285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'775","reported_seq":2472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.941688+0000","last_change":"2024-09-14T11:11:04.634705+0000","last_active":"2024-09-14T12:09:53.941688+0000","last_peered":"2024-09-14T12:09:53.941688+0000","last_clean":"2024-09-14T12:09:53.941688+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:09:53.941688+0000","last_undegraded":"2024-09-14T12:09:53.941688+0000","last_fullsized":"2024-09-14T12:09:53.941688+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:03.937654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'114","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582391+0000","last_change":"2024-09-14T11:11:06.646677+0000","last_active":"2024-09-14T12:07:24.582391+0000","last_peered":"2024-09-14T12:07:24.582391+0000","last_clean":"2024-09-14T12:07:24.582391+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:07:24.582391+0000","last_undegraded":"2024-09-14T12:07:24.582391+0000","last_fullsized":"2024-09-14T12:07:24.582391+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:35.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'141","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672466+0000","last_change":"2024-09-14T11:10:58.604050+0000","last_active":"2024-09-14T12:07:25.672466+0000","last_peered":"2024-09-14T12:07:25.672466+0000","last_clean":"2024-09-14T12:07:25.672466+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:07:25.672466+0000","last_undegraded":"2024-09-14T12:07:25.672466+0000","last_fullsized":"2024-09-14T12:07:25.672466+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:01.910346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.606683+0000","last_change":"2024-09-14T11:10:56.621625+0000","last_active":"2024-09-14T12:09:54.606683+0000","last_peered":"2024-09-14T12:09:54.606683+0000","last_clean":"2024-09-14T12:09:54.606683+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:09:54.606683+0000","last_undegraded":"2024-09-14T12:09:54.606683+0000","last_fullsized":"2024-09-14T12:09:54.606683+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:04.662417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581695+0000","last_change":"2024-09-14T11:11:00.612752+0000","last_active":"2024-09-14T12:07:19.581695+0000","last_peered":"2024-09-14T12:07:19.581695+0000","last_clean":"2024-09-14T12:07:19.581695+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:07:19.581695+0000","last_undegraded":"2024-09-14T12:07:19.581695+0000","last_fullsized":"2024-09-14T12:07:19.581695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.297030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'355","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.860007+0000","last_change":"2024-09-14T11:11:02.616725+0000","last_active":"2024-09-14T12:09:53.860007+0000","last_peered":"2024-09-14T12:09:53.860007+0000","last_clean":"2024-09-14T12:09:53.860007+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:09:53.860007+0000","last_undegraded":"2024-09-14T12:09:53.860007+0000","last_fullsized":"2024-09-14T12:09:53.860007+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:01.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.588143+0000","last_change":"2024-09-14T11:11:04.635198+0000","last_active":"2024-09-14T12:07:20.588143+0000","last_peered":"2024-09-14T12:07:20.588143+0000","last_clean":"2024-09-14T12:07:20.588143+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:07:20.588143+0000","last_undegraded":"2024-09-14T12:07:20.588143+0000","last_fullsized":"2024-09-14T12:07:20.588143+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:55.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'136","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672420+0000","last_change":"2024-09-14T11:11:06.646340+0000","last_active":"2024-09-14T12:07:25.672420+0000","last_peered":"2024-09-14T12:07:25.672420+0000","last_clean":"2024-09-14T12:07:25.672420+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:07:25.672420+0000","last_undegraded":"2024-09-14T12:07:25.672420+0000","last_fullsized":"2024-09-14T12:07:25.672420+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:44.114108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'105","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:55.202777+0000","last_change":"2024-09-14T11:10:58.606027+0000","last_active":"2024-09-14T12:08:55.202777+0000","last_peered":"2024-09-14T12:08:55.202777+0000","last_clean":"2024-09-14T12:08:55.202777+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:08:55.202777+0000","last_undegraded":"2024-09-14T12:08:55.202777+0000","last_fullsized":"2024-09-14T12:08:55.202777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:25.981163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578466+0000","last_change":"2024-09-14T11:10:40.558361+0000","last_active":"2024-09-14T12:06:54.578466+0000","last_peered":"2024-09-14T12:06:54.578466+0000","last_clean":"2024-09-14T12:06:54.578466+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:06:54.578466+0000","last_undegraded":"2024-09-14T12:06:54.578466+0000","last_fullsized":"2024-09-14T12:06:54.578466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:39.523268+0000","last_clean_scrub_stamp":"2024-09-14T11:10:39.523268+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:36.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715535+0000","last_change":"2024-09-14T11:10:49.566289+0000","last_active":"2024-09-14T12:07:04.715535+0000","last_peered":"2024-09-14T12:07:04.715535+0000","last_clean":"2024-09-14T12:07:04.715535+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:07:04.715535+0000","last_undegraded":"2024-09-14T12:07:04.715535+0000","last_fullsized":"2024-09-14T12:07:04.715535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:43.935144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.783949+0000","last_change":"2024-09-14T11:10:56.613702+0000","last_active":"2024-09-14T12:09:54.783949+0000","last_peered":"2024-09-14T12:09:54.783949+0000","last_clean":"2024-09-14T12:09:54.783949+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:09:54.783949+0000","last_undegraded":"2024-09-14T12:09:54.783949+0000","last_fullsized":"2024-09-14T12:09:54.783949+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:09.052677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":21923,"num_write":1076,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582005+0000","last_change":"2024-09-14T11:11:00.610291+0000","last_active":"2024-09-14T12:07:19.582005+0000","last_peered":"2024-09-14T12:07:19.582005+0000","last_clean":"2024-09-14T12:07:19.582005+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:07:19.582005+0000","last_undegraded":"2024-09-14T12:07:19.582005+0000","last_fullsized":"2024-09-14T12:07:19.582005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:59.638567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'762","reported_seq":1474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.547865+0000","last_change":"2024-09-14T11:11:02.621281+0000","last_active":"2024-09-14T12:09:54.547865+0000","last_peered":"2024-09-14T12:09:54.547865+0000","last_clean":"2024-09-14T12:09:54.547865+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:09:54.547865+0000","last_undegraded":"2024-09-14T12:09:54.547865+0000","last_fullsized":"2024-09-14T12:09:54.547865+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:39.469737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.570862+0000","last_change":"2024-09-14T11:11:04.632962+0000","last_active":"2024-09-14T12:07:25.570862+0000","last_peered":"2024-09-14T12:07:25.570862+0000","last_clean":"2024-09-14T12:07:25.570862+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:07:25.570862+0000","last_undegraded":"2024-09-14T12:07:25.570862+0000","last_fullsized":"2024-09-14T12:07:25.570862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'182","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.397769+0000","last_change":"2024-09-14T11:11:06.647490+0000","last_active":"2024-09-14T12:07:57.397769+0000","last_peered":"2024-09-14T12:07:57.397769+0000","last_clean":"2024-09-14T12:07:57.397769+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:07:57.397769+0000","last_undegraded":"2024-09-14T12:07:57.397769+0000","last_fullsized":"2024-09-14T12:07:57.397769+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:49.491579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570300+0000","last_change":"2024-09-14T11:10:58.611939+0000","last_active":"2024-09-14T12:07:20.570300+0000","last_peered":"2024-09-14T12:07:20.570300+0000","last_clean":"2024-09-14T12:07:20.570300+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:07:20.570300+0000","last_undegraded":"2024-09-14T12:07:20.570300+0000","last_fullsized":"2024-09-14T12:07:20.570300+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:08.887333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579159+0000","last_change":"2024-09-14T11:10:49.784961+0000","last_active":"2024-09-14T12:06:59.579159+0000","last_peered":"2024-09-14T12:06:59.579159+0000","last_clean":"2024-09-14T12:06:59.579159+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:06:59.579159+0000","last_undegraded":"2024-09-14T12:06:59.579159+0000","last_fullsized":"2024-09-14T12:06:59.579159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:46.921965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.014417+0000","last_change":"2024-09-14T12:10:00.014417+0000","last_active":"2024-09-14T12:10:00.014417+0000","last_peered":"2024-09-14T12:10:00.014417+0000","last_clean":"2024-09-14T12:10:00.014417+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:10:00.014417+0000","last_undegraded":"2024-09-14T12:10:00.014417+0000","last_fullsized":"2024-09-14T12:10:00.014417+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.014290+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:59.265225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":48298,"num_write":1181,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.718904+0000","last_change":"2024-09-14T11:11:00.610424+0000","last_active":"2024-09-14T12:07:24.718904+0000","last_peered":"2024-09-14T12:07:24.718904+0000","last_clean":"2024-09-14T12:07:24.718904+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:07:24.718904+0000","last_undegraded":"2024-09-14T12:07:24.718904+0000","last_fullsized":"2024-09-14T12:07:24.718904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:04.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1276","reported_seq":2913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.934548+0000","last_change":"2024-09-14T11:11:02.616425+0000","last_active":"2024-09-14T12:09:53.934548+0000","last_peered":"2024-09-14T12:09:53.934548+0000","last_clean":"2024-09-14T12:09:53.934548+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:09:53.934548+0000","last_undegraded":"2024-09-14T12:09:53.934548+0000","last_fullsized":"2024-09-14T12:09:53.934548+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:08.009826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140197,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2031,"num_read_kb":3753,"num_write":1136,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583514+0000","last_change":"2024-09-14T11:11:04.638084+0000","last_active":"2024-09-14T12:07:29.583514+0000","last_peered":"2024-09-14T12:07:29.583514+0000","last_clean":"2024-09-14T12:07:29.583514+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:07:29.583514+0000","last_undegraded":"2024-09-14T12:07:29.583514+0000","last_fullsized":"2024-09-14T12:07:29.583514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.322127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'220","reported_seq":743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.081368+0000","last_change":"2024-09-14T11:11:06.643093+0000","last_active":"2024-09-14T12:07:54.081368+0000","last_peered":"2024-09-14T12:07:54.081368+0000","last_clean":"2024-09-14T12:07:54.081368+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:07:54.081368+0000","last_undegraded":"2024-09-14T12:07:54.081368+0000","last_fullsized":"2024-09-14T12:07:54.081368+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:50.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671975+0000","last_change":"2024-09-14T11:10:58.601798+0000","last_active":"2024-09-14T12:07:20.671975+0000","last_peered":"2024-09-14T12:07:20.671975+0000","last_clean":"2024-09-14T12:07:20.671975+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:07:20.671975+0000","last_undegraded":"2024-09-14T12:07:20.671975+0000","last_fullsized":"2024-09-14T12:07:20.671975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:30.795951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.586595+0000","last_change":"2024-09-14T12:09:59.586595+0000","last_active":"2024-09-14T12:09:59.586595+0000","last_peered":"2024-09-14T12:09:59.586595+0000","last_clean":"2024-09-14T12:09:59.586595+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:09:59.586595+0000","last_undegraded":"2024-09-14T12:09:59.586595+0000","last_fullsized":"2024-09-14T12:09:59.586595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.586474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:31.075728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'377","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.870135+0000","last_change":"2024-09-14T12:09:58.870135+0000","last_active":"2024-09-14T12:09:58.870135+0000","last_peered":"2024-09-14T12:09:58.870135+0000","last_clean":"2024-09-14T12:09:58.870135+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:09:58.870135+0000","last_undegraded":"2024-09-14T12:09:58.870135+0000","last_fullsized":"2024-09-14T12:09:58.870135+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.870049+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:28.701680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":652,"num_read_kb":34638,"num_write":1221,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656189+0000","last_change":"2024-09-14T11:11:00.611993+0000","last_active":"2024-09-14T12:07:24.656189+0000","last_peered":"2024-09-14T12:07:24.656189+0000","last_clean":"2024-09-14T12:07:24.656189+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:07:24.656189+0000","last_undegraded":"2024-09-14T12:07:24.656189+0000","last_fullsized":"2024-09-14T12:07:24.656189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:06.468911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.035888+0000","last_change":"2024-09-14T11:11:02.887250+0000","last_active":"2024-09-14T12:09:15.035888+0000","last_peered":"2024-09-14T12:09:15.035888+0000","last_clean":"2024-09-14T12:09:15.035888+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:09:15.035888+0000","last_undegraded":"2024-09-14T12:09:15.035888+0000","last_fullsized":"2024-09-14T12:09:15.035888+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:22.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570276+0000","last_change":"2024-09-14T11:11:04.635365+0000","last_active":"2024-09-14T12:07:20.570276+0000","last_peered":"2024-09-14T12:07:20.570276+0000","last_clean":"2024-09-14T12:07:20.570276+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:07:20.570276+0000","last_undegraded":"2024-09-14T12:07:20.570276+0000","last_fullsized":"2024-09-14T12:07:20.570276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:48.407204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'240","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.650870+0000","last_change":"2024-09-14T11:11:06.650013+0000","last_active":"2024-09-14T12:07:57.650870+0000","last_peered":"2024-09-14T12:07:57.650870+0000","last_clean":"2024-09-14T12:07:57.650870+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:07:57.650870+0000","last_undegraded":"2024-09-14T12:07:57.650870+0000","last_fullsized":"2024-09-14T12:07:57.650870+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.193259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671361+0000","last_change":"2024-09-14T11:10:58.611132+0000","last_active":"2024-09-14T12:07:15.671361+0000","last_peered":"2024-09-14T12:07:15.671361+0000","last_clean":"2024-09-14T12:07:15.671361+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:07:15.671361+0000","last_undegraded":"2024-09-14T12:07:15.671361+0000","last_fullsized":"2024-09-14T12:07:15.671361+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:47.565536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.715494+0000","last_change":"2024-09-14T11:10:49.566261+0000","last_active":"2024-09-14T12:07:04.715494+0000","last_peered":"2024-09-14T12:07:04.715494+0000","last_clean":"2024-09-14T12:07:04.715494+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:07:04.715494+0000","last_undegraded":"2024-09-14T12:07:04.715494+0000","last_fullsized":"2024-09-14T12:07:04.715494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:49.383472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'320","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.814133+0000","last_change":"2024-09-14T11:10:56.606302+0000","last_active":"2024-09-14T12:09:54.814133+0000","last_peered":"2024-09-14T12:09:54.814133+0000","last_clean":"2024-09-14T12:09:54.814133+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:09:54.814133+0000","last_undegraded":"2024-09-14T12:09:54.814133+0000","last_fullsized":"2024-09-14T12:09:54.814133+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.821812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":663,"num_read_kb":8841,"num_write":1009,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"37'3","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.928782+0000","last_change":"2024-09-14T11:11:00.607385+0000","last_active":"2024-09-14T12:09:51.928782+0000","last_peered":"2024-09-14T12:09:51.928782+0000","last_clean":"2024-09-14T12:09:51.928782+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:09:51.928782+0000","last_undegraded":"2024-09-14T12:09:51.928782+0000","last_fullsized":"2024-09-14T12:09:51.928782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:18.357859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'141","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.049855+0000","last_change":"2024-09-14T11:11:02.619842+0000","last_active":"2024-09-14T12:09:15.049855+0000","last_peered":"2024-09-14T12:09:15.049855+0000","last_clean":"2024-09-14T12:09:15.049855+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:09:15.049855+0000","last_undegraded":"2024-09-14T12:09:15.049855+0000","last_fullsized":"2024-09-14T12:09:15.049855+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:29.586585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.588952+0000","last_change":"2024-09-14T11:11:04.632880+0000","last_active":"2024-09-14T12:07:25.588952+0000","last_peered":"2024-09-14T12:07:25.588952+0000","last_clean":"2024-09-14T12:07:25.588952+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:07:25.588952+0000","last_undegraded":"2024-09-14T12:07:25.588952+0000","last_fullsized":"2024-09-14T12:07:25.588952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:41.973457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.719671+0000","last_change":"2024-09-14T11:11:06.652421+0000","last_active":"2024-09-14T12:07:29.719671+0000","last_peered":"2024-09-14T12:07:29.719671+0000","last_clean":"2024-09-14T12:07:29.719671+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:07:29.719671+0000","last_undegraded":"2024-09-14T12:07:29.719671+0000","last_fullsized":"2024-09-14T12:07:29.719671+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:13.461185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:49.658858+0000","last_change":"2024-09-14T11:11:32.676598+0000","last_active":"2024-09-14T12:07:49.658858+0000","last_peered":"2024-09-14T12:07:49.658858+0000","last_clean":"2024-09-14T12:07:49.658858+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:07:49.658858+0000","last_undegraded":"2024-09-14T12:07:49.658858+0000","last_fullsized":"2024-09-14T12:07:49.658858+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:34.343713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.650599+0000","last_change":"2024-09-14T11:10:56.607551+0000","last_active":"2024-09-14T12:09:54.650599+0000","last_peered":"2024-09-14T12:09:54.650599+0000","last_clean":"2024-09-14T12:09:54.650599+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:09:54.650599+0000","last_undegraded":"2024-09-14T12:09:54.650599+0000","last_fullsized":"2024-09-14T12:09:54.650599+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:34.558354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.670214+0000","last_change":"2024-09-14T11:10:49.565862+0000","last_active":"2024-09-14T12:07:05.670214+0000","last_peered":"2024-09-14T12:07:05.670214+0000","last_clean":"2024-09-14T12:07:05.670214+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:07:05.670214+0000","last_undegraded":"2024-09-14T12:07:05.670214+0000","last_fullsized":"2024-09-14T12:07:05.670214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:23.143257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569681+0000","last_change":"2024-09-14T11:11:00.604266+0000","last_active":"2024-09-14T12:07:15.569681+0000","last_peered":"2024-09-14T12:07:15.569681+0000","last_clean":"2024-09-14T12:07:15.569681+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:07:15.569681+0000","last_undegraded":"2024-09-14T12:07:15.569681+0000","last_fullsized":"2024-09-14T12:07:15.569681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:23.466098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'591","reported_seq":1264,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.601000+0000","last_change":"2024-09-14T11:11:02.621799+0000","last_active":"2024-09-14T12:09:54.601000+0000","last_peered":"2024-09-14T12:09:54.601000+0000","last_clean":"2024-09-14T12:09:54.601000+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:09:54.601000+0000","last_undegraded":"2024-09-14T12:09:54.601000+0000","last_fullsized":"2024-09-14T12:09:54.601000+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:35.213739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1669,"num_read_kb":2890,"num_write":2218,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581595+0000","last_change":"2024-09-14T11:11:04.637891+0000","last_active":"2024-09-14T12:07:19.581595+0000","last_peered":"2024-09-14T12:07:19.581595+0000","last_clean":"2024-09-14T12:07:19.581595+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:07:19.581595+0000","last_undegraded":"2024-09-14T12:07:19.581595+0000","last_fullsized":"2024-09-14T12:07:19.581595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.595704+0000","last_change":"2024-09-14T11:11:06.644529+0000","last_active":"2024-09-14T12:07:54.595704+0000","last_peered":"2024-09-14T12:07:54.595704+0000","last_clean":"2024-09-14T12:07:54.595704+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:07:54.595704+0000","last_undegraded":"2024-09-14T12:07:54.595704+0000","last_fullsized":"2024-09-14T12:07:54.595704+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:27.041637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569674+0000","last_change":"2024-09-14T11:10:58.610011+0000","last_active":"2024-09-14T12:07:15.569674+0000","last_peered":"2024-09-14T12:07:15.569674+0000","last_clean":"2024-09-14T12:07:15.569674+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:07:15.569674+0000","last_undegraded":"2024-09-14T12:07:15.569674+0000","last_fullsized":"2024-09-14T12:07:15.569674+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:35.811227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'378","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.804531+0000","last_change":"2024-09-14T11:10:56.602134+0000","last_active":"2024-09-14T12:09:54.804531+0000","last_peered":"2024-09-14T12:09:54.804531+0000","last_clean":"2024-09-14T12:09:54.804531+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:09:54.804531+0000","last_undegraded":"2024-09-14T12:09:54.804531+0000","last_fullsized":"2024-09-14T12:09:54.804531+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:30.985152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":671,"num_read_kb":35559,"num_write":1182,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581198+0000","last_change":"2024-09-14T11:10:49.784939+0000","last_active":"2024-09-14T12:07:14.581198+0000","last_peered":"2024-09-14T12:07:14.581198+0000","last_clean":"2024-09-14T12:07:14.581198+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:07:14.581198+0000","last_undegraded":"2024-09-14T12:07:14.581198+0000","last_fullsized":"2024-09-14T12:07:14.581198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:20.447651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587487+0000","last_change":"2024-09-14T11:11:00.605387+0000","last_active":"2024-09-14T12:07:15.587487+0000","last_peered":"2024-09-14T12:07:15.587487+0000","last_clean":"2024-09-14T12:07:15.587487+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:07:15.587487+0000","last_undegraded":"2024-09-14T12:07:15.587487+0000","last_fullsized":"2024-09-14T12:07:15.587487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:46.178240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'169","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.885619+0000","last_change":"2024-09-14T11:11:02.887280+0000","last_active":"2024-09-14T12:09:13.885619+0000","last_peered":"2024-09-14T12:09:13.885619+0000","last_clean":"2024-09-14T12:09:13.885619+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:09:13.885619+0000","last_undegraded":"2024-09-14T12:09:13.885619+0000","last_fullsized":"2024-09-14T12:09:13.885619+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.345916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'772","reported_seq":2649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.128180+0000","last_change":"2024-09-14T11:11:04.632716+0000","last_active":"2024-09-14T12:09:54.128180+0000","last_peered":"2024-09-14T12:09:54.128180+0000","last_clean":"2024-09-14T12:09:54.128180+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:09:54.128180+0000","last_undegraded":"2024-09-14T12:09:54.128180+0000","last_fullsized":"2024-09-14T12:09:54.128180+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:21.258508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'121","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.871748+0000","last_change":"2024-09-14T11:11:06.651630+0000","last_active":"2024-09-14T12:09:14.871748+0000","last_peered":"2024-09-14T12:09:14.871748+0000","last_clean":"2024-09-14T12:09:14.871748+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:09:14.871748+0000","last_undegraded":"2024-09-14T12:09:14.871748+0000","last_fullsized":"2024-09-14T12:09:14.871748+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:46.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681248+0000","last_change":"2024-09-14T11:10:58.608290+0000","last_active":"2024-09-14T12:07:09.681248+0000","last_peered":"2024-09-14T12:07:09.681248+0000","last_clean":"2024-09-14T12:07:09.681248+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:07:09.681248+0000","last_undegraded":"2024-09-14T12:07:09.681248+0000","last_fullsized":"2024-09-14T12:07:09.681248+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:31.554400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.635141+0000","last_change":"2024-09-14T11:10:56.620615+0000","last_active":"2024-09-14T12:09:54.635141+0000","last_peered":"2024-09-14T12:09:54.635141+0000","last_clean":"2024-09-14T12:09:54.635141+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:09:54.635141+0000","last_undegraded":"2024-09-14T12:09:54.635141+0000","last_fullsized":"2024-09-14T12:09:54.635141+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:20.532731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.836980+0000","last_change":"2024-09-14T12:09:59.836980+0000","last_active":"2024-09-14T12:09:59.836980+0000","last_peered":"2024-09-14T12:09:59.836980+0000","last_clean":"2024-09-14T12:09:59.836980+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:09:59.836980+0000","last_undegraded":"2024-09-14T12:09:59.836980+0000","last_fullsized":"2024-09-14T12:09:59.836980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.836907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:32.571263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581576+0000","last_change":"2024-09-14T11:11:00.610462+0000","last_active":"2024-09-14T12:07:19.581576+0000","last_peered":"2024-09-14T12:07:19.581576+0000","last_clean":"2024-09-14T12:07:19.581576+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:07:19.581576+0000","last_undegraded":"2024-09-14T12:07:19.581576+0000","last_fullsized":"2024-09-14T12:07:19.581576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:57.985170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'120","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581610+0000","last_change":"2024-09-14T11:11:02.618565+0000","last_active":"2024-09-14T12:07:19.581610+0000","last_peered":"2024-09-14T12:07:19.581610+0000","last_clean":"2024-09-14T12:07:19.581610+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:07:19.581610+0000","last_undegraded":"2024-09-14T12:07:19.581610+0000","last_fullsized":"2024-09-14T12:07:19.581610+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:49.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'792","reported_seq":6722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.288470+0000","last_change":"2024-09-14T11:11:04.641546+0000","last_active":"2024-09-14T12:09:54.288470+0000","last_peered":"2024-09-14T12:09:54.288470+0000","last_clean":"2024-09-14T12:09:54.288470+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:09:54.288470+0000","last_undegraded":"2024-09-14T12:09:54.288470+0000","last_fullsized":"2024-09-14T12:09:54.288470+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:25.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'211","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.574448+0000","last_change":"2024-09-14T11:11:06.651293+0000","last_active":"2024-09-14T12:07:56.574448+0000","last_peered":"2024-09-14T12:07:56.574448+0000","last_clean":"2024-09-14T12:07:56.574448+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:07:56.574448+0000","last_undegraded":"2024-09-14T12:07:56.574448+0000","last_fullsized":"2024-09-14T12:07:56.574448+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580636+0000","last_change":"2024-09-14T11:10:58.600988+0000","last_active":"2024-09-14T12:07:14.580636+0000","last_peered":"2024-09-14T12:07:14.580636+0000","last_clean":"2024-09-14T12:07:14.580636+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:07:14.580636+0000","last_undegraded":"2024-09-14T12:07:14.580636+0000","last_fullsized":"2024-09-14T12:07:14.580636+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:34.213245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'380","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.799816+0000","last_change":"2024-09-14T11:11:32.791407+0000","last_active":"2024-09-14T12:09:54.799816+0000","last_peered":"2024-09-14T12:09:54.799816+0000","last_clean":"2024-09-14T12:09:54.799816+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:09:54.799816+0000","last_undegraded":"2024-09-14T12:09:54.799816+0000","last_fullsized":"2024-09-14T12:09:54.799816+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:37.633694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":5405,"num_write":1192,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586795+0000","last_change":"2024-09-14T11:10:49.566365+0000","last_active":"2024-09-14T12:07:10.586795+0000","last_peered":"2024-09-14T12:07:10.586795+0000","last_clean":"2024-09-14T12:07:10.586795+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:07:10.586795+0000","last_undegraded":"2024-09-14T12:07:10.586795+0000","last_fullsized":"2024-09-14T12:07:10.586795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:46.544062+0000","last_clean_scrub_stamp":"2024-09-14T11:10:46.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:17.078627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681822+0000","last_change":"2024-09-14T11:11:00.612749+0000","last_active":"2024-09-14T12:07:14.681822+0000","last_peered":"2024-09-14T12:07:14.681822+0000","last_clean":"2024-09-14T12:07:14.681822+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:07:14.681822+0000","last_undegraded":"2024-09-14T12:07:14.681822+0000","last_fullsized":"2024-09-14T12:07:14.681822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:08.731984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'795","reported_seq":1517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.736663+0000","last_change":"2024-09-14T11:11:02.882288+0000","last_active":"2024-09-14T12:09:53.736663+0000","last_peered":"2024-09-14T12:09:53.736663+0000","last_clean":"2024-09-14T12:09:53.736663+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:09:53.736663+0000","last_undegraded":"2024-09-14T12:09:53.736663+0000","last_fullsized":"2024-09-14T12:09:53.736663+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:52.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682515+0000","last_change":"2024-09-14T11:11:04.636384+0000","last_active":"2024-09-14T12:07:19.682515+0000","last_peered":"2024-09-14T12:07:19.682515+0000","last_clean":"2024-09-14T12:07:19.682515+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:07:19.682515+0000","last_undegraded":"2024-09-14T12:07:19.682515+0000","last_fullsized":"2024-09-14T12:07:19.682515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:19.200941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'147","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.868910+0000","last_change":"2024-09-14T11:11:06.645842+0000","last_active":"2024-09-14T12:09:14.868910+0000","last_peered":"2024-09-14T12:09:14.868910+0000","last_clean":"2024-09-14T12:09:14.868910+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:09:14.868910+0000","last_undegraded":"2024-09-14T12:09:14.868910+0000","last_fullsized":"2024-09-14T12:09:14.868910+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:49.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'133","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.592187+0000","last_change":"2024-09-14T11:11:06.646108+0000","last_active":"2024-09-14T12:07:57.592187+0000","last_peered":"2024-09-14T12:07:57.592187+0000","last_clean":"2024-09-14T12:07:57.592187+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:07:57.592187+0000","last_undegraded":"2024-09-14T12:07:57.592187+0000","last_fullsized":"2024-09-14T12:07:57.592187+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:15.069138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578521+0000","last_change":"2024-09-14T11:10:58.604359+0000","last_active":"2024-09-14T12:06:59.578521+0000","last_peered":"2024-09-14T12:06:59.578521+0000","last_clean":"2024-09-14T12:06:59.578521+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:06:59.578521+0000","last_undegraded":"2024-09-14T12:06:59.578521+0000","last_fullsized":"2024-09-14T12:06:59.578521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:16.978960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'349","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.627083+0000","last_change":"2024-09-14T11:10:56.615808+0000","last_active":"2024-09-14T12:09:54.627083+0000","last_peered":"2024-09-14T12:09:54.627083+0000","last_clean":"2024-09-14T12:09:54.627083+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:09:54.627083+0000","last_undegraded":"2024-09-14T12:09:54.627083+0000","last_fullsized":"2024-09-14T12:09:54.627083+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:43.217150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":5106,"num_write":1232,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669712+0000","last_change":"2024-09-14T11:11:00.610690+0000","last_active":"2024-09-14T12:07:00.669712+0000","last_peered":"2024-09-14T12:07:00.669712+0000","last_clean":"2024-09-14T12:07:00.669712+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:07:00.669712+0000","last_undegraded":"2024-09-14T12:07:00.669712+0000","last_fullsized":"2024-09-14T12:07:00.669712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:39.467881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'323","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.143808+0000","last_change":"2024-09-14T11:11:02.622367+0000","last_active":"2024-09-14T12:09:54.143808+0000","last_peered":"2024-09-14T12:09:54.143808+0000","last_clean":"2024-09-14T12:09:54.143808+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:09:54.143808+0000","last_undegraded":"2024-09-14T12:09:54.143808+0000","last_fullsized":"2024-09-14T12:09:54.143808+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:39.564835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680693+0000","last_change":"2024-09-14T11:11:04.639827+0000","last_active":"2024-09-14T12:07:04.680693+0000","last_peered":"2024-09-14T12:07:04.680693+0000","last_clean":"2024-09-14T12:07:04.680693+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:07:04.680693+0000","last_undegraded":"2024-09-14T12:07:04.680693+0000","last_fullsized":"2024-09-14T12:07:04.680693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:10.987465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'132","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682683+0000","last_change":"2024-09-14T11:11:06.649975+0000","last_active":"2024-09-14T12:07:19.682683+0000","last_peered":"2024-09-14T12:07:19.682683+0000","last_clean":"2024-09-14T12:07:19.682683+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:07:19.682683+0000","last_undegraded":"2024-09-14T12:07:19.682683+0000","last_fullsized":"2024-09-14T12:07:19.682683+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:50.322032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669720+0000","last_change":"2024-09-14T11:10:58.609253+0000","last_active":"2024-09-14T12:07:00.669720+0000","last_peered":"2024-09-14T12:07:00.669720+0000","last_clean":"2024-09-14T12:07:00.669720+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:07:00.669720+0000","last_undegraded":"2024-09-14T12:07:00.669720+0000","last_fullsized":"2024-09-14T12:07:00.669720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.292062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'348","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.803504+0000","last_change":"2024-09-14T11:10:56.618778+0000","last_active":"2024-09-14T12:09:54.803504+0000","last_peered":"2024-09-14T12:09:54.803504+0000","last_clean":"2024-09-14T12:09:54.803504+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:09:54.803504+0000","last_undegraded":"2024-09-14T12:09:54.803504+0000","last_fullsized":"2024-09-14T12:09:54.803504+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:10.981915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":33435,"num_write":1030,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680772+0000","last_change":"2024-09-14T11:11:00.611300+0000","last_active":"2024-09-14T12:07:04.680772+0000","last_peered":"2024-09-14T12:07:04.680772+0000","last_clean":"2024-09-14T12:07:04.680772+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:07:04.680772+0000","last_undegraded":"2024-09-14T12:07:04.680772+0000","last_fullsized":"2024-09-14T12:07:04.680772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:08.169880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568300+0000","last_change":"2024-09-14T11:11:02.616318+0000","last_active":"2024-09-14T12:07:05.568300+0000","last_peered":"2024-09-14T12:07:05.568300+0000","last_clean":"2024-09-14T12:07:05.568300+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:07:05.568300+0000","last_undegraded":"2024-09-14T12:07:05.568300+0000","last_fullsized":"2024-09-14T12:07:05.568300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:14.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579853+0000","last_change":"2024-09-14T11:11:04.630959+0000","last_active":"2024-09-14T12:07:04.579853+0000","last_peered":"2024-09-14T12:07:04.579853+0000","last_clean":"2024-09-14T12:07:04.579853+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:07:04.579853+0000","last_undegraded":"2024-09-14T12:07:04.579853+0000","last_fullsized":"2024-09-14T12:07:04.579853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:47.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'253","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.593628+0000","last_change":"2024-09-14T11:11:06.642887+0000","last_active":"2024-09-14T12:07:56.593628+0000","last_peered":"2024-09-14T12:07:56.593628+0000","last_clean":"2024-09-14T12:07:56.593628+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:07:56.593628+0000","last_undegraded":"2024-09-14T12:07:56.593628+0000","last_fullsized":"2024-09-14T12:07:56.593628+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:46.857547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680183+0000","last_change":"2024-09-14T11:10:58.605181+0000","last_active":"2024-09-14T12:06:59.680183+0000","last_peered":"2024-09-14T12:06:59.680183+0000","last_clean":"2024-09-14T12:06:59.680183+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:06:59.680183+0000","last_undegraded":"2024-09-14T12:06:59.680183+0000","last_fullsized":"2024-09-14T12:06:59.680183+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:43.046442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1250,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.611356+0000","last_change":"2024-09-14T11:10:56.600738+0000","last_active":"2024-09-14T12:09:54.611356+0000","last_peered":"2024-09-14T12:09:54.611356+0000","last_clean":"2024-09-14T12:09:54.611356+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:09:54.611356+0000","last_undegraded":"2024-09-14T12:09:54.611356+0000","last_fullsized":"2024-09-14T12:09:54.611356+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:28.803066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579817+0000","last_change":"2024-09-14T11:11:00.608611+0000","last_active":"2024-09-14T12:07:04.579817+0000","last_peered":"2024-09-14T12:07:04.579817+0000","last_clean":"2024-09-14T12:07:04.579817+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:04.579817+0000","last_undegraded":"2024-09-14T12:07:04.579817+0000","last_fullsized":"2024-09-14T12:07:04.579817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:32.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'307","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.395477+0000","last_change":"2024-09-14T11:11:02.621487+0000","last_active":"2024-09-14T12:09:53.395477+0000","last_peered":"2024-09-14T12:09:53.395477+0000","last_clean":"2024-09-14T12:09:53.395477+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:09:53.395477+0000","last_undegraded":"2024-09-14T12:09:53.395477+0000","last_fullsized":"2024-09-14T12:09:53.395477+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:57.571157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.585970+0000","last_change":"2024-09-14T11:11:04.632741+0000","last_active":"2024-09-14T12:07:05.585970+0000","last_peered":"2024-09-14T12:07:05.585970+0000","last_clean":"2024-09-14T12:07:05.585970+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:07:05.585970+0000","last_undegraded":"2024-09-14T12:07:05.585970+0000","last_fullsized":"2024-09-14T12:07:05.585970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:33.615718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'110","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.940177+0000","last_change":"2024-09-14T11:11:06.646134+0000","last_active":"2024-09-14T12:07:55.940177+0000","last_peered":"2024-09-14T12:07:55.940177+0000","last_clean":"2024-09-14T12:07:55.940177+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:07:55.940177+0000","last_undegraded":"2024-09-14T12:07:55.940177+0000","last_fullsized":"2024-09-14T12:07:55.940177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:44.141877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'143","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.680151+0000","last_change":"2024-09-14T11:10:58.610261+0000","last_active":"2024-09-14T12:06:59.680151+0000","last_peered":"2024-09-14T12:06:59.680151+0000","last_clean":"2024-09-14T12:06:59.680151+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:06:59.680151+0000","last_undegraded":"2024-09-14T12:06:59.680151+0000","last_fullsized":"2024-09-14T12:06:59.680151+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:38.951705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'377","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.785282+0000","last_change":"2024-09-14T11:10:56.623865+0000","last_active":"2024-09-14T12:09:54.785282+0000","last_peered":"2024-09-14T12:09:54.785282+0000","last_clean":"2024-09-14T12:09:54.785282+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:09:54.785282+0000","last_undegraded":"2024-09-14T12:09:54.785282+0000","last_fullsized":"2024-09-14T12:09:54.785282+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:27.676587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":721,"num_read_kb":71289,"num_write":1192,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.585298+0000","last_change":"2024-09-14T11:11:00.608657+0000","last_active":"2024-09-14T12:07:00.585298+0000","last_peered":"2024-09-14T12:07:00.585298+0000","last_clean":"2024-09-14T12:07:00.585298+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:07:00.585298+0000","last_undegraded":"2024-09-14T12:07:00.585298+0000","last_fullsized":"2024-09-14T12:07:00.585298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:34.927234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'265","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.192042+0000","last_change":"2024-09-14T11:11:02.615297+0000","last_active":"2024-09-14T12:09:53.192042+0000","last_peered":"2024-09-14T12:09:53.192042+0000","last_clean":"2024-09-14T12:09:53.192042+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:09:53.192042+0000","last_undegraded":"2024-09-14T12:09:53.192042+0000","last_fullsized":"2024-09-14T12:09:53.192042+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:52.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568346+0000","last_change":"2024-09-14T11:11:04.634007+0000","last_active":"2024-09-14T12:07:05.568346+0000","last_peered":"2024-09-14T12:07:05.568346+0000","last_clean":"2024-09-14T12:07:05.568346+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:07:05.568346+0000","last_undegraded":"2024-09-14T12:07:05.568346+0000","last_fullsized":"2024-09-14T12:07:05.568346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.560589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":725,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587539+0000","last_change":"2024-09-14T11:10:58.606214+0000","last_active":"2024-09-14T12:07:15.587539+0000","last_peered":"2024-09-14T12:07:15.587539+0000","last_clean":"2024-09-14T12:07:15.587539+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:07:15.587539+0000","last_undegraded":"2024-09-14T12:07:15.587539+0000","last_fullsized":"2024-09-14T12:07:15.587539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:23.749986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'373","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.574074+0000","last_change":"2024-09-14T11:10:56.622004+0000","last_active":"2024-09-14T12:09:54.574074+0000","last_peered":"2024-09-14T12:09:54.574074+0000","last_clean":"2024-09-14T12:09:54.574074+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:09:54.574074+0000","last_undegraded":"2024-09-14T12:09:54.574074+0000","last_fullsized":"2024-09-14T12:09:54.574074+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:22.080952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":695,"num_read_kb":6455,"num_write":1238,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569728+0000","last_change":"2024-09-14T11:11:00.603297+0000","last_active":"2024-09-14T12:07:15.569728+0000","last_peered":"2024-09-14T12:07:15.569728+0000","last_clean":"2024-09-14T12:07:15.569728+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:07:15.569728+0000","last_undegraded":"2024-09-14T12:07:15.569728+0000","last_fullsized":"2024-09-14T12:07:15.569728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:28.255243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'501","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.485393+0000","last_change":"2024-09-14T11:11:02.615607+0000","last_active":"2024-09-14T12:09:54.485393+0000","last_peered":"2024-09-14T12:09:54.485393+0000","last_clean":"2024-09-14T12:09:54.485393+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:09:54.485393+0000","last_undegraded":"2024-09-14T12:09:54.485393+0000","last_fullsized":"2024-09-14T12:09:54.485393+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:23.294326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":912,"num_read_kb":2171,"num_write":788,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706944+0000","last_change":"2024-09-14T11:11:04.636718+0000","last_active":"2024-09-14T12:06:04.706944+0000","last_peered":"2024-09-14T12:06:04.706944+0000","last_clean":"2024-09-14T12:06:04.706944+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:06:04.706944+0000","last_undegraded":"2024-09-14T12:06:04.706944+0000","last_fullsized":"2024-09-14T12:06:04.706944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.511083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'174","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681293+0000","last_change":"2024-09-14T11:11:06.650082+0000","last_active":"2024-09-14T12:07:09.681293+0000","last_peered":"2024-09-14T12:07:09.681293+0000","last_clean":"2024-09-14T12:07:09.681293+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:07:09.681293+0000","last_undegraded":"2024-09-14T12:07:09.681293+0000","last_fullsized":"2024-09-14T12:07:09.681293+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:16.276250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569715+0000","last_change":"2024-09-14T11:10:58.606571+0000","last_active":"2024-09-14T12:07:15.569715+0000","last_peered":"2024-09-14T12:07:15.569715+0000","last_clean":"2024-09-14T12:07:15.569715+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:07:15.569715+0000","last_undegraded":"2024-09-14T12:07:15.569715+0000","last_fullsized":"2024-09-14T12:07:15.569715+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:01.887992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'333","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.805046+0000","last_change":"2024-09-14T11:10:56.607042+0000","last_active":"2024-09-14T12:09:54.805046+0000","last_peered":"2024-09-14T12:09:54.805046+0000","last_clean":"2024-09-14T12:09:54.805046+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:09:54.805046+0000","last_undegraded":"2024-09-14T12:09:54.805046+0000","last_fullsized":"2024-09-14T12:09:54.805046+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:10.108123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":4521,"num_write":984,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587550+0000","last_change":"2024-09-14T11:11:00.608589+0000","last_active":"2024-09-14T12:07:15.587550+0000","last_peered":"2024-09-14T12:07:15.587550+0000","last_clean":"2024-09-14T12:07:15.587550+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:15.587550+0000","last_undegraded":"2024-09-14T12:07:15.587550+0000","last_fullsized":"2024-09-14T12:07:15.587550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:24.982876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'312","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.256716+0000","last_change":"2024-09-14T11:11:02.611238+0000","last_active":"2024-09-14T12:09:53.256716+0000","last_peered":"2024-09-14T12:09:53.256716+0000","last_clean":"2024-09-14T12:09:53.256716+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:09:53.256716+0000","last_undegraded":"2024-09-14T12:09:53.256716+0000","last_fullsized":"2024-09-14T12:09:53.256716+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.446639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663956+0000","last_change":"2024-09-14T11:11:04.630801+0000","last_active":"2024-09-14T12:06:05.663956+0000","last_peered":"2024-09-14T12:06:05.663956+0000","last_clean":"2024-09-14T12:06:05.663956+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:06:05.663956+0000","last_undegraded":"2024-09-14T12:06:05.663956+0000","last_fullsized":"2024-09-14T12:06:05.663956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:37.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'187","reported_seq":714,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586739+0000","last_change":"2024-09-14T11:11:06.647146+0000","last_active":"2024-09-14T12:07:10.586739+0000","last_peered":"2024-09-14T12:07:10.586739+0000","last_clean":"2024-09-14T12:07:10.586739+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:07:10.586739+0000","last_undegraded":"2024-09-14T12:07:10.586739+0000","last_fullsized":"2024-09-14T12:07:10.586739+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.672972+0000","last_change":"2024-09-14T11:10:58.603000+0000","last_active":"2024-09-14T12:05:59.672972+0000","last_peered":"2024-09-14T12:05:59.672972+0000","last_clean":"2024-09-14T12:05:59.672972+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:05:59.672972+0000","last_undegraded":"2024-09-14T12:05:59.672972+0000","last_fullsized":"2024-09-14T12:05:59.672972+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:38.408009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'343","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.652044+0000","last_change":"2024-09-14T11:11:32.679317+0000","last_active":"2024-09-14T12:09:54.652044+0000","last_peered":"2024-09-14T12:09:54.652044+0000","last_clean":"2024-09-14T12:09:54.652044+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:09:54.652044+0000","last_undegraded":"2024-09-14T12:09:54.652044+0000","last_fullsized":"2024-09-14T12:09:54.652044+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:20.868051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":125003,"num_write":1056,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570899+0000","last_change":"2024-09-14T11:11:00.610641+0000","last_active":"2024-09-14T12:06:04.570899+0000","last_peered":"2024-09-14T12:06:04.570899+0000","last_clean":"2024-09-14T12:06:04.570899+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:06:04.570899+0000","last_undegraded":"2024-09-14T12:06:04.570899+0000","last_fullsized":"2024-09-14T12:06:04.570899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:34.052721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'303","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.373148+0000","last_change":"2024-09-14T11:11:02.882152+0000","last_active":"2024-09-14T12:09:54.373148+0000","last_peered":"2024-09-14T12:09:54.373148+0000","last_clean":"2024-09-14T12:09:54.373148+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:09:54.373148+0000","last_undegraded":"2024-09-14T12:09:54.373148+0000","last_fullsized":"2024-09-14T12:09:54.373148+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:00.329236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671401+0000","last_change":"2024-09-14T11:11:04.637717+0000","last_active":"2024-09-14T12:07:15.671401+0000","last_peered":"2024-09-14T12:07:15.671401+0000","last_clean":"2024-09-14T12:07:15.671401+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:07:15.671401+0000","last_undegraded":"2024-09-14T12:07:15.671401+0000","last_fullsized":"2024-09-14T12:07:15.671401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:00.714105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'131","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.877188+0000","last_change":"2024-09-14T11:11:06.644460+0000","last_active":"2024-09-14T12:09:14.877188+0000","last_peered":"2024-09-14T12:09:14.877188+0000","last_clean":"2024-09-14T12:09:14.877188+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:09:14.877188+0000","last_undegraded":"2024-09-14T12:09:14.877188+0000","last_fullsized":"2024-09-14T12:09:14.877188+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:22.358502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.587198+0000","last_change":"2024-09-14T11:10:58.609393+0000","last_active":"2024-09-14T12:07:56.587198+0000","last_peered":"2024-09-14T12:07:56.587198+0000","last_clean":"2024-09-14T12:07:56.587198+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:07:56.587198+0000","last_undegraded":"2024-09-14T12:07:56.587198+0000","last_fullsized":"2024-09-14T12:07:56.587198+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:50.454872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'420","reported_seq":1140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.035048+0000","last_change":"2024-09-14T12:09:58.035048+0000","last_active":"2024-09-14T12:09:58.035048+0000","last_peered":"2024-09-14T12:09:58.035048+0000","last_clean":"2024-09-14T12:09:58.035048+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:09:58.035048+0000","last_undegraded":"2024-09-14T12:09:58.035048+0000","last_fullsized":"2024-09-14T12:09:58.035048+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.034944+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:02.918444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":916,"num_read_kb":75270,"num_write":1291,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.663411+0000","last_change":"2024-09-14T11:11:00.608561+0000","last_active":"2024-09-14T12:06:00.663411+0000","last_peered":"2024-09-14T12:06:00.663411+0000","last_clean":"2024-09-14T12:06:00.663411+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:06:00.663411+0000","last_undegraded":"2024-09-14T12:06:00.663411+0000","last_fullsized":"2024-09-14T12:06:00.663411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:50.035124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'107","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580809+0000","last_change":"2024-09-14T11:11:02.882216+0000","last_active":"2024-09-14T12:07:14.580809+0000","last_peered":"2024-09-14T12:07:14.580809+0000","last_clean":"2024-09-14T12:07:14.580809+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:07:14.580809+0000","last_undegraded":"2024-09-14T12:07:14.580809+0000","last_fullsized":"2024-09-14T12:07:14.580809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.190894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'777","reported_seq":2369,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.941924+0000","last_change":"2024-09-14T11:11:04.634837+0000","last_active":"2024-09-14T12:09:53.941924+0000","last_peered":"2024-09-14T12:09:53.941924+0000","last_clean":"2024-09-14T12:09:53.941924+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:09:53.941924+0000","last_undegraded":"2024-09-14T12:09:53.941924+0000","last_fullsized":"2024-09-14T12:09:53.941924+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:02.919719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.505956+0000","last_change":"2024-09-14T11:11:06.646662+0000","last_active":"2024-09-14T12:07:57.505956+0000","last_peered":"2024-09-14T12:07:57.505956+0000","last_clean":"2024-09-14T12:07:57.505956+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:07:57.505956+0000","last_undegraded":"2024-09-14T12:07:57.505956+0000","last_fullsized":"2024-09-14T12:07:57.505956+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:39.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.570113+0000","last_change":"2024-09-14T11:10:58.612211+0000","last_active":"2024-09-14T12:05:59.570113+0000","last_peered":"2024-09-14T12:05:59.570113+0000","last_clean":"2024-09-14T12:05:59.570113+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:05:59.570113+0000","last_undegraded":"2024-09-14T12:05:59.570113+0000","last_fullsized":"2024-09-14T12:05:59.570113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.689101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'295","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.641809+0000","last_change":"2024-09-14T11:10:56.602145+0000","last_active":"2024-09-14T12:09:54.641809+0000","last_peered":"2024-09-14T12:09:54.641809+0000","last_clean":"2024-09-14T12:09:54.641809+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:09:54.641809+0000","last_undegraded":"2024-09-14T12:09:54.641809+0000","last_fullsized":"2024-09-14T12:09:54.641809+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:25.629525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":114075,"num_write":994,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570893+0000","last_change":"2024-09-14T11:11:00.608599+0000","last_active":"2024-09-14T12:06:04.570893+0000","last_peered":"2024-09-14T12:06:04.570893+0000","last_clean":"2024-09-14T12:06:04.570893+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:06:04.570893+0000","last_undegraded":"2024-09-14T12:06:04.570893+0000","last_fullsized":"2024-09-14T12:06:04.570893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:59.368073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'301","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.816456+0000","last_change":"2024-09-14T11:11:02.616575+0000","last_active":"2024-09-14T12:09:54.816456+0000","last_peered":"2024-09-14T12:09:54.816456+0000","last_clean":"2024-09-14T12:09:54.816456+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:09:54.816456+0000","last_undegraded":"2024-09-14T12:09:54.816456+0000","last_fullsized":"2024-09-14T12:09:54.816456+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:12.984482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":1004,"num_write":382,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565340+0000","last_change":"2024-09-14T11:11:04.635106+0000","last_active":"2024-09-14T12:06:40.565340+0000","last_peered":"2024-09-14T12:06:40.565340+0000","last_clean":"2024-09-14T12:06:40.565340+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:06:40.565340+0000","last_undegraded":"2024-09-14T12:06:40.565340+0000","last_fullsized":"2024-09-14T12:06:40.565340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:25.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'100","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.598806+0000","last_change":"2024-09-14T11:11:06.649099+0000","last_active":"2024-09-14T12:07:54.598806+0000","last_peered":"2024-09-14T12:07:54.598806+0000","last_clean":"2024-09-14T12:07:54.598806+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:07:54.598806+0000","last_undegraded":"2024-09-14T12:07:54.598806+0000","last_fullsized":"2024-09-14T12:07:54.598806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:17.632657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:18.837677+0000","last_change":"2024-09-14T11:10:58.612093+0000","last_active":"2024-09-14T12:07:18.837677+0000","last_peered":"2024-09-14T12:07:18.837677+0000","last_clean":"2024-09-14T12:07:18.837677+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:07:18.837677+0000","last_undegraded":"2024-09-14T12:07:18.837677+0000","last_fullsized":"2024-09-14T12:07:18.837677+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:49.500728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'364","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.794741+0000","last_change":"2024-09-14T11:12:32.771972+0000","last_active":"2024-09-14T12:09:54.794741+0000","last_peered":"2024-09-14T12:09:54.794741+0000","last_clean":"2024-09-14T12:09:54.794741+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:09:54.794741+0000","last_undegraded":"2024-09-14T12:09:54.794741+0000","last_fullsized":"2024-09-14T12:09:54.794741+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:36.488962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":577,"num_read_kb":11549,"num_write":1068,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706910+0000","last_change":"2024-09-14T11:11:00.610742+0000","last_active":"2024-09-14T12:06:04.706910+0000","last_peered":"2024-09-14T12:06:04.706910+0000","last_clean":"2024-09-14T12:06:04.706910+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:06:04.706910+0000","last_undegraded":"2024-09-14T12:06:04.706910+0000","last_fullsized":"2024-09-14T12:06:04.706910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:51.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":849,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.495469+0000","last_change":"2024-09-14T11:11:02.617754+0000","last_active":"2024-09-14T12:09:52.495469+0000","last_peered":"2024-09-14T12:09:52.495469+0000","last_clean":"2024-09-14T12:09:52.495469+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:09:52.495469+0000","last_undegraded":"2024-09-14T12:09:52.495469+0000","last_fullsized":"2024-09-14T12:09:52.495469+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:03.531301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44701,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1000,"num_write":364,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.583943+0000","last_change":"2024-09-14T11:11:04.629288+0000","last_active":"2024-09-14T12:06:50.583943+0000","last_peered":"2024-09-14T12:06:50.583943+0000","last_clean":"2024-09-14T12:06:50.583943+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:06:50.583943+0000","last_undegraded":"2024-09-14T12:06:50.583943+0000","last_fullsized":"2024-09-14T12:06:50.583943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:29.995583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'105","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.593163+0000","last_change":"2024-09-14T11:11:06.648742+0000","last_active":"2024-09-14T12:07:54.593163+0000","last_peered":"2024-09-14T12:07:54.593163+0000","last_clean":"2024-09-14T12:07:54.593163+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:07:54.593163+0000","last_undegraded":"2024-09-14T12:07:54.593163+0000","last_fullsized":"2024-09-14T12:07:54.593163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:19.341185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'440","reported_seq":1196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:13.845766+0000","last_change":"2024-09-14T11:10:58.608774+0000","last_active":"2024-09-14T12:07:13.845766+0000","last_peered":"2024-09-14T12:07:13.845766+0000","last_clean":"2024-09-14T12:07:13.845766+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:07:13.845766+0000","last_undegraded":"2024-09-14T12:07:13.845766+0000","last_fullsized":"2024-09-14T12:07:13.845766+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:13.214663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'351","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.774393+0000","last_change":"2024-09-14T11:10:56.619597+0000","last_active":"2024-09-14T12:09:54.774393+0000","last_peered":"2024-09-14T12:09:54.774393+0000","last_clean":"2024-09-14T12:09:54.774393+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:09:54.774393+0000","last_undegraded":"2024-09-14T12:09:54.774393+0000","last_fullsized":"2024-09-14T12:09:54.774393+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:58.279398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":1479,"num_write":1091,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575841+0000","last_change":"2024-09-14T11:11:00.613471+0000","last_active":"2024-09-14T12:06:39.575841+0000","last_peered":"2024-09-14T12:06:39.575841+0000","last_clean":"2024-09-14T12:06:39.575841+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:06:39.575841+0000","last_undegraded":"2024-09-14T12:06:39.575841+0000","last_fullsized":"2024-09-14T12:06:39.575841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:51.522567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'237","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.260926+0000","last_change":"2024-09-14T11:11:02.620023+0000","last_active":"2024-09-14T12:09:54.260926+0000","last_peered":"2024-09-14T12:09:54.260926+0000","last_clean":"2024-09-14T12:09:54.260926+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:09:54.260926+0000","last_undegraded":"2024-09-14T12:09:54.260926+0000","last_fullsized":"2024-09-14T12:09:54.260926+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.942166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570865+0000","last_change":"2024-09-14T11:11:04.636920+0000","last_active":"2024-09-14T12:06:04.570865+0000","last_peered":"2024-09-14T12:06:04.570865+0000","last_clean":"2024-09-14T12:06:04.570865+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:06:04.570865+0000","last_undegraded":"2024-09-14T12:06:04.570865+0000","last_fullsized":"2024-09-14T12:06:04.570865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:04.328783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'210","reported_seq":1682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.573850+0000","last_change":"2024-09-14T11:11:06.646323+0000","last_active":"2024-09-14T12:07:54.573850+0000","last_peered":"2024-09-14T12:07:54.573850+0000","last_clean":"2024-09-14T12:07:54.573850+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:07:54.573850+0000","last_undegraded":"2024-09-14T12:07:54.573850+0000","last_fullsized":"2024-09-14T12:07:54.573850+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:54.472116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.626310+0000","last_change":"2024-09-14T11:10:58.603025+0000","last_active":"2024-09-14T12:06:35.626310+0000","last_peered":"2024-09-14T12:06:35.626310+0000","last_clean":"2024-09-14T12:06:35.626310+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:06:35.626310+0000","last_undegraded":"2024-09-14T12:06:35.626310+0000","last_fullsized":"2024-09-14T12:06:35.626310+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:50.041412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'348","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.640788+0000","last_change":"2024-09-14T11:10:56.609202+0000","last_active":"2024-09-14T12:09:54.640788+0000","last_peered":"2024-09-14T12:09:54.640788+0000","last_clean":"2024-09-14T12:09:54.640788+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:09:54.640788+0000","last_undegraded":"2024-09-14T12:09:54.640788+0000","last_fullsized":"2024-09-14T12:09:54.640788+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:20.975464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":4572,"num_write":1085,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:45.668134+0000","last_change":"2024-09-14T11:11:00.612948+0000","last_active":"2024-09-14T12:06:45.668134+0000","last_peered":"2024-09-14T12:06:45.668134+0000","last_clean":"2024-09-14T12:06:45.668134+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:06:45.668134+0000","last_undegraded":"2024-09-14T12:06:45.668134+0000","last_fullsized":"2024-09-14T12:06:45.668134+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:59.559655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.427158+0000","last_change":"2024-09-14T11:11:02.615915+0000","last_active":"2024-09-14T12:09:54.427158+0000","last_peered":"2024-09-14T12:09:54.427158+0000","last_clean":"2024-09-14T12:09:54.427158+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:09:54.427158+0000","last_undegraded":"2024-09-14T12:09:54.427158+0000","last_fullsized":"2024-09-14T12:09:54.427158+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:13.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561147+0000","last_change":"2024-09-14T11:11:04.638367+0000","last_active":"2024-09-14T12:06:05.561147+0000","last_peered":"2024-09-14T12:06:05.561147+0000","last_clean":"2024-09-14T12:06:05.561147+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:06:05.561147+0000","last_undegraded":"2024-09-14T12:06:05.561147+0000","last_fullsized":"2024-09-14T12:06:05.561147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:16.944434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.887875+0000","last_change":"2024-09-14T11:11:06.650184+0000","last_active":"2024-09-14T12:09:13.887875+0000","last_peered":"2024-09-14T12:09:13.887875+0000","last_clean":"2024-09-14T12:09:13.887875+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:09:13.887875+0000","last_undegraded":"2024-09-14T12:09:13.887875+0000","last_fullsized":"2024-09-14T12:09:13.887875+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:56.510761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671963+0000","last_change":"2024-09-14T11:10:58.608289+0000","last_active":"2024-09-14T12:07:20.671963+0000","last_peered":"2024-09-14T12:07:20.671963+0000","last_clean":"2024-09-14T12:07:20.671963+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:07:20.671963+0000","last_undegraded":"2024-09-14T12:07:20.671963+0000","last_fullsized":"2024-09-14T12:07:20.671963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:55.384223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'310","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.639098+0000","last_change":"2024-09-14T11:10:56.618556+0000","last_active":"2024-09-14T12:09:54.639098+0000","last_peered":"2024-09-14T12:09:54.639098+0000","last_clean":"2024-09-14T12:09:54.639098+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:09:54.639098+0000","last_undegraded":"2024-09-14T12:09:54.639098+0000","last_fullsized":"2024-09-14T12:09:54.639098+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:36.853534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":25535,"num_write":1011,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'180","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671944+0000","last_change":"2024-09-14T11:10:58.609726+0000","last_active":"2024-09-14T12:07:20.671944+0000","last_peered":"2024-09-14T12:07:20.671944+0000","last_clean":"2024-09-14T12:07:20.671944+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:07:20.671944+0000","last_undegraded":"2024-09-14T12:07:20.671944+0000","last_fullsized":"2024-09-14T12:07:20.671944+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:49.028498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'354","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.676172+0000","last_change":"2024-09-14T11:10:56.612746+0000","last_active":"2024-09-14T12:09:54.676172+0000","last_peered":"2024-09-14T12:09:54.676172+0000","last_clean":"2024-09-14T12:09:54.676172+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:09:54.676172+0000","last_undegraded":"2024-09-14T12:09:54.676172+0000","last_fullsized":"2024-09-14T12:09:54.676172+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:46.452349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":943,"num_read_kb":26386,"num_write":1247,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.718057+0000","last_change":"2024-09-14T11:10:58.599992+0000","last_active":"2024-09-14T12:07:19.718057+0000","last_peered":"2024-09-14T12:07:19.718057+0000","last_clean":"2024-09-14T12:07:19.718057+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:07:19.718057+0000","last_undegraded":"2024-09-14T12:07:19.718057+0000","last_fullsized":"2024-09-14T12:07:19.718057+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:35.235270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'349","reported_seq":990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.644386+0000","last_change":"2024-09-14T11:10:56.622668+0000","last_active":"2024-09-14T12:09:54.644386+0000","last_peered":"2024-09-14T12:09:54.644386+0000","last_clean":"2024-09-14T12:09:54.644386+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:09:54.644386+0000","last_undegraded":"2024-09-14T12:09:54.644386+0000","last_fullsized":"2024-09-14T12:09:54.644386+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.252105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":18057,"num_write":1029,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671901+0000","last_change":"2024-09-14T11:10:58.599162+0000","last_active":"2024-09-14T12:07:20.671901+0000","last_peered":"2024-09-14T12:07:20.671901+0000","last_clean":"2024-09-14T12:07:20.671901+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:07:20.671901+0000","last_undegraded":"2024-09-14T12:07:20.671901+0000","last_fullsized":"2024-09-14T12:07:20.671901+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:04.215338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'339","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.641931+0000","last_change":"2024-09-14T11:11:32.790442+0000","last_active":"2024-09-14T12:09:54.641931+0000","last_peered":"2024-09-14T12:09:54.641931+0000","last_clean":"2024-09-14T12:09:54.641931+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:09:54.641931+0000","last_undegraded":"2024-09-14T12:09:54.641931+0000","last_fullsized":"2024-09-14T12:09:54.641931+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:26.523306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263498,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":9886,"num_write":1170,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.683406+0000","last_change":"2024-09-14T11:10:58.603379+0000","last_active":"2024-09-14T12:07:24.683406+0000","last_peered":"2024-09-14T12:07:24.683406+0000","last_clean":"2024-09-14T12:07:24.683406+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:07:24.683406+0000","last_undegraded":"2024-09-14T12:07:24.683406+0000","last_fullsized":"2024-09-14T12:07:24.683406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:08.757768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'373","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.622829+0000","last_change":"2024-09-14T11:10:56.619064+0000","last_active":"2024-09-14T12:09:54.622829+0000","last_peered":"2024-09-14T12:09:54.622829+0000","last_clean":"2024-09-14T12:09:54.622829+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:09:54.622829+0000","last_undegraded":"2024-09-14T12:09:54.622829+0000","last_fullsized":"2024-09-14T12:09:54.622829+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:51.621055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":11859,"num_write":1346,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'247","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580693+0000","last_change":"2024-09-14T11:10:58.604356+0000","last_active":"2024-09-14T12:07:14.580693+0000","last_peered":"2024-09-14T12:07:14.580693+0000","last_clean":"2024-09-14T12:07:14.580693+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:07:14.580693+0000","last_undegraded":"2024-09-14T12:07:14.580693+0000","last_fullsized":"2024-09-14T12:07:14.580693+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:09.830102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.580574+0000","last_change":"2024-09-14T11:10:56.607620+0000","last_active":"2024-09-14T12:09:54.580574+0000","last_peered":"2024-09-14T12:09:54.580574+0000","last_clean":"2024-09-14T12:09:54.580574+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:09:54.580574+0000","last_undegraded":"2024-09-14T12:09:54.580574+0000","last_fullsized":"2024-09-14T12:09:54.580574+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:01.270486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":36459,"num_write":976,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681847+0000","last_change":"2024-09-14T11:10:58.610796+0000","last_active":"2024-09-14T12:07:14.681847+0000","last_peered":"2024-09-14T12:07:14.681847+0000","last_clean":"2024-09-14T12:07:14.681847+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:07:14.681847+0000","last_undegraded":"2024-09-14T12:07:14.681847+0000","last_fullsized":"2024-09-14T12:07:14.681847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.802576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'380","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.655435+0000","last_change":"2024-09-14T11:11:32.791047+0000","last_active":"2024-09-14T12:09:54.655435+0000","last_peered":"2024-09-14T12:09:54.655435+0000","last_clean":"2024-09-14T12:09:54.655435+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:09:54.655435+0000","last_undegraded":"2024-09-14T12:09:54.655435+0000","last_fullsized":"2024-09-14T12:09:54.655435+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:03.370176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":129855,"num_write":1253,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587458+0000","last_change":"2024-09-14T11:10:58.607143+0000","last_active":"2024-09-14T12:07:15.587458+0000","last_peered":"2024-09-14T12:07:15.587458+0000","last_clean":"2024-09-14T12:07:15.587458+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:07:15.587458+0000","last_undegraded":"2024-09-14T12:07:15.587458+0000","last_fullsized":"2024-09-14T12:07:15.587458+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:11.437478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'359","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.615639+0000","last_change":"2024-09-14T11:10:56.620202+0000","last_active":"2024-09-14T12:09:54.615639+0000","last_peered":"2024-09-14T12:09:54.615639+0000","last_clean":"2024-09-14T12:09:54.615639+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:09:54.615639+0000","last_undegraded":"2024-09-14T12:09:54.615639+0000","last_fullsized":"2024-09-14T12:09:54.615639+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:43.014580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":616,"num_read_kb":2365,"num_write":1155,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.567847+0000","last_change":"2024-09-14T11:10:58.614201+0000","last_active":"2024-09-14T12:07:00.567847+0000","last_peered":"2024-09-14T12:07:00.567847+0000","last_clean":"2024-09-14T12:07:00.567847+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:07:00.567847+0000","last_undegraded":"2024-09-14T12:07:00.567847+0000","last_fullsized":"2024-09-14T12:07:00.567847+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:57.400806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.785146+0000","last_change":"2024-09-14T11:10:56.606394+0000","last_active":"2024-09-14T12:09:54.785146+0000","last_peered":"2024-09-14T12:09:54.785146+0000","last_clean":"2024-09-14T12:09:54.785146+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:09:54.785146+0000","last_undegraded":"2024-09-14T12:09:54.785146+0000","last_fullsized":"2024-09-14T12:09:54.785146+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:34.783451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":15479,"num_write":1162,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.578562+0000","last_change":"2024-09-14T11:10:58.609097+0000","last_active":"2024-09-14T12:06:59.578562+0000","last_peered":"2024-09-14T12:06:59.578562+0000","last_clean":"2024-09-14T12:06:59.578562+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:06:59.578562+0000","last_undegraded":"2024-09-14T12:06:59.578562+0000","last_fullsized":"2024-09-14T12:06:59.578562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:56.920723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'356","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.596496+0000","last_change":"2024-09-14T11:11:32.791033+0000","last_active":"2024-09-14T12:09:54.596496+0000","last_peered":"2024-09-14T12:09:54.596496+0000","last_clean":"2024-09-14T12:09:54.596496+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:09:54.596496+0000","last_undegraded":"2024-09-14T12:09:54.596496+0000","last_fullsized":"2024-09-14T12:09:54.596496+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:01.149980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":4745,"num_write":1096,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'455","reported_seq":1139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.655648+0000","last_change":"2024-09-14T11:10:58.607355+0000","last_active":"2024-09-14T12:07:19.655648+0000","last_peered":"2024-09-14T12:07:19.655648+0000","last_clean":"2024-09-14T12:07:19.655648+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:07:19.655648+0000","last_undegraded":"2024-09-14T12:07:19.655648+0000","last_fullsized":"2024-09-14T12:07:19.655648+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:29.211083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'551","reported_seq":1353,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.803792+0000","last_change":"2024-09-14T11:10:56.609284+0000","last_active":"2024-09-14T12:09:54.803792+0000","last_peered":"2024-09-14T12:09:54.803792+0000","last_clean":"2024-09-14T12:09:54.803792+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:09:54.803792+0000","last_undegraded":"2024-09-14T12:09:54.803792+0000","last_fullsized":"2024-09-14T12:09:54.803792+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:15.856244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1371,"num_read_kb":53620,"num_write":1733,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'707","reported_seq":1554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580728+0000","last_change":"2024-09-14T11:10:58.605938+0000","last_active":"2024-09-14T12:07:14.580728+0000","last_peered":"2024-09-14T12:07:14.580728+0000","last_clean":"2024-09-14T12:07:14.580728+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:07:14.580728+0000","last_undegraded":"2024-09-14T12:07:14.580728+0000","last_fullsized":"2024-09-14T12:07:14.580728+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.944096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'328","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.628029+0000","last_change":"2024-09-14T11:10:56.612040+0000","last_active":"2024-09-14T12:09:54.628029+0000","last_peered":"2024-09-14T12:09:54.628029+0000","last_clean":"2024-09-14T12:09:54.628029+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:09:54.628029+0000","last_undegraded":"2024-09-14T12:09:54.628029+0000","last_fullsized":"2024-09-14T12:09:54.628029+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:34.021658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10603,"num_write":1037,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":709,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581159+0000","last_change":"2024-09-14T11:10:58.613360+0000","last_active":"2024-09-14T12:07:14.581159+0000","last_peered":"2024-09-14T12:07:14.581159+0000","last_clean":"2024-09-14T12:07:14.581159+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:07:14.581159+0000","last_undegraded":"2024-09-14T12:07:14.581159+0000","last_fullsized":"2024-09-14T12:07:14.581159+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:24.266610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'348","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.618452+0000","last_change":"2024-09-14T11:10:56.618547+0000","last_active":"2024-09-14T12:09:54.618452+0000","last_peered":"2024-09-14T12:09:54.618452+0000","last_clean":"2024-09-14T12:09:54.618452+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:09:54.618452+0000","last_undegraded":"2024-09-14T12:09:54.618452+0000","last_fullsized":"2024-09-14T12:09:54.618452+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:44.204258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":12533,"num_write":1141,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":673,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569633+0000","last_change":"2024-09-14T11:10:58.613749+0000","last_active":"2024-09-14T12:07:15.569633+0000","last_peered":"2024-09-14T12:07:15.569633+0000","last_clean":"2024-09-14T12:07:15.569633+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:07:15.569633+0000","last_undegraded":"2024-09-14T12:07:15.569633+0000","last_fullsized":"2024-09-14T12:07:15.569633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:40.466116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'401","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.804550+0000","last_change":"2024-09-14T11:10:56.605577+0000","last_active":"2024-09-14T12:09:54.804550+0000","last_peered":"2024-09-14T12:09:54.804550+0000","last_clean":"2024-09-14T12:09:54.804550+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:09:54.804550+0000","last_undegraded":"2024-09-14T12:09:54.804550+0000","last_fullsized":"2024-09-14T12:09:54.804550+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:17.688717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":13606,"num_write":1190,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.093054+0000","last_change":"2024-09-14T11:10:58.609288+0000","last_active":"2024-09-14T12:07:54.093054+0000","last_peered":"2024-09-14T12:07:54.093054+0000","last_clean":"2024-09-14T12:07:54.093054+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:07:54.093054+0000","last_undegraded":"2024-09-14T12:07:54.093054+0000","last_fullsized":"2024-09-14T12:07:54.093054+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:13.226950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'342","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.790496+0000","last_change":"2024-09-14T11:10:56.610961+0000","last_active":"2024-09-14T12:09:54.790496+0000","last_peered":"2024-09-14T12:09:54.790496+0000","last_clean":"2024-09-14T12:09:54.790496+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:09:54.790496+0000","last_undegraded":"2024-09-14T12:09:54.790496+0000","last_fullsized":"2024-09-14T12:09:54.790496+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:29.522513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":59967,"num_write":1134,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'392","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583376+0000","last_change":"2024-09-14T11:10:58.613428+0000","last_active":"2024-09-14T12:07:29.583376+0000","last_peered":"2024-09-14T12:07:29.583376+0000","last_clean":"2024-09-14T12:07:29.583376+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:07:29.583376+0000","last_undegraded":"2024-09-14T12:07:29.583376+0000","last_fullsized":"2024-09-14T12:07:29.583376+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:14.361166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'331","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.784167+0000","last_change":"2024-09-14T11:10:56.608905+0000","last_active":"2024-09-14T12:09:54.784167+0000","last_peered":"2024-09-14T12:09:54.784167+0000","last_clean":"2024-09-14T12:09:54.784167+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:09:54.784167+0000","last_undegraded":"2024-09-14T12:09:54.784167+0000","last_fullsized":"2024-09-14T12:09:54.784167+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.643941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":22222,"num_write":1088,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'360","reported_seq":1046,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.621785+0000","last_change":"2024-09-14T11:10:56.602252+0000","last_active":"2024-09-14T12:09:54.621785+0000","last_peered":"2024-09-14T12:09:54.621785+0000","last_clean":"2024-09-14T12:09:54.621785+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:09:54.621785+0000","last_undegraded":"2024-09-14T12:09:54.621785+0000","last_fullsized":"2024-09-14T12:09:54.621785+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:51.972236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":41589,"num_write":1192,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566728+0000","last_change":"2024-09-14T11:10:58.614921+0000","last_active":"2024-09-14T12:06:50.566728+0000","last_peered":"2024-09-14T12:06:50.566728+0000","last_clean":"2024-09-14T12:06:50.566728+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:06:50.566728+0000","last_undegraded":"2024-09-14T12:06:50.566728+0000","last_fullsized":"2024-09-14T12:06:50.566728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:23.537706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'467","reported_seq":1142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.804784+0000","last_change":"2024-09-14T11:11:32.677927+0000","last_active":"2024-09-14T12:09:54.804784+0000","last_peered":"2024-09-14T12:09:54.804784+0000","last_clean":"2024-09-14T12:09:54.804784+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:09:54.804784+0000","last_undegraded":"2024-09-14T12:09:54.804784+0000","last_fullsized":"2024-09-14T12:09:54.804784+0000","mapping_epoch":38,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:55.581419+0000","last_clean_scrub_stamp":"2024-09-14T11:10:55.581419+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:06.109677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":936,"num_read_kb":7353,"num_write":1336,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.782731+0000","last_change":"2024-09-14T11:10:58.606955+0000","last_active":"2024-09-14T12:07:10.782731+0000","last_peered":"2024-09-14T12:07:10.782731+0000","last_clean":"2024-09-14T12:07:10.782731+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:07:10.782731+0000","last_undegraded":"2024-09-14T12:07:10.782731+0000","last_fullsized":"2024-09-14T12:07:10.782731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:23.557773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1690,"ondisk_log_size":1690,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595,"ondisk_log_size":595,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1638457,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":18085,"num_read_kb":37656,"num_write":15239,"num_write_kb":11977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2188,"ondisk_log_size":2188,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4332,"ondisk_log_size":4332,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":32687811,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44407,"num_read_kb":2049088,"num_write":73495,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50442240,"data_stored":50442240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3782,"ondisk_log_size":3782,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":224799,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":204319,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510157,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280296,"kb_used_data":10328,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94091544,"statfs":{"total":96636764160,"available":96349741056,"internally_reserved":0,"allocated":10575872,"data_stored":8512576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510157,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149360,"kb_used_data":9952,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":10190848,"data_stored":8104359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510157,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275176,"kb_used_data":14936,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94096664,"statfs":{"total":96636764160,"available":96354983936,"internally_reserved":0,"allocated":15294464,"data_stored":13168761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":266467781},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542860,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296732,"kb_used_data":12876,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075108,"statfs":{"total":96636764160,"available":96332910592,"internally_reserved":0,"allocated":13185024,"data_stored":11050510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":290650571},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542861,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144272,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94227568,"statfs":{"total":96636764160,"available":96489029632,"internally_reserved":0,"allocated":9097216,"data_stored":6957133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542859,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126596,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94245244,"statfs":{"total":96636764160,"available":96507129856,"internally_reserved":0,"allocated":15171584,"data_stored":13135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542861,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280592,"kb_used_data":6192,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94091248,"statfs":{"total":96636764160,"available":96349437952,"internally_reserved":0,"allocated":6340608,"data_stored":4233902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542861,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87884,"kb_used_data":6644,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94283956,"statfs":{"total":96636764160,"available":96546770944,"internally_reserved":0,"allocated":6803456,"data_stored":4759690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10289152,"data_stored":10289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":5816320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2473984,"data_stored":2473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":1945600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10850304,"data_stored":10850304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4669440,"data_stored":4669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8171520,"data_stored":8171520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:10:01.650 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.650 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.651 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.652 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.653 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.654 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.655 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.656 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.657 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.658 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.659 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.660 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.661 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.662 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.663 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.664 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.665 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.666 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.667 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.668 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.669 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.670 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.671 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.672 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.673 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.674 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.675 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.676 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.677 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.678 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:10:39.523268+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=39, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:10:46.544062+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.679 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:10:46.544062+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.680 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.681 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:10:46.544062+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.682 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:10:46.544062+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.683 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:10:46.544062+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.684 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:10:46.544062+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.685 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.686 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.687 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.688 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.689 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.690 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.691 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.692 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.693 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.694 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.695 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.696 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.697 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:10:55.581419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.698 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:01.699 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:10:21.700 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:10:22.052 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:10:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:10:22.064 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2048,"stamp":"2024-09-14T12:10:20.853789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34933529,"num_objects":607,"num_object_clones":0,"num_object_copies":1495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":607,"num_whiteouts":0,"num_read":199663,"num_read_kb":2633567,"num_write":147738,"num_write_kb":2509949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":605416,"num_omap_keys":1431,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13963,"ondisk_log_size":13963,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1644372,"kb_used_data":84628,"kb_used_omap":12,"kb_used_meta":1559603,"kb_avail":753330348,"statfs":{"total":773094113280,"available":771410276352,"internally_reserved":0,"allocated":86659072,"data_stored":69922534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1597034033},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":605416,"num_omap_keys":1431,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004929"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.714132+0000","last_change":"2024-09-14T11:44:25.351991+0000","last_active":"2024-09-14T12:06:54.714132+0000","last_peered":"2024-09-14T12:06:54.714132+0000","last_clean":"2024-09-14T12:06:54.714132+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:06:54.714132+0000","last_undegraded":"2024-09-14T12:06:54.714132+0000","last_fullsized":"2024-09-14T12:06:54.714132+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:51.739360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.707626+0000","last_change":"2024-09-14T11:28:36.255342+0000","last_active":"2024-09-14T12:06:09.707626+0000","last_peered":"2024-09-14T12:06:09.707626+0000","last_clean":"2024-09-14T12:06:09.707626+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:06:09.707626+0000","last_undegraded":"2024-09-14T12:06:09.707626+0000","last_fullsized":"2024-09-14T12:06:09.707626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.129757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.673633+0000","last_change":"2024-09-14T11:28:33.234582+0000","last_active":"2024-09-14T12:06:04.673633+0000","last_peered":"2024-09-14T12:06:04.673633+0000","last_clean":"2024-09-14T12:06:04.673633+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:06:04.673633+0000","last_undegraded":"2024-09-14T12:06:04.673633+0000","last_fullsized":"2024-09-14T12:06:04.673633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.203877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.569061+0000","last_change":"2024-09-14T11:25:27.952561+0000","last_active":"2024-09-14T12:07:10.569061+0000","last_peered":"2024-09-14T12:07:10.569061+0000","last_clean":"2024-09-14T12:07:10.569061+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:07:10.569061+0000","last_undegraded":"2024-09-14T12:07:10.569061+0000","last_fullsized":"2024-09-14T12:07:10.569061+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:17.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.651197+0000","last_change":"2024-09-14T11:44:25.353765+0000","last_active":"2024-09-14T12:06:54.651197+0000","last_peered":"2024-09-14T12:06:54.651197+0000","last_clean":"2024-09-14T12:06:54.651197+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:06:54.651197+0000","last_undegraded":"2024-09-14T12:06:54.651197+0000","last_fullsized":"2024-09-14T12:06:54.651197+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:11.645628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593518+0000","last_change":"2024-09-14T11:28:36.260521+0000","last_active":"2024-09-14T12:08:39.593518+0000","last_peered":"2024-09-14T12:08:39.593518+0000","last_clean":"2024-09-14T12:08:39.593518+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:08:39.593518+0000","last_undegraded":"2024-09-14T12:08:39.593518+0000","last_fullsized":"2024-09-14T12:08:39.593518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:16.049764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:35.680475+0000","last_change":"2024-09-14T11:28:33.226443+0000","last_active":"2024-09-14T12:08:35.680475+0000","last_peered":"2024-09-14T12:08:35.680475+0000","last_clean":"2024-09-14T12:08:35.680475+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:08:35.680475+0000","last_undegraded":"2024-09-14T12:08:35.680475+0000","last_fullsized":"2024-09-14T12:08:35.680475+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:38.075764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.657263+0000","last_change":"2024-09-14T11:25:27.951069+0000","last_active":"2024-09-14T12:07:34.657263+0000","last_peered":"2024-09-14T12:07:34.657263+0000","last_clean":"2024-09-14T12:07:34.657263+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:07:34.657263+0000","last_undegraded":"2024-09-14T12:07:34.657263+0000","last_fullsized":"2024-09-14T12:07:34.657263+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:28.986404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.578394+0000","last_change":"2024-09-14T11:44:25.347621+0000","last_active":"2024-09-14T12:06:10.578394+0000","last_peered":"2024-09-14T12:06:10.578394+0000","last_clean":"2024-09-14T12:06:10.578394+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:06:10.578394+0000","last_undegraded":"2024-09-14T12:06:10.578394+0000","last_fullsized":"2024-09-14T12:06:10.578394+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:39.883404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'14","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.082866+0000","last_change":"2024-09-14T11:28:36.367262+0000","last_active":"2024-09-14T12:09:54.082866+0000","last_peered":"2024-09-14T12:09:54.082866+0000","last_clean":"2024-09-14T12:09:54.082866+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:09:54.082866+0000","last_undegraded":"2024-09-14T12:09:54.082866+0000","last_fullsized":"2024-09-14T12:09:54.082866+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":33792,"num_write":24,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.649550+0000","last_change":"2024-09-14T11:28:33.226810+0000","last_active":"2024-09-14T12:06:39.649550+0000","last_peered":"2024-09-14T12:06:39.649550+0000","last_clean":"2024-09-14T12:06:39.649550+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:06:39.649550+0000","last_undegraded":"2024-09-14T12:06:39.649550+0000","last_fullsized":"2024-09-14T12:06:39.649550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:52.798886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.557251+0000","last_change":"2024-09-14T11:25:27.940069+0000","last_active":"2024-09-14T12:05:30.557251+0000","last_peered":"2024-09-14T12:05:30.557251+0000","last_clean":"2024-09-14T12:05:30.557251+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:05:30.557251+0000","last_undegraded":"2024-09-14T12:05:30.557251+0000","last_fullsized":"2024-09-14T12:05:30.557251+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:45.611766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:19.675494+0000","last_change":"2024-09-14T11:44:25.356282+0000","last_active":"2024-09-14T12:06:19.675494+0000","last_peered":"2024-09-14T12:06:19.675494+0000","last_clean":"2024-09-14T12:06:19.675494+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:06:19.675494+0000","last_undegraded":"2024-09-14T12:06:19.675494+0000","last_fullsized":"2024-09-14T12:06:19.675494+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:56.126294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.127142+0000","last_change":"2024-09-14T11:28:36.366276+0000","last_active":"2024-09-14T12:09:53.127142+0000","last_peered":"2024-09-14T12:09:53.127142+0000","last_clean":"2024-09-14T12:09:53.127142+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:09:53.127142+0000","last_undegraded":"2024-09-14T12:09:53.127142+0000","last_fullsized":"2024-09-14T12:09:53.127142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:40.126728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.420173+0000","last_change":"2024-09-14T11:28:33.228558+0000","last_active":"2024-09-14T12:09:52.420173+0000","last_peered":"2024-09-14T12:09:52.420173+0000","last_clean":"2024-09-14T12:09:52.420173+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:09:52.420173+0000","last_undegraded":"2024-09-14T12:09:52.420173+0000","last_fullsized":"2024-09-14T12:09:52.420173+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669719+0000","last_change":"2024-09-14T11:25:27.953674+0000","last_active":"2024-09-14T12:05:29.669719+0000","last_peered":"2024-09-14T12:05:29.669719+0000","last_clean":"2024-09-14T12:05:29.669719+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:05:29.669719+0000","last_undegraded":"2024-09-14T12:05:29.669719+0000","last_fullsized":"2024-09-14T12:05:29.669719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:04.652722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677327+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:06:34.677327+0000","last_peered":"2024-09-14T12:06:34.677327+0000","last_clean":"2024-09-14T12:06:34.677327+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:06:34.677327+0000","last_undegraded":"2024-09-14T12:06:34.677327+0000","last_fullsized":"2024-09-14T12:06:34.677327+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:38.317315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:49.741974+0000","last_change":"2024-09-14T11:28:36.259291+0000","last_active":"2024-09-14T12:09:49.741974+0000","last_peered":"2024-09-14T12:09:49.741974+0000","last_clean":"2024-09-14T12:09:49.741974+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:09:49.741974+0000","last_undegraded":"2024-09-14T12:09:49.741974+0000","last_fullsized":"2024-09-14T12:09:49.741974+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:04.701036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569572+0000","last_change":"2024-09-14T11:28:33.231526+0000","last_active":"2024-09-14T12:07:15.569572+0000","last_peered":"2024-09-14T12:07:15.569572+0000","last_clean":"2024-09-14T12:07:15.569572+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:07:15.569572+0000","last_undegraded":"2024-09-14T12:07:15.569572+0000","last_fullsized":"2024-09-14T12:07:15.569572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:57.361260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:29.669669+0000","last_change":"2024-09-14T11:25:27.952436+0000","last_active":"2024-09-14T12:05:29.669669+0000","last_peered":"2024-09-14T12:05:29.669669+0000","last_clean":"2024-09-14T12:05:29.669669+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:05:29.669669+0000","last_undegraded":"2024-09-14T12:05:29.669669+0000","last_fullsized":"2024-09-14T12:05:29.669669+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:37.926867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671952+0000","last_change":"2024-09-14T11:44:25.349268+0000","last_active":"2024-09-14T12:07:20.671952+0000","last_peered":"2024-09-14T12:07:20.671952+0000","last_clean":"2024-09-14T12:07:20.671952+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:07:20.671952+0000","last_undegraded":"2024-09-14T12:07:20.671952+0000","last_fullsized":"2024-09-14T12:07:20.671952+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:40.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.587416+0000","last_change":"2024-09-14T11:28:36.259293+0000","last_active":"2024-09-14T12:07:15.587416+0000","last_peered":"2024-09-14T12:07:15.587416+0000","last_clean":"2024-09-14T12:07:15.587416+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:07:15.587416+0000","last_undegraded":"2024-09-14T12:07:15.587416+0000","last_fullsized":"2024-09-14T12:07:15.587416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:44.079464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582351+0000","last_change":"2024-09-14T11:28:33.230634+0000","last_active":"2024-09-14T12:07:24.582351+0000","last_peered":"2024-09-14T12:07:24.582351+0000","last_clean":"2024-09-14T12:07:24.582351+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:07:24.582351+0000","last_undegraded":"2024-09-14T12:07:24.582351+0000","last_fullsized":"2024-09-14T12:07:24.582351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.201670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:30.572739+0000","last_change":"2024-09-14T11:25:27.951325+0000","last_active":"2024-09-14T12:05:30.572739+0000","last_peered":"2024-09-14T12:05:30.572739+0000","last_clean":"2024-09-14T12:05:30.572739+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:05:30.572739+0000","last_undegraded":"2024-09-14T12:05:30.572739+0000","last_fullsized":"2024-09-14T12:05:30.572739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:34.624675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578552+0000","last_change":"2024-09-14T11:44:25.353198+0000","last_active":"2024-09-14T12:06:54.578552+0000","last_peered":"2024-09-14T12:06:54.578552+0000","last_clean":"2024-09-14T12:06:54.578552+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:06:54.578552+0000","last_undegraded":"2024-09-14T12:06:54.578552+0000","last_fullsized":"2024-09-14T12:06:54.578552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:09.499820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577573+0000","last_change":"2024-09-14T11:28:36.261093+0000","last_active":"2024-09-14T12:06:05.577573+0000","last_peered":"2024-09-14T12:06:05.577573+0000","last_clean":"2024-09-14T12:06:05.577573+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:06:05.577573+0000","last_undegraded":"2024-09-14T12:06:05.577573+0000","last_fullsized":"2024-09-14T12:06:05.577573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:33.800970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.592790+0000","last_change":"2024-09-14T11:28:33.231811+0000","last_active":"2024-09-14T12:08:34.592790+0000","last_peered":"2024-09-14T12:08:34.592790+0000","last_clean":"2024-09-14T12:08:34.592790+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:08:34.592790+0000","last_undegraded":"2024-09-14T12:08:34.592790+0000","last_fullsized":"2024-09-14T12:08:34.592790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:14.016741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566550+0000","last_change":"2024-09-14T11:25:27.947671+0000","last_active":"2024-09-14T12:06:50.566550+0000","last_peered":"2024-09-14T12:06:50.566550+0000","last_clean":"2024-09-14T12:06:50.566550+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:06:50.566550+0000","last_undegraded":"2024-09-14T12:06:50.566550+0000","last_fullsized":"2024-09-14T12:06:50.566550+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:21.104088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578614+0000","last_change":"2024-09-14T11:44:25.355575+0000","last_active":"2024-09-14T12:06:54.578614+0000","last_peered":"2024-09-14T12:06:54.578614+0000","last_clean":"2024-09-14T12:06:54.578614+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:06:54.578614+0000","last_undegraded":"2024-09-14T12:06:54.578614+0000","last_fullsized":"2024-09-14T12:06:54.578614+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.828628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674310+0000","last_change":"2024-09-14T11:28:36.254791+0000","last_active":"2024-09-14T12:06:09.674310+0000","last_peered":"2024-09-14T12:06:09.674310+0000","last_clean":"2024-09-14T12:06:09.674310+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:06:09.674310+0000","last_undegraded":"2024-09-14T12:06:09.674310+0000","last_fullsized":"2024-09-14T12:06:09.674310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:16.546392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561126+0000","last_change":"2024-09-14T11:28:33.230741+0000","last_active":"2024-09-14T12:06:05.561126+0000","last_peered":"2024-09-14T12:06:05.561126+0000","last_clean":"2024-09-14T12:06:05.561126+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:06:05.561126+0000","last_undegraded":"2024-09-14T12:06:05.561126+0000","last_fullsized":"2024-09-14T12:06:05.561126+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:45.191280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.667058+0000","last_change":"2024-09-14T11:25:27.942564+0000","last_active":"2024-09-14T12:06:35.667058+0000","last_peered":"2024-09-14T12:06:35.667058+0000","last_clean":"2024-09-14T12:06:35.667058+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:06:35.667058+0000","last_undegraded":"2024-09-14T12:06:35.667058+0000","last_fullsized":"2024-09-14T12:06:35.667058+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:16.091896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:45.674483+0000","last_change":"2024-09-14T11:44:25.351716+0000","last_active":"2024-09-14T12:07:45.674483+0000","last_peered":"2024-09-14T12:07:45.674483+0000","last_clean":"2024-09-14T12:07:45.674483+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:07:45.674483+0000","last_undegraded":"2024-09-14T12:07:45.674483+0000","last_fullsized":"2024-09-14T12:07:45.674483+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210853+0000","last_change":"2024-09-14T11:28:36.369321+0000","last_active":"2024-09-14T12:09:54.210853+0000","last_peered":"2024-09-14T12:09:54.210853+0000","last_clean":"2024-09-14T12:09:54.210853+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:09:54.210853+0000","last_undegraded":"2024-09-14T12:09:54.210853+0000","last_fullsized":"2024-09-14T12:09:54.210853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:22.989447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706081+0000","last_change":"2024-09-14T11:28:33.231360+0000","last_active":"2024-09-14T12:05:59.706081+0000","last_peered":"2024-09-14T12:05:59.706081+0000","last_clean":"2024-09-14T12:05:59.706081+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:05:59.706081+0000","last_undegraded":"2024-09-14T12:05:59.706081+0000","last_fullsized":"2024-09-14T12:05:59.706081+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.002852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564851+0000","last_change":"2024-09-14T11:25:27.949982+0000","last_active":"2024-09-14T12:06:35.564851+0000","last_peered":"2024-09-14T12:06:35.564851+0000","last_clean":"2024-09-14T12:06:35.564851+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:06:35.564851+0000","last_undegraded":"2024-09-14T12:06:35.564851+0000","last_fullsized":"2024-09-14T12:06:35.564851+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:12.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.658302+0000","last_change":"2024-09-14T11:44:25.346519+0000","last_active":"2024-09-14T12:07:44.658302+0000","last_peered":"2024-09-14T12:07:44.658302+0000","last_clean":"2024-09-14T12:07:44.658302+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:07:44.658302+0000","last_undegraded":"2024-09-14T12:07:44.658302+0000","last_fullsized":"2024-09-14T12:07:44.658302+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674369+0000","last_change":"2024-09-14T11:28:36.367601+0000","last_active":"2024-09-14T12:06:09.674369+0000","last_peered":"2024-09-14T12:06:09.674369+0000","last_clean":"2024-09-14T12:06:09.674369+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:06:09.674369+0000","last_undegraded":"2024-09-14T12:06:09.674369+0000","last_fullsized":"2024-09-14T12:06:09.674369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:47.572025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581225+0000","last_change":"2024-09-14T11:28:33.228389+0000","last_active":"2024-09-14T12:07:14.581225+0000","last_peered":"2024-09-14T12:07:14.581225+0000","last_clean":"2024-09-14T12:07:14.581225+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:07:14.581225+0000","last_undegraded":"2024-09-14T12:07:14.581225+0000","last_fullsized":"2024-09-14T12:07:14.581225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:11.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677357+0000","last_change":"2024-09-14T11:25:27.953781+0000","last_active":"2024-09-14T12:06:34.677357+0000","last_peered":"2024-09-14T12:06:34.677357+0000","last_clean":"2024-09-14T12:06:34.677357+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:06:34.677357+0000","last_undegraded":"2024-09-14T12:06:34.677357+0000","last_fullsized":"2024-09-14T12:06:34.677357+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.652754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585504+0000","last_change":"2024-09-14T11:44:25.348811+0000","last_active":"2024-09-14T12:07:44.585504+0000","last_peered":"2024-09-14T12:07:44.585504+0000","last_clean":"2024-09-14T12:07:44.585504+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:07:44.585504+0000","last_undegraded":"2024-09-14T12:07:44.585504+0000","last_fullsized":"2024-09-14T12:07:44.585504+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682708+0000","last_change":"2024-09-14T11:28:36.369256+0000","last_active":"2024-09-14T12:07:19.682708+0000","last_peered":"2024-09-14T12:07:19.682708+0000","last_clean":"2024-09-14T12:07:19.682708+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:07:19.682708+0000","last_undegraded":"2024-09-14T12:07:19.682708+0000","last_fullsized":"2024-09-14T12:07:19.682708+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:54.707659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.653192+0000","last_change":"2024-09-14T11:28:33.233405+0000","last_active":"2024-09-14T12:07:14.653192+0000","last_peered":"2024-09-14T12:07:14.653192+0000","last_clean":"2024-09-14T12:07:14.653192+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:07:14.653192+0000","last_undegraded":"2024-09-14T12:07:14.653192+0000","last_fullsized":"2024-09-14T12:07:14.653192+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.734057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.649083+0000","last_change":"2024-09-14T11:25:27.945742+0000","last_active":"2024-09-14T12:06:34.649083+0000","last_peered":"2024-09-14T12:06:34.649083+0000","last_clean":"2024-09-14T12:06:34.649083+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:06:34.649083+0000","last_undegraded":"2024-09-14T12:06:34.649083+0000","last_fullsized":"2024-09-14T12:06:34.649083+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:48.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.721796+0000","last_change":"2024-09-14T11:44:25.352981+0000","last_active":"2024-09-14T12:07:44.721796+0000","last_peered":"2024-09-14T12:07:44.721796+0000","last_clean":"2024-09-14T12:07:44.721796+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:07:44.721796+0000","last_undegraded":"2024-09-14T12:07:44.721796+0000","last_fullsized":"2024-09-14T12:07:44.721796+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581671+0000","last_change":"2024-09-14T11:28:36.261453+0000","last_active":"2024-09-14T12:07:19.581671+0000","last_peered":"2024-09-14T12:07:19.581671+0000","last_clean":"2024-09-14T12:07:19.581671+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:07:19.581671+0000","last_undegraded":"2024-09-14T12:07:19.581671+0000","last_fullsized":"2024-09-14T12:07:19.581671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:40.588548+0000","last_change":"2024-09-14T11:28:33.226734+0000","last_active":"2024-09-14T12:09:40.588548+0000","last_peered":"2024-09-14T12:09:40.588548+0000","last_clean":"2024-09-14T12:09:40.588548+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:09:40.588548+0000","last_undegraded":"2024-09-14T12:09:40.588548+0000","last_fullsized":"2024-09-14T12:09:40.588548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584878+0000","last_change":"2024-09-14T11:25:27.950879+0000","last_active":"2024-09-14T12:07:39.584878+0000","last_peered":"2024-09-14T12:07:39.584878+0000","last_clean":"2024-09-14T12:07:39.584878+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:07:39.584878+0000","last_undegraded":"2024-09-14T12:07:39.584878+0000","last_fullsized":"2024-09-14T12:07:39.584878+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:13.451590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674442+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:06:09.674442+0000","last_peered":"2024-09-14T12:06:09.674442+0000","last_clean":"2024-09-14T12:06:09.674442+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:06:09.674442+0000","last_undegraded":"2024-09-14T12:06:09.674442+0000","last_fullsized":"2024-09-14T12:06:09.674442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.648826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662808+0000","last_change":"2024-09-14T11:28:36.257731+0000","last_active":"2024-09-14T12:05:55.662808+0000","last_peered":"2024-09-14T12:05:55.662808+0000","last_clean":"2024-09-14T12:05:55.662808+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:05:55.662808+0000","last_undegraded":"2024-09-14T12:05:55.662808+0000","last_fullsized":"2024-09-14T12:05:55.662808+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:03.144550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.569273+0000","last_change":"2024-09-14T11:28:33.232810+0000","last_active":"2024-09-14T12:05:54.569273+0000","last_peered":"2024-09-14T12:05:54.569273+0000","last_clean":"2024-09-14T12:05:54.569273+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:05:54.569273+0000","last_undegraded":"2024-09-14T12:05:54.569273+0000","last_fullsized":"2024-09-14T12:05:54.569273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:44.564156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583435+0000","last_change":"2024-09-14T11:25:27.949859+0000","last_active":"2024-09-14T12:07:29.583435+0000","last_peered":"2024-09-14T12:07:29.583435+0000","last_clean":"2024-09-14T12:07:29.583435+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:07:29.583435+0000","last_undegraded":"2024-09-14T12:07:29.583435+0000","last_fullsized":"2024-09-14T12:07:29.583435+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:45.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561924+0000","last_change":"2024-09-14T11:44:25.355586+0000","last_active":"2024-09-14T12:06:10.561924+0000","last_peered":"2024-09-14T12:06:10.561924+0000","last_clean":"2024-09-14T12:06:10.561924+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:06:10.561924+0000","last_undegraded":"2024-09-14T12:06:10.561924+0000","last_fullsized":"2024-09-14T12:06:10.561924+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:15.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.662766+0000","last_change":"2024-09-14T11:28:36.261024+0000","last_active":"2024-09-14T12:05:55.662766+0000","last_peered":"2024-09-14T12:05:55.662766+0000","last_clean":"2024-09-14T12:05:55.662766+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:05:55.662766+0000","last_undegraded":"2024-09-14T12:05:55.662766+0000","last_fullsized":"2024-09-14T12:05:55.662766+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.772500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:54.672323+0000","last_change":"2024-09-14T11:28:33.229372+0000","last_active":"2024-09-14T12:05:54.672323+0000","last_peered":"2024-09-14T12:05:54.672323+0000","last_clean":"2024-09-14T12:05:54.672323+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:05:54.672323+0000","last_undegraded":"2024-09-14T12:05:54.672323+0000","last_fullsized":"2024-09-14T12:05:54.672323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:23.134165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:30.571324+0000","last_change":"2024-09-14T11:25:27.945571+0000","last_active":"2024-09-14T12:07:30.571324+0000","last_peered":"2024-09-14T12:07:30.571324+0000","last_clean":"2024-09-14T12:07:30.571324+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:07:30.571324+0000","last_undegraded":"2024-09-14T12:07:30.571324+0000","last_fullsized":"2024-09-14T12:07:30.571324+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:07.890808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.574038+0000","last_change":"2024-09-14T11:44:25.351774+0000","last_active":"2024-09-14T12:07:55.574038+0000","last_peered":"2024-09-14T12:07:55.574038+0000","last_clean":"2024-09-14T12:07:55.574038+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:07:55.574038+0000","last_undegraded":"2024-09-14T12:07:55.574038+0000","last_fullsized":"2024-09-14T12:07:55.574038+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.406287+0000","last_change":"2024-09-14T11:28:36.257478+0000","last_active":"2024-09-14T12:09:53.406287+0000","last_peered":"2024-09-14T12:09:53.406287+0000","last_clean":"2024-09-14T12:09:53.406287+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:09:53.406287+0000","last_undegraded":"2024-09-14T12:09:53.406287+0000","last_fullsized":"2024-09-14T12:09:53.406287+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:23.930944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:15.596168+0000","last_change":"2024-09-14T11:28:33.226764+0000","last_active":"2024-09-14T12:08:15.596168+0000","last_peered":"2024-09-14T12:08:15.596168+0000","last_clean":"2024-09-14T12:08:15.596168+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:08:15.596168+0000","last_undegraded":"2024-09-14T12:08:15.596168+0000","last_fullsized":"2024-09-14T12:08:15.596168+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:07.256510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583059+0000","last_change":"2024-09-14T11:25:27.946060+0000","last_active":"2024-09-14T12:07:29.583059+0000","last_peered":"2024-09-14T12:07:29.583059+0000","last_clean":"2024-09-14T12:07:29.583059+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:07:29.583059+0000","last_undegraded":"2024-09-14T12:07:29.583059+0000","last_fullsized":"2024-09-14T12:07:29.583059+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:07.686737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674405+0000","last_change":"2024-09-14T11:44:25.350108+0000","last_active":"2024-09-14T12:06:09.674405+0000","last_peered":"2024-09-14T12:06:09.674405+0000","last_clean":"2024-09-14T12:06:09.674405+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:06:09.674405+0000","last_undegraded":"2024-09-14T12:06:09.674405+0000","last_fullsized":"2024-09-14T12:06:09.674405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:05.638059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:55.576237+0000","last_change":"2024-09-14T11:28:36.254787+0000","last_active":"2024-09-14T12:05:55.576237+0000","last_peered":"2024-09-14T12:05:55.576237+0000","last_clean":"2024-09-14T12:05:55.576237+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:05:55.576237+0000","last_undegraded":"2024-09-14T12:05:55.576237+0000","last_fullsized":"2024-09-14T12:05:55.576237+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:50.371867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.726150+0000","last_change":"2024-09-14T11:28:33.230870+0000","last_active":"2024-09-14T12:08:14.726150+0000","last_peered":"2024-09-14T12:08:14.726150+0000","last_clean":"2024-09-14T12:08:14.726150+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:08:14.726150+0000","last_undegraded":"2024-09-14T12:08:14.726150+0000","last_fullsized":"2024-09-14T12:08:14.726150+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.098373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.683991+0000","last_change":"2024-09-14T11:25:27.953081+0000","last_active":"2024-09-14T12:07:29.683991+0000","last_peered":"2024-09-14T12:07:29.683991+0000","last_clean":"2024-09-14T12:07:29.683991+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:07:29.683991+0000","last_undegraded":"2024-09-14T12:07:29.683991+0000","last_fullsized":"2024-09-14T12:07:29.683991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:37.718041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646069+0000","last_change":"2024-09-14T11:44:25.347178+0000","last_active":"2024-09-14T12:06:04.646069+0000","last_peered":"2024-09-14T12:06:04.646069+0000","last_clean":"2024-09-14T12:06:04.646069+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:06:04.646069+0000","last_undegraded":"2024-09-14T12:06:04.646069+0000","last_fullsized":"2024-09-14T12:06:04.646069+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:18.558120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679683+0000","last_change":"2024-09-14T11:28:36.257470+0000","last_active":"2024-09-14T12:06:54.679683+0000","last_peered":"2024-09-14T12:06:54.679683+0000","last_clean":"2024-09-14T12:06:54.679683+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:06:54.679683+0000","last_undegraded":"2024-09-14T12:06:54.679683+0000","last_fullsized":"2024-09-14T12:06:54.679683+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.008987+0000","last_change":"2024-09-14T11:28:33.233762+0000","last_active":"2024-09-14T12:09:54.008987+0000","last_peered":"2024-09-14T12:09:54.008987+0000","last_clean":"2024-09-14T12:09:54.008987+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:09:54.008987+0000","last_undegraded":"2024-09-14T12:09:54.008987+0000","last_fullsized":"2024-09-14T12:09:54.008987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:03.013761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674471+0000","last_change":"2024-09-14T11:25:27.950690+0000","last_active":"2024-09-14T12:06:09.674471+0000","last_peered":"2024-09-14T12:06:09.674471+0000","last_clean":"2024-09-14T12:06:09.674471+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:06:09.674471+0000","last_undegraded":"2024-09-14T12:06:09.674471+0000","last_fullsized":"2024-09-14T12:06:09.674471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:51.496056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578529+0000","last_change":"2024-09-14T11:44:25.354265+0000","last_active":"2024-09-14T12:06:54.578529+0000","last_peered":"2024-09-14T12:06:54.578529+0000","last_clean":"2024-09-14T12:06:54.578529+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:06:54.578529+0000","last_undegraded":"2024-09-14T12:06:54.578529+0000","last_fullsized":"2024-09-14T12:06:54.578529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.737799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679648+0000","last_change":"2024-09-14T11:28:36.254946+0000","last_active":"2024-09-14T12:06:54.679648+0000","last_peered":"2024-09-14T12:06:54.679648+0000","last_clean":"2024-09-14T12:06:54.679648+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:06:54.679648+0000","last_undegraded":"2024-09-14T12:06:54.679648+0000","last_fullsized":"2024-09-14T12:06:54.679648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:55.651650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.876445+0000","last_change":"2024-09-14T11:28:33.228679+0000","last_active":"2024-09-14T12:09:52.876445+0000","last_peered":"2024-09-14T12:09:52.876445+0000","last_clean":"2024-09-14T12:09:52.876445+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:09:52.876445+0000","last_undegraded":"2024-09-14T12:09:52.876445+0000","last_fullsized":"2024-09-14T12:09:52.876445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:50.038738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.706137+0000","last_change":"2024-09-14T11:25:27.949880+0000","last_active":"2024-09-14T12:05:59.706137+0000","last_peered":"2024-09-14T12:05:59.706137+0000","last_clean":"2024-09-14T12:05:59.706137+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:05:59.706137+0000","last_undegraded":"2024-09-14T12:05:59.706137+0000","last_fullsized":"2024-09-14T12:05:59.706137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.896653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.577462+0000","last_change":"2024-09-14T11:44:25.340707+0000","last_active":"2024-09-14T12:06:05.577462+0000","last_peered":"2024-09-14T12:06:05.577462+0000","last_clean":"2024-09-14T12:06:05.577462+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:06:05.577462+0000","last_undegraded":"2024-09-14T12:06:05.577462+0000","last_fullsized":"2024-09-14T12:06:05.577462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:41.520475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:00.669775+0000","last_change":"2024-09-14T11:28:36.367731+0000","last_active":"2024-09-14T12:07:00.669775+0000","last_peered":"2024-09-14T12:07:00.669775+0000","last_clean":"2024-09-14T12:07:00.669775+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:07:00.669775+0000","last_undegraded":"2024-09-14T12:07:00.669775+0000","last_fullsized":"2024-09-14T12:07:00.669775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:55.831862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566673+0000","last_change":"2024-09-14T11:28:33.231847+0000","last_active":"2024-09-14T12:06:50.566673+0000","last_peered":"2024-09-14T12:06:50.566673+0000","last_clean":"2024-09-14T12:06:50.566673+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:06:50.566673+0000","last_undegraded":"2024-09-14T12:06:50.566673+0000","last_fullsized":"2024-09-14T12:06:50.566673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:38.952131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.576926+0000","last_change":"2024-09-14T11:25:27.950496+0000","last_active":"2024-09-14T12:06:00.576926+0000","last_peered":"2024-09-14T12:06:00.576926+0000","last_clean":"2024-09-14T12:06:00.576926+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:06:00.576926+0000","last_undegraded":"2024-09-14T12:06:00.576926+0000","last_fullsized":"2024-09-14T12:06:00.576926+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:38.743937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570818+0000","last_change":"2024-09-14T11:44:25.347374+0000","last_active":"2024-09-14T12:06:04.570818+0000","last_peered":"2024-09-14T12:06:04.570818+0000","last_clean":"2024-09-14T12:06:04.570818+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:06:04.570818+0000","last_undegraded":"2024-09-14T12:06:04.570818+0000","last_fullsized":"2024-09-14T12:06:04.570818+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:02.575878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679699+0000","last_change":"2024-09-14T11:28:36.256404+0000","last_active":"2024-09-14T12:06:54.679699+0000","last_peered":"2024-09-14T12:06:54.679699+0000","last_clean":"2024-09-14T12:06:54.679699+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:06:54.679699+0000","last_undegraded":"2024-09-14T12:06:54.679699+0000","last_fullsized":"2024-09-14T12:06:54.679699+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:18.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.335330+0000","last_change":"2024-09-14T11:28:33.227452+0000","last_active":"2024-09-14T12:09:53.335330+0000","last_peered":"2024-09-14T12:09:53.335330+0000","last_clean":"2024-09-14T12:09:53.335330+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:09:53.335330+0000","last_undegraded":"2024-09-14T12:09:53.335330+0000","last_fullsized":"2024-09-14T12:09:53.335330+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.149389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:05:59.645601+0000","last_change":"2024-09-14T11:25:27.954496+0000","last_active":"2024-09-14T12:05:59.645601+0000","last_peered":"2024-09-14T12:05:59.645601+0000","last_clean":"2024-09-14T12:05:59.645601+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:05:59.645601+0000","last_undegraded":"2024-09-14T12:05:59.645601+0000","last_fullsized":"2024-09-14T12:05:59.645601+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:03.897519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679716+0000","last_change":"2024-09-14T11:44:25.355046+0000","last_active":"2024-09-14T12:06:54.679716+0000","last_peered":"2024-09-14T12:06:54.679716+0000","last_clean":"2024-09-14T12:06:54.679716+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:06:54.679716+0000","last_undegraded":"2024-09-14T12:06:54.679716+0000","last_fullsized":"2024-09-14T12:06:54.679716+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.119733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.955962+0000","last_change":"2024-09-14T11:28:36.260180+0000","last_active":"2024-09-14T12:09:52.955962+0000","last_peered":"2024-09-14T12:09:52.955962+0000","last_clean":"2024-09-14T12:09:52.955962+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:09:52.955962+0000","last_undegraded":"2024-09-14T12:09:52.955962+0000","last_fullsized":"2024-09-14T12:09:52.955962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:35.619938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571885+0000","last_change":"2024-09-14T11:28:33.230223+0000","last_active":"2024-09-14T12:07:35.571885+0000","last_peered":"2024-09-14T12:07:35.571885+0000","last_clean":"2024-09-14T12:07:35.571885+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:07:35.571885+0000","last_undegraded":"2024-09-14T12:07:35.571885+0000","last_fullsized":"2024-09-14T12:07:35.571885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:17.221998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:00.560556+0000","last_change":"2024-09-14T11:25:27.953095+0000","last_active":"2024-09-14T12:06:00.560556+0000","last_peered":"2024-09-14T12:06:00.560556+0000","last_clean":"2024-09-14T12:06:00.560556+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:06:00.560556+0000","last_undegraded":"2024-09-14T12:06:00.560556+0000","last_fullsized":"2024-09-14T12:06:00.560556+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:58.766336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579278+0000","last_change":"2024-09-14T11:44:25.354056+0000","last_active":"2024-09-14T12:06:59.579278+0000","last_peered":"2024-09-14T12:06:59.579278+0000","last_clean":"2024-09-14T12:06:59.579278+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:06:59.579278+0000","last_undegraded":"2024-09-14T12:06:59.579278+0000","last_fullsized":"2024-09-14T12:06:59.579278+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.958850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.131052+0000","last_change":"2024-09-14T11:28:36.365890+0000","last_active":"2024-09-14T12:09:53.131052+0000","last_peered":"2024-09-14T12:09:53.131052+0000","last_clean":"2024-09-14T12:09:53.131052+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:09:53.131052+0000","last_undegraded":"2024-09-14T12:09:53.131052+0000","last_fullsized":"2024-09-14T12:09:53.131052+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.017356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.673401+0000","last_change":"2024-09-14T11:28:33.228030+0000","last_active":"2024-09-14T12:07:35.673401+0000","last_peered":"2024-09-14T12:07:35.673401+0000","last_clean":"2024-09-14T12:07:35.673401+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:07:35.673401+0000","last_undegraded":"2024-09-14T12:07:35.673401+0000","last_fullsized":"2024-09-14T12:07:35.673401+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:06.971364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":88,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577681+0000","last_change":"2024-09-14T11:25:27.950183+0000","last_active":"2024-09-14T12:06:49.577681+0000","last_peered":"2024-09-14T12:06:49.577681+0000","last_clean":"2024-09-14T12:06:49.577681+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:06:49.577681+0000","last_undegraded":"2024-09-14T12:06:49.577681+0000","last_fullsized":"2024-09-14T12:06:49.577681+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:47.768324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578564+0000","last_change":"2024-09-14T11:44:25.351682+0000","last_active":"2024-09-14T12:06:54.578564+0000","last_peered":"2024-09-14T12:06:54.578564+0000","last_clean":"2024-09-14T12:06:54.578564+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:06:54.578564+0000","last_undegraded":"2024-09-14T12:06:54.578564+0000","last_fullsized":"2024-09-14T12:06:54.578564+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:33.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'8","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:05.684181+0000","last_change":"2024-09-14T11:28:36.252721+0000","last_active":"2024-09-14T12:09:05.684181+0000","last_peered":"2024-09-14T12:09:05.684181+0000","last_clean":"2024-09-14T12:09:05.684181+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:09:05.684181+0000","last_undegraded":"2024-09-14T12:09:05.684181+0000","last_fullsized":"2024-09-14T12:09:05.684181+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:40.814206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17937,"num_write":8,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.082484+0000","last_change":"2024-09-14T11:28:33.228385+0000","last_active":"2024-09-14T12:09:54.082484+0000","last_peered":"2024-09-14T12:09:54.082484+0000","last_clean":"2024-09-14T12:09:54.082484+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:09:54.082484+0000","last_undegraded":"2024-09-14T12:09:54.082484+0000","last_fullsized":"2024-09-14T12:09:54.082484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:36.884948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.677912+0000","last_change":"2024-09-14T11:25:27.951396+0000","last_active":"2024-09-14T12:06:39.677912+0000","last_peered":"2024-09-14T12:06:39.677912+0000","last_clean":"2024-09-14T12:06:39.677912+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:06:39.677912+0000","last_undegraded":"2024-09-14T12:06:39.677912+0000","last_fullsized":"2024-09-14T12:06:39.677912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.372583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:55.567242+0000","last_change":"2024-09-14T11:44:25.356594+0000","last_active":"2024-09-14T12:06:55.567242+0000","last_peered":"2024-09-14T12:06:55.567242+0000","last_clean":"2024-09-14T12:06:55.567242+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:06:55.567242+0000","last_undegraded":"2024-09-14T12:06:55.567242+0000","last_fullsized":"2024-09-14T12:06:55.567242+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.437539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585586+0000","last_change":"2024-09-14T11:29:33.340403+0000","last_active":"2024-09-14T12:07:44.585586+0000","last_peered":"2024-09-14T12:07:44.585586+0000","last_clean":"2024-09-14T12:07:44.585586+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:07:44.585586+0000","last_undegraded":"2024-09-14T12:07:44.585586+0000","last_fullsized":"2024-09-14T12:07:44.585586+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:46.256090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:49.577175+0000","last_change":"2024-09-14T11:28:33.230335+0000","last_active":"2024-09-14T12:06:49.577175+0000","last_peered":"2024-09-14T12:06:49.577175+0000","last_clean":"2024-09-14T12:06:49.577175+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:06:49.577175+0000","last_undegraded":"2024-09-14T12:06:49.577175+0000","last_fullsized":"2024-09-14T12:06:49.577175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:57.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582421+0000","last_change":"2024-09-14T11:25:27.949670+0000","last_active":"2024-09-14T12:06:40.582421+0000","last_peered":"2024-09-14T12:06:40.582421+0000","last_clean":"2024-09-14T12:06:40.582421+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:06:40.582421+0000","last_undegraded":"2024-09-14T12:06:40.582421+0000","last_fullsized":"2024-09-14T12:06:40.582421+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:26.893035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581926+0000","last_change":"2024-09-14T11:44:25.351860+0000","last_active":"2024-09-14T12:07:19.581926+0000","last_peered":"2024-09-14T12:07:19.581926+0000","last_clean":"2024-09-14T12:07:19.581926+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:07:19.581926+0000","last_undegraded":"2024-09-14T12:07:19.581926+0000","last_fullsized":"2024-09-14T12:07:19.581926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:01.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:15.562475+0000","last_change":"2024-09-14T11:28:36.252024+0000","last_active":"2024-09-14T12:06:15.562475+0000","last_peered":"2024-09-14T12:06:15.562475+0000","last_clean":"2024-09-14T12:06:15.562475+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:06:15.562475+0000","last_undegraded":"2024-09-14T12:06:15.562475+0000","last_fullsized":"2024-09-14T12:06:15.562475+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:46.918571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.379658+0000","last_change":"2024-09-14T11:28:33.229236+0000","last_active":"2024-09-14T12:09:54.379658+0000","last_peered":"2024-09-14T12:09:54.379658+0000","last_clean":"2024-09-14T12:09:54.379658+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:09:54.379658+0000","last_undegraded":"2024-09-14T12:09:54.379658+0000","last_fullsized":"2024-09-14T12:09:54.379658+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565430+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:06:40.565430+0000","last_peered":"2024-09-14T12:06:40.565430+0000","last_clean":"2024-09-14T12:06:40.565430+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:06:40.565430+0000","last_undegraded":"2024-09-14T12:06:40.565430+0000","last_fullsized":"2024-09-14T12:06:40.565430+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:53.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717994+0000","last_change":"2024-09-14T11:44:25.350439+0000","last_active":"2024-09-14T12:07:19.717994+0000","last_peered":"2024-09-14T12:07:19.717994+0000","last_clean":"2024-09-14T12:07:19.717994+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:07:19.717994+0000","last_undegraded":"2024-09-14T12:07:19.717994+0000","last_fullsized":"2024-09-14T12:07:19.717994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:24.626683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210104+0000","last_change":"2024-09-14T11:28:36.365847+0000","last_active":"2024-09-14T12:09:54.210104+0000","last_peered":"2024-09-14T12:09:54.210104+0000","last_clean":"2024-09-14T12:09:54.210104+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:09:54.210104+0000","last_undegraded":"2024-09-14T12:09:54.210104+0000","last_fullsized":"2024-09-14T12:09:54.210104+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.404691+0000","last_change":"2024-09-14T11:28:33.228362+0000","last_active":"2024-09-14T12:09:53.404691+0000","last_peered":"2024-09-14T12:09:53.404691+0000","last_clean":"2024-09-14T12:09:53.404691+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:09:53.404691+0000","last_undegraded":"2024-09-14T12:09:53.404691+0000","last_fullsized":"2024-09-14T12:09:53.404691+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.582495+0000","last_change":"2024-09-14T11:25:27.948331+0000","last_active":"2024-09-14T12:06:40.582495+0000","last_peered":"2024-09-14T12:06:40.582495+0000","last_clean":"2024-09-14T12:06:40.582495+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:06:40.582495+0000","last_undegraded":"2024-09-14T12:06:40.582495+0000","last_fullsized":"2024-09-14T12:06:40.582495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:11.277301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:30.666552+0000","last_change":"2024-09-14T11:44:25.351133+0000","last_active":"2024-09-14T12:06:30.666552+0000","last_peered":"2024-09-14T12:06:30.666552+0000","last_clean":"2024-09-14T12:06:30.666552+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:06:30.666552+0000","last_undegraded":"2024-09-14T12:06:30.666552+0000","last_fullsized":"2024-09-14T12:06:30.666552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:44.289131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584940+0000","last_change":"2024-09-14T11:28:36.367086+0000","last_active":"2024-09-14T12:07:39.584940+0000","last_peered":"2024-09-14T12:07:39.584940+0000","last_clean":"2024-09-14T12:07:39.584940+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:07:39.584940+0000","last_undegraded":"2024-09-14T12:07:39.584940+0000","last_fullsized":"2024-09-14T12:07:39.584940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.893706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.720510+0000","last_change":"2024-09-14T11:28:33.231027+0000","last_active":"2024-09-14T12:07:34.720510+0000","last_peered":"2024-09-14T12:07:34.720510+0000","last_clean":"2024-09-14T12:07:34.720510+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:07:34.720510+0000","last_undegraded":"2024-09-14T12:07:34.720510+0000","last_fullsized":"2024-09-14T12:07:34.720510+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:08.425071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582020+0000","last_change":"2024-09-14T11:25:27.948199+0000","last_active":"2024-09-14T12:07:19.582020+0000","last_peered":"2024-09-14T12:07:19.582020+0000","last_clean":"2024-09-14T12:07:19.582020+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:07:19.582020+0000","last_undegraded":"2024-09-14T12:07:19.582020+0000","last_fullsized":"2024-09-14T12:07:19.582020+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:39.351483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581534+0000","last_change":"2024-09-14T11:44:25.354049+0000","last_active":"2024-09-14T12:07:19.581534+0000","last_peered":"2024-09-14T12:07:19.581534+0000","last_clean":"2024-09-14T12:07:19.581534+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:07:19.581534+0000","last_undegraded":"2024-09-14T12:07:19.581534+0000","last_fullsized":"2024-09-14T12:07:19.581534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:06.436515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584665+0000","last_change":"2024-09-14T11:28:36.260053+0000","last_active":"2024-09-14T12:07:39.584665+0000","last_peered":"2024-09-14T12:07:39.584665+0000","last_clean":"2024-09-14T12:07:39.584665+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:07:39.584665+0000","last_undegraded":"2024-09-14T12:07:39.584665+0000","last_fullsized":"2024-09-14T12:07:39.584665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.584214+0000","last_change":"2024-09-14T11:28:33.233002+0000","last_active":"2024-09-14T12:07:34.584214+0000","last_peered":"2024-09-14T12:07:34.584214+0000","last_clean":"2024-09-14T12:07:34.584214+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:07:34.584214+0000","last_undegraded":"2024-09-14T12:07:34.584214+0000","last_fullsized":"2024-09-14T12:07:34.584214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:57.509567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.670809+0000","last_change":"2024-09-14T11:25:27.948445+0000","last_active":"2024-09-14T12:07:10.670809+0000","last_peered":"2024-09-14T12:07:10.670809+0000","last_clean":"2024-09-14T12:07:10.670809+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:07:10.670809+0000","last_undegraded":"2024-09-14T12:07:10.670809+0000","last_fullsized":"2024-09-14T12:07:10.670809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.849100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.646115+0000","last_change":"2024-09-14T11:44:25.348388+0000","last_active":"2024-09-14T12:06:04.646115+0000","last_peered":"2024-09-14T12:06:04.646115+0000","last_clean":"2024-09-14T12:06:04.646115+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:06:04.646115+0000","last_undegraded":"2024-09-14T12:06:04.646115+0000","last_fullsized":"2024-09-14T12:06:04.646115+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:30.181019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.797477+0000","last_change":"2024-09-14T11:28:36.257342+0000","last_active":"2024-09-14T12:09:53.797477+0000","last_peered":"2024-09-14T12:09:53.797477+0000","last_clean":"2024-09-14T12:09:53.797477+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:09:53.797477+0000","last_undegraded":"2024-09-14T12:09:53.797477+0000","last_fullsized":"2024-09-14T12:09:53.797477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576072+0000","last_change":"2024-09-14T11:28:33.228459+0000","last_active":"2024-09-14T12:06:39.576072+0000","last_peered":"2024-09-14T12:06:39.576072+0000","last_clean":"2024-09-14T12:06:39.576072+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:06:39.576072+0000","last_undegraded":"2024-09-14T12:06:39.576072+0000","last_fullsized":"2024-09-14T12:06:39.576072+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:32.489364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.716392+0000","last_change":"2024-09-14T11:25:27.948557+0000","last_active":"2024-09-14T12:07:09.716392+0000","last_peered":"2024-09-14T12:07:09.716392+0000","last_clean":"2024-09-14T12:07:09.716392+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:07:09.716392+0000","last_undegraded":"2024-09-14T12:07:09.716392+0000","last_fullsized":"2024-09-14T12:07:09.716392+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:20.912923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561205+0000","last_change":"2024-09-14T11:44:25.353177+0000","last_active":"2024-09-14T12:06:05.561205+0000","last_peered":"2024-09-14T12:06:05.561205+0000","last_clean":"2024-09-14T12:06:05.561205+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:06:05.561205+0000","last_undegraded":"2024-09-14T12:06:05.561205+0000","last_fullsized":"2024-09-14T12:06:05.561205+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:05.032981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:44.730416+0000","last_change":"2024-09-14T11:28:36.256678+0000","last_active":"2024-09-14T12:08:44.730416+0000","last_peered":"2024-09-14T12:08:44.730416+0000","last_clean":"2024-09-14T12:08:44.730416+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:08:44.730416+0000","last_undegraded":"2024-09-14T12:08:44.730416+0000","last_fullsized":"2024-09-14T12:08:44.730416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:25.852294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.543343+0000","last_change":"2024-09-14T11:28:33.232601+0000","last_active":"2024-09-14T12:09:53.543343+0000","last_peered":"2024-09-14T12:09:53.543343+0000","last_clean":"2024-09-14T12:09:53.543343+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:09:53.543343+0000","last_undegraded":"2024-09-14T12:09:53.543343+0000","last_fullsized":"2024-09-14T12:09:53.543343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.579944+0000","last_change":"2024-09-14T11:25:27.949489+0000","last_active":"2024-09-14T12:07:09.579944+0000","last_peered":"2024-09-14T12:07:09.579944+0000","last_clean":"2024-09-14T12:07:09.579944+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:07:09.579944+0000","last_undegraded":"2024-09-14T12:07:09.579944+0000","last_fullsized":"2024-09-14T12:07:09.579944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:23.544881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570267+0000","last_change":"2024-09-14T11:44:25.353056+0000","last_active":"2024-09-14T12:07:20.570267+0000","last_peered":"2024-09-14T12:07:20.570267+0000","last_clean":"2024-09-14T12:07:20.570267+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:07:20.570267+0000","last_undegraded":"2024-09-14T12:07:20.570267+0000","last_fullsized":"2024-09-14T12:07:20.570267+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:07.137155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'8","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.673045+0000","last_change":"2024-09-14T11:28:36.259431+0000","last_active":"2024-09-14T12:09:54.673045+0000","last_peered":"2024-09-14T12:09:54.673045+0000","last_clean":"2024-09-14T12:09:54.673045+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:09:54.673045+0000","last_undegraded":"2024-09-14T12:09:54.673045+0000","last_fullsized":"2024-09-14T12:09:54.673045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'9","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.545523+0000","last_change":"2024-09-14T11:28:33.227906+0000","last_active":"2024-09-14T12:09:53.545523+0000","last_peered":"2024-09-14T12:09:53.545523+0000","last_clean":"2024-09-14T12:09:53.545523+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:09:53.545523+0000","last_undegraded":"2024-09-14T12:09:53.545523+0000","last_fullsized":"2024-09-14T12:09:53.545523+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":172,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586665+0000","last_change":"2024-09-14T11:25:27.946605+0000","last_active":"2024-09-14T12:07:10.586665+0000","last_peered":"2024-09-14T12:07:10.586665+0000","last_clean":"2024-09-14T12:07:10.586665+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:07:10.586665+0000","last_undegraded":"2024-09-14T12:07:10.586665+0000","last_fullsized":"2024-09-14T12:07:10.586665+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.771354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582789+0000","last_change":"2024-09-14T11:44:25.355567+0000","last_active":"2024-09-14T12:07:24.582789+0000","last_peered":"2024-09-14T12:07:24.582789+0000","last_clean":"2024-09-14T12:07:24.582789+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:07:24.582789+0000","last_undegraded":"2024-09-14T12:07:24.582789+0000","last_fullsized":"2024-09-14T12:07:24.582789+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:15.391313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.957193+0000","last_change":"2024-09-14T11:28:36.260711+0000","last_active":"2024-09-14T12:09:52.957193+0000","last_peered":"2024-09-14T12:09:52.957193+0000","last_clean":"2024-09-14T12:09:52.957193+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:09:52.957193+0000","last_undegraded":"2024-09-14T12:09:52.957193+0000","last_fullsized":"2024-09-14T12:09:52.957193+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:10.595361+0000","last_change":"2024-09-14T11:28:33.228247+0000","last_active":"2024-09-14T12:08:10.595361+0000","last_peered":"2024-09-14T12:08:10.595361+0000","last_clean":"2024-09-14T12:08:10.595361+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:08:10.595361+0000","last_undegraded":"2024-09-14T12:08:10.595361+0000","last_fullsized":"2024-09-14T12:08:10.595361+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584808+0000","last_change":"2024-09-14T11:25:27.949061+0000","last_active":"2024-09-14T12:07:39.584808+0000","last_peered":"2024-09-14T12:07:39.584808+0000","last_clean":"2024-09-14T12:07:39.584808+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:07:39.584808+0000","last_undegraded":"2024-09-14T12:07:39.584808+0000","last_fullsized":"2024-09-14T12:07:39.584808+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.419328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'367","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.459244+0000","last_change":"2024-09-14T12:10:14.459244+0000","last_active":"2024-09-14T12:10:14.459244+0000","last_peered":"2024-09-14T12:10:14.459244+0000","last_clean":"2024-09-14T12:10:14.459244+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:10:14.459244+0000","last_undegraded":"2024-09-14T12:10:14.459244+0000","last_fullsized":"2024-09-14T12:10:14.459244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.459145+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.624776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":757,"num_read_kb":12872,"num_write":1136,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.668440+0000","last_change":"2024-09-14T12:10:19.668440+0000","last_active":"2024-09-14T12:10:19.668440+0000","last_peered":"2024-09-14T12:10:19.668440+0000","last_clean":"2024-09-14T12:10:19.668440+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:10:19.668440+0000","last_undegraded":"2024-09-14T12:10:19.668440+0000","last_fullsized":"2024-09-14T12:10:19.668440+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.668328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.312199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'341","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.826945+0000","last_change":"2024-09-14T12:10:05.826945+0000","last_active":"2024-09-14T12:10:05.826945+0000","last_peered":"2024-09-14T12:10:05.826945+0000","last_clean":"2024-09-14T12:10:05.826945+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:10:05.826945+0000","last_undegraded":"2024-09-14T12:10:05.826945+0000","last_fullsized":"2024-09-14T12:10:05.826945+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.826834+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:29.237796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":30246,"num_write":1175,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.530643+0000","last_change":"2024-09-14T12:10:18.530643+0000","last_active":"2024-09-14T12:10:18.530643+0000","last_peered":"2024-09-14T12:10:18.530643+0000","last_clean":"2024-09-14T12:10:18.530643+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:10:18.530643+0000","last_undegraded":"2024-09-14T12:10:18.530643+0000","last_fullsized":"2024-09-14T12:10:18.530643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.530556+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:40.837032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'341","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.095197+0000","last_change":"2024-09-14T12:10:05.095197+0000","last_active":"2024-09-14T12:10:05.095197+0000","last_peered":"2024-09-14T12:10:05.095197+0000","last_clean":"2024-09-14T12:10:05.095197+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:10:05.095197+0000","last_undegraded":"2024-09-14T12:10:05.095197+0000","last_fullsized":"2024-09-14T12:10:05.095197+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.095059+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.483265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":3312,"num_write":1178,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.971020+0000","last_change":"2024-09-14T12:10:16.971020+0000","last_active":"2024-09-14T12:10:16.971020+0000","last_peered":"2024-09-14T12:10:16.971020+0000","last_clean":"2024-09-14T12:10:16.971020+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:10:16.971020+0000","last_undegraded":"2024-09-14T12:10:16.971020+0000","last_fullsized":"2024-09-14T12:10:16.971020+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.970940+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.622124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'370","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.705623+0000","last_change":"2024-09-14T12:10:13.705623+0000","last_active":"2024-09-14T12:10:13.705623+0000","last_peered":"2024-09-14T12:10:13.705623+0000","last_clean":"2024-09-14T12:10:13.705623+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:10:13.705623+0000","last_undegraded":"2024-09-14T12:10:13.705623+0000","last_fullsized":"2024-09-14T12:10:13.705623+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.705505+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:38.303648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5058,"num_write":1126,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.214780+0000","last_change":"2024-09-14T12:10:14.214780+0000","last_active":"2024-09-14T12:10:14.214780+0000","last_peered":"2024-09-14T12:10:14.214780+0000","last_clean":"2024-09-14T12:10:14.214780+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:10:14.214780+0000","last_undegraded":"2024-09-14T12:10:14.214780+0000","last_fullsized":"2024-09-14T12:10:14.214780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.214689+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:13.644836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'332","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.452437+0000","last_change":"2024-09-14T12:10:13.452437+0000","last_active":"2024-09-14T12:10:13.452437+0000","last_peered":"2024-09-14T12:10:13.452437+0000","last_clean":"2024-09-14T12:10:13.452437+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:10:13.452437+0000","last_undegraded":"2024-09-14T12:10:13.452437+0000","last_fullsized":"2024-09-14T12:10:13.452437+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.452316+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:51.046156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":17822,"num_write":1000,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'253","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.296368+0000","last_change":"2024-09-14T12:10:12.296368+0000","last_active":"2024-09-14T12:10:12.296368+0000","last_peered":"2024-09-14T12:10:12.296368+0000","last_clean":"2024-09-14T12:10:12.296368+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:10:12.296368+0000","last_undegraded":"2024-09-14T12:10:12.296368+0000","last_fullsized":"2024-09-14T12:10:12.296368+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.296241+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:52.581921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.675366+0000","last_change":"2024-09-14T12:10:12.675366+0000","last_active":"2024-09-14T12:10:12.675366+0000","last_peered":"2024-09-14T12:10:12.675366+0000","last_clean":"2024-09-14T12:10:12.675366+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:10:12.675366+0000","last_undegraded":"2024-09-14T12:10:12.675366+0000","last_fullsized":"2024-09-14T12:10:12.675366+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.675269+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:51.405065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.981965+0000","last_change":"2024-09-14T12:10:18.981965+0000","last_active":"2024-09-14T12:10:18.981965+0000","last_peered":"2024-09-14T12:10:18.981965+0000","last_clean":"2024-09-14T12:10:18.981965+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:10:18.981965+0000","last_undegraded":"2024-09-14T12:10:18.981965+0000","last_fullsized":"2024-09-14T12:10:18.981965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.981860+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:07.103412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'350","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.486823+0000","last_change":"2024-09-14T12:10:12.486823+0000","last_active":"2024-09-14T12:10:12.486823+0000","last_peered":"2024-09-14T12:10:12.486823+0000","last_clean":"2024-09-14T12:10:12.486823+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:10:12.486823+0000","last_undegraded":"2024-09-14T12:10:12.486823+0000","last_fullsized":"2024-09-14T12:10:12.486823+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.486683+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:55.966016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":627,"num_read_kb":84521,"num_write":1155,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.717225+0000","last_change":"2024-09-14T11:10:58.601531+0000","last_active":"2024-09-14T12:07:14.717225+0000","last_peered":"2024-09-14T12:07:14.717225+0000","last_clean":"2024-09-14T12:07:14.717225+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:07:14.717225+0000","last_undegraded":"2024-09-14T12:07:14.717225+0000","last_fullsized":"2024-09-14T12:07:14.717225+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:57.585086+0000","last_clean_scrub_stamp":"2024-09-14T11:10:57.585086+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.466412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.085587+0000","last_change":"2024-09-14T12:10:07.085587+0000","last_active":"2024-09-14T12:10:07.085587+0000","last_peered":"2024-09-14T12:10:07.085587+0000","last_clean":"2024-09-14T12:10:07.085587+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:10:07.085587+0000","last_undegraded":"2024-09-14T12:10:07.085587+0000","last_fullsized":"2024-09-14T12:10:07.085587+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.085466+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.348034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.664539+0000","last_change":"2024-09-14T12:10:12.664539+0000","last_active":"2024-09-14T12:10:12.664539+0000","last_peered":"2024-09-14T12:10:12.664539+0000","last_clean":"2024-09-14T12:10:12.664539+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:10:12.664539+0000","last_undegraded":"2024-09-14T12:10:12.664539+0000","last_fullsized":"2024-09-14T12:10:12.664539+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'180","last_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_deep_scrub":"265'180","last_deep_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.664453+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:36.687451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.967028+0000","last_change":"2024-09-14T12:10:15.967028+0000","last_active":"2024-09-14T12:10:15.967028+0000","last_peered":"2024-09-14T12:10:15.967028+0000","last_clean":"2024-09-14T12:10:15.967028+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:10:15.967028+0000","last_undegraded":"2024-09-14T12:10:15.967028+0000","last_fullsized":"2024-09-14T12:10:15.967028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.966942+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:08.208593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.306614+0000","last_change":"2024-09-14T12:10:07.306614+0000","last_active":"2024-09-14T12:10:07.306614+0000","last_peered":"2024-09-14T12:10:07.306614+0000","last_clean":"2024-09-14T12:10:07.306614+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:10:07.306614+0000","last_undegraded":"2024-09-14T12:10:07.306614+0000","last_fullsized":"2024-09-14T12:10:07.306614+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.306483+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:41.620701+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159838,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":4801,"num_write":1283,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1378,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.461288+0000","last_change":"2024-09-14T12:10:16.461288+0000","last_active":"2024-09-14T12:10:16.461288+0000","last_peered":"2024-09-14T12:10:16.461288+0000","last_clean":"2024-09-14T12:10:16.461288+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:10:16.461288+0000","last_undegraded":"2024-09-14T12:10:16.461288+0000","last_fullsized":"2024-09-14T12:10:16.461288+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'788","last_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_deep_scrub":"265'788","last_deep_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.461206+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.733748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'314","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.261791+0000","last_change":"2024-09-14T12:10:09.261791+0000","last_active":"2024-09-14T12:10:09.261791+0000","last_peered":"2024-09-14T12:10:09.261791+0000","last_clean":"2024-09-14T12:10:09.261791+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:10:09.261791+0000","last_undegraded":"2024-09-14T12:10:09.261791+0000","last_fullsized":"2024-09-14T12:10:09.261791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.261563+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:34.016334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":568,"num_read_kb":2774,"num_write":998,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.641090+0000","last_change":"2024-09-14T12:10:17.641090+0000","last_active":"2024-09-14T12:10:17.641090+0000","last_peered":"2024-09-14T12:10:17.641090+0000","last_clean":"2024-09-14T12:10:17.641090+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:10:17.641090+0000","last_undegraded":"2024-09-14T12:10:17.641090+0000","last_fullsized":"2024-09-14T12:10:17.641090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.640942+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.697431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'334","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.289358+0000","last_change":"2024-09-14T12:10:05.289358+0000","last_active":"2024-09-14T12:10:05.289358+0000","last_peered":"2024-09-14T12:10:05.289358+0000","last_clean":"2024-09-14T12:10:05.289358+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:10:05.289358+0000","last_undegraded":"2024-09-14T12:10:05.289358+0000","last_fullsized":"2024-09-14T12:10:05.289358+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.289211+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.228353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":52006,"num_write":1108,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.639093+0000","last_change":"2024-09-14T12:10:09.639093+0000","last_active":"2024-09-14T12:10:09.639093+0000","last_peered":"2024-09-14T12:10:09.639093+0000","last_clean":"2024-09-14T12:10:09.639093+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:10:09.639093+0000","last_undegraded":"2024-09-14T12:10:09.639093+0000","last_fullsized":"2024-09-14T12:10:09.639093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.638966+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:04.748932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'371","reported_seq":1127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.865158+0000","last_change":"2024-09-14T12:10:03.865158+0000","last_active":"2024-09-14T12:10:03.865158+0000","last_peered":"2024-09-14T12:10:03.865158+0000","last_clean":"2024-09-14T12:10:03.865158+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:10:03.865158+0000","last_undegraded":"2024-09-14T12:10:03.865158+0000","last_fullsized":"2024-09-14T12:10:03.865158+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.865003+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:04.754565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1062,"num_read_kb":40711,"num_write":1149,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.649985+0000","last_change":"2024-09-14T12:10:14.649985+0000","last_active":"2024-09-14T12:10:14.649985+0000","last_peered":"2024-09-14T12:10:14.649985+0000","last_clean":"2024-09-14T12:10:14.649985+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:10:14.649985+0000","last_undegraded":"2024-09-14T12:10:14.649985+0000","last_fullsized":"2024-09-14T12:10:14.649985+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.649893+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:52.251100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'337","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.094911+0000","last_change":"2024-09-14T12:10:12.094911+0000","last_active":"2024-09-14T12:10:12.094911+0000","last_peered":"2024-09-14T12:10:12.094911+0000","last_clean":"2024-09-14T12:10:12.094911+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:10:12.094911+0000","last_undegraded":"2024-09-14T12:10:12.094911+0000","last_fullsized":"2024-09-14T12:10:12.094911+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.094760+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.754532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254516,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":58308,"num_write":1138,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.953578+0000","last_change":"2024-09-14T12:10:17.953578+0000","last_active":"2024-09-14T12:10:17.953578+0000","last_peered":"2024-09-14T12:10:17.953578+0000","last_clean":"2024-09-14T12:10:17.953578+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:10:17.953578+0000","last_undegraded":"2024-09-14T12:10:17.953578+0000","last_fullsized":"2024-09-14T12:10:17.953578+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.953497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:54.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'412","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.030763+0000","last_change":"2024-09-14T12:10:02.030763+0000","last_active":"2024-09-14T12:10:02.030763+0000","last_peered":"2024-09-14T12:10:02.030763+0000","last_clean":"2024-09-14T12:10:02.030763+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:10:02.030763+0000","last_undegraded":"2024-09-14T12:10:02.030763+0000","last_fullsized":"2024-09-14T12:10:02.030763+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'412","last_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_deep_scrub":"265'412","last_deep_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.030666+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:19.284654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":94295,"num_write":1155,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'189","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.512796+0000","last_change":"2024-09-14T11:11:06.654536+0000","last_active":"2024-09-14T12:07:57.512796+0000","last_peered":"2024-09-14T12:07:57.512796+0000","last_clean":"2024-09-14T12:07:57.512796+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:07:57.512796+0000","last_undegraded":"2024-09-14T12:07:57.512796+0000","last_fullsized":"2024-09-14T12:07:57.512796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:45.779160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'123","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.666541+0000","last_change":"2024-09-14T12:10:10.666541+0000","last_active":"2024-09-14T12:10:10.666541+0000","last_peered":"2024-09-14T12:10:10.666541+0000","last_clean":"2024-09-14T12:10:10.666541+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:10:10.666541+0000","last_undegraded":"2024-09-14T12:10:10.666541+0000","last_fullsized":"2024-09-14T12:10:10.666541+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.666460+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:53.474495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'488","reported_seq":1230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.285231+0000","last_change":"2024-09-14T12:10:06.285231+0000","last_active":"2024-09-14T12:10:06.285231+0000","last_peered":"2024-09-14T12:10:06.285231+0000","last_clean":"2024-09-14T12:10:06.285231+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:10:06.285231+0000","last_undegraded":"2024-09-14T12:10:06.285231+0000","last_fullsized":"2024-09-14T12:10:06.285231+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.285136+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:30.855826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":951,"num_read_kb":68364,"num_write":1403,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711914+0000","last_change":"2024-09-14T11:11:00.612390+0000","last_active":"2024-09-14T12:06:39.711914+0000","last_peered":"2024-09-14T12:06:39.711914+0000","last_clean":"2024-09-14T12:06:39.711914+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:06:39.711914+0000","last_undegraded":"2024-09-14T12:06:39.711914+0000","last_fullsized":"2024-09-14T12:06:39.711914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.711231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'321","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.790438+0000","last_change":"2024-09-14T11:11:02.616888+0000","last_active":"2024-09-14T12:09:53.790438+0000","last_peered":"2024-09-14T12:09:53.790438+0000","last_clean":"2024-09-14T12:09:53.790438+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:09:53.790438+0000","last_undegraded":"2024-09-14T12:09:53.790438+0000","last_fullsized":"2024-09-14T12:09:53.790438+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:38.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1030,"num_write":396,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.576286+0000","last_change":"2024-09-14T11:11:04.630024+0000","last_active":"2024-09-14T12:06:39.576286+0000","last_peered":"2024-09-14T12:06:39.576286+0000","last_clean":"2024-09-14T12:06:39.576286+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:06:39.576286+0000","last_undegraded":"2024-09-14T12:06:39.576286+0000","last_fullsized":"2024-09-14T12:06:39.576286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.568217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'129","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.875581+0000","last_change":"2024-09-14T11:11:06.647460+0000","last_active":"2024-09-14T12:09:13.875581+0000","last_peered":"2024-09-14T12:09:13.875581+0000","last_clean":"2024-09-14T12:09:13.875581+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:09:13.875581+0000","last_undegraded":"2024-09-14T12:09:13.875581+0000","last_fullsized":"2024-09-14T12:09:13.875581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:13.860138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.667533+0000","last_change":"2024-09-14T12:10:14.667533+0000","last_active":"2024-09-14T12:10:14.667533+0000","last_peered":"2024-09-14T12:10:14.667533+0000","last_clean":"2024-09-14T12:10:14.667533+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:10:14.667533+0000","last_undegraded":"2024-09-14T12:10:14.667533+0000","last_fullsized":"2024-09-14T12:10:14.667533+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.667432+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:35.887947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'285","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.047316+0000","last_change":"2024-09-14T12:09:59.047316+0000","last_active":"2024-09-14T12:09:59.047316+0000","last_peered":"2024-09-14T12:09:59.047316+0000","last_clean":"2024-09-14T12:09:59.047316+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:09:59.047316+0000","last_undegraded":"2024-09-14T12:09:59.047316+0000","last_fullsized":"2024-09-14T12:09:59.047316+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'285","last_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_deep_scrub":"265'285","last_deep_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.047215+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:06.088837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":825,"num_read_kb":44655,"num_write":1001,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.681915+0000","last_change":"2024-09-14T11:11:00.610829+0000","last_active":"2024-09-14T12:07:14.681915+0000","last_peered":"2024-09-14T12:07:14.681915+0000","last_clean":"2024-09-14T12:07:14.681915+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:07:14.681915+0000","last_undegraded":"2024-09-14T12:07:14.681915+0000","last_fullsized":"2024-09-14T12:07:14.681915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:59.756124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'96","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.887529+0000","last_change":"2024-09-14T11:11:02.616223+0000","last_active":"2024-09-14T12:07:04.887529+0000","last_peered":"2024-09-14T12:07:04.887529+0000","last_clean":"2024-09-14T12:07:04.887529+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:07:04.887529+0000","last_undegraded":"2024-09-14T12:07:04.887529+0000","last_fullsized":"2024-09-14T12:07:04.887529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:49.797468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575949+0000","last_change":"2024-09-14T11:11:04.636341+0000","last_active":"2024-09-14T12:06:39.575949+0000","last_peered":"2024-09-14T12:06:39.575949+0000","last_clean":"2024-09-14T12:06:39.575949+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:06:39.575949+0000","last_undegraded":"2024-09-14T12:06:39.575949+0000","last_fullsized":"2024-09-14T12:06:39.575949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:29.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'146","reported_seq":655,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561795+0000","last_change":"2024-09-14T11:11:06.647305+0000","last_active":"2024-09-14T12:06:10.561795+0000","last_peered":"2024-09-14T12:06:10.561795+0000","last_clean":"2024-09-14T12:06:10.561795+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:06:10.561795+0000","last_undegraded":"2024-09-14T12:06:10.561795+0000","last_fullsized":"2024-09-14T12:06:10.561795+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:31.457028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.148946+0000","last_change":"2024-09-14T12:10:10.148946+0000","last_active":"2024-09-14T12:10:10.148946+0000","last_peered":"2024-09-14T12:10:10.148946+0000","last_clean":"2024-09-14T12:10:10.148946+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:10:10.148946+0000","last_undegraded":"2024-09-14T12:10:10.148946+0000","last_fullsized":"2024-09-14T12:10:10.148946+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'243","last_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_deep_scrub":"265'243","last_deep_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.148844+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:48.584464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'405","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.397851+0000","last_change":"2024-09-14T12:10:10.397851+0000","last_active":"2024-09-14T12:10:10.397851+0000","last_peered":"2024-09-14T12:10:10.397851+0000","last_clean":"2024-09-14T12:10:10.397851+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:10:10.397851+0000","last_undegraded":"2024-09-14T12:10:10.397851+0000","last_fullsized":"2024-09-14T12:10:10.397851+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.397701+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:07.184919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":632,"num_read_kb":37555,"num_write":1183,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.678008+0000","last_change":"2024-09-14T11:11:00.613697+0000","last_active":"2024-09-14T12:06:39.678008+0000","last_peered":"2024-09-14T12:06:39.678008+0000","last_clean":"2024-09-14T12:06:39.678008+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:06:39.678008+0000","last_undegraded":"2024-09-14T12:06:39.678008+0000","last_fullsized":"2024-09-14T12:06:39.678008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:02.212530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'117","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.652713+0000","last_change":"2024-09-14T11:11:02.616784+0000","last_active":"2024-09-14T12:07:09.652713+0000","last_peered":"2024-09-14T12:07:09.652713+0000","last_clean":"2024-09-14T12:07:09.652713+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:07:09.652713+0000","last_undegraded":"2024-09-14T12:07:09.652713+0000","last_fullsized":"2024-09-14T12:07:09.652713+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:51.199047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'770","reported_seq":2413,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.141834+0000","last_change":"2024-09-14T11:11:04.634733+0000","last_active":"2024-09-14T12:09:54.141834+0000","last_peered":"2024-09-14T12:09:54.141834+0000","last_clean":"2024-09-14T12:09:54.141834+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:09:54.141834+0000","last_undegraded":"2024-09-14T12:09:54.141834+0000","last_fullsized":"2024-09-14T12:09:54.141834+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:34.929041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'217","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.572311+0000","last_change":"2024-09-14T11:11:06.650554+0000","last_active":"2024-09-14T12:07:57.572311+0000","last_peered":"2024-09-14T12:07:57.572311+0000","last_clean":"2024-09-14T12:07:57.572311+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:07:57.572311+0000","last_undegraded":"2024-09-14T12:07:57.572311+0000","last_fullsized":"2024-09-14T12:07:57.572311+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:31.837463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.087612+0000","last_change":"2024-09-14T12:10:10.087612+0000","last_active":"2024-09-14T12:10:10.087612+0000","last_peered":"2024-09-14T12:10:10.087612+0000","last_clean":"2024-09-14T12:10:10.087612+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:10:10.087612+0000","last_undegraded":"2024-09-14T12:10:10.087612+0000","last_fullsized":"2024-09-14T12:10:10.087612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'263","last_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_deep_scrub":"265'263","last_deep_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.087521+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:48.169805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'422","reported_seq":1130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.319589+0000","last_change":"2024-09-14T12:10:02.319589+0000","last_active":"2024-09-14T12:10:02.319589+0000","last_peered":"2024-09-14T12:10:02.319589+0000","last_clean":"2024-09-14T12:10:02.319589+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:10:02.319589+0000","last_undegraded":"2024-09-14T12:10:02.319589+0000","last_fullsized":"2024-09-14T12:10:02.319589+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.319485+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:23.716370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1004,"num_read_kb":6071,"num_write":1268,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.711951+0000","last_change":"2024-09-14T11:11:00.611895+0000","last_active":"2024-09-14T12:06:39.711951+0000","last_peered":"2024-09-14T12:06:39.711951+0000","last_clean":"2024-09-14T12:06:39.711951+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:06:39.711951+0000","last_undegraded":"2024-09-14T12:06:39.711951+0000","last_fullsized":"2024-09-14T12:06:39.711951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:07.634034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'288","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.469446+0000","last_change":"2024-09-14T11:11:02.883054+0000","last_active":"2024-09-14T12:09:53.469446+0000","last_peered":"2024-09-14T12:09:53.469446+0000","last_clean":"2024-09-14T12:09:53.469446+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:09:53.469446+0000","last_undegraded":"2024-09-14T12:09:53.469446+0000","last_fullsized":"2024-09-14T12:09:53.469446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:16.798635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'792","reported_seq":2488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.288675+0000","last_change":"2024-09-14T11:11:04.639858+0000","last_active":"2024-09-14T12:09:54.288675+0000","last_peered":"2024-09-14T12:09:54.288675+0000","last_clean":"2024-09-14T12:09:54.288675+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:09:54.288675+0000","last_undegraded":"2024-09-14T12:09:54.288675+0000","last_fullsized":"2024-09-14T12:09:54.288675+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:13.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666351+0000","last_change":"2024-09-14T12:10:15.666351+0000","last_active":"2024-09-14T12:10:15.666351+0000","last_peered":"2024-09-14T12:10:15.666351+0000","last_clean":"2024-09-14T12:10:15.666351+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:10:15.666351+0000","last_undegraded":"2024-09-14T12:10:15.666351+0000","last_fullsized":"2024-09-14T12:10:15.666351+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.666266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:56.819864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'373","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.247413+0000","last_change":"2024-09-14T12:10:03.247413+0000","last_active":"2024-09-14T12:10:03.247413+0000","last_peered":"2024-09-14T12:10:03.247413+0000","last_clean":"2024-09-14T12:10:03.247413+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:10:03.247413+0000","last_undegraded":"2024-09-14T12:10:03.247413+0000","last_fullsized":"2024-09-14T12:10:03.247413+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.247260+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:03.568283+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343358,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":30361,"num_write":1111,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.563706+0000","last_change":"2024-09-14T12:10:19.563706+0000","last_active":"2024-09-14T12:10:19.563706+0000","last_peered":"2024-09-14T12:10:19.563706+0000","last_clean":"2024-09-14T12:10:19.563706+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:10:19.563706+0000","last_undegraded":"2024-09-14T12:10:19.563706+0000","last_fullsized":"2024-09-14T12:10:19.563706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.563568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:52.176982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'380","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.075411+0000","last_change":"2024-09-14T11:11:02.882354+0000","last_active":"2024-09-14T12:09:54.075411+0000","last_peered":"2024-09-14T12:09:54.075411+0000","last_clean":"2024-09-14T12:09:54.075411+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:09:54.075411+0000","last_undegraded":"2024-09-14T12:09:54.075411+0000","last_fullsized":"2024-09-14T12:09:54.075411+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:23.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.671886+0000","last_change":"2024-09-14T11:11:04.630742+0000","last_active":"2024-09-14T12:07:20.671886+0000","last_peered":"2024-09-14T12:07:20.671886+0000","last_clean":"2024-09-14T12:07:20.671886+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:07:20.671886+0000","last_undegraded":"2024-09-14T12:07:20.671886+0000","last_fullsized":"2024-09-14T12:07:20.671886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:21.580563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'537","reported_seq":1354,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.874293+0000","last_change":"2024-09-14T11:11:06.650569+0000","last_active":"2024-09-14T12:09:14.874293+0000","last_peered":"2024-09-14T12:09:14.874293+0000","last_clean":"2024-09-14T12:09:14.874293+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:09:14.874293+0000","last_undegraded":"2024-09-14T12:09:14.874293+0000","last_fullsized":"2024-09-14T12:09:14.874293+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:39.704565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.875048+0000","last_change":"2024-09-14T12:10:04.875048+0000","last_active":"2024-09-14T12:10:04.875048+0000","last_peered":"2024-09-14T12:10:04.875048+0000","last_clean":"2024-09-14T12:10:04.875048+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:10:04.875048+0000","last_undegraded":"2024-09-14T12:10:04.875048+0000","last_fullsized":"2024-09-14T12:10:04.875048+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.874958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:10.686558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'384","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.371688+0000","last_change":"2024-09-14T12:10:09.371688+0000","last_active":"2024-09-14T12:10:09.371688+0000","last_peered":"2024-09-14T12:10:09.371688+0000","last_clean":"2024-09-14T12:10:09.371688+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:10:09.371688+0000","last_undegraded":"2024-09-14T12:10:09.371688+0000","last_fullsized":"2024-09-14T12:10:09.371688+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.371601+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:05.670350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":916,"num_read_kb":57128,"num_write":1152,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656137+0000","last_change":"2024-09-14T11:11:00.610368+0000","last_active":"2024-09-14T12:07:24.656137+0000","last_peered":"2024-09-14T12:07:24.656137+0000","last_clean":"2024-09-14T12:07:24.656137+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:07:24.656137+0000","last_undegraded":"2024-09-14T12:07:24.656137+0000","last_fullsized":"2024-09-14T12:07:24.656137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:41.032264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'270","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.724302+0000","last_change":"2024-09-14T11:11:02.620109+0000","last_active":"2024-09-14T12:09:52.724302+0000","last_peered":"2024-09-14T12:09:52.724302+0000","last_clean":"2024-09-14T12:09:52.724302+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:09:52.724302+0000","last_undegraded":"2024-09-14T12:09:52.724302+0000","last_fullsized":"2024-09-14T12:09:52.724302+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:44.080763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.684553+0000","last_change":"2024-09-14T11:11:04.638763+0000","last_active":"2024-09-14T12:07:34.684553+0000","last_peered":"2024-09-14T12:07:34.684553+0000","last_clean":"2024-09-14T12:07:34.684553+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:07:34.684553+0000","last_undegraded":"2024-09-14T12:07:34.684553+0000","last_fullsized":"2024-09-14T12:07:34.684553+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:07.104699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2496","reported_seq":4317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.077061+0000","last_change":"2024-09-14T11:11:06.650408+0000","last_active":"2024-09-14T12:09:04.077061+0000","last_peered":"2024-09-14T12:09:04.077061+0000","last_clean":"2024-09-14T12:09:04.077061+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:09:04.077061+0000","last_undegraded":"2024-09-14T12:09:04.077061+0000","last_fullsized":"2024-09-14T12:09:04.077061+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:25.723597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4178","reported_seq":4828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.262356+0000","last_change":"2024-09-14T12:10:08.262356+0000","last_active":"2024-09-14T12:10:08.262356+0000","last_peered":"2024-09-14T12:10:08.262356+0000","last_clean":"2024-09-14T12:10:08.262356+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:10:08.262356+0000","last_undegraded":"2024-09-14T12:10:08.262356+0000","last_fullsized":"2024-09-14T12:10:08.262356+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4178","last_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_deep_scrub":"265'4178","last_deep_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.262241+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:42.755259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'356","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.272037+0000","last_change":"2024-09-14T12:10:05.272037+0000","last_active":"2024-09-14T12:10:05.272037+0000","last_peered":"2024-09-14T12:10:05.272037+0000","last_clean":"2024-09-14T12:10:05.272037+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:10:05.272037+0000","last_undegraded":"2024-09-14T12:10:05.272037+0000","last_fullsized":"2024-09-14T12:10:05.272037+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.271893+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.064154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":21988,"num_write":1237,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666026+0000","last_change":"2024-09-14T12:10:15.666026+0000","last_active":"2024-09-14T12:10:15.666026+0000","last_peered":"2024-09-14T12:10:15.666026+0000","last_clean":"2024-09-14T12:10:15.666026+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:10:15.666026+0000","last_undegraded":"2024-09-14T12:10:15.666026+0000","last_fullsized":"2024-09-14T12:10:15.666026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.665936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:15.551151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'309","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.203620+0000","last_change":"2024-09-14T11:11:02.615273+0000","last_active":"2024-09-14T12:09:54.203620+0000","last_peered":"2024-09-14T12:09:54.203620+0000","last_clean":"2024-09-14T12:09:54.203620+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:09:54.203620+0000","last_undegraded":"2024-09-14T12:09:54.203620+0000","last_fullsized":"2024-09-14T12:09:54.203620+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:37.294965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'780","reported_seq":2794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.506949+0000","last_change":"2024-09-14T11:11:04.634337+0000","last_active":"2024-09-14T12:09:54.506949+0000","last_peered":"2024-09-14T12:09:54.506949+0000","last_clean":"2024-09-14T12:09:54.506949+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:09:54.506949+0000","last_undegraded":"2024-09-14T12:09:54.506949+0000","last_fullsized":"2024-09-14T12:09:54.506949+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":701,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:25.363526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'154","reported_seq":653,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.869470+0000","last_change":"2024-09-14T11:11:06.648183+0000","last_active":"2024-09-14T12:09:13.869470+0000","last_peered":"2024-09-14T12:09:13.869470+0000","last_clean":"2024-09-14T12:09:13.869470+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:09:13.869470+0000","last_undegraded":"2024-09-14T12:09:13.869470+0000","last_fullsized":"2024-09-14T12:09:13.869470+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:52.292024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":711,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.120635+0000","last_change":"2024-09-14T12:10:09.120635+0000","last_active":"2024-09-14T12:10:09.120635+0000","last_peered":"2024-09-14T12:10:09.120635+0000","last_clean":"2024-09-14T12:10:09.120635+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:10:09.120635+0000","last_undegraded":"2024-09-14T12:10:09.120635+0000","last_fullsized":"2024-09-14T12:10:09.120635+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.120547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:00.785994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'364","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.791535+0000","last_change":"2024-09-14T12:10:04.791535+0000","last_active":"2024-09-14T12:10:04.791535+0000","last_peered":"2024-09-14T12:10:04.791535+0000","last_clean":"2024-09-14T12:10:04.791535+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:10:04.791535+0000","last_undegraded":"2024-09-14T12:10:04.791535+0000","last_fullsized":"2024-09-14T12:10:04.791535+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.791431+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:20.658739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":27518,"num_write":1082,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.698872+0000","last_change":"2024-09-14T12:10:18.698872+0000","last_active":"2024-09-14T12:10:18.698872+0000","last_peered":"2024-09-14T12:10:18.698872+0000","last_clean":"2024-09-14T12:10:18.698872+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:10:18.698872+0000","last_undegraded":"2024-09-14T12:10:18.698872+0000","last_fullsized":"2024-09-14T12:10:18.698872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.698762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:25.328497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'483","reported_seq":1128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.266110+0000","last_change":"2024-09-14T12:10:20.266110+0000","last_active":"2024-09-14T12:10:20.266110+0000","last_peered":"2024-09-14T12:10:20.266110+0000","last_clean":"2024-09-14T12:10:20.266110+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:10:20.266110+0000","last_undegraded":"2024-09-14T12:10:20.266110+0000","last_fullsized":"2024-09-14T12:10:20.266110+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.265983+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:56.414346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100274,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":841,"num_read_kb":1995,"num_write":694,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.656109+0000","last_change":"2024-09-14T11:11:04.629148+0000","last_active":"2024-09-14T12:07:24.656109+0000","last_peered":"2024-09-14T12:07:24.656109+0000","last_clean":"2024-09-14T12:07:24.656109+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:07:24.656109+0000","last_undegraded":"2024-09-14T12:07:24.656109+0000","last_fullsized":"2024-09-14T12:07:24.656109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.153280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'174","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.360071+0000","last_change":"2024-09-14T11:11:06.652430+0000","last_active":"2024-09-14T12:07:57.360071+0000","last_peered":"2024-09-14T12:07:57.360071+0000","last_clean":"2024-09-14T12:07:57.360071+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:07:57.360071+0000","last_undegraded":"2024-09-14T12:07:57.360071+0000","last_fullsized":"2024-09-14T12:07:57.360071+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:26.755770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.864662+0000","last_change":"2024-09-14T12:10:05.864662+0000","last_active":"2024-09-14T12:10:05.864662+0000","last_peered":"2024-09-14T12:10:05.864662+0000","last_clean":"2024-09-14T12:10:05.864662+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:10:05.864662+0000","last_undegraded":"2024-09-14T12:10:05.864662+0000","last_fullsized":"2024-09-14T12:10:05.864662+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.864516+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'302","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.548905+0000","last_change":"2024-09-14T12:10:00.548905+0000","last_active":"2024-09-14T12:10:00.548905+0000","last_peered":"2024-09-14T12:10:00.548905+0000","last_clean":"2024-09-14T12:10:00.548905+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:10:00.548905+0000","last_undegraded":"2024-09-14T12:10:00.548905+0000","last_fullsized":"2024-09-14T12:10:00.548905+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.548789+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:47.038045+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":20886,"num_write":921,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.709439+0000","last_change":"2024-09-14T12:10:16.709439+0000","last_active":"2024-09-14T12:10:16.709439+0000","last_peered":"2024-09-14T12:10:16.709439+0000","last_clean":"2024-09-14T12:10:16.709439+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:10:16.709439+0000","last_undegraded":"2024-09-14T12:10:16.709439+0000","last_fullsized":"2024-09-14T12:10:16.709439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.709344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:41.114596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'281","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.032254+0000","last_change":"2024-09-14T11:11:02.617188+0000","last_active":"2024-09-14T12:09:53.032254+0000","last_peered":"2024-09-14T12:09:53.032254+0000","last_clean":"2024-09-14T12:09:53.032254+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:09:53.032254+0000","last_undegraded":"2024-09-14T12:09:53.032254+0000","last_fullsized":"2024-09-14T12:09:53.032254+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:27.613509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571992+0000","last_change":"2024-09-14T11:11:04.638409+0000","last_active":"2024-09-14T12:07:35.571992+0000","last_peered":"2024-09-14T12:07:35.571992+0000","last_clean":"2024-09-14T12:07:35.571992+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:07:35.571992+0000","last_undegraded":"2024-09-14T12:07:35.571992+0000","last_fullsized":"2024-09-14T12:07:35.571992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:18.627071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'96","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:04.080423+0000","last_change":"2024-09-14T11:11:06.653079+0000","last_active":"2024-09-14T12:09:04.080423+0000","last_peered":"2024-09-14T12:09:04.080423+0000","last_clean":"2024-09-14T12:09:04.080423+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:09:04.080423+0000","last_undegraded":"2024-09-14T12:09:04.080423+0000","last_fullsized":"2024-09-14T12:09:04.080423+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:58.237781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.862166+0000","last_change":"2024-09-14T12:10:06.862166+0000","last_active":"2024-09-14T12:10:06.862166+0000","last_peered":"2024-09-14T12:10:06.862166+0000","last_clean":"2024-09-14T12:10:06.862166+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:10:06.862166+0000","last_undegraded":"2024-09-14T12:10:06.862166+0000","last_fullsized":"2024-09-14T12:10:06.862166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'87","last_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_deep_scrub":"265'87","last_deep_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.862087+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:39.538988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'354","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.319113+0000","last_change":"2024-09-14T12:10:03.319113+0000","last_active":"2024-09-14T12:10:03.319113+0000","last_peered":"2024-09-14T12:10:03.319113+0000","last_clean":"2024-09-14T12:10:03.319113+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:10:03.319113+0000","last_undegraded":"2024-09-14T12:10:03.319113+0000","last_fullsized":"2024-09-14T12:10:03.319113+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.318990+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:10.334308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":12874,"num_write":1161,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"265'6","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.772240+0000","last_change":"2024-09-14T12:10:15.772240+0000","last_active":"2024-09-14T12:10:15.772240+0000","last_peered":"2024-09-14T12:10:15.772240+0000","last_clean":"2024-09-14T12:10:15.772240+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:10:15.772240+0000","last_undegraded":"2024-09-14T12:10:15.772240+0000","last_fullsized":"2024-09-14T12:10:15.772240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.772157+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:51.427742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'323","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.688900+0000","last_change":"2024-09-14T12:10:17.688900+0000","last_active":"2024-09-14T12:10:17.688900+0000","last_peered":"2024-09-14T12:10:17.688900+0000","last_clean":"2024-09-14T12:10:17.688900+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:10:17.688900+0000","last_undegraded":"2024-09-14T12:10:17.688900+0000","last_fullsized":"2024-09-14T12:10:17.688900+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.688794+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.306543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'738","reported_seq":2479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.645010+0000","last_change":"2024-09-14T11:11:04.632093+0000","last_active":"2024-09-14T12:09:54.645010+0000","last_peered":"2024-09-14T12:09:54.645010+0000","last_clean":"2024-09-14T12:09:54.645010+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:09:54.645010+0000","last_undegraded":"2024-09-14T12:09:54.645010+0000","last_fullsized":"2024-09-14T12:09:54.645010+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:57.296761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.523143+0000","last_change":"2024-09-14T11:11:06.644785+0000","last_active":"2024-09-14T12:07:55.523143+0000","last_peered":"2024-09-14T12:07:55.523143+0000","last_clean":"2024-09-14T12:07:55.523143+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:07:55.523143+0000","last_undegraded":"2024-09-14T12:07:55.523143+0000","last_fullsized":"2024-09-14T12:07:55.523143+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:20.927650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.861006+0000","last_change":"2024-09-14T12:10:07.861006+0000","last_active":"2024-09-14T12:10:07.861006+0000","last_peered":"2024-09-14T12:10:07.861006+0000","last_clean":"2024-09-14T12:10:07.861006+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:10:07.861006+0000","last_undegraded":"2024-09-14T12:10:07.861006+0000","last_fullsized":"2024-09-14T12:10:07.861006+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.860920+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:10.720698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'309","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.813691+0000","last_change":"2024-09-14T12:09:59.813691+0000","last_active":"2024-09-14T12:09:59.813691+0000","last_peered":"2024-09-14T12:09:59.813691+0000","last_clean":"2024-09-14T12:09:59.813691+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:59.813691+0000","last_undegraded":"2024-09-14T12:09:59.813691+0000","last_fullsized":"2024-09-14T12:09:59.813691+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.813558+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:42.477590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":37578,"num_write":940,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1461,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:51.939893+0000","last_change":"2024-09-14T11:11:00.612934+0000","last_active":"2024-09-14T12:09:51.939893+0000","last_peered":"2024-09-14T12:09:51.939893+0000","last_clean":"2024-09-14T12:09:51.939893+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:09:51.939893+0000","last_undegraded":"2024-09-14T12:09:51.939893+0000","last_fullsized":"2024-09-14T12:09:51.939893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:31.596836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'90","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682622+0000","last_change":"2024-09-14T11:11:02.882134+0000","last_active":"2024-09-14T12:07:19.682622+0000","last_peered":"2024-09-14T12:07:19.682622+0000","last_clean":"2024-09-14T12:07:19.682622+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:07:19.682622+0000","last_undegraded":"2024-09-14T12:07:19.682622+0000","last_fullsized":"2024-09-14T12:07:19.682622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:12.534285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'775","reported_seq":2480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.399320+0000","last_change":"2024-09-14T12:10:18.399320+0000","last_active":"2024-09-14T12:10:18.399320+0000","last_peered":"2024-09-14T12:10:18.399320+0000","last_clean":"2024-09-14T12:10:18.399320+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:10:18.399320+0000","last_undegraded":"2024-09-14T12:10:18.399320+0000","last_fullsized":"2024-09-14T12:10:18.399320+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'775","last_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_deep_scrub":"265'775","last_deep_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.399218+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:25.017139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'114","reported_seq":600,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582391+0000","last_change":"2024-09-14T11:11:06.646677+0000","last_active":"2024-09-14T12:07:24.582391+0000","last_peered":"2024-09-14T12:07:24.582391+0000","last_clean":"2024-09-14T12:07:24.582391+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:07:24.582391+0000","last_undegraded":"2024-09-14T12:07:24.582391+0000","last_fullsized":"2024-09-14T12:07:24.582391+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:35.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'142","reported_seq":744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.733075+0000","last_change":"2024-09-14T12:10:11.733075+0000","last_active":"2024-09-14T12:10:11.733075+0000","last_peered":"2024-09-14T12:10:11.733075+0000","last_clean":"2024-09-14T12:10:11.733075+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:10:11.733075+0000","last_undegraded":"2024-09-14T12:10:11.733075+0000","last_fullsized":"2024-09-14T12:10:11.733075+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.732986+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.340583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1083,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.032758+0000","last_change":"2024-09-14T12:10:05.032758+0000","last_active":"2024-09-14T12:10:05.032758+0000","last_peered":"2024-09-14T12:10:05.032758+0000","last_clean":"2024-09-14T12:10:05.032758+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:10:05.032758+0000","last_undegraded":"2024-09-14T12:10:05.032758+0000","last_fullsized":"2024-09-14T12:10:05.032758+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.032635+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:23.135116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581695+0000","last_change":"2024-09-14T11:11:00.612752+0000","last_active":"2024-09-14T12:07:19.581695+0000","last_peered":"2024-09-14T12:07:19.581695+0000","last_clean":"2024-09-14T12:07:19.581695+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:07:19.581695+0000","last_undegraded":"2024-09-14T12:07:19.581695+0000","last_fullsized":"2024-09-14T12:07:19.581695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:06.297030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'355","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.860007+0000","last_change":"2024-09-14T11:11:02.616725+0000","last_active":"2024-09-14T12:09:53.860007+0000","last_peered":"2024-09-14T12:09:53.860007+0000","last_clean":"2024-09-14T12:09:53.860007+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:09:53.860007+0000","last_undegraded":"2024-09-14T12:09:53.860007+0000","last_fullsized":"2024-09-14T12:09:53.860007+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:01.539137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.399470+0000","last_change":"2024-09-14T12:10:17.399470+0000","last_active":"2024-09-14T12:10:17.399470+0000","last_peered":"2024-09-14T12:10:17.399470+0000","last_clean":"2024-09-14T12:10:17.399470+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:10:17.399470+0000","last_undegraded":"2024-09-14T12:10:17.399470+0000","last_fullsized":"2024-09-14T12:10:17.399470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.399343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:00.798907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'136","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.672420+0000","last_change":"2024-09-14T11:11:06.646340+0000","last_active":"2024-09-14T12:07:25.672420+0000","last_peered":"2024-09-14T12:07:25.672420+0000","last_clean":"2024-09-14T12:07:25.672420+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:07:25.672420+0000","last_undegraded":"2024-09-14T12:07:25.672420+0000","last_fullsized":"2024-09-14T12:07:25.672420+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:44.114108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'106","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.223843+0000","last_change":"2024-09-14T12:10:07.223843+0000","last_active":"2024-09-14T12:10:07.223843+0000","last_peered":"2024-09-14T12:10:07.223843+0000","last_clean":"2024-09-14T12:10:07.223843+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:10:07.223843+0000","last_undegraded":"2024-09-14T12:10:07.223843+0000","last_fullsized":"2024-09-14T12:10:07.223843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.223720+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:16.297510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.260893+0000","last_change":"2024-09-14T12:10:01.260893+0000","last_active":"2024-09-14T12:10:01.260893+0000","last_peered":"2024-09-14T12:10:01.260893+0000","last_clean":"2024-09-14T12:10:01.260893+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:10:01.260893+0000","last_undegraded":"2024-09-14T12:10:01.260893+0000","last_fullsized":"2024-09-14T12:10:01.260893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.260776+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:12.451761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.799298+0000","last_change":"2024-09-14T12:10:02.799298+0000","last_active":"2024-09-14T12:10:02.799298+0000","last_peered":"2024-09-14T12:10:02.799298+0000","last_clean":"2024-09-14T12:10:02.799298+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:10:02.799298+0000","last_undegraded":"2024-09-14T12:10:02.799298+0000","last_fullsized":"2024-09-14T12:10:02.799298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.799218+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:43.571584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.019453+0000","last_change":"2024-09-14T12:10:01.019453+0000","last_active":"2024-09-14T12:10:01.019453+0000","last_peered":"2024-09-14T12:10:01.019453+0000","last_clean":"2024-09-14T12:10:01.019453+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:10:01.019453+0000","last_undegraded":"2024-09-14T12:10:01.019453+0000","last_fullsized":"2024-09-14T12:10:01.019453+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.019366+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:16.170494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":21923,"num_write":1076,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.582005+0000","last_change":"2024-09-14T11:11:00.610291+0000","last_active":"2024-09-14T12:07:19.582005+0000","last_peered":"2024-09-14T12:07:19.582005+0000","last_clean":"2024-09-14T12:07:19.582005+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:07:19.582005+0000","last_undegraded":"2024-09-14T12:07:19.582005+0000","last_fullsized":"2024-09-14T12:07:19.582005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:59.638567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'762","reported_seq":1474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.547865+0000","last_change":"2024-09-14T11:11:02.621281+0000","last_active":"2024-09-14T12:09:54.547865+0000","last_peered":"2024-09-14T12:09:54.547865+0000","last_clean":"2024-09-14T12:09:54.547865+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:09:54.547865+0000","last_undegraded":"2024-09-14T12:09:54.547865+0000","last_fullsized":"2024-09-14T12:09:54.547865+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:39.469737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:25.570862+0000","last_change":"2024-09-14T11:11:04.632962+0000","last_active":"2024-09-14T12:07:25.570862+0000","last_peered":"2024-09-14T12:07:25.570862+0000","last_clean":"2024-09-14T12:07:25.570862+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:07:25.570862+0000","last_undegraded":"2024-09-14T12:07:25.570862+0000","last_fullsized":"2024-09-14T12:07:25.570862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'182","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.397769+0000","last_change":"2024-09-14T11:11:06.647490+0000","last_active":"2024-09-14T12:07:57.397769+0000","last_peered":"2024-09-14T12:07:57.397769+0000","last_clean":"2024-09-14T12:07:57.397769+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:07:57.397769+0000","last_undegraded":"2024-09-14T12:07:57.397769+0000","last_fullsized":"2024-09-14T12:07:57.397769+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:49.491579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.075205+0000","last_change":"2024-09-14T12:10:08.075205+0000","last_active":"2024-09-14T12:10:08.075205+0000","last_peered":"2024-09-14T12:10:08.075205+0000","last_clean":"2024-09-14T12:10:08.075205+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:10:08.075205+0000","last_undegraded":"2024-09-14T12:10:08.075205+0000","last_fullsized":"2024-09-14T12:10:08.075205+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.075089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:14.415988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.224677+0000","last_change":"2024-09-14T12:10:04.224677+0000","last_active":"2024-09-14T12:10:04.224677+0000","last_peered":"2024-09-14T12:10:04.224677+0000","last_clean":"2024-09-14T12:10:04.224677+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:10:04.224677+0000","last_undegraded":"2024-09-14T12:10:04.224677+0000","last_fullsized":"2024-09-14T12:10:04.224677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.224592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.747913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.014417+0000","last_change":"2024-09-14T12:10:00.014417+0000","last_active":"2024-09-14T12:10:00.014417+0000","last_peered":"2024-09-14T12:10:00.014417+0000","last_clean":"2024-09-14T12:10:00.014417+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:10:00.014417+0000","last_undegraded":"2024-09-14T12:10:00.014417+0000","last_fullsized":"2024-09-14T12:10:00.014417+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.014290+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:59.265225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":48298,"num_write":1181,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.718904+0000","last_change":"2024-09-14T11:11:00.610424+0000","last_active":"2024-09-14T12:07:24.718904+0000","last_peered":"2024-09-14T12:07:24.718904+0000","last_clean":"2024-09-14T12:07:24.718904+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:07:24.718904+0000","last_undegraded":"2024-09-14T12:07:24.718904+0000","last_fullsized":"2024-09-14T12:07:24.718904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:04.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1284","reported_seq":2929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.805274+0000","last_change":"2024-09-14T12:10:18.805274+0000","last_active":"2024-09-14T12:10:18.805274+0000","last_peered":"2024-09-14T12:10:18.805274+0000","last_clean":"2024-09-14T12:10:18.805274+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:10:18.805274+0000","last_undegraded":"2024-09-14T12:10:18.805274+0000","last_fullsized":"2024-09-14T12:10:18.805274+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1284","last_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_deep_scrub":"265'1284","last_deep_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.805160+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":1200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:19.969704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140197,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2031,"num_read_kb":3753,"num_write":1136,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.583514+0000","last_change":"2024-09-14T11:11:04.638084+0000","last_active":"2024-09-14T12:07:29.583514+0000","last_peered":"2024-09-14T12:07:29.583514+0000","last_clean":"2024-09-14T12:07:29.583514+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:07:29.583514+0000","last_undegraded":"2024-09-14T12:07:29.583514+0000","last_fullsized":"2024-09-14T12:07:29.583514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.322127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'220","reported_seq":743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.081368+0000","last_change":"2024-09-14T11:11:06.643093+0000","last_active":"2024-09-14T12:07:54.081368+0000","last_peered":"2024-09-14T12:07:54.081368+0000","last_clean":"2024-09-14T12:07:54.081368+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:07:54.081368+0000","last_undegraded":"2024-09-14T12:07:54.081368+0000","last_fullsized":"2024-09-14T12:07:54.081368+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:50.057224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.817859+0000","last_change":"2024-09-14T12:10:07.817859+0000","last_active":"2024-09-14T12:10:07.817859+0000","last_peered":"2024-09-14T12:10:07.817859+0000","last_clean":"2024-09-14T12:10:07.817859+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:10:07.817859+0000","last_undegraded":"2024-09-14T12:10:07.817859+0000","last_fullsized":"2024-09-14T12:10:07.817859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.817764+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.265513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.586595+0000","last_change":"2024-09-14T12:09:59.586595+0000","last_active":"2024-09-14T12:09:59.586595+0000","last_peered":"2024-09-14T12:09:59.586595+0000","last_clean":"2024-09-14T12:09:59.586595+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:09:59.586595+0000","last_undegraded":"2024-09-14T12:09:59.586595+0000","last_fullsized":"2024-09-14T12:09:59.586595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.586474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:31.075728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'377","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.870135+0000","last_change":"2024-09-14T12:09:58.870135+0000","last_active":"2024-09-14T12:09:58.870135+0000","last_peered":"2024-09-14T12:09:58.870135+0000","last_clean":"2024-09-14T12:09:58.870135+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:09:58.870135+0000","last_undegraded":"2024-09-14T12:09:58.870135+0000","last_fullsized":"2024-09-14T12:09:58.870135+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.870049+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:28.701680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":652,"num_read_kb":34638,"num_write":1221,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.670856+0000","last_change":"2024-09-14T12:10:11.670856+0000","last_active":"2024-09-14T12:10:11.670856+0000","last_peered":"2024-09-14T12:10:11.670856+0000","last_clean":"2024-09-14T12:10:11.670856+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:10:11.670856+0000","last_undegraded":"2024-09-14T12:10:11.670856+0000","last_fullsized":"2024-09-14T12:10:11.670856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.670773+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:07.716742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.035888+0000","last_change":"2024-09-14T11:11:02.887250+0000","last_active":"2024-09-14T12:09:15.035888+0000","last_peered":"2024-09-14T12:09:15.035888+0000","last_clean":"2024-09-14T12:09:15.035888+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:09:15.035888+0000","last_undegraded":"2024-09-14T12:09:15.035888+0000","last_fullsized":"2024-09-14T12:09:15.035888+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:22.027517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570276+0000","last_change":"2024-09-14T11:11:04.635365+0000","last_active":"2024-09-14T12:07:20.570276+0000","last_peered":"2024-09-14T12:07:20.570276+0000","last_clean":"2024-09-14T12:07:20.570276+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:07:20.570276+0000","last_undegraded":"2024-09-14T12:07:20.570276+0000","last_fullsized":"2024-09-14T12:07:20.570276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:48.407204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'240","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.650870+0000","last_change":"2024-09-14T11:11:06.650013+0000","last_active":"2024-09-14T12:07:57.650870+0000","last_peered":"2024-09-14T12:07:57.650870+0000","last_clean":"2024-09-14T12:07:57.650870+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:07:57.650870+0000","last_undegraded":"2024-09-14T12:07:57.650870+0000","last_fullsized":"2024-09-14T12:07:57.650870+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.193259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.796640+0000","last_change":"2024-09-14T12:10:04.796640+0000","last_active":"2024-09-14T12:10:04.796640+0000","last_peered":"2024-09-14T12:10:04.796640+0000","last_clean":"2024-09-14T12:10:04.796640+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:10:04.796640+0000","last_undegraded":"2024-09-14T12:10:04.796640+0000","last_fullsized":"2024-09-14T12:10:04.796640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.796540+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:34.364854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.780661+0000","last_change":"2024-09-14T12:10:01.780661+0000","last_active":"2024-09-14T12:10:01.780661+0000","last_peered":"2024-09-14T12:10:01.780661+0000","last_clean":"2024-09-14T12:10:01.780661+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:10:01.780661+0000","last_undegraded":"2024-09-14T12:10:01.780661+0000","last_fullsized":"2024-09-14T12:10:01.780661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.780573+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:54.383561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'320","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.820112+0000","last_change":"2024-09-14T12:10:00.820112+0000","last_active":"2024-09-14T12:10:00.820112+0000","last_peered":"2024-09-14T12:10:00.820112+0000","last_clean":"2024-09-14T12:10:00.820112+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:10:00.820112+0000","last_undegraded":"2024-09-14T12:10:00.820112+0000","last_fullsized":"2024-09-14T12:10:00.820112+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.820017+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:02.962307+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":663,"num_read_kb":8841,"num_write":1009,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"265'4","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.278392+0000","last_change":"2024-09-14T12:10:17.278392+0000","last_active":"2024-09-14T12:10:17.278392+0000","last_peered":"2024-09-14T12:10:17.278392+0000","last_clean":"2024-09-14T12:10:17.278392+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:10:17.278392+0000","last_undegraded":"2024-09-14T12:10:17.278392+0000","last_fullsized":"2024-09-14T12:10:17.278392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.278291+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.269121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'141","reported_seq":687,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:15.049855+0000","last_change":"2024-09-14T11:11:02.619842+0000","last_active":"2024-09-14T12:09:15.049855+0000","last_peered":"2024-09-14T12:09:15.049855+0000","last_clean":"2024-09-14T12:09:15.049855+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:09:15.049855+0000","last_undegraded":"2024-09-14T12:09:15.049855+0000","last_fullsized":"2024-09-14T12:09:15.049855+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:29.586585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.368105+0000","last_change":"2024-09-14T12:10:16.368105+0000","last_active":"2024-09-14T12:10:16.368105+0000","last_peered":"2024-09-14T12:10:16.368105+0000","last_clean":"2024-09-14T12:10:16.368105+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:10:16.368105+0000","last_undegraded":"2024-09-14T12:10:16.368105+0000","last_fullsized":"2024-09-14T12:10:16.368105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.368014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:07.077831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.719671+0000","last_change":"2024-09-14T11:11:06.652421+0000","last_active":"2024-09-14T12:07:29.719671+0000","last_peered":"2024-09-14T12:07:29.719671+0000","last_clean":"2024-09-14T12:07:29.719671+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:07:29.719671+0000","last_undegraded":"2024-09-14T12:07:29.719671+0000","last_fullsized":"2024-09-14T12:07:29.719671+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:13.461185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.609490+0000","last_change":"2024-09-14T12:10:06.609490+0000","last_active":"2024-09-14T12:10:06.609490+0000","last_peered":"2024-09-14T12:10:06.609490+0000","last_clean":"2024-09-14T12:10:06.609490+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:10:06.609490+0000","last_undegraded":"2024-09-14T12:10:06.609490+0000","last_fullsized":"2024-09-14T12:10:06.609490+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.609384+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:45.973252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.734129+0000","last_change":"2024-09-14T12:10:00.734129+0000","last_active":"2024-09-14T12:10:00.734129+0000","last_peered":"2024-09-14T12:10:00.734129+0000","last_clean":"2024-09-14T12:10:00.734129+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:10:00.734129+0000","last_undegraded":"2024-09-14T12:10:00.734129+0000","last_fullsized":"2024-09-14T12:10:00.734129+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.734031+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:49.843097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.821103+0000","last_change":"2024-09-14T12:10:00.821103+0000","last_active":"2024-09-14T12:10:00.821103+0000","last_peered":"2024-09-14T12:10:00.821103+0000","last_clean":"2024-09-14T12:10:00.821103+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:10:00.821103+0000","last_undegraded":"2024-09-14T12:10:00.821103+0000","last_fullsized":"2024-09-14T12:10:00.821103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.821034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:21.167595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.242975+0000","last_change":"2024-09-14T12:10:19.242975+0000","last_active":"2024-09-14T12:10:19.242975+0000","last_peered":"2024-09-14T12:10:19.242975+0000","last_clean":"2024-09-14T12:10:19.242975+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:10:19.242975+0000","last_undegraded":"2024-09-14T12:10:19.242975+0000","last_fullsized":"2024-09-14T12:10:19.242975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.242892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:59.906575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1280,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.247855+0000","last_change":"2024-09-14T12:10:18.247855+0000","last_active":"2024-09-14T12:10:18.247855+0000","last_peered":"2024-09-14T12:10:18.247855+0000","last_clean":"2024-09-14T12:10:18.247855+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:10:18.247855+0000","last_undegraded":"2024-09-14T12:10:18.247855+0000","last_fullsized":"2024-09-14T12:10:18.247855+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'599","last_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_deep_scrub":"265'599","last_deep_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.247734+0000","objects_scrubbed":10,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:14.437465+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1669,"num_read_kb":2890,"num_write":2218,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537664,"num_omap_keys":1218,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581595+0000","last_change":"2024-09-14T11:11:04.637891+0000","last_active":"2024-09-14T12:07:19.581595+0000","last_peered":"2024-09-14T12:07:19.581595+0000","last_clean":"2024-09-14T12:07:19.581595+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:07:19.581595+0000","last_undegraded":"2024-09-14T12:07:19.581595+0000","last_fullsized":"2024-09-14T12:07:19.581595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.595704+0000","last_change":"2024-09-14T11:11:06.644529+0000","last_active":"2024-09-14T12:07:54.595704+0000","last_peered":"2024-09-14T12:07:54.595704+0000","last_clean":"2024-09-14T12:07:54.595704+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:07:54.595704+0000","last_undegraded":"2024-09-14T12:07:54.595704+0000","last_fullsized":"2024-09-14T12:07:54.595704+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:27.041637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.057475+0000","last_change":"2024-09-14T12:10:07.057475+0000","last_active":"2024-09-14T12:10:07.057475+0000","last_peered":"2024-09-14T12:10:07.057475+0000","last_clean":"2024-09-14T12:10:07.057475+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:10:07.057475+0000","last_undegraded":"2024-09-14T12:10:07.057475+0000","last_fullsized":"2024-09-14T12:10:07.057475+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.057369+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:52.846935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'378","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.805142+0000","last_change":"2024-09-14T12:10:01.805142+0000","last_active":"2024-09-14T12:10:01.805142+0000","last_peered":"2024-09-14T12:10:01.805142+0000","last_clean":"2024-09-14T12:10:01.805142+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:10:01.805142+0000","last_undegraded":"2024-09-14T12:10:01.805142+0000","last_fullsized":"2024-09-14T12:10:01.805142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.805035+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:40.071458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":671,"num_read_kb":35559,"num_write":1182,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.234636+0000","last_change":"2024-09-14T12:10:02.234636+0000","last_active":"2024-09-14T12:10:02.234636+0000","last_peered":"2024-09-14T12:10:02.234636+0000","last_clean":"2024-09-14T12:10:02.234636+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:10:02.234636+0000","last_undegraded":"2024-09-14T12:10:02.234636+0000","last_fullsized":"2024-09-14T12:10:02.234636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.234555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.749698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.293819+0000","last_change":"2024-09-14T12:10:13.293819+0000","last_active":"2024-09-14T12:10:13.293819+0000","last_peered":"2024-09-14T12:10:13.293819+0000","last_clean":"2024-09-14T12:10:13.293819+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:10:13.293819+0000","last_undegraded":"2024-09-14T12:10:13.293819+0000","last_fullsized":"2024-09-14T12:10:13.293819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.293717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:44.892162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.763162+0000","last_change":"2024-09-14T12:10:17.763162+0000","last_active":"2024-09-14T12:10:17.763162+0000","last_peered":"2024-09-14T12:10:17.763162+0000","last_clean":"2024-09-14T12:10:17.763162+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:10:17.763162+0000","last_undegraded":"2024-09-14T12:10:17.763162+0000","last_fullsized":"2024-09-14T12:10:17.763162+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.763047+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:11.047981+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'772","reported_seq":2649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.128180+0000","last_change":"2024-09-14T11:11:04.632716+0000","last_active":"2024-09-14T12:09:54.128180+0000","last_peered":"2024-09-14T12:09:54.128180+0000","last_clean":"2024-09-14T12:09:54.128180+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:09:54.128180+0000","last_undegraded":"2024-09-14T12:09:54.128180+0000","last_fullsized":"2024-09-14T12:09:54.128180+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:21.258508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'121","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.871748+0000","last_change":"2024-09-14T11:11:06.651630+0000","last_active":"2024-09-14T12:09:14.871748+0000","last_peered":"2024-09-14T12:09:14.871748+0000","last_clean":"2024-09-14T12:09:14.871748+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:09:14.871748+0000","last_undegraded":"2024-09-14T12:09:14.871748+0000","last_fullsized":"2024-09-14T12:09:14.871748+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:46.113659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.112509+0000","last_change":"2024-09-14T12:10:08.112509+0000","last_active":"2024-09-14T12:10:08.112509+0000","last_peered":"2024-09-14T12:10:08.112509+0000","last_clean":"2024-09-14T12:10:08.112509+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:10:08.112509+0000","last_undegraded":"2024-09-14T12:10:08.112509+0000","last_fullsized":"2024-09-14T12:10:08.112509+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.112409+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:09.821615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.001125+0000","last_change":"2024-09-14T12:10:00.001125+0000","last_active":"2024-09-14T12:10:00.001125+0000","last_peered":"2024-09-14T12:10:00.001125+0000","last_clean":"2024-09-14T12:10:00.001125+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:10:00.001125+0000","last_undegraded":"2024-09-14T12:10:00.001125+0000","last_fullsized":"2024-09-14T12:10:00.001125+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.001028+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.912729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.836980+0000","last_change":"2024-09-14T12:09:59.836980+0000","last_active":"2024-09-14T12:09:59.836980+0000","last_peered":"2024-09-14T12:09:59.836980+0000","last_clean":"2024-09-14T12:09:59.836980+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:09:59.836980+0000","last_undegraded":"2024-09-14T12:09:59.836980+0000","last_fullsized":"2024-09-14T12:09:59.836980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.836907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:32.571263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581576+0000","last_change":"2024-09-14T11:11:00.610462+0000","last_active":"2024-09-14T12:07:19.581576+0000","last_peered":"2024-09-14T12:07:19.581576+0000","last_clean":"2024-09-14T12:07:19.581576+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:07:19.581576+0000","last_undegraded":"2024-09-14T12:07:19.581576+0000","last_fullsized":"2024-09-14T12:07:19.581576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:57.985170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'120","reported_seq":656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581610+0000","last_change":"2024-09-14T11:11:02.618565+0000","last_active":"2024-09-14T12:07:19.581610+0000","last_peered":"2024-09-14T12:07:19.581610+0000","last_clean":"2024-09-14T12:07:19.581610+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:07:19.581610+0000","last_undegraded":"2024-09-14T12:07:19.581610+0000","last_fullsized":"2024-09-14T12:07:19.581610+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:49.564984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'792","reported_seq":6722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.288470+0000","last_change":"2024-09-14T11:11:04.641546+0000","last_active":"2024-09-14T12:09:54.288470+0000","last_peered":"2024-09-14T12:09:54.288470+0000","last_clean":"2024-09-14T12:09:54.288470+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:09:54.288470+0000","last_undegraded":"2024-09-14T12:09:54.288470+0000","last_fullsized":"2024-09-14T12:09:54.288470+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:25.512512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'211","reported_seq":720,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.574448+0000","last_change":"2024-09-14T11:11:06.651293+0000","last_active":"2024-09-14T12:07:56.574448+0000","last_peered":"2024-09-14T12:07:56.574448+0000","last_clean":"2024-09-14T12:07:56.574448+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:07:56.574448+0000","last_undegraded":"2024-09-14T12:07:56.574448+0000","last_fullsized":"2024-09-14T12:07:56.574448+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:36.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.833148+0000","last_change":"2024-09-14T12:10:02.833148+0000","last_active":"2024-09-14T12:10:02.833148+0000","last_peered":"2024-09-14T12:10:02.833148+0000","last_clean":"2024-09-14T12:10:02.833148+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:10:02.833148+0000","last_undegraded":"2024-09-14T12:10:02.833148+0000","last_fullsized":"2024-09-14T12:10:02.833148+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4144","last_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_deep_scrub":"265'4144","last_deep_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.833062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:50.518946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'380","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.549372+0000","last_change":"2024-09-14T12:10:03.549302+0000","last_active":"2024-09-14T12:10:03.549372+0000","last_peered":"2024-09-14T12:10:03.549372+0000","last_clean":"2024-09-14T12:10:03.549372+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:10:03.549372+0000","last_undegraded":"2024-09-14T12:10:03.549372+0000","last_fullsized":"2024-09-14T12:10:03.549372+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.549195+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:33.120720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":5405,"num_write":1192,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.355045+0000","last_change":"2024-09-14T12:10:01.355045+0000","last_active":"2024-09-14T12:10:01.355045+0000","last_peered":"2024-09-14T12:10:01.355045+0000","last_clean":"2024-09-14T12:10:01.355045+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:10:01.355045+0000","last_undegraded":"2024-09-14T12:10:01.355045+0000","last_fullsized":"2024-09-14T12:10:01.355045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.354958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:25.192772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.241169+0000","last_change":"2024-09-14T12:10:18.241169+0000","last_active":"2024-09-14T12:10:18.241169+0000","last_peered":"2024-09-14T12:10:18.241169+0000","last_clean":"2024-09-14T12:10:18.241169+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:10:18.241169+0000","last_undegraded":"2024-09-14T12:10:18.241169+0000","last_fullsized":"2024-09-14T12:10:18.241169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.241011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:36.998156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'795","reported_seq":1517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.736663+0000","last_change":"2024-09-14T11:11:02.882288+0000","last_active":"2024-09-14T12:09:53.736663+0000","last_peered":"2024-09-14T12:09:53.736663+0000","last_clean":"2024-09-14T12:09:53.736663+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:09:53.736663+0000","last_undegraded":"2024-09-14T12:09:53.736663+0000","last_fullsized":"2024-09-14T12:09:53.736663+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:52.083848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682515+0000","last_change":"2024-09-14T11:11:04.636384+0000","last_active":"2024-09-14T12:07:19.682515+0000","last_peered":"2024-09-14T12:07:19.682515+0000","last_clean":"2024-09-14T12:07:19.682515+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:07:19.682515+0000","last_undegraded":"2024-09-14T12:07:19.682515+0000","last_fullsized":"2024-09-14T12:07:19.682515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:19.200941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'147","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.868910+0000","last_change":"2024-09-14T11:11:06.645842+0000","last_active":"2024-09-14T12:09:14.868910+0000","last_peered":"2024-09-14T12:09:14.868910+0000","last_clean":"2024-09-14T12:09:14.868910+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:09:14.868910+0000","last_undegraded":"2024-09-14T12:09:14.868910+0000","last_fullsized":"2024-09-14T12:09:14.868910+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:49.989680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'133","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.592187+0000","last_change":"2024-09-14T11:11:06.646108+0000","last_active":"2024-09-14T12:07:57.592187+0000","last_peered":"2024-09-14T12:07:57.592187+0000","last_clean":"2024-09-14T12:07:57.592187+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:07:57.592187+0000","last_undegraded":"2024-09-14T12:07:57.592187+0000","last_fullsized":"2024-09-14T12:07:57.592187+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:15.069138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.867191+0000","last_change":"2024-09-14T12:10:10.867191+0000","last_active":"2024-09-14T12:10:10.867191+0000","last_peered":"2024-09-14T12:10:10.867191+0000","last_clean":"2024-09-14T12:10:10.867191+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:10:10.867191+0000","last_undegraded":"2024-09-14T12:10:10.867191+0000","last_fullsized":"2024-09-14T12:10:10.867191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.867096+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:37.567590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'349","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.790676+0000","last_change":"2024-09-14T12:10:01.790676+0000","last_active":"2024-09-14T12:10:01.790676+0000","last_peered":"2024-09-14T12:10:01.790676+0000","last_clean":"2024-09-14T12:10:01.790676+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:10:01.790676+0000","last_undegraded":"2024-09-14T12:10:01.790676+0000","last_fullsized":"2024-09-14T12:10:01.790676+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.790549+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.092776+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":5106,"num_write":1232,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.730899+0000","last_change":"2024-09-14T12:10:12.730899+0000","last_active":"2024-09-14T12:10:12.730899+0000","last_peered":"2024-09-14T12:10:12.730899+0000","last_clean":"2024-09-14T12:10:12.730899+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:10:12.730899+0000","last_undegraded":"2024-09-14T12:10:12.730899+0000","last_fullsized":"2024-09-14T12:10:12.730899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.730806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:09.075497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'323","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.143808+0000","last_change":"2024-09-14T11:11:02.622367+0000","last_active":"2024-09-14T12:09:54.143808+0000","last_peered":"2024-09-14T12:09:54.143808+0000","last_clean":"2024-09-14T12:09:54.143808+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:09:54.143808+0000","last_undegraded":"2024-09-14T12:09:54.143808+0000","last_fullsized":"2024-09-14T12:09:54.143808+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:39.564835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.680693+0000","last_change":"2024-09-14T11:11:04.639827+0000","last_active":"2024-09-14T12:07:04.680693+0000","last_peered":"2024-09-14T12:07:04.680693+0000","last_clean":"2024-09-14T12:07:04.680693+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:07:04.680693+0000","last_undegraded":"2024-09-14T12:07:04.680693+0000","last_fullsized":"2024-09-14T12:07:04.680693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:10.987465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'132","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682683+0000","last_change":"2024-09-14T11:11:06.649975+0000","last_active":"2024-09-14T12:07:19.682683+0000","last_peered":"2024-09-14T12:07:19.682683+0000","last_clean":"2024-09-14T12:07:19.682683+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:07:19.682683+0000","last_undegraded":"2024-09-14T12:07:19.682683+0000","last_fullsized":"2024-09-14T12:07:19.682683+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:50.322032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.818239+0000","last_change":"2024-09-14T12:10:08.818239+0000","last_active":"2024-09-14T12:10:08.818239+0000","last_peered":"2024-09-14T12:10:08.818239+0000","last_clean":"2024-09-14T12:10:08.818239+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:10:08.818239+0000","last_undegraded":"2024-09-14T12:10:08.818239+0000","last_fullsized":"2024-09-14T12:10:08.818239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.818146+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:58.032521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'348","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.325150+0000","last_change":"2024-09-14T12:10:08.325150+0000","last_active":"2024-09-14T12:10:08.325150+0000","last_peered":"2024-09-14T12:10:08.325150+0000","last_clean":"2024-09-14T12:10:08.325150+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:10:08.325150+0000","last_undegraded":"2024-09-14T12:10:08.325150+0000","last_fullsized":"2024-09-14T12:10:08.325150+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.325054+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:38.981426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":33435,"num_write":1030,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.215844+0000","last_change":"2024-09-14T12:10:19.215844+0000","last_active":"2024-09-14T12:10:19.215844+0000","last_peered":"2024-09-14T12:10:19.215844+0000","last_clean":"2024-09-14T12:10:19.215844+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:10:19.215844+0000","last_undegraded":"2024-09-14T12:10:19.215844+0000","last_fullsized":"2024-09-14T12:10:19.215844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.215754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:04.064105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'47","reported_seq":554,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568300+0000","last_change":"2024-09-14T11:11:02.616318+0000","last_active":"2024-09-14T12:07:05.568300+0000","last_peered":"2024-09-14T12:07:05.568300+0000","last_clean":"2024-09-14T12:07:05.568300+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:07:05.568300+0000","last_undegraded":"2024-09-14T12:07:05.568300+0000","last_fullsized":"2024-09-14T12:07:05.568300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:14.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579853+0000","last_change":"2024-09-14T11:11:04.630959+0000","last_active":"2024-09-14T12:07:04.579853+0000","last_peered":"2024-09-14T12:07:04.579853+0000","last_clean":"2024-09-14T12:07:04.579853+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:07:04.579853+0000","last_undegraded":"2024-09-14T12:07:04.579853+0000","last_fullsized":"2024-09-14T12:07:04.579853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:47.446758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'253","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:56.593628+0000","last_change":"2024-09-14T11:11:06.642887+0000","last_active":"2024-09-14T12:07:56.593628+0000","last_peered":"2024-09-14T12:07:56.593628+0000","last_clean":"2024-09-14T12:07:56.593628+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:07:56.593628+0000","last_undegraded":"2024-09-14T12:07:56.593628+0000","last_fullsized":"2024-09-14T12:07:56.593628+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:46.857547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.069541+0000","last_change":"2024-09-14T12:10:09.069541+0000","last_active":"2024-09-14T12:10:09.069541+0000","last_peered":"2024-09-14T12:10:09.069541+0000","last_clean":"2024-09-14T12:10:09.069541+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:10:09.069541+0000","last_undegraded":"2024-09-14T12:10:09.069541+0000","last_fullsized":"2024-09-14T12:10:09.069541+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.069447+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.610666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1258,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.804369+0000","last_change":"2024-09-14T12:10:03.804369+0000","last_active":"2024-09-14T12:10:03.804369+0000","last_peered":"2024-09-14T12:10:03.804369+0000","last_clean":"2024-09-14T12:10:03.804369+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:10:03.804369+0000","last_undegraded":"2024-09-14T12:10:03.804369+0000","last_fullsized":"2024-09-14T12:10:03.804369+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.804231+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.949022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:04.579817+0000","last_change":"2024-09-14T11:11:00.608611+0000","last_active":"2024-09-14T12:07:04.579817+0000","last_peered":"2024-09-14T12:07:04.579817+0000","last_clean":"2024-09-14T12:07:04.579817+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:07:04.579817+0000","last_undegraded":"2024-09-14T12:07:04.579817+0000","last_fullsized":"2024-09-14T12:07:04.579817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:32.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'307","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.395477+0000","last_change":"2024-09-14T11:11:02.621487+0000","last_active":"2024-09-14T12:09:53.395477+0000","last_peered":"2024-09-14T12:09:53.395477+0000","last_clean":"2024-09-14T12:09:53.395477+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:09:53.395477+0000","last_undegraded":"2024-09-14T12:09:53.395477+0000","last_fullsized":"2024-09-14T12:09:53.395477+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:57.571157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.585970+0000","last_change":"2024-09-14T11:11:04.632741+0000","last_active":"2024-09-14T12:07:05.585970+0000","last_peered":"2024-09-14T12:07:05.585970+0000","last_clean":"2024-09-14T12:07:05.585970+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:07:05.585970+0000","last_undegraded":"2024-09-14T12:07:05.585970+0000","last_fullsized":"2024-09-14T12:07:05.585970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:33.615718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'110","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.940177+0000","last_change":"2024-09-14T11:11:06.646134+0000","last_active":"2024-09-14T12:07:55.940177+0000","last_peered":"2024-09-14T12:07:55.940177+0000","last_clean":"2024-09-14T12:07:55.940177+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:07:55.940177+0000","last_undegraded":"2024-09-14T12:07:55.940177+0000","last_fullsized":"2024-09-14T12:07:55.940177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:44.141877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'144","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.115730+0000","last_change":"2024-09-14T12:10:11.115730+0000","last_active":"2024-09-14T12:10:11.115730+0000","last_peered":"2024-09-14T12:10:11.115730+0000","last_clean":"2024-09-14T12:10:11.115730+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:10:11.115730+0000","last_undegraded":"2024-09-14T12:10:11.115730+0000","last_fullsized":"2024-09-14T12:10:11.115730+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.115619+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.488762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'377","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.003226+0000","last_change":"2024-09-14T12:10:01.003226+0000","last_active":"2024-09-14T12:10:01.003226+0000","last_peered":"2024-09-14T12:10:01.003226+0000","last_clean":"2024-09-14T12:10:01.003226+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:10:01.003226+0000","last_undegraded":"2024-09-14T12:10:01.003226+0000","last_fullsized":"2024-09-14T12:10:01.003226+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.003138+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:56.741486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":721,"num_read_kb":71289,"num_write":1192,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.311021+0000","last_change":"2024-09-14T12:10:14.311021+0000","last_active":"2024-09-14T12:10:14.311021+0000","last_peered":"2024-09-14T12:10:14.311021+0000","last_clean":"2024-09-14T12:10:14.311021+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:10:14.311021+0000","last_undegraded":"2024-09-14T12:10:14.311021+0000","last_fullsized":"2024-09-14T12:10:14.311021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.310925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:23.832794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'265","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.192042+0000","last_change":"2024-09-14T11:11:02.615297+0000","last_active":"2024-09-14T12:09:53.192042+0000","last_peered":"2024-09-14T12:09:53.192042+0000","last_clean":"2024-09-14T12:09:53.192042+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:09:53.192042+0000","last_undegraded":"2024-09-14T12:09:53.192042+0000","last_fullsized":"2024-09-14T12:09:53.192042+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:52.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:05.568346+0000","last_change":"2024-09-14T11:11:04.634007+0000","last_active":"2024-09-14T12:07:05.568346+0000","last_peered":"2024-09-14T12:07:05.568346+0000","last_clean":"2024-09-14T12:07:05.568346+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:07:05.568346+0000","last_undegraded":"2024-09-14T12:07:05.568346+0000","last_fullsized":"2024-09-14T12:07:05.568346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.560589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.268794+0000","last_change":"2024-09-14T12:10:11.268794+0000","last_active":"2024-09-14T12:10:11.268794+0000","last_peered":"2024-09-14T12:10:11.268794+0000","last_clean":"2024-09-14T12:10:11.268794+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:10:11.268794+0000","last_undegraded":"2024-09-14T12:10:11.268794+0000","last_fullsized":"2024-09-14T12:10:11.268794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.268689+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:54.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'373","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.060204+0000","last_change":"2024-09-14T12:10:03.060204+0000","last_active":"2024-09-14T12:10:03.060204+0000","last_peered":"2024-09-14T12:10:03.060204+0000","last_clean":"2024-09-14T12:10:03.060204+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:10:03.060204+0000","last_undegraded":"2024-09-14T12:10:03.060204+0000","last_fullsized":"2024-09-14T12:10:03.060204+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.060083+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.821132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":695,"num_read_kb":6455,"num_write":1238,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.291568+0000","last_change":"2024-09-14T12:10:16.291568+0000","last_active":"2024-09-14T12:10:16.291568+0000","last_peered":"2024-09-14T12:10:16.291568+0000","last_clean":"2024-09-14T12:10:16.291568+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:10:16.291568+0000","last_undegraded":"2024-09-14T12:10:16.291568+0000","last_fullsized":"2024-09-14T12:10:16.291568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.291473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:05.832571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.809552+0000","last_change":"2024-09-14T12:10:19.809552+0000","last_active":"2024-09-14T12:10:19.809552+0000","last_peered":"2024-09-14T12:10:19.809552+0000","last_clean":"2024-09-14T12:10:19.809552+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:10:19.809552+0000","last_undegraded":"2024-09-14T12:10:19.809552+0000","last_fullsized":"2024-09-14T12:10:19.809552+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.809459+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:21.052022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":912,"num_read_kb":2171,"num_write":788,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706944+0000","last_change":"2024-09-14T11:11:04.636718+0000","last_active":"2024-09-14T12:06:04.706944+0000","last_peered":"2024-09-14T12:06:04.706944+0000","last_clean":"2024-09-14T12:06:04.706944+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:06:04.706944+0000","last_undegraded":"2024-09-14T12:06:04.706944+0000","last_fullsized":"2024-09-14T12:06:04.706944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.511083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'174","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:09.681293+0000","last_change":"2024-09-14T11:11:06.650082+0000","last_active":"2024-09-14T12:07:09.681293+0000","last_peered":"2024-09-14T12:07:09.681293+0000","last_clean":"2024-09-14T12:07:09.681293+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:07:09.681293+0000","last_undegraded":"2024-09-14T12:07:09.681293+0000","last_fullsized":"2024-09-14T12:07:09.681293+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:16.276250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.138191+0000","last_change":"2024-09-14T12:10:12.138191+0000","last_active":"2024-09-14T12:10:12.138191+0000","last_peered":"2024-09-14T12:10:12.138191+0000","last_clean":"2024-09-14T12:10:12.138191+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:10:12.138191+0000","last_undegraded":"2024-09-14T12:10:12.138191+0000","last_fullsized":"2024-09-14T12:10:12.138191+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.138098+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:11.397910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.791625+0000","last_change":"2024-09-14T12:10:02.791625+0000","last_active":"2024-09-14T12:10:02.791625+0000","last_peered":"2024-09-14T12:10:02.791625+0000","last_clean":"2024-09-14T12:10:02.791625+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:10:02.791625+0000","last_undegraded":"2024-09-14T12:10:02.791625+0000","last_fullsized":"2024-09-14T12:10:02.791625+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.791485+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:30.525115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":4521,"num_write":984,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.329226+0000","last_change":"2024-09-14T12:10:15.329226+0000","last_active":"2024-09-14T12:10:15.329226+0000","last_peered":"2024-09-14T12:10:15.329226+0000","last_clean":"2024-09-14T12:10:15.329226+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:15.329226+0000","last_undegraded":"2024-09-14T12:10:15.329226+0000","last_fullsized":"2024-09-14T12:10:15.329226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.329133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:37.556057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'312","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.256716+0000","last_change":"2024-09-14T11:11:02.611238+0000","last_active":"2024-09-14T12:09:53.256716+0000","last_peered":"2024-09-14T12:09:53.256716+0000","last_clean":"2024-09-14T12:09:53.256716+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:09:53.256716+0000","last_undegraded":"2024-09-14T12:09:53.256716+0000","last_fullsized":"2024-09-14T12:09:53.256716+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:21.446639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.663956+0000","last_change":"2024-09-14T11:11:04.630801+0000","last_active":"2024-09-14T12:06:05.663956+0000","last_peered":"2024-09-14T12:06:05.663956+0000","last_clean":"2024-09-14T12:06:05.663956+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:06:05.663956+0000","last_undegraded":"2024-09-14T12:06:05.663956+0000","last_fullsized":"2024-09-14T12:06:05.663956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:37.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'187","reported_seq":714,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.586739+0000","last_change":"2024-09-14T11:11:06.647146+0000","last_active":"2024-09-14T12:07:10.586739+0000","last_peered":"2024-09-14T12:07:10.586739+0000","last_clean":"2024-09-14T12:07:10.586739+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:07:10.586739+0000","last_undegraded":"2024-09-14T12:07:10.586739+0000","last_fullsized":"2024-09-14T12:07:10.586739+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.806363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.129538+0000","last_change":"2024-09-14T12:10:14.129538+0000","last_active":"2024-09-14T12:10:14.129538+0000","last_peered":"2024-09-14T12:10:14.129538+0000","last_clean":"2024-09-14T12:10:14.129538+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:10:14.129538+0000","last_undegraded":"2024-09-14T12:10:14.129538+0000","last_fullsized":"2024-09-14T12:10:14.129538+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.129436+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:00.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'343","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.585762+0000","last_change":"2024-09-14T12:10:01.585762+0000","last_active":"2024-09-14T12:10:01.585762+0000","last_peered":"2024-09-14T12:10:01.585762+0000","last_clean":"2024-09-14T12:10:01.585762+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:10:01.585762+0000","last_undegraded":"2024-09-14T12:10:01.585762+0000","last_fullsized":"2024-09-14T12:10:01.585762+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.585672+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.361742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":125003,"num_write":1056,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570899+0000","last_change":"2024-09-14T11:11:00.610641+0000","last_active":"2024-09-14T12:06:04.570899+0000","last_peered":"2024-09-14T12:06:04.570899+0000","last_clean":"2024-09-14T12:06:04.570899+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:06:04.570899+0000","last_undegraded":"2024-09-14T12:06:04.570899+0000","last_fullsized":"2024-09-14T12:06:04.570899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:34.052721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'303","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.373148+0000","last_change":"2024-09-14T11:11:02.882152+0000","last_active":"2024-09-14T12:09:54.373148+0000","last_peered":"2024-09-14T12:09:54.373148+0000","last_clean":"2024-09-14T12:09:54.373148+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:09:54.373148+0000","last_undegraded":"2024-09-14T12:09:54.373148+0000","last_fullsized":"2024-09-14T12:09:54.373148+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:00.329236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.671401+0000","last_change":"2024-09-14T11:11:04.637717+0000","last_active":"2024-09-14T12:07:15.671401+0000","last_peered":"2024-09-14T12:07:15.671401+0000","last_clean":"2024-09-14T12:07:15.671401+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:07:15.671401+0000","last_undegraded":"2024-09-14T12:07:15.671401+0000","last_fullsized":"2024-09-14T12:07:15.671401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:00.714105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'131","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:14.877188+0000","last_change":"2024-09-14T11:11:06.644460+0000","last_active":"2024-09-14T12:09:14.877188+0000","last_peered":"2024-09-14T12:09:14.877188+0000","last_clean":"2024-09-14T12:09:14.877188+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:09:14.877188+0000","last_undegraded":"2024-09-14T12:09:14.877188+0000","last_fullsized":"2024-09-14T12:09:14.877188+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:22.358502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.689637+0000","last_change":"2024-09-14T12:10:13.689637+0000","last_active":"2024-09-14T12:10:13.689637+0000","last_peered":"2024-09-14T12:10:13.689637+0000","last_clean":"2024-09-14T12:10:13.689637+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:10:13.689637+0000","last_undegraded":"2024-09-14T12:10:13.689637+0000","last_fullsized":"2024-09-14T12:10:13.689637+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.689552+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:15.549909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'420","reported_seq":1140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.035048+0000","last_change":"2024-09-14T12:09:58.035048+0000","last_active":"2024-09-14T12:09:58.035048+0000","last_peered":"2024-09-14T12:09:58.035048+0000","last_clean":"2024-09-14T12:09:58.035048+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:09:58.035048+0000","last_undegraded":"2024-09-14T12:09:58.035048+0000","last_fullsized":"2024-09-14T12:09:58.035048+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.034944+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:02.918444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":916,"num_read_kb":75270,"num_write":1291,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.727588+0000","last_change":"2024-09-14T12:10:14.727588+0000","last_active":"2024-09-14T12:10:14.727588+0000","last_peered":"2024-09-14T12:10:14.727588+0000","last_clean":"2024-09-14T12:10:14.727588+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:10:14.727588+0000","last_undegraded":"2024-09-14T12:10:14.727588+0000","last_fullsized":"2024-09-14T12:10:14.727588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.727491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:45.961043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'107","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.580809+0000","last_change":"2024-09-14T11:11:02.882216+0000","last_active":"2024-09-14T12:07:14.580809+0000","last_peered":"2024-09-14T12:07:14.580809+0000","last_clean":"2024-09-14T12:07:14.580809+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:07:14.580809+0000","last_undegraded":"2024-09-14T12:07:14.580809+0000","last_fullsized":"2024-09-14T12:07:14.580809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:45.190894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'777","reported_seq":2377,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.392892+0000","last_change":"2024-09-14T12:10:20.392892+0000","last_active":"2024-09-14T12:10:20.392892+0000","last_peered":"2024-09-14T12:10:20.392892+0000","last_clean":"2024-09-14T12:10:20.392892+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:10:20.392892+0000","last_undegraded":"2024-09-14T12:10:20.392892+0000","last_fullsized":"2024-09-14T12:10:20.392892+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'777","last_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_deep_scrub":"265'777","last_deep_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.392801+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:46.710130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:57.505956+0000","last_change":"2024-09-14T11:11:06.646662+0000","last_active":"2024-09-14T12:07:57.505956+0000","last_peered":"2024-09-14T12:07:57.505956+0000","last_clean":"2024-09-14T12:07:57.505956+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:07:57.505956+0000","last_undegraded":"2024-09-14T12:07:57.505956+0000","last_fullsized":"2024-09-14T12:07:57.505956+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:39.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.888161+0000","last_change":"2024-09-14T12:10:11.888161+0000","last_active":"2024-09-14T12:10:11.888161+0000","last_peered":"2024-09-14T12:10:11.888161+0000","last_clean":"2024-09-14T12:10:11.888161+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:10:11.888161+0000","last_undegraded":"2024-09-14T12:10:11.888161+0000","last_fullsized":"2024-09-14T12:10:11.888161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.888043+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:26.749909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'295","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.716484+0000","last_change":"2024-09-14T12:10:06.716484+0000","last_active":"2024-09-14T12:10:06.716484+0000","last_peered":"2024-09-14T12:10:06.716484+0000","last_clean":"2024-09-14T12:10:06.716484+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:10:06.716484+0000","last_undegraded":"2024-09-14T12:10:06.716484+0000","last_fullsized":"2024-09-14T12:10:06.716484+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.716383+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:44.130365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":114075,"num_write":994,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570893+0000","last_change":"2024-09-14T11:11:00.608599+0000","last_active":"2024-09-14T12:06:04.570893+0000","last_peered":"2024-09-14T12:06:04.570893+0000","last_clean":"2024-09-14T12:06:04.570893+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:06:04.570893+0000","last_undegraded":"2024-09-14T12:06:04.570893+0000","last_fullsized":"2024-09-14T12:06:04.570893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:59.368073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'301","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.816456+0000","last_change":"2024-09-14T11:11:02.616575+0000","last_active":"2024-09-14T12:09:54.816456+0000","last_peered":"2024-09-14T12:09:54.816456+0000","last_clean":"2024-09-14T12:09:54.816456+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:09:54.816456+0000","last_undegraded":"2024-09-14T12:09:54.816456+0000","last_fullsized":"2024-09-14T12:09:54.816456+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:12.984482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":1004,"num_write":382,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:40.565340+0000","last_change":"2024-09-14T11:11:04.635106+0000","last_active":"2024-09-14T12:06:40.565340+0000","last_peered":"2024-09-14T12:06:40.565340+0000","last_clean":"2024-09-14T12:06:40.565340+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:06:40.565340+0000","last_undegraded":"2024-09-14T12:06:40.565340+0000","last_fullsized":"2024-09-14T12:06:40.565340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:25.900603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'100","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.598806+0000","last_change":"2024-09-14T11:11:06.649099+0000","last_active":"2024-09-14T12:07:54.598806+0000","last_peered":"2024-09-14T12:07:54.598806+0000","last_clean":"2024-09-14T12:07:54.598806+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:07:54.598806+0000","last_undegraded":"2024-09-14T12:07:54.598806+0000","last_fullsized":"2024-09-14T12:07:54.598806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:17.632657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.902249+0000","last_change":"2024-09-14T12:10:09.902249+0000","last_active":"2024-09-14T12:10:09.902249+0000","last_peered":"2024-09-14T12:10:09.902249+0000","last_clean":"2024-09-14T12:10:09.902249+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:10:09.902249+0000","last_undegraded":"2024-09-14T12:10:09.902249+0000","last_fullsized":"2024-09-14T12:10:09.902249+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.902123+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:17.521695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'364","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.657890+0000","last_change":"2024-09-14T12:10:09.657890+0000","last_active":"2024-09-14T12:10:09.657890+0000","last_peered":"2024-09-14T12:10:09.657890+0000","last_clean":"2024-09-14T12:10:09.657890+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:10:09.657890+0000","last_undegraded":"2024-09-14T12:10:09.657890+0000","last_fullsized":"2024-09-14T12:10:09.657890+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.657777+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:26.554926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":577,"num_read_kb":11549,"num_write":1068,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.706910+0000","last_change":"2024-09-14T11:11:00.610742+0000","last_active":"2024-09-14T12:06:04.706910+0000","last_peered":"2024-09-14T12:06:04.706910+0000","last_clean":"2024-09-14T12:06:04.706910+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:06:04.706910+0000","last_undegraded":"2024-09-14T12:06:04.706910+0000","last_fullsized":"2024-09-14T12:06:04.706910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:51.481430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":849,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.495469+0000","last_change":"2024-09-14T11:11:02.617754+0000","last_active":"2024-09-14T12:09:52.495469+0000","last_peered":"2024-09-14T12:09:52.495469+0000","last_clean":"2024-09-14T12:09:52.495469+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:09:52.495469+0000","last_undegraded":"2024-09-14T12:09:52.495469+0000","last_fullsized":"2024-09-14T12:09:52.495469+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:03.531301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44701,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1000,"num_write":364,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.390487+0000","last_change":"2024-09-14T12:10:19.390487+0000","last_active":"2024-09-14T12:10:19.390487+0000","last_peered":"2024-09-14T12:10:19.390487+0000","last_clean":"2024-09-14T12:10:19.390487+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:10:19.390487+0000","last_undegraded":"2024-09-14T12:10:19.390487+0000","last_fullsized":"2024-09-14T12:10:19.390487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.390407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:27.514718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'105","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.593163+0000","last_change":"2024-09-14T11:11:06.648742+0000","last_active":"2024-09-14T12:07:54.593163+0000","last_peered":"2024-09-14T12:07:54.593163+0000","last_clean":"2024-09-14T12:07:54.593163+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:07:54.593163+0000","last_undegraded":"2024-09-14T12:07:54.593163+0000","last_fullsized":"2024-09-14T12:07:54.593163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:19.341185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'441","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.090742+0000","last_change":"2024-09-14T12:10:13.090742+0000","last_active":"2024-09-14T12:10:13.090742+0000","last_peered":"2024-09-14T12:10:13.090742+0000","last_clean":"2024-09-14T12:10:13.090742+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:10:13.090742+0000","last_undegraded":"2024-09-14T12:10:13.090742+0000","last_fullsized":"2024-09-14T12:10:13.090742+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'441","last_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_deep_scrub":"265'441","last_deep_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.090640+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:48.381349+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25759,"num_omap_keys":101,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'351","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.065794+0000","last_change":"2024-09-14T12:10:02.065794+0000","last_active":"2024-09-14T12:10:02.065794+0000","last_peered":"2024-09-14T12:10:02.065794+0000","last_clean":"2024-09-14T12:10:02.065794+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:10:02.065794+0000","last_undegraded":"2024-09-14T12:10:02.065794+0000","last_fullsized":"2024-09-14T12:10:02.065794+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.065711+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:42.511318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":1479,"num_write":1091,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.575841+0000","last_change":"2024-09-14T11:11:00.613471+0000","last_active":"2024-09-14T12:06:39.575841+0000","last_peered":"2024-09-14T12:06:39.575841+0000","last_clean":"2024-09-14T12:06:39.575841+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:06:39.575841+0000","last_undegraded":"2024-09-14T12:06:39.575841+0000","last_fullsized":"2024-09-14T12:06:39.575841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:59.588831+0000","last_clean_scrub_stamp":"2024-09-14T11:10:59.588831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:51.522567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'237","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.260926+0000","last_change":"2024-09-14T11:11:02.620023+0000","last_active":"2024-09-14T12:09:54.260926+0000","last_peered":"2024-09-14T12:09:54.260926+0000","last_clean":"2024-09-14T12:09:54.260926+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:09:54.260926+0000","last_undegraded":"2024-09-14T12:09:54.260926+0000","last_fullsized":"2024-09-14T12:09:54.260926+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:43.942166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.570865+0000","last_change":"2024-09-14T11:11:04.636920+0000","last_active":"2024-09-14T12:06:04.570865+0000","last_peered":"2024-09-14T12:06:04.570865+0000","last_clean":"2024-09-14T12:06:04.570865+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:06:04.570865+0000","last_undegraded":"2024-09-14T12:06:04.570865+0000","last_fullsized":"2024-09-14T12:06:04.570865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:04.328783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'210","reported_seq":1682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:54.573850+0000","last_change":"2024-09-14T11:11:06.646323+0000","last_active":"2024-09-14T12:07:54.573850+0000","last_peered":"2024-09-14T12:07:54.573850+0000","last_clean":"2024-09-14T12:07:54.573850+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:07:54.573850+0000","last_undegraded":"2024-09-14T12:07:54.573850+0000","last_fullsized":"2024-09-14T12:07:54.573850+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:54.472116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.885591+0000","last_change":"2024-09-14T12:10:08.885591+0000","last_active":"2024-09-14T12:10:08.885591+0000","last_peered":"2024-09-14T12:10:08.885591+0000","last_clean":"2024-09-14T12:10:08.885591+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:10:08.885591+0000","last_undegraded":"2024-09-14T12:10:08.885591+0000","last_fullsized":"2024-09-14T12:10:08.885591+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.885498+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:11.730545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'348","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.083183+0000","last_change":"2024-09-14T12:10:04.083183+0000","last_active":"2024-09-14T12:10:04.083183+0000","last_peered":"2024-09-14T12:10:04.083183+0000","last_clean":"2024-09-14T12:10:04.083183+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:10:04.083183+0000","last_undegraded":"2024-09-14T12:10:04.083183+0000","last_fullsized":"2024-09-14T12:10:04.083183+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.083077+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:38.782611+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":4572,"num_write":1085,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.789830+0000","last_change":"2024-09-14T12:10:16.789830+0000","last_active":"2024-09-14T12:10:16.789830+0000","last_peered":"2024-09-14T12:10:16.789830+0000","last_clean":"2024-09-14T12:10:16.789830+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:10:16.789830+0000","last_undegraded":"2024-09-14T12:10:16.789830+0000","last_fullsized":"2024-09-14T12:10:16.789830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.789746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:21.212395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.427158+0000","last_change":"2024-09-14T11:11:02.615915+0000","last_active":"2024-09-14T12:09:54.427158+0000","last_peered":"2024-09-14T12:09:54.427158+0000","last_clean":"2024-09-14T12:09:54.427158+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:09:54.427158+0000","last_undegraded":"2024-09-14T12:09:54.427158+0000","last_fullsized":"2024-09-14T12:09:54.427158+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:01.596055+0000","last_clean_scrub_stamp":"2024-09-14T11:11:01.596055+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:13.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561147+0000","last_change":"2024-09-14T11:11:04.638367+0000","last_active":"2024-09-14T12:06:05.561147+0000","last_peered":"2024-09-14T12:06:05.561147+0000","last_clean":"2024-09-14T12:06:05.561147+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:06:05.561147+0000","last_undegraded":"2024-09-14T12:06:05.561147+0000","last_fullsized":"2024-09-14T12:06:05.561147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.609605+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.609605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:16.944434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:13.887875+0000","last_change":"2024-09-14T11:11:06.650184+0000","last_active":"2024-09-14T12:09:13.887875+0000","last_peered":"2024-09-14T12:09:13.887875+0000","last_clean":"2024-09-14T12:09:13.887875+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:09:13.887875+0000","last_undegraded":"2024-09-14T12:09:13.887875+0000","last_fullsized":"2024-09-14T12:09:13.887875+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.619468+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.619468+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:56.510761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.721989+0000","last_change":"2024-09-14T12:10:13.721989+0000","last_active":"2024-09-14T12:10:13.721989+0000","last_peered":"2024-09-14T12:10:13.721989+0000","last_clean":"2024-09-14T12:10:13.721989+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:10:13.721989+0000","last_undegraded":"2024-09-14T12:10:13.721989+0000","last_fullsized":"2024-09-14T12:10:13.721989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.721897+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:48.815645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'310","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.318587+0000","last_change":"2024-09-14T12:10:04.318587+0000","last_active":"2024-09-14T12:10:04.318587+0000","last_peered":"2024-09-14T12:10:04.318587+0000","last_clean":"2024-09-14T12:10:04.318587+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:10:04.318587+0000","last_undegraded":"2024-09-14T12:10:04.318587+0000","last_fullsized":"2024-09-14T12:10:04.318587+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.318456+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:42.943217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":25535,"num_write":1011,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'181","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.772140+0000","last_change":"2024-09-14T12:10:10.772140+0000","last_active":"2024-09-14T12:10:10.772140+0000","last_peered":"2024-09-14T12:10:10.772140+0000","last_clean":"2024-09-14T12:10:10.772140+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:10:10.772140+0000","last_undegraded":"2024-09-14T12:10:10.772140+0000","last_fullsized":"2024-09-14T12:10:10.772140+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'181","last_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_deep_scrub":"265'181","last_deep_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.772052+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.934951+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'354","reported_seq":1089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.544506+0000","last_change":"2024-09-14T12:10:02.544506+0000","last_active":"2024-09-14T12:10:02.544506+0000","last_peered":"2024-09-14T12:10:02.544506+0000","last_clean":"2024-09-14T12:10:02.544506+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:10:02.544506+0000","last_undegraded":"2024-09-14T12:10:02.544506+0000","last_fullsized":"2024-09-14T12:10:02.544506+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.544370+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:51.044659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":943,"num_read_kb":26386,"num_write":1247,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.681166+0000","last_change":"2024-09-14T12:10:16.681166+0000","last_active":"2024-09-14T12:10:16.681166+0000","last_peered":"2024-09-14T12:10:16.681166+0000","last_clean":"2024-09-14T12:10:16.681166+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:10:16.681166+0000","last_undegraded":"2024-09-14T12:10:16.681166+0000","last_fullsized":"2024-09-14T12:10:16.681166+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.681055+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.774592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'349","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.749863+0000","last_change":"2024-09-14T12:10:05.749863+0000","last_active":"2024-09-14T12:10:05.749863+0000","last_peered":"2024-09-14T12:10:05.749863+0000","last_clean":"2024-09-14T12:10:05.749863+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:10:05.749863+0000","last_undegraded":"2024-09-14T12:10:05.749863+0000","last_fullsized":"2024-09-14T12:10:05.749863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.749741+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:29.820426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":18057,"num_write":1029,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.781574+0000","last_change":"2024-09-14T12:10:09.781574+0000","last_active":"2024-09-14T12:10:09.781574+0000","last_peered":"2024-09-14T12:10:09.781574+0000","last_clean":"2024-09-14T12:10:09.781574+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:10:09.781574+0000","last_undegraded":"2024-09-14T12:10:09.781574+0000","last_fullsized":"2024-09-14T12:10:09.781574+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.781479+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:34.531293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'339","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.038240+0000","last_change":"2024-09-14T12:10:03.038240+0000","last_active":"2024-09-14T12:10:03.038240+0000","last_peered":"2024-09-14T12:10:03.038240+0000","last_clean":"2024-09-14T12:10:03.038240+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:10:03.038240+0000","last_undegraded":"2024-09-14T12:10:03.038240+0000","last_fullsized":"2024-09-14T12:10:03.038240+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.038108+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.535266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263498,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":9886,"num_write":1170,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.185314+0000","last_change":"2024-09-14T12:10:16.185314+0000","last_active":"2024-09-14T12:10:16.185314+0000","last_peered":"2024-09-14T12:10:16.185314+0000","last_clean":"2024-09-14T12:10:16.185314+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:10:16.185314+0000","last_undegraded":"2024-09-14T12:10:16.185314+0000","last_fullsized":"2024-09-14T12:10:16.185314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.185216+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:09.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'373","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.015350+0000","last_change":"2024-09-14T12:10:04.015350+0000","last_active":"2024-09-14T12:10:04.015350+0000","last_peered":"2024-09-14T12:10:04.015350+0000","last_clean":"2024-09-14T12:10:04.015350+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:10:04.015350+0000","last_undegraded":"2024-09-14T12:10:04.015350+0000","last_fullsized":"2024-09-14T12:10:04.015350+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.015227+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:44.163154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":11859,"num_write":1346,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'248","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.883633+0000","last_change":"2024-09-14T12:10:12.883633+0000","last_active":"2024-09-14T12:10:12.883633+0000","last_peered":"2024-09-14T12:10:12.883633+0000","last_clean":"2024-09-14T12:10:12.883633+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:10:12.883633+0000","last_undegraded":"2024-09-14T12:10:12.883633+0000","last_fullsized":"2024-09-14T12:10:12.883633+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.883551+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:51.010155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.798328+0000","last_change":"2024-09-14T12:10:03.798328+0000","last_active":"2024-09-14T12:10:03.798328+0000","last_peered":"2024-09-14T12:10:03.798328+0000","last_clean":"2024-09-14T12:10:03.798328+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:10:03.798328+0000","last_undegraded":"2024-09-14T12:10:03.798328+0000","last_fullsized":"2024-09-14T12:10:03.798328+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.798206+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:42.809623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":36459,"num_write":976,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.152436+0000","last_change":"2024-09-14T12:10:15.152436+0000","last_active":"2024-09-14T12:10:15.152436+0000","last_peered":"2024-09-14T12:10:15.152436+0000","last_clean":"2024-09-14T12:10:15.152436+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:10:15.152436+0000","last_undegraded":"2024-09-14T12:10:15.152436+0000","last_fullsized":"2024-09-14T12:10:15.152436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'107","last_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_deep_scrub":"265'107","last_deep_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.152342+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:21.250556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'380","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.594137+0000","last_change":"2024-09-14T12:10:04.594069+0000","last_active":"2024-09-14T12:10:04.594137+0000","last_peered":"2024-09-14T12:10:04.594137+0000","last_clean":"2024-09-14T12:10:04.594137+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:10:04.594137+0000","last_undegraded":"2024-09-14T12:10:04.594137+0000","last_fullsized":"2024-09-14T12:10:04.594137+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.593947+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:28.209010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":129855,"num_write":1253,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.293798+0000","last_change":"2024-09-14T12:10:10.293798+0000","last_active":"2024-09-14T12:10:10.293798+0000","last_peered":"2024-09-14T12:10:10.293798+0000","last_clean":"2024-09-14T12:10:10.293798+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:10:10.293798+0000","last_undegraded":"2024-09-14T12:10:10.293798+0000","last_fullsized":"2024-09-14T12:10:10.293798+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.293666+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:00.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'359","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.079299+0000","last_change":"2024-09-14T12:10:06.079299+0000","last_active":"2024-09-14T12:10:06.079299+0000","last_peered":"2024-09-14T12:10:06.079299+0000","last_clean":"2024-09-14T12:10:06.079299+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:10:06.079299+0000","last_undegraded":"2024-09-14T12:10:06.079299+0000","last_fullsized":"2024-09-14T12:10:06.079299+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.079163+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:31.178991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":616,"num_read_kb":2365,"num_write":1155,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.179101+0000","last_change":"2024-09-14T12:10:13.179101+0000","last_active":"2024-09-14T12:10:13.179101+0000","last_peered":"2024-09-14T12:10:13.179101+0000","last_clean":"2024-09-14T12:10:13.179101+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:10:13.179101+0000","last_undegraded":"2024-09-14T12:10:13.179101+0000","last_fullsized":"2024-09-14T12:10:13.179101+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4110","last_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_deep_scrub":"265'4110","last_deep_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.179000+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:04.053266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.698323+0000","last_change":"2024-09-14T12:10:08.698323+0000","last_active":"2024-09-14T12:10:08.698323+0000","last_peered":"2024-09-14T12:10:08.698323+0000","last_clean":"2024-09-14T12:10:08.698323+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:10:08.698323+0000","last_undegraded":"2024-09-14T12:10:08.698323+0000","last_fullsized":"2024-09-14T12:10:08.698323+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.698222+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:32.447428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":15479,"num_write":1162,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.966499+0000","last_change":"2024-09-14T12:10:14.966499+0000","last_active":"2024-09-14T12:10:14.966499+0000","last_peered":"2024-09-14T12:10:14.966499+0000","last_clean":"2024-09-14T12:10:14.966499+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:10:14.966499+0000","last_undegraded":"2024-09-14T12:10:14.966499+0000","last_fullsized":"2024-09-14T12:10:14.966499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.966397+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:03.981292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'356","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.588883+0000","last_change":"2024-09-14T12:10:05.588883+0000","last_active":"2024-09-14T12:10:05.588883+0000","last_peered":"2024-09-14T12:10:05.588883+0000","last_clean":"2024-09-14T12:10:05.588883+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:10:05.588883+0000","last_undegraded":"2024-09-14T12:10:05.588883+0000","last_fullsized":"2024-09-14T12:10:05.588883+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.588778+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:06.256609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":4745,"num_write":1096,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'456","reported_seq":1148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.620065+0000","last_change":"2024-09-14T12:10:08.620065+0000","last_active":"2024-09-14T12:10:08.620065+0000","last_peered":"2024-09-14T12:10:08.620065+0000","last_clean":"2024-09-14T12:10:08.620065+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:10:08.620065+0000","last_undegraded":"2024-09-14T12:10:08.620065+0000","last_fullsized":"2024-09-14T12:10:08.620065+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.619947+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.459276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'551","reported_seq":1361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.640999+0000","last_change":"2024-09-14T12:10:11.640999+0000","last_active":"2024-09-14T12:10:11.640999+0000","last_peered":"2024-09-14T12:10:11.640999+0000","last_clean":"2024-09-14T12:10:11.640999+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:10:11.640999+0000","last_undegraded":"2024-09-14T12:10:11.640999+0000","last_fullsized":"2024-09-14T12:10:11.640999+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'551","last_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_deep_scrub":"265'551","last_deep_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.640830+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:36.282096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1371,"num_read_kb":53620,"num_write":1733,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'708","reported_seq":1563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.931892+0000","last_change":"2024-09-14T12:10:13.931892+0000","last_active":"2024-09-14T12:10:13.931892+0000","last_peered":"2024-09-14T12:10:13.931892+0000","last_clean":"2024-09-14T12:10:13.931892+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:10:13.931892+0000","last_undegraded":"2024-09-14T12:10:13.931892+0000","last_fullsized":"2024-09-14T12:10:13.931892+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'708","last_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_deep_scrub":"265'708","last_deep_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.931809+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:18.907786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'328","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.060187+0000","last_change":"2024-09-14T12:10:06.060187+0000","last_active":"2024-09-14T12:10:06.060187+0000","last_peered":"2024-09-14T12:10:06.060187+0000","last_clean":"2024-09-14T12:10:06.060187+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:10:06.060187+0000","last_undegraded":"2024-09-14T12:10:06.060187+0000","last_fullsized":"2024-09-14T12:10:06.060187+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.060039+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:17.060911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10603,"num_write":1037,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.485953+0000","last_change":"2024-09-14T12:10:17.485953+0000","last_active":"2024-09-14T12:10:17.485953+0000","last_peered":"2024-09-14T12:10:17.485953+0000","last_clean":"2024-09-14T12:10:17.485953+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:10:17.485953+0000","last_undegraded":"2024-09-14T12:10:17.485953+0000","last_fullsized":"2024-09-14T12:10:17.485953+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.485872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:10.610144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'348","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.246678+0000","last_change":"2024-09-14T12:10:06.246678+0000","last_active":"2024-09-14T12:10:06.246678+0000","last_peered":"2024-09-14T12:10:06.246678+0000","last_clean":"2024-09-14T12:10:06.246678+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:10:06.246678+0000","last_undegraded":"2024-09-14T12:10:06.246678+0000","last_fullsized":"2024-09-14T12:10:06.246678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.246522+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:24.006671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":12533,"num_write":1141,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.138876+0000","last_change":"2024-09-14T12:10:11.138876+0000","last_active":"2024-09-14T12:10:11.138876+0000","last_peered":"2024-09-14T12:10:11.138876+0000","last_clean":"2024-09-14T12:10:11.138876+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:10:11.138876+0000","last_undegraded":"2024-09-14T12:10:11.138876+0000","last_fullsized":"2024-09-14T12:10:11.138876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.138758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.430506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'401","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.436072+0000","last_change":"2024-09-14T12:10:11.436072+0000","last_active":"2024-09-14T12:10:11.436072+0000","last_peered":"2024-09-14T12:10:11.436072+0000","last_clean":"2024-09-14T12:10:11.436072+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:10:11.436072+0000","last_undegraded":"2024-09-14T12:10:11.436072+0000","last_fullsized":"2024-09-14T12:10:11.436072+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.435967+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.312166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":13606,"num_write":1190,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.197307+0000","last_change":"2024-09-14T12:10:17.197307+0000","last_active":"2024-09-14T12:10:17.197307+0000","last_peered":"2024-09-14T12:10:17.197307+0000","last_clean":"2024-09-14T12:10:17.197307+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:10:17.197307+0000","last_undegraded":"2024-09-14T12:10:17.197307+0000","last_fullsized":"2024-09-14T12:10:17.197307+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.197213+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:00.401598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.636571+0000","last_change":"2024-09-14T12:10:07.636571+0000","last_active":"2024-09-14T12:10:07.636571+0000","last_peered":"2024-09-14T12:10:07.636571+0000","last_clean":"2024-09-14T12:10:07.636571+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:10:07.636571+0000","last_undegraded":"2024-09-14T12:10:07.636571+0000","last_fullsized":"2024-09-14T12:10:07.636571+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.636466+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:24.340392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":59967,"num_write":1134,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'394","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.458471+0000","last_change":"2024-09-14T12:10:15.458471+0000","last_active":"2024-09-14T12:10:15.458471+0000","last_peered":"2024-09-14T12:10:15.458471+0000","last_clean":"2024-09-14T12:10:15.458471+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:10:15.458471+0000","last_undegraded":"2024-09-14T12:10:15.458471+0000","last_fullsized":"2024-09-14T12:10:15.458471+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.458379+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:39.482027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3561,"num_omap_keys":15,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'331","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.715505+0000","last_change":"2024-09-14T12:10:07.715505+0000","last_active":"2024-09-14T12:10:07.715505+0000","last_peered":"2024-09-14T12:10:07.715505+0000","last_clean":"2024-09-14T12:10:07.715505+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:10:07.715505+0000","last_undegraded":"2024-09-14T12:10:07.715505+0000","last_fullsized":"2024-09-14T12:10:07.715505+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.715389+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:27.252175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":22222,"num_write":1088,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'360","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.634166+0000","last_change":"2024-09-14T12:10:10.634166+0000","last_active":"2024-09-14T12:10:10.634166+0000","last_peered":"2024-09-14T12:10:10.634166+0000","last_clean":"2024-09-14T12:10:10.634166+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:10:10.634166+0000","last_undegraded":"2024-09-14T12:10:10.634166+0000","last_fullsized":"2024-09-14T12:10:10.634166+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.634055+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:17.564902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":41589,"num_write":1192,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.262913+0000","last_change":"2024-09-14T12:10:15.262913+0000","last_active":"2024-09-14T12:10:15.262913+0000","last_peered":"2024-09-14T12:10:15.262913+0000","last_clean":"2024-09-14T12:10:15.262913+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:10:15.262913+0000","last_undegraded":"2024-09-14T12:10:15.262913+0000","last_fullsized":"2024-09-14T12:10:15.262913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'88","last_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_deep_scrub":"265'88","last_deep_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.262821+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:29.014884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'467","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.799973+0000","last_change":"2024-09-14T12:10:06.799973+0000","last_active":"2024-09-14T12:10:06.799973+0000","last_peered":"2024-09-14T12:10:06.799973+0000","last_clean":"2024-09-14T12:10:06.799973+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:10:06.799973+0000","last_undegraded":"2024-09-14T12:10:06.799973+0000","last_fullsized":"2024-09-14T12:10:06.799973+0000","mapping_epoch":38,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'467","last_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_deep_scrub":"265'467","last_deep_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.799866+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.839357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":936,"num_read_kb":7353,"num_write":1336,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.681579+0000","last_change":"2024-09-14T12:10:18.681579+0000","last_active":"2024-09-14T12:10:18.681579+0000","last_peered":"2024-09-14T12:10:18.681579+0000","last_clean":"2024-09-14T12:10:18.681579+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:10:18.681579+0000","last_undegraded":"2024-09-14T12:10:18.681579+0000","last_fullsized":"2024-09-14T12:10:18.681579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.681470+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:22.840994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1690,"ondisk_log_size":1690,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":595,"ondisk_log_size":595,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1638457,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":18085,"num_read_kb":37656,"num_write":15239,"num_write_kb":11977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":569158,"num_omap_keys":1284,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2225,"ondisk_log_size":2225,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36258,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4345,"ondisk_log_size":4345,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":32687811,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44407,"num_read_kb":2049088,"num_write":73495,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50442240,"data_stored":50442240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3782,"ondisk_log_size":3782,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":224799,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":204319,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510161,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280296,"kb_used_data":10328,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94091544,"statfs":{"total":96636764160,"available":96349741056,"internally_reserved":0,"allocated":10575872,"data_stored":8512576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510161,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149360,"kb_used_data":9952,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":10190848,"data_stored":8104359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510161,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275176,"kb_used_data":14936,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94096664,"statfs":{"total":96636764160,"available":96354983936,"internally_reserved":0,"allocated":15294464,"data_stored":13168761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":266467781},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542864,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296732,"kb_used_data":12876,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075108,"statfs":{"total":96636764160,"available":96332910592,"internally_reserved":0,"allocated":13185024,"data_stored":11050510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":290650571},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542865,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144132,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94227708,"statfs":{"total":96636764160,"available":96489172992,"internally_reserved":0,"allocated":9097216,"data_stored":6957133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542863,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126512,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94245328,"statfs":{"total":96636764160,"available":96507215872,"internally_reserved":0,"allocated":15171584,"data_stored":13135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542865,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280256,"kb_used_data":6192,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94091584,"statfs":{"total":96636764160,"available":96349782016,"internally_reserved":0,"allocated":6340608,"data_stored":4233902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542865,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91908,"kb_used_data":6644,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279932,"statfs":{"total":96636764160,"available":96542650368,"internally_reserved":0,"allocated":6803456,"data_stored":4759690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10289152,"data_stored":10289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":5816320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2473984,"data_stored":2473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":1945600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10850304,"data_stored":10850304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4669440,"data_stored":4669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8171520,"data_stored":8171520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.078 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.079 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.080 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.081 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.082 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.083 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.084 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.085 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.086 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.087 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.088 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.089 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.090 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:10:57.585086+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=57, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.091 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.092 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.093 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.094 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.095 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.096 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.097 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.098 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.099 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.100 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.100 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.100 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.100 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.100 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.100 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.101 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.102 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:10:59.588831+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.103 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:11:01.596055+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=1, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.104 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:11:03.609605+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.104 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:11:05.619468+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:22.104 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:10:42.106 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:10:42.455 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:10:42.466 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:10:42.468 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2058,"stamp":"2024-09-14T12:10:40.862865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34933529,"num_objects":607,"num_object_clones":0,"num_object_copies":1495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":607,"num_whiteouts":0,"num_read":199663,"num_read_kb":2633567,"num_write":147738,"num_write_kb":2509949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752711,"num_omap_keys":1800,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13607,"ondisk_log_size":13607,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1631892,"kb_used_data":84628,"kb_used_omap":12,"kb_used_meta":1547123,"kb_avail":753342828,"statfs":{"total":773094113280,"available":771423055872,"internally_reserved":0,"allocated":86659072,"data_stored":69922534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1584254513},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121613,"num_omap_keys":303,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005375"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.714132+0000","last_change":"2024-09-14T11:44:25.351991+0000","last_active":"2024-09-14T12:06:54.714132+0000","last_peered":"2024-09-14T12:06:54.714132+0000","last_clean":"2024-09-14T12:06:54.714132+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:06:54.714132+0000","last_undegraded":"2024-09-14T12:06:54.714132+0000","last_fullsized":"2024-09-14T12:06:54.714132+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:51.739360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.707626+0000","last_change":"2024-09-14T11:28:36.255342+0000","last_active":"2024-09-14T12:06:09.707626+0000","last_peered":"2024-09-14T12:06:09.707626+0000","last_clean":"2024-09-14T12:06:09.707626+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:06:09.707626+0000","last_undegraded":"2024-09-14T12:06:09.707626+0000","last_fullsized":"2024-09-14T12:06:09.707626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.129757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:04.673633+0000","last_change":"2024-09-14T11:28:33.234582+0000","last_active":"2024-09-14T12:06:04.673633+0000","last_peered":"2024-09-14T12:06:04.673633+0000","last_clean":"2024-09-14T12:06:04.673633+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:06:04.673633+0000","last_undegraded":"2024-09-14T12:06:04.673633+0000","last_fullsized":"2024-09-14T12:06:04.673633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.203877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":86,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:10.569061+0000","last_change":"2024-09-14T11:25:27.952561+0000","last_active":"2024-09-14T12:07:10.569061+0000","last_peered":"2024-09-14T12:07:10.569061+0000","last_clean":"2024-09-14T12:07:10.569061+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:07:10.569061+0000","last_undegraded":"2024-09-14T12:07:10.569061+0000","last_fullsized":"2024-09-14T12:07:10.569061+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:17.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.669413+0000","last_change":"2024-09-14T12:10:33.669413+0000","last_active":"2024-09-14T12:10:33.669413+0000","last_peered":"2024-09-14T12:10:33.669413+0000","last_clean":"2024-09-14T12:10:33.669413+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:10:33.669413+0000","last_undegraded":"2024-09-14T12:10:33.669413+0000","last_fullsized":"2024-09-14T12:10:33.669413+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:33.669320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:33.669320+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.669320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:15.038665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593518+0000","last_change":"2024-09-14T11:28:36.260521+0000","last_active":"2024-09-14T12:08:39.593518+0000","last_peered":"2024-09-14T12:08:39.593518+0000","last_clean":"2024-09-14T12:08:39.593518+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:08:39.593518+0000","last_undegraded":"2024-09-14T12:08:39.593518+0000","last_fullsized":"2024-09-14T12:08:39.593518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:16.049764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.981579+0000","last_change":"2024-09-14T12:10:35.981579+0000","last_active":"2024-09-14T12:10:35.981579+0000","last_peered":"2024-09-14T12:10:35.981579+0000","last_clean":"2024-09-14T12:10:35.981579+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:10:35.981579+0000","last_undegraded":"2024-09-14T12:10:35.981579+0000","last_fullsized":"2024-09-14T12:10:35.981579+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:35.981488+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:35.981488+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.981488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:20.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":223,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.698899+0000","last_change":"2024-09-14T12:10:24.698899+0000","last_active":"2024-09-14T12:10:24.698899+0000","last_peered":"2024-09-14T12:10:24.698899+0000","last_clean":"2024-09-14T12:10:24.698899+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:10:24.698899+0000","last_undegraded":"2024-09-14T12:10:24.698899+0000","last_fullsized":"2024-09-14T12:10:24.698899+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-14T12:10:24.698806+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-14T12:10:24.698806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.698806+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:23.603844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.638057+0000","last_change":"2024-09-14T12:10:37.638057+0000","last_active":"2024-09-14T12:10:37.638057+0000","last_peered":"2024-09-14T12:10:37.638057+0000","last_clean":"2024-09-14T12:10:37.638057+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:10:37.638057+0000","last_undegraded":"2024-09-14T12:10:37.638057+0000","last_fullsized":"2024-09-14T12:10:37.638057+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:37.637968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:37.637968+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.637968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:47.338696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'14","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.082866+0000","last_change":"2024-09-14T11:28:36.367262+0000","last_active":"2024-09-14T12:09:54.082866+0000","last_peered":"2024-09-14T12:09:54.082866+0000","last_clean":"2024-09-14T12:09:54.082866+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:09:54.082866+0000","last_undegraded":"2024-09-14T12:09:54.082866+0000","last_fullsized":"2024-09-14T12:09:54.082866+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":33792,"num_write":24,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.681455+0000","last_change":"2024-09-14T12:10:29.681373+0000","last_active":"2024-09-14T12:10:29.681455+0000","last_peered":"2024-09-14T12:10:29.681455+0000","last_clean":"2024-09-14T12:10:29.681455+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:10:29.681455+0000","last_undegraded":"2024-09-14T12:10:29.681455+0000","last_fullsized":"2024-09-14T12:10:29.681455+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.681271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.681271+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.681271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:16.281265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:00.574709+0000","last_change":"2024-09-14T11:25:27.940069+0000","last_active":"2024-09-14T12:08:00.574709+0000","last_peered":"2024-09-14T12:08:00.574709+0000","last_clean":"2024-09-14T12:08:00.574709+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:08:00.574709+0000","last_undegraded":"2024-09-14T12:08:00.574709+0000","last_fullsized":"2024-09-14T12:08:00.574709+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:19.675494+0000","last_change":"2024-09-14T11:44:25.356282+0000","last_active":"2024-09-14T12:06:19.675494+0000","last_peered":"2024-09-14T12:06:19.675494+0000","last_clean":"2024-09-14T12:06:19.675494+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:06:19.675494+0000","last_undegraded":"2024-09-14T12:06:19.675494+0000","last_fullsized":"2024-09-14T12:06:19.675494+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:56.126294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.127142+0000","last_change":"2024-09-14T11:28:36.366276+0000","last_active":"2024-09-14T12:09:53.127142+0000","last_peered":"2024-09-14T12:09:53.127142+0000","last_clean":"2024-09-14T12:09:53.127142+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:09:53.127142+0000","last_undegraded":"2024-09-14T12:09:53.127142+0000","last_fullsized":"2024-09-14T12:09:53.127142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:40.126728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.420173+0000","last_change":"2024-09-14T11:28:33.228558+0000","last_active":"2024-09-14T12:09:52.420173+0000","last_peered":"2024-09-14T12:09:52.420173+0000","last_clean":"2024-09-14T12:09:52.420173+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:09:52.420173+0000","last_undegraded":"2024-09-14T12:09:52.420173+0000","last_fullsized":"2024-09-14T12:09:52.420173+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:59.687224+0000","last_change":"2024-09-14T11:25:27.953674+0000","last_active":"2024-09-14T12:07:59.687224+0000","last_peered":"2024-09-14T12:07:59.687224+0000","last_clean":"2024-09-14T12:07:59.687224+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:07:59.687224+0000","last_undegraded":"2024-09-14T12:07:59.687224+0000","last_fullsized":"2024-09-14T12:07:59.687224+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.691712+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:08:34.691712+0000","last_peered":"2024-09-14T12:08:34.691712+0000","last_clean":"2024-09-14T12:08:34.691712+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:08:34.691712+0000","last_undegraded":"2024-09-14T12:08:34.691712+0000","last_fullsized":"2024-09-14T12:08:34.691712+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:49.741974+0000","last_change":"2024-09-14T11:28:36.259291+0000","last_active":"2024-09-14T12:09:49.741974+0000","last_peered":"2024-09-14T12:09:49.741974+0000","last_clean":"2024-09-14T12:09:49.741974+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:09:49.741974+0000","last_undegraded":"2024-09-14T12:09:49.741974+0000","last_fullsized":"2024-09-14T12:09:49.741974+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:04.701036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:15.569572+0000","last_change":"2024-09-14T11:28:33.231526+0000","last_active":"2024-09-14T12:07:15.569572+0000","last_peered":"2024-09-14T12:07:15.569572+0000","last_clean":"2024-09-14T12:07:15.569572+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:07:15.569572+0000","last_undegraded":"2024-09-14T12:07:15.569572+0000","last_fullsized":"2024-09-14T12:07:15.569572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:57.361260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:59.687179+0000","last_change":"2024-09-14T11:25:27.952436+0000","last_active":"2024-09-14T12:07:59.687179+0000","last_peered":"2024-09-14T12:07:59.687179+0000","last_clean":"2024-09-14T12:07:59.687179+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:07:59.687179+0000","last_undegraded":"2024-09-14T12:07:59.687179+0000","last_fullsized":"2024-09-14T12:07:59.687179+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.011252+0000","last_change":"2024-09-14T12:10:40.011252+0000","last_active":"2024-09-14T12:10:40.011252+0000","last_peered":"2024-09-14T12:10:40.011252+0000","last_clean":"2024-09-14T12:10:40.011252+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:10:40.011252+0000","last_undegraded":"2024-09-14T12:10:40.011252+0000","last_fullsized":"2024-09-14T12:10:40.011252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:40.011161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:40.011161+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.011161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.352660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.627784+0000","last_change":"2024-09-14T12:10:34.627784+0000","last_active":"2024-09-14T12:10:34.627784+0000","last_peered":"2024-09-14T12:10:34.627784+0000","last_clean":"2024-09-14T12:10:34.627784+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:10:34.627784+0000","last_undegraded":"2024-09-14T12:10:34.627784+0000","last_fullsized":"2024-09-14T12:10:34.627784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:34.627690+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:34.627690+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.627690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:11.119124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582351+0000","last_change":"2024-09-14T11:28:33.230634+0000","last_active":"2024-09-14T12:07:24.582351+0000","last_peered":"2024-09-14T12:07:24.582351+0000","last_clean":"2024-09-14T12:07:24.582351+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:07:24.582351+0000","last_undegraded":"2024-09-14T12:07:24.582351+0000","last_fullsized":"2024-09-14T12:07:24.582351+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:55.201670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.472213+0000","last_change":"2024-09-14T12:10:27.472153+0000","last_active":"2024-09-14T12:10:27.472213+0000","last_peered":"2024-09-14T12:10:27.472213+0000","last_clean":"2024-09-14T12:10:27.472213+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:10:27.472213+0000","last_undegraded":"2024-09-14T12:10:27.472213+0000","last_fullsized":"2024-09-14T12:10:27.472213+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-14T12:10:27.472026+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-14T12:10:27.472026+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.472026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:49.059641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578552+0000","last_change":"2024-09-14T11:44:25.353198+0000","last_active":"2024-09-14T12:06:54.578552+0000","last_peered":"2024-09-14T12:06:54.578552+0000","last_clean":"2024-09-14T12:06:54.578552+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:06:54.578552+0000","last_undegraded":"2024-09-14T12:06:54.578552+0000","last_fullsized":"2024-09-14T12:06:54.578552+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:09.499820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.634693+0000","last_change":"2024-09-14T12:10:35.634693+0000","last_active":"2024-09-14T12:10:35.634693+0000","last_peered":"2024-09-14T12:10:35.634693+0000","last_clean":"2024-09-14T12:10:35.634693+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:10:35.634693+0000","last_undegraded":"2024-09-14T12:10:35.634693+0000","last_fullsized":"2024-09-14T12:10:35.634693+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:35.634583+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:35.634583+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.634583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:42.017222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.592790+0000","last_change":"2024-09-14T11:28:33.231811+0000","last_active":"2024-09-14T12:08:34.592790+0000","last_peered":"2024-09-14T12:08:34.592790+0000","last_clean":"2024-09-14T12:08:34.592790+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:08:34.592790+0000","last_undegraded":"2024-09-14T12:08:34.592790+0000","last_fullsized":"2024-09-14T12:08:34.592790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:14.016741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.235452+0000","last_change":"2024-09-14T12:10:40.235452+0000","last_active":"2024-09-14T12:10:40.235452+0000","last_peered":"2024-09-14T12:10:40.235452+0000","last_clean":"2024-09-14T12:10:40.235452+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:10:40.235452+0000","last_undegraded":"2024-09-14T12:10:40.235452+0000","last_fullsized":"2024-09-14T12:10:40.235452+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-14T12:10:40.235367+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-14T12:10:40.235367+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.235367+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:55.287767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578614+0000","last_change":"2024-09-14T11:44:25.355575+0000","last_active":"2024-09-14T12:06:54.578614+0000","last_peered":"2024-09-14T12:06:54.578614+0000","last_clean":"2024-09-14T12:06:54.578614+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:06:54.578614+0000","last_undegraded":"2024-09-14T12:06:54.578614+0000","last_fullsized":"2024-09-14T12:06:54.578614+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:45.828628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674310+0000","last_change":"2024-09-14T11:28:36.254791+0000","last_active":"2024-09-14T12:06:09.674310+0000","last_peered":"2024-09-14T12:06:09.674310+0000","last_clean":"2024-09-14T12:06:09.674310+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:06:09.674310+0000","last_undegraded":"2024-09-14T12:06:09.674310+0000","last_fullsized":"2024-09-14T12:06:09.674310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:16.546392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:05.561126+0000","last_change":"2024-09-14T11:28:33.230741+0000","last_active":"2024-09-14T12:06:05.561126+0000","last_peered":"2024-09-14T12:06:05.561126+0000","last_clean":"2024-09-14T12:06:05.561126+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:06:05.561126+0000","last_undegraded":"2024-09-14T12:06:05.561126+0000","last_fullsized":"2024-09-14T12:06:05.561126+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:45.191280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.894280+0000","last_change":"2024-09-14T12:10:26.894280+0000","last_active":"2024-09-14T12:10:26.894280+0000","last_peered":"2024-09-14T12:10:26.894280+0000","last_clean":"2024-09-14T12:10:26.894280+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:10:26.894280+0000","last_undegraded":"2024-09-14T12:10:26.894280+0000","last_fullsized":"2024-09-14T12:10:26.894280+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T12:10:26.894190+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T12:10:26.894190+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.894190+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:35.886806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:45.674483+0000","last_change":"2024-09-14T11:44:25.351716+0000","last_active":"2024-09-14T12:07:45.674483+0000","last_peered":"2024-09-14T12:07:45.674483+0000","last_clean":"2024-09-14T12:07:45.674483+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:07:45.674483+0000","last_undegraded":"2024-09-14T12:07:45.674483+0000","last_fullsized":"2024-09-14T12:07:45.674483+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210853+0000","last_change":"2024-09-14T11:28:36.369321+0000","last_active":"2024-09-14T12:09:54.210853+0000","last_peered":"2024-09-14T12:09:54.210853+0000","last_clean":"2024-09-14T12:09:54.210853+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:09:54.210853+0000","last_undegraded":"2024-09-14T12:09:54.210853+0000","last_fullsized":"2024-09-14T12:09:54.210853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:22.989447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:19.726796+0000","last_change":"2024-09-14T11:28:33.231360+0000","last_active":"2024-09-14T12:08:19.726796+0000","last_peered":"2024-09-14T12:08:19.726796+0000","last_clean":"2024-09-14T12:08:19.726796+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:08:19.726796+0000","last_undegraded":"2024-09-14T12:08:19.726796+0000","last_fullsized":"2024-09-14T12:08:19.726796+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:35.564851+0000","last_change":"2024-09-14T11:25:27.949982+0000","last_active":"2024-09-14T12:06:35.564851+0000","last_peered":"2024-09-14T12:06:35.564851+0000","last_clean":"2024-09-14T12:06:35.564851+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:06:35.564851+0000","last_undegraded":"2024-09-14T12:06:35.564851+0000","last_fullsized":"2024-09-14T12:06:35.564851+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:12.193530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.666439+0000","last_change":"2024-09-14T12:10:32.666439+0000","last_active":"2024-09-14T12:10:32.666439+0000","last_peered":"2024-09-14T12:10:32.666439+0000","last_clean":"2024-09-14T12:10:32.666439+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:10:32.666439+0000","last_undegraded":"2024-09-14T12:10:32.666439+0000","last_fullsized":"2024-09-14T12:10:32.666439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:32.666336+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:32.666336+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.666336+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.413521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674369+0000","last_change":"2024-09-14T11:28:36.367601+0000","last_active":"2024-09-14T12:06:09.674369+0000","last_peered":"2024-09-14T12:06:09.674369+0000","last_clean":"2024-09-14T12:06:09.674369+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:06:09.674369+0000","last_undegraded":"2024-09-14T12:06:09.674369+0000","last_fullsized":"2024-09-14T12:06:09.674369+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:47.572025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:14.581225+0000","last_change":"2024-09-14T11:28:33.228389+0000","last_active":"2024-09-14T12:07:14.581225+0000","last_peered":"2024-09-14T12:07:14.581225+0000","last_clean":"2024-09-14T12:07:14.581225+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:07:14.581225+0000","last_undegraded":"2024-09-14T12:07:14.581225+0000","last_fullsized":"2024-09-14T12:07:14.581225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:11.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:34.677357+0000","last_change":"2024-09-14T11:25:27.953781+0000","last_active":"2024-09-14T12:06:34.677357+0000","last_peered":"2024-09-14T12:06:34.677357+0000","last_clean":"2024-09-14T12:06:34.677357+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:06:34.677357+0000","last_undegraded":"2024-09-14T12:06:34.677357+0000","last_fullsized":"2024-09-14T12:06:34.677357+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:48.652754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585504+0000","last_change":"2024-09-14T11:44:25.348811+0000","last_active":"2024-09-14T12:07:44.585504+0000","last_peered":"2024-09-14T12:07:44.585504+0000","last_clean":"2024-09-14T12:07:44.585504+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:07:44.585504+0000","last_undegraded":"2024-09-14T12:07:44.585504+0000","last_fullsized":"2024-09-14T12:07:44.585504+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.682708+0000","last_change":"2024-09-14T11:28:36.369256+0000","last_active":"2024-09-14T12:07:19.682708+0000","last_peered":"2024-09-14T12:07:19.682708+0000","last_clean":"2024-09-14T12:07:19.682708+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:07:19.682708+0000","last_undegraded":"2024-09-14T12:07:19.682708+0000","last_fullsized":"2024-09-14T12:07:19.682708+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:54.707659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.634499+0000","last_change":"2024-09-14T12:10:28.634499+0000","last_active":"2024-09-14T12:10:28.634499+0000","last_peered":"2024-09-14T12:10:28.634499+0000","last_clean":"2024-09-14T12:10:28.634499+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:10:28.634499+0000","last_undegraded":"2024-09-14T12:10:28.634499+0000","last_fullsized":"2024-09-14T12:10:28.634499+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.634405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.634405+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.634405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:48.158772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.651452+0000","last_change":"2024-09-14T12:10:25.651452+0000","last_active":"2024-09-14T12:10:25.651452+0000","last_peered":"2024-09-14T12:10:25.651452+0000","last_clean":"2024-09-14T12:10:25.651452+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:10:25.651452+0000","last_undegraded":"2024-09-14T12:10:25.651452+0000","last_fullsized":"2024-09-14T12:10:25.651452+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-14T12:10:25.651333+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-14T12:10:25.651333+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.651333+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:53.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.721796+0000","last_change":"2024-09-14T11:44:25.352981+0000","last_active":"2024-09-14T12:07:44.721796+0000","last_peered":"2024-09-14T12:07:44.721796+0000","last_clean":"2024-09-14T12:07:44.721796+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:07:44.721796+0000","last_undegraded":"2024-09-14T12:07:44.721796+0000","last_fullsized":"2024-09-14T12:07:44.721796+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581671+0000","last_change":"2024-09-14T11:28:36.261453+0000","last_active":"2024-09-14T12:07:19.581671+0000","last_peered":"2024-09-14T12:07:19.581671+0000","last_clean":"2024-09-14T12:07:19.581671+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:07:19.581671+0000","last_undegraded":"2024-09-14T12:07:19.581671+0000","last_fullsized":"2024-09-14T12:07:19.581671+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:37.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:40.588548+0000","last_change":"2024-09-14T11:28:33.226734+0000","last_active":"2024-09-14T12:09:40.588548+0000","last_peered":"2024-09-14T12:09:40.588548+0000","last_clean":"2024-09-14T12:09:40.588548+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:09:40.588548+0000","last_undegraded":"2024-09-14T12:09:40.588548+0000","last_fullsized":"2024-09-14T12:09:40.588548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:28.817130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584878+0000","last_change":"2024-09-14T11:25:27.950879+0000","last_active":"2024-09-14T12:07:39.584878+0000","last_peered":"2024-09-14T12:07:39.584878+0000","last_clean":"2024-09-14T12:07:39.584878+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:07:39.584878+0000","last_undegraded":"2024-09-14T12:07:39.584878+0000","last_fullsized":"2024-09-14T12:07:39.584878+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:13.451590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674442+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:06:09.674442+0000","last_peered":"2024-09-14T12:06:09.674442+0000","last_clean":"2024-09-14T12:06:09.674442+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:06:09.674442+0000","last_undegraded":"2024-09-14T12:06:09.674442+0000","last_fullsized":"2024-09-14T12:06:09.674442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.648826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.064545+0000","last_change":"2024-09-14T12:10:38.064545+0000","last_active":"2024-09-14T12:10:38.064545+0000","last_peered":"2024-09-14T12:10:38.064545+0000","last_clean":"2024-09-14T12:10:38.064545+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:10:38.064545+0000","last_undegraded":"2024-09-14T12:10:38.064545+0000","last_fullsized":"2024-09-14T12:10:38.064545+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:38.064437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:38.064437+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.064437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:11.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.076970+0000","last_change":"2024-09-14T12:10:38.076970+0000","last_active":"2024-09-14T12:10:38.076970+0000","last_peered":"2024-09-14T12:10:38.076970+0000","last_clean":"2024-09-14T12:10:38.076970+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:10:38.076970+0000","last_undegraded":"2024-09-14T12:10:38.076970+0000","last_fullsized":"2024-09-14T12:10:38.076970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:38.076864+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:38.076864+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.076864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:26.235717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":236,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.518682+0000","last_change":"2024-09-14T12:10:38.518682+0000","last_active":"2024-09-14T12:10:38.518682+0000","last_peered":"2024-09-14T12:10:38.518682+0000","last_clean":"2024-09-14T12:10:38.518682+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:10:38.518682+0000","last_undegraded":"2024-09-14T12:10:38.518682+0000","last_fullsized":"2024-09-14T12:10:38.518682+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'62","last_scrub_stamp":"2024-09-14T12:10:38.518602+0000","last_deep_scrub":"265'62","last_deep_scrub_stamp":"2024-09-14T12:10:38.518602+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.518602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:45.752697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:10.561924+0000","last_change":"2024-09-14T11:44:25.355586+0000","last_active":"2024-09-14T12:06:10.561924+0000","last_peered":"2024-09-14T12:06:10.561924+0000","last_clean":"2024-09-14T12:06:10.561924+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:06:10.561924+0000","last_undegraded":"2024-09-14T12:06:10.561924+0000","last_fullsized":"2024-09-14T12:06:10.561924+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:15.135525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.015006+0000","last_change":"2024-09-14T12:10:37.015006+0000","last_active":"2024-09-14T12:10:37.015006+0000","last_peered":"2024-09-14T12:10:37.015006+0000","last_clean":"2024-09-14T12:10:37.015006+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:10:37.015006+0000","last_undegraded":"2024-09-14T12:10:37.015006+0000","last_fullsized":"2024-09-14T12:10:37.015006+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:37.014890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:37.014890+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.014890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.635990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.689131+0000","last_change":"2024-09-14T11:28:33.229372+0000","last_active":"2024-09-14T12:08:14.689131+0000","last_peered":"2024-09-14T12:08:14.689131+0000","last_clean":"2024-09-14T12:08:14.689131+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:08:14.689131+0000","last_undegraded":"2024-09-14T12:08:14.689131+0000","last_fullsized":"2024-09-14T12:08:14.689131+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.245202+0000","last_change":"2024-09-14T12:10:39.245202+0000","last_active":"2024-09-14T12:10:39.245202+0000","last_peered":"2024-09-14T12:10:39.245202+0000","last_clean":"2024-09-14T12:10:39.245202+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:10:39.245202+0000","last_undegraded":"2024-09-14T12:10:39.245202+0000","last_fullsized":"2024-09-14T12:10:39.245202+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'49","last_scrub_stamp":"2024-09-14T12:10:39.245115+0000","last_deep_scrub":"262'49","last_deep_scrub_stamp":"2024-09-14T12:10:39.245115+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.245115+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:07.893173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:55.574038+0000","last_change":"2024-09-14T11:44:25.351774+0000","last_active":"2024-09-14T12:07:55.574038+0000","last_peered":"2024-09-14T12:07:55.574038+0000","last_clean":"2024-09-14T12:07:55.574038+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:07:55.574038+0000","last_undegraded":"2024-09-14T12:07:55.574038+0000","last_fullsized":"2024-09-14T12:07:55.574038+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.211604+0000","last_change":"2024-09-14T11:28:36.257478+0000","last_active":"2024-09-14T12:09:54.211604+0000","last_peered":"2024-09-14T12:09:54.211604+0000","last_clean":"2024-09-14T12:09:54.211604+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:09:54.211604+0000","last_undegraded":"2024-09-14T12:09:54.211604+0000","last_fullsized":"2024-09-14T12:09:54.211604+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.524514+0000","last_change":"2024-09-14T12:10:30.524447+0000","last_active":"2024-09-14T12:10:30.524514+0000","last_peered":"2024-09-14T12:10:30.524514+0000","last_clean":"2024-09-14T12:10:30.524514+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:10:30.524514+0000","last_undegraded":"2024-09-14T12:10:30.524514+0000","last_fullsized":"2024-09-14T12:10:30.524514+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:30.524343+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:30.524343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.524343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:49.484368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.022994+0000","last_change":"2024-09-14T12:10:36.022994+0000","last_active":"2024-09-14T12:10:36.022994+0000","last_peered":"2024-09-14T12:10:36.022994+0000","last_clean":"2024-09-14T12:10:36.022994+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:10:36.022994+0000","last_undegraded":"2024-09-14T12:10:36.022994+0000","last_fullsized":"2024-09-14T12:10:36.022994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:36.022906+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:36.022906+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.022906+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:48.376166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:09.674405+0000","last_change":"2024-09-14T11:44:25.350108+0000","last_active":"2024-09-14T12:06:09.674405+0000","last_peered":"2024-09-14T12:06:09.674405+0000","last_clean":"2024-09-14T12:06:09.674405+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:06:09.674405+0000","last_undegraded":"2024-09-14T12:06:09.674405+0000","last_fullsized":"2024-09-14T12:06:09.674405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:05.638059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.632077+0000","last_change":"2024-09-14T12:10:33.632005+0000","last_active":"2024-09-14T12:10:33.632077+0000","last_peered":"2024-09-14T12:10:33.632077+0000","last_clean":"2024-09-14T12:10:33.632077+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:10:33.632077+0000","last_undegraded":"2024-09-14T12:10:33.632077+0000","last_fullsized":"2024-09-14T12:10:33.632077+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:33.631920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:33.631920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.631920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:31.081297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.335416+0000","last_change":"2024-09-14T11:28:33.230870+0000","last_active":"2024-09-14T12:09:53.335416+0000","last_peered":"2024-09-14T12:09:53.335416+0000","last_clean":"2024-09-14T12:09:53.335416+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:09:53.335416+0000","last_undegraded":"2024-09-14T12:09:53.335416+0000","last_fullsized":"2024-09-14T12:09:53.335416+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:29.683991+0000","last_change":"2024-09-14T11:25:27.953081+0000","last_active":"2024-09-14T12:07:29.683991+0000","last_peered":"2024-09-14T12:07:29.683991+0000","last_clean":"2024-09-14T12:07:29.683991+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:07:29.683991+0000","last_undegraded":"2024-09-14T12:07:29.683991+0000","last_fullsized":"2024-09-14T12:07:29.683991+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:37.718041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.703935+0000","last_change":"2024-09-14T12:10:30.703935+0000","last_active":"2024-09-14T12:10:30.703935+0000","last_peered":"2024-09-14T12:10:30.703935+0000","last_clean":"2024-09-14T12:10:30.703935+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:10:30.703935+0000","last_undegraded":"2024-09-14T12:10:30.703935+0000","last_fullsized":"2024-09-14T12:10:30.703935+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.703836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.703836+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.703836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:35.246152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679683+0000","last_change":"2024-09-14T11:28:36.257470+0000","last_active":"2024-09-14T12:06:54.679683+0000","last_peered":"2024-09-14T12:06:54.679683+0000","last_clean":"2024-09-14T12:06:54.679683+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:06:54.679683+0000","last_undegraded":"2024-09-14T12:06:54.679683+0000","last_fullsized":"2024-09-14T12:06:54.679683+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:59.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.008987+0000","last_change":"2024-09-14T11:28:33.233762+0000","last_active":"2024-09-14T12:09:54.008987+0000","last_peered":"2024-09-14T12:09:54.008987+0000","last_clean":"2024-09-14T12:09:54.008987+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:09:54.008987+0000","last_undegraded":"2024-09-14T12:09:54.008987+0000","last_fullsized":"2024-09-14T12:09:54.008987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:03.013761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:24.690434+0000","last_change":"2024-09-14T11:25:27.950690+0000","last_active":"2024-09-14T12:08:24.690434+0000","last_peered":"2024-09-14T12:08:24.690434+0000","last_clean":"2024-09-14T12:08:24.690434+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:08:24.690434+0000","last_undegraded":"2024-09-14T12:08:24.690434+0000","last_fullsized":"2024-09-14T12:08:24.690434+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578529+0000","last_change":"2024-09-14T11:44:25.354265+0000","last_active":"2024-09-14T12:06:54.578529+0000","last_peered":"2024-09-14T12:06:54.578529+0000","last_clean":"2024-09-14T12:06:54.578529+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:06:54.578529+0000","last_undegraded":"2024-09-14T12:06:54.578529+0000","last_fullsized":"2024-09-14T12:06:54.578529+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.737799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679648+0000","last_change":"2024-09-14T11:28:36.254946+0000","last_active":"2024-09-14T12:06:54.679648+0000","last_peered":"2024-09-14T12:06:54.679648+0000","last_clean":"2024-09-14T12:06:54.679648+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:06:54.679648+0000","last_undegraded":"2024-09-14T12:06:54.679648+0000","last_fullsized":"2024-09-14T12:06:54.679648+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:55.651650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.599235+0000","last_change":"2024-09-14T12:10:27.599235+0000","last_active":"2024-09-14T12:10:27.599235+0000","last_peered":"2024-09-14T12:10:27.599235+0000","last_clean":"2024-09-14T12:10:27.599235+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:10:27.599235+0000","last_undegraded":"2024-09-14T12:10:27.599235+0000","last_fullsized":"2024-09-14T12:10:27.599235+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:27.599137+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:27.599137+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.599137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:18.228646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.726226+0000","last_change":"2024-09-14T11:25:27.949880+0000","last_active":"2024-09-14T12:08:14.726226+0000","last_peered":"2024-09-14T12:08:14.726226+0000","last_clean":"2024-09-14T12:08:14.726226+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:08:14.726226+0000","last_undegraded":"2024-09-14T12:08:14.726226+0000","last_fullsized":"2024-09-14T12:08:14.726226+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.656553+0000","last_change":"2024-09-14T12:10:36.656553+0000","last_active":"2024-09-14T12:10:36.656553+0000","last_peered":"2024-09-14T12:10:36.656553+0000","last_clean":"2024-09-14T12:10:36.656553+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:10:36.656553+0000","last_undegraded":"2024-09-14T12:10:36.656553+0000","last_fullsized":"2024-09-14T12:10:36.656553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:36.656465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:36.656465+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.656465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:04.886372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.956830+0000","last_change":"2024-09-14T12:10:34.956830+0000","last_active":"2024-09-14T12:10:34.956830+0000","last_peered":"2024-09-14T12:10:34.956830+0000","last_clean":"2024-09-14T12:10:34.956830+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:10:34.956830+0000","last_undegraded":"2024-09-14T12:10:34.956830+0000","last_fullsized":"2024-09-14T12:10:34.956830+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:34.956716+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:34.956716+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.956716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:57.306536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:50.566673+0000","last_change":"2024-09-14T11:28:33.231847+0000","last_active":"2024-09-14T12:06:50.566673+0000","last_peered":"2024-09-14T12:06:50.566673+0000","last_clean":"2024-09-14T12:06:50.566673+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:06:50.566673+0000","last_undegraded":"2024-09-14T12:06:50.566673+0000","last_fullsized":"2024-09-14T12:06:50.566673+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:38.952131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.487619+0000","last_change":"2024-09-14T12:10:26.487556+0000","last_active":"2024-09-14T12:10:26.487619+0000","last_peered":"2024-09-14T12:10:26.487619+0000","last_clean":"2024-09-14T12:10:26.487619+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:10:26.487619+0000","last_undegraded":"2024-09-14T12:10:26.487619+0000","last_fullsized":"2024-09-14T12:10:26.487619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-14T12:10:26.487463+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-14T12:10:26.487463+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.487463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:58.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:14.590091+0000","last_change":"2024-09-14T11:44:25.347374+0000","last_active":"2024-09-14T12:08:14.590091+0000","last_peered":"2024-09-14T12:08:14.590091+0000","last_clean":"2024-09-14T12:08:14.590091+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:08:14.590091+0000","last_undegraded":"2024-09-14T12:08:14.590091+0000","last_fullsized":"2024-09-14T12:08:14.590091+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679699+0000","last_change":"2024-09-14T11:28:36.256404+0000","last_active":"2024-09-14T12:06:54.679699+0000","last_peered":"2024-09-14T12:06:54.679699+0000","last_clean":"2024-09-14T12:06:54.679699+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:06:54.679699+0000","last_undegraded":"2024-09-14T12:06:54.679699+0000","last_fullsized":"2024-09-14T12:06:54.679699+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:18.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.945985+0000","last_change":"2024-09-14T12:10:31.945985+0000","last_active":"2024-09-14T12:10:31.945985+0000","last_peered":"2024-09-14T12:10:31.945985+0000","last_clean":"2024-09-14T12:10:31.945985+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:10:31.945985+0000","last_undegraded":"2024-09-14T12:10:31.945985+0000","last_fullsized":"2024-09-14T12:10:31.945985+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:31.945896+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:31.945896+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.945896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:23.234876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.741384+0000","last_change":"2024-09-14T12:10:23.741291+0000","last_active":"2024-09-14T12:10:23.741384+0000","last_peered":"2024-09-14T12:10:23.741384+0000","last_clean":"2024-09-14T12:10:23.741384+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:10:23.741384+0000","last_undegraded":"2024-09-14T12:10:23.741384+0000","last_fullsized":"2024-09-14T12:10:23.741384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'28","last_scrub_stamp":"2024-09-14T12:10:23.741177+0000","last_deep_scrub":"262'28","last_deep_scrub_stamp":"2024-09-14T12:10:23.741177+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.741177+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:32.349253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.679716+0000","last_change":"2024-09-14T11:44:25.355046+0000","last_active":"2024-09-14T12:06:54.679716+0000","last_peered":"2024-09-14T12:06:54.679716+0000","last_clean":"2024-09-14T12:06:54.679716+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:06:54.679716+0000","last_undegraded":"2024-09-14T12:06:54.679716+0000","last_fullsized":"2024-09-14T12:06:54.679716+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:51.119733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.955962+0000","last_change":"2024-09-14T11:28:36.260180+0000","last_active":"2024-09-14T12:09:52.955962+0000","last_peered":"2024-09-14T12:09:52.955962+0000","last_clean":"2024-09-14T12:09:52.955962+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:09:52.955962+0000","last_undegraded":"2024-09-14T12:09:52.955962+0000","last_fullsized":"2024-09-14T12:09:52.955962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:35.619938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:35.571885+0000","last_change":"2024-09-14T11:28:33.230223+0000","last_active":"2024-09-14T12:07:35.571885+0000","last_peered":"2024-09-14T12:07:35.571885+0000","last_clean":"2024-09-14T12:07:35.571885+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:07:35.571885+0000","last_undegraded":"2024-09-14T12:07:35.571885+0000","last_fullsized":"2024-09-14T12:07:35.571885+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:17.221998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.234013+0000","last_change":"2024-09-14T12:10:38.234013+0000","last_active":"2024-09-14T12:10:38.234013+0000","last_peered":"2024-09-14T12:10:38.234013+0000","last_clean":"2024-09-14T12:10:38.234013+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:10:38.234013+0000","last_undegraded":"2024-09-14T12:10:38.234013+0000","last_fullsized":"2024-09-14T12:10:38.234013+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-14T12:10:38.233907+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-14T12:10:38.233907+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.233907+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:17.747594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:59.579278+0000","last_change":"2024-09-14T11:44:25.354056+0000","last_active":"2024-09-14T12:06:59.579278+0000","last_peered":"2024-09-14T12:06:59.579278+0000","last_clean":"2024-09-14T12:06:59.579278+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:06:59.579278+0000","last_undegraded":"2024-09-14T12:06:59.579278+0000","last_fullsized":"2024-09-14T12:06:59.579278+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:37.958850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.131052+0000","last_change":"2024-09-14T11:28:36.365890+0000","last_active":"2024-09-14T12:09:53.131052+0000","last_peered":"2024-09-14T12:09:53.131052+0000","last_clean":"2024-09-14T12:09:53.131052+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:09:53.131052+0000","last_undegraded":"2024-09-14T12:09:53.131052+0000","last_fullsized":"2024-09-14T12:09:53.131052+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.017356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.903051+0000","last_change":"2024-09-14T12:10:30.903051+0000","last_active":"2024-09-14T12:10:30.903051+0000","last_peered":"2024-09-14T12:10:30.903051+0000","last_clean":"2024-09-14T12:10:30.903051+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:10:30.903051+0000","last_undegraded":"2024-09-14T12:10:30.903051+0000","last_fullsized":"2024-09-14T12:10:30.903051+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:30.902949+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:30.902949+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.902949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:54.542664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.483049+0000","last_change":"2024-09-14T12:10:37.483049+0000","last_active":"2024-09-14T12:10:37.483049+0000","last_peered":"2024-09-14T12:10:37.483049+0000","last_clean":"2024-09-14T12:10:37.483049+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:10:37.483049+0000","last_undegraded":"2024-09-14T12:10:37.483049+0000","last_fullsized":"2024-09-14T12:10:37.483049+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-14T12:10:37.482966+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-14T12:10:37.482966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.482966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:28.164284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:54.578564+0000","last_change":"2024-09-14T11:44:25.351682+0000","last_active":"2024-09-14T12:06:54.578564+0000","last_peered":"2024-09-14T12:06:54.578564+0000","last_clean":"2024-09-14T12:06:54.578564+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:06:54.578564+0000","last_undegraded":"2024-09-14T12:06:54.578564+0000","last_fullsized":"2024-09-14T12:06:54.578564+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:33.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.931874+0000","last_change":"2024-09-14T12:10:33.931874+0000","last_active":"2024-09-14T12:10:33.931874+0000","last_peered":"2024-09-14T12:10:33.931874+0000","last_clean":"2024-09-14T12:10:33.931874+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:10:33.931874+0000","last_undegraded":"2024-09-14T12:10:33.931874+0000","last_fullsized":"2024-09-14T12:10:33.931874+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T12:10:33.931788+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T12:10:33.931788+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.931788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:09.612933+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17937,"num_write":8,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'6","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.082484+0000","last_change":"2024-09-14T11:28:33.228385+0000","last_active":"2024-09-14T12:09:54.082484+0000","last_peered":"2024-09-14T12:09:54.082484+0000","last_clean":"2024-09-14T12:09:54.082484+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:09:54.082484+0000","last_undegraded":"2024-09-14T12:09:54.082484+0000","last_fullsized":"2024-09-14T12:09:54.082484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:36.884948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:39.677912+0000","last_change":"2024-09-14T11:25:27.951396+0000","last_active":"2024-09-14T12:06:39.677912+0000","last_peered":"2024-09-14T12:06:39.677912+0000","last_clean":"2024-09-14T12:06:39.677912+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:06:39.677912+0000","last_undegraded":"2024-09-14T12:06:39.677912+0000","last_fullsized":"2024-09-14T12:06:39.677912+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:25:26.917939+0000","last_clean_scrub_stamp":"2024-09-14T11:25:26.917939+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.372583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:06:55.567242+0000","last_change":"2024-09-14T11:44:25.356594+0000","last_active":"2024-09-14T12:06:55.567242+0000","last_peered":"2024-09-14T12:06:55.567242+0000","last_clean":"2024-09-14T12:06:55.567242+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:06:55.567242+0000","last_undegraded":"2024-09-14T12:06:55.567242+0000","last_fullsized":"2024-09-14T12:06:55.567242+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:38.437539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:44.585586+0000","last_change":"2024-09-14T11:29:33.340403+0000","last_active":"2024-09-14T12:07:44.585586+0000","last_peered":"2024-09-14T12:07:44.585586+0000","last_clean":"2024-09-14T12:07:44.585586+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:07:44.585586+0000","last_undegraded":"2024-09-14T12:07:44.585586+0000","last_fullsized":"2024-09-14T12:07:44.585586+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:46.256090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.061228+0000","last_change":"2024-09-14T12:10:39.061228+0000","last_active":"2024-09-14T12:10:39.061228+0000","last_peered":"2024-09-14T12:10:39.061228+0000","last_clean":"2024-09-14T12:10:39.061228+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:10:39.061228+0000","last_undegraded":"2024-09-14T12:10:39.061228+0000","last_fullsized":"2024-09-14T12:10:39.061228+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.061111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.061111+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.061111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:40.612611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.537776+0000","last_change":"2024-09-14T12:10:29.537776+0000","last_active":"2024-09-14T12:10:29.537776+0000","last_peered":"2024-09-14T12:10:29.537776+0000","last_clean":"2024-09-14T12:10:29.537776+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:10:29.537776+0000","last_undegraded":"2024-09-14T12:10:29.537776+0000","last_fullsized":"2024-09-14T12:10:29.537776+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-14T12:10:29.537674+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-14T12:10:29.537674+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.537674+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:55.031465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581926+0000","last_change":"2024-09-14T11:44:25.351860+0000","last_active":"2024-09-14T12:07:19.581926+0000","last_peered":"2024-09-14T12:07:19.581926+0000","last_clean":"2024-09-14T12:07:19.581926+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:07:19.581926+0000","last_undegraded":"2024-09-14T12:07:19.581926+0000","last_fullsized":"2024-09-14T12:07:19.581926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:01.524031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:20.577308+0000","last_change":"2024-09-14T11:28:36.252024+0000","last_active":"2024-09-14T12:08:20.577308+0000","last_peered":"2024-09-14T12:08:20.577308+0000","last_clean":"2024-09-14T12:08:20.577308+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:08:20.577308+0000","last_undegraded":"2024-09-14T12:08:20.577308+0000","last_fullsized":"2024-09-14T12:08:20.577308+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.379658+0000","last_change":"2024-09-14T11:28:33.229236+0000","last_active":"2024-09-14T12:09:54.379658+0000","last_peered":"2024-09-14T12:09:54.379658+0000","last_clean":"2024-09-14T12:09:54.379658+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:09:54.379658+0000","last_undegraded":"2024-09-14T12:09:54.379658+0000","last_fullsized":"2024-09-14T12:09:54.379658+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.194085+0000","last_change":"2024-09-14T12:10:37.194085+0000","last_active":"2024-09-14T12:10:37.194085+0000","last_peered":"2024-09-14T12:10:37.194085+0000","last_clean":"2024-09-14T12:10:37.194085+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:10:37.194085+0000","last_undegraded":"2024-09-14T12:10:37.194085+0000","last_fullsized":"2024-09-14T12:10:37.194085+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-14T12:10:37.193995+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-14T12:10:37.193995+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.193995+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:41.153802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.717994+0000","last_change":"2024-09-14T11:44:25.350439+0000","last_active":"2024-09-14T12:07:19.717994+0000","last_peered":"2024-09-14T12:07:19.717994+0000","last_clean":"2024-09-14T12:07:19.717994+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:07:19.717994+0000","last_undegraded":"2024-09-14T12:07:19.717994+0000","last_fullsized":"2024-09-14T12:07:19.717994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:24.626683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:54.210104+0000","last_change":"2024-09-14T11:28:36.365847+0000","last_active":"2024-09-14T12:09:54.210104+0000","last_peered":"2024-09-14T12:09:54.210104+0000","last_clean":"2024-09-14T12:09:54.210104+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:09:54.210104+0000","last_undegraded":"2024-09-14T12:09:54.210104+0000","last_fullsized":"2024-09-14T12:09:54.210104+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.604950+0000","last_change":"2024-09-14T12:10:26.604950+0000","last_active":"2024-09-14T12:10:26.604950+0000","last_peered":"2024-09-14T12:10:26.604950+0000","last_clean":"2024-09-14T12:10:26.604950+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:10:26.604950+0000","last_undegraded":"2024-09-14T12:10:26.604950+0000","last_fullsized":"2024-09-14T12:10:26.604950+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:26.604867+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:26.604867+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.604867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:23.881125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.437755+0000","last_change":"2024-09-14T12:10:25.437755+0000","last_active":"2024-09-14T12:10:25.437755+0000","last_peered":"2024-09-14T12:10:25.437755+0000","last_clean":"2024-09-14T12:10:25.437755+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:10:25.437755+0000","last_undegraded":"2024-09-14T12:10:25.437755+0000","last_fullsized":"2024-09-14T12:10:25.437755+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:25.437626+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:25.437626+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.437626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:14.993165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.056974+0000","last_change":"2024-09-14T12:10:39.056974+0000","last_active":"2024-09-14T12:10:39.056974+0000","last_peered":"2024-09-14T12:10:39.056974+0000","last_clean":"2024-09-14T12:10:39.056974+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:10:39.056974+0000","last_undegraded":"2024-09-14T12:10:39.056974+0000","last_fullsized":"2024-09-14T12:10:39.056974+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.056866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.056866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.056866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.111137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584940+0000","last_change":"2024-09-14T11:28:36.367086+0000","last_active":"2024-09-14T12:07:39.584940+0000","last_peered":"2024-09-14T12:07:39.584940+0000","last_clean":"2024-09-14T12:07:39.584940+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:07:39.584940+0000","last_undegraded":"2024-09-14T12:07:39.584940+0000","last_fullsized":"2024-09-14T12:07:39.584940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.893706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.537112+0000","last_change":"2024-09-14T12:10:39.537112+0000","last_active":"2024-09-14T12:10:39.537112+0000","last_peered":"2024-09-14T12:10:39.537112+0000","last_clean":"2024-09-14T12:10:39.537112+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:10:39.537112+0000","last_undegraded":"2024-09-14T12:10:39.537112+0000","last_fullsized":"2024-09-14T12:10:39.537112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.537019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.537019+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.537019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:43.511738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.494266+0000","last_change":"2024-09-14T12:10:36.494266+0000","last_active":"2024-09-14T12:10:36.494266+0000","last_peered":"2024-09-14T12:10:36.494266+0000","last_clean":"2024-09-14T12:10:36.494266+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:10:36.494266+0000","last_undegraded":"2024-09-14T12:10:36.494266+0000","last_fullsized":"2024-09-14T12:10:36.494266+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-14T12:10:36.494160+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-14T12:10:36.494160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.494160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:43.294501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:19.581534+0000","last_change":"2024-09-14T11:44:25.354049+0000","last_active":"2024-09-14T12:07:19.581534+0000","last_peered":"2024-09-14T12:07:19.581534+0000","last_clean":"2024-09-14T12:07:19.581534+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:07:19.581534+0000","last_undegraded":"2024-09-14T12:07:19.581534+0000","last_fullsized":"2024-09-14T12:07:19.581534+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:06.436515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:39.584665+0000","last_change":"2024-09-14T11:28:36.260053+0000","last_active":"2024-09-14T12:07:39.584665+0000","last_peered":"2024-09-14T12:07:39.584665+0000","last_clean":"2024-09-14T12:07:39.584665+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:07:39.584665+0000","last_undegraded":"2024-09-14T12:07:39.584665+0000","last_fullsized":"2024-09-14T12:07:39.584665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:34.584214+0000","last_change":"2024-09-14T11:28:33.233002+0000","last_active":"2024-09-14T12:07:34.584214+0000","last_peered":"2024-09-14T12:07:34.584214+0000","last_clean":"2024-09-14T12:07:34.584214+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:07:34.584214+0000","last_undegraded":"2024-09-14T12:07:34.584214+0000","last_fullsized":"2024-09-14T12:07:34.584214+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:57.509567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.919786+0000","last_change":"2024-09-14T12:10:27.919786+0000","last_active":"2024-09-14T12:10:27.919786+0000","last_peered":"2024-09-14T12:10:27.919786+0000","last_clean":"2024-09-14T12:10:27.919786+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:10:27.919786+0000","last_undegraded":"2024-09-14T12:10:27.919786+0000","last_fullsized":"2024-09-14T12:10:27.919786+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-14T12:10:27.919699+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-14T12:10:27.919699+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.919699+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:15.231975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.715104+0000","last_change":"2024-09-14T12:10:31.715104+0000","last_active":"2024-09-14T12:10:31.715104+0000","last_peered":"2024-09-14T12:10:31.715104+0000","last_clean":"2024-09-14T12:10:31.715104+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:10:31.715104+0000","last_undegraded":"2024-09-14T12:10:31.715104+0000","last_fullsized":"2024-09-14T12:10:31.715104+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:31.715014+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:31.715014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.715014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.502111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.906639+0000","last_change":"2024-09-14T12:10:32.906639+0000","last_active":"2024-09-14T12:10:32.906639+0000","last_peered":"2024-09-14T12:10:32.906639+0000","last_clean":"2024-09-14T12:10:32.906639+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:10:32.906639+0000","last_undegraded":"2024-09-14T12:10:32.906639+0000","last_fullsized":"2024-09-14T12:10:32.906639+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:32.906554+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:32.906554+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.906554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:07.014171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:39.593742+0000","last_change":"2024-09-14T11:28:33.228459+0000","last_active":"2024-09-14T12:08:39.593742+0000","last_peered":"2024-09-14T12:08:39.593742+0000","last_clean":"2024-09-14T12:08:39.593742+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:08:39.593742+0000","last_undegraded":"2024-09-14T12:08:39.593742+0000","last_fullsized":"2024-09-14T12:08:39.593742+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.585175+0000","last_change":"2024-09-14T12:10:38.585175+0000","last_active":"2024-09-14T12:10:38.585175+0000","last_peered":"2024-09-14T12:10:38.585175+0000","last_clean":"2024-09-14T12:10:38.585175+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:10:38.585175+0000","last_undegraded":"2024-09-14T12:10:38.585175+0000","last_fullsized":"2024-09-14T12:10:38.585175+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-14T12:10:38.585084+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-14T12:10:38.585084+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.585084+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:41.498626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:15.576809+0000","last_change":"2024-09-14T11:44:25.353177+0000","last_active":"2024-09-14T12:08:15.576809+0000","last_peered":"2024-09-14T12:08:15.576809+0000","last_clean":"2024-09-14T12:08:15.576809+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:08:15.576809+0000","last_undegraded":"2024-09-14T12:08:15.576809+0000","last_fullsized":"2024-09-14T12:08:15.576809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:44.730416+0000","last_change":"2024-09-14T11:28:36.256678+0000","last_active":"2024-09-14T12:08:44.730416+0000","last_peered":"2024-09-14T12:08:44.730416+0000","last_clean":"2024-09-14T12:08:44.730416+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:08:44.730416+0000","last_undegraded":"2024-09-14T12:08:44.730416+0000","last_fullsized":"2024-09-14T12:08:44.730416+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:25.852294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:53.543343+0000","last_change":"2024-09-14T11:28:33.232601+0000","last_active":"2024-09-14T12:09:53.543343+0000","last_peered":"2024-09-14T12:09:53.543343+0000","last_clean":"2024-09-14T12:09:53.543343+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:09:53.543343+0000","last_undegraded":"2024-09-14T12:09:53.543343+0000","last_fullsized":"2024-09-14T12:09:53.543343+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:32.205460+0000","last_clean_scrub_stamp":"2024-09-14T11:28:32.205460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.057643+0000","last_change":"2024-09-14T12:10:37.057643+0000","last_active":"2024-09-14T12:10:37.057643+0000","last_peered":"2024-09-14T12:10:37.057643+0000","last_clean":"2024-09-14T12:10:37.057643+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:10:37.057643+0000","last_undegraded":"2024-09-14T12:10:37.057643+0000","last_fullsized":"2024-09-14T12:10:37.057643+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-14T12:10:37.057550+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-14T12:10:37.057550+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.057550+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:07.525476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:20.570267+0000","last_change":"2024-09-14T11:44:25.353056+0000","last_active":"2024-09-14T12:07:20.570267+0000","last_peered":"2024-09-14T12:07:20.570267+0000","last_clean":"2024-09-14T12:07:20.570267+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:07:20.570267+0000","last_undegraded":"2024-09-14T12:07:20.570267+0000","last_fullsized":"2024-09-14T12:07:20.570267+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:07.137155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.570057+0000","last_change":"2024-09-14T12:10:31.570057+0000","last_active":"2024-09-14T12:10:31.570057+0000","last_peered":"2024-09-14T12:10:31.570057+0000","last_clean":"2024-09-14T12:10:31.570057+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:10:31.570057+0000","last_undegraded":"2024-09-14T12:10:31.570057+0000","last_fullsized":"2024-09-14T12:10:31.570057+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T12:10:31.569964+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T12:10:31.569964+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.569964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:48.357791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'9","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.952201+0000","last_change":"2024-09-14T12:10:29.952201+0000","last_active":"2024-09-14T12:10:29.952201+0000","last_peered":"2024-09-14T12:10:29.952201+0000","last_clean":"2024-09-14T12:10:29.952201+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:10:29.952201+0000","last_undegraded":"2024-09-14T12:10:29.952201+0000","last_fullsized":"2024-09-14T12:10:29.952201+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T12:10:29.952118+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T12:10:29.952118+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.952118+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:40.168274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.435191+0000","last_change":"2024-09-14T12:10:24.435191+0000","last_active":"2024-09-14T12:10:24.435191+0000","last_peered":"2024-09-14T12:10:24.435191+0000","last_clean":"2024-09-14T12:10:24.435191+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:10:24.435191+0000","last_undegraded":"2024-09-14T12:10:24.435191+0000","last_fullsized":"2024-09-14T12:10:24.435191+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:24.435114+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:24.435114+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.435114+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:38.814026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:07:24.582789+0000","last_change":"2024-09-14T11:44:25.355567+0000","last_active":"2024-09-14T12:07:24.582789+0000","last_peered":"2024-09-14T12:07:24.582789+0000","last_clean":"2024-09-14T12:07:24.582789+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:07:24.582789+0000","last_undegraded":"2024-09-14T12:07:24.582789+0000","last_fullsized":"2024-09-14T12:07:24.582789+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:15.391313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:52.957193+0000","last_change":"2024-09-14T11:28:36.260711+0000","last_active":"2024-09-14T12:09:52.957193+0000","last_peered":"2024-09-14T12:09:52.957193+0000","last_clean":"2024-09-14T12:09:52.957193+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:09:52.957193+0000","last_undegraded":"2024-09-14T12:09:52.957193+0000","last_fullsized":"2024-09-14T12:09:52.957193+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:28:35.231500+0000","last_clean_scrub_stamp":"2024-09-14T11:28:35.231500+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.588628+0000","last_change":"2024-09-14T12:10:32.588628+0000","last_active":"2024-09-14T12:10:32.588628+0000","last_peered":"2024-09-14T12:10:32.588628+0000","last_clean":"2024-09-14T12:10:32.588628+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:10:32.588628+0000","last_undegraded":"2024-09-14T12:10:32.588628+0000","last_fullsized":"2024-09-14T12:10:32.588628+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.588504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.588504+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.588504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.828863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.563742+0000","last_change":"2024-09-14T12:10:39.563742+0000","last_active":"2024-09-14T12:10:39.563742+0000","last_peered":"2024-09-14T12:10:39.563742+0000","last_clean":"2024-09-14T12:10:39.563742+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:10:39.563742+0000","last_undegraded":"2024-09-14T12:10:39.563742+0000","last_fullsized":"2024-09-14T12:10:39.563742+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-14T12:10:39.563657+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-14T12:10:39.563657+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.563657+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:32.966571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'367","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.459244+0000","last_change":"2024-09-14T12:10:14.459244+0000","last_active":"2024-09-14T12:10:14.459244+0000","last_peered":"2024-09-14T12:10:14.459244+0000","last_clean":"2024-09-14T12:10:14.459244+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:10:14.459244+0000","last_undegraded":"2024-09-14T12:10:14.459244+0000","last_fullsized":"2024-09-14T12:10:14.459244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.459145+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.624776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":757,"num_read_kb":12872,"num_write":1136,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.668440+0000","last_change":"2024-09-14T12:10:19.668440+0000","last_active":"2024-09-14T12:10:19.668440+0000","last_peered":"2024-09-14T12:10:19.668440+0000","last_clean":"2024-09-14T12:10:19.668440+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:10:19.668440+0000","last_undegraded":"2024-09-14T12:10:19.668440+0000","last_fullsized":"2024-09-14T12:10:19.668440+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.668328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.312199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'341","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.826945+0000","last_change":"2024-09-14T12:10:05.826945+0000","last_active":"2024-09-14T12:10:05.826945+0000","last_peered":"2024-09-14T12:10:05.826945+0000","last_clean":"2024-09-14T12:10:05.826945+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:10:05.826945+0000","last_undegraded":"2024-09-14T12:10:05.826945+0000","last_fullsized":"2024-09-14T12:10:05.826945+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.826834+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:29.237796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":30246,"num_write":1175,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.530643+0000","last_change":"2024-09-14T12:10:18.530643+0000","last_active":"2024-09-14T12:10:18.530643+0000","last_peered":"2024-09-14T12:10:18.530643+0000","last_clean":"2024-09-14T12:10:18.530643+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:10:18.530643+0000","last_undegraded":"2024-09-14T12:10:18.530643+0000","last_fullsized":"2024-09-14T12:10:18.530643+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.530556+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:40.837032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'341","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.095197+0000","last_change":"2024-09-14T12:10:05.095197+0000","last_active":"2024-09-14T12:10:05.095197+0000","last_peered":"2024-09-14T12:10:05.095197+0000","last_clean":"2024-09-14T12:10:05.095197+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:10:05.095197+0000","last_undegraded":"2024-09-14T12:10:05.095197+0000","last_fullsized":"2024-09-14T12:10:05.095197+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.095059+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.483265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":3312,"num_write":1178,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.971020+0000","last_change":"2024-09-14T12:10:16.971020+0000","last_active":"2024-09-14T12:10:16.971020+0000","last_peered":"2024-09-14T12:10:16.971020+0000","last_clean":"2024-09-14T12:10:16.971020+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:10:16.971020+0000","last_undegraded":"2024-09-14T12:10:16.971020+0000","last_fullsized":"2024-09-14T12:10:16.971020+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.970940+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.622124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'370","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.705623+0000","last_change":"2024-09-14T12:10:13.705623+0000","last_active":"2024-09-14T12:10:13.705623+0000","last_peered":"2024-09-14T12:10:13.705623+0000","last_clean":"2024-09-14T12:10:13.705623+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:10:13.705623+0000","last_undegraded":"2024-09-14T12:10:13.705623+0000","last_fullsized":"2024-09-14T12:10:13.705623+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.705505+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:38.303648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5058,"num_write":1126,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.214780+0000","last_change":"2024-09-14T12:10:14.214780+0000","last_active":"2024-09-14T12:10:14.214780+0000","last_peered":"2024-09-14T12:10:14.214780+0000","last_clean":"2024-09-14T12:10:14.214780+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:10:14.214780+0000","last_undegraded":"2024-09-14T12:10:14.214780+0000","last_fullsized":"2024-09-14T12:10:14.214780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.214689+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:13.644836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'332","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.452437+0000","last_change":"2024-09-14T12:10:13.452437+0000","last_active":"2024-09-14T12:10:13.452437+0000","last_peered":"2024-09-14T12:10:13.452437+0000","last_clean":"2024-09-14T12:10:13.452437+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:10:13.452437+0000","last_undegraded":"2024-09-14T12:10:13.452437+0000","last_fullsized":"2024-09-14T12:10:13.452437+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.452316+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:51.046156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":17822,"num_write":1000,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'253","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.296368+0000","last_change":"2024-09-14T12:10:12.296368+0000","last_active":"2024-09-14T12:10:12.296368+0000","last_peered":"2024-09-14T12:10:12.296368+0000","last_clean":"2024-09-14T12:10:12.296368+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:10:12.296368+0000","last_undegraded":"2024-09-14T12:10:12.296368+0000","last_fullsized":"2024-09-14T12:10:12.296368+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.296241+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:52.581921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.675366+0000","last_change":"2024-09-14T12:10:12.675366+0000","last_active":"2024-09-14T12:10:12.675366+0000","last_peered":"2024-09-14T12:10:12.675366+0000","last_clean":"2024-09-14T12:10:12.675366+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:10:12.675366+0000","last_undegraded":"2024-09-14T12:10:12.675366+0000","last_fullsized":"2024-09-14T12:10:12.675366+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.675269+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:51.405065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.981965+0000","last_change":"2024-09-14T12:10:18.981965+0000","last_active":"2024-09-14T12:10:18.981965+0000","last_peered":"2024-09-14T12:10:18.981965+0000","last_clean":"2024-09-14T12:10:18.981965+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:10:18.981965+0000","last_undegraded":"2024-09-14T12:10:18.981965+0000","last_fullsized":"2024-09-14T12:10:18.981965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.981860+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:07.103412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'350","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.486823+0000","last_change":"2024-09-14T12:10:12.486823+0000","last_active":"2024-09-14T12:10:12.486823+0000","last_peered":"2024-09-14T12:10:12.486823+0000","last_clean":"2024-09-14T12:10:12.486823+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:10:12.486823+0000","last_undegraded":"2024-09-14T12:10:12.486823+0000","last_fullsized":"2024-09-14T12:10:12.486823+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.486683+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:55.966016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":627,"num_read_kb":84521,"num_write":1155,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.679975+0000","last_change":"2024-09-14T12:10:20.679975+0000","last_active":"2024-09-14T12:10:20.679975+0000","last_peered":"2024-09-14T12:10:20.679975+0000","last_clean":"2024-09-14T12:10:20.679975+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:10:20.679975+0000","last_undegraded":"2024-09-14T12:10:20.679975+0000","last_fullsized":"2024-09-14T12:10:20.679975+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:20.679881+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:20.679881+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.679881+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:50.257170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.085587+0000","last_change":"2024-09-14T12:10:07.085587+0000","last_active":"2024-09-14T12:10:07.085587+0000","last_peered":"2024-09-14T12:10:07.085587+0000","last_clean":"2024-09-14T12:10:07.085587+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:10:07.085587+0000","last_undegraded":"2024-09-14T12:10:07.085587+0000","last_fullsized":"2024-09-14T12:10:07.085587+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.085466+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.348034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.664539+0000","last_change":"2024-09-14T12:10:12.664539+0000","last_active":"2024-09-14T12:10:12.664539+0000","last_peered":"2024-09-14T12:10:12.664539+0000","last_clean":"2024-09-14T12:10:12.664539+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:10:12.664539+0000","last_undegraded":"2024-09-14T12:10:12.664539+0000","last_fullsized":"2024-09-14T12:10:12.664539+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'180","last_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_deep_scrub":"265'180","last_deep_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.664453+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:36.687451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.967028+0000","last_change":"2024-09-14T12:10:15.967028+0000","last_active":"2024-09-14T12:10:15.967028+0000","last_peered":"2024-09-14T12:10:15.967028+0000","last_clean":"2024-09-14T12:10:15.967028+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:10:15.967028+0000","last_undegraded":"2024-09-14T12:10:15.967028+0000","last_fullsized":"2024-09-14T12:10:15.967028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.966942+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:08.208593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.306614+0000","last_change":"2024-09-14T12:10:07.306614+0000","last_active":"2024-09-14T12:10:07.306614+0000","last_peered":"2024-09-14T12:10:07.306614+0000","last_clean":"2024-09-14T12:10:07.306614+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:10:07.306614+0000","last_undegraded":"2024-09-14T12:10:07.306614+0000","last_fullsized":"2024-09-14T12:10:07.306614+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.306483+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:41.620701+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159838,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":4801,"num_write":1283,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1378,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.461288+0000","last_change":"2024-09-14T12:10:16.461288+0000","last_active":"2024-09-14T12:10:16.461288+0000","last_peered":"2024-09-14T12:10:16.461288+0000","last_clean":"2024-09-14T12:10:16.461288+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:10:16.461288+0000","last_undegraded":"2024-09-14T12:10:16.461288+0000","last_fullsized":"2024-09-14T12:10:16.461288+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'788","last_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_deep_scrub":"265'788","last_deep_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.461206+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.733748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'314","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.261791+0000","last_change":"2024-09-14T12:10:09.261791+0000","last_active":"2024-09-14T12:10:09.261791+0000","last_peered":"2024-09-14T12:10:09.261791+0000","last_clean":"2024-09-14T12:10:09.261791+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:10:09.261791+0000","last_undegraded":"2024-09-14T12:10:09.261791+0000","last_fullsized":"2024-09-14T12:10:09.261791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.261563+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:34.016334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":568,"num_read_kb":2774,"num_write":998,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.641090+0000","last_change":"2024-09-14T12:10:17.641090+0000","last_active":"2024-09-14T12:10:17.641090+0000","last_peered":"2024-09-14T12:10:17.641090+0000","last_clean":"2024-09-14T12:10:17.641090+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:10:17.641090+0000","last_undegraded":"2024-09-14T12:10:17.641090+0000","last_fullsized":"2024-09-14T12:10:17.641090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.640942+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.697431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'334","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.289358+0000","last_change":"2024-09-14T12:10:05.289358+0000","last_active":"2024-09-14T12:10:05.289358+0000","last_peered":"2024-09-14T12:10:05.289358+0000","last_clean":"2024-09-14T12:10:05.289358+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:10:05.289358+0000","last_undegraded":"2024-09-14T12:10:05.289358+0000","last_fullsized":"2024-09-14T12:10:05.289358+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.289211+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.228353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":52006,"num_write":1108,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.639093+0000","last_change":"2024-09-14T12:10:09.639093+0000","last_active":"2024-09-14T12:10:09.639093+0000","last_peered":"2024-09-14T12:10:09.639093+0000","last_clean":"2024-09-14T12:10:09.639093+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:10:09.639093+0000","last_undegraded":"2024-09-14T12:10:09.639093+0000","last_fullsized":"2024-09-14T12:10:09.639093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.638966+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:04.748932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'371","reported_seq":1127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.865158+0000","last_change":"2024-09-14T12:10:03.865158+0000","last_active":"2024-09-14T12:10:03.865158+0000","last_peered":"2024-09-14T12:10:03.865158+0000","last_clean":"2024-09-14T12:10:03.865158+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:10:03.865158+0000","last_undegraded":"2024-09-14T12:10:03.865158+0000","last_fullsized":"2024-09-14T12:10:03.865158+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.865003+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:04.754565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1062,"num_read_kb":40711,"num_write":1149,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.649985+0000","last_change":"2024-09-14T12:10:14.649985+0000","last_active":"2024-09-14T12:10:14.649985+0000","last_peered":"2024-09-14T12:10:14.649985+0000","last_clean":"2024-09-14T12:10:14.649985+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:10:14.649985+0000","last_undegraded":"2024-09-14T12:10:14.649985+0000","last_fullsized":"2024-09-14T12:10:14.649985+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.649893+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:52.251100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'337","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.094911+0000","last_change":"2024-09-14T12:10:12.094911+0000","last_active":"2024-09-14T12:10:12.094911+0000","last_peered":"2024-09-14T12:10:12.094911+0000","last_clean":"2024-09-14T12:10:12.094911+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:10:12.094911+0000","last_undegraded":"2024-09-14T12:10:12.094911+0000","last_fullsized":"2024-09-14T12:10:12.094911+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.094760+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.754532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254516,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":58308,"num_write":1138,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.953578+0000","last_change":"2024-09-14T12:10:17.953578+0000","last_active":"2024-09-14T12:10:17.953578+0000","last_peered":"2024-09-14T12:10:17.953578+0000","last_clean":"2024-09-14T12:10:17.953578+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:10:17.953578+0000","last_undegraded":"2024-09-14T12:10:17.953578+0000","last_fullsized":"2024-09-14T12:10:17.953578+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.953497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:54.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'412","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.030763+0000","last_change":"2024-09-14T12:10:02.030763+0000","last_active":"2024-09-14T12:10:02.030763+0000","last_peered":"2024-09-14T12:10:02.030763+0000","last_clean":"2024-09-14T12:10:02.030763+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:10:02.030763+0000","last_undegraded":"2024-09-14T12:10:02.030763+0000","last_fullsized":"2024-09-14T12:10:02.030763+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'412","last_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_deep_scrub":"265'412","last_deep_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.030666+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:19.284654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":94295,"num_write":1155,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'191","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.991978+0000","last_change":"2024-09-14T12:10:33.991978+0000","last_active":"2024-09-14T12:10:33.991978+0000","last_peered":"2024-09-14T12:10:33.991978+0000","last_clean":"2024-09-14T12:10:33.991978+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:10:33.991978+0000","last_undegraded":"2024-09-14T12:10:33.991978+0000","last_fullsized":"2024-09-14T12:10:33.991978+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-14T12:10:33.991879+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-14T12:10:33.991879+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.991879+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:38.776578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'123","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.666541+0000","last_change":"2024-09-14T12:10:10.666541+0000","last_active":"2024-09-14T12:10:10.666541+0000","last_peered":"2024-09-14T12:10:10.666541+0000","last_clean":"2024-09-14T12:10:10.666541+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:10:10.666541+0000","last_undegraded":"2024-09-14T12:10:10.666541+0000","last_fullsized":"2024-09-14T12:10:10.666541+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.666460+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:53.474495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'488","reported_seq":1230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.285231+0000","last_change":"2024-09-14T12:10:06.285231+0000","last_active":"2024-09-14T12:10:06.285231+0000","last_peered":"2024-09-14T12:10:06.285231+0000","last_clean":"2024-09-14T12:10:06.285231+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:10:06.285231+0000","last_undegraded":"2024-09-14T12:10:06.285231+0000","last_fullsized":"2024-09-14T12:10:06.285231+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.285136+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:30.855826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":951,"num_read_kb":68364,"num_write":1403,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.602188+0000","last_change":"2024-09-14T12:10:23.602188+0000","last_active":"2024-09-14T12:10:23.602188+0000","last_peered":"2024-09-14T12:10:23.602188+0000","last_clean":"2024-09-14T12:10:23.602188+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:10:23.602188+0000","last_undegraded":"2024-09-14T12:10:23.602188+0000","last_fullsized":"2024-09-14T12:10:23.602188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.602105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.602105+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.602105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:03.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'324","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.258264+0000","last_change":"2024-09-14T12:10:22.258264+0000","last_active":"2024-09-14T12:10:22.258264+0000","last_peered":"2024-09-14T12:10:22.258264+0000","last_clean":"2024-09-14T12:10:22.258264+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:10:22.258264+0000","last_undegraded":"2024-09-14T12:10:22.258264+0000","last_fullsized":"2024-09-14T12:10:22.258264+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-14T12:10:22.258164+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-14T12:10:22.258164+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.258164+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:20.928434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1030,"num_write":396,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.464251+0000","last_change":"2024-09-14T12:10:32.464251+0000","last_active":"2024-09-14T12:10:32.464251+0000","last_peered":"2024-09-14T12:10:32.464251+0000","last_clean":"2024-09-14T12:10:32.464251+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:10:32.464251+0000","last_undegraded":"2024-09-14T12:10:32.464251+0000","last_fullsized":"2024-09-14T12:10:32.464251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.464135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.464135+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.464135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.501971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'132","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.562184+0000","last_change":"2024-09-14T12:10:36.562184+0000","last_active":"2024-09-14T12:10:36.562184+0000","last_peered":"2024-09-14T12:10:36.562184+0000","last_clean":"2024-09-14T12:10:36.562184+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:10:36.562184+0000","last_undegraded":"2024-09-14T12:10:36.562184+0000","last_fullsized":"2024-09-14T12:10:36.562184+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-14T12:10:36.562090+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-14T12:10:36.562090+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.562090+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.296268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.667533+0000","last_change":"2024-09-14T12:10:14.667533+0000","last_active":"2024-09-14T12:10:14.667533+0000","last_peered":"2024-09-14T12:10:14.667533+0000","last_clean":"2024-09-14T12:10:14.667533+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:10:14.667533+0000","last_undegraded":"2024-09-14T12:10:14.667533+0000","last_fullsized":"2024-09-14T12:10:14.667533+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.667432+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:35.887947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'285","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.047316+0000","last_change":"2024-09-14T12:09:59.047316+0000","last_active":"2024-09-14T12:09:59.047316+0000","last_peered":"2024-09-14T12:09:59.047316+0000","last_clean":"2024-09-14T12:09:59.047316+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:09:59.047316+0000","last_undegraded":"2024-09-14T12:09:59.047316+0000","last_fullsized":"2024-09-14T12:09:59.047316+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'285","last_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_deep_scrub":"265'285","last_deep_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.047215+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:06.088837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":825,"num_read_kb":44655,"num_write":1001,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.224044+0000","last_change":"2024-09-14T12:10:20.224044+0000","last_active":"2024-09-14T12:10:20.224044+0000","last_peered":"2024-09-14T12:10:20.224044+0000","last_clean":"2024-09-14T12:10:20.224044+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:10:20.224044+0000","last_undegraded":"2024-09-14T12:10:20.224044+0000","last_fullsized":"2024-09-14T12:10:20.224044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.223950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.223950+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.223950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:08.471542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.093239+0000","last_change":"2024-09-14T12:10:26.093239+0000","last_active":"2024-09-14T12:10:26.093239+0000","last_peered":"2024-09-14T12:10:26.093239+0000","last_clean":"2024-09-14T12:10:26.093239+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:10:26.093239+0000","last_undegraded":"2024-09-14T12:10:26.093239+0000","last_fullsized":"2024-09-14T12:10:26.093239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-14T12:10:26.093140+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-14T12:10:26.093140+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.093140+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.909515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.088634+0000","last_change":"2024-09-14T12:10:28.088634+0000","last_active":"2024-09-14T12:10:28.088634+0000","last_peered":"2024-09-14T12:10:28.088634+0000","last_clean":"2024-09-14T12:10:28.088634+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:10:28.088634+0000","last_undegraded":"2024-09-14T12:10:28.088634+0000","last_fullsized":"2024-09-14T12:10:28.088634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.088515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.088515+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.088515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:55.904182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'151","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.204685+0000","last_change":"2024-09-14T12:10:32.204685+0000","last_active":"2024-09-14T12:10:32.204685+0000","last_peered":"2024-09-14T12:10:32.204685+0000","last_clean":"2024-09-14T12:10:32.204685+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:10:32.204685+0000","last_undegraded":"2024-09-14T12:10:32.204685+0000","last_fullsized":"2024-09-14T12:10:32.204685+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-14T12:10:32.204581+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-14T12:10:32.204581+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.204581+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:14.251567+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.148946+0000","last_change":"2024-09-14T12:10:10.148946+0000","last_active":"2024-09-14T12:10:10.148946+0000","last_peered":"2024-09-14T12:10:10.148946+0000","last_clean":"2024-09-14T12:10:10.148946+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:10:10.148946+0000","last_undegraded":"2024-09-14T12:10:10.148946+0000","last_fullsized":"2024-09-14T12:10:10.148946+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'243","last_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_deep_scrub":"265'243","last_deep_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.148844+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:48.584464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'405","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.397851+0000","last_change":"2024-09-14T12:10:10.397851+0000","last_active":"2024-09-14T12:10:10.397851+0000","last_peered":"2024-09-14T12:10:10.397851+0000","last_clean":"2024-09-14T12:10:10.397851+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:10:10.397851+0000","last_undegraded":"2024-09-14T12:10:10.397851+0000","last_fullsized":"2024-09-14T12:10:10.397851+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.397701+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:07.184919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":632,"num_read_kb":37555,"num_write":1183,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.224896+0000","last_change":"2024-09-14T12:10:21.224896+0000","last_active":"2024-09-14T12:10:21.224896+0000","last_peered":"2024-09-14T12:10:21.224896+0000","last_clean":"2024-09-14T12:10:21.224896+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:10:21.224896+0000","last_undegraded":"2024-09-14T12:10:21.224896+0000","last_fullsized":"2024-09-14T12:10:21.224896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.224794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.224794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.224794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:51.879744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'122","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.734696+0000","last_change":"2024-09-14T12:10:19.734696+0000","last_active":"2024-09-14T12:10:19.734696+0000","last_peered":"2024-09-14T12:10:19.734696+0000","last_clean":"2024-09-14T12:10:19.734696+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:10:19.734696+0000","last_undegraded":"2024-09-14T12:10:19.734696+0000","last_fullsized":"2024-09-14T12:10:19.734696+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-14T12:10:19.734578+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-14T12:10:19.734578+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.734578+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:55.917431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'771","reported_seq":2422,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.472135+0000","last_change":"2024-09-14T12:10:31.472135+0000","last_active":"2024-09-14T12:10:31.472135+0000","last_peered":"2024-09-14T12:10:31.472135+0000","last_clean":"2024-09-14T12:10:31.472135+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:10:31.472135+0000","last_undegraded":"2024-09-14T12:10:31.472135+0000","last_fullsized":"2024-09-14T12:10:31.472135+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-14T12:10:31.472023+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-14T12:10:31.472023+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.472023+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:18.719751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'219","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.993612+0000","last_change":"2024-09-14T12:10:34.993612+0000","last_active":"2024-09-14T12:10:34.993612+0000","last_peered":"2024-09-14T12:10:34.993612+0000","last_clean":"2024-09-14T12:10:34.993612+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:10:34.993612+0000","last_undegraded":"2024-09-14T12:10:34.993612+0000","last_fullsized":"2024-09-14T12:10:34.993612+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'219","last_scrub_stamp":"2024-09-14T12:10:34.993525+0000","last_deep_scrub":"265'219","last_deep_scrub_stamp":"2024-09-14T12:10:34.993525+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.993525+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:16.682973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.087612+0000","last_change":"2024-09-14T12:10:10.087612+0000","last_active":"2024-09-14T12:10:10.087612+0000","last_peered":"2024-09-14T12:10:10.087612+0000","last_clean":"2024-09-14T12:10:10.087612+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:10:10.087612+0000","last_undegraded":"2024-09-14T12:10:10.087612+0000","last_fullsized":"2024-09-14T12:10:10.087612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'263","last_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_deep_scrub":"265'263","last_deep_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.087521+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:48.169805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'422","reported_seq":1130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.319589+0000","last_change":"2024-09-14T12:10:02.319589+0000","last_active":"2024-09-14T12:10:02.319589+0000","last_peered":"2024-09-14T12:10:02.319589+0000","last_clean":"2024-09-14T12:10:02.319589+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:10:02.319589+0000","last_undegraded":"2024-09-14T12:10:02.319589+0000","last_fullsized":"2024-09-14T12:10:02.319589+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.319485+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:23.716370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1004,"num_read_kb":6071,"num_write":1268,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.599185+0000","last_change":"2024-09-14T12:10:24.599185+0000","last_active":"2024-09-14T12:10:24.599185+0000","last_peered":"2024-09-14T12:10:24.599185+0000","last_clean":"2024-09-14T12:10:24.599185+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:10:24.599185+0000","last_undegraded":"2024-09-14T12:10:24.599185+0000","last_fullsized":"2024-09-14T12:10:24.599185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:24.599092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:24.599092+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.599092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:25.066364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'292","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.474782+0000","last_change":"2024-09-14T12:10:27.474782+0000","last_active":"2024-09-14T12:10:27.474782+0000","last_peered":"2024-09-14T12:10:27.474782+0000","last_clean":"2024-09-14T12:10:27.474782+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:10:27.474782+0000","last_undegraded":"2024-09-14T12:10:27.474782+0000","last_fullsized":"2024-09-14T12:10:27.474782+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'292","last_scrub_stamp":"2024-09-14T12:10:27.474683+0000","last_deep_scrub":"265'292","last_deep_scrub_stamp":"2024-09-14T12:10:27.474683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.474683+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:12.392164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'793","reported_seq":2497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.127033+0000","last_change":"2024-09-14T12:10:33.127033+0000","last_active":"2024-09-14T12:10:33.127033+0000","last_peered":"2024-09-14T12:10:33.127033+0000","last_clean":"2024-09-14T12:10:33.127033+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:10:33.127033+0000","last_undegraded":"2024-09-14T12:10:33.127033+0000","last_fullsized":"2024-09-14T12:10:33.127033+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-14T12:10:33.126938+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-14T12:10:33.126938+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.126938+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:43.707386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666351+0000","last_change":"2024-09-14T12:10:15.666351+0000","last_active":"2024-09-14T12:10:15.666351+0000","last_peered":"2024-09-14T12:10:15.666351+0000","last_clean":"2024-09-14T12:10:15.666351+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:10:15.666351+0000","last_undegraded":"2024-09-14T12:10:15.666351+0000","last_fullsized":"2024-09-14T12:10:15.666351+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.666266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:56.819864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'373","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.247413+0000","last_change":"2024-09-14T12:10:03.247413+0000","last_active":"2024-09-14T12:10:03.247413+0000","last_peered":"2024-09-14T12:10:03.247413+0000","last_clean":"2024-09-14T12:10:03.247413+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:10:03.247413+0000","last_undegraded":"2024-09-14T12:10:03.247413+0000","last_fullsized":"2024-09-14T12:10:03.247413+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.247260+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:03.568283+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343358,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":30361,"num_write":1111,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.563706+0000","last_change":"2024-09-14T12:10:19.563706+0000","last_active":"2024-09-14T12:10:19.563706+0000","last_peered":"2024-09-14T12:10:19.563706+0000","last_clean":"2024-09-14T12:10:19.563706+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:10:19.563706+0000","last_undegraded":"2024-09-14T12:10:19.563706+0000","last_fullsized":"2024-09-14T12:10:19.563706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.563568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:52.176982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'389","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.697605+0000","last_change":"2024-09-14T12:10:28.697605+0000","last_active":"2024-09-14T12:10:28.697605+0000","last_peered":"2024-09-14T12:10:28.697605+0000","last_clean":"2024-09-14T12:10:28.697605+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:10:28.697605+0000","last_undegraded":"2024-09-14T12:10:28.697605+0000","last_fullsized":"2024-09-14T12:10:28.697605+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-14T12:10:28.697498+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-14T12:10:28.697498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.697498+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:12.455664+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.832140+0000","last_change":"2024-09-14T12:10:20.832140+0000","last_active":"2024-09-14T12:10:20.832140+0000","last_peered":"2024-09-14T12:10:20.832140+0000","last_clean":"2024-09-14T12:10:20.832140+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:10:20.832140+0000","last_undegraded":"2024-09-14T12:10:20.832140+0000","last_fullsized":"2024-09-14T12:10:20.832140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.832059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.832059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.832059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:57.670837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'540","reported_seq":1365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.582821+0000","last_change":"2024-09-14T12:10:32.582821+0000","last_active":"2024-09-14T12:10:32.582821+0000","last_peered":"2024-09-14T12:10:32.582821+0000","last_clean":"2024-09-14T12:10:32.582821+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:10:32.582821+0000","last_undegraded":"2024-09-14T12:10:32.582821+0000","last_fullsized":"2024-09-14T12:10:32.582821+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-14T12:10:32.582710+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-14T12:10:32.582710+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.582710+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.319374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.875048+0000","last_change":"2024-09-14T12:10:04.875048+0000","last_active":"2024-09-14T12:10:04.875048+0000","last_peered":"2024-09-14T12:10:04.875048+0000","last_clean":"2024-09-14T12:10:04.875048+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:10:04.875048+0000","last_undegraded":"2024-09-14T12:10:04.875048+0000","last_fullsized":"2024-09-14T12:10:04.875048+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.874958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:10.686558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'384","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.371688+0000","last_change":"2024-09-14T12:10:09.371688+0000","last_active":"2024-09-14T12:10:09.371688+0000","last_peered":"2024-09-14T12:10:09.371688+0000","last_clean":"2024-09-14T12:10:09.371688+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:10:09.371688+0000","last_undegraded":"2024-09-14T12:10:09.371688+0000","last_fullsized":"2024-09-14T12:10:09.371688+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.371601+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:05.670350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":916,"num_read_kb":57128,"num_write":1152,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.716284+0000","last_change":"2024-09-14T12:10:20.716284+0000","last_active":"2024-09-14T12:10:20.716284+0000","last_peered":"2024-09-14T12:10:20.716284+0000","last_clean":"2024-09-14T12:10:20.716284+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:10:20.716284+0000","last_undegraded":"2024-09-14T12:10:20.716284+0000","last_fullsized":"2024-09-14T12:10:20.716284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.716198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.716198+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.716198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:51.902300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'274","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.253520+0000","last_change":"2024-09-14T12:10:23.253520+0000","last_active":"2024-09-14T12:10:23.253520+0000","last_peered":"2024-09-14T12:10:23.253520+0000","last_clean":"2024-09-14T12:10:23.253520+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:10:23.253520+0000","last_undegraded":"2024-09-14T12:10:23.253520+0000","last_fullsized":"2024-09-14T12:10:23.253520+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:23.253433+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:23.253433+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.253433+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.585150+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.164088+0000","last_change":"2024-09-14T12:10:31.164088+0000","last_active":"2024-09-14T12:10:31.164088+0000","last_peered":"2024-09-14T12:10:31.164088+0000","last_clean":"2024-09-14T12:10:31.164088+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:10:31.164088+0000","last_undegraded":"2024-09-14T12:10:31.164088+0000","last_fullsized":"2024-09-14T12:10:31.164088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:31.163976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:31.163976+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.163976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:48.664750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2498","reported_seq":4327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.435653+0000","last_change":"2024-09-14T12:10:23.435653+0000","last_active":"2024-09-14T12:10:23.435653+0000","last_peered":"2024-09-14T12:10:23.435653+0000","last_clean":"2024-09-14T12:10:23.435653+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:10:23.435653+0000","last_undegraded":"2024-09-14T12:10:23.435653+0000","last_fullsized":"2024-09-14T12:10:23.435653+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2498","last_scrub_stamp":"2024-09-14T12:10:23.435533+0000","last_deep_scrub":"265'2498","last_deep_scrub_stamp":"2024-09-14T12:10:23.435533+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.435533+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":2400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:39.924000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4178","reported_seq":4828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.262356+0000","last_change":"2024-09-14T12:10:08.262356+0000","last_active":"2024-09-14T12:10:08.262356+0000","last_peered":"2024-09-14T12:10:08.262356+0000","last_clean":"2024-09-14T12:10:08.262356+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:10:08.262356+0000","last_undegraded":"2024-09-14T12:10:08.262356+0000","last_fullsized":"2024-09-14T12:10:08.262356+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4178","last_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_deep_scrub":"265'4178","last_deep_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.262241+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:42.755259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'356","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.272037+0000","last_change":"2024-09-14T12:10:05.272037+0000","last_active":"2024-09-14T12:10:05.272037+0000","last_peered":"2024-09-14T12:10:05.272037+0000","last_clean":"2024-09-14T12:10:05.272037+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:10:05.272037+0000","last_undegraded":"2024-09-14T12:10:05.272037+0000","last_fullsized":"2024-09-14T12:10:05.272037+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.271893+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.064154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":21988,"num_write":1237,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666026+0000","last_change":"2024-09-14T12:10:15.666026+0000","last_active":"2024-09-14T12:10:15.666026+0000","last_peered":"2024-09-14T12:10:15.666026+0000","last_clean":"2024-09-14T12:10:15.666026+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:10:15.666026+0000","last_undegraded":"2024-09-14T12:10:15.666026+0000","last_fullsized":"2024-09-14T12:10:15.666026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.665936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:15.551151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'317","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.497008+0000","last_change":"2024-09-14T12:10:25.497008+0000","last_active":"2024-09-14T12:10:25.497008+0000","last_peered":"2024-09-14T12:10:25.497008+0000","last_clean":"2024-09-14T12:10:25.497008+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:10:25.497008+0000","last_undegraded":"2024-09-14T12:10:25.497008+0000","last_fullsized":"2024-09-14T12:10:25.497008+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-14T12:10:25.496914+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-14T12:10:25.496914+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.496914+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:09.096079+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'781","reported_seq":2803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.130857+0000","last_change":"2024-09-14T12:10:25.130857+0000","last_active":"2024-09-14T12:10:25.130857+0000","last_peered":"2024-09-14T12:10:25.130857+0000","last_clean":"2024-09-14T12:10:25.130857+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:10:25.130857+0000","last_undegraded":"2024-09-14T12:10:25.130857+0000","last_fullsized":"2024-09-14T12:10:25.130857+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'781","last_scrub_stamp":"2024-09-14T12:10:25.130754+0000","last_deep_scrub":"265'781","last_deep_scrub_stamp":"2024-09-14T12:10:25.130754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.130754+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.723670+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'155","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.155833+0000","last_change":"2024-09-14T12:10:29.155833+0000","last_active":"2024-09-14T12:10:29.155833+0000","last_peered":"2024-09-14T12:10:29.155833+0000","last_clean":"2024-09-14T12:10:29.155833+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:10:29.155833+0000","last_undegraded":"2024-09-14T12:10:29.155833+0000","last_fullsized":"2024-09-14T12:10:29.155833+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-14T12:10:29.155743+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-14T12:10:29.155743+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.155743+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:29.322939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":711,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.120635+0000","last_change":"2024-09-14T12:10:09.120635+0000","last_active":"2024-09-14T12:10:09.120635+0000","last_peered":"2024-09-14T12:10:09.120635+0000","last_clean":"2024-09-14T12:10:09.120635+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:10:09.120635+0000","last_undegraded":"2024-09-14T12:10:09.120635+0000","last_fullsized":"2024-09-14T12:10:09.120635+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.120547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:00.785994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'364","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.791535+0000","last_change":"2024-09-14T12:10:04.791535+0000","last_active":"2024-09-14T12:10:04.791535+0000","last_peered":"2024-09-14T12:10:04.791535+0000","last_clean":"2024-09-14T12:10:04.791535+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:10:04.791535+0000","last_undegraded":"2024-09-14T12:10:04.791535+0000","last_fullsized":"2024-09-14T12:10:04.791535+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.791431+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:20.658739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":27518,"num_write":1082,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.698872+0000","last_change":"2024-09-14T12:10:18.698872+0000","last_active":"2024-09-14T12:10:18.698872+0000","last_peered":"2024-09-14T12:10:18.698872+0000","last_clean":"2024-09-14T12:10:18.698872+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:10:18.698872+0000","last_undegraded":"2024-09-14T12:10:18.698872+0000","last_fullsized":"2024-09-14T12:10:18.698872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.698762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:25.328497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'483","reported_seq":1128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.266110+0000","last_change":"2024-09-14T12:10:20.266110+0000","last_active":"2024-09-14T12:10:20.266110+0000","last_peered":"2024-09-14T12:10:20.266110+0000","last_clean":"2024-09-14T12:10:20.266110+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:10:20.266110+0000","last_undegraded":"2024-09-14T12:10:20.266110+0000","last_fullsized":"2024-09-14T12:10:20.266110+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.265983+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:56.414346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100274,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":841,"num_read_kb":1995,"num_write":694,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.712406+0000","last_change":"2024-09-14T12:10:21.712406+0000","last_active":"2024-09-14T12:10:21.712406+0000","last_peered":"2024-09-14T12:10:21.712406+0000","last_clean":"2024-09-14T12:10:21.712406+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:10:21.712406+0000","last_undegraded":"2024-09-14T12:10:21.712406+0000","last_fullsized":"2024-09-14T12:10:21.712406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.712312+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.712312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:54.774758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'176","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.884994+0000","last_change":"2024-09-14T12:10:24.884994+0000","last_active":"2024-09-14T12:10:24.884994+0000","last_peered":"2024-09-14T12:10:24.884994+0000","last_clean":"2024-09-14T12:10:24.884994+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:10:24.884994+0000","last_undegraded":"2024-09-14T12:10:24.884994+0000","last_fullsized":"2024-09-14T12:10:24.884994+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:24.884849+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:24.884849+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.884849+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:18.793560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.864662+0000","last_change":"2024-09-14T12:10:05.864662+0000","last_active":"2024-09-14T12:10:05.864662+0000","last_peered":"2024-09-14T12:10:05.864662+0000","last_clean":"2024-09-14T12:10:05.864662+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:10:05.864662+0000","last_undegraded":"2024-09-14T12:10:05.864662+0000","last_fullsized":"2024-09-14T12:10:05.864662+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.864516+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'302","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.548905+0000","last_change":"2024-09-14T12:10:00.548905+0000","last_active":"2024-09-14T12:10:00.548905+0000","last_peered":"2024-09-14T12:10:00.548905+0000","last_clean":"2024-09-14T12:10:00.548905+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:10:00.548905+0000","last_undegraded":"2024-09-14T12:10:00.548905+0000","last_fullsized":"2024-09-14T12:10:00.548905+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.548789+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:47.038045+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":20886,"num_write":921,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.709439+0000","last_change":"2024-09-14T12:10:16.709439+0000","last_active":"2024-09-14T12:10:16.709439+0000","last_peered":"2024-09-14T12:10:16.709439+0000","last_clean":"2024-09-14T12:10:16.709439+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:10:16.709439+0000","last_undegraded":"2024-09-14T12:10:16.709439+0000","last_fullsized":"2024-09-14T12:10:16.709439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.709344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:41.114596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'287","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.116437+0000","last_change":"2024-09-14T12:10:24.116437+0000","last_active":"2024-09-14T12:10:24.116437+0000","last_peered":"2024-09-14T12:10:24.116437+0000","last_clean":"2024-09-14T12:10:24.116437+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:10:24.116437+0000","last_undegraded":"2024-09-14T12:10:24.116437+0000","last_fullsized":"2024-09-14T12:10:24.116437+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'287","last_scrub_stamp":"2024-09-14T12:10:24.116328+0000","last_deep_scrub":"265'287","last_deep_scrub_stamp":"2024-09-14T12:10:24.116328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.116328+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:29.318558+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.091785+0000","last_change":"2024-09-14T12:10:26.091785+0000","last_active":"2024-09-14T12:10:26.091785+0000","last_peered":"2024-09-14T12:10:26.091785+0000","last_clean":"2024-09-14T12:10:26.091785+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:10:26.091785+0000","last_undegraded":"2024-09-14T12:10:26.091785+0000","last_fullsized":"2024-09-14T12:10:26.091785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:26.091699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:26.091699+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.091699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:46.567994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.120762+0000","last_change":"2024-09-14T12:10:35.120762+0000","last_active":"2024-09-14T12:10:35.120762+0000","last_peered":"2024-09-14T12:10:35.120762+0000","last_clean":"2024-09-14T12:10:35.120762+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:10:35.120762+0000","last_undegraded":"2024-09-14T12:10:35.120762+0000","last_fullsized":"2024-09-14T12:10:35.120762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-14T12:10:35.120667+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-14T12:10:35.120667+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.120667+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:51.522650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.862166+0000","last_change":"2024-09-14T12:10:06.862166+0000","last_active":"2024-09-14T12:10:06.862166+0000","last_peered":"2024-09-14T12:10:06.862166+0000","last_clean":"2024-09-14T12:10:06.862166+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:10:06.862166+0000","last_undegraded":"2024-09-14T12:10:06.862166+0000","last_fullsized":"2024-09-14T12:10:06.862166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'87","last_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_deep_scrub":"265'87","last_deep_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.862087+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:39.538988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'354","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.319113+0000","last_change":"2024-09-14T12:10:03.319113+0000","last_active":"2024-09-14T12:10:03.319113+0000","last_peered":"2024-09-14T12:10:03.319113+0000","last_clean":"2024-09-14T12:10:03.319113+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:10:03.319113+0000","last_undegraded":"2024-09-14T12:10:03.319113+0000","last_fullsized":"2024-09-14T12:10:03.319113+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.318990+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:10.334308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":12874,"num_write":1161,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"265'6","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.772240+0000","last_change":"2024-09-14T12:10:15.772240+0000","last_active":"2024-09-14T12:10:15.772240+0000","last_peered":"2024-09-14T12:10:15.772240+0000","last_clean":"2024-09-14T12:10:15.772240+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:10:15.772240+0000","last_undegraded":"2024-09-14T12:10:15.772240+0000","last_fullsized":"2024-09-14T12:10:15.772240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.772157+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:51.427742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'323","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.688900+0000","last_change":"2024-09-14T12:10:17.688900+0000","last_active":"2024-09-14T12:10:17.688900+0000","last_peered":"2024-09-14T12:10:17.688900+0000","last_clean":"2024-09-14T12:10:17.688900+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:10:17.688900+0000","last_undegraded":"2024-09-14T12:10:17.688900+0000","last_fullsized":"2024-09-14T12:10:17.688900+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.688794+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.306543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'738","reported_seq":2487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.724781+0000","last_change":"2024-09-14T12:10:22.724781+0000","last_active":"2024-09-14T12:10:22.724781+0000","last_peered":"2024-09-14T12:10:22.724781+0000","last_clean":"2024-09-14T12:10:22.724781+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:10:22.724781+0000","last_undegraded":"2024-09-14T12:10:22.724781+0000","last_fullsized":"2024-09-14T12:10:22.724781+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'738","last_scrub_stamp":"2024-09-14T12:10:22.724704+0000","last_deep_scrub":"265'738","last_deep_scrub_stamp":"2024-09-14T12:10:22.724704+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.724704+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:32.922720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'143","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.908076+0000","last_change":"2024-09-14T12:10:28.908076+0000","last_active":"2024-09-14T12:10:28.908076+0000","last_peered":"2024-09-14T12:10:28.908076+0000","last_clean":"2024-09-14T12:10:28.908076+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:10:28.908076+0000","last_undegraded":"2024-09-14T12:10:28.908076+0000","last_fullsized":"2024-09-14T12:10:28.908076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-14T12:10:28.907985+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-14T12:10:28.907985+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.907985+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:26.854086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.861006+0000","last_change":"2024-09-14T12:10:07.861006+0000","last_active":"2024-09-14T12:10:07.861006+0000","last_peered":"2024-09-14T12:10:07.861006+0000","last_clean":"2024-09-14T12:10:07.861006+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:10:07.861006+0000","last_undegraded":"2024-09-14T12:10:07.861006+0000","last_fullsized":"2024-09-14T12:10:07.861006+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.860920+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:10.720698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'309","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.813691+0000","last_change":"2024-09-14T12:09:59.813691+0000","last_active":"2024-09-14T12:09:59.813691+0000","last_peered":"2024-09-14T12:09:59.813691+0000","last_clean":"2024-09-14T12:09:59.813691+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:59.813691+0000","last_undegraded":"2024-09-14T12:09:59.813691+0000","last_fullsized":"2024-09-14T12:09:59.813691+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.813558+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:42.477590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":37578,"num_write":940,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1471,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.646610+0000","last_change":"2024-09-14T12:10:22.646610+0000","last_active":"2024-09-14T12:10:22.646610+0000","last_peered":"2024-09-14T12:10:22.646610+0000","last_clean":"2024-09-14T12:10:22.646610+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:10:22.646610+0000","last_undegraded":"2024-09-14T12:10:22.646610+0000","last_fullsized":"2024-09-14T12:10:22.646610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:22.646521+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:22.646521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.646521+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:20.953885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'95","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.206287+0000","last_change":"2024-09-14T12:10:24.206287+0000","last_active":"2024-09-14T12:10:24.206287+0000","last_peered":"2024-09-14T12:10:24.206287+0000","last_clean":"2024-09-14T12:10:24.206287+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:10:24.206287+0000","last_undegraded":"2024-09-14T12:10:24.206287+0000","last_fullsized":"2024-09-14T12:10:24.206287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-14T12:10:24.206188+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-14T12:10:24.206188+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.206188+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:01.065950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'775","reported_seq":2480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.399320+0000","last_change":"2024-09-14T12:10:18.399320+0000","last_active":"2024-09-14T12:10:18.399320+0000","last_peered":"2024-09-14T12:10:18.399320+0000","last_clean":"2024-09-14T12:10:18.399320+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:10:18.399320+0000","last_undegraded":"2024-09-14T12:10:18.399320+0000","last_fullsized":"2024-09-14T12:10:18.399320+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'775","last_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_deep_scrub":"265'775","last_deep_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.399218+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:25.017139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.019590+0000","last_change":"2024-09-14T12:10:33.019590+0000","last_active":"2024-09-14T12:10:33.019590+0000","last_peered":"2024-09-14T12:10:33.019590+0000","last_clean":"2024-09-14T12:10:33.019590+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:10:33.019590+0000","last_undegraded":"2024-09-14T12:10:33.019590+0000","last_fullsized":"2024-09-14T12:10:33.019590+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-14T12:10:33.019500+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-14T12:10:33.019500+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.019500+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:04.431083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'142","reported_seq":744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.733075+0000","last_change":"2024-09-14T12:10:11.733075+0000","last_active":"2024-09-14T12:10:11.733075+0000","last_peered":"2024-09-14T12:10:11.733075+0000","last_clean":"2024-09-14T12:10:11.733075+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:10:11.733075+0000","last_undegraded":"2024-09-14T12:10:11.733075+0000","last_fullsized":"2024-09-14T12:10:11.733075+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.732986+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.340583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1083,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.032758+0000","last_change":"2024-09-14T12:10:05.032758+0000","last_active":"2024-09-14T12:10:05.032758+0000","last_peered":"2024-09-14T12:10:05.032758+0000","last_clean":"2024-09-14T12:10:05.032758+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:10:05.032758+0000","last_undegraded":"2024-09-14T12:10:05.032758+0000","last_fullsized":"2024-09-14T12:10:05.032758+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.032635+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:23.135116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.013381+0000","last_change":"2024-09-14T12:10:20.013381+0000","last_active":"2024-09-14T12:10:20.013381+0000","last_peered":"2024-09-14T12:10:20.013381+0000","last_clean":"2024-09-14T12:10:20.013381+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:10:20.013381+0000","last_undegraded":"2024-09-14T12:10:20.013381+0000","last_fullsized":"2024-09-14T12:10:20.013381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.013295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.013295+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.013295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:44.013025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'363","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.661632+0000","last_change":"2024-09-14T12:10:27.661632+0000","last_active":"2024-09-14T12:10:27.661632+0000","last_peered":"2024-09-14T12:10:27.661632+0000","last_clean":"2024-09-14T12:10:27.661632+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:10:27.661632+0000","last_undegraded":"2024-09-14T12:10:27.661632+0000","last_fullsized":"2024-09-14T12:10:27.661632+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-14T12:10:27.661537+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-14T12:10:27.661537+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.661537+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:11.232522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.399470+0000","last_change":"2024-09-14T12:10:17.399470+0000","last_active":"2024-09-14T12:10:17.399470+0000","last_peered":"2024-09-14T12:10:17.399470+0000","last_clean":"2024-09-14T12:10:17.399470+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:10:17.399470+0000","last_undegraded":"2024-09-14T12:10:17.399470+0000","last_fullsized":"2024-09-14T12:10:17.399470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.399343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:00.798907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.870379+0000","last_change":"2024-09-14T12:10:23.870379+0000","last_active":"2024-09-14T12:10:23.870379+0000","last_peered":"2024-09-14T12:10:23.870379+0000","last_clean":"2024-09-14T12:10:23.870379+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:10:23.870379+0000","last_undegraded":"2024-09-14T12:10:23.870379+0000","last_fullsized":"2024-09-14T12:10:23.870379+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-14T12:10:23.870301+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-14T12:10:23.870301+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.870301+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.006161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'106","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.223843+0000","last_change":"2024-09-14T12:10:07.223843+0000","last_active":"2024-09-14T12:10:07.223843+0000","last_peered":"2024-09-14T12:10:07.223843+0000","last_clean":"2024-09-14T12:10:07.223843+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:10:07.223843+0000","last_undegraded":"2024-09-14T12:10:07.223843+0000","last_fullsized":"2024-09-14T12:10:07.223843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.223720+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:16.297510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.260893+0000","last_change":"2024-09-14T12:10:01.260893+0000","last_active":"2024-09-14T12:10:01.260893+0000","last_peered":"2024-09-14T12:10:01.260893+0000","last_clean":"2024-09-14T12:10:01.260893+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:10:01.260893+0000","last_undegraded":"2024-09-14T12:10:01.260893+0000","last_fullsized":"2024-09-14T12:10:01.260893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.260776+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:12.451761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.799298+0000","last_change":"2024-09-14T12:10:02.799298+0000","last_active":"2024-09-14T12:10:02.799298+0000","last_peered":"2024-09-14T12:10:02.799298+0000","last_clean":"2024-09-14T12:10:02.799298+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:10:02.799298+0000","last_undegraded":"2024-09-14T12:10:02.799298+0000","last_fullsized":"2024-09-14T12:10:02.799298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.799218+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:43.571584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.019453+0000","last_change":"2024-09-14T12:10:01.019453+0000","last_active":"2024-09-14T12:10:01.019453+0000","last_peered":"2024-09-14T12:10:01.019453+0000","last_clean":"2024-09-14T12:10:01.019453+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:10:01.019453+0000","last_undegraded":"2024-09-14T12:10:01.019453+0000","last_fullsized":"2024-09-14T12:10:01.019453+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.019366+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:16.170494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":21923,"num_write":1076,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.567257+0000","last_change":"2024-09-14T12:10:20.567257+0000","last_active":"2024-09-14T12:10:20.567257+0000","last_peered":"2024-09-14T12:10:20.567257+0000","last_clean":"2024-09-14T12:10:20.567257+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:10:20.567257+0000","last_undegraded":"2024-09-14T12:10:20.567257+0000","last_fullsized":"2024-09-14T12:10:20.567257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.567143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.567143+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.567143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:31.859917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'768","reported_seq":1488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.645340+0000","last_change":"2024-09-14T12:10:26.645340+0000","last_active":"2024-09-14T12:10:26.645340+0000","last_peered":"2024-09-14T12:10:26.645340+0000","last_clean":"2024-09-14T12:10:26.645340+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:10:26.645340+0000","last_undegraded":"2024-09-14T12:10:26.645340+0000","last_fullsized":"2024-09-14T12:10:26.645340+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-14T12:10:26.645214+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-14T12:10:26.645214+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.645214+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:28.785218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89194,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.161498+0000","last_change":"2024-09-14T12:10:24.161498+0000","last_active":"2024-09-14T12:10:24.161498+0000","last_peered":"2024-09-14T12:10:24.161498+0000","last_clean":"2024-09-14T12:10:24.161498+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:10:24.161498+0000","last_undegraded":"2024-09-14T12:10:24.161498+0000","last_fullsized":"2024-09-14T12:10:24.161498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:24.161412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:24.161412+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.161412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:39.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.421056+0000","last_change":"2024-09-14T12:10:22.421056+0000","last_active":"2024-09-14T12:10:22.421056+0000","last_peered":"2024-09-14T12:10:22.421056+0000","last_clean":"2024-09-14T12:10:22.421056+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:10:22.421056+0000","last_undegraded":"2024-09-14T12:10:22.421056+0000","last_fullsized":"2024-09-14T12:10:22.421056+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:22.420953+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:22.420953+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.420953+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:22.371086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.075205+0000","last_change":"2024-09-14T12:10:08.075205+0000","last_active":"2024-09-14T12:10:08.075205+0000","last_peered":"2024-09-14T12:10:08.075205+0000","last_clean":"2024-09-14T12:10:08.075205+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:10:08.075205+0000","last_undegraded":"2024-09-14T12:10:08.075205+0000","last_fullsized":"2024-09-14T12:10:08.075205+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.075089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:14.415988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.224677+0000","last_change":"2024-09-14T12:10:04.224677+0000","last_active":"2024-09-14T12:10:04.224677+0000","last_peered":"2024-09-14T12:10:04.224677+0000","last_clean":"2024-09-14T12:10:04.224677+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:10:04.224677+0000","last_undegraded":"2024-09-14T12:10:04.224677+0000","last_fullsized":"2024-09-14T12:10:04.224677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.224592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.747913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.014417+0000","last_change":"2024-09-14T12:10:00.014417+0000","last_active":"2024-09-14T12:10:00.014417+0000","last_peered":"2024-09-14T12:10:00.014417+0000","last_clean":"2024-09-14T12:10:00.014417+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:10:00.014417+0000","last_undegraded":"2024-09-14T12:10:00.014417+0000","last_fullsized":"2024-09-14T12:10:00.014417+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.014290+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:59.265225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":48298,"num_write":1181,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.673611+0000","last_change":"2024-09-14T12:10:21.673611+0000","last_active":"2024-09-14T12:10:21.673611+0000","last_peered":"2024-09-14T12:10:21.673611+0000","last_clean":"2024-09-14T12:10:21.673611+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:10:21.673611+0000","last_undegraded":"2024-09-14T12:10:21.673611+0000","last_fullsized":"2024-09-14T12:10:21.673611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.673525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.673525+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.673525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:37.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1284","reported_seq":2929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.805274+0000","last_change":"2024-09-14T12:10:18.805274+0000","last_active":"2024-09-14T12:10:18.805274+0000","last_peered":"2024-09-14T12:10:18.805274+0000","last_clean":"2024-09-14T12:10:18.805274+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:10:18.805274+0000","last_undegraded":"2024-09-14T12:10:18.805274+0000","last_fullsized":"2024-09-14T12:10:18.805274+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1284","last_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_deep_scrub":"265'1284","last_deep_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.805160+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":1200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:19.969704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140197,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2031,"num_read_kb":3753,"num_write":1136,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.455486+0000","last_change":"2024-09-14T12:10:30.455486+0000","last_active":"2024-09-14T12:10:30.455486+0000","last_peered":"2024-09-14T12:10:30.455486+0000","last_clean":"2024-09-14T12:10:30.455486+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:10:30.455486+0000","last_undegraded":"2024-09-14T12:10:30.455486+0000","last_fullsized":"2024-09-14T12:10:30.455486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.455395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.455395+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.455395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:27.833412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'222","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.908479+0000","last_change":"2024-09-14T12:10:25.908479+0000","last_active":"2024-09-14T12:10:25.908479+0000","last_peered":"2024-09-14T12:10:25.908479+0000","last_clean":"2024-09-14T12:10:25.908479+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:10:25.908479+0000","last_undegraded":"2024-09-14T12:10:25.908479+0000","last_fullsized":"2024-09-14T12:10:25.908479+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-14T12:10:25.908376+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-14T12:10:25.908376+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.908376+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.573130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.817859+0000","last_change":"2024-09-14T12:10:07.817859+0000","last_active":"2024-09-14T12:10:07.817859+0000","last_peered":"2024-09-14T12:10:07.817859+0000","last_clean":"2024-09-14T12:10:07.817859+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:10:07.817859+0000","last_undegraded":"2024-09-14T12:10:07.817859+0000","last_fullsized":"2024-09-14T12:10:07.817859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.817764+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.265513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.586595+0000","last_change":"2024-09-14T12:09:59.586595+0000","last_active":"2024-09-14T12:09:59.586595+0000","last_peered":"2024-09-14T12:09:59.586595+0000","last_clean":"2024-09-14T12:09:59.586595+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:09:59.586595+0000","last_undegraded":"2024-09-14T12:09:59.586595+0000","last_fullsized":"2024-09-14T12:09:59.586595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.586474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:31.075728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'377","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.870135+0000","last_change":"2024-09-14T12:09:58.870135+0000","last_active":"2024-09-14T12:09:58.870135+0000","last_peered":"2024-09-14T12:09:58.870135+0000","last_clean":"2024-09-14T12:09:58.870135+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:09:58.870135+0000","last_undegraded":"2024-09-14T12:09:58.870135+0000","last_fullsized":"2024-09-14T12:09:58.870135+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.870049+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:28.701680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":652,"num_read_kb":34638,"num_write":1221,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.670856+0000","last_change":"2024-09-14T12:10:11.670856+0000","last_active":"2024-09-14T12:10:11.670856+0000","last_peered":"2024-09-14T12:10:11.670856+0000","last_clean":"2024-09-14T12:10:11.670856+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:10:11.670856+0000","last_undegraded":"2024-09-14T12:10:11.670856+0000","last_fullsized":"2024-09-14T12:10:11.670856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.670773+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:07.716742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'255","reported_seq":1500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.523542+0000","last_change":"2024-09-14T12:10:24.523542+0000","last_active":"2024-09-14T12:10:24.523542+0000","last_peered":"2024-09-14T12:10:24.523542+0000","last_clean":"2024-09-14T12:10:24.523542+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:10:24.523542+0000","last_undegraded":"2024-09-14T12:10:24.523542+0000","last_fullsized":"2024-09-14T12:10:24.523542+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'255","last_scrub_stamp":"2024-09-14T12:10:24.523451+0000","last_deep_scrub":"265'255","last_deep_scrub_stamp":"2024-09-14T12:10:24.523451+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.523451+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:13.202729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.108167+0000","last_change":"2024-09-14T12:10:27.108167+0000","last_active":"2024-09-14T12:10:27.108167+0000","last_peered":"2024-09-14T12:10:27.108167+0000","last_clean":"2024-09-14T12:10:27.108167+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:10:27.108167+0000","last_undegraded":"2024-09-14T12:10:27.108167+0000","last_fullsized":"2024-09-14T12:10:27.108167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:27.108062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:27.108062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.108062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:02.428040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'242","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.122139+0000","last_change":"2024-09-14T12:10:34.122139+0000","last_active":"2024-09-14T12:10:34.122139+0000","last_peered":"2024-09-14T12:10:34.122139+0000","last_clean":"2024-09-14T12:10:34.122139+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:10:34.122139+0000","last_undegraded":"2024-09-14T12:10:34.122139+0000","last_fullsized":"2024-09-14T12:10:34.122139+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-14T12:10:34.122053+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-14T12:10:34.122053+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.122053+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:35.602598+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.796640+0000","last_change":"2024-09-14T12:10:04.796640+0000","last_active":"2024-09-14T12:10:04.796640+0000","last_peered":"2024-09-14T12:10:04.796640+0000","last_clean":"2024-09-14T12:10:04.796640+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:10:04.796640+0000","last_undegraded":"2024-09-14T12:10:04.796640+0000","last_fullsized":"2024-09-14T12:10:04.796640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.796540+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:34.364854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.780661+0000","last_change":"2024-09-14T12:10:01.780661+0000","last_active":"2024-09-14T12:10:01.780661+0000","last_peered":"2024-09-14T12:10:01.780661+0000","last_clean":"2024-09-14T12:10:01.780661+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:10:01.780661+0000","last_undegraded":"2024-09-14T12:10:01.780661+0000","last_fullsized":"2024-09-14T12:10:01.780661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.780573+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:54.383561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'320","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.820112+0000","last_change":"2024-09-14T12:10:00.820112+0000","last_active":"2024-09-14T12:10:00.820112+0000","last_peered":"2024-09-14T12:10:00.820112+0000","last_clean":"2024-09-14T12:10:00.820112+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:10:00.820112+0000","last_undegraded":"2024-09-14T12:10:00.820112+0000","last_fullsized":"2024-09-14T12:10:00.820112+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.820017+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:02.962307+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":663,"num_read_kb":8841,"num_write":1009,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"265'4","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.278392+0000","last_change":"2024-09-14T12:10:17.278392+0000","last_active":"2024-09-14T12:10:17.278392+0000","last_peered":"2024-09-14T12:10:17.278392+0000","last_clean":"2024-09-14T12:10:17.278392+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:10:17.278392+0000","last_undegraded":"2024-09-14T12:10:17.278392+0000","last_fullsized":"2024-09-14T12:10:17.278392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.278291+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.269121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'148","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.221325+0000","last_change":"2024-09-14T12:10:22.221325+0000","last_active":"2024-09-14T12:10:22.221325+0000","last_peered":"2024-09-14T12:10:22.221325+0000","last_clean":"2024-09-14T12:10:22.221325+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:10:22.221325+0000","last_undegraded":"2024-09-14T12:10:22.221325+0000","last_fullsized":"2024-09-14T12:10:22.221325+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'148","last_scrub_stamp":"2024-09-14T12:10:22.221256+0000","last_deep_scrub":"265'148","last_deep_scrub_stamp":"2024-09-14T12:10:22.221256+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.221256+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:43.118211+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.368105+0000","last_change":"2024-09-14T12:10:16.368105+0000","last_active":"2024-09-14T12:10:16.368105+0000","last_peered":"2024-09-14T12:10:16.368105+0000","last_clean":"2024-09-14T12:10:16.368105+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:10:16.368105+0000","last_undegraded":"2024-09-14T12:10:16.368105+0000","last_fullsized":"2024-09-14T12:10:16.368105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.368014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:07.077831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.539885+0000","last_change":"2024-09-14T12:10:33.539885+0000","last_active":"2024-09-14T12:10:33.539885+0000","last_peered":"2024-09-14T12:10:33.539885+0000","last_clean":"2024-09-14T12:10:33.539885+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:10:33.539885+0000","last_undegraded":"2024-09-14T12:10:33.539885+0000","last_fullsized":"2024-09-14T12:10:33.539885+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-14T12:10:33.539802+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-14T12:10:33.539802+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.539802+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:54.946538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.609490+0000","last_change":"2024-09-14T12:10:06.609490+0000","last_active":"2024-09-14T12:10:06.609490+0000","last_peered":"2024-09-14T12:10:06.609490+0000","last_clean":"2024-09-14T12:10:06.609490+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:10:06.609490+0000","last_undegraded":"2024-09-14T12:10:06.609490+0000","last_fullsized":"2024-09-14T12:10:06.609490+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.609384+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:45.973252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.734129+0000","last_change":"2024-09-14T12:10:00.734129+0000","last_active":"2024-09-14T12:10:00.734129+0000","last_peered":"2024-09-14T12:10:00.734129+0000","last_clean":"2024-09-14T12:10:00.734129+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:10:00.734129+0000","last_undegraded":"2024-09-14T12:10:00.734129+0000","last_fullsized":"2024-09-14T12:10:00.734129+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.734031+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:49.843097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.821103+0000","last_change":"2024-09-14T12:10:00.821103+0000","last_active":"2024-09-14T12:10:00.821103+0000","last_peered":"2024-09-14T12:10:00.821103+0000","last_clean":"2024-09-14T12:10:00.821103+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:10:00.821103+0000","last_undegraded":"2024-09-14T12:10:00.821103+0000","last_fullsized":"2024-09-14T12:10:00.821103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.821034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:21.167595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.242975+0000","last_change":"2024-09-14T12:10:19.242975+0000","last_active":"2024-09-14T12:10:19.242975+0000","last_peered":"2024-09-14T12:10:19.242975+0000","last_clean":"2024-09-14T12:10:19.242975+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:10:19.242975+0000","last_undegraded":"2024-09-14T12:10:19.242975+0000","last_fullsized":"2024-09-14T12:10:19.242975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.242892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:59.906575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1280,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.247855+0000","last_change":"2024-09-14T12:10:18.247855+0000","last_active":"2024-09-14T12:10:18.247855+0000","last_peered":"2024-09-14T12:10:18.247855+0000","last_clean":"2024-09-14T12:10:18.247855+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:10:18.247855+0000","last_undegraded":"2024-09-14T12:10:18.247855+0000","last_fullsized":"2024-09-14T12:10:18.247855+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'599","last_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_deep_scrub":"265'599","last_deep_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.247734+0000","objects_scrubbed":10,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:14.437465+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1669,"num_read_kb":2890,"num_write":2218,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537664,"num_omap_keys":1218,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.093496+0000","last_change":"2024-09-14T12:10:30.093496+0000","last_active":"2024-09-14T12:10:30.093496+0000","last_peered":"2024-09-14T12:10:30.093496+0000","last_clean":"2024-09-14T12:10:30.093496+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:10:30.093496+0000","last_undegraded":"2024-09-14T12:10:30.093496+0000","last_fullsized":"2024-09-14T12:10:30.093496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.093402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.093402+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.093402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:12.239531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'126","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.227318+0000","last_change":"2024-09-14T12:10:34.227318+0000","last_active":"2024-09-14T12:10:34.227318+0000","last_peered":"2024-09-14T12:10:34.227318+0000","last_clean":"2024-09-14T12:10:34.227318+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:10:34.227318+0000","last_undegraded":"2024-09-14T12:10:34.227318+0000","last_fullsized":"2024-09-14T12:10:34.227318+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-14T12:10:34.227217+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-14T12:10:34.227217+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.227217+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:34.630736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.057475+0000","last_change":"2024-09-14T12:10:07.057475+0000","last_active":"2024-09-14T12:10:07.057475+0000","last_peered":"2024-09-14T12:10:07.057475+0000","last_clean":"2024-09-14T12:10:07.057475+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:10:07.057475+0000","last_undegraded":"2024-09-14T12:10:07.057475+0000","last_fullsized":"2024-09-14T12:10:07.057475+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.057369+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:52.846935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'378","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.805142+0000","last_change":"2024-09-14T12:10:01.805142+0000","last_active":"2024-09-14T12:10:01.805142+0000","last_peered":"2024-09-14T12:10:01.805142+0000","last_clean":"2024-09-14T12:10:01.805142+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:10:01.805142+0000","last_undegraded":"2024-09-14T12:10:01.805142+0000","last_fullsized":"2024-09-14T12:10:01.805142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.805035+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:40.071458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":671,"num_read_kb":35559,"num_write":1182,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.234636+0000","last_change":"2024-09-14T12:10:02.234636+0000","last_active":"2024-09-14T12:10:02.234636+0000","last_peered":"2024-09-14T12:10:02.234636+0000","last_clean":"2024-09-14T12:10:02.234636+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:10:02.234636+0000","last_undegraded":"2024-09-14T12:10:02.234636+0000","last_fullsized":"2024-09-14T12:10:02.234636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.234555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.749698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.293819+0000","last_change":"2024-09-14T12:10:13.293819+0000","last_active":"2024-09-14T12:10:13.293819+0000","last_peered":"2024-09-14T12:10:13.293819+0000","last_clean":"2024-09-14T12:10:13.293819+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:10:13.293819+0000","last_undegraded":"2024-09-14T12:10:13.293819+0000","last_fullsized":"2024-09-14T12:10:13.293819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.293717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:44.892162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.763162+0000","last_change":"2024-09-14T12:10:17.763162+0000","last_active":"2024-09-14T12:10:17.763162+0000","last_peered":"2024-09-14T12:10:17.763162+0000","last_clean":"2024-09-14T12:10:17.763162+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:10:17.763162+0000","last_undegraded":"2024-09-14T12:10:17.763162+0000","last_fullsized":"2024-09-14T12:10:17.763162+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.763047+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:11.047981+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.618674+0000","last_change":"2024-09-14T12:10:31.618674+0000","last_active":"2024-09-14T12:10:31.618674+0000","last_peered":"2024-09-14T12:10:31.618674+0000","last_clean":"2024-09-14T12:10:31.618674+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:10:31.618674+0000","last_undegraded":"2024-09-14T12:10:31.618674+0000","last_fullsized":"2024-09-14T12:10:31.618674+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-14T12:10:31.618581+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-14T12:10:31.618581+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.618581+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.564737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'125","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.173064+0000","last_change":"2024-09-14T12:10:39.173064+0000","last_active":"2024-09-14T12:10:39.173064+0000","last_peered":"2024-09-14T12:10:39.173064+0000","last_clean":"2024-09-14T12:10:39.173064+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:10:39.173064+0000","last_undegraded":"2024-09-14T12:10:39.173064+0000","last_fullsized":"2024-09-14T12:10:39.173064+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-14T12:10:39.172981+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-14T12:10:39.172981+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.172981+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:49.444193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.112509+0000","last_change":"2024-09-14T12:10:08.112509+0000","last_active":"2024-09-14T12:10:08.112509+0000","last_peered":"2024-09-14T12:10:08.112509+0000","last_clean":"2024-09-14T12:10:08.112509+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:10:08.112509+0000","last_undegraded":"2024-09-14T12:10:08.112509+0000","last_fullsized":"2024-09-14T12:10:08.112509+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.112409+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:09.821615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.001125+0000","last_change":"2024-09-14T12:10:00.001125+0000","last_active":"2024-09-14T12:10:00.001125+0000","last_peered":"2024-09-14T12:10:00.001125+0000","last_clean":"2024-09-14T12:10:00.001125+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:10:00.001125+0000","last_undegraded":"2024-09-14T12:10:00.001125+0000","last_fullsized":"2024-09-14T12:10:00.001125+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.001028+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.912729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.836980+0000","last_change":"2024-09-14T12:09:59.836980+0000","last_active":"2024-09-14T12:09:59.836980+0000","last_peered":"2024-09-14T12:09:59.836980+0000","last_clean":"2024-09-14T12:09:59.836980+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:09:59.836980+0000","last_undegraded":"2024-09-14T12:09:59.836980+0000","last_fullsized":"2024-09-14T12:09:59.836980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.836907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:32.571263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.062743+0000","last_change":"2024-09-14T12:10:21.062743+0000","last_active":"2024-09-14T12:10:21.062743+0000","last_peered":"2024-09-14T12:10:21.062743+0000","last_clean":"2024-09-14T12:10:21.062743+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:10:21.062743+0000","last_undegraded":"2024-09-14T12:10:21.062743+0000","last_fullsized":"2024-09-14T12:10:21.062743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.062656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.062656+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.062656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:51.112747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'125","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.142508+0000","last_change":"2024-09-14T12:10:25.142508+0000","last_active":"2024-09-14T12:10:25.142508+0000","last_peered":"2024-09-14T12:10:25.142508+0000","last_clean":"2024-09-14T12:10:25.142508+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:10:25.142508+0000","last_undegraded":"2024-09-14T12:10:25.142508+0000","last_fullsized":"2024-09-14T12:10:25.142508+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-14T12:10:25.142414+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-14T12:10:25.142414+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.142414+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:59.124812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'793","reported_seq":6731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.182101+0000","last_change":"2024-09-14T12:10:28.182101+0000","last_active":"2024-09-14T12:10:28.182101+0000","last_peered":"2024-09-14T12:10:28.182101+0000","last_clean":"2024-09-14T12:10:28.182101+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:10:28.182101+0000","last_undegraded":"2024-09-14T12:10:28.182101+0000","last_fullsized":"2024-09-14T12:10:28.182101+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-14T12:10:28.182006+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-14T12:10:28.182006+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.182006+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:08.785563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'217","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.167503+0000","last_change":"2024-09-14T12:10:31.167503+0000","last_active":"2024-09-14T12:10:31.167503+0000","last_peered":"2024-09-14T12:10:31.167503+0000","last_clean":"2024-09-14T12:10:31.167503+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:10:31.167503+0000","last_undegraded":"2024-09-14T12:10:31.167503+0000","last_fullsized":"2024-09-14T12:10:31.167503+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-14T12:10:31.167362+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-14T12:10:31.167362+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.167362+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.614038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.833148+0000","last_change":"2024-09-14T12:10:02.833148+0000","last_active":"2024-09-14T12:10:02.833148+0000","last_peered":"2024-09-14T12:10:02.833148+0000","last_clean":"2024-09-14T12:10:02.833148+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:10:02.833148+0000","last_undegraded":"2024-09-14T12:10:02.833148+0000","last_fullsized":"2024-09-14T12:10:02.833148+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4144","last_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_deep_scrub":"265'4144","last_deep_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.833062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:50.518946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'380","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.549372+0000","last_change":"2024-09-14T12:10:03.549302+0000","last_active":"2024-09-14T12:10:03.549372+0000","last_peered":"2024-09-14T12:10:03.549372+0000","last_clean":"2024-09-14T12:10:03.549372+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:10:03.549372+0000","last_undegraded":"2024-09-14T12:10:03.549372+0000","last_fullsized":"2024-09-14T12:10:03.549372+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.549195+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:33.120720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":5405,"num_write":1192,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.355045+0000","last_change":"2024-09-14T12:10:01.355045+0000","last_active":"2024-09-14T12:10:01.355045+0000","last_peered":"2024-09-14T12:10:01.355045+0000","last_clean":"2024-09-14T12:10:01.355045+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:10:01.355045+0000","last_undegraded":"2024-09-14T12:10:01.355045+0000","last_fullsized":"2024-09-14T12:10:01.355045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.354958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:25.192772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.241169+0000","last_change":"2024-09-14T12:10:18.241169+0000","last_active":"2024-09-14T12:10:18.241169+0000","last_peered":"2024-09-14T12:10:18.241169+0000","last_clean":"2024-09-14T12:10:18.241169+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:10:18.241169+0000","last_undegraded":"2024-09-14T12:10:18.241169+0000","last_fullsized":"2024-09-14T12:10:18.241169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.241011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:36.998156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'800","reported_seq":1530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.571305+0000","last_change":"2024-09-14T12:10:22.571305+0000","last_active":"2024-09-14T12:10:22.571305+0000","last_peered":"2024-09-14T12:10:22.571305+0000","last_clean":"2024-09-14T12:10:22.571305+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:10:22.571305+0000","last_undegraded":"2024-09-14T12:10:22.571305+0000","last_fullsized":"2024-09-14T12:10:22.571305+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'800","last_scrub_stamp":"2024-09-14T12:10:22.571194+0000","last_deep_scrub":"265'800","last_deep_scrub_stamp":"2024-09-14T12:10:22.571194+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.571194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.338770+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.173127+0000","last_change":"2024-09-14T12:10:29.173127+0000","last_active":"2024-09-14T12:10:29.173127+0000","last_peered":"2024-09-14T12:10:29.173127+0000","last_clean":"2024-09-14T12:10:29.173127+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:10:29.173127+0000","last_undegraded":"2024-09-14T12:10:29.173127+0000","last_fullsized":"2024-09-14T12:10:29.173127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.173026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.173026+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.173026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.984503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'149","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.569999+0000","last_change":"2024-09-14T12:10:34.569999+0000","last_active":"2024-09-14T12:10:34.569999+0000","last_peered":"2024-09-14T12:10:34.569999+0000","last_clean":"2024-09-14T12:10:34.569999+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:10:34.569999+0000","last_undegraded":"2024-09-14T12:10:34.569999+0000","last_fullsized":"2024-09-14T12:10:34.569999+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'149","last_scrub_stamp":"2024-09-14T12:10:34.569906+0000","last_deep_scrub":"265'149","last_deep_scrub_stamp":"2024-09-14T12:10:34.569906+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.569906+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:33.194573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.198485+0000","last_change":"2024-09-14T12:10:35.198485+0000","last_active":"2024-09-14T12:10:35.198485+0000","last_peered":"2024-09-14T12:10:35.198485+0000","last_clean":"2024-09-14T12:10:35.198485+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:10:35.198485+0000","last_undegraded":"2024-09-14T12:10:35.198485+0000","last_fullsized":"2024-09-14T12:10:35.198485+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-14T12:10:35.198397+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-14T12:10:35.198397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.198397+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.366891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.867191+0000","last_change":"2024-09-14T12:10:10.867191+0000","last_active":"2024-09-14T12:10:10.867191+0000","last_peered":"2024-09-14T12:10:10.867191+0000","last_clean":"2024-09-14T12:10:10.867191+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:10:10.867191+0000","last_undegraded":"2024-09-14T12:10:10.867191+0000","last_fullsized":"2024-09-14T12:10:10.867191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.867096+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:37.567590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'349","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.790676+0000","last_change":"2024-09-14T12:10:01.790676+0000","last_active":"2024-09-14T12:10:01.790676+0000","last_peered":"2024-09-14T12:10:01.790676+0000","last_clean":"2024-09-14T12:10:01.790676+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:10:01.790676+0000","last_undegraded":"2024-09-14T12:10:01.790676+0000","last_fullsized":"2024-09-14T12:10:01.790676+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.790549+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.092776+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":5106,"num_write":1232,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.730899+0000","last_change":"2024-09-14T12:10:12.730899+0000","last_active":"2024-09-14T12:10:12.730899+0000","last_peered":"2024-09-14T12:10:12.730899+0000","last_clean":"2024-09-14T12:10:12.730899+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:10:12.730899+0000","last_undegraded":"2024-09-14T12:10:12.730899+0000","last_fullsized":"2024-09-14T12:10:12.730899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.730806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:09.075497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'329","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.171310+0000","last_change":"2024-09-14T12:10:25.171310+0000","last_active":"2024-09-14T12:10:25.171310+0000","last_peered":"2024-09-14T12:10:25.171310+0000","last_clean":"2024-09-14T12:10:25.171310+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:10:25.171310+0000","last_undegraded":"2024-09-14T12:10:25.171310+0000","last_fullsized":"2024-09-14T12:10:25.171310+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-14T12:10:25.171217+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-14T12:10:25.171217+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.171217+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:27.217163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.169739+0000","last_change":"2024-09-14T12:10:32.169739+0000","last_active":"2024-09-14T12:10:32.169739+0000","last_peered":"2024-09-14T12:10:32.169739+0000","last_clean":"2024-09-14T12:10:32.169739+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:10:32.169739+0000","last_undegraded":"2024-09-14T12:10:32.169739+0000","last_fullsized":"2024-09-14T12:10:32.169739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.169632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.169632+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.169632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:21.976939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'133","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.122891+0000","last_change":"2024-09-14T12:10:38.122891+0000","last_active":"2024-09-14T12:10:38.122891+0000","last_peered":"2024-09-14T12:10:38.122891+0000","last_clean":"2024-09-14T12:10:38.122891+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:10:38.122891+0000","last_undegraded":"2024-09-14T12:10:38.122891+0000","last_fullsized":"2024-09-14T12:10:38.122891+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:38.122784+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:38.122784+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.122784+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.978913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.818239+0000","last_change":"2024-09-14T12:10:08.818239+0000","last_active":"2024-09-14T12:10:08.818239+0000","last_peered":"2024-09-14T12:10:08.818239+0000","last_clean":"2024-09-14T12:10:08.818239+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:10:08.818239+0000","last_undegraded":"2024-09-14T12:10:08.818239+0000","last_fullsized":"2024-09-14T12:10:08.818239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.818146+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:58.032521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'348","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.325150+0000","last_change":"2024-09-14T12:10:08.325150+0000","last_active":"2024-09-14T12:10:08.325150+0000","last_peered":"2024-09-14T12:10:08.325150+0000","last_clean":"2024-09-14T12:10:08.325150+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:10:08.325150+0000","last_undegraded":"2024-09-14T12:10:08.325150+0000","last_fullsized":"2024-09-14T12:10:08.325150+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.325054+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:38.981426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":33435,"num_write":1030,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.215844+0000","last_change":"2024-09-14T12:10:19.215844+0000","last_active":"2024-09-14T12:10:19.215844+0000","last_peered":"2024-09-14T12:10:19.215844+0000","last_clean":"2024-09-14T12:10:19.215844+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:10:19.215844+0000","last_undegraded":"2024-09-14T12:10:19.215844+0000","last_fullsized":"2024-09-14T12:10:19.215844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.215754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:04.064105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'50","reported_seq":565,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.282515+0000","last_change":"2024-09-14T12:10:21.282515+0000","last_active":"2024-09-14T12:10:21.282515+0000","last_peered":"2024-09-14T12:10:21.282515+0000","last_clean":"2024-09-14T12:10:21.282515+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:10:21.282515+0000","last_undegraded":"2024-09-14T12:10:21.282515+0000","last_fullsized":"2024-09-14T12:10:21.282515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-14T12:10:21.282415+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-14T12:10:21.282415+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.282415+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:42.993531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.488546+0000","last_change":"2024-09-14T12:10:29.488546+0000","last_active":"2024-09-14T12:10:29.488546+0000","last_peered":"2024-09-14T12:10:29.488546+0000","last_clean":"2024-09-14T12:10:29.488546+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:10:29.488546+0000","last_undegraded":"2024-09-14T12:10:29.488546+0000","last_fullsized":"2024-09-14T12:10:29.488546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.488380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.488380+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.488380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:15.572534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'254","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.184053+0000","last_change":"2024-09-14T12:10:33.184053+0000","last_active":"2024-09-14T12:10:33.184053+0000","last_peered":"2024-09-14T12:10:33.184053+0000","last_clean":"2024-09-14T12:10:33.184053+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:10:33.184053+0000","last_undegraded":"2024-09-14T12:10:33.184053+0000","last_fullsized":"2024-09-14T12:10:33.184053+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-14T12:10:33.183967+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-14T12:10:33.183967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.183967+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:05.916700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.069541+0000","last_change":"2024-09-14T12:10:09.069541+0000","last_active":"2024-09-14T12:10:09.069541+0000","last_peered":"2024-09-14T12:10:09.069541+0000","last_clean":"2024-09-14T12:10:09.069541+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:10:09.069541+0000","last_undegraded":"2024-09-14T12:10:09.069541+0000","last_fullsized":"2024-09-14T12:10:09.069541+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.069447+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.610666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1258,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.804369+0000","last_change":"2024-09-14T12:10:03.804369+0000","last_active":"2024-09-14T12:10:03.804369+0000","last_peered":"2024-09-14T12:10:03.804369+0000","last_clean":"2024-09-14T12:10:03.804369+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:10:03.804369+0000","last_undegraded":"2024-09-14T12:10:03.804369+0000","last_fullsized":"2024-09-14T12:10:03.804369+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.804231+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.949022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.588199+0000","last_change":"2024-09-14T12:10:21.588199+0000","last_active":"2024-09-14T12:10:21.588199+0000","last_peered":"2024-09-14T12:10:21.588199+0000","last_clean":"2024-09-14T12:10:21.588199+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:21.588199+0000","last_undegraded":"2024-09-14T12:10:21.588199+0000","last_fullsized":"2024-09-14T12:10:21.588199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.588115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.588115+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.588115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:54.368894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'312","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.148522+0000","last_change":"2024-09-14T12:10:26.148522+0000","last_active":"2024-09-14T12:10:26.148522+0000","last_peered":"2024-09-14T12:10:26.148522+0000","last_clean":"2024-09-14T12:10:26.148522+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:10:26.148522+0000","last_undegraded":"2024-09-14T12:10:26.148522+0000","last_fullsized":"2024-09-14T12:10:26.148522+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-14T12:10:26.148430+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-14T12:10:26.148430+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.148430+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:20.299138+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.420495+0000","last_change":"2024-09-14T12:10:21.420495+0000","last_active":"2024-09-14T12:10:21.420495+0000","last_peered":"2024-09-14T12:10:21.420495+0000","last_clean":"2024-09-14T12:10:21.420495+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:10:21.420495+0000","last_undegraded":"2024-09-14T12:10:21.420495+0000","last_fullsized":"2024-09-14T12:10:21.420495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.420410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.420410+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.420410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:41.884735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'112","reported_seq":632,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.608406+0000","last_change":"2024-09-14T12:10:37.608406+0000","last_active":"2024-09-14T12:10:37.608406+0000","last_peered":"2024-09-14T12:10:37.608406+0000","last_clean":"2024-09-14T12:10:37.608406+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:10:37.608406+0000","last_undegraded":"2024-09-14T12:10:37.608406+0000","last_fullsized":"2024-09-14T12:10:37.608406+0000","mapping_epoch":35,"log_start":"265'101","ondisk_log_start":"265'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-14T12:10:37.608319+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-14T12:10:37.608319+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.608319+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.341297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'144","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.115730+0000","last_change":"2024-09-14T12:10:11.115730+0000","last_active":"2024-09-14T12:10:11.115730+0000","last_peered":"2024-09-14T12:10:11.115730+0000","last_clean":"2024-09-14T12:10:11.115730+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:10:11.115730+0000","last_undegraded":"2024-09-14T12:10:11.115730+0000","last_fullsized":"2024-09-14T12:10:11.115730+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.115619+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.488762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'377","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.003226+0000","last_change":"2024-09-14T12:10:01.003226+0000","last_active":"2024-09-14T12:10:01.003226+0000","last_peered":"2024-09-14T12:10:01.003226+0000","last_clean":"2024-09-14T12:10:01.003226+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:10:01.003226+0000","last_undegraded":"2024-09-14T12:10:01.003226+0000","last_fullsized":"2024-09-14T12:10:01.003226+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.003138+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:56.741486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":721,"num_read_kb":71289,"num_write":1192,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.311021+0000","last_change":"2024-09-14T12:10:14.311021+0000","last_active":"2024-09-14T12:10:14.311021+0000","last_peered":"2024-09-14T12:10:14.311021+0000","last_clean":"2024-09-14T12:10:14.311021+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:10:14.311021+0000","last_undegraded":"2024-09-14T12:10:14.311021+0000","last_fullsized":"2024-09-14T12:10:14.311021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.310925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:23.832794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'269","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.464707+0000","last_change":"2024-09-14T12:10:26.464707+0000","last_active":"2024-09-14T12:10:26.464707+0000","last_peered":"2024-09-14T12:10:26.464707+0000","last_clean":"2024-09-14T12:10:26.464707+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:10:26.464707+0000","last_undegraded":"2024-09-14T12:10:26.464707+0000","last_fullsized":"2024-09-14T12:10:26.464707+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-14T12:10:26.464613+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-14T12:10:26.464613+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.464613+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:58.834720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.154161+0000","last_change":"2024-09-14T12:10:30.154161+0000","last_active":"2024-09-14T12:10:30.154161+0000","last_peered":"2024-09-14T12:10:30.154161+0000","last_clean":"2024-09-14T12:10:30.154161+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:10:30.154161+0000","last_undegraded":"2024-09-14T12:10:30.154161+0000","last_fullsized":"2024-09-14T12:10:30.154161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.154074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.154074+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.154074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:28.047612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.268794+0000","last_change":"2024-09-14T12:10:11.268794+0000","last_active":"2024-09-14T12:10:11.268794+0000","last_peered":"2024-09-14T12:10:11.268794+0000","last_clean":"2024-09-14T12:10:11.268794+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:10:11.268794+0000","last_undegraded":"2024-09-14T12:10:11.268794+0000","last_fullsized":"2024-09-14T12:10:11.268794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.268689+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:54.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'373","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.060204+0000","last_change":"2024-09-14T12:10:03.060204+0000","last_active":"2024-09-14T12:10:03.060204+0000","last_peered":"2024-09-14T12:10:03.060204+0000","last_clean":"2024-09-14T12:10:03.060204+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:10:03.060204+0000","last_undegraded":"2024-09-14T12:10:03.060204+0000","last_fullsized":"2024-09-14T12:10:03.060204+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.060083+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.821132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":695,"num_read_kb":6455,"num_write":1238,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.291568+0000","last_change":"2024-09-14T12:10:16.291568+0000","last_active":"2024-09-14T12:10:16.291568+0000","last_peered":"2024-09-14T12:10:16.291568+0000","last_clean":"2024-09-14T12:10:16.291568+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:10:16.291568+0000","last_undegraded":"2024-09-14T12:10:16.291568+0000","last_fullsized":"2024-09-14T12:10:16.291568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.291473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:05.832571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.809552+0000","last_change":"2024-09-14T12:10:19.809552+0000","last_active":"2024-09-14T12:10:19.809552+0000","last_peered":"2024-09-14T12:10:19.809552+0000","last_clean":"2024-09-14T12:10:19.809552+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:10:19.809552+0000","last_undegraded":"2024-09-14T12:10:19.809552+0000","last_fullsized":"2024-09-14T12:10:19.809552+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.809459+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:21.052022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":912,"num_read_kb":2171,"num_write":788,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.658111+0000","last_change":"2024-09-14T12:10:30.658111+0000","last_active":"2024-09-14T12:10:30.658111+0000","last_peered":"2024-09-14T12:10:30.658111+0000","last_clean":"2024-09-14T12:10:30.658111+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:10:30.658111+0000","last_undegraded":"2024-09-14T12:10:30.658111+0000","last_fullsized":"2024-09-14T12:10:30.658111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.658016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.658016+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.658016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:29.843616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'176","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.076865+0000","last_change":"2024-09-14T12:10:36.076865+0000","last_active":"2024-09-14T12:10:36.076865+0000","last_peered":"2024-09-14T12:10:36.076865+0000","last_clean":"2024-09-14T12:10:36.076865+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:10:36.076865+0000","last_undegraded":"2024-09-14T12:10:36.076865+0000","last_fullsized":"2024-09-14T12:10:36.076865+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:36.076779+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:36.076779+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.076779+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.804134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.138191+0000","last_change":"2024-09-14T12:10:12.138191+0000","last_active":"2024-09-14T12:10:12.138191+0000","last_peered":"2024-09-14T12:10:12.138191+0000","last_clean":"2024-09-14T12:10:12.138191+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:10:12.138191+0000","last_undegraded":"2024-09-14T12:10:12.138191+0000","last_fullsized":"2024-09-14T12:10:12.138191+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.138098+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:11.397910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.791625+0000","last_change":"2024-09-14T12:10:02.791625+0000","last_active":"2024-09-14T12:10:02.791625+0000","last_peered":"2024-09-14T12:10:02.791625+0000","last_clean":"2024-09-14T12:10:02.791625+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:10:02.791625+0000","last_undegraded":"2024-09-14T12:10:02.791625+0000","last_fullsized":"2024-09-14T12:10:02.791625+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.791485+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:30.525115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":4521,"num_write":984,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.329226+0000","last_change":"2024-09-14T12:10:15.329226+0000","last_active":"2024-09-14T12:10:15.329226+0000","last_peered":"2024-09-14T12:10:15.329226+0000","last_clean":"2024-09-14T12:10:15.329226+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:15.329226+0000","last_undegraded":"2024-09-14T12:10:15.329226+0000","last_fullsized":"2024-09-14T12:10:15.329226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.329133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:37.556057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'320","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.515207+0000","last_change":"2024-09-14T12:10:28.515207+0000","last_active":"2024-09-14T12:10:28.515207+0000","last_peered":"2024-09-14T12:10:28.515207+0000","last_clean":"2024-09-14T12:10:28.515207+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:10:28.515207+0000","last_undegraded":"2024-09-14T12:10:28.515207+0000","last_fullsized":"2024-09-14T12:10:28.515207+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:28.515114+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:28.515114+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.515114+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:43.805134+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.824070+0000","last_change":"2024-09-14T12:10:21.824070+0000","last_active":"2024-09-14T12:10:21.824070+0000","last_peered":"2024-09-14T12:10:21.824070+0000","last_clean":"2024-09-14T12:10:21.824070+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:10:21.824070+0000","last_undegraded":"2024-09-14T12:10:21.824070+0000","last_fullsized":"2024-09-14T12:10:21.824070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.823994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.823994+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.823994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.993330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'193","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.504212+0000","last_change":"2024-09-14T12:10:28.504212+0000","last_active":"2024-09-14T12:10:28.504212+0000","last_peered":"2024-09-14T12:10:28.504212+0000","last_clean":"2024-09-14T12:10:28.504212+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:10:28.504212+0000","last_undegraded":"2024-09-14T12:10:28.504212+0000","last_fullsized":"2024-09-14T12:10:28.504212+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'193","last_scrub_stamp":"2024-09-14T12:10:28.504112+0000","last_deep_scrub":"265'193","last_deep_scrub_stamp":"2024-09-14T12:10:28.504112+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.504112+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:54.702733+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.129538+0000","last_change":"2024-09-14T12:10:14.129538+0000","last_active":"2024-09-14T12:10:14.129538+0000","last_peered":"2024-09-14T12:10:14.129538+0000","last_clean":"2024-09-14T12:10:14.129538+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:10:14.129538+0000","last_undegraded":"2024-09-14T12:10:14.129538+0000","last_fullsized":"2024-09-14T12:10:14.129538+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.129436+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:00.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'343","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.585762+0000","last_change":"2024-09-14T12:10:01.585762+0000","last_active":"2024-09-14T12:10:01.585762+0000","last_peered":"2024-09-14T12:10:01.585762+0000","last_clean":"2024-09-14T12:10:01.585762+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:10:01.585762+0000","last_undegraded":"2024-09-14T12:10:01.585762+0000","last_fullsized":"2024-09-14T12:10:01.585762+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.585672+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.361742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":125003,"num_write":1056,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.102871+0000","last_change":"2024-09-14T12:10:23.102871+0000","last_active":"2024-09-14T12:10:23.102871+0000","last_peered":"2024-09-14T12:10:23.102871+0000","last_clean":"2024-09-14T12:10:23.102871+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:10:23.102871+0000","last_undegraded":"2024-09-14T12:10:23.102871+0000","last_fullsized":"2024-09-14T12:10:23.102871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.102779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.102779+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.102779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:26.238331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'309","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.209118+0000","last_change":"2024-09-14T12:10:30.209118+0000","last_active":"2024-09-14T12:10:30.209118+0000","last_peered":"2024-09-14T12:10:30.209118+0000","last_clean":"2024-09-14T12:10:30.209118+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:10:30.209118+0000","last_undegraded":"2024-09-14T12:10:30.209118+0000","last_fullsized":"2024-09-14T12:10:30.209118+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:10:30.209019+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:10:30.209019+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.209019+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:02.348494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.836816+0000","last_change":"2024-09-14T12:10:22.836816+0000","last_active":"2024-09-14T12:10:22.836816+0000","last_peered":"2024-09-14T12:10:22.836816+0000","last_clean":"2024-09-14T12:10:22.836816+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:10:22.836816+0000","last_undegraded":"2024-09-14T12:10:22.836816+0000","last_fullsized":"2024-09-14T12:10:22.836816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:22.836737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:22.836737+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.836737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:53.232235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.569934+0000","last_change":"2024-09-14T12:10:35.569934+0000","last_active":"2024-09-14T12:10:35.569934+0000","last_peered":"2024-09-14T12:10:35.569934+0000","last_clean":"2024-09-14T12:10:35.569934+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:10:35.569934+0000","last_undegraded":"2024-09-14T12:10:35.569934+0000","last_fullsized":"2024-09-14T12:10:35.569934+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-14T12:10:35.569829+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-14T12:10:35.569829+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.569829+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:57.670180+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":787,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.689637+0000","last_change":"2024-09-14T12:10:13.689637+0000","last_active":"2024-09-14T12:10:13.689637+0000","last_peered":"2024-09-14T12:10:13.689637+0000","last_clean":"2024-09-14T12:10:13.689637+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:10:13.689637+0000","last_undegraded":"2024-09-14T12:10:13.689637+0000","last_fullsized":"2024-09-14T12:10:13.689637+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.689552+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:15.549909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'420","reported_seq":1140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.035048+0000","last_change":"2024-09-14T12:09:58.035048+0000","last_active":"2024-09-14T12:09:58.035048+0000","last_peered":"2024-09-14T12:09:58.035048+0000","last_clean":"2024-09-14T12:09:58.035048+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:09:58.035048+0000","last_undegraded":"2024-09-14T12:09:58.035048+0000","last_fullsized":"2024-09-14T12:09:58.035048+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.034944+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:02.918444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":916,"num_read_kb":75270,"num_write":1291,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.727588+0000","last_change":"2024-09-14T12:10:14.727588+0000","last_active":"2024-09-14T12:10:14.727588+0000","last_peered":"2024-09-14T12:10:14.727588+0000","last_clean":"2024-09-14T12:10:14.727588+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:10:14.727588+0000","last_undegraded":"2024-09-14T12:10:14.727588+0000","last_fullsized":"2024-09-14T12:10:14.727588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.727491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:45.961043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'114","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.102506+0000","last_change":"2024-09-14T12:10:27.102506+0000","last_active":"2024-09-14T12:10:27.102506+0000","last_peered":"2024-09-14T12:10:27.102506+0000","last_clean":"2024-09-14T12:10:27.102506+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:10:27.102506+0000","last_undegraded":"2024-09-14T12:10:27.102506+0000","last_fullsized":"2024-09-14T12:10:27.102506+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:27.102406+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:27.102406+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.102406+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:31.401975+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'777","reported_seq":2377,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.392892+0000","last_change":"2024-09-14T12:10:20.392892+0000","last_active":"2024-09-14T12:10:20.392892+0000","last_peered":"2024-09-14T12:10:20.392892+0000","last_clean":"2024-09-14T12:10:20.392892+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:10:20.392892+0000","last_undegraded":"2024-09-14T12:10:20.392892+0000","last_fullsized":"2024-09-14T12:10:20.392892+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'777","last_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_deep_scrub":"265'777","last_deep_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.392801+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:46.710130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.489519+0000","last_change":"2024-09-14T12:10:33.489519+0000","last_active":"2024-09-14T12:10:33.489519+0000","last_peered":"2024-09-14T12:10:33.489519+0000","last_clean":"2024-09-14T12:10:33.489519+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:10:33.489519+0000","last_undegraded":"2024-09-14T12:10:33.489519+0000","last_fullsized":"2024-09-14T12:10:33.489519+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-14T12:10:33.489423+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-14T12:10:33.489423+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.489423+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:49.539458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.888161+0000","last_change":"2024-09-14T12:10:11.888161+0000","last_active":"2024-09-14T12:10:11.888161+0000","last_peered":"2024-09-14T12:10:11.888161+0000","last_clean":"2024-09-14T12:10:11.888161+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:10:11.888161+0000","last_undegraded":"2024-09-14T12:10:11.888161+0000","last_fullsized":"2024-09-14T12:10:11.888161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.888043+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:26.749909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'295","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.716484+0000","last_change":"2024-09-14T12:10:06.716484+0000","last_active":"2024-09-14T12:10:06.716484+0000","last_peered":"2024-09-14T12:10:06.716484+0000","last_clean":"2024-09-14T12:10:06.716484+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:10:06.716484+0000","last_undegraded":"2024-09-14T12:10:06.716484+0000","last_fullsized":"2024-09-14T12:10:06.716484+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.716383+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:44.130365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":114075,"num_write":994,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.523154+0000","last_change":"2024-09-14T12:10:23.523154+0000","last_active":"2024-09-14T12:10:23.523154+0000","last_peered":"2024-09-14T12:10:23.523154+0000","last_clean":"2024-09-14T12:10:23.523154+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:10:23.523154+0000","last_undegraded":"2024-09-14T12:10:23.523154+0000","last_fullsized":"2024-09-14T12:10:23.523154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.523074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.523074+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.523074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:22.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'309","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.710490+0000","last_change":"2024-09-14T12:10:29.710490+0000","last_active":"2024-09-14T12:10:29.710490+0000","last_peered":"2024-09-14T12:10:29.710490+0000","last_clean":"2024-09-14T12:10:29.710490+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:10:29.710490+0000","last_undegraded":"2024-09-14T12:10:29.710490+0000","last_fullsized":"2024-09-14T12:10:29.710490+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:10:29.710346+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:10:29.710346+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.710346+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:11.757953+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":1004,"num_write":382,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.107162+0000","last_change":"2024-09-14T12:10:28.107162+0000","last_active":"2024-09-14T12:10:28.107162+0000","last_peered":"2024-09-14T12:10:28.107162+0000","last_clean":"2024-09-14T12:10:28.107162+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:10:28.107162+0000","last_undegraded":"2024-09-14T12:10:28.107162+0000","last_fullsized":"2024-09-14T12:10:28.107162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.107065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.107065+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.107065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:25.172614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'104","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.479326+0000","last_change":"2024-09-14T12:10:34.479326+0000","last_active":"2024-09-14T12:10:34.479326+0000","last_peered":"2024-09-14T12:10:34.479326+0000","last_clean":"2024-09-14T12:10:34.479326+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:10:34.479326+0000","last_undegraded":"2024-09-14T12:10:34.479326+0000","last_fullsized":"2024-09-14T12:10:34.479326+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:34.479231+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:34.479231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.479231+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:05.636206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.902249+0000","last_change":"2024-09-14T12:10:09.902249+0000","last_active":"2024-09-14T12:10:09.902249+0000","last_peered":"2024-09-14T12:10:09.902249+0000","last_clean":"2024-09-14T12:10:09.902249+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:10:09.902249+0000","last_undegraded":"2024-09-14T12:10:09.902249+0000","last_fullsized":"2024-09-14T12:10:09.902249+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.902123+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:17.521695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'364","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.657890+0000","last_change":"2024-09-14T12:10:09.657890+0000","last_active":"2024-09-14T12:10:09.657890+0000","last_peered":"2024-09-14T12:10:09.657890+0000","last_clean":"2024-09-14T12:10:09.657890+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:10:09.657890+0000","last_undegraded":"2024-09-14T12:10:09.657890+0000","last_fullsized":"2024-09-14T12:10:09.657890+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.657777+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:26.554926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":577,"num_read_kb":11549,"num_write":1068,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.624010+0000","last_change":"2024-09-14T12:10:25.624010+0000","last_active":"2024-09-14T12:10:25.624010+0000","last_peered":"2024-09-14T12:10:25.624010+0000","last_clean":"2024-09-14T12:10:25.624010+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:10:25.624010+0000","last_undegraded":"2024-09-14T12:10:25.624010+0000","last_fullsized":"2024-09-14T12:10:25.624010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:25.623907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:25.623907+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.623907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:56.414412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.210307+0000","last_change":"2024-09-14T12:10:23.210307+0000","last_active":"2024-09-14T12:10:23.210307+0000","last_peered":"2024-09-14T12:10:23.210307+0000","last_clean":"2024-09-14T12:10:23.210307+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:10:23.210307+0000","last_undegraded":"2024-09-14T12:10:23.210307+0000","last_fullsized":"2024-09-14T12:10:23.210307+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-14T12:10:23.210222+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-14T12:10:23.210222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.210222+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:40.458601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44701,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1000,"num_write":364,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.390487+0000","last_change":"2024-09-14T12:10:19.390487+0000","last_active":"2024-09-14T12:10:19.390487+0000","last_peered":"2024-09-14T12:10:19.390487+0000","last_clean":"2024-09-14T12:10:19.390487+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:10:19.390487+0000","last_undegraded":"2024-09-14T12:10:19.390487+0000","last_fullsized":"2024-09-14T12:10:19.390487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.390407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:27.514718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'108","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.087993+0000","last_change":"2024-09-14T12:10:37.087993+0000","last_active":"2024-09-14T12:10:37.087993+0000","last_peered":"2024-09-14T12:10:37.087993+0000","last_clean":"2024-09-14T12:10:37.087993+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:10:37.087993+0000","last_undegraded":"2024-09-14T12:10:37.087993+0000","last_fullsized":"2024-09-14T12:10:37.087993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-14T12:10:37.087898+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-14T12:10:37.087898+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.087898+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:40.698273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'441","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.090742+0000","last_change":"2024-09-14T12:10:13.090742+0000","last_active":"2024-09-14T12:10:13.090742+0000","last_peered":"2024-09-14T12:10:13.090742+0000","last_clean":"2024-09-14T12:10:13.090742+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:10:13.090742+0000","last_undegraded":"2024-09-14T12:10:13.090742+0000","last_fullsized":"2024-09-14T12:10:13.090742+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'441","last_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_deep_scrub":"265'441","last_deep_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.090640+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:48.381349+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25759,"num_omap_keys":101,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'351","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.065794+0000","last_change":"2024-09-14T12:10:02.065794+0000","last_active":"2024-09-14T12:10:02.065794+0000","last_peered":"2024-09-14T12:10:02.065794+0000","last_clean":"2024-09-14T12:10:02.065794+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:10:02.065794+0000","last_undegraded":"2024-09-14T12:10:02.065794+0000","last_fullsized":"2024-09-14T12:10:02.065794+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.065711+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:42.511318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":1479,"num_write":1091,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.083133+0000","last_change":"2024-09-14T12:10:22.083133+0000","last_active":"2024-09-14T12:10:22.083133+0000","last_peered":"2024-09-14T12:10:22.083133+0000","last_clean":"2024-09-14T12:10:22.083133+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:10:22.083133+0000","last_undegraded":"2024-09-14T12:10:22.083133+0000","last_fullsized":"2024-09-14T12:10:22.083133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:22.083055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:22.083055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.083055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:26.984342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'239","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.190156+0000","last_change":"2024-09-14T12:10:27.190156+0000","last_active":"2024-09-14T12:10:27.190156+0000","last_peered":"2024-09-14T12:10:27.190156+0000","last_clean":"2024-09-14T12:10:27.190156+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:10:27.190156+0000","last_undegraded":"2024-09-14T12:10:27.190156+0000","last_fullsized":"2024-09-14T12:10:27.190156+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-14T12:10:27.190067+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-14T12:10:27.190067+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.190067+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:54.545499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.057034+0000","last_change":"2024-09-14T12:10:31.057034+0000","last_active":"2024-09-14T12:10:31.057034+0000","last_peered":"2024-09-14T12:10:31.057034+0000","last_clean":"2024-09-14T12:10:31.057034+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:10:31.057034+0000","last_undegraded":"2024-09-14T12:10:31.057034+0000","last_fullsized":"2024-09-14T12:10:31.057034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:31.056932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:31.056932+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.056932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:54.148855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'216","reported_seq":1696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.529583+0000","last_change":"2024-09-14T12:10:35.529583+0000","last_active":"2024-09-14T12:10:35.529583+0000","last_peered":"2024-09-14T12:10:35.529583+0000","last_clean":"2024-09-14T12:10:35.529583+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:10:35.529583+0000","last_undegraded":"2024-09-14T12:10:35.529583+0000","last_fullsized":"2024-09-14T12:10:35.529583+0000","mapping_epoch":35,"log_start":"265'201","ondisk_log_start":"265'201","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'216","last_scrub_stamp":"2024-09-14T12:10:35.529481+0000","last_deep_scrub":"265'216","last_deep_scrub_stamp":"2024-09-14T12:10:35.529481+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.529481+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":201,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.632377+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.885591+0000","last_change":"2024-09-14T12:10:08.885591+0000","last_active":"2024-09-14T12:10:08.885591+0000","last_peered":"2024-09-14T12:10:08.885591+0000","last_clean":"2024-09-14T12:10:08.885591+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:10:08.885591+0000","last_undegraded":"2024-09-14T12:10:08.885591+0000","last_fullsized":"2024-09-14T12:10:08.885591+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.885498+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:11.730545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'348","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.083183+0000","last_change":"2024-09-14T12:10:04.083183+0000","last_active":"2024-09-14T12:10:04.083183+0000","last_peered":"2024-09-14T12:10:04.083183+0000","last_clean":"2024-09-14T12:10:04.083183+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:10:04.083183+0000","last_undegraded":"2024-09-14T12:10:04.083183+0000","last_fullsized":"2024-09-14T12:10:04.083183+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.083077+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:38.782611+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":4572,"num_write":1085,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.789830+0000","last_change":"2024-09-14T12:10:16.789830+0000","last_active":"2024-09-14T12:10:16.789830+0000","last_peered":"2024-09-14T12:10:16.789830+0000","last_clean":"2024-09-14T12:10:16.789830+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:10:16.789830+0000","last_undegraded":"2024-09-14T12:10:16.789830+0000","last_fullsized":"2024-09-14T12:10:16.789830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.789746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:21.212395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'311","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.104466+0000","last_change":"2024-09-14T12:10:29.104466+0000","last_active":"2024-09-14T12:10:29.104466+0000","last_peered":"2024-09-14T12:10:29.104466+0000","last_clean":"2024-09-14T12:10:29.104466+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:10:29.104466+0000","last_undegraded":"2024-09-14T12:10:29.104466+0000","last_fullsized":"2024-09-14T12:10:29.104466+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-14T12:10:29.104374+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-14T12:10:29.104374+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.104374+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:59.515158+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.186869+0000","last_change":"2024-09-14T12:10:36.186869+0000","last_active":"2024-09-14T12:10:36.186869+0000","last_peered":"2024-09-14T12:10:36.186869+0000","last_clean":"2024-09-14T12:10:36.186869+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:10:36.186869+0000","last_undegraded":"2024-09-14T12:10:36.186869+0000","last_fullsized":"2024-09-14T12:10:36.186869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:36.186785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:36.186785+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.186785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.512864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'133","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.022815+0000","last_change":"2024-09-14T12:10:32.022815+0000","last_active":"2024-09-14T12:10:32.022815+0000","last_peered":"2024-09-14T12:10:32.022815+0000","last_clean":"2024-09-14T12:10:32.022815+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:10:32.022815+0000","last_undegraded":"2024-09-14T12:10:32.022815+0000","last_fullsized":"2024-09-14T12:10:32.022815+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:32.022721+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:32.022721+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.022721+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:48.560732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.721989+0000","last_change":"2024-09-14T12:10:13.721989+0000","last_active":"2024-09-14T12:10:13.721989+0000","last_peered":"2024-09-14T12:10:13.721989+0000","last_clean":"2024-09-14T12:10:13.721989+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:10:13.721989+0000","last_undegraded":"2024-09-14T12:10:13.721989+0000","last_fullsized":"2024-09-14T12:10:13.721989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.721897+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:48.815645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'310","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.318587+0000","last_change":"2024-09-14T12:10:04.318587+0000","last_active":"2024-09-14T12:10:04.318587+0000","last_peered":"2024-09-14T12:10:04.318587+0000","last_clean":"2024-09-14T12:10:04.318587+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:10:04.318587+0000","last_undegraded":"2024-09-14T12:10:04.318587+0000","last_fullsized":"2024-09-14T12:10:04.318587+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.318456+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:42.943217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":25535,"num_write":1011,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'181","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.772140+0000","last_change":"2024-09-14T12:10:10.772140+0000","last_active":"2024-09-14T12:10:10.772140+0000","last_peered":"2024-09-14T12:10:10.772140+0000","last_clean":"2024-09-14T12:10:10.772140+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:10:10.772140+0000","last_undegraded":"2024-09-14T12:10:10.772140+0000","last_fullsized":"2024-09-14T12:10:10.772140+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'181","last_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_deep_scrub":"265'181","last_deep_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.772052+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.934951+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'354","reported_seq":1089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.544506+0000","last_change":"2024-09-14T12:10:02.544506+0000","last_active":"2024-09-14T12:10:02.544506+0000","last_peered":"2024-09-14T12:10:02.544506+0000","last_clean":"2024-09-14T12:10:02.544506+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:10:02.544506+0000","last_undegraded":"2024-09-14T12:10:02.544506+0000","last_fullsized":"2024-09-14T12:10:02.544506+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.544370+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:51.044659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":943,"num_read_kb":26386,"num_write":1247,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.681166+0000","last_change":"2024-09-14T12:10:16.681166+0000","last_active":"2024-09-14T12:10:16.681166+0000","last_peered":"2024-09-14T12:10:16.681166+0000","last_clean":"2024-09-14T12:10:16.681166+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:10:16.681166+0000","last_undegraded":"2024-09-14T12:10:16.681166+0000","last_fullsized":"2024-09-14T12:10:16.681166+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.681055+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.774592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'349","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.749863+0000","last_change":"2024-09-14T12:10:05.749863+0000","last_active":"2024-09-14T12:10:05.749863+0000","last_peered":"2024-09-14T12:10:05.749863+0000","last_clean":"2024-09-14T12:10:05.749863+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:10:05.749863+0000","last_undegraded":"2024-09-14T12:10:05.749863+0000","last_fullsized":"2024-09-14T12:10:05.749863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.749741+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:29.820426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":18057,"num_write":1029,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.781574+0000","last_change":"2024-09-14T12:10:09.781574+0000","last_active":"2024-09-14T12:10:09.781574+0000","last_peered":"2024-09-14T12:10:09.781574+0000","last_clean":"2024-09-14T12:10:09.781574+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:10:09.781574+0000","last_undegraded":"2024-09-14T12:10:09.781574+0000","last_fullsized":"2024-09-14T12:10:09.781574+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.781479+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:34.531293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'339","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.038240+0000","last_change":"2024-09-14T12:10:03.038240+0000","last_active":"2024-09-14T12:10:03.038240+0000","last_peered":"2024-09-14T12:10:03.038240+0000","last_clean":"2024-09-14T12:10:03.038240+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:10:03.038240+0000","last_undegraded":"2024-09-14T12:10:03.038240+0000","last_fullsized":"2024-09-14T12:10:03.038240+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.038108+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.535266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263498,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":9886,"num_write":1170,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.185314+0000","last_change":"2024-09-14T12:10:16.185314+0000","last_active":"2024-09-14T12:10:16.185314+0000","last_peered":"2024-09-14T12:10:16.185314+0000","last_clean":"2024-09-14T12:10:16.185314+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:10:16.185314+0000","last_undegraded":"2024-09-14T12:10:16.185314+0000","last_fullsized":"2024-09-14T12:10:16.185314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.185216+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:09.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'373","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.015350+0000","last_change":"2024-09-14T12:10:04.015350+0000","last_active":"2024-09-14T12:10:04.015350+0000","last_peered":"2024-09-14T12:10:04.015350+0000","last_clean":"2024-09-14T12:10:04.015350+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:10:04.015350+0000","last_undegraded":"2024-09-14T12:10:04.015350+0000","last_fullsized":"2024-09-14T12:10:04.015350+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.015227+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:44.163154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":11859,"num_write":1346,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'248","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.883633+0000","last_change":"2024-09-14T12:10:12.883633+0000","last_active":"2024-09-14T12:10:12.883633+0000","last_peered":"2024-09-14T12:10:12.883633+0000","last_clean":"2024-09-14T12:10:12.883633+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:10:12.883633+0000","last_undegraded":"2024-09-14T12:10:12.883633+0000","last_fullsized":"2024-09-14T12:10:12.883633+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.883551+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:51.010155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.798328+0000","last_change":"2024-09-14T12:10:03.798328+0000","last_active":"2024-09-14T12:10:03.798328+0000","last_peered":"2024-09-14T12:10:03.798328+0000","last_clean":"2024-09-14T12:10:03.798328+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:10:03.798328+0000","last_undegraded":"2024-09-14T12:10:03.798328+0000","last_fullsized":"2024-09-14T12:10:03.798328+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.798206+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:42.809623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":36459,"num_write":976,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.152436+0000","last_change":"2024-09-14T12:10:15.152436+0000","last_active":"2024-09-14T12:10:15.152436+0000","last_peered":"2024-09-14T12:10:15.152436+0000","last_clean":"2024-09-14T12:10:15.152436+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:10:15.152436+0000","last_undegraded":"2024-09-14T12:10:15.152436+0000","last_fullsized":"2024-09-14T12:10:15.152436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'107","last_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_deep_scrub":"265'107","last_deep_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.152342+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:21.250556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'380","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.594137+0000","last_change":"2024-09-14T12:10:04.594069+0000","last_active":"2024-09-14T12:10:04.594137+0000","last_peered":"2024-09-14T12:10:04.594137+0000","last_clean":"2024-09-14T12:10:04.594137+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:10:04.594137+0000","last_undegraded":"2024-09-14T12:10:04.594137+0000","last_fullsized":"2024-09-14T12:10:04.594137+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.593947+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:28.209010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":129855,"num_write":1253,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.293798+0000","last_change":"2024-09-14T12:10:10.293798+0000","last_active":"2024-09-14T12:10:10.293798+0000","last_peered":"2024-09-14T12:10:10.293798+0000","last_clean":"2024-09-14T12:10:10.293798+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:10:10.293798+0000","last_undegraded":"2024-09-14T12:10:10.293798+0000","last_fullsized":"2024-09-14T12:10:10.293798+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.293666+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:00.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'359","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.079299+0000","last_change":"2024-09-14T12:10:06.079299+0000","last_active":"2024-09-14T12:10:06.079299+0000","last_peered":"2024-09-14T12:10:06.079299+0000","last_clean":"2024-09-14T12:10:06.079299+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:10:06.079299+0000","last_undegraded":"2024-09-14T12:10:06.079299+0000","last_fullsized":"2024-09-14T12:10:06.079299+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.079163+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:31.178991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":616,"num_read_kb":2365,"num_write":1155,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.179101+0000","last_change":"2024-09-14T12:10:13.179101+0000","last_active":"2024-09-14T12:10:13.179101+0000","last_peered":"2024-09-14T12:10:13.179101+0000","last_clean":"2024-09-14T12:10:13.179101+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:10:13.179101+0000","last_undegraded":"2024-09-14T12:10:13.179101+0000","last_fullsized":"2024-09-14T12:10:13.179101+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4110","last_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_deep_scrub":"265'4110","last_deep_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.179000+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:04.053266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.698323+0000","last_change":"2024-09-14T12:10:08.698323+0000","last_active":"2024-09-14T12:10:08.698323+0000","last_peered":"2024-09-14T12:10:08.698323+0000","last_clean":"2024-09-14T12:10:08.698323+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:10:08.698323+0000","last_undegraded":"2024-09-14T12:10:08.698323+0000","last_fullsized":"2024-09-14T12:10:08.698323+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.698222+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:32.447428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":15479,"num_write":1162,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.966499+0000","last_change":"2024-09-14T12:10:14.966499+0000","last_active":"2024-09-14T12:10:14.966499+0000","last_peered":"2024-09-14T12:10:14.966499+0000","last_clean":"2024-09-14T12:10:14.966499+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:10:14.966499+0000","last_undegraded":"2024-09-14T12:10:14.966499+0000","last_fullsized":"2024-09-14T12:10:14.966499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.966397+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:03.981292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'356","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.588883+0000","last_change":"2024-09-14T12:10:05.588883+0000","last_active":"2024-09-14T12:10:05.588883+0000","last_peered":"2024-09-14T12:10:05.588883+0000","last_clean":"2024-09-14T12:10:05.588883+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:10:05.588883+0000","last_undegraded":"2024-09-14T12:10:05.588883+0000","last_fullsized":"2024-09-14T12:10:05.588883+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.588778+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:06.256609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":4745,"num_write":1096,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'456","reported_seq":1148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.620065+0000","last_change":"2024-09-14T12:10:08.620065+0000","last_active":"2024-09-14T12:10:08.620065+0000","last_peered":"2024-09-14T12:10:08.620065+0000","last_clean":"2024-09-14T12:10:08.620065+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:10:08.620065+0000","last_undegraded":"2024-09-14T12:10:08.620065+0000","last_fullsized":"2024-09-14T12:10:08.620065+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.619947+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.459276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'551","reported_seq":1361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.640999+0000","last_change":"2024-09-14T12:10:11.640999+0000","last_active":"2024-09-14T12:10:11.640999+0000","last_peered":"2024-09-14T12:10:11.640999+0000","last_clean":"2024-09-14T12:10:11.640999+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:10:11.640999+0000","last_undegraded":"2024-09-14T12:10:11.640999+0000","last_fullsized":"2024-09-14T12:10:11.640999+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'551","last_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_deep_scrub":"265'551","last_deep_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.640830+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:36.282096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1371,"num_read_kb":53620,"num_write":1733,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'708","reported_seq":1563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.931892+0000","last_change":"2024-09-14T12:10:13.931892+0000","last_active":"2024-09-14T12:10:13.931892+0000","last_peered":"2024-09-14T12:10:13.931892+0000","last_clean":"2024-09-14T12:10:13.931892+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:10:13.931892+0000","last_undegraded":"2024-09-14T12:10:13.931892+0000","last_fullsized":"2024-09-14T12:10:13.931892+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'708","last_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_deep_scrub":"265'708","last_deep_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.931809+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:18.907786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'328","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.060187+0000","last_change":"2024-09-14T12:10:06.060187+0000","last_active":"2024-09-14T12:10:06.060187+0000","last_peered":"2024-09-14T12:10:06.060187+0000","last_clean":"2024-09-14T12:10:06.060187+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:10:06.060187+0000","last_undegraded":"2024-09-14T12:10:06.060187+0000","last_fullsized":"2024-09-14T12:10:06.060187+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.060039+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:17.060911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10603,"num_write":1037,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.485953+0000","last_change":"2024-09-14T12:10:17.485953+0000","last_active":"2024-09-14T12:10:17.485953+0000","last_peered":"2024-09-14T12:10:17.485953+0000","last_clean":"2024-09-14T12:10:17.485953+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:10:17.485953+0000","last_undegraded":"2024-09-14T12:10:17.485953+0000","last_fullsized":"2024-09-14T12:10:17.485953+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.485872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:10.610144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'348","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.246678+0000","last_change":"2024-09-14T12:10:06.246678+0000","last_active":"2024-09-14T12:10:06.246678+0000","last_peered":"2024-09-14T12:10:06.246678+0000","last_clean":"2024-09-14T12:10:06.246678+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:10:06.246678+0000","last_undegraded":"2024-09-14T12:10:06.246678+0000","last_fullsized":"2024-09-14T12:10:06.246678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.246522+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:24.006671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":12533,"num_write":1141,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.138876+0000","last_change":"2024-09-14T12:10:11.138876+0000","last_active":"2024-09-14T12:10:11.138876+0000","last_peered":"2024-09-14T12:10:11.138876+0000","last_clean":"2024-09-14T12:10:11.138876+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:10:11.138876+0000","last_undegraded":"2024-09-14T12:10:11.138876+0000","last_fullsized":"2024-09-14T12:10:11.138876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.138758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.430506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'401","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.436072+0000","last_change":"2024-09-14T12:10:11.436072+0000","last_active":"2024-09-14T12:10:11.436072+0000","last_peered":"2024-09-14T12:10:11.436072+0000","last_clean":"2024-09-14T12:10:11.436072+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:10:11.436072+0000","last_undegraded":"2024-09-14T12:10:11.436072+0000","last_fullsized":"2024-09-14T12:10:11.436072+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.435967+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.312166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":13606,"num_write":1190,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.197307+0000","last_change":"2024-09-14T12:10:17.197307+0000","last_active":"2024-09-14T12:10:17.197307+0000","last_peered":"2024-09-14T12:10:17.197307+0000","last_clean":"2024-09-14T12:10:17.197307+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:10:17.197307+0000","last_undegraded":"2024-09-14T12:10:17.197307+0000","last_fullsized":"2024-09-14T12:10:17.197307+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.197213+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:00.401598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.636571+0000","last_change":"2024-09-14T12:10:07.636571+0000","last_active":"2024-09-14T12:10:07.636571+0000","last_peered":"2024-09-14T12:10:07.636571+0000","last_clean":"2024-09-14T12:10:07.636571+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:10:07.636571+0000","last_undegraded":"2024-09-14T12:10:07.636571+0000","last_fullsized":"2024-09-14T12:10:07.636571+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.636466+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:24.340392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":59967,"num_write":1134,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'394","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.458471+0000","last_change":"2024-09-14T12:10:15.458471+0000","last_active":"2024-09-14T12:10:15.458471+0000","last_peered":"2024-09-14T12:10:15.458471+0000","last_clean":"2024-09-14T12:10:15.458471+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:10:15.458471+0000","last_undegraded":"2024-09-14T12:10:15.458471+0000","last_fullsized":"2024-09-14T12:10:15.458471+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.458379+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:39.482027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3561,"num_omap_keys":15,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'331","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.715505+0000","last_change":"2024-09-14T12:10:07.715505+0000","last_active":"2024-09-14T12:10:07.715505+0000","last_peered":"2024-09-14T12:10:07.715505+0000","last_clean":"2024-09-14T12:10:07.715505+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:10:07.715505+0000","last_undegraded":"2024-09-14T12:10:07.715505+0000","last_fullsized":"2024-09-14T12:10:07.715505+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.715389+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:27.252175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":22222,"num_write":1088,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'360","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.634166+0000","last_change":"2024-09-14T12:10:10.634166+0000","last_active":"2024-09-14T12:10:10.634166+0000","last_peered":"2024-09-14T12:10:10.634166+0000","last_clean":"2024-09-14T12:10:10.634166+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:10:10.634166+0000","last_undegraded":"2024-09-14T12:10:10.634166+0000","last_fullsized":"2024-09-14T12:10:10.634166+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.634055+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:17.564902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":41589,"num_write":1192,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.262913+0000","last_change":"2024-09-14T12:10:15.262913+0000","last_active":"2024-09-14T12:10:15.262913+0000","last_peered":"2024-09-14T12:10:15.262913+0000","last_clean":"2024-09-14T12:10:15.262913+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:10:15.262913+0000","last_undegraded":"2024-09-14T12:10:15.262913+0000","last_fullsized":"2024-09-14T12:10:15.262913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'88","last_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_deep_scrub":"265'88","last_deep_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.262821+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:29.014884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'467","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.799973+0000","last_change":"2024-09-14T12:10:06.799973+0000","last_active":"2024-09-14T12:10:06.799973+0000","last_peered":"2024-09-14T12:10:06.799973+0000","last_clean":"2024-09-14T12:10:06.799973+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:10:06.799973+0000","last_undegraded":"2024-09-14T12:10:06.799973+0000","last_fullsized":"2024-09-14T12:10:06.799973+0000","mapping_epoch":38,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'467","last_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_deep_scrub":"265'467","last_deep_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.799866+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.839357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":936,"num_read_kb":7353,"num_write":1336,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.681579+0000","last_change":"2024-09-14T12:10:18.681579+0000","last_active":"2024-09-14T12:10:18.681579+0000","last_peered":"2024-09-14T12:10:18.681579+0000","last_clean":"2024-09-14T12:10:18.681579+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:10:18.681579+0000","last_undegraded":"2024-09-14T12:10:18.681579+0000","last_fullsized":"2024-09-14T12:10:18.681579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.681470+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:22.840994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1579,"ondisk_log_size":1579,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":600,"ondisk_log_size":600,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1638457,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":18085,"num_read_kb":37656,"num_write":15239,"num_write_kb":11977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713492,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36258,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4345,"ondisk_log_size":4345,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":32687811,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44407,"num_read_kb":2049088,"num_write":73495,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50442240,"data_stored":50442240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3782,"ondisk_log_size":3782,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":224799,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":204319,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510165,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280296,"kb_used_data":10328,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94091544,"statfs":{"total":96636764160,"available":96349741056,"internally_reserved":0,"allocated":10575872,"data_stored":8512576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510165,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149360,"kb_used_data":9952,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":10190848,"data_stored":8104359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510165,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258536,"kb_used_data":14936,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94113304,"statfs":{"total":96636764160,"available":96372023296,"internally_reserved":0,"allocated":15294464,"data_stored":13168761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542868,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296732,"kb_used_data":12876,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075108,"statfs":{"total":96636764160,"available":96332910592,"internally_reserved":0,"allocated":13185024,"data_stored":11050510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":290650571},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542869,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144132,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94227708,"statfs":{"total":96636764160,"available":96489172992,"internally_reserved":0,"allocated":9097216,"data_stored":6957133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542867,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130672,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94241168,"statfs":{"total":96636764160,"available":96502956032,"internally_reserved":0,"allocated":15171584,"data_stored":13135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542869,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280256,"kb_used_data":6192,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94091584,"statfs":{"total":96636764160,"available":96349782016,"internally_reserved":0,"allocated":6340608,"data_stored":4233902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542869,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91908,"kb_used_data":6644,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279932,"statfs":{"total":96636764160,"available":96542650368,"internally_reserved":0,"allocated":6803456,"data_stored":4759690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10289152,"data_stored":10289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":5816320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2473984,"data_stored":2473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":1945600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10850304,"data_stored":10850304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4669440,"data_stored":4669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8171520,"data_stored":8171520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:10:42.481 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.481 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.481 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.481 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.482 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.483 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.484 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.485 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.486 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.486 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.486 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.486 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.487 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.487 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.487 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.487 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.487 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.488 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.488 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.488 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.488 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.488 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:25:26.917939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=25, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.489 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.490 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.490 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.490 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.490 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.491 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.491 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.491 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.491 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.492 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.492 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.492 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.492 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.492 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:28:32.205460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.493 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.493 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.493 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:28:35.231500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:10:42.497 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:11:02.498 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:11:02.849 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:11:02.860 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:11:02.862 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2068,"stamp":"2024-09-14T12:11:00.871801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34933529,"num_objects":607,"num_object_clones":0,"num_object_copies":1495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":607,"num_whiteouts":0,"num_read":199663,"num_read_kb":2633567,"num_write":147738,"num_write_kb":2509949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":753463,"num_omap_keys":1808,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13611,"ondisk_log_size":13611,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1636052,"kb_used_data":84628,"kb_used_omap":12,"kb_used_meta":1551283,"kb_avail":753338668,"statfs":{"total":773094113280,"available":771418796032,"internally_reserved":0,"allocated":86659072,"data_stored":69922534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1588514353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004899"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.732870+0000","last_change":"2024-09-14T12:10:48.732870+0000","last_active":"2024-09-14T12:10:48.732870+0000","last_peered":"2024-09-14T12:10:48.732870+0000","last_clean":"2024-09-14T12:10:48.732870+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:10:48.732870+0000","last_undegraded":"2024-09-14T12:10:48.732870+0000","last_fullsized":"2024-09-14T12:10:48.732870+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.732774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.732774+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.732774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:45.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.773085+0000","last_change":"2024-09-14T12:10:47.773085+0000","last_active":"2024-09-14T12:10:47.773085+0000","last_peered":"2024-09-14T12:10:47.773085+0000","last_clean":"2024-09-14T12:10:47.773085+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:10:47.773085+0000","last_undegraded":"2024-09-14T12:10:47.773085+0000","last_fullsized":"2024-09-14T12:10:47.773085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:47.772990+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:47.772990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.772990+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:56.977187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.003809+0000","last_change":"2024-09-14T12:10:48.003809+0000","last_active":"2024-09-14T12:10:48.003809+0000","last_peered":"2024-09-14T12:10:48.003809+0000","last_clean":"2024-09-14T12:10:48.003809+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:10:48.003809+0000","last_undegraded":"2024-09-14T12:10:48.003809+0000","last_fullsized":"2024-09-14T12:10:48.003809+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.003712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.003712+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.003712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:11.452983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.162909+0000","last_change":"2024-09-14T12:10:44.162909+0000","last_active":"2024-09-14T12:10:44.162909+0000","last_peered":"2024-09-14T12:10:44.162909+0000","last_clean":"2024-09-14T12:10:44.162909+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:10:44.162909+0000","last_undegraded":"2024-09-14T12:10:44.162909+0000","last_fullsized":"2024-09-14T12:10:44.162909+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-14T12:10:44.162818+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-14T12:10:44.162818+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.162818+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:06.535957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.669413+0000","last_change":"2024-09-14T12:10:33.669413+0000","last_active":"2024-09-14T12:10:33.669413+0000","last_peered":"2024-09-14T12:10:33.669413+0000","last_clean":"2024-09-14T12:10:33.669413+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:10:33.669413+0000","last_undegraded":"2024-09-14T12:10:33.669413+0000","last_fullsized":"2024-09-14T12:10:33.669413+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:33.669320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:33.669320+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.669320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:15.038665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.201787+0000","last_change":"2024-09-14T12:10:47.201787+0000","last_active":"2024-09-14T12:10:47.201787+0000","last_peered":"2024-09-14T12:10:47.201787+0000","last_clean":"2024-09-14T12:10:47.201787+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:10:47.201787+0000","last_undegraded":"2024-09-14T12:10:47.201787+0000","last_fullsized":"2024-09-14T12:10:47.201787+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:47.201688+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:47.201688+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.201688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:07.152706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.981579+0000","last_change":"2024-09-14T12:10:35.981579+0000","last_active":"2024-09-14T12:10:35.981579+0000","last_peered":"2024-09-14T12:10:35.981579+0000","last_clean":"2024-09-14T12:10:35.981579+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:10:35.981579+0000","last_undegraded":"2024-09-14T12:10:35.981579+0000","last_fullsized":"2024-09-14T12:10:35.981579+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:35.981488+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:35.981488+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.981488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:20.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":223,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.698899+0000","last_change":"2024-09-14T12:10:24.698899+0000","last_active":"2024-09-14T12:10:24.698899+0000","last_peered":"2024-09-14T12:10:24.698899+0000","last_clean":"2024-09-14T12:10:24.698899+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:10:24.698899+0000","last_undegraded":"2024-09-14T12:10:24.698899+0000","last_fullsized":"2024-09-14T12:10:24.698899+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-14T12:10:24.698806+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-14T12:10:24.698806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.698806+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:23.603844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.638119+0000","last_change":"2024-09-14T12:10:37.638057+0000","last_active":"2024-09-14T12:10:37.638119+0000","last_peered":"2024-09-14T12:10:37.638119+0000","last_clean":"2024-09-14T12:10:37.638119+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:10:37.638119+0000","last_undegraded":"2024-09-14T12:10:37.638119+0000","last_fullsized":"2024-09-14T12:10:37.638119+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:37.637968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:37.637968+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.637968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:47.338696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'14","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:52.156170+0000","last_change":"2024-09-14T12:10:52.156170+0000","last_active":"2024-09-14T12:10:52.156170+0000","last_peered":"2024-09-14T12:10:52.156170+0000","last_clean":"2024-09-14T12:10:52.156170+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:10:52.156170+0000","last_undegraded":"2024-09-14T12:10:52.156170+0000","last_fullsized":"2024-09-14T12:10:52.156170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:52.156068+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:52.156068+0000","last_clean_scrub_stamp":"2024-09-14T12:10:52.156068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:11.091528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":33792,"num_write":24,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.681455+0000","last_change":"2024-09-14T12:10:29.681373+0000","last_active":"2024-09-14T12:10:29.681455+0000","last_peered":"2024-09-14T12:10:29.681455+0000","last_clean":"2024-09-14T12:10:29.681455+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:10:29.681455+0000","last_undegraded":"2024-09-14T12:10:29.681455+0000","last_fullsized":"2024-09-14T12:10:29.681455+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.681271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.681271+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.681271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:16.281265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.196490+0000","last_change":"2024-09-14T12:10:42.196490+0000","last_active":"2024-09-14T12:10:42.196490+0000","last_peered":"2024-09-14T12:10:42.196490+0000","last_clean":"2024-09-14T12:10:42.196490+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:10:42.196490+0000","last_undegraded":"2024-09-14T12:10:42.196490+0000","last_fullsized":"2024-09-14T12:10:42.196490+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-14T12:10:42.196410+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-14T12:10:42.196410+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.196410+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:38.694889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:58.895480+0000","last_change":"2024-09-14T12:10:58.895480+0000","last_active":"2024-09-14T12:10:58.895480+0000","last_peered":"2024-09-14T12:10:58.895480+0000","last_clean":"2024-09-14T12:10:58.895480+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:10:58.895480+0000","last_undegraded":"2024-09-14T12:10:58.895480+0000","last_fullsized":"2024-09-14T12:10:58.895480+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:58.895381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:58.895381+0000","last_clean_scrub_stamp":"2024-09-14T12:10:58.895381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:35.930184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:54.932684+0000","last_change":"2024-09-14T12:10:54.932684+0000","last_active":"2024-09-14T12:10:54.932684+0000","last_peered":"2024-09-14T12:10:54.932684+0000","last_clean":"2024-09-14T12:10:54.932684+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:10:54.932684+0000","last_undegraded":"2024-09-14T12:10:54.932684+0000","last_fullsized":"2024-09-14T12:10:54.932684+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:54.932569+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:54.932569+0000","last_clean_scrub_stamp":"2024-09-14T12:10:54.932569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:45.838836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.107357+0000","last_change":"2024-09-14T12:10:42.107357+0000","last_active":"2024-09-14T12:10:42.107357+0000","last_peered":"2024-09-14T12:10:42.107357+0000","last_clean":"2024-09-14T12:10:42.107357+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:10:42.107357+0000","last_undegraded":"2024-09-14T12:10:42.107357+0000","last_fullsized":"2024-09-14T12:10:42.107357+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:42.107240+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:42.107240+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.107240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:09.779063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.044244+0000","last_change":"2024-09-14T12:10:45.044244+0000","last_active":"2024-09-14T12:10:45.044244+0000","last_peered":"2024-09-14T12:10:45.044244+0000","last_clean":"2024-09-14T12:10:45.044244+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:10:45.044244+0000","last_undegraded":"2024-09-14T12:10:45.044244+0000","last_fullsized":"2024-09-14T12:10:45.044244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T12:10:45.044151+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T12:10:45.044151+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.044151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:42.946720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.691712+0000","last_change":"2024-09-14T11:44:25.355257+0000","last_active":"2024-09-14T12:08:34.691712+0000","last_peered":"2024-09-14T12:08:34.691712+0000","last_clean":"2024-09-14T12:08:34.691712+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:08:34.691712+0000","last_undegraded":"2024-09-14T12:08:34.691712+0000","last_fullsized":"2024-09-14T12:08:34.691712+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.693157+0000","last_change":"2024-09-14T12:10:45.693157+0000","last_active":"2024-09-14T12:10:45.693157+0000","last_peered":"2024-09-14T12:10:45.693157+0000","last_clean":"2024-09-14T12:10:45.693157+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:10:45.693157+0000","last_undegraded":"2024-09-14T12:10:45.693157+0000","last_fullsized":"2024-09-14T12:10:45.693157+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:45.693075+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:45.693075+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.693075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:38.938774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.148608+0000","last_change":"2024-09-14T12:10:47.148608+0000","last_active":"2024-09-14T12:10:47.148608+0000","last_peered":"2024-09-14T12:10:47.148608+0000","last_clean":"2024-09-14T12:10:47.148608+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:10:47.148608+0000","last_undegraded":"2024-09-14T12:10:47.148608+0000","last_fullsized":"2024-09-14T12:10:47.148608+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:47.148499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:47.148499+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.148499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:39.688269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.002574+0000","last_change":"2024-09-14T12:10:47.002574+0000","last_active":"2024-09-14T12:10:47.002574+0000","last_peered":"2024-09-14T12:10:47.002574+0000","last_clean":"2024-09-14T12:10:47.002574+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:10:47.002574+0000","last_undegraded":"2024-09-14T12:10:47.002574+0000","last_fullsized":"2024-09-14T12:10:47.002574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-14T12:10:47.002485+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-14T12:10:47.002485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.002485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:22.206649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.011252+0000","last_change":"2024-09-14T12:10:40.011252+0000","last_active":"2024-09-14T12:10:40.011252+0000","last_peered":"2024-09-14T12:10:40.011252+0000","last_clean":"2024-09-14T12:10:40.011252+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:10:40.011252+0000","last_undegraded":"2024-09-14T12:10:40.011252+0000","last_fullsized":"2024-09-14T12:10:40.011252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:40.011161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:40.011161+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.011161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.352660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.627784+0000","last_change":"2024-09-14T12:10:34.627784+0000","last_active":"2024-09-14T12:10:34.627784+0000","last_peered":"2024-09-14T12:10:34.627784+0000","last_clean":"2024-09-14T12:10:34.627784+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:10:34.627784+0000","last_undegraded":"2024-09-14T12:10:34.627784+0000","last_fullsized":"2024-09-14T12:10:34.627784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:34.627690+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:34.627690+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.627690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:11.119124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.072812+0000","last_change":"2024-09-14T12:10:41.072812+0000","last_active":"2024-09-14T12:10:41.072812+0000","last_peered":"2024-09-14T12:10:41.072812+0000","last_clean":"2024-09-14T12:10:41.072812+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:10:41.072812+0000","last_undegraded":"2024-09-14T12:10:41.072812+0000","last_fullsized":"2024-09-14T12:10:41.072812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:41.072718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:41.072718+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.072718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:12.565892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.472213+0000","last_change":"2024-09-14T12:10:27.472153+0000","last_active":"2024-09-14T12:10:27.472213+0000","last_peered":"2024-09-14T12:10:27.472213+0000","last_clean":"2024-09-14T12:10:27.472213+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:10:27.472213+0000","last_undegraded":"2024-09-14T12:10:27.472213+0000","last_fullsized":"2024-09-14T12:10:27.472213+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-14T12:10:27.472026+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-14T12:10:27.472026+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.472026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:49.059641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:57.494333+0000","last_change":"2024-09-14T12:10:57.494333+0000","last_active":"2024-09-14T12:10:57.494333+0000","last_peered":"2024-09-14T12:10:57.494333+0000","last_clean":"2024-09-14T12:10:57.494333+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:10:57.494333+0000","last_undegraded":"2024-09-14T12:10:57.494333+0000","last_fullsized":"2024-09-14T12:10:57.494333+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:57.494250+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:57.494250+0000","last_clean_scrub_stamp":"2024-09-14T12:10:57.494250+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:50.748882+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.634693+0000","last_change":"2024-09-14T12:10:35.634693+0000","last_active":"2024-09-14T12:10:35.634693+0000","last_peered":"2024-09-14T12:10:35.634693+0000","last_clean":"2024-09-14T12:10:35.634693+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:10:35.634693+0000","last_undegraded":"2024-09-14T12:10:35.634693+0000","last_fullsized":"2024-09-14T12:10:35.634693+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:35.634583+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:35.634583+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.634583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:42.017222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.030648+0000","last_change":"2024-09-14T12:10:40.030648+0000","last_active":"2024-09-14T12:10:40.030648+0000","last_peered":"2024-09-14T12:10:40.030648+0000","last_clean":"2024-09-14T12:10:40.030648+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:10:40.030648+0000","last_undegraded":"2024-09-14T12:10:40.030648+0000","last_fullsized":"2024-09-14T12:10:40.030648+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T12:10:40.030520+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T12:10:40.030520+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.030520+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:04.933574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.235452+0000","last_change":"2024-09-14T12:10:40.235452+0000","last_active":"2024-09-14T12:10:40.235452+0000","last_peered":"2024-09-14T12:10:40.235452+0000","last_clean":"2024-09-14T12:10:40.235452+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:10:40.235452+0000","last_undegraded":"2024-09-14T12:10:40.235452+0000","last_fullsized":"2024-09-14T12:10:40.235452+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-14T12:10:40.235367+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-14T12:10:40.235367+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.235367+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:55.287767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:56.486040+0000","last_change":"2024-09-14T12:10:56.486040+0000","last_active":"2024-09-14T12:10:56.486040+0000","last_peered":"2024-09-14T12:10:56.486040+0000","last_clean":"2024-09-14T12:10:56.486040+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:10:56.486040+0000","last_undegraded":"2024-09-14T12:10:56.486040+0000","last_fullsized":"2024-09-14T12:10:56.486040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:56.485940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:56.485940+0000","last_clean_scrub_stamp":"2024-09-14T12:10:56.485940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:20.362943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:53.934186+0000","last_change":"2024-09-14T12:10:53.934186+0000","last_active":"2024-09-14T12:10:53.934186+0000","last_peered":"2024-09-14T12:10:53.934186+0000","last_clean":"2024-09-14T12:10:53.934186+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:10:53.934186+0000","last_undegraded":"2024-09-14T12:10:53.934186+0000","last_fullsized":"2024-09-14T12:10:53.934186+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:53.934099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:53.934099+0000","last_clean_scrub_stamp":"2024-09-14T12:10:53.934099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:47.372149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:51.195606+0000","last_change":"2024-09-14T12:10:51.195606+0000","last_active":"2024-09-14T12:10:51.195606+0000","last_peered":"2024-09-14T12:10:51.195606+0000","last_clean":"2024-09-14T12:10:51.195606+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:10:51.195606+0000","last_undegraded":"2024-09-14T12:10:51.195606+0000","last_fullsized":"2024-09-14T12:10:51.195606+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:51.195508+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:51.195508+0000","last_clean_scrub_stamp":"2024-09-14T12:10:51.195508+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:17.288233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.894280+0000","last_change":"2024-09-14T12:10:26.894280+0000","last_active":"2024-09-14T12:10:26.894280+0000","last_peered":"2024-09-14T12:10:26.894280+0000","last_clean":"2024-09-14T12:10:26.894280+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:10:26.894280+0000","last_undegraded":"2024-09-14T12:10:26.894280+0000","last_fullsized":"2024-09-14T12:10:26.894280+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T12:10:26.894190+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T12:10:26.894190+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.894190+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:35.886806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.052903+0000","last_change":"2024-09-14T12:10:41.052903+0000","last_active":"2024-09-14T12:10:41.052903+0000","last_peered":"2024-09-14T12:10:41.052903+0000","last_clean":"2024-09-14T12:10:41.052903+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:10:41.052903+0000","last_undegraded":"2024-09-14T12:10:41.052903+0000","last_fullsized":"2024-09-14T12:10:41.052903+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:41.052796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:41.052796+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.052796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:11.933831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:52.973939+0000","last_change":"2024-09-14T12:10:52.973939+0000","last_active":"2024-09-14T12:10:52.973939+0000","last_peered":"2024-09-14T12:10:52.973939+0000","last_clean":"2024-09-14T12:10:52.973939+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:10:52.973939+0000","last_undegraded":"2024-09-14T12:10:52.973939+0000","last_fullsized":"2024-09-14T12:10:52.973939+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:52.973848+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:52.973848+0000","last_clean_scrub_stamp":"2024-09-14T12:10:52.973848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:56.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.625892+0000","last_change":"2024-09-14T12:10:42.625892+0000","last_active":"2024-09-14T12:10:42.625892+0000","last_peered":"2024-09-14T12:10:42.625892+0000","last_clean":"2024-09-14T12:10:42.625892+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:10:42.625892+0000","last_undegraded":"2024-09-14T12:10:42.625892+0000","last_fullsized":"2024-09-14T12:10:42.625892+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:42.625803+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:42.625803+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.625803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:14.610136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.205010+0000","last_change":"2024-09-14T12:10:41.205010+0000","last_active":"2024-09-14T12:10:41.205010+0000","last_peered":"2024-09-14T12:10:41.205010+0000","last_clean":"2024-09-14T12:10:41.205010+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:10:41.205010+0000","last_undegraded":"2024-09-14T12:10:41.205010+0000","last_fullsized":"2024-09-14T12:10:41.205010+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-14T12:10:41.204917+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-14T12:10:41.204917+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.204917+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:24.550925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.666439+0000","last_change":"2024-09-14T12:10:32.666439+0000","last_active":"2024-09-14T12:10:32.666439+0000","last_peered":"2024-09-14T12:10:32.666439+0000","last_clean":"2024-09-14T12:10:32.666439+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:10:32.666439+0000","last_undegraded":"2024-09-14T12:10:32.666439+0000","last_fullsized":"2024-09-14T12:10:32.666439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:32.666336+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:32.666336+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.666336+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.413521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:51.923723+0000","last_change":"2024-09-14T12:10:51.923723+0000","last_active":"2024-09-14T12:10:51.923723+0000","last_peered":"2024-09-14T12:10:51.923723+0000","last_clean":"2024-09-14T12:10:51.923723+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:10:51.923723+0000","last_undegraded":"2024-09-14T12:10:51.923723+0000","last_fullsized":"2024-09-14T12:10:51.923723+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:51.923620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:51.923620+0000","last_clean_scrub_stamp":"2024-09-14T12:10:51.923620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:15.874380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.552614+0000","last_change":"2024-09-14T12:10:46.552614+0000","last_active":"2024-09-14T12:10:46.552614+0000","last_peered":"2024-09-14T12:10:46.552614+0000","last_clean":"2024-09-14T12:10:46.552614+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:10:46.552614+0000","last_undegraded":"2024-09-14T12:10:46.552614+0000","last_fullsized":"2024-09-14T12:10:46.552614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:46.552523+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:46.552523+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.552523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:10.981369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.133490+0000","last_change":"2024-09-14T12:10:41.133490+0000","last_active":"2024-09-14T12:10:41.133490+0000","last_peered":"2024-09-14T12:10:41.133490+0000","last_clean":"2024-09-14T12:10:41.133490+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:10:41.133490+0000","last_undegraded":"2024-09-14T12:10:41.133490+0000","last_fullsized":"2024-09-14T12:10:41.133490+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-14T12:10:41.133375+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-14T12:10:41.133375+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.133375+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.381972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:54.425090+0000","last_change":"2024-09-14T12:10:54.425090+0000","last_active":"2024-09-14T12:10:54.425090+0000","last_peered":"2024-09-14T12:10:54.425090+0000","last_clean":"2024-09-14T12:10:54.425090+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:10:54.425090+0000","last_undegraded":"2024-09-14T12:10:54.425090+0000","last_fullsized":"2024-09-14T12:10:54.425090+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:54.425003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:54.425003+0000","last_clean_scrub_stamp":"2024-09-14T12:10:54.425003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.181965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:57.895070+0000","last_change":"2024-09-14T12:10:57.895070+0000","last_active":"2024-09-14T12:10:57.895070+0000","last_peered":"2024-09-14T12:10:57.895070+0000","last_clean":"2024-09-14T12:10:57.895070+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:10:57.895070+0000","last_undegraded":"2024-09-14T12:10:57.895070+0000","last_fullsized":"2024-09-14T12:10:57.895070+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-14T12:10:57.894978+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-14T12:10:57.894978+0000","last_clean_scrub_stamp":"2024-09-14T12:10:57.894978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:43.771232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.634499+0000","last_change":"2024-09-14T12:10:28.634499+0000","last_active":"2024-09-14T12:10:28.634499+0000","last_peered":"2024-09-14T12:10:28.634499+0000","last_clean":"2024-09-14T12:10:28.634499+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:10:28.634499+0000","last_undegraded":"2024-09-14T12:10:28.634499+0000","last_fullsized":"2024-09-14T12:10:28.634499+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.634405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.634405+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.634405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:48.158772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.651452+0000","last_change":"2024-09-14T12:10:25.651452+0000","last_active":"2024-09-14T12:10:25.651452+0000","last_peered":"2024-09-14T12:10:25.651452+0000","last_clean":"2024-09-14T12:10:25.651452+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:10:25.651452+0000","last_undegraded":"2024-09-14T12:10:25.651452+0000","last_fullsized":"2024-09-14T12:10:25.651452+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-14T12:10:25.651333+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-14T12:10:25.651333+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.651333+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:53.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.740972+0000","last_change":"2024-09-14T12:10:46.740972+0000","last_active":"2024-09-14T12:10:46.740972+0000","last_peered":"2024-09-14T12:10:46.740972+0000","last_clean":"2024-09-14T12:10:46.740972+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:10:46.740972+0000","last_undegraded":"2024-09-14T12:10:46.740972+0000","last_fullsized":"2024-09-14T12:10:46.740972+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:46.740882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:46.740882+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.740882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.294038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.123271+0000","last_change":"2024-09-14T12:10:45.123271+0000","last_active":"2024-09-14T12:10:45.123271+0000","last_peered":"2024-09-14T12:10:45.123271+0000","last_clean":"2024-09-14T12:10:45.123271+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:10:45.123271+0000","last_undegraded":"2024-09-14T12:10:45.123271+0000","last_fullsized":"2024-09-14T12:10:45.123271+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:45.123183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:45.123183+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.123183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:50.598100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.156538+0000","last_change":"2024-09-14T12:10:48.156538+0000","last_active":"2024-09-14T12:10:48.156538+0000","last_peered":"2024-09-14T12:10:48.156538+0000","last_clean":"2024-09-14T12:10:48.156538+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:10:48.156538+0000","last_undegraded":"2024-09-14T12:10:48.156538+0000","last_fullsized":"2024-09-14T12:10:48.156538+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:48.156437+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:48.156437+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.156437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:23.656429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.572988+0000","last_change":"2024-09-14T12:10:40.572988+0000","last_active":"2024-09-14T12:10:40.572988+0000","last_peered":"2024-09-14T12:10:40.572988+0000","last_clean":"2024-09-14T12:10:40.572988+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:10:40.572988+0000","last_undegraded":"2024-09-14T12:10:40.572988+0000","last_fullsized":"2024-09-14T12:10:40.572988+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'37","last_scrub_stamp":"2024-09-14T12:10:40.572898+0000","last_deep_scrub":"265'37","last_deep_scrub_stamp":"2024-09-14T12:10:40.572898+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.572898+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:40.443983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:08:34.691731+0000","last_change":"2024-09-14T11:44:25.346724+0000","last_active":"2024-09-14T12:08:34.691731+0000","last_peered":"2024-09-14T12:08:34.691731+0000","last_clean":"2024-09-14T12:08:34.691731+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:08:34.691731+0000","last_undegraded":"2024-09-14T12:08:34.691731+0000","last_fullsized":"2024-09-14T12:08:34.691731+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:44:24.326051+0000","last_clean_scrub_stamp":"2024-09-14T11:44:24.326051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.064545+0000","last_change":"2024-09-14T12:10:38.064545+0000","last_active":"2024-09-14T12:10:38.064545+0000","last_peered":"2024-09-14T12:10:38.064545+0000","last_clean":"2024-09-14T12:10:38.064545+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:10:38.064545+0000","last_undegraded":"2024-09-14T12:10:38.064545+0000","last_fullsized":"2024-09-14T12:10:38.064545+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:38.064437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:38.064437+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.064437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:11.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.076970+0000","last_change":"2024-09-14T12:10:38.076970+0000","last_active":"2024-09-14T12:10:38.076970+0000","last_peered":"2024-09-14T12:10:38.076970+0000","last_clean":"2024-09-14T12:10:38.076970+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:10:38.076970+0000","last_undegraded":"2024-09-14T12:10:38.076970+0000","last_fullsized":"2024-09-14T12:10:38.076970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:38.076864+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:38.076864+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.076864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:26.235717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":236,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.518682+0000","last_change":"2024-09-14T12:10:38.518682+0000","last_active":"2024-09-14T12:10:38.518682+0000","last_peered":"2024-09-14T12:10:38.518682+0000","last_clean":"2024-09-14T12:10:38.518682+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:10:38.518682+0000","last_undegraded":"2024-09-14T12:10:38.518682+0000","last_fullsized":"2024-09-14T12:10:38.518682+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'62","last_scrub_stamp":"2024-09-14T12:10:38.518602+0000","last_deep_scrub":"265'62","last_deep_scrub_stamp":"2024-09-14T12:10:38.518602+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.518602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:45.752697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:57.165945+0000","last_change":"2024-09-14T12:10:57.165854+0000","last_active":"2024-09-14T12:10:57.165945+0000","last_peered":"2024-09-14T12:10:57.165945+0000","last_clean":"2024-09-14T12:10:57.165945+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:10:57.165945+0000","last_undegraded":"2024-09-14T12:10:57.165945+0000","last_fullsized":"2024-09-14T12:10:57.165945+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:57.165749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:57.165749+0000","last_clean_scrub_stamp":"2024-09-14T12:10:57.165749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.082241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.015006+0000","last_change":"2024-09-14T12:10:37.015006+0000","last_active":"2024-09-14T12:10:37.015006+0000","last_peered":"2024-09-14T12:10:37.015006+0000","last_clean":"2024-09-14T12:10:37.015006+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:10:37.015006+0000","last_undegraded":"2024-09-14T12:10:37.015006+0000","last_fullsized":"2024-09-14T12:10:37.015006+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:37.014890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:37.014890+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.014890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.635990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.070235+0000","last_change":"2024-09-14T12:10:44.070235+0000","last_active":"2024-09-14T12:10:44.070235+0000","last_peered":"2024-09-14T12:10:44.070235+0000","last_clean":"2024-09-14T12:10:44.070235+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:10:44.070235+0000","last_undegraded":"2024-09-14T12:10:44.070235+0000","last_fullsized":"2024-09-14T12:10:44.070235+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:44.070136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:44.070136+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.070136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:35.988653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.245202+0000","last_change":"2024-09-14T12:10:39.245202+0000","last_active":"2024-09-14T12:10:39.245202+0000","last_peered":"2024-09-14T12:10:39.245202+0000","last_clean":"2024-09-14T12:10:39.245202+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:10:39.245202+0000","last_undegraded":"2024-09-14T12:10:39.245202+0000","last_fullsized":"2024-09-14T12:10:39.245202+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'49","last_scrub_stamp":"2024-09-14T12:10:39.245115+0000","last_deep_scrub":"262'49","last_deep_scrub_stamp":"2024-09-14T12:10:39.245115+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.245115+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:07.893173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:56.208071+0000","last_change":"2024-09-14T12:10:56.208071+0000","last_active":"2024-09-14T12:10:56.208071+0000","last_peered":"2024-09-14T12:10:56.208071+0000","last_clean":"2024-09-14T12:10:56.208071+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:10:56.208071+0000","last_undegraded":"2024-09-14T12:10:56.208071+0000","last_fullsized":"2024-09-14T12:10:56.208071+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:56.207983+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:56.207983+0000","last_clean_scrub_stamp":"2024-09-14T12:10:56.207983+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:48.860096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:50.934210+0000","last_change":"2024-09-14T12:10:50.934210+0000","last_active":"2024-09-14T12:10:50.934210+0000","last_peered":"2024-09-14T12:10:50.934210+0000","last_clean":"2024-09-14T12:10:50.934210+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:10:50.934210+0000","last_undegraded":"2024-09-14T12:10:50.934210+0000","last_fullsized":"2024-09-14T12:10:50.934210+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:50.934106+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:50.934106+0000","last_clean_scrub_stamp":"2024-09-14T12:10:50.934106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:14.700471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.524514+0000","last_change":"2024-09-14T12:10:30.524447+0000","last_active":"2024-09-14T12:10:30.524514+0000","last_peered":"2024-09-14T12:10:30.524514+0000","last_clean":"2024-09-14T12:10:30.524514+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:10:30.524514+0000","last_undegraded":"2024-09-14T12:10:30.524514+0000","last_fullsized":"2024-09-14T12:10:30.524514+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:30.524343+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:30.524343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.524343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:49.484368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.022994+0000","last_change":"2024-09-14T12:10:36.022994+0000","last_active":"2024-09-14T12:10:36.022994+0000","last_peered":"2024-09-14T12:10:36.022994+0000","last_clean":"2024-09-14T12:10:36.022994+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:10:36.022994+0000","last_undegraded":"2024-09-14T12:10:36.022994+0000","last_fullsized":"2024-09-14T12:10:36.022994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:36.022906+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:36.022906+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.022906+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:48.376166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:56.888822+0000","last_change":"2024-09-14T12:10:56.888700+0000","last_active":"2024-09-14T12:10:56.888822+0000","last_peered":"2024-09-14T12:10:56.888822+0000","last_clean":"2024-09-14T12:10:56.888822+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:10:56.888822+0000","last_undegraded":"2024-09-14T12:10:56.888822+0000","last_fullsized":"2024-09-14T12:10:56.888822+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:56.888597+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:56.888597+0000","last_clean_scrub_stamp":"2024-09-14T12:10:56.888597+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:06.823803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.632077+0000","last_change":"2024-09-14T12:10:33.632005+0000","last_active":"2024-09-14T12:10:33.632077+0000","last_peered":"2024-09-14T12:10:33.632077+0000","last_clean":"2024-09-14T12:10:33.632077+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:10:33.632077+0000","last_undegraded":"2024-09-14T12:10:33.632077+0000","last_fullsized":"2024-09-14T12:10:33.632077+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:33.631920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:33.631920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.631920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:31.081297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.577347+0000","last_change":"2024-09-14T12:10:40.577347+0000","last_active":"2024-09-14T12:10:40.577347+0000","last_peered":"2024-09-14T12:10:40.577347+0000","last_clean":"2024-09-14T12:10:40.577347+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:10:40.577347+0000","last_undegraded":"2024-09-14T12:10:40.577347+0000","last_fullsized":"2024-09-14T12:10:40.577347+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:40.577246+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:40.577246+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.577246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:20.683725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.106225+0000","last_change":"2024-09-14T12:10:43.106225+0000","last_active":"2024-09-14T12:10:43.106225+0000","last_peered":"2024-09-14T12:10:43.106225+0000","last_clean":"2024-09-14T12:10:43.106225+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:10:43.106225+0000","last_undegraded":"2024-09-14T12:10:43.106225+0000","last_fullsized":"2024-09-14T12:10:43.106225+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:43.106139+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:43.106139+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.106139+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:48.676378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.703935+0000","last_change":"2024-09-14T12:10:30.703935+0000","last_active":"2024-09-14T12:10:30.703935+0000","last_peered":"2024-09-14T12:10:30.703935+0000","last_clean":"2024-09-14T12:10:30.703935+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:10:30.703935+0000","last_undegraded":"2024-09-14T12:10:30.703935+0000","last_fullsized":"2024-09-14T12:10:30.703935+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.703836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.703836+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.703836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:35.246152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.010507+0000","last_change":"2024-09-14T12:10:46.010507+0000","last_active":"2024-09-14T12:10:46.010507+0000","last_peered":"2024-09-14T12:10:46.010507+0000","last_clean":"2024-09-14T12:10:46.010507+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:10:46.010507+0000","last_undegraded":"2024-09-14T12:10:46.010507+0000","last_fullsized":"2024-09-14T12:10:46.010507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:46.010413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:46.010413+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.010413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:15.494944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.507043+0000","last_change":"2024-09-14T12:10:45.507043+0000","last_active":"2024-09-14T12:10:45.507043+0000","last_peered":"2024-09-14T12:10:45.507043+0000","last_clean":"2024-09-14T12:10:45.507043+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:10:45.507043+0000","last_undegraded":"2024-09-14T12:10:45.507043+0000","last_fullsized":"2024-09-14T12:10:45.507043+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-14T12:10:45.506950+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-14T12:10:45.506950+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.506950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:35.915610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.128734+0000","last_change":"2024-09-14T12:10:40.128734+0000","last_active":"2024-09-14T12:10:40.128734+0000","last_peered":"2024-09-14T12:10:40.128734+0000","last_clean":"2024-09-14T12:10:40.128734+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:10:40.128734+0000","last_undegraded":"2024-09-14T12:10:40.128734+0000","last_fullsized":"2024-09-14T12:10:40.128734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-14T12:10:40.128618+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-14T12:10:40.128618+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.128618+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:32.148044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:53.454640+0000","last_change":"2024-09-14T12:10:53.454640+0000","last_active":"2024-09-14T12:10:53.454640+0000","last_peered":"2024-09-14T12:10:53.454640+0000","last_clean":"2024-09-14T12:10:53.454640+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:10:53.454640+0000","last_undegraded":"2024-09-14T12:10:53.454640+0000","last_fullsized":"2024-09-14T12:10:53.454640+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:53.454555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:53.454555+0000","last_clean_scrub_stamp":"2024-09-14T12:10:53.454555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:18.544162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.991310+0000","last_change":"2024-09-14T12:10:48.991310+0000","last_active":"2024-09-14T12:10:48.991310+0000","last_peered":"2024-09-14T12:10:48.991310+0000","last_clean":"2024-09-14T12:10:48.991310+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:10:48.991310+0000","last_undegraded":"2024-09-14T12:10:48.991310+0000","last_fullsized":"2024-09-14T12:10:48.991310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.991222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.991222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.991222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:39.146791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.599235+0000","last_change":"2024-09-14T12:10:27.599235+0000","last_active":"2024-09-14T12:10:27.599235+0000","last_peered":"2024-09-14T12:10:27.599235+0000","last_clean":"2024-09-14T12:10:27.599235+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:10:27.599235+0000","last_undegraded":"2024-09-14T12:10:27.599235+0000","last_fullsized":"2024-09-14T12:10:27.599235+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:27.599137+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:27.599137+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.599137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:18.228646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.576187+0000","last_change":"2024-09-14T12:10:41.576187+0000","last_active":"2024-09-14T12:10:41.576187+0000","last_peered":"2024-09-14T12:10:41.576187+0000","last_clean":"2024-09-14T12:10:41.576187+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:10:41.576187+0000","last_undegraded":"2024-09-14T12:10:41.576187+0000","last_fullsized":"2024-09-14T12:10:41.576187+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:41.576103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:41.576103+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.576103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:40.952126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.656553+0000","last_change":"2024-09-14T12:10:36.656553+0000","last_active":"2024-09-14T12:10:36.656553+0000","last_peered":"2024-09-14T12:10:36.656553+0000","last_clean":"2024-09-14T12:10:36.656553+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:10:36.656553+0000","last_undegraded":"2024-09-14T12:10:36.656553+0000","last_fullsized":"2024-09-14T12:10:36.656553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:36.656465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:36.656465+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.656465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:04.886372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.956830+0000","last_change":"2024-09-14T12:10:34.956830+0000","last_active":"2024-09-14T12:10:34.956830+0000","last_peered":"2024-09-14T12:10:34.956830+0000","last_clean":"2024-09-14T12:10:34.956830+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:10:34.956830+0000","last_undegraded":"2024-09-14T12:10:34.956830+0000","last_fullsized":"2024-09-14T12:10:34.956830+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:34.956716+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:34.956716+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.956716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:57.306536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.154311+0000","last_change":"2024-09-14T12:10:46.154311+0000","last_active":"2024-09-14T12:10:46.154311+0000","last_peered":"2024-09-14T12:10:46.154311+0000","last_clean":"2024-09-14T12:10:46.154311+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:10:46.154311+0000","last_undegraded":"2024-09-14T12:10:46.154311+0000","last_fullsized":"2024-09-14T12:10:46.154311+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:46.154207+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:46.154207+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.154207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.720350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.487619+0000","last_change":"2024-09-14T12:10:26.487556+0000","last_active":"2024-09-14T12:10:26.487619+0000","last_peered":"2024-09-14T12:10:26.487619+0000","last_clean":"2024-09-14T12:10:26.487619+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:10:26.487619+0000","last_undegraded":"2024-09-14T12:10:26.487619+0000","last_fullsized":"2024-09-14T12:10:26.487619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-14T12:10:26.487463+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-14T12:10:26.487463+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.487463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:58.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:51.452306+0000","last_change":"2024-09-14T12:10:51.452306+0000","last_active":"2024-09-14T12:10:51.452306+0000","last_peered":"2024-09-14T12:10:51.452306+0000","last_clean":"2024-09-14T12:10:51.452306+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:10:51.452306+0000","last_undegraded":"2024-09-14T12:10:51.452306+0000","last_fullsized":"2024-09-14T12:10:51.452306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:51.452214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:51.452214+0000","last_clean_scrub_stamp":"2024-09-14T12:10:51.452214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:49.944698+0000","last_change":"2024-09-14T12:10:49.944698+0000","last_active":"2024-09-14T12:10:49.944698+0000","last_peered":"2024-09-14T12:10:49.944698+0000","last_clean":"2024-09-14T12:10:49.944698+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:10:49.944698+0000","last_undegraded":"2024-09-14T12:10:49.944698+0000","last_fullsized":"2024-09-14T12:10:49.944698+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:49.944537+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:49.944537+0000","last_clean_scrub_stamp":"2024-09-14T12:10:49.944537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:26.096927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.945985+0000","last_change":"2024-09-14T12:10:31.945985+0000","last_active":"2024-09-14T12:10:31.945985+0000","last_peered":"2024-09-14T12:10:31.945985+0000","last_clean":"2024-09-14T12:10:31.945985+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:10:31.945985+0000","last_undegraded":"2024-09-14T12:10:31.945985+0000","last_fullsized":"2024-09-14T12:10:31.945985+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:31.945896+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:31.945896+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.945896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:23.234876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.741384+0000","last_change":"2024-09-14T12:10:23.741291+0000","last_active":"2024-09-14T12:10:23.741384+0000","last_peered":"2024-09-14T12:10:23.741384+0000","last_clean":"2024-09-14T12:10:23.741384+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:10:23.741384+0000","last_undegraded":"2024-09-14T12:10:23.741384+0000","last_fullsized":"2024-09-14T12:10:23.741384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'28","last_scrub_stamp":"2024-09-14T12:10:23.741177+0000","last_deep_scrub":"262'28","last_deep_scrub_stamp":"2024-09-14T12:10:23.741177+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.741177+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:32.349253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:55.899645+0000","last_change":"2024-09-14T12:10:55.899645+0000","last_active":"2024-09-14T12:10:55.899645+0000","last_peered":"2024-09-14T12:10:55.899645+0000","last_clean":"2024-09-14T12:10:55.899645+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:10:55.899645+0000","last_undegraded":"2024-09-14T12:10:55.899645+0000","last_fullsized":"2024-09-14T12:10:55.899645+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:55.899540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:55.899540+0000","last_clean_scrub_stamp":"2024-09-14T12:10:55.899540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:49.785998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.160500+0000","last_change":"2024-09-14T12:10:46.160500+0000","last_active":"2024-09-14T12:10:46.160500+0000","last_peered":"2024-09-14T12:10:46.160500+0000","last_clean":"2024-09-14T12:10:46.160500+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:10:46.160500+0000","last_undegraded":"2024-09-14T12:10:46.160500+0000","last_fullsized":"2024-09-14T12:10:46.160500+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:46.160393+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:46.160393+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.160393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:50.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.200169+0000","last_change":"2024-09-14T12:10:43.200169+0000","last_active":"2024-09-14T12:10:43.200169+0000","last_peered":"2024-09-14T12:10:43.200169+0000","last_clean":"2024-09-14T12:10:43.200169+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:10:43.200169+0000","last_undegraded":"2024-09-14T12:10:43.200169+0000","last_fullsized":"2024-09-14T12:10:43.200169+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:43.200086+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:43.200086+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.200086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:17.908787+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.234013+0000","last_change":"2024-09-14T12:10:38.234013+0000","last_active":"2024-09-14T12:10:38.234013+0000","last_peered":"2024-09-14T12:10:38.234013+0000","last_clean":"2024-09-14T12:10:38.234013+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:10:38.234013+0000","last_undegraded":"2024-09-14T12:10:38.234013+0000","last_fullsized":"2024-09-14T12:10:38.234013+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-14T12:10:38.233907+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-14T12:10:38.233907+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.233907+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:17.747594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:58.523813+0000","last_change":"2024-09-14T12:10:58.523813+0000","last_active":"2024-09-14T12:10:58.523813+0000","last_peered":"2024-09-14T12:10:58.523813+0000","last_clean":"2024-09-14T12:10:58.523813+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:10:58.523813+0000","last_undegraded":"2024-09-14T12:10:58.523813+0000","last_fullsized":"2024-09-14T12:10:58.523813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:58.523685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:58.523685+0000","last_clean_scrub_stamp":"2024-09-14T12:10:58.523685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:15.370446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.555054+0000","last_change":"2024-09-14T12:10:48.555054+0000","last_active":"2024-09-14T12:10:48.555054+0000","last_peered":"2024-09-14T12:10:48.555054+0000","last_clean":"2024-09-14T12:10:48.555054+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:10:48.555054+0000","last_undegraded":"2024-09-14T12:10:48.555054+0000","last_fullsized":"2024-09-14T12:10:48.555054+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:48.554966+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:48.554966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.554966+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:58.079973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.903051+0000","last_change":"2024-09-14T12:10:30.903051+0000","last_active":"2024-09-14T12:10:30.903051+0000","last_peered":"2024-09-14T12:10:30.903051+0000","last_clean":"2024-09-14T12:10:30.903051+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:10:30.903051+0000","last_undegraded":"2024-09-14T12:10:30.903051+0000","last_fullsized":"2024-09-14T12:10:30.903051+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:30.902949+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:30.902949+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.902949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:54.542664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.483049+0000","last_change":"2024-09-14T12:10:37.483049+0000","last_active":"2024-09-14T12:10:37.483049+0000","last_peered":"2024-09-14T12:10:37.483049+0000","last_clean":"2024-09-14T12:10:37.483049+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:10:37.483049+0000","last_undegraded":"2024-09-14T12:10:37.483049+0000","last_fullsized":"2024-09-14T12:10:37.483049+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-14T12:10:37.482966+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-14T12:10:37.482966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.482966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:28.164284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:55.446736+0000","last_change":"2024-09-14T12:10:55.446736+0000","last_active":"2024-09-14T12:10:55.446736+0000","last_peered":"2024-09-14T12:10:55.446736+0000","last_clean":"2024-09-14T12:10:55.446736+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:10:55.446736+0000","last_undegraded":"2024-09-14T12:10:55.446736+0000","last_fullsized":"2024-09-14T12:10:55.446736+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:55.446636+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:55.446636+0000","last_clean_scrub_stamp":"2024-09-14T12:10:55.446636+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:08.136564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.931874+0000","last_change":"2024-09-14T12:10:33.931874+0000","last_active":"2024-09-14T12:10:33.931874+0000","last_peered":"2024-09-14T12:10:33.931874+0000","last_clean":"2024-09-14T12:10:33.931874+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:10:33.931874+0000","last_undegraded":"2024-09-14T12:10:33.931874+0000","last_fullsized":"2024-09-14T12:10:33.931874+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T12:10:33.931788+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T12:10:33.931788+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.931788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:09.612933+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17937,"num_write":8,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.138619+0000","last_change":"2024-09-14T12:10:45.138619+0000","last_active":"2024-09-14T12:10:45.138619+0000","last_peered":"2024-09-14T12:10:45.138619+0000","last_clean":"2024-09-14T12:10:45.138619+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:10:45.138619+0000","last_undegraded":"2024-09-14T12:10:45.138619+0000","last_fullsized":"2024-09-14T12:10:45.138619+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:45.138515+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:45.138515+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.138515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:51.617956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.127259+0000","last_change":"2024-09-14T12:10:42.127178+0000","last_active":"2024-09-14T12:10:42.127259+0000","last_peered":"2024-09-14T12:10:42.127259+0000","last_clean":"2024-09-14T12:10:42.127259+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:10:42.127259+0000","last_undegraded":"2024-09-14T12:10:42.127259+0000","last_fullsized":"2024-09-14T12:10:42.127259+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-14T12:10:42.127079+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-14T12:10:42.127079+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.127079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.490021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:54.167689+0000","last_change":"2024-09-14T12:10:54.167689+0000","last_active":"2024-09-14T12:10:54.167689+0000","last_peered":"2024-09-14T12:10:54.167689+0000","last_clean":"2024-09-14T12:10:54.167689+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:10:54.167689+0000","last_undegraded":"2024-09-14T12:10:54.167689+0000","last_fullsized":"2024-09-14T12:10:54.167689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:54.167531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:54.167531+0000","last_clean_scrub_stamp":"2024-09-14T12:10:54.167531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:36.970872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:49.505982+0000","last_change":"2024-09-14T12:10:49.505982+0000","last_active":"2024-09-14T12:10:49.505982+0000","last_peered":"2024-09-14T12:10:49.505982+0000","last_clean":"2024-09-14T12:10:49.505982+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:10:49.505982+0000","last_undegraded":"2024-09-14T12:10:49.505982+0000","last_fullsized":"2024-09-14T12:10:49.505982+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:49.505888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:49.505888+0000","last_clean_scrub_stamp":"2024-09-14T12:10:49.505888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:58.875106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.061228+0000","last_change":"2024-09-14T12:10:39.061228+0000","last_active":"2024-09-14T12:10:39.061228+0000","last_peered":"2024-09-14T12:10:39.061228+0000","last_clean":"2024-09-14T12:10:39.061228+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:10:39.061228+0000","last_undegraded":"2024-09-14T12:10:39.061228+0000","last_fullsized":"2024-09-14T12:10:39.061228+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.061111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.061111+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.061111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:40.612611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.537833+0000","last_change":"2024-09-14T12:10:29.537776+0000","last_active":"2024-09-14T12:10:29.537833+0000","last_peered":"2024-09-14T12:10:29.537833+0000","last_clean":"2024-09-14T12:10:29.537833+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:10:29.537833+0000","last_undegraded":"2024-09-14T12:10:29.537833+0000","last_fullsized":"2024-09-14T12:10:29.537833+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-14T12:10:29.537674+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-14T12:10:29.537674+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.537674+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:55.031465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:50.458028+0000","last_change":"2024-09-14T12:10:50.458028+0000","last_active":"2024-09-14T12:10:50.458028+0000","last_peered":"2024-09-14T12:10:50.458028+0000","last_clean":"2024-09-14T12:10:50.458028+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:10:50.458028+0000","last_undegraded":"2024-09-14T12:10:50.458028+0000","last_fullsized":"2024-09-14T12:10:50.458028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:50.457928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:50.457928+0000","last_clean_scrub_stamp":"2024-09-14T12:10:50.457928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.222831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:50.147504+0000","last_change":"2024-09-14T12:10:50.147504+0000","last_active":"2024-09-14T12:10:50.147504+0000","last_peered":"2024-09-14T12:10:50.147504+0000","last_clean":"2024-09-14T12:10:50.147504+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:10:50.147504+0000","last_undegraded":"2024-09-14T12:10:50.147504+0000","last_fullsized":"2024-09-14T12:10:50.147504+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:50.147419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:50.147419+0000","last_clean_scrub_stamp":"2024-09-14T12:10:50.147419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:14.239274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.527041+0000","last_change":"2024-09-14T12:10:43.527041+0000","last_active":"2024-09-14T12:10:43.527041+0000","last_peered":"2024-09-14T12:10:43.527041+0000","last_clean":"2024-09-14T12:10:43.527041+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:10:43.527041+0000","last_undegraded":"2024-09-14T12:10:43.527041+0000","last_fullsized":"2024-09-14T12:10:43.527041+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:43.526957+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:43.526957+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.526957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:45.876471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.194165+0000","last_change":"2024-09-14T12:10:37.194085+0000","last_active":"2024-09-14T12:10:37.194165+0000","last_peered":"2024-09-14T12:10:37.194165+0000","last_clean":"2024-09-14T12:10:37.194165+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:10:37.194165+0000","last_undegraded":"2024-09-14T12:10:37.194165+0000","last_fullsized":"2024-09-14T12:10:37.194165+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-14T12:10:37.193995+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-14T12:10:37.193995+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.193995+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:41.153802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.630179+0000","last_change":"2024-09-14T12:10:43.630179+0000","last_active":"2024-09-14T12:10:43.630179+0000","last_peered":"2024-09-14T12:10:43.630179+0000","last_clean":"2024-09-14T12:10:43.630179+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:10:43.630179+0000","last_undegraded":"2024-09-14T12:10:43.630179+0000","last_fullsized":"2024-09-14T12:10:43.630179+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:43.630095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:43.630095+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.630095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:37.614737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:49.112188+0000","last_change":"2024-09-14T12:10:49.112188+0000","last_active":"2024-09-14T12:10:49.112188+0000","last_peered":"2024-09-14T12:10:49.112188+0000","last_clean":"2024-09-14T12:10:49.112188+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:10:49.112188+0000","last_undegraded":"2024-09-14T12:10:49.112188+0000","last_fullsized":"2024-09-14T12:10:49.112188+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:49.112106+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:49.112106+0000","last_clean_scrub_stamp":"2024-09-14T12:10:49.112106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:44.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.604950+0000","last_change":"2024-09-14T12:10:26.604950+0000","last_active":"2024-09-14T12:10:26.604950+0000","last_peered":"2024-09-14T12:10:26.604950+0000","last_clean":"2024-09-14T12:10:26.604950+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:10:26.604950+0000","last_undegraded":"2024-09-14T12:10:26.604950+0000","last_fullsized":"2024-09-14T12:10:26.604950+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:26.604867+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:26.604867+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.604867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:23.881125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.437842+0000","last_change":"2024-09-14T12:10:25.437755+0000","last_active":"2024-09-14T12:10:25.437842+0000","last_peered":"2024-09-14T12:10:25.437842+0000","last_clean":"2024-09-14T12:10:25.437842+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:10:25.437842+0000","last_undegraded":"2024-09-14T12:10:25.437842+0000","last_fullsized":"2024-09-14T12:10:25.437842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:25.437626+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:25.437626+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.437626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:14.993165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.056974+0000","last_change":"2024-09-14T12:10:39.056974+0000","last_active":"2024-09-14T12:10:39.056974+0000","last_peered":"2024-09-14T12:10:39.056974+0000","last_clean":"2024-09-14T12:10:39.056974+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:10:39.056974+0000","last_undegraded":"2024-09-14T12:10:39.056974+0000","last_fullsized":"2024-09-14T12:10:39.056974+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.056866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.056866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.056866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.111137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.514415+0000","last_change":"2024-09-14T12:10:47.514415+0000","last_active":"2024-09-14T12:10:47.514415+0000","last_peered":"2024-09-14T12:10:47.514415+0000","last_clean":"2024-09-14T12:10:47.514415+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:10:47.514415+0000","last_undegraded":"2024-09-14T12:10:47.514415+0000","last_fullsized":"2024-09-14T12:10:47.514415+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:47.514320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:47.514320+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.514320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:08.529818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.537112+0000","last_change":"2024-09-14T12:10:39.537112+0000","last_active":"2024-09-14T12:10:39.537112+0000","last_peered":"2024-09-14T12:10:39.537112+0000","last_clean":"2024-09-14T12:10:39.537112+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:10:39.537112+0000","last_undegraded":"2024-09-14T12:10:39.537112+0000","last_fullsized":"2024-09-14T12:10:39.537112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.537019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.537019+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.537019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:43.511738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.494266+0000","last_change":"2024-09-14T12:10:36.494266+0000","last_active":"2024-09-14T12:10:36.494266+0000","last_peered":"2024-09-14T12:10:36.494266+0000","last_clean":"2024-09-14T12:10:36.494266+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:10:36.494266+0000","last_undegraded":"2024-09-14T12:10:36.494266+0000","last_fullsized":"2024-09-14T12:10:36.494266+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-14T12:10:36.494160+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-14T12:10:36.494160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.494160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:43.294501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.226881+0000","last_change":"2024-09-14T12:10:48.226881+0000","last_active":"2024-09-14T12:10:48.226881+0000","last_peered":"2024-09-14T12:10:48.226881+0000","last_clean":"2024-09-14T12:10:48.226881+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:10:48.226881+0000","last_undegraded":"2024-09-14T12:10:48.226881+0000","last_fullsized":"2024-09-14T12:10:48.226881+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.226800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.226800+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.226800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:05.123660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.144680+0000","last_change":"2024-09-14T12:10:43.144680+0000","last_active":"2024-09-14T12:10:43.144680+0000","last_peered":"2024-09-14T12:10:43.144680+0000","last_clean":"2024-09-14T12:10:43.144680+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:10:43.144680+0000","last_undegraded":"2024-09-14T12:10:43.144680+0000","last_fullsized":"2024-09-14T12:10:43.144680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:43.144593+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:43.144593+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.144593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:15.696044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.517899+0000","last_change":"2024-09-14T12:10:44.517899+0000","last_active":"2024-09-14T12:10:44.517899+0000","last_peered":"2024-09-14T12:10:44.517899+0000","last_clean":"2024-09-14T12:10:44.517899+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:10:44.517899+0000","last_undegraded":"2024-09-14T12:10:44.517899+0000","last_fullsized":"2024-09-14T12:10:44.517899+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:44.517817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:44.517817+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.517817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.656397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.919786+0000","last_change":"2024-09-14T12:10:27.919786+0000","last_active":"2024-09-14T12:10:27.919786+0000","last_peered":"2024-09-14T12:10:27.919786+0000","last_clean":"2024-09-14T12:10:27.919786+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:10:27.919786+0000","last_undegraded":"2024-09-14T12:10:27.919786+0000","last_fullsized":"2024-09-14T12:10:27.919786+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-14T12:10:27.919699+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-14T12:10:27.919699+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.919699+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:15.231975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.715104+0000","last_change":"2024-09-14T12:10:31.715104+0000","last_active":"2024-09-14T12:10:31.715104+0000","last_peered":"2024-09-14T12:10:31.715104+0000","last_clean":"2024-09-14T12:10:31.715104+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:10:31.715104+0000","last_undegraded":"2024-09-14T12:10:31.715104+0000","last_fullsized":"2024-09-14T12:10:31.715104+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:31.715014+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:31.715014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.715014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.502111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.906639+0000","last_change":"2024-09-14T12:10:32.906639+0000","last_active":"2024-09-14T12:10:32.906639+0000","last_peered":"2024-09-14T12:10:32.906639+0000","last_clean":"2024-09-14T12:10:32.906639+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:10:32.906639+0000","last_undegraded":"2024-09-14T12:10:32.906639+0000","last_fullsized":"2024-09-14T12:10:32.906639+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:32.906554+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:32.906554+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.906554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:07.014171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.533797+0000","last_change":"2024-09-14T12:10:41.533797+0000","last_active":"2024-09-14T12:10:41.533797+0000","last_peered":"2024-09-14T12:10:41.533797+0000","last_clean":"2024-09-14T12:10:41.533797+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:10:41.533797+0000","last_undegraded":"2024-09-14T12:10:41.533797+0000","last_fullsized":"2024-09-14T12:10:41.533797+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:41.533688+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:41.533688+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.533688+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:06.473065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.585175+0000","last_change":"2024-09-14T12:10:38.585175+0000","last_active":"2024-09-14T12:10:38.585175+0000","last_peered":"2024-09-14T12:10:38.585175+0000","last_clean":"2024-09-14T12:10:38.585175+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:10:38.585175+0000","last_undegraded":"2024-09-14T12:10:38.585175+0000","last_fullsized":"2024-09-14T12:10:38.585175+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-14T12:10:38.585084+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-14T12:10:38.585084+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.585084+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:41.498626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:55.188077+0000","last_change":"2024-09-14T12:10:55.188077+0000","last_active":"2024-09-14T12:10:55.188077+0000","last_peered":"2024-09-14T12:10:55.188077+0000","last_clean":"2024-09-14T12:10:55.188077+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:10:55.188077+0000","last_undegraded":"2024-09-14T12:10:55.188077+0000","last_fullsized":"2024-09-14T12:10:55.188077+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:55.187986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:55.187986+0000","last_clean_scrub_stamp":"2024-09-14T12:10:55.187986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:25.283496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.671703+0000","last_change":"2024-09-14T12:10:44.671635+0000","last_active":"2024-09-14T12:10:44.671703+0000","last_peered":"2024-09-14T12:10:44.671703+0000","last_clean":"2024-09-14T12:10:44.671703+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:10:44.671703+0000","last_undegraded":"2024-09-14T12:10:44.671703+0000","last_fullsized":"2024-09-14T12:10:44.671703+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:44.671551+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:44.671551+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.671551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:31.136663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.522936+0000","last_change":"2024-09-14T12:10:42.522936+0000","last_active":"2024-09-14T12:10:42.522936+0000","last_peered":"2024-09-14T12:10:42.522936+0000","last_clean":"2024-09-14T12:10:42.522936+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:10:42.522936+0000","last_undegraded":"2024-09-14T12:10:42.522936+0000","last_fullsized":"2024-09-14T12:10:42.522936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:42.522845+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:42.522845+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.522845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:17.548786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.057643+0000","last_change":"2024-09-14T12:10:37.057643+0000","last_active":"2024-09-14T12:10:37.057643+0000","last_peered":"2024-09-14T12:10:37.057643+0000","last_clean":"2024-09-14T12:10:37.057643+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:10:37.057643+0000","last_undegraded":"2024-09-14T12:10:37.057643+0000","last_fullsized":"2024-09-14T12:10:37.057643+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-14T12:10:37.057550+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-14T12:10:37.057550+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.057550+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:07.525476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:53.146920+0000","last_change":"2024-09-14T12:10:53.146920+0000","last_active":"2024-09-14T12:10:53.146920+0000","last_peered":"2024-09-14T12:10:53.146920+0000","last_clean":"2024-09-14T12:10:53.146920+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:10:53.146920+0000","last_undegraded":"2024-09-14T12:10:53.146920+0000","last_fullsized":"2024-09-14T12:10:53.146920+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:53.146822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:53.146822+0000","last_clean_scrub_stamp":"2024-09-14T12:10:53.146822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.609634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.570057+0000","last_change":"2024-09-14T12:10:31.570057+0000","last_active":"2024-09-14T12:10:31.570057+0000","last_peered":"2024-09-14T12:10:31.570057+0000","last_clean":"2024-09-14T12:10:31.570057+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:10:31.570057+0000","last_undegraded":"2024-09-14T12:10:31.570057+0000","last_fullsized":"2024-09-14T12:10:31.570057+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T12:10:31.569964+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T12:10:31.569964+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.569964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:48.357791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'9","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.952201+0000","last_change":"2024-09-14T12:10:29.952201+0000","last_active":"2024-09-14T12:10:29.952201+0000","last_peered":"2024-09-14T12:10:29.952201+0000","last_clean":"2024-09-14T12:10:29.952201+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:10:29.952201+0000","last_undegraded":"2024-09-14T12:10:29.952201+0000","last_fullsized":"2024-09-14T12:10:29.952201+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T12:10:29.952118+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T12:10:29.952118+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.952118+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:40.168274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.435191+0000","last_change":"2024-09-14T12:10:24.435191+0000","last_active":"2024-09-14T12:10:24.435191+0000","last_peered":"2024-09-14T12:10:24.435191+0000","last_clean":"2024-09-14T12:10:24.435191+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:10:24.435191+0000","last_undegraded":"2024-09-14T12:10:24.435191+0000","last_fullsized":"2024-09-14T12:10:24.435191+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:24.435114+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:24.435114+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.435114+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:38.814026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:52.432103+0000","last_change":"2024-09-14T12:10:52.432103+0000","last_active":"2024-09-14T12:10:52.432103+0000","last_peered":"2024-09-14T12:10:52.432103+0000","last_clean":"2024-09-14T12:10:52.432103+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:10:52.432103+0000","last_undegraded":"2024-09-14T12:10:52.432103+0000","last_fullsized":"2024-09-14T12:10:52.432103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:52.432013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:52.432013+0000","last_clean_scrub_stamp":"2024-09-14T12:10:52.432013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:00.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.124363+0000","last_change":"2024-09-14T12:10:44.124363+0000","last_active":"2024-09-14T12:10:44.124363+0000","last_peered":"2024-09-14T12:10:44.124363+0000","last_clean":"2024-09-14T12:10:44.124363+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:10:44.124363+0000","last_undegraded":"2024-09-14T12:10:44.124363+0000","last_fullsized":"2024-09-14T12:10:44.124363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:44.124256+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:44.124256+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.124256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:18.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.588628+0000","last_change":"2024-09-14T12:10:32.588628+0000","last_active":"2024-09-14T12:10:32.588628+0000","last_peered":"2024-09-14T12:10:32.588628+0000","last_clean":"2024-09-14T12:10:32.588628+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:10:32.588628+0000","last_undegraded":"2024-09-14T12:10:32.588628+0000","last_fullsized":"2024-09-14T12:10:32.588628+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.588504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.588504+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.588504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.828863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.563742+0000","last_change":"2024-09-14T12:10:39.563742+0000","last_active":"2024-09-14T12:10:39.563742+0000","last_peered":"2024-09-14T12:10:39.563742+0000","last_clean":"2024-09-14T12:10:39.563742+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:10:39.563742+0000","last_undegraded":"2024-09-14T12:10:39.563742+0000","last_fullsized":"2024-09-14T12:10:39.563742+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-14T12:10:39.563657+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-14T12:10:39.563657+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.563657+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:32.966571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'367","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.459244+0000","last_change":"2024-09-14T12:10:14.459244+0000","last_active":"2024-09-14T12:10:14.459244+0000","last_peered":"2024-09-14T12:10:14.459244+0000","last_clean":"2024-09-14T12:10:14.459244+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:10:14.459244+0000","last_undegraded":"2024-09-14T12:10:14.459244+0000","last_fullsized":"2024-09-14T12:10:14.459244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.459145+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.624776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":757,"num_read_kb":12872,"num_write":1136,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.668527+0000","last_change":"2024-09-14T12:10:19.668440+0000","last_active":"2024-09-14T12:10:19.668527+0000","last_peered":"2024-09-14T12:10:19.668527+0000","last_clean":"2024-09-14T12:10:19.668527+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:10:19.668527+0000","last_undegraded":"2024-09-14T12:10:19.668527+0000","last_fullsized":"2024-09-14T12:10:19.668527+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.668328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.312199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'341","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.826945+0000","last_change":"2024-09-14T12:10:05.826945+0000","last_active":"2024-09-14T12:10:05.826945+0000","last_peered":"2024-09-14T12:10:05.826945+0000","last_clean":"2024-09-14T12:10:05.826945+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:10:05.826945+0000","last_undegraded":"2024-09-14T12:10:05.826945+0000","last_fullsized":"2024-09-14T12:10:05.826945+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.826834+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:29.237796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":30246,"num_write":1175,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.530701+0000","last_change":"2024-09-14T12:10:18.530643+0000","last_active":"2024-09-14T12:10:18.530701+0000","last_peered":"2024-09-14T12:10:18.530701+0000","last_clean":"2024-09-14T12:10:18.530701+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:10:18.530701+0000","last_undegraded":"2024-09-14T12:10:18.530701+0000","last_fullsized":"2024-09-14T12:10:18.530701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.530556+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:40.837032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'341","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.095197+0000","last_change":"2024-09-14T12:10:05.095197+0000","last_active":"2024-09-14T12:10:05.095197+0000","last_peered":"2024-09-14T12:10:05.095197+0000","last_clean":"2024-09-14T12:10:05.095197+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:10:05.095197+0000","last_undegraded":"2024-09-14T12:10:05.095197+0000","last_fullsized":"2024-09-14T12:10:05.095197+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.095059+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.483265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":3312,"num_write":1178,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.971082+0000","last_change":"2024-09-14T12:10:16.971020+0000","last_active":"2024-09-14T12:10:16.971082+0000","last_peered":"2024-09-14T12:10:16.971082+0000","last_clean":"2024-09-14T12:10:16.971082+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:10:16.971082+0000","last_undegraded":"2024-09-14T12:10:16.971082+0000","last_fullsized":"2024-09-14T12:10:16.971082+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.970940+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.622124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'370","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.705623+0000","last_change":"2024-09-14T12:10:13.705623+0000","last_active":"2024-09-14T12:10:13.705623+0000","last_peered":"2024-09-14T12:10:13.705623+0000","last_clean":"2024-09-14T12:10:13.705623+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:10:13.705623+0000","last_undegraded":"2024-09-14T12:10:13.705623+0000","last_fullsized":"2024-09-14T12:10:13.705623+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.705505+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:38.303648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5058,"num_write":1126,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.214862+0000","last_change":"2024-09-14T12:10:14.214780+0000","last_active":"2024-09-14T12:10:14.214862+0000","last_peered":"2024-09-14T12:10:14.214862+0000","last_clean":"2024-09-14T12:10:14.214862+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:10:14.214862+0000","last_undegraded":"2024-09-14T12:10:14.214862+0000","last_fullsized":"2024-09-14T12:10:14.214862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.214689+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:13.644836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'332","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.452497+0000","last_change":"2024-09-14T12:10:13.452437+0000","last_active":"2024-09-14T12:10:13.452497+0000","last_peered":"2024-09-14T12:10:13.452497+0000","last_clean":"2024-09-14T12:10:13.452497+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:10:13.452497+0000","last_undegraded":"2024-09-14T12:10:13.452497+0000","last_fullsized":"2024-09-14T12:10:13.452497+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.452316+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:51.046156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":17822,"num_write":1000,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'253","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.296368+0000","last_change":"2024-09-14T12:10:12.296368+0000","last_active":"2024-09-14T12:10:12.296368+0000","last_peered":"2024-09-14T12:10:12.296368+0000","last_clean":"2024-09-14T12:10:12.296368+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:10:12.296368+0000","last_undegraded":"2024-09-14T12:10:12.296368+0000","last_fullsized":"2024-09-14T12:10:12.296368+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.296241+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:52.581921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.675440+0000","last_change":"2024-09-14T12:10:12.675366+0000","last_active":"2024-09-14T12:10:12.675440+0000","last_peered":"2024-09-14T12:10:12.675440+0000","last_clean":"2024-09-14T12:10:12.675440+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:10:12.675440+0000","last_undegraded":"2024-09-14T12:10:12.675440+0000","last_fullsized":"2024-09-14T12:10:12.675440+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.675269+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:51.405065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.981965+0000","last_change":"2024-09-14T12:10:18.981965+0000","last_active":"2024-09-14T12:10:18.981965+0000","last_peered":"2024-09-14T12:10:18.981965+0000","last_clean":"2024-09-14T12:10:18.981965+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:10:18.981965+0000","last_undegraded":"2024-09-14T12:10:18.981965+0000","last_fullsized":"2024-09-14T12:10:18.981965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.981860+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:07.103412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'350","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.486884+0000","last_change":"2024-09-14T12:10:12.486823+0000","last_active":"2024-09-14T12:10:12.486884+0000","last_peered":"2024-09-14T12:10:12.486884+0000","last_clean":"2024-09-14T12:10:12.486884+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:10:12.486884+0000","last_undegraded":"2024-09-14T12:10:12.486884+0000","last_fullsized":"2024-09-14T12:10:12.486884+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.486683+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:55.966016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":627,"num_read_kb":84521,"num_write":1155,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.679975+0000","last_change":"2024-09-14T12:10:20.679975+0000","last_active":"2024-09-14T12:10:20.679975+0000","last_peered":"2024-09-14T12:10:20.679975+0000","last_clean":"2024-09-14T12:10:20.679975+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:10:20.679975+0000","last_undegraded":"2024-09-14T12:10:20.679975+0000","last_fullsized":"2024-09-14T12:10:20.679975+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:20.679881+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:20.679881+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.679881+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:50.257170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.085667+0000","last_change":"2024-09-14T12:10:07.085587+0000","last_active":"2024-09-14T12:10:07.085667+0000","last_peered":"2024-09-14T12:10:07.085667+0000","last_clean":"2024-09-14T12:10:07.085667+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:10:07.085667+0000","last_undegraded":"2024-09-14T12:10:07.085667+0000","last_fullsized":"2024-09-14T12:10:07.085667+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.085466+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.348034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.664539+0000","last_change":"2024-09-14T12:10:12.664539+0000","last_active":"2024-09-14T12:10:12.664539+0000","last_peered":"2024-09-14T12:10:12.664539+0000","last_clean":"2024-09-14T12:10:12.664539+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:10:12.664539+0000","last_undegraded":"2024-09-14T12:10:12.664539+0000","last_fullsized":"2024-09-14T12:10:12.664539+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'180","last_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_deep_scrub":"265'180","last_deep_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.664453+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:36.687451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.967028+0000","last_change":"2024-09-14T12:10:15.967028+0000","last_active":"2024-09-14T12:10:15.967028+0000","last_peered":"2024-09-14T12:10:15.967028+0000","last_clean":"2024-09-14T12:10:15.967028+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:10:15.967028+0000","last_undegraded":"2024-09-14T12:10:15.967028+0000","last_fullsized":"2024-09-14T12:10:15.967028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.966942+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:08.208593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.306614+0000","last_change":"2024-09-14T12:10:07.306614+0000","last_active":"2024-09-14T12:10:07.306614+0000","last_peered":"2024-09-14T12:10:07.306614+0000","last_clean":"2024-09-14T12:10:07.306614+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:10:07.306614+0000","last_undegraded":"2024-09-14T12:10:07.306614+0000","last_fullsized":"2024-09-14T12:10:07.306614+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.306483+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:41.620701+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159838,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":4801,"num_write":1283,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1378,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.461288+0000","last_change":"2024-09-14T12:10:16.461288+0000","last_active":"2024-09-14T12:10:16.461288+0000","last_peered":"2024-09-14T12:10:16.461288+0000","last_clean":"2024-09-14T12:10:16.461288+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:10:16.461288+0000","last_undegraded":"2024-09-14T12:10:16.461288+0000","last_fullsized":"2024-09-14T12:10:16.461288+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'788","last_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_deep_scrub":"265'788","last_deep_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.461206+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.733748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'314","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.261791+0000","last_change":"2024-09-14T12:10:09.261791+0000","last_active":"2024-09-14T12:10:09.261791+0000","last_peered":"2024-09-14T12:10:09.261791+0000","last_clean":"2024-09-14T12:10:09.261791+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:10:09.261791+0000","last_undegraded":"2024-09-14T12:10:09.261791+0000","last_fullsized":"2024-09-14T12:10:09.261791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.261563+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:34.016334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":568,"num_read_kb":2774,"num_write":998,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.641090+0000","last_change":"2024-09-14T12:10:17.641090+0000","last_active":"2024-09-14T12:10:17.641090+0000","last_peered":"2024-09-14T12:10:17.641090+0000","last_clean":"2024-09-14T12:10:17.641090+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:10:17.641090+0000","last_undegraded":"2024-09-14T12:10:17.641090+0000","last_fullsized":"2024-09-14T12:10:17.641090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.640942+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.697431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'334","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.289358+0000","last_change":"2024-09-14T12:10:05.289358+0000","last_active":"2024-09-14T12:10:05.289358+0000","last_peered":"2024-09-14T12:10:05.289358+0000","last_clean":"2024-09-14T12:10:05.289358+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:10:05.289358+0000","last_undegraded":"2024-09-14T12:10:05.289358+0000","last_fullsized":"2024-09-14T12:10:05.289358+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.289211+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.228353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":52006,"num_write":1108,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.639093+0000","last_change":"2024-09-14T12:10:09.639093+0000","last_active":"2024-09-14T12:10:09.639093+0000","last_peered":"2024-09-14T12:10:09.639093+0000","last_clean":"2024-09-14T12:10:09.639093+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:10:09.639093+0000","last_undegraded":"2024-09-14T12:10:09.639093+0000","last_fullsized":"2024-09-14T12:10:09.639093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.638966+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:04.748932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'371","reported_seq":1127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.865158+0000","last_change":"2024-09-14T12:10:03.865158+0000","last_active":"2024-09-14T12:10:03.865158+0000","last_peered":"2024-09-14T12:10:03.865158+0000","last_clean":"2024-09-14T12:10:03.865158+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:10:03.865158+0000","last_undegraded":"2024-09-14T12:10:03.865158+0000","last_fullsized":"2024-09-14T12:10:03.865158+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.865003+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:04.754565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1062,"num_read_kb":40711,"num_write":1149,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.649985+0000","last_change":"2024-09-14T12:10:14.649985+0000","last_active":"2024-09-14T12:10:14.649985+0000","last_peered":"2024-09-14T12:10:14.649985+0000","last_clean":"2024-09-14T12:10:14.649985+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:10:14.649985+0000","last_undegraded":"2024-09-14T12:10:14.649985+0000","last_fullsized":"2024-09-14T12:10:14.649985+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.649893+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:52.251100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'337","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.094911+0000","last_change":"2024-09-14T12:10:12.094911+0000","last_active":"2024-09-14T12:10:12.094911+0000","last_peered":"2024-09-14T12:10:12.094911+0000","last_clean":"2024-09-14T12:10:12.094911+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:10:12.094911+0000","last_undegraded":"2024-09-14T12:10:12.094911+0000","last_fullsized":"2024-09-14T12:10:12.094911+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.094760+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.754532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254516,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":58308,"num_write":1138,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.953578+0000","last_change":"2024-09-14T12:10:17.953578+0000","last_active":"2024-09-14T12:10:17.953578+0000","last_peered":"2024-09-14T12:10:17.953578+0000","last_clean":"2024-09-14T12:10:17.953578+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:10:17.953578+0000","last_undegraded":"2024-09-14T12:10:17.953578+0000","last_fullsized":"2024-09-14T12:10:17.953578+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.953497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:54.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'412","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.030763+0000","last_change":"2024-09-14T12:10:02.030763+0000","last_active":"2024-09-14T12:10:02.030763+0000","last_peered":"2024-09-14T12:10:02.030763+0000","last_clean":"2024-09-14T12:10:02.030763+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:10:02.030763+0000","last_undegraded":"2024-09-14T12:10:02.030763+0000","last_fullsized":"2024-09-14T12:10:02.030763+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'412","last_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_deep_scrub":"265'412","last_deep_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.030666+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:19.284654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":94295,"num_write":1155,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'191","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.991978+0000","last_change":"2024-09-14T12:10:33.991978+0000","last_active":"2024-09-14T12:10:33.991978+0000","last_peered":"2024-09-14T12:10:33.991978+0000","last_clean":"2024-09-14T12:10:33.991978+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:10:33.991978+0000","last_undegraded":"2024-09-14T12:10:33.991978+0000","last_fullsized":"2024-09-14T12:10:33.991978+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-14T12:10:33.991879+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-14T12:10:33.991879+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.991879+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:38.776578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'123","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.666541+0000","last_change":"2024-09-14T12:10:10.666541+0000","last_active":"2024-09-14T12:10:10.666541+0000","last_peered":"2024-09-14T12:10:10.666541+0000","last_clean":"2024-09-14T12:10:10.666541+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:10:10.666541+0000","last_undegraded":"2024-09-14T12:10:10.666541+0000","last_fullsized":"2024-09-14T12:10:10.666541+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.666460+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:53.474495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'488","reported_seq":1230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.285231+0000","last_change":"2024-09-14T12:10:06.285231+0000","last_active":"2024-09-14T12:10:06.285231+0000","last_peered":"2024-09-14T12:10:06.285231+0000","last_clean":"2024-09-14T12:10:06.285231+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:10:06.285231+0000","last_undegraded":"2024-09-14T12:10:06.285231+0000","last_fullsized":"2024-09-14T12:10:06.285231+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.285136+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:30.855826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":951,"num_read_kb":68364,"num_write":1403,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.602188+0000","last_change":"2024-09-14T12:10:23.602188+0000","last_active":"2024-09-14T12:10:23.602188+0000","last_peered":"2024-09-14T12:10:23.602188+0000","last_clean":"2024-09-14T12:10:23.602188+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:10:23.602188+0000","last_undegraded":"2024-09-14T12:10:23.602188+0000","last_fullsized":"2024-09-14T12:10:23.602188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.602105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.602105+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.602105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:03.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'324","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.258264+0000","last_change":"2024-09-14T12:10:22.258264+0000","last_active":"2024-09-14T12:10:22.258264+0000","last_peered":"2024-09-14T12:10:22.258264+0000","last_clean":"2024-09-14T12:10:22.258264+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:10:22.258264+0000","last_undegraded":"2024-09-14T12:10:22.258264+0000","last_fullsized":"2024-09-14T12:10:22.258264+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-14T12:10:22.258164+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-14T12:10:22.258164+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.258164+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:20.928434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1030,"num_write":396,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.464251+0000","last_change":"2024-09-14T12:10:32.464251+0000","last_active":"2024-09-14T12:10:32.464251+0000","last_peered":"2024-09-14T12:10:32.464251+0000","last_clean":"2024-09-14T12:10:32.464251+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:10:32.464251+0000","last_undegraded":"2024-09-14T12:10:32.464251+0000","last_fullsized":"2024-09-14T12:10:32.464251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.464135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.464135+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.464135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.501971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'132","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.562184+0000","last_change":"2024-09-14T12:10:36.562184+0000","last_active":"2024-09-14T12:10:36.562184+0000","last_peered":"2024-09-14T12:10:36.562184+0000","last_clean":"2024-09-14T12:10:36.562184+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:10:36.562184+0000","last_undegraded":"2024-09-14T12:10:36.562184+0000","last_fullsized":"2024-09-14T12:10:36.562184+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-14T12:10:36.562090+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-14T12:10:36.562090+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.562090+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.296268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.667533+0000","last_change":"2024-09-14T12:10:14.667533+0000","last_active":"2024-09-14T12:10:14.667533+0000","last_peered":"2024-09-14T12:10:14.667533+0000","last_clean":"2024-09-14T12:10:14.667533+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:10:14.667533+0000","last_undegraded":"2024-09-14T12:10:14.667533+0000","last_fullsized":"2024-09-14T12:10:14.667533+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.667432+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:35.887947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'285","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.047316+0000","last_change":"2024-09-14T12:09:59.047316+0000","last_active":"2024-09-14T12:09:59.047316+0000","last_peered":"2024-09-14T12:09:59.047316+0000","last_clean":"2024-09-14T12:09:59.047316+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:09:59.047316+0000","last_undegraded":"2024-09-14T12:09:59.047316+0000","last_fullsized":"2024-09-14T12:09:59.047316+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'285","last_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_deep_scrub":"265'285","last_deep_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.047215+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:06.088837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":825,"num_read_kb":44655,"num_write":1001,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.224044+0000","last_change":"2024-09-14T12:10:20.224044+0000","last_active":"2024-09-14T12:10:20.224044+0000","last_peered":"2024-09-14T12:10:20.224044+0000","last_clean":"2024-09-14T12:10:20.224044+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:10:20.224044+0000","last_undegraded":"2024-09-14T12:10:20.224044+0000","last_fullsized":"2024-09-14T12:10:20.224044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.223950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.223950+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.223950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:08.471542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.093239+0000","last_change":"2024-09-14T12:10:26.093239+0000","last_active":"2024-09-14T12:10:26.093239+0000","last_peered":"2024-09-14T12:10:26.093239+0000","last_clean":"2024-09-14T12:10:26.093239+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:10:26.093239+0000","last_undegraded":"2024-09-14T12:10:26.093239+0000","last_fullsized":"2024-09-14T12:10:26.093239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-14T12:10:26.093140+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-14T12:10:26.093140+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.093140+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.909515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.088634+0000","last_change":"2024-09-14T12:10:28.088634+0000","last_active":"2024-09-14T12:10:28.088634+0000","last_peered":"2024-09-14T12:10:28.088634+0000","last_clean":"2024-09-14T12:10:28.088634+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:10:28.088634+0000","last_undegraded":"2024-09-14T12:10:28.088634+0000","last_fullsized":"2024-09-14T12:10:28.088634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.088515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.088515+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.088515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:55.904182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'151","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.204685+0000","last_change":"2024-09-14T12:10:32.204685+0000","last_active":"2024-09-14T12:10:32.204685+0000","last_peered":"2024-09-14T12:10:32.204685+0000","last_clean":"2024-09-14T12:10:32.204685+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:10:32.204685+0000","last_undegraded":"2024-09-14T12:10:32.204685+0000","last_fullsized":"2024-09-14T12:10:32.204685+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-14T12:10:32.204581+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-14T12:10:32.204581+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.204581+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:14.251567+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.148946+0000","last_change":"2024-09-14T12:10:10.148946+0000","last_active":"2024-09-14T12:10:10.148946+0000","last_peered":"2024-09-14T12:10:10.148946+0000","last_clean":"2024-09-14T12:10:10.148946+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:10:10.148946+0000","last_undegraded":"2024-09-14T12:10:10.148946+0000","last_fullsized":"2024-09-14T12:10:10.148946+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'243","last_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_deep_scrub":"265'243","last_deep_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.148844+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:48.584464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'405","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.397851+0000","last_change":"2024-09-14T12:10:10.397851+0000","last_active":"2024-09-14T12:10:10.397851+0000","last_peered":"2024-09-14T12:10:10.397851+0000","last_clean":"2024-09-14T12:10:10.397851+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:10:10.397851+0000","last_undegraded":"2024-09-14T12:10:10.397851+0000","last_fullsized":"2024-09-14T12:10:10.397851+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.397701+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:07.184919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":632,"num_read_kb":37555,"num_write":1183,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.224896+0000","last_change":"2024-09-14T12:10:21.224896+0000","last_active":"2024-09-14T12:10:21.224896+0000","last_peered":"2024-09-14T12:10:21.224896+0000","last_clean":"2024-09-14T12:10:21.224896+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:10:21.224896+0000","last_undegraded":"2024-09-14T12:10:21.224896+0000","last_fullsized":"2024-09-14T12:10:21.224896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.224794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.224794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.224794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:51.879744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'122","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.734696+0000","last_change":"2024-09-14T12:10:19.734696+0000","last_active":"2024-09-14T12:10:19.734696+0000","last_peered":"2024-09-14T12:10:19.734696+0000","last_clean":"2024-09-14T12:10:19.734696+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:10:19.734696+0000","last_undegraded":"2024-09-14T12:10:19.734696+0000","last_fullsized":"2024-09-14T12:10:19.734696+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-14T12:10:19.734578+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-14T12:10:19.734578+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.734578+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:55.917431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'771","reported_seq":2422,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.472135+0000","last_change":"2024-09-14T12:10:31.472135+0000","last_active":"2024-09-14T12:10:31.472135+0000","last_peered":"2024-09-14T12:10:31.472135+0000","last_clean":"2024-09-14T12:10:31.472135+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:10:31.472135+0000","last_undegraded":"2024-09-14T12:10:31.472135+0000","last_fullsized":"2024-09-14T12:10:31.472135+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-14T12:10:31.472023+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-14T12:10:31.472023+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.472023+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:18.719751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'219","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.993612+0000","last_change":"2024-09-14T12:10:34.993612+0000","last_active":"2024-09-14T12:10:34.993612+0000","last_peered":"2024-09-14T12:10:34.993612+0000","last_clean":"2024-09-14T12:10:34.993612+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:10:34.993612+0000","last_undegraded":"2024-09-14T12:10:34.993612+0000","last_fullsized":"2024-09-14T12:10:34.993612+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'219","last_scrub_stamp":"2024-09-14T12:10:34.993525+0000","last_deep_scrub":"265'219","last_deep_scrub_stamp":"2024-09-14T12:10:34.993525+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.993525+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:16.682973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.087612+0000","last_change":"2024-09-14T12:10:10.087612+0000","last_active":"2024-09-14T12:10:10.087612+0000","last_peered":"2024-09-14T12:10:10.087612+0000","last_clean":"2024-09-14T12:10:10.087612+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:10:10.087612+0000","last_undegraded":"2024-09-14T12:10:10.087612+0000","last_fullsized":"2024-09-14T12:10:10.087612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'263","last_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_deep_scrub":"265'263","last_deep_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.087521+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:48.169805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'422","reported_seq":1130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.319589+0000","last_change":"2024-09-14T12:10:02.319589+0000","last_active":"2024-09-14T12:10:02.319589+0000","last_peered":"2024-09-14T12:10:02.319589+0000","last_clean":"2024-09-14T12:10:02.319589+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:10:02.319589+0000","last_undegraded":"2024-09-14T12:10:02.319589+0000","last_fullsized":"2024-09-14T12:10:02.319589+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.319485+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:23.716370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1004,"num_read_kb":6071,"num_write":1268,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.599185+0000","last_change":"2024-09-14T12:10:24.599185+0000","last_active":"2024-09-14T12:10:24.599185+0000","last_peered":"2024-09-14T12:10:24.599185+0000","last_clean":"2024-09-14T12:10:24.599185+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:10:24.599185+0000","last_undegraded":"2024-09-14T12:10:24.599185+0000","last_fullsized":"2024-09-14T12:10:24.599185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:24.599092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:24.599092+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.599092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:25.066364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'292","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.474782+0000","last_change":"2024-09-14T12:10:27.474782+0000","last_active":"2024-09-14T12:10:27.474782+0000","last_peered":"2024-09-14T12:10:27.474782+0000","last_clean":"2024-09-14T12:10:27.474782+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:10:27.474782+0000","last_undegraded":"2024-09-14T12:10:27.474782+0000","last_fullsized":"2024-09-14T12:10:27.474782+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'292","last_scrub_stamp":"2024-09-14T12:10:27.474683+0000","last_deep_scrub":"265'292","last_deep_scrub_stamp":"2024-09-14T12:10:27.474683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.474683+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:12.392164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'793","reported_seq":2497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.127033+0000","last_change":"2024-09-14T12:10:33.127033+0000","last_active":"2024-09-14T12:10:33.127033+0000","last_peered":"2024-09-14T12:10:33.127033+0000","last_clean":"2024-09-14T12:10:33.127033+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:10:33.127033+0000","last_undegraded":"2024-09-14T12:10:33.127033+0000","last_fullsized":"2024-09-14T12:10:33.127033+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-14T12:10:33.126938+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-14T12:10:33.126938+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.126938+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:43.707386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666351+0000","last_change":"2024-09-14T12:10:15.666351+0000","last_active":"2024-09-14T12:10:15.666351+0000","last_peered":"2024-09-14T12:10:15.666351+0000","last_clean":"2024-09-14T12:10:15.666351+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:10:15.666351+0000","last_undegraded":"2024-09-14T12:10:15.666351+0000","last_fullsized":"2024-09-14T12:10:15.666351+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.666266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:56.819864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'373","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.247413+0000","last_change":"2024-09-14T12:10:03.247413+0000","last_active":"2024-09-14T12:10:03.247413+0000","last_peered":"2024-09-14T12:10:03.247413+0000","last_clean":"2024-09-14T12:10:03.247413+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:10:03.247413+0000","last_undegraded":"2024-09-14T12:10:03.247413+0000","last_fullsized":"2024-09-14T12:10:03.247413+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.247260+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:03.568283+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343358,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":30361,"num_write":1111,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.563706+0000","last_change":"2024-09-14T12:10:19.563706+0000","last_active":"2024-09-14T12:10:19.563706+0000","last_peered":"2024-09-14T12:10:19.563706+0000","last_clean":"2024-09-14T12:10:19.563706+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:10:19.563706+0000","last_undegraded":"2024-09-14T12:10:19.563706+0000","last_fullsized":"2024-09-14T12:10:19.563706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.563568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:52.176982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'389","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.697605+0000","last_change":"2024-09-14T12:10:28.697605+0000","last_active":"2024-09-14T12:10:28.697605+0000","last_peered":"2024-09-14T12:10:28.697605+0000","last_clean":"2024-09-14T12:10:28.697605+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:10:28.697605+0000","last_undegraded":"2024-09-14T12:10:28.697605+0000","last_fullsized":"2024-09-14T12:10:28.697605+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-14T12:10:28.697498+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-14T12:10:28.697498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.697498+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:12.455664+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.832140+0000","last_change":"2024-09-14T12:10:20.832140+0000","last_active":"2024-09-14T12:10:20.832140+0000","last_peered":"2024-09-14T12:10:20.832140+0000","last_clean":"2024-09-14T12:10:20.832140+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:10:20.832140+0000","last_undegraded":"2024-09-14T12:10:20.832140+0000","last_fullsized":"2024-09-14T12:10:20.832140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.832059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.832059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.832059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:57.670837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'540","reported_seq":1365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.582821+0000","last_change":"2024-09-14T12:10:32.582821+0000","last_active":"2024-09-14T12:10:32.582821+0000","last_peered":"2024-09-14T12:10:32.582821+0000","last_clean":"2024-09-14T12:10:32.582821+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:10:32.582821+0000","last_undegraded":"2024-09-14T12:10:32.582821+0000","last_fullsized":"2024-09-14T12:10:32.582821+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-14T12:10:32.582710+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-14T12:10:32.582710+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.582710+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.319374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.875048+0000","last_change":"2024-09-14T12:10:04.875048+0000","last_active":"2024-09-14T12:10:04.875048+0000","last_peered":"2024-09-14T12:10:04.875048+0000","last_clean":"2024-09-14T12:10:04.875048+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:10:04.875048+0000","last_undegraded":"2024-09-14T12:10:04.875048+0000","last_fullsized":"2024-09-14T12:10:04.875048+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.874958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:10.686558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'384","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.371688+0000","last_change":"2024-09-14T12:10:09.371688+0000","last_active":"2024-09-14T12:10:09.371688+0000","last_peered":"2024-09-14T12:10:09.371688+0000","last_clean":"2024-09-14T12:10:09.371688+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:10:09.371688+0000","last_undegraded":"2024-09-14T12:10:09.371688+0000","last_fullsized":"2024-09-14T12:10:09.371688+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.371601+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:05.670350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":916,"num_read_kb":57128,"num_write":1152,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.716284+0000","last_change":"2024-09-14T12:10:20.716284+0000","last_active":"2024-09-14T12:10:20.716284+0000","last_peered":"2024-09-14T12:10:20.716284+0000","last_clean":"2024-09-14T12:10:20.716284+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:10:20.716284+0000","last_undegraded":"2024-09-14T12:10:20.716284+0000","last_fullsized":"2024-09-14T12:10:20.716284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.716198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.716198+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.716198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:51.902300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'274","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.253520+0000","last_change":"2024-09-14T12:10:23.253520+0000","last_active":"2024-09-14T12:10:23.253520+0000","last_peered":"2024-09-14T12:10:23.253520+0000","last_clean":"2024-09-14T12:10:23.253520+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:10:23.253520+0000","last_undegraded":"2024-09-14T12:10:23.253520+0000","last_fullsized":"2024-09-14T12:10:23.253520+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:23.253433+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:23.253433+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.253433+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.585150+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.164088+0000","last_change":"2024-09-14T12:10:31.164088+0000","last_active":"2024-09-14T12:10:31.164088+0000","last_peered":"2024-09-14T12:10:31.164088+0000","last_clean":"2024-09-14T12:10:31.164088+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:10:31.164088+0000","last_undegraded":"2024-09-14T12:10:31.164088+0000","last_fullsized":"2024-09-14T12:10:31.164088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:31.163976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:31.163976+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.163976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:48.664750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2498","reported_seq":4327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.435653+0000","last_change":"2024-09-14T12:10:23.435653+0000","last_active":"2024-09-14T12:10:23.435653+0000","last_peered":"2024-09-14T12:10:23.435653+0000","last_clean":"2024-09-14T12:10:23.435653+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:10:23.435653+0000","last_undegraded":"2024-09-14T12:10:23.435653+0000","last_fullsized":"2024-09-14T12:10:23.435653+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2498","last_scrub_stamp":"2024-09-14T12:10:23.435533+0000","last_deep_scrub":"265'2498","last_deep_scrub_stamp":"2024-09-14T12:10:23.435533+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.435533+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":2400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:39.924000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4178","reported_seq":4828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.262356+0000","last_change":"2024-09-14T12:10:08.262356+0000","last_active":"2024-09-14T12:10:08.262356+0000","last_peered":"2024-09-14T12:10:08.262356+0000","last_clean":"2024-09-14T12:10:08.262356+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:10:08.262356+0000","last_undegraded":"2024-09-14T12:10:08.262356+0000","last_fullsized":"2024-09-14T12:10:08.262356+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4178","last_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_deep_scrub":"265'4178","last_deep_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.262241+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:42.755259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'356","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.272037+0000","last_change":"2024-09-14T12:10:05.272037+0000","last_active":"2024-09-14T12:10:05.272037+0000","last_peered":"2024-09-14T12:10:05.272037+0000","last_clean":"2024-09-14T12:10:05.272037+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:10:05.272037+0000","last_undegraded":"2024-09-14T12:10:05.272037+0000","last_fullsized":"2024-09-14T12:10:05.272037+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.271893+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.064154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":21988,"num_write":1237,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666026+0000","last_change":"2024-09-14T12:10:15.666026+0000","last_active":"2024-09-14T12:10:15.666026+0000","last_peered":"2024-09-14T12:10:15.666026+0000","last_clean":"2024-09-14T12:10:15.666026+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:10:15.666026+0000","last_undegraded":"2024-09-14T12:10:15.666026+0000","last_fullsized":"2024-09-14T12:10:15.666026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.665936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:15.551151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'317","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.497008+0000","last_change":"2024-09-14T12:10:25.497008+0000","last_active":"2024-09-14T12:10:25.497008+0000","last_peered":"2024-09-14T12:10:25.497008+0000","last_clean":"2024-09-14T12:10:25.497008+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:10:25.497008+0000","last_undegraded":"2024-09-14T12:10:25.497008+0000","last_fullsized":"2024-09-14T12:10:25.497008+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-14T12:10:25.496914+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-14T12:10:25.496914+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.496914+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:09.096079+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'781","reported_seq":2803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.130857+0000","last_change":"2024-09-14T12:10:25.130857+0000","last_active":"2024-09-14T12:10:25.130857+0000","last_peered":"2024-09-14T12:10:25.130857+0000","last_clean":"2024-09-14T12:10:25.130857+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:10:25.130857+0000","last_undegraded":"2024-09-14T12:10:25.130857+0000","last_fullsized":"2024-09-14T12:10:25.130857+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'781","last_scrub_stamp":"2024-09-14T12:10:25.130754+0000","last_deep_scrub":"265'781","last_deep_scrub_stamp":"2024-09-14T12:10:25.130754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.130754+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.723670+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'155","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.155833+0000","last_change":"2024-09-14T12:10:29.155833+0000","last_active":"2024-09-14T12:10:29.155833+0000","last_peered":"2024-09-14T12:10:29.155833+0000","last_clean":"2024-09-14T12:10:29.155833+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:10:29.155833+0000","last_undegraded":"2024-09-14T12:10:29.155833+0000","last_fullsized":"2024-09-14T12:10:29.155833+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-14T12:10:29.155743+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-14T12:10:29.155743+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.155743+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:29.322939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":711,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.120635+0000","last_change":"2024-09-14T12:10:09.120635+0000","last_active":"2024-09-14T12:10:09.120635+0000","last_peered":"2024-09-14T12:10:09.120635+0000","last_clean":"2024-09-14T12:10:09.120635+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:10:09.120635+0000","last_undegraded":"2024-09-14T12:10:09.120635+0000","last_fullsized":"2024-09-14T12:10:09.120635+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.120547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:00.785994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'364","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.791535+0000","last_change":"2024-09-14T12:10:04.791535+0000","last_active":"2024-09-14T12:10:04.791535+0000","last_peered":"2024-09-14T12:10:04.791535+0000","last_clean":"2024-09-14T12:10:04.791535+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:10:04.791535+0000","last_undegraded":"2024-09-14T12:10:04.791535+0000","last_fullsized":"2024-09-14T12:10:04.791535+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.791431+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:20.658739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":27518,"num_write":1082,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.698872+0000","last_change":"2024-09-14T12:10:18.698872+0000","last_active":"2024-09-14T12:10:18.698872+0000","last_peered":"2024-09-14T12:10:18.698872+0000","last_clean":"2024-09-14T12:10:18.698872+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:10:18.698872+0000","last_undegraded":"2024-09-14T12:10:18.698872+0000","last_fullsized":"2024-09-14T12:10:18.698872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.698762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:25.328497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'483","reported_seq":1128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.266110+0000","last_change":"2024-09-14T12:10:20.266110+0000","last_active":"2024-09-14T12:10:20.266110+0000","last_peered":"2024-09-14T12:10:20.266110+0000","last_clean":"2024-09-14T12:10:20.266110+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:10:20.266110+0000","last_undegraded":"2024-09-14T12:10:20.266110+0000","last_fullsized":"2024-09-14T12:10:20.266110+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.265983+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:56.414346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100274,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":841,"num_read_kb":1995,"num_write":694,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.712406+0000","last_change":"2024-09-14T12:10:21.712406+0000","last_active":"2024-09-14T12:10:21.712406+0000","last_peered":"2024-09-14T12:10:21.712406+0000","last_clean":"2024-09-14T12:10:21.712406+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:10:21.712406+0000","last_undegraded":"2024-09-14T12:10:21.712406+0000","last_fullsized":"2024-09-14T12:10:21.712406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.712312+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.712312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:54.774758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'176","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.884994+0000","last_change":"2024-09-14T12:10:24.884994+0000","last_active":"2024-09-14T12:10:24.884994+0000","last_peered":"2024-09-14T12:10:24.884994+0000","last_clean":"2024-09-14T12:10:24.884994+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:10:24.884994+0000","last_undegraded":"2024-09-14T12:10:24.884994+0000","last_fullsized":"2024-09-14T12:10:24.884994+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:24.884849+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:24.884849+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.884849+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:18.793560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.864662+0000","last_change":"2024-09-14T12:10:05.864662+0000","last_active":"2024-09-14T12:10:05.864662+0000","last_peered":"2024-09-14T12:10:05.864662+0000","last_clean":"2024-09-14T12:10:05.864662+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:10:05.864662+0000","last_undegraded":"2024-09-14T12:10:05.864662+0000","last_fullsized":"2024-09-14T12:10:05.864662+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.864516+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'302","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.548905+0000","last_change":"2024-09-14T12:10:00.548905+0000","last_active":"2024-09-14T12:10:00.548905+0000","last_peered":"2024-09-14T12:10:00.548905+0000","last_clean":"2024-09-14T12:10:00.548905+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:10:00.548905+0000","last_undegraded":"2024-09-14T12:10:00.548905+0000","last_fullsized":"2024-09-14T12:10:00.548905+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.548789+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:47.038045+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":20886,"num_write":921,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.709439+0000","last_change":"2024-09-14T12:10:16.709439+0000","last_active":"2024-09-14T12:10:16.709439+0000","last_peered":"2024-09-14T12:10:16.709439+0000","last_clean":"2024-09-14T12:10:16.709439+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:10:16.709439+0000","last_undegraded":"2024-09-14T12:10:16.709439+0000","last_fullsized":"2024-09-14T12:10:16.709439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.709344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:41.114596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'287","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.116437+0000","last_change":"2024-09-14T12:10:24.116437+0000","last_active":"2024-09-14T12:10:24.116437+0000","last_peered":"2024-09-14T12:10:24.116437+0000","last_clean":"2024-09-14T12:10:24.116437+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:10:24.116437+0000","last_undegraded":"2024-09-14T12:10:24.116437+0000","last_fullsized":"2024-09-14T12:10:24.116437+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'287","last_scrub_stamp":"2024-09-14T12:10:24.116328+0000","last_deep_scrub":"265'287","last_deep_scrub_stamp":"2024-09-14T12:10:24.116328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.116328+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:29.318558+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.091785+0000","last_change":"2024-09-14T12:10:26.091785+0000","last_active":"2024-09-14T12:10:26.091785+0000","last_peered":"2024-09-14T12:10:26.091785+0000","last_clean":"2024-09-14T12:10:26.091785+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:10:26.091785+0000","last_undegraded":"2024-09-14T12:10:26.091785+0000","last_fullsized":"2024-09-14T12:10:26.091785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:26.091699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:26.091699+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.091699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:46.567994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":605,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.120762+0000","last_change":"2024-09-14T12:10:35.120762+0000","last_active":"2024-09-14T12:10:35.120762+0000","last_peered":"2024-09-14T12:10:35.120762+0000","last_clean":"2024-09-14T12:10:35.120762+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:10:35.120762+0000","last_undegraded":"2024-09-14T12:10:35.120762+0000","last_fullsized":"2024-09-14T12:10:35.120762+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-14T12:10:35.120667+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-14T12:10:35.120667+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.120667+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:51.522650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.862166+0000","last_change":"2024-09-14T12:10:06.862166+0000","last_active":"2024-09-14T12:10:06.862166+0000","last_peered":"2024-09-14T12:10:06.862166+0000","last_clean":"2024-09-14T12:10:06.862166+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:10:06.862166+0000","last_undegraded":"2024-09-14T12:10:06.862166+0000","last_fullsized":"2024-09-14T12:10:06.862166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'87","last_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_deep_scrub":"265'87","last_deep_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.862087+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:39.538988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'354","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.319113+0000","last_change":"2024-09-14T12:10:03.319113+0000","last_active":"2024-09-14T12:10:03.319113+0000","last_peered":"2024-09-14T12:10:03.319113+0000","last_clean":"2024-09-14T12:10:03.319113+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:10:03.319113+0000","last_undegraded":"2024-09-14T12:10:03.319113+0000","last_fullsized":"2024-09-14T12:10:03.319113+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.318990+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:10.334308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":12874,"num_write":1161,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"265'6","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.772240+0000","last_change":"2024-09-14T12:10:15.772240+0000","last_active":"2024-09-14T12:10:15.772240+0000","last_peered":"2024-09-14T12:10:15.772240+0000","last_clean":"2024-09-14T12:10:15.772240+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:10:15.772240+0000","last_undegraded":"2024-09-14T12:10:15.772240+0000","last_fullsized":"2024-09-14T12:10:15.772240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.772157+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:51.427742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'323","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.688900+0000","last_change":"2024-09-14T12:10:17.688900+0000","last_active":"2024-09-14T12:10:17.688900+0000","last_peered":"2024-09-14T12:10:17.688900+0000","last_clean":"2024-09-14T12:10:17.688900+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:10:17.688900+0000","last_undegraded":"2024-09-14T12:10:17.688900+0000","last_fullsized":"2024-09-14T12:10:17.688900+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.688794+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.306543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'738","reported_seq":2487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.724781+0000","last_change":"2024-09-14T12:10:22.724781+0000","last_active":"2024-09-14T12:10:22.724781+0000","last_peered":"2024-09-14T12:10:22.724781+0000","last_clean":"2024-09-14T12:10:22.724781+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:10:22.724781+0000","last_undegraded":"2024-09-14T12:10:22.724781+0000","last_fullsized":"2024-09-14T12:10:22.724781+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'738","last_scrub_stamp":"2024-09-14T12:10:22.724704+0000","last_deep_scrub":"265'738","last_deep_scrub_stamp":"2024-09-14T12:10:22.724704+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.724704+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:32.922720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'143","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.908076+0000","last_change":"2024-09-14T12:10:28.908076+0000","last_active":"2024-09-14T12:10:28.908076+0000","last_peered":"2024-09-14T12:10:28.908076+0000","last_clean":"2024-09-14T12:10:28.908076+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:10:28.908076+0000","last_undegraded":"2024-09-14T12:10:28.908076+0000","last_fullsized":"2024-09-14T12:10:28.908076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-14T12:10:28.907985+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-14T12:10:28.907985+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.907985+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:26.854086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.861006+0000","last_change":"2024-09-14T12:10:07.861006+0000","last_active":"2024-09-14T12:10:07.861006+0000","last_peered":"2024-09-14T12:10:07.861006+0000","last_clean":"2024-09-14T12:10:07.861006+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:10:07.861006+0000","last_undegraded":"2024-09-14T12:10:07.861006+0000","last_fullsized":"2024-09-14T12:10:07.861006+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.860920+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:10.720698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'309","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.813691+0000","last_change":"2024-09-14T12:09:59.813691+0000","last_active":"2024-09-14T12:09:59.813691+0000","last_peered":"2024-09-14T12:09:59.813691+0000","last_clean":"2024-09-14T12:09:59.813691+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:59.813691+0000","last_undegraded":"2024-09-14T12:09:59.813691+0000","last_fullsized":"2024-09-14T12:09:59.813691+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.813558+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:42.477590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":37578,"num_write":940,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1471,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.646610+0000","last_change":"2024-09-14T12:10:22.646610+0000","last_active":"2024-09-14T12:10:22.646610+0000","last_peered":"2024-09-14T12:10:22.646610+0000","last_clean":"2024-09-14T12:10:22.646610+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:10:22.646610+0000","last_undegraded":"2024-09-14T12:10:22.646610+0000","last_fullsized":"2024-09-14T12:10:22.646610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:22.646521+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:22.646521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.646521+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:20.953885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'95","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.206287+0000","last_change":"2024-09-14T12:10:24.206287+0000","last_active":"2024-09-14T12:10:24.206287+0000","last_peered":"2024-09-14T12:10:24.206287+0000","last_clean":"2024-09-14T12:10:24.206287+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:10:24.206287+0000","last_undegraded":"2024-09-14T12:10:24.206287+0000","last_fullsized":"2024-09-14T12:10:24.206287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-14T12:10:24.206188+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-14T12:10:24.206188+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.206188+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:01.065950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'775","reported_seq":2480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.399320+0000","last_change":"2024-09-14T12:10:18.399320+0000","last_active":"2024-09-14T12:10:18.399320+0000","last_peered":"2024-09-14T12:10:18.399320+0000","last_clean":"2024-09-14T12:10:18.399320+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:10:18.399320+0000","last_undegraded":"2024-09-14T12:10:18.399320+0000","last_fullsized":"2024-09-14T12:10:18.399320+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'775","last_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_deep_scrub":"265'775","last_deep_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.399218+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:25.017139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.019590+0000","last_change":"2024-09-14T12:10:33.019590+0000","last_active":"2024-09-14T12:10:33.019590+0000","last_peered":"2024-09-14T12:10:33.019590+0000","last_clean":"2024-09-14T12:10:33.019590+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:10:33.019590+0000","last_undegraded":"2024-09-14T12:10:33.019590+0000","last_fullsized":"2024-09-14T12:10:33.019590+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-14T12:10:33.019500+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-14T12:10:33.019500+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.019500+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:04.431083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'142","reported_seq":744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.733075+0000","last_change":"2024-09-14T12:10:11.733075+0000","last_active":"2024-09-14T12:10:11.733075+0000","last_peered":"2024-09-14T12:10:11.733075+0000","last_clean":"2024-09-14T12:10:11.733075+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:10:11.733075+0000","last_undegraded":"2024-09-14T12:10:11.733075+0000","last_fullsized":"2024-09-14T12:10:11.733075+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.732986+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.340583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1083,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.032758+0000","last_change":"2024-09-14T12:10:05.032758+0000","last_active":"2024-09-14T12:10:05.032758+0000","last_peered":"2024-09-14T12:10:05.032758+0000","last_clean":"2024-09-14T12:10:05.032758+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:10:05.032758+0000","last_undegraded":"2024-09-14T12:10:05.032758+0000","last_fullsized":"2024-09-14T12:10:05.032758+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.032635+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:23.135116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.013381+0000","last_change":"2024-09-14T12:10:20.013381+0000","last_active":"2024-09-14T12:10:20.013381+0000","last_peered":"2024-09-14T12:10:20.013381+0000","last_clean":"2024-09-14T12:10:20.013381+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:10:20.013381+0000","last_undegraded":"2024-09-14T12:10:20.013381+0000","last_fullsized":"2024-09-14T12:10:20.013381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.013295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.013295+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.013295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:44.013025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'363","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.661632+0000","last_change":"2024-09-14T12:10:27.661632+0000","last_active":"2024-09-14T12:10:27.661632+0000","last_peered":"2024-09-14T12:10:27.661632+0000","last_clean":"2024-09-14T12:10:27.661632+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:10:27.661632+0000","last_undegraded":"2024-09-14T12:10:27.661632+0000","last_fullsized":"2024-09-14T12:10:27.661632+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-14T12:10:27.661537+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-14T12:10:27.661537+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.661537+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:11.232522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.399470+0000","last_change":"2024-09-14T12:10:17.399470+0000","last_active":"2024-09-14T12:10:17.399470+0000","last_peered":"2024-09-14T12:10:17.399470+0000","last_clean":"2024-09-14T12:10:17.399470+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:10:17.399470+0000","last_undegraded":"2024-09-14T12:10:17.399470+0000","last_fullsized":"2024-09-14T12:10:17.399470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.399343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:00.798907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.870379+0000","last_change":"2024-09-14T12:10:23.870379+0000","last_active":"2024-09-14T12:10:23.870379+0000","last_peered":"2024-09-14T12:10:23.870379+0000","last_clean":"2024-09-14T12:10:23.870379+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:10:23.870379+0000","last_undegraded":"2024-09-14T12:10:23.870379+0000","last_fullsized":"2024-09-14T12:10:23.870379+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-14T12:10:23.870301+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-14T12:10:23.870301+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.870301+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.006161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'106","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.223843+0000","last_change":"2024-09-14T12:10:07.223843+0000","last_active":"2024-09-14T12:10:07.223843+0000","last_peered":"2024-09-14T12:10:07.223843+0000","last_clean":"2024-09-14T12:10:07.223843+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:10:07.223843+0000","last_undegraded":"2024-09-14T12:10:07.223843+0000","last_fullsized":"2024-09-14T12:10:07.223843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.223720+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:16.297510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.260992+0000","last_change":"2024-09-14T12:10:01.260893+0000","last_active":"2024-09-14T12:10:01.260992+0000","last_peered":"2024-09-14T12:10:01.260992+0000","last_clean":"2024-09-14T12:10:01.260992+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:10:01.260992+0000","last_undegraded":"2024-09-14T12:10:01.260992+0000","last_fullsized":"2024-09-14T12:10:01.260992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.260776+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:12.451761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.799298+0000","last_change":"2024-09-14T12:10:02.799298+0000","last_active":"2024-09-14T12:10:02.799298+0000","last_peered":"2024-09-14T12:10:02.799298+0000","last_clean":"2024-09-14T12:10:02.799298+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:10:02.799298+0000","last_undegraded":"2024-09-14T12:10:02.799298+0000","last_fullsized":"2024-09-14T12:10:02.799298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.799218+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:43.571584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.019453+0000","last_change":"2024-09-14T12:10:01.019453+0000","last_active":"2024-09-14T12:10:01.019453+0000","last_peered":"2024-09-14T12:10:01.019453+0000","last_clean":"2024-09-14T12:10:01.019453+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:10:01.019453+0000","last_undegraded":"2024-09-14T12:10:01.019453+0000","last_fullsized":"2024-09-14T12:10:01.019453+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.019366+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:16.170494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":21923,"num_write":1076,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.567257+0000","last_change":"2024-09-14T12:10:20.567257+0000","last_active":"2024-09-14T12:10:20.567257+0000","last_peered":"2024-09-14T12:10:20.567257+0000","last_clean":"2024-09-14T12:10:20.567257+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:10:20.567257+0000","last_undegraded":"2024-09-14T12:10:20.567257+0000","last_fullsized":"2024-09-14T12:10:20.567257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.567143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.567143+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.567143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:31.859917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'768","reported_seq":1488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.645340+0000","last_change":"2024-09-14T12:10:26.645340+0000","last_active":"2024-09-14T12:10:26.645340+0000","last_peered":"2024-09-14T12:10:26.645340+0000","last_clean":"2024-09-14T12:10:26.645340+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:10:26.645340+0000","last_undegraded":"2024-09-14T12:10:26.645340+0000","last_fullsized":"2024-09-14T12:10:26.645340+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-14T12:10:26.645214+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-14T12:10:26.645214+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.645214+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:28.785218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89194,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.161498+0000","last_change":"2024-09-14T12:10:24.161498+0000","last_active":"2024-09-14T12:10:24.161498+0000","last_peered":"2024-09-14T12:10:24.161498+0000","last_clean":"2024-09-14T12:10:24.161498+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:10:24.161498+0000","last_undegraded":"2024-09-14T12:10:24.161498+0000","last_fullsized":"2024-09-14T12:10:24.161498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:24.161412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:24.161412+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.161412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:39.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.421056+0000","last_change":"2024-09-14T12:10:22.421056+0000","last_active":"2024-09-14T12:10:22.421056+0000","last_peered":"2024-09-14T12:10:22.421056+0000","last_clean":"2024-09-14T12:10:22.421056+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:10:22.421056+0000","last_undegraded":"2024-09-14T12:10:22.421056+0000","last_fullsized":"2024-09-14T12:10:22.421056+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:22.420953+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:22.420953+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.420953+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:22.371086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.075205+0000","last_change":"2024-09-14T12:10:08.075205+0000","last_active":"2024-09-14T12:10:08.075205+0000","last_peered":"2024-09-14T12:10:08.075205+0000","last_clean":"2024-09-14T12:10:08.075205+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:10:08.075205+0000","last_undegraded":"2024-09-14T12:10:08.075205+0000","last_fullsized":"2024-09-14T12:10:08.075205+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.075089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:14.415988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.224738+0000","last_change":"2024-09-14T12:10:04.224677+0000","last_active":"2024-09-14T12:10:04.224738+0000","last_peered":"2024-09-14T12:10:04.224738+0000","last_clean":"2024-09-14T12:10:04.224738+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:10:04.224738+0000","last_undegraded":"2024-09-14T12:10:04.224738+0000","last_fullsized":"2024-09-14T12:10:04.224738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.224592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.747913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.014417+0000","last_change":"2024-09-14T12:10:00.014417+0000","last_active":"2024-09-14T12:10:00.014417+0000","last_peered":"2024-09-14T12:10:00.014417+0000","last_clean":"2024-09-14T12:10:00.014417+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:10:00.014417+0000","last_undegraded":"2024-09-14T12:10:00.014417+0000","last_fullsized":"2024-09-14T12:10:00.014417+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.014290+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:59.265225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":48298,"num_write":1181,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.673611+0000","last_change":"2024-09-14T12:10:21.673611+0000","last_active":"2024-09-14T12:10:21.673611+0000","last_peered":"2024-09-14T12:10:21.673611+0000","last_clean":"2024-09-14T12:10:21.673611+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:10:21.673611+0000","last_undegraded":"2024-09-14T12:10:21.673611+0000","last_fullsized":"2024-09-14T12:10:21.673611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.673525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.673525+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.673525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:37.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1284","reported_seq":2929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.805274+0000","last_change":"2024-09-14T12:10:18.805274+0000","last_active":"2024-09-14T12:10:18.805274+0000","last_peered":"2024-09-14T12:10:18.805274+0000","last_clean":"2024-09-14T12:10:18.805274+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:10:18.805274+0000","last_undegraded":"2024-09-14T12:10:18.805274+0000","last_fullsized":"2024-09-14T12:10:18.805274+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1284","last_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_deep_scrub":"265'1284","last_deep_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.805160+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":1200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:19.969704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140197,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2031,"num_read_kb":3753,"num_write":1136,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.455486+0000","last_change":"2024-09-14T12:10:30.455486+0000","last_active":"2024-09-14T12:10:30.455486+0000","last_peered":"2024-09-14T12:10:30.455486+0000","last_clean":"2024-09-14T12:10:30.455486+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:10:30.455486+0000","last_undegraded":"2024-09-14T12:10:30.455486+0000","last_fullsized":"2024-09-14T12:10:30.455486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.455395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.455395+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.455395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:27.833412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'222","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.908479+0000","last_change":"2024-09-14T12:10:25.908479+0000","last_active":"2024-09-14T12:10:25.908479+0000","last_peered":"2024-09-14T12:10:25.908479+0000","last_clean":"2024-09-14T12:10:25.908479+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:10:25.908479+0000","last_undegraded":"2024-09-14T12:10:25.908479+0000","last_fullsized":"2024-09-14T12:10:25.908479+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-14T12:10:25.908376+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-14T12:10:25.908376+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.908376+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.573130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.817859+0000","last_change":"2024-09-14T12:10:07.817859+0000","last_active":"2024-09-14T12:10:07.817859+0000","last_peered":"2024-09-14T12:10:07.817859+0000","last_clean":"2024-09-14T12:10:07.817859+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:10:07.817859+0000","last_undegraded":"2024-09-14T12:10:07.817859+0000","last_fullsized":"2024-09-14T12:10:07.817859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.817764+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.265513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.586595+0000","last_change":"2024-09-14T12:09:59.586595+0000","last_active":"2024-09-14T12:09:59.586595+0000","last_peered":"2024-09-14T12:09:59.586595+0000","last_clean":"2024-09-14T12:09:59.586595+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:09:59.586595+0000","last_undegraded":"2024-09-14T12:09:59.586595+0000","last_fullsized":"2024-09-14T12:09:59.586595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.586474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:31.075728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'377","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.870135+0000","last_change":"2024-09-14T12:09:58.870135+0000","last_active":"2024-09-14T12:09:58.870135+0000","last_peered":"2024-09-14T12:09:58.870135+0000","last_clean":"2024-09-14T12:09:58.870135+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:09:58.870135+0000","last_undegraded":"2024-09-14T12:09:58.870135+0000","last_fullsized":"2024-09-14T12:09:58.870135+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.870049+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:28.701680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":652,"num_read_kb":34638,"num_write":1221,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.670856+0000","last_change":"2024-09-14T12:10:11.670856+0000","last_active":"2024-09-14T12:10:11.670856+0000","last_peered":"2024-09-14T12:10:11.670856+0000","last_clean":"2024-09-14T12:10:11.670856+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:10:11.670856+0000","last_undegraded":"2024-09-14T12:10:11.670856+0000","last_fullsized":"2024-09-14T12:10:11.670856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.670773+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:07.716742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'255","reported_seq":1500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.523542+0000","last_change":"2024-09-14T12:10:24.523542+0000","last_active":"2024-09-14T12:10:24.523542+0000","last_peered":"2024-09-14T12:10:24.523542+0000","last_clean":"2024-09-14T12:10:24.523542+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:10:24.523542+0000","last_undegraded":"2024-09-14T12:10:24.523542+0000","last_fullsized":"2024-09-14T12:10:24.523542+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'255","last_scrub_stamp":"2024-09-14T12:10:24.523451+0000","last_deep_scrub":"265'255","last_deep_scrub_stamp":"2024-09-14T12:10:24.523451+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.523451+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:13.202729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.108167+0000","last_change":"2024-09-14T12:10:27.108167+0000","last_active":"2024-09-14T12:10:27.108167+0000","last_peered":"2024-09-14T12:10:27.108167+0000","last_clean":"2024-09-14T12:10:27.108167+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:10:27.108167+0000","last_undegraded":"2024-09-14T12:10:27.108167+0000","last_fullsized":"2024-09-14T12:10:27.108167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:27.108062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:27.108062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.108062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:02.428040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'242","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.122139+0000","last_change":"2024-09-14T12:10:34.122139+0000","last_active":"2024-09-14T12:10:34.122139+0000","last_peered":"2024-09-14T12:10:34.122139+0000","last_clean":"2024-09-14T12:10:34.122139+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:10:34.122139+0000","last_undegraded":"2024-09-14T12:10:34.122139+0000","last_fullsized":"2024-09-14T12:10:34.122139+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-14T12:10:34.122053+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-14T12:10:34.122053+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.122053+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:35.602598+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.796640+0000","last_change":"2024-09-14T12:10:04.796640+0000","last_active":"2024-09-14T12:10:04.796640+0000","last_peered":"2024-09-14T12:10:04.796640+0000","last_clean":"2024-09-14T12:10:04.796640+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:10:04.796640+0000","last_undegraded":"2024-09-14T12:10:04.796640+0000","last_fullsized":"2024-09-14T12:10:04.796640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.796540+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:34.364854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.780661+0000","last_change":"2024-09-14T12:10:01.780661+0000","last_active":"2024-09-14T12:10:01.780661+0000","last_peered":"2024-09-14T12:10:01.780661+0000","last_clean":"2024-09-14T12:10:01.780661+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:10:01.780661+0000","last_undegraded":"2024-09-14T12:10:01.780661+0000","last_fullsized":"2024-09-14T12:10:01.780661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.780573+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:54.383561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'320","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.820112+0000","last_change":"2024-09-14T12:10:00.820112+0000","last_active":"2024-09-14T12:10:00.820112+0000","last_peered":"2024-09-14T12:10:00.820112+0000","last_clean":"2024-09-14T12:10:00.820112+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:10:00.820112+0000","last_undegraded":"2024-09-14T12:10:00.820112+0000","last_fullsized":"2024-09-14T12:10:00.820112+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.820017+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:02.962307+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":663,"num_read_kb":8841,"num_write":1009,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"265'4","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.278392+0000","last_change":"2024-09-14T12:10:17.278392+0000","last_active":"2024-09-14T12:10:17.278392+0000","last_peered":"2024-09-14T12:10:17.278392+0000","last_clean":"2024-09-14T12:10:17.278392+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:10:17.278392+0000","last_undegraded":"2024-09-14T12:10:17.278392+0000","last_fullsized":"2024-09-14T12:10:17.278392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.278291+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.269121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'148","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.221325+0000","last_change":"2024-09-14T12:10:22.221325+0000","last_active":"2024-09-14T12:10:22.221325+0000","last_peered":"2024-09-14T12:10:22.221325+0000","last_clean":"2024-09-14T12:10:22.221325+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:10:22.221325+0000","last_undegraded":"2024-09-14T12:10:22.221325+0000","last_fullsized":"2024-09-14T12:10:22.221325+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'148","last_scrub_stamp":"2024-09-14T12:10:22.221256+0000","last_deep_scrub":"265'148","last_deep_scrub_stamp":"2024-09-14T12:10:22.221256+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.221256+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:43.118211+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.368105+0000","last_change":"2024-09-14T12:10:16.368105+0000","last_active":"2024-09-14T12:10:16.368105+0000","last_peered":"2024-09-14T12:10:16.368105+0000","last_clean":"2024-09-14T12:10:16.368105+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:10:16.368105+0000","last_undegraded":"2024-09-14T12:10:16.368105+0000","last_fullsized":"2024-09-14T12:10:16.368105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.368014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:07.077831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.539885+0000","last_change":"2024-09-14T12:10:33.539885+0000","last_active":"2024-09-14T12:10:33.539885+0000","last_peered":"2024-09-14T12:10:33.539885+0000","last_clean":"2024-09-14T12:10:33.539885+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:10:33.539885+0000","last_undegraded":"2024-09-14T12:10:33.539885+0000","last_fullsized":"2024-09-14T12:10:33.539885+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-14T12:10:33.539802+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-14T12:10:33.539802+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.539802+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:54.946538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.609490+0000","last_change":"2024-09-14T12:10:06.609490+0000","last_active":"2024-09-14T12:10:06.609490+0000","last_peered":"2024-09-14T12:10:06.609490+0000","last_clean":"2024-09-14T12:10:06.609490+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:10:06.609490+0000","last_undegraded":"2024-09-14T12:10:06.609490+0000","last_fullsized":"2024-09-14T12:10:06.609490+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.609384+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:45.973252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.734129+0000","last_change":"2024-09-14T12:10:00.734129+0000","last_active":"2024-09-14T12:10:00.734129+0000","last_peered":"2024-09-14T12:10:00.734129+0000","last_clean":"2024-09-14T12:10:00.734129+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:10:00.734129+0000","last_undegraded":"2024-09-14T12:10:00.734129+0000","last_fullsized":"2024-09-14T12:10:00.734129+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.734031+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:49.843097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.821103+0000","last_change":"2024-09-14T12:10:00.821103+0000","last_active":"2024-09-14T12:10:00.821103+0000","last_peered":"2024-09-14T12:10:00.821103+0000","last_clean":"2024-09-14T12:10:00.821103+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:10:00.821103+0000","last_undegraded":"2024-09-14T12:10:00.821103+0000","last_fullsized":"2024-09-14T12:10:00.821103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.821034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:21.167595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.242975+0000","last_change":"2024-09-14T12:10:19.242975+0000","last_active":"2024-09-14T12:10:19.242975+0000","last_peered":"2024-09-14T12:10:19.242975+0000","last_clean":"2024-09-14T12:10:19.242975+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:10:19.242975+0000","last_undegraded":"2024-09-14T12:10:19.242975+0000","last_fullsized":"2024-09-14T12:10:19.242975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.242892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:59.906575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1280,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.247855+0000","last_change":"2024-09-14T12:10:18.247855+0000","last_active":"2024-09-14T12:10:18.247855+0000","last_peered":"2024-09-14T12:10:18.247855+0000","last_clean":"2024-09-14T12:10:18.247855+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:10:18.247855+0000","last_undegraded":"2024-09-14T12:10:18.247855+0000","last_fullsized":"2024-09-14T12:10:18.247855+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'599","last_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_deep_scrub":"265'599","last_deep_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.247734+0000","objects_scrubbed":10,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:14.437465+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1669,"num_read_kb":2890,"num_write":2218,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537664,"num_omap_keys":1218,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.093496+0000","last_change":"2024-09-14T12:10:30.093496+0000","last_active":"2024-09-14T12:10:30.093496+0000","last_peered":"2024-09-14T12:10:30.093496+0000","last_clean":"2024-09-14T12:10:30.093496+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:10:30.093496+0000","last_undegraded":"2024-09-14T12:10:30.093496+0000","last_fullsized":"2024-09-14T12:10:30.093496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.093402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.093402+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.093402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:12.239531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'126","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.227318+0000","last_change":"2024-09-14T12:10:34.227318+0000","last_active":"2024-09-14T12:10:34.227318+0000","last_peered":"2024-09-14T12:10:34.227318+0000","last_clean":"2024-09-14T12:10:34.227318+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:10:34.227318+0000","last_undegraded":"2024-09-14T12:10:34.227318+0000","last_fullsized":"2024-09-14T12:10:34.227318+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-14T12:10:34.227217+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-14T12:10:34.227217+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.227217+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:34.630736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.057475+0000","last_change":"2024-09-14T12:10:07.057475+0000","last_active":"2024-09-14T12:10:07.057475+0000","last_peered":"2024-09-14T12:10:07.057475+0000","last_clean":"2024-09-14T12:10:07.057475+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:10:07.057475+0000","last_undegraded":"2024-09-14T12:10:07.057475+0000","last_fullsized":"2024-09-14T12:10:07.057475+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.057369+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:52.846935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'378","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.805142+0000","last_change":"2024-09-14T12:10:01.805142+0000","last_active":"2024-09-14T12:10:01.805142+0000","last_peered":"2024-09-14T12:10:01.805142+0000","last_clean":"2024-09-14T12:10:01.805142+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:10:01.805142+0000","last_undegraded":"2024-09-14T12:10:01.805142+0000","last_fullsized":"2024-09-14T12:10:01.805142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.805035+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:40.071458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":671,"num_read_kb":35559,"num_write":1182,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.234636+0000","last_change":"2024-09-14T12:10:02.234636+0000","last_active":"2024-09-14T12:10:02.234636+0000","last_peered":"2024-09-14T12:10:02.234636+0000","last_clean":"2024-09-14T12:10:02.234636+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:10:02.234636+0000","last_undegraded":"2024-09-14T12:10:02.234636+0000","last_fullsized":"2024-09-14T12:10:02.234636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.234555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.749698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.293819+0000","last_change":"2024-09-14T12:10:13.293819+0000","last_active":"2024-09-14T12:10:13.293819+0000","last_peered":"2024-09-14T12:10:13.293819+0000","last_clean":"2024-09-14T12:10:13.293819+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:10:13.293819+0000","last_undegraded":"2024-09-14T12:10:13.293819+0000","last_fullsized":"2024-09-14T12:10:13.293819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.293717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:44.892162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.763162+0000","last_change":"2024-09-14T12:10:17.763162+0000","last_active":"2024-09-14T12:10:17.763162+0000","last_peered":"2024-09-14T12:10:17.763162+0000","last_clean":"2024-09-14T12:10:17.763162+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:10:17.763162+0000","last_undegraded":"2024-09-14T12:10:17.763162+0000","last_fullsized":"2024-09-14T12:10:17.763162+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.763047+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:11.047981+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.618674+0000","last_change":"2024-09-14T12:10:31.618674+0000","last_active":"2024-09-14T12:10:31.618674+0000","last_peered":"2024-09-14T12:10:31.618674+0000","last_clean":"2024-09-14T12:10:31.618674+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:10:31.618674+0000","last_undegraded":"2024-09-14T12:10:31.618674+0000","last_fullsized":"2024-09-14T12:10:31.618674+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-14T12:10:31.618581+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-14T12:10:31.618581+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.618581+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.564737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'125","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.173064+0000","last_change":"2024-09-14T12:10:39.173064+0000","last_active":"2024-09-14T12:10:39.173064+0000","last_peered":"2024-09-14T12:10:39.173064+0000","last_clean":"2024-09-14T12:10:39.173064+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:10:39.173064+0000","last_undegraded":"2024-09-14T12:10:39.173064+0000","last_fullsized":"2024-09-14T12:10:39.173064+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-14T12:10:39.172981+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-14T12:10:39.172981+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.172981+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:49.444193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.112509+0000","last_change":"2024-09-14T12:10:08.112509+0000","last_active":"2024-09-14T12:10:08.112509+0000","last_peered":"2024-09-14T12:10:08.112509+0000","last_clean":"2024-09-14T12:10:08.112509+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:10:08.112509+0000","last_undegraded":"2024-09-14T12:10:08.112509+0000","last_fullsized":"2024-09-14T12:10:08.112509+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.112409+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:09.821615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.001125+0000","last_change":"2024-09-14T12:10:00.001125+0000","last_active":"2024-09-14T12:10:00.001125+0000","last_peered":"2024-09-14T12:10:00.001125+0000","last_clean":"2024-09-14T12:10:00.001125+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:10:00.001125+0000","last_undegraded":"2024-09-14T12:10:00.001125+0000","last_fullsized":"2024-09-14T12:10:00.001125+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.001028+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.912729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.836980+0000","last_change":"2024-09-14T12:09:59.836980+0000","last_active":"2024-09-14T12:09:59.836980+0000","last_peered":"2024-09-14T12:09:59.836980+0000","last_clean":"2024-09-14T12:09:59.836980+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:09:59.836980+0000","last_undegraded":"2024-09-14T12:09:59.836980+0000","last_fullsized":"2024-09-14T12:09:59.836980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.836907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:32.571263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.062743+0000","last_change":"2024-09-14T12:10:21.062743+0000","last_active":"2024-09-14T12:10:21.062743+0000","last_peered":"2024-09-14T12:10:21.062743+0000","last_clean":"2024-09-14T12:10:21.062743+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:10:21.062743+0000","last_undegraded":"2024-09-14T12:10:21.062743+0000","last_fullsized":"2024-09-14T12:10:21.062743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.062656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.062656+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.062656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:51.112747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'125","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.142508+0000","last_change":"2024-09-14T12:10:25.142508+0000","last_active":"2024-09-14T12:10:25.142508+0000","last_peered":"2024-09-14T12:10:25.142508+0000","last_clean":"2024-09-14T12:10:25.142508+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:10:25.142508+0000","last_undegraded":"2024-09-14T12:10:25.142508+0000","last_fullsized":"2024-09-14T12:10:25.142508+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-14T12:10:25.142414+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-14T12:10:25.142414+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.142414+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:59.124812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'793","reported_seq":6731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.182101+0000","last_change":"2024-09-14T12:10:28.182101+0000","last_active":"2024-09-14T12:10:28.182101+0000","last_peered":"2024-09-14T12:10:28.182101+0000","last_clean":"2024-09-14T12:10:28.182101+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:10:28.182101+0000","last_undegraded":"2024-09-14T12:10:28.182101+0000","last_fullsized":"2024-09-14T12:10:28.182101+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-14T12:10:28.182006+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-14T12:10:28.182006+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.182006+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:08.785563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'217","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.167503+0000","last_change":"2024-09-14T12:10:31.167503+0000","last_active":"2024-09-14T12:10:31.167503+0000","last_peered":"2024-09-14T12:10:31.167503+0000","last_clean":"2024-09-14T12:10:31.167503+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:10:31.167503+0000","last_undegraded":"2024-09-14T12:10:31.167503+0000","last_fullsized":"2024-09-14T12:10:31.167503+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-14T12:10:31.167362+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-14T12:10:31.167362+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.167362+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.614038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.833148+0000","last_change":"2024-09-14T12:10:02.833148+0000","last_active":"2024-09-14T12:10:02.833148+0000","last_peered":"2024-09-14T12:10:02.833148+0000","last_clean":"2024-09-14T12:10:02.833148+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:10:02.833148+0000","last_undegraded":"2024-09-14T12:10:02.833148+0000","last_fullsized":"2024-09-14T12:10:02.833148+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4144","last_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_deep_scrub":"265'4144","last_deep_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.833062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:50.518946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'380","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.549372+0000","last_change":"2024-09-14T12:10:03.549302+0000","last_active":"2024-09-14T12:10:03.549372+0000","last_peered":"2024-09-14T12:10:03.549372+0000","last_clean":"2024-09-14T12:10:03.549372+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:10:03.549372+0000","last_undegraded":"2024-09-14T12:10:03.549372+0000","last_fullsized":"2024-09-14T12:10:03.549372+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.549195+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:33.120720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":5405,"num_write":1192,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.355045+0000","last_change":"2024-09-14T12:10:01.355045+0000","last_active":"2024-09-14T12:10:01.355045+0000","last_peered":"2024-09-14T12:10:01.355045+0000","last_clean":"2024-09-14T12:10:01.355045+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:10:01.355045+0000","last_undegraded":"2024-09-14T12:10:01.355045+0000","last_fullsized":"2024-09-14T12:10:01.355045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.354958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:25.192772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.241169+0000","last_change":"2024-09-14T12:10:18.241169+0000","last_active":"2024-09-14T12:10:18.241169+0000","last_peered":"2024-09-14T12:10:18.241169+0000","last_clean":"2024-09-14T12:10:18.241169+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:10:18.241169+0000","last_undegraded":"2024-09-14T12:10:18.241169+0000","last_fullsized":"2024-09-14T12:10:18.241169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.241011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:36.998156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'800","reported_seq":1530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.571305+0000","last_change":"2024-09-14T12:10:22.571305+0000","last_active":"2024-09-14T12:10:22.571305+0000","last_peered":"2024-09-14T12:10:22.571305+0000","last_clean":"2024-09-14T12:10:22.571305+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:10:22.571305+0000","last_undegraded":"2024-09-14T12:10:22.571305+0000","last_fullsized":"2024-09-14T12:10:22.571305+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'800","last_scrub_stamp":"2024-09-14T12:10:22.571194+0000","last_deep_scrub":"265'800","last_deep_scrub_stamp":"2024-09-14T12:10:22.571194+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.571194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.338770+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.173127+0000","last_change":"2024-09-14T12:10:29.173127+0000","last_active":"2024-09-14T12:10:29.173127+0000","last_peered":"2024-09-14T12:10:29.173127+0000","last_clean":"2024-09-14T12:10:29.173127+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:10:29.173127+0000","last_undegraded":"2024-09-14T12:10:29.173127+0000","last_fullsized":"2024-09-14T12:10:29.173127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.173026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.173026+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.173026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.984503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'149","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.569999+0000","last_change":"2024-09-14T12:10:34.569999+0000","last_active":"2024-09-14T12:10:34.569999+0000","last_peered":"2024-09-14T12:10:34.569999+0000","last_clean":"2024-09-14T12:10:34.569999+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:10:34.569999+0000","last_undegraded":"2024-09-14T12:10:34.569999+0000","last_fullsized":"2024-09-14T12:10:34.569999+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'149","last_scrub_stamp":"2024-09-14T12:10:34.569906+0000","last_deep_scrub":"265'149","last_deep_scrub_stamp":"2024-09-14T12:10:34.569906+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.569906+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:33.194573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.198485+0000","last_change":"2024-09-14T12:10:35.198485+0000","last_active":"2024-09-14T12:10:35.198485+0000","last_peered":"2024-09-14T12:10:35.198485+0000","last_clean":"2024-09-14T12:10:35.198485+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:10:35.198485+0000","last_undegraded":"2024-09-14T12:10:35.198485+0000","last_fullsized":"2024-09-14T12:10:35.198485+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-14T12:10:35.198397+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-14T12:10:35.198397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.198397+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.366891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.867191+0000","last_change":"2024-09-14T12:10:10.867191+0000","last_active":"2024-09-14T12:10:10.867191+0000","last_peered":"2024-09-14T12:10:10.867191+0000","last_clean":"2024-09-14T12:10:10.867191+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:10:10.867191+0000","last_undegraded":"2024-09-14T12:10:10.867191+0000","last_fullsized":"2024-09-14T12:10:10.867191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.867096+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:37.567590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'349","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.790676+0000","last_change":"2024-09-14T12:10:01.790676+0000","last_active":"2024-09-14T12:10:01.790676+0000","last_peered":"2024-09-14T12:10:01.790676+0000","last_clean":"2024-09-14T12:10:01.790676+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:10:01.790676+0000","last_undegraded":"2024-09-14T12:10:01.790676+0000","last_fullsized":"2024-09-14T12:10:01.790676+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.790549+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.092776+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":5106,"num_write":1232,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.730899+0000","last_change":"2024-09-14T12:10:12.730899+0000","last_active":"2024-09-14T12:10:12.730899+0000","last_peered":"2024-09-14T12:10:12.730899+0000","last_clean":"2024-09-14T12:10:12.730899+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:10:12.730899+0000","last_undegraded":"2024-09-14T12:10:12.730899+0000","last_fullsized":"2024-09-14T12:10:12.730899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.730806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:09.075497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'329","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.171310+0000","last_change":"2024-09-14T12:10:25.171310+0000","last_active":"2024-09-14T12:10:25.171310+0000","last_peered":"2024-09-14T12:10:25.171310+0000","last_clean":"2024-09-14T12:10:25.171310+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:10:25.171310+0000","last_undegraded":"2024-09-14T12:10:25.171310+0000","last_fullsized":"2024-09-14T12:10:25.171310+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-14T12:10:25.171217+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-14T12:10:25.171217+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.171217+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:27.217163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.169739+0000","last_change":"2024-09-14T12:10:32.169739+0000","last_active":"2024-09-14T12:10:32.169739+0000","last_peered":"2024-09-14T12:10:32.169739+0000","last_clean":"2024-09-14T12:10:32.169739+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:10:32.169739+0000","last_undegraded":"2024-09-14T12:10:32.169739+0000","last_fullsized":"2024-09-14T12:10:32.169739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.169632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.169632+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.169632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:21.976939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'133","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.122891+0000","last_change":"2024-09-14T12:10:38.122891+0000","last_active":"2024-09-14T12:10:38.122891+0000","last_peered":"2024-09-14T12:10:38.122891+0000","last_clean":"2024-09-14T12:10:38.122891+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:10:38.122891+0000","last_undegraded":"2024-09-14T12:10:38.122891+0000","last_fullsized":"2024-09-14T12:10:38.122891+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:38.122784+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:38.122784+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.122784+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.978913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.818239+0000","last_change":"2024-09-14T12:10:08.818239+0000","last_active":"2024-09-14T12:10:08.818239+0000","last_peered":"2024-09-14T12:10:08.818239+0000","last_clean":"2024-09-14T12:10:08.818239+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:10:08.818239+0000","last_undegraded":"2024-09-14T12:10:08.818239+0000","last_fullsized":"2024-09-14T12:10:08.818239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.818146+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:58.032521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'348","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.325150+0000","last_change":"2024-09-14T12:10:08.325150+0000","last_active":"2024-09-14T12:10:08.325150+0000","last_peered":"2024-09-14T12:10:08.325150+0000","last_clean":"2024-09-14T12:10:08.325150+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:10:08.325150+0000","last_undegraded":"2024-09-14T12:10:08.325150+0000","last_fullsized":"2024-09-14T12:10:08.325150+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.325054+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:38.981426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":33435,"num_write":1030,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.215844+0000","last_change":"2024-09-14T12:10:19.215844+0000","last_active":"2024-09-14T12:10:19.215844+0000","last_peered":"2024-09-14T12:10:19.215844+0000","last_clean":"2024-09-14T12:10:19.215844+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:10:19.215844+0000","last_undegraded":"2024-09-14T12:10:19.215844+0000","last_fullsized":"2024-09-14T12:10:19.215844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.215754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:04.064105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'50","reported_seq":565,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.282515+0000","last_change":"2024-09-14T12:10:21.282515+0000","last_active":"2024-09-14T12:10:21.282515+0000","last_peered":"2024-09-14T12:10:21.282515+0000","last_clean":"2024-09-14T12:10:21.282515+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:10:21.282515+0000","last_undegraded":"2024-09-14T12:10:21.282515+0000","last_fullsized":"2024-09-14T12:10:21.282515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-14T12:10:21.282415+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-14T12:10:21.282415+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.282415+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:42.993531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.488546+0000","last_change":"2024-09-14T12:10:29.488546+0000","last_active":"2024-09-14T12:10:29.488546+0000","last_peered":"2024-09-14T12:10:29.488546+0000","last_clean":"2024-09-14T12:10:29.488546+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:10:29.488546+0000","last_undegraded":"2024-09-14T12:10:29.488546+0000","last_fullsized":"2024-09-14T12:10:29.488546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.488380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.488380+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.488380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:15.572534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'254","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.184053+0000","last_change":"2024-09-14T12:10:33.184053+0000","last_active":"2024-09-14T12:10:33.184053+0000","last_peered":"2024-09-14T12:10:33.184053+0000","last_clean":"2024-09-14T12:10:33.184053+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:10:33.184053+0000","last_undegraded":"2024-09-14T12:10:33.184053+0000","last_fullsized":"2024-09-14T12:10:33.184053+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-14T12:10:33.183967+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-14T12:10:33.183967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.183967+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:05.916700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.069541+0000","last_change":"2024-09-14T12:10:09.069541+0000","last_active":"2024-09-14T12:10:09.069541+0000","last_peered":"2024-09-14T12:10:09.069541+0000","last_clean":"2024-09-14T12:10:09.069541+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:10:09.069541+0000","last_undegraded":"2024-09-14T12:10:09.069541+0000","last_fullsized":"2024-09-14T12:10:09.069541+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.069447+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.610666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1258,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.804369+0000","last_change":"2024-09-14T12:10:03.804369+0000","last_active":"2024-09-14T12:10:03.804369+0000","last_peered":"2024-09-14T12:10:03.804369+0000","last_clean":"2024-09-14T12:10:03.804369+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:10:03.804369+0000","last_undegraded":"2024-09-14T12:10:03.804369+0000","last_fullsized":"2024-09-14T12:10:03.804369+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.804231+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.949022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.588199+0000","last_change":"2024-09-14T12:10:21.588199+0000","last_active":"2024-09-14T12:10:21.588199+0000","last_peered":"2024-09-14T12:10:21.588199+0000","last_clean":"2024-09-14T12:10:21.588199+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:21.588199+0000","last_undegraded":"2024-09-14T12:10:21.588199+0000","last_fullsized":"2024-09-14T12:10:21.588199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.588115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.588115+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.588115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:54.368894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'312","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.148522+0000","last_change":"2024-09-14T12:10:26.148522+0000","last_active":"2024-09-14T12:10:26.148522+0000","last_peered":"2024-09-14T12:10:26.148522+0000","last_clean":"2024-09-14T12:10:26.148522+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:10:26.148522+0000","last_undegraded":"2024-09-14T12:10:26.148522+0000","last_fullsized":"2024-09-14T12:10:26.148522+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-14T12:10:26.148430+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-14T12:10:26.148430+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.148430+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:20.299138+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.420495+0000","last_change":"2024-09-14T12:10:21.420495+0000","last_active":"2024-09-14T12:10:21.420495+0000","last_peered":"2024-09-14T12:10:21.420495+0000","last_clean":"2024-09-14T12:10:21.420495+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:10:21.420495+0000","last_undegraded":"2024-09-14T12:10:21.420495+0000","last_fullsized":"2024-09-14T12:10:21.420495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.420410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.420410+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.420410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:41.884735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'112","reported_seq":632,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.608406+0000","last_change":"2024-09-14T12:10:37.608406+0000","last_active":"2024-09-14T12:10:37.608406+0000","last_peered":"2024-09-14T12:10:37.608406+0000","last_clean":"2024-09-14T12:10:37.608406+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:10:37.608406+0000","last_undegraded":"2024-09-14T12:10:37.608406+0000","last_fullsized":"2024-09-14T12:10:37.608406+0000","mapping_epoch":35,"log_start":"265'101","ondisk_log_start":"265'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-14T12:10:37.608319+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-14T12:10:37.608319+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.608319+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.341297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'144","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.115730+0000","last_change":"2024-09-14T12:10:11.115730+0000","last_active":"2024-09-14T12:10:11.115730+0000","last_peered":"2024-09-14T12:10:11.115730+0000","last_clean":"2024-09-14T12:10:11.115730+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:10:11.115730+0000","last_undegraded":"2024-09-14T12:10:11.115730+0000","last_fullsized":"2024-09-14T12:10:11.115730+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.115619+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.488762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'377","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.003226+0000","last_change":"2024-09-14T12:10:01.003226+0000","last_active":"2024-09-14T12:10:01.003226+0000","last_peered":"2024-09-14T12:10:01.003226+0000","last_clean":"2024-09-14T12:10:01.003226+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:10:01.003226+0000","last_undegraded":"2024-09-14T12:10:01.003226+0000","last_fullsized":"2024-09-14T12:10:01.003226+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.003138+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:56.741486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":721,"num_read_kb":71289,"num_write":1192,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.311021+0000","last_change":"2024-09-14T12:10:14.311021+0000","last_active":"2024-09-14T12:10:14.311021+0000","last_peered":"2024-09-14T12:10:14.311021+0000","last_clean":"2024-09-14T12:10:14.311021+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:10:14.311021+0000","last_undegraded":"2024-09-14T12:10:14.311021+0000","last_fullsized":"2024-09-14T12:10:14.311021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.310925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:23.832794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'269","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.464707+0000","last_change":"2024-09-14T12:10:26.464707+0000","last_active":"2024-09-14T12:10:26.464707+0000","last_peered":"2024-09-14T12:10:26.464707+0000","last_clean":"2024-09-14T12:10:26.464707+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:10:26.464707+0000","last_undegraded":"2024-09-14T12:10:26.464707+0000","last_fullsized":"2024-09-14T12:10:26.464707+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-14T12:10:26.464613+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-14T12:10:26.464613+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.464613+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:58.834720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.154161+0000","last_change":"2024-09-14T12:10:30.154161+0000","last_active":"2024-09-14T12:10:30.154161+0000","last_peered":"2024-09-14T12:10:30.154161+0000","last_clean":"2024-09-14T12:10:30.154161+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:10:30.154161+0000","last_undegraded":"2024-09-14T12:10:30.154161+0000","last_fullsized":"2024-09-14T12:10:30.154161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.154074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.154074+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.154074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:28.047612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.268794+0000","last_change":"2024-09-14T12:10:11.268794+0000","last_active":"2024-09-14T12:10:11.268794+0000","last_peered":"2024-09-14T12:10:11.268794+0000","last_clean":"2024-09-14T12:10:11.268794+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:10:11.268794+0000","last_undegraded":"2024-09-14T12:10:11.268794+0000","last_fullsized":"2024-09-14T12:10:11.268794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.268689+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:54.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'373","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.060204+0000","last_change":"2024-09-14T12:10:03.060204+0000","last_active":"2024-09-14T12:10:03.060204+0000","last_peered":"2024-09-14T12:10:03.060204+0000","last_clean":"2024-09-14T12:10:03.060204+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:10:03.060204+0000","last_undegraded":"2024-09-14T12:10:03.060204+0000","last_fullsized":"2024-09-14T12:10:03.060204+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.060083+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.821132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":695,"num_read_kb":6455,"num_write":1238,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.291568+0000","last_change":"2024-09-14T12:10:16.291568+0000","last_active":"2024-09-14T12:10:16.291568+0000","last_peered":"2024-09-14T12:10:16.291568+0000","last_clean":"2024-09-14T12:10:16.291568+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:10:16.291568+0000","last_undegraded":"2024-09-14T12:10:16.291568+0000","last_fullsized":"2024-09-14T12:10:16.291568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.291473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:05.832571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.809552+0000","last_change":"2024-09-14T12:10:19.809552+0000","last_active":"2024-09-14T12:10:19.809552+0000","last_peered":"2024-09-14T12:10:19.809552+0000","last_clean":"2024-09-14T12:10:19.809552+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:10:19.809552+0000","last_undegraded":"2024-09-14T12:10:19.809552+0000","last_fullsized":"2024-09-14T12:10:19.809552+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.809459+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:21.052022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":912,"num_read_kb":2171,"num_write":788,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.658111+0000","last_change":"2024-09-14T12:10:30.658111+0000","last_active":"2024-09-14T12:10:30.658111+0000","last_peered":"2024-09-14T12:10:30.658111+0000","last_clean":"2024-09-14T12:10:30.658111+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:10:30.658111+0000","last_undegraded":"2024-09-14T12:10:30.658111+0000","last_fullsized":"2024-09-14T12:10:30.658111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.658016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.658016+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.658016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:29.843616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'176","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.076865+0000","last_change":"2024-09-14T12:10:36.076865+0000","last_active":"2024-09-14T12:10:36.076865+0000","last_peered":"2024-09-14T12:10:36.076865+0000","last_clean":"2024-09-14T12:10:36.076865+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:10:36.076865+0000","last_undegraded":"2024-09-14T12:10:36.076865+0000","last_fullsized":"2024-09-14T12:10:36.076865+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:36.076779+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:36.076779+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.076779+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.804134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.138191+0000","last_change":"2024-09-14T12:10:12.138191+0000","last_active":"2024-09-14T12:10:12.138191+0000","last_peered":"2024-09-14T12:10:12.138191+0000","last_clean":"2024-09-14T12:10:12.138191+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:10:12.138191+0000","last_undegraded":"2024-09-14T12:10:12.138191+0000","last_fullsized":"2024-09-14T12:10:12.138191+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.138098+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:11.397910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.791625+0000","last_change":"2024-09-14T12:10:02.791625+0000","last_active":"2024-09-14T12:10:02.791625+0000","last_peered":"2024-09-14T12:10:02.791625+0000","last_clean":"2024-09-14T12:10:02.791625+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:10:02.791625+0000","last_undegraded":"2024-09-14T12:10:02.791625+0000","last_fullsized":"2024-09-14T12:10:02.791625+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.791485+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:30.525115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":4521,"num_write":984,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.329226+0000","last_change":"2024-09-14T12:10:15.329226+0000","last_active":"2024-09-14T12:10:15.329226+0000","last_peered":"2024-09-14T12:10:15.329226+0000","last_clean":"2024-09-14T12:10:15.329226+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:15.329226+0000","last_undegraded":"2024-09-14T12:10:15.329226+0000","last_fullsized":"2024-09-14T12:10:15.329226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.329133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:37.556057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'320","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.515207+0000","last_change":"2024-09-14T12:10:28.515207+0000","last_active":"2024-09-14T12:10:28.515207+0000","last_peered":"2024-09-14T12:10:28.515207+0000","last_clean":"2024-09-14T12:10:28.515207+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:10:28.515207+0000","last_undegraded":"2024-09-14T12:10:28.515207+0000","last_fullsized":"2024-09-14T12:10:28.515207+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:28.515114+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:28.515114+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.515114+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:43.805134+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.824070+0000","last_change":"2024-09-14T12:10:21.824070+0000","last_active":"2024-09-14T12:10:21.824070+0000","last_peered":"2024-09-14T12:10:21.824070+0000","last_clean":"2024-09-14T12:10:21.824070+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:10:21.824070+0000","last_undegraded":"2024-09-14T12:10:21.824070+0000","last_fullsized":"2024-09-14T12:10:21.824070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.823994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.823994+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.823994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.993330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'193","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.504212+0000","last_change":"2024-09-14T12:10:28.504212+0000","last_active":"2024-09-14T12:10:28.504212+0000","last_peered":"2024-09-14T12:10:28.504212+0000","last_clean":"2024-09-14T12:10:28.504212+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:10:28.504212+0000","last_undegraded":"2024-09-14T12:10:28.504212+0000","last_fullsized":"2024-09-14T12:10:28.504212+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'193","last_scrub_stamp":"2024-09-14T12:10:28.504112+0000","last_deep_scrub":"265'193","last_deep_scrub_stamp":"2024-09-14T12:10:28.504112+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.504112+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:54.702733+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.129601+0000","last_change":"2024-09-14T12:10:14.129538+0000","last_active":"2024-09-14T12:10:14.129601+0000","last_peered":"2024-09-14T12:10:14.129601+0000","last_clean":"2024-09-14T12:10:14.129601+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:10:14.129601+0000","last_undegraded":"2024-09-14T12:10:14.129601+0000","last_fullsized":"2024-09-14T12:10:14.129601+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.129436+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:00.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'343","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.585762+0000","last_change":"2024-09-14T12:10:01.585762+0000","last_active":"2024-09-14T12:10:01.585762+0000","last_peered":"2024-09-14T12:10:01.585762+0000","last_clean":"2024-09-14T12:10:01.585762+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:10:01.585762+0000","last_undegraded":"2024-09-14T12:10:01.585762+0000","last_fullsized":"2024-09-14T12:10:01.585762+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.585672+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.361742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":125003,"num_write":1056,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.102871+0000","last_change":"2024-09-14T12:10:23.102871+0000","last_active":"2024-09-14T12:10:23.102871+0000","last_peered":"2024-09-14T12:10:23.102871+0000","last_clean":"2024-09-14T12:10:23.102871+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:10:23.102871+0000","last_undegraded":"2024-09-14T12:10:23.102871+0000","last_fullsized":"2024-09-14T12:10:23.102871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.102779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.102779+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.102779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:26.238331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'309","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.209118+0000","last_change":"2024-09-14T12:10:30.209118+0000","last_active":"2024-09-14T12:10:30.209118+0000","last_peered":"2024-09-14T12:10:30.209118+0000","last_clean":"2024-09-14T12:10:30.209118+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:10:30.209118+0000","last_undegraded":"2024-09-14T12:10:30.209118+0000","last_fullsized":"2024-09-14T12:10:30.209118+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:10:30.209019+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:10:30.209019+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.209019+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:02.348494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.836816+0000","last_change":"2024-09-14T12:10:22.836816+0000","last_active":"2024-09-14T12:10:22.836816+0000","last_peered":"2024-09-14T12:10:22.836816+0000","last_clean":"2024-09-14T12:10:22.836816+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:10:22.836816+0000","last_undegraded":"2024-09-14T12:10:22.836816+0000","last_fullsized":"2024-09-14T12:10:22.836816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:22.836737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:22.836737+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.836737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:53.232235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.569934+0000","last_change":"2024-09-14T12:10:35.569934+0000","last_active":"2024-09-14T12:10:35.569934+0000","last_peered":"2024-09-14T12:10:35.569934+0000","last_clean":"2024-09-14T12:10:35.569934+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:10:35.569934+0000","last_undegraded":"2024-09-14T12:10:35.569934+0000","last_fullsized":"2024-09-14T12:10:35.569934+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-14T12:10:35.569829+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-14T12:10:35.569829+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.569829+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:57.670180+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.689718+0000","last_change":"2024-09-14T12:10:13.689637+0000","last_active":"2024-09-14T12:10:13.689718+0000","last_peered":"2024-09-14T12:10:13.689718+0000","last_clean":"2024-09-14T12:10:13.689718+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:10:13.689718+0000","last_undegraded":"2024-09-14T12:10:13.689718+0000","last_fullsized":"2024-09-14T12:10:13.689718+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.689552+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:15.549909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'420","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.035145+0000","last_change":"2024-09-14T12:09:58.035048+0000","last_active":"2024-09-14T12:09:58.035145+0000","last_peered":"2024-09-14T12:09:58.035145+0000","last_clean":"2024-09-14T12:09:58.035145+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:09:58.035145+0000","last_undegraded":"2024-09-14T12:09:58.035145+0000","last_fullsized":"2024-09-14T12:09:58.035145+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.034944+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:02.918444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":916,"num_read_kb":75270,"num_write":1291,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.727644+0000","last_change":"2024-09-14T12:10:14.727588+0000","last_active":"2024-09-14T12:10:14.727644+0000","last_peered":"2024-09-14T12:10:14.727644+0000","last_clean":"2024-09-14T12:10:14.727644+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:10:14.727644+0000","last_undegraded":"2024-09-14T12:10:14.727644+0000","last_fullsized":"2024-09-14T12:10:14.727644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.727491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:45.961043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'114","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.102506+0000","last_change":"2024-09-14T12:10:27.102506+0000","last_active":"2024-09-14T12:10:27.102506+0000","last_peered":"2024-09-14T12:10:27.102506+0000","last_clean":"2024-09-14T12:10:27.102506+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:10:27.102506+0000","last_undegraded":"2024-09-14T12:10:27.102506+0000","last_fullsized":"2024-09-14T12:10:27.102506+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:27.102406+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:27.102406+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.102406+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:31.401975+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'777","reported_seq":2377,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.392892+0000","last_change":"2024-09-14T12:10:20.392892+0000","last_active":"2024-09-14T12:10:20.392892+0000","last_peered":"2024-09-14T12:10:20.392892+0000","last_clean":"2024-09-14T12:10:20.392892+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:10:20.392892+0000","last_undegraded":"2024-09-14T12:10:20.392892+0000","last_fullsized":"2024-09-14T12:10:20.392892+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'777","last_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_deep_scrub":"265'777","last_deep_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.392801+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:46.710130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.489519+0000","last_change":"2024-09-14T12:10:33.489519+0000","last_active":"2024-09-14T12:10:33.489519+0000","last_peered":"2024-09-14T12:10:33.489519+0000","last_clean":"2024-09-14T12:10:33.489519+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:10:33.489519+0000","last_undegraded":"2024-09-14T12:10:33.489519+0000","last_fullsized":"2024-09-14T12:10:33.489519+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-14T12:10:33.489423+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-14T12:10:33.489423+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.489423+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:49.539458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.888232+0000","last_change":"2024-09-14T12:10:11.888161+0000","last_active":"2024-09-14T12:10:11.888232+0000","last_peered":"2024-09-14T12:10:11.888232+0000","last_clean":"2024-09-14T12:10:11.888232+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:10:11.888232+0000","last_undegraded":"2024-09-14T12:10:11.888232+0000","last_fullsized":"2024-09-14T12:10:11.888232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.888043+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:26.749909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'295","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.716546+0000","last_change":"2024-09-14T12:10:06.716484+0000","last_active":"2024-09-14T12:10:06.716546+0000","last_peered":"2024-09-14T12:10:06.716546+0000","last_clean":"2024-09-14T12:10:06.716546+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:10:06.716546+0000","last_undegraded":"2024-09-14T12:10:06.716546+0000","last_fullsized":"2024-09-14T12:10:06.716546+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.716383+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:44.130365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":114075,"num_write":994,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.523154+0000","last_change":"2024-09-14T12:10:23.523154+0000","last_active":"2024-09-14T12:10:23.523154+0000","last_peered":"2024-09-14T12:10:23.523154+0000","last_clean":"2024-09-14T12:10:23.523154+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:10:23.523154+0000","last_undegraded":"2024-09-14T12:10:23.523154+0000","last_fullsized":"2024-09-14T12:10:23.523154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.523074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.523074+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.523074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:22.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'309","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.710490+0000","last_change":"2024-09-14T12:10:29.710490+0000","last_active":"2024-09-14T12:10:29.710490+0000","last_peered":"2024-09-14T12:10:29.710490+0000","last_clean":"2024-09-14T12:10:29.710490+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:10:29.710490+0000","last_undegraded":"2024-09-14T12:10:29.710490+0000","last_fullsized":"2024-09-14T12:10:29.710490+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:10:29.710346+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:10:29.710346+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.710346+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:11.757953+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":1004,"num_write":382,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.107162+0000","last_change":"2024-09-14T12:10:28.107162+0000","last_active":"2024-09-14T12:10:28.107162+0000","last_peered":"2024-09-14T12:10:28.107162+0000","last_clean":"2024-09-14T12:10:28.107162+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:10:28.107162+0000","last_undegraded":"2024-09-14T12:10:28.107162+0000","last_fullsized":"2024-09-14T12:10:28.107162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.107065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.107065+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.107065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:25.172614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'104","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.479326+0000","last_change":"2024-09-14T12:10:34.479326+0000","last_active":"2024-09-14T12:10:34.479326+0000","last_peered":"2024-09-14T12:10:34.479326+0000","last_clean":"2024-09-14T12:10:34.479326+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:10:34.479326+0000","last_undegraded":"2024-09-14T12:10:34.479326+0000","last_fullsized":"2024-09-14T12:10:34.479326+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:34.479231+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:34.479231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.479231+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:05.636206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.902339+0000","last_change":"2024-09-14T12:10:09.902249+0000","last_active":"2024-09-14T12:10:09.902339+0000","last_peered":"2024-09-14T12:10:09.902339+0000","last_clean":"2024-09-14T12:10:09.902339+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:10:09.902339+0000","last_undegraded":"2024-09-14T12:10:09.902339+0000","last_fullsized":"2024-09-14T12:10:09.902339+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.902123+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:17.521695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'364","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.657969+0000","last_change":"2024-09-14T12:10:09.657890+0000","last_active":"2024-09-14T12:10:09.657969+0000","last_peered":"2024-09-14T12:10:09.657969+0000","last_clean":"2024-09-14T12:10:09.657969+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:10:09.657969+0000","last_undegraded":"2024-09-14T12:10:09.657969+0000","last_fullsized":"2024-09-14T12:10:09.657969+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.657777+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:26.554926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":577,"num_read_kb":11549,"num_write":1068,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.624010+0000","last_change":"2024-09-14T12:10:25.624010+0000","last_active":"2024-09-14T12:10:25.624010+0000","last_peered":"2024-09-14T12:10:25.624010+0000","last_clean":"2024-09-14T12:10:25.624010+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:10:25.624010+0000","last_undegraded":"2024-09-14T12:10:25.624010+0000","last_fullsized":"2024-09-14T12:10:25.624010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:25.623907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:25.623907+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.623907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:56.414412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.210307+0000","last_change":"2024-09-14T12:10:23.210307+0000","last_active":"2024-09-14T12:10:23.210307+0000","last_peered":"2024-09-14T12:10:23.210307+0000","last_clean":"2024-09-14T12:10:23.210307+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:10:23.210307+0000","last_undegraded":"2024-09-14T12:10:23.210307+0000","last_fullsized":"2024-09-14T12:10:23.210307+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-14T12:10:23.210222+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-14T12:10:23.210222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.210222+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:40.458601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44701,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1000,"num_write":364,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.390487+0000","last_change":"2024-09-14T12:10:19.390487+0000","last_active":"2024-09-14T12:10:19.390487+0000","last_peered":"2024-09-14T12:10:19.390487+0000","last_clean":"2024-09-14T12:10:19.390487+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:10:19.390487+0000","last_undegraded":"2024-09-14T12:10:19.390487+0000","last_fullsized":"2024-09-14T12:10:19.390487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.390407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:27.514718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'108","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.087993+0000","last_change":"2024-09-14T12:10:37.087993+0000","last_active":"2024-09-14T12:10:37.087993+0000","last_peered":"2024-09-14T12:10:37.087993+0000","last_clean":"2024-09-14T12:10:37.087993+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:10:37.087993+0000","last_undegraded":"2024-09-14T12:10:37.087993+0000","last_fullsized":"2024-09-14T12:10:37.087993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-14T12:10:37.087898+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-14T12:10:37.087898+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.087898+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:40.698273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'441","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.090742+0000","last_change":"2024-09-14T12:10:13.090742+0000","last_active":"2024-09-14T12:10:13.090742+0000","last_peered":"2024-09-14T12:10:13.090742+0000","last_clean":"2024-09-14T12:10:13.090742+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:10:13.090742+0000","last_undegraded":"2024-09-14T12:10:13.090742+0000","last_fullsized":"2024-09-14T12:10:13.090742+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'441","last_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_deep_scrub":"265'441","last_deep_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.090640+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:48.381349+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25759,"num_omap_keys":101,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'351","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.065794+0000","last_change":"2024-09-14T12:10:02.065794+0000","last_active":"2024-09-14T12:10:02.065794+0000","last_peered":"2024-09-14T12:10:02.065794+0000","last_clean":"2024-09-14T12:10:02.065794+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:10:02.065794+0000","last_undegraded":"2024-09-14T12:10:02.065794+0000","last_fullsized":"2024-09-14T12:10:02.065794+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.065711+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:42.511318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":1479,"num_write":1091,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.083133+0000","last_change":"2024-09-14T12:10:22.083133+0000","last_active":"2024-09-14T12:10:22.083133+0000","last_peered":"2024-09-14T12:10:22.083133+0000","last_clean":"2024-09-14T12:10:22.083133+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:10:22.083133+0000","last_undegraded":"2024-09-14T12:10:22.083133+0000","last_fullsized":"2024-09-14T12:10:22.083133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:22.083055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:22.083055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.083055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:26.984342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'239","reported_seq":804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.190156+0000","last_change":"2024-09-14T12:10:27.190156+0000","last_active":"2024-09-14T12:10:27.190156+0000","last_peered":"2024-09-14T12:10:27.190156+0000","last_clean":"2024-09-14T12:10:27.190156+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:10:27.190156+0000","last_undegraded":"2024-09-14T12:10:27.190156+0000","last_fullsized":"2024-09-14T12:10:27.190156+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-14T12:10:27.190067+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-14T12:10:27.190067+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.190067+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:54.545499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.057034+0000","last_change":"2024-09-14T12:10:31.057034+0000","last_active":"2024-09-14T12:10:31.057034+0000","last_peered":"2024-09-14T12:10:31.057034+0000","last_clean":"2024-09-14T12:10:31.057034+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:10:31.057034+0000","last_undegraded":"2024-09-14T12:10:31.057034+0000","last_fullsized":"2024-09-14T12:10:31.057034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:31.056932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:31.056932+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.056932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:54.148855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'216","reported_seq":1696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.529583+0000","last_change":"2024-09-14T12:10:35.529583+0000","last_active":"2024-09-14T12:10:35.529583+0000","last_peered":"2024-09-14T12:10:35.529583+0000","last_clean":"2024-09-14T12:10:35.529583+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:10:35.529583+0000","last_undegraded":"2024-09-14T12:10:35.529583+0000","last_fullsized":"2024-09-14T12:10:35.529583+0000","mapping_epoch":35,"log_start":"265'201","ondisk_log_start":"265'201","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'216","last_scrub_stamp":"2024-09-14T12:10:35.529481+0000","last_deep_scrub":"265'216","last_deep_scrub_stamp":"2024-09-14T12:10:35.529481+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.529481+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":201,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.632377+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.885591+0000","last_change":"2024-09-14T12:10:08.885591+0000","last_active":"2024-09-14T12:10:08.885591+0000","last_peered":"2024-09-14T12:10:08.885591+0000","last_clean":"2024-09-14T12:10:08.885591+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:10:08.885591+0000","last_undegraded":"2024-09-14T12:10:08.885591+0000","last_fullsized":"2024-09-14T12:10:08.885591+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.885498+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:11.730545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'348","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.083183+0000","last_change":"2024-09-14T12:10:04.083183+0000","last_active":"2024-09-14T12:10:04.083183+0000","last_peered":"2024-09-14T12:10:04.083183+0000","last_clean":"2024-09-14T12:10:04.083183+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:10:04.083183+0000","last_undegraded":"2024-09-14T12:10:04.083183+0000","last_fullsized":"2024-09-14T12:10:04.083183+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.083077+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:38.782611+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":4572,"num_write":1085,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.789830+0000","last_change":"2024-09-14T12:10:16.789830+0000","last_active":"2024-09-14T12:10:16.789830+0000","last_peered":"2024-09-14T12:10:16.789830+0000","last_clean":"2024-09-14T12:10:16.789830+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:10:16.789830+0000","last_undegraded":"2024-09-14T12:10:16.789830+0000","last_fullsized":"2024-09-14T12:10:16.789830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.789746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:21.212395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'311","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.104466+0000","last_change":"2024-09-14T12:10:29.104466+0000","last_active":"2024-09-14T12:10:29.104466+0000","last_peered":"2024-09-14T12:10:29.104466+0000","last_clean":"2024-09-14T12:10:29.104466+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:10:29.104466+0000","last_undegraded":"2024-09-14T12:10:29.104466+0000","last_fullsized":"2024-09-14T12:10:29.104466+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-14T12:10:29.104374+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-14T12:10:29.104374+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.104374+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:59.515158+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.186869+0000","last_change":"2024-09-14T12:10:36.186869+0000","last_active":"2024-09-14T12:10:36.186869+0000","last_peered":"2024-09-14T12:10:36.186869+0000","last_clean":"2024-09-14T12:10:36.186869+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:10:36.186869+0000","last_undegraded":"2024-09-14T12:10:36.186869+0000","last_fullsized":"2024-09-14T12:10:36.186869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:36.186785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:36.186785+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.186785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.512864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'133","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.022815+0000","last_change":"2024-09-14T12:10:32.022815+0000","last_active":"2024-09-14T12:10:32.022815+0000","last_peered":"2024-09-14T12:10:32.022815+0000","last_clean":"2024-09-14T12:10:32.022815+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:10:32.022815+0000","last_undegraded":"2024-09-14T12:10:32.022815+0000","last_fullsized":"2024-09-14T12:10:32.022815+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:32.022721+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:32.022721+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.022721+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:48.560732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.721989+0000","last_change":"2024-09-14T12:10:13.721989+0000","last_active":"2024-09-14T12:10:13.721989+0000","last_peered":"2024-09-14T12:10:13.721989+0000","last_clean":"2024-09-14T12:10:13.721989+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:10:13.721989+0000","last_undegraded":"2024-09-14T12:10:13.721989+0000","last_fullsized":"2024-09-14T12:10:13.721989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.721897+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:48.815645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'310","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.318587+0000","last_change":"2024-09-14T12:10:04.318587+0000","last_active":"2024-09-14T12:10:04.318587+0000","last_peered":"2024-09-14T12:10:04.318587+0000","last_clean":"2024-09-14T12:10:04.318587+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:10:04.318587+0000","last_undegraded":"2024-09-14T12:10:04.318587+0000","last_fullsized":"2024-09-14T12:10:04.318587+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.318456+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:42.943217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":25535,"num_write":1011,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'181","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.772140+0000","last_change":"2024-09-14T12:10:10.772140+0000","last_active":"2024-09-14T12:10:10.772140+0000","last_peered":"2024-09-14T12:10:10.772140+0000","last_clean":"2024-09-14T12:10:10.772140+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:10:10.772140+0000","last_undegraded":"2024-09-14T12:10:10.772140+0000","last_fullsized":"2024-09-14T12:10:10.772140+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'181","last_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_deep_scrub":"265'181","last_deep_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.772052+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.934951+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'354","reported_seq":1089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.544506+0000","last_change":"2024-09-14T12:10:02.544506+0000","last_active":"2024-09-14T12:10:02.544506+0000","last_peered":"2024-09-14T12:10:02.544506+0000","last_clean":"2024-09-14T12:10:02.544506+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:10:02.544506+0000","last_undegraded":"2024-09-14T12:10:02.544506+0000","last_fullsized":"2024-09-14T12:10:02.544506+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.544370+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:51.044659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":943,"num_read_kb":26386,"num_write":1247,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.681166+0000","last_change":"2024-09-14T12:10:16.681166+0000","last_active":"2024-09-14T12:10:16.681166+0000","last_peered":"2024-09-14T12:10:16.681166+0000","last_clean":"2024-09-14T12:10:16.681166+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:10:16.681166+0000","last_undegraded":"2024-09-14T12:10:16.681166+0000","last_fullsized":"2024-09-14T12:10:16.681166+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.681055+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.774592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'349","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.749863+0000","last_change":"2024-09-14T12:10:05.749863+0000","last_active":"2024-09-14T12:10:05.749863+0000","last_peered":"2024-09-14T12:10:05.749863+0000","last_clean":"2024-09-14T12:10:05.749863+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:10:05.749863+0000","last_undegraded":"2024-09-14T12:10:05.749863+0000","last_fullsized":"2024-09-14T12:10:05.749863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.749741+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:29.820426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":18057,"num_write":1029,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.781574+0000","last_change":"2024-09-14T12:10:09.781574+0000","last_active":"2024-09-14T12:10:09.781574+0000","last_peered":"2024-09-14T12:10:09.781574+0000","last_clean":"2024-09-14T12:10:09.781574+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:10:09.781574+0000","last_undegraded":"2024-09-14T12:10:09.781574+0000","last_fullsized":"2024-09-14T12:10:09.781574+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.781479+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:34.531293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'339","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.038240+0000","last_change":"2024-09-14T12:10:03.038240+0000","last_active":"2024-09-14T12:10:03.038240+0000","last_peered":"2024-09-14T12:10:03.038240+0000","last_clean":"2024-09-14T12:10:03.038240+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:10:03.038240+0000","last_undegraded":"2024-09-14T12:10:03.038240+0000","last_fullsized":"2024-09-14T12:10:03.038240+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.038108+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.535266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263498,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":9886,"num_write":1170,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.185314+0000","last_change":"2024-09-14T12:10:16.185314+0000","last_active":"2024-09-14T12:10:16.185314+0000","last_peered":"2024-09-14T12:10:16.185314+0000","last_clean":"2024-09-14T12:10:16.185314+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:10:16.185314+0000","last_undegraded":"2024-09-14T12:10:16.185314+0000","last_fullsized":"2024-09-14T12:10:16.185314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.185216+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:09.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'373","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.015350+0000","last_change":"2024-09-14T12:10:04.015350+0000","last_active":"2024-09-14T12:10:04.015350+0000","last_peered":"2024-09-14T12:10:04.015350+0000","last_clean":"2024-09-14T12:10:04.015350+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:10:04.015350+0000","last_undegraded":"2024-09-14T12:10:04.015350+0000","last_fullsized":"2024-09-14T12:10:04.015350+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.015227+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:44.163154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":11859,"num_write":1346,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'248","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.883633+0000","last_change":"2024-09-14T12:10:12.883633+0000","last_active":"2024-09-14T12:10:12.883633+0000","last_peered":"2024-09-14T12:10:12.883633+0000","last_clean":"2024-09-14T12:10:12.883633+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:10:12.883633+0000","last_undegraded":"2024-09-14T12:10:12.883633+0000","last_fullsized":"2024-09-14T12:10:12.883633+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.883551+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:51.010155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.798328+0000","last_change":"2024-09-14T12:10:03.798328+0000","last_active":"2024-09-14T12:10:03.798328+0000","last_peered":"2024-09-14T12:10:03.798328+0000","last_clean":"2024-09-14T12:10:03.798328+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:10:03.798328+0000","last_undegraded":"2024-09-14T12:10:03.798328+0000","last_fullsized":"2024-09-14T12:10:03.798328+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.798206+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:42.809623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":36459,"num_write":976,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.152436+0000","last_change":"2024-09-14T12:10:15.152436+0000","last_active":"2024-09-14T12:10:15.152436+0000","last_peered":"2024-09-14T12:10:15.152436+0000","last_clean":"2024-09-14T12:10:15.152436+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:10:15.152436+0000","last_undegraded":"2024-09-14T12:10:15.152436+0000","last_fullsized":"2024-09-14T12:10:15.152436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'107","last_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_deep_scrub":"265'107","last_deep_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.152342+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:21.250556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'380","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.594137+0000","last_change":"2024-09-14T12:10:04.594069+0000","last_active":"2024-09-14T12:10:04.594137+0000","last_peered":"2024-09-14T12:10:04.594137+0000","last_clean":"2024-09-14T12:10:04.594137+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:10:04.594137+0000","last_undegraded":"2024-09-14T12:10:04.594137+0000","last_fullsized":"2024-09-14T12:10:04.594137+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.593947+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:28.209010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":129855,"num_write":1253,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.293798+0000","last_change":"2024-09-14T12:10:10.293798+0000","last_active":"2024-09-14T12:10:10.293798+0000","last_peered":"2024-09-14T12:10:10.293798+0000","last_clean":"2024-09-14T12:10:10.293798+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:10:10.293798+0000","last_undegraded":"2024-09-14T12:10:10.293798+0000","last_fullsized":"2024-09-14T12:10:10.293798+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.293666+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:00.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'359","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.079299+0000","last_change":"2024-09-14T12:10:06.079299+0000","last_active":"2024-09-14T12:10:06.079299+0000","last_peered":"2024-09-14T12:10:06.079299+0000","last_clean":"2024-09-14T12:10:06.079299+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:10:06.079299+0000","last_undegraded":"2024-09-14T12:10:06.079299+0000","last_fullsized":"2024-09-14T12:10:06.079299+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.079163+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:31.178991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":616,"num_read_kb":2365,"num_write":1155,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.179101+0000","last_change":"2024-09-14T12:10:13.179101+0000","last_active":"2024-09-14T12:10:13.179101+0000","last_peered":"2024-09-14T12:10:13.179101+0000","last_clean":"2024-09-14T12:10:13.179101+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:10:13.179101+0000","last_undegraded":"2024-09-14T12:10:13.179101+0000","last_fullsized":"2024-09-14T12:10:13.179101+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4110","last_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_deep_scrub":"265'4110","last_deep_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.179000+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:04.053266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.698323+0000","last_change":"2024-09-14T12:10:08.698323+0000","last_active":"2024-09-14T12:10:08.698323+0000","last_peered":"2024-09-14T12:10:08.698323+0000","last_clean":"2024-09-14T12:10:08.698323+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:10:08.698323+0000","last_undegraded":"2024-09-14T12:10:08.698323+0000","last_fullsized":"2024-09-14T12:10:08.698323+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.698222+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:32.447428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":15479,"num_write":1162,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.966499+0000","last_change":"2024-09-14T12:10:14.966499+0000","last_active":"2024-09-14T12:10:14.966499+0000","last_peered":"2024-09-14T12:10:14.966499+0000","last_clean":"2024-09-14T12:10:14.966499+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:10:14.966499+0000","last_undegraded":"2024-09-14T12:10:14.966499+0000","last_fullsized":"2024-09-14T12:10:14.966499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.966397+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:03.981292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'356","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.588883+0000","last_change":"2024-09-14T12:10:05.588883+0000","last_active":"2024-09-14T12:10:05.588883+0000","last_peered":"2024-09-14T12:10:05.588883+0000","last_clean":"2024-09-14T12:10:05.588883+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:10:05.588883+0000","last_undegraded":"2024-09-14T12:10:05.588883+0000","last_fullsized":"2024-09-14T12:10:05.588883+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.588778+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:06.256609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":4745,"num_write":1096,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'456","reported_seq":1148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.620065+0000","last_change":"2024-09-14T12:10:08.620065+0000","last_active":"2024-09-14T12:10:08.620065+0000","last_peered":"2024-09-14T12:10:08.620065+0000","last_clean":"2024-09-14T12:10:08.620065+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:10:08.620065+0000","last_undegraded":"2024-09-14T12:10:08.620065+0000","last_fullsized":"2024-09-14T12:10:08.620065+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.619947+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.459276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'551","reported_seq":1361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.640999+0000","last_change":"2024-09-14T12:10:11.640999+0000","last_active":"2024-09-14T12:10:11.640999+0000","last_peered":"2024-09-14T12:10:11.640999+0000","last_clean":"2024-09-14T12:10:11.640999+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:10:11.640999+0000","last_undegraded":"2024-09-14T12:10:11.640999+0000","last_fullsized":"2024-09-14T12:10:11.640999+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'551","last_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_deep_scrub":"265'551","last_deep_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.640830+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:36.282096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1371,"num_read_kb":53620,"num_write":1733,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'708","reported_seq":1563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.931892+0000","last_change":"2024-09-14T12:10:13.931892+0000","last_active":"2024-09-14T12:10:13.931892+0000","last_peered":"2024-09-14T12:10:13.931892+0000","last_clean":"2024-09-14T12:10:13.931892+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:10:13.931892+0000","last_undegraded":"2024-09-14T12:10:13.931892+0000","last_fullsized":"2024-09-14T12:10:13.931892+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'708","last_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_deep_scrub":"265'708","last_deep_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.931809+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:18.907786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'328","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.060187+0000","last_change":"2024-09-14T12:10:06.060187+0000","last_active":"2024-09-14T12:10:06.060187+0000","last_peered":"2024-09-14T12:10:06.060187+0000","last_clean":"2024-09-14T12:10:06.060187+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:10:06.060187+0000","last_undegraded":"2024-09-14T12:10:06.060187+0000","last_fullsized":"2024-09-14T12:10:06.060187+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.060039+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:17.060911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10603,"num_write":1037,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.485953+0000","last_change":"2024-09-14T12:10:17.485953+0000","last_active":"2024-09-14T12:10:17.485953+0000","last_peered":"2024-09-14T12:10:17.485953+0000","last_clean":"2024-09-14T12:10:17.485953+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:10:17.485953+0000","last_undegraded":"2024-09-14T12:10:17.485953+0000","last_fullsized":"2024-09-14T12:10:17.485953+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.485872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:10.610144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'348","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.246678+0000","last_change":"2024-09-14T12:10:06.246678+0000","last_active":"2024-09-14T12:10:06.246678+0000","last_peered":"2024-09-14T12:10:06.246678+0000","last_clean":"2024-09-14T12:10:06.246678+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:10:06.246678+0000","last_undegraded":"2024-09-14T12:10:06.246678+0000","last_fullsized":"2024-09-14T12:10:06.246678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.246522+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:24.006671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":12533,"num_write":1141,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.138876+0000","last_change":"2024-09-14T12:10:11.138876+0000","last_active":"2024-09-14T12:10:11.138876+0000","last_peered":"2024-09-14T12:10:11.138876+0000","last_clean":"2024-09-14T12:10:11.138876+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:10:11.138876+0000","last_undegraded":"2024-09-14T12:10:11.138876+0000","last_fullsized":"2024-09-14T12:10:11.138876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.138758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.430506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'401","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.436072+0000","last_change":"2024-09-14T12:10:11.436072+0000","last_active":"2024-09-14T12:10:11.436072+0000","last_peered":"2024-09-14T12:10:11.436072+0000","last_clean":"2024-09-14T12:10:11.436072+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:10:11.436072+0000","last_undegraded":"2024-09-14T12:10:11.436072+0000","last_fullsized":"2024-09-14T12:10:11.436072+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.435967+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.312166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":13606,"num_write":1190,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.197307+0000","last_change":"2024-09-14T12:10:17.197307+0000","last_active":"2024-09-14T12:10:17.197307+0000","last_peered":"2024-09-14T12:10:17.197307+0000","last_clean":"2024-09-14T12:10:17.197307+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:10:17.197307+0000","last_undegraded":"2024-09-14T12:10:17.197307+0000","last_fullsized":"2024-09-14T12:10:17.197307+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.197213+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:00.401598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.636571+0000","last_change":"2024-09-14T12:10:07.636571+0000","last_active":"2024-09-14T12:10:07.636571+0000","last_peered":"2024-09-14T12:10:07.636571+0000","last_clean":"2024-09-14T12:10:07.636571+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:10:07.636571+0000","last_undegraded":"2024-09-14T12:10:07.636571+0000","last_fullsized":"2024-09-14T12:10:07.636571+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.636466+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:24.340392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":59967,"num_write":1134,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'394","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.458471+0000","last_change":"2024-09-14T12:10:15.458471+0000","last_active":"2024-09-14T12:10:15.458471+0000","last_peered":"2024-09-14T12:10:15.458471+0000","last_clean":"2024-09-14T12:10:15.458471+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:10:15.458471+0000","last_undegraded":"2024-09-14T12:10:15.458471+0000","last_fullsized":"2024-09-14T12:10:15.458471+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.458379+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:39.482027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3561,"num_omap_keys":15,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'331","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.715505+0000","last_change":"2024-09-14T12:10:07.715505+0000","last_active":"2024-09-14T12:10:07.715505+0000","last_peered":"2024-09-14T12:10:07.715505+0000","last_clean":"2024-09-14T12:10:07.715505+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:10:07.715505+0000","last_undegraded":"2024-09-14T12:10:07.715505+0000","last_fullsized":"2024-09-14T12:10:07.715505+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.715389+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:27.252175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":22222,"num_write":1088,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'360","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.634166+0000","last_change":"2024-09-14T12:10:10.634166+0000","last_active":"2024-09-14T12:10:10.634166+0000","last_peered":"2024-09-14T12:10:10.634166+0000","last_clean":"2024-09-14T12:10:10.634166+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:10:10.634166+0000","last_undegraded":"2024-09-14T12:10:10.634166+0000","last_fullsized":"2024-09-14T12:10:10.634166+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.634055+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:17.564902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":41589,"num_write":1192,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.262913+0000","last_change":"2024-09-14T12:10:15.262913+0000","last_active":"2024-09-14T12:10:15.262913+0000","last_peered":"2024-09-14T12:10:15.262913+0000","last_clean":"2024-09-14T12:10:15.262913+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:10:15.262913+0000","last_undegraded":"2024-09-14T12:10:15.262913+0000","last_fullsized":"2024-09-14T12:10:15.262913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'88","last_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_deep_scrub":"265'88","last_deep_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.262821+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:29.014884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'467","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.799973+0000","last_change":"2024-09-14T12:10:06.799973+0000","last_active":"2024-09-14T12:10:06.799973+0000","last_peered":"2024-09-14T12:10:06.799973+0000","last_clean":"2024-09-14T12:10:06.799973+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:10:06.799973+0000","last_undegraded":"2024-09-14T12:10:06.799973+0000","last_fullsized":"2024-09-14T12:10:06.799973+0000","mapping_epoch":38,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'467","last_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_deep_scrub":"265'467","last_deep_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.799866+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.839357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":936,"num_read_kb":7353,"num_write":1336,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.681579+0000","last_change":"2024-09-14T12:10:18.681579+0000","last_active":"2024-09-14T12:10:18.681579+0000","last_peered":"2024-09-14T12:10:18.681579+0000","last_clean":"2024-09-14T12:10:18.681579+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:10:18.681579+0000","last_undegraded":"2024-09-14T12:10:18.681579+0000","last_fullsized":"2024-09-14T12:10:18.681579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.681470+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:22.840994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1579,"ondisk_log_size":1579,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":600,"ondisk_log_size":600,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1638457,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":18085,"num_read_kb":37656,"num_write":15239,"num_write_kb":11977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713492,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36258,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4345,"ondisk_log_size":4345,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":32687811,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44407,"num_read_kb":2049088,"num_write":73495,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50442240,"data_stored":50442240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3782,"ondisk_log_size":3782,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":224799,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":204319,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510169,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280296,"kb_used_data":10328,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94091544,"statfs":{"total":96636764160,"available":96349741056,"internally_reserved":0,"allocated":10575872,"data_stored":8512576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510169,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149360,"kb_used_data":9952,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":10190848,"data_stored":8104359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510169,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258536,"kb_used_data":14936,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94113304,"statfs":{"total":96636764160,"available":96372023296,"internally_reserved":0,"allocated":15294464,"data_stored":13168761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542872,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300892,"kb_used_data":12876,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94070948,"statfs":{"total":96636764160,"available":96328650752,"internally_reserved":0,"allocated":13185024,"data_stored":11050510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":294910411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542873,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144132,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94227708,"statfs":{"total":96636764160,"available":96489172992,"internally_reserved":0,"allocated":9097216,"data_stored":6957133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542871,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130672,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94241168,"statfs":{"total":96636764160,"available":96502956032,"internally_reserved":0,"allocated":15171584,"data_stored":13135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542873,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280256,"kb_used_data":6192,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94091584,"statfs":{"total":96636764160,"available":96349782016,"internally_reserved":0,"allocated":6340608,"data_stored":4233902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542873,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91908,"kb_used_data":6644,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279932,"statfs":{"total":96636764160,"available":96542650368,"internally_reserved":0,"allocated":6803456,"data_stored":4759690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10289152,"data_stored":10289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":5816320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2473984,"data_stored":2473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":1945600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10850304,"data_stored":10850304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4669440,"data_stored":4669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8171520,"data_stored":8171520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:11:02.875 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:11:02.876 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:44:24.326051+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=44, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=12, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T12:11:02.879 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:11:22.880 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:11:23.229 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-09-14T12:11:23.240 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-09-14T12:11:23.242 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":2079,"stamp":"2024-09-14T12:11:22.881944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34933529,"num_objects":607,"num_object_clones":0,"num_object_copies":1495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":607,"num_whiteouts":0,"num_read":199663,"num_read_kb":2633567,"num_write":147738,"num_write_kb":2509949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":753463,"num_omap_keys":1808,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13611,"ondisk_log_size":13611,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1636052,"kb_used_data":84628,"kb_used_omap":12,"kb_used_meta":1551283,"kb_avail":753338668,"statfs":{"total":773094113280,"available":771418796032,"internally_reserved":0,"allocated":86659072,"data_stored":69922534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1588514353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005791"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.732870+0000","last_change":"2024-09-14T12:10:48.732870+0000","last_active":"2024-09-14T12:10:48.732870+0000","last_peered":"2024-09-14T12:10:48.732870+0000","last_clean":"2024-09-14T12:10:48.732870+0000","last_became_active":"2024-09-14T11:44:25.351464+0000","last_became_peered":"2024-09-14T11:44:25.351464+0000","last_unstale":"2024-09-14T12:10:48.732870+0000","last_undegraded":"2024-09-14T12:10:48.732870+0000","last_fullsized":"2024-09-14T12:10:48.732870+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.732774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.732774+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.732774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:45.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.773179+0000","last_change":"2024-09-14T12:10:47.773085+0000","last_active":"2024-09-14T12:10:47.773179+0000","last_peered":"2024-09-14T12:10:47.773179+0000","last_clean":"2024-09-14T12:10:47.773179+0000","last_became_active":"2024-09-14T11:28:36.255056+0000","last_became_peered":"2024-09-14T11:28:36.255056+0000","last_unstale":"2024-09-14T12:10:47.773179+0000","last_undegraded":"2024-09-14T12:10:47.773179+0000","last_fullsized":"2024-09-14T12:10:47.773179+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:47.772990+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:47.772990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.772990+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:56.977187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.003919+0000","last_change":"2024-09-14T12:10:48.003809+0000","last_active":"2024-09-14T12:10:48.003919+0000","last_peered":"2024-09-14T12:10:48.003919+0000","last_clean":"2024-09-14T12:10:48.003919+0000","last_became_active":"2024-09-14T11:28:33.234054+0000","last_became_peered":"2024-09-14T11:28:33.234054+0000","last_unstale":"2024-09-14T12:10:48.003919+0000","last_undegraded":"2024-09-14T12:10:48.003919+0000","last_fullsized":"2024-09-14T12:10:48.003919+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.003712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.003712+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.003712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:11.452983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'11","reported_seq":95,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.162969+0000","last_change":"2024-09-14T12:10:44.162909+0000","last_active":"2024-09-14T12:10:44.162969+0000","last_peered":"2024-09-14T12:10:44.162969+0000","last_clean":"2024-09-14T12:10:44.162969+0000","last_became_active":"2024-09-14T11:25:27.952167+0000","last_became_peered":"2024-09-14T11:25:27.952167+0000","last_unstale":"2024-09-14T12:10:44.162969+0000","last_undegraded":"2024-09-14T12:10:44.162969+0000","last_fullsized":"2024-09-14T12:10:44.162969+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-14T12:10:44.162818+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-14T12:10:44.162818+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.162818+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:06.535957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":46,"num_write":35,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.669413+0000","last_change":"2024-09-14T12:10:33.669413+0000","last_active":"2024-09-14T12:10:33.669413+0000","last_peered":"2024-09-14T12:10:33.669413+0000","last_clean":"2024-09-14T12:10:33.669413+0000","last_became_active":"2024-09-14T11:44:25.353427+0000","last_became_peered":"2024-09-14T11:44:25.353427+0000","last_unstale":"2024-09-14T12:10:33.669413+0000","last_undegraded":"2024-09-14T12:10:33.669413+0000","last_fullsized":"2024-09-14T12:10:33.669413+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:33.669320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:33.669320+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.669320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:15.038665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.201848+0000","last_change":"2024-09-14T12:10:47.201787+0000","last_active":"2024-09-14T12:10:47.201848+0000","last_peered":"2024-09-14T12:10:47.201848+0000","last_clean":"2024-09-14T12:10:47.201848+0000","last_became_active":"2024-09-14T11:28:36.260229+0000","last_became_peered":"2024-09-14T11:28:36.260229+0000","last_unstale":"2024-09-14T12:10:47.201848+0000","last_undegraded":"2024-09-14T12:10:47.201848+0000","last_fullsized":"2024-09-14T12:10:47.201848+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:47.201688+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:47.201688+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.201688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:07.152706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.981641+0000","last_change":"2024-09-14T12:10:35.981579+0000","last_active":"2024-09-14T12:10:35.981641+0000","last_peered":"2024-09-14T12:10:35.981641+0000","last_clean":"2024-09-14T12:10:35.981641+0000","last_became_active":"2024-09-14T11:28:33.226167+0000","last_became_peered":"2024-09-14T11:28:33.226167+0000","last_unstale":"2024-09-14T12:10:35.981641+0000","last_undegraded":"2024-09-14T12:10:35.981641+0000","last_fullsized":"2024-09-14T12:10:35.981641+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:35.981488+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:35.981488+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.981488+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:20.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'59","reported_seq":223,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.698899+0000","last_change":"2024-09-14T12:10:24.698899+0000","last_active":"2024-09-14T12:10:24.698899+0000","last_peered":"2024-09-14T12:10:24.698899+0000","last_clean":"2024-09-14T12:10:24.698899+0000","last_became_active":"2024-09-14T11:25:27.950617+0000","last_became_peered":"2024-09-14T11:25:27.950617+0000","last_unstale":"2024-09-14T12:10:24.698899+0000","last_undegraded":"2024-09-14T12:10:24.698899+0000","last_fullsized":"2024-09-14T12:10:24.698899+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-14T12:10:24.698806+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-14T12:10:24.698806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.698806+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:23.603844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":465,"num_read_kb":315,"num_write":142,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.638119+0000","last_change":"2024-09-14T12:10:37.638057+0000","last_active":"2024-09-14T12:10:37.638119+0000","last_peered":"2024-09-14T12:10:37.638119+0000","last_clean":"2024-09-14T12:10:37.638119+0000","last_became_active":"2024-09-14T11:44:25.347365+0000","last_became_peered":"2024-09-14T11:44:25.347365+0000","last_unstale":"2024-09-14T12:10:37.638119+0000","last_undegraded":"2024-09-14T12:10:37.638119+0000","last_fullsized":"2024-09-14T12:10:37.638119+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:37.637968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:37.637968+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.637968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:47.338696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'14","reported_seq":78,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:52.156170+0000","last_change":"2024-09-14T12:10:52.156170+0000","last_active":"2024-09-14T12:10:52.156170+0000","last_peered":"2024-09-14T12:10:52.156170+0000","last_clean":"2024-09-14T12:10:52.156170+0000","last_became_active":"2024-09-14T11:28:36.366958+0000","last_became_peered":"2024-09-14T11:28:36.366958+0000","last_unstale":"2024-09-14T12:10:52.156170+0000","last_undegraded":"2024-09-14T12:10:52.156170+0000","last_fullsized":"2024-09-14T12:10:52.156170+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:52.156068+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:52.156068+0000","last_clean_scrub_stamp":"2024-09-14T12:10:52.156068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:11.091528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":33792,"num_write":24,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.681455+0000","last_change":"2024-09-14T12:10:29.681373+0000","last_active":"2024-09-14T12:10:29.681455+0000","last_peered":"2024-09-14T12:10:29.681455+0000","last_clean":"2024-09-14T12:10:29.681455+0000","last_became_active":"2024-09-14T11:28:33.225946+0000","last_became_peered":"2024-09-14T11:28:33.225946+0000","last_unstale":"2024-09-14T12:10:29.681455+0000","last_undegraded":"2024-09-14T12:10:29.681455+0000","last_fullsized":"2024-09-14T12:10:29.681455+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.681271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.681271+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.681271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:16.281265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'165","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.196490+0000","last_change":"2024-09-14T12:10:42.196490+0000","last_active":"2024-09-14T12:10:42.196490+0000","last_peered":"2024-09-14T12:10:42.196490+0000","last_clean":"2024-09-14T12:10:42.196490+0000","last_became_active":"2024-09-14T11:25:27.939778+0000","last_became_peered":"2024-09-14T11:25:27.939778+0000","last_unstale":"2024-09-14T12:10:42.196490+0000","last_undegraded":"2024-09-14T12:10:42.196490+0000","last_fullsized":"2024-09-14T12:10:42.196490+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'165","last_scrub_stamp":"2024-09-14T12:10:42.196410+0000","last_deep_scrub":"265'165","last_deep_scrub_stamp":"2024-09-14T12:10:42.196410+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.196410+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:38.694889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1440,"num_read_kb":1376,"num_write":349,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:58.895544+0000","last_change":"2024-09-14T12:10:58.895480+0000","last_active":"2024-09-14T12:10:58.895544+0000","last_peered":"2024-09-14T12:10:58.895544+0000","last_clean":"2024-09-14T12:10:58.895544+0000","last_became_active":"2024-09-14T11:44:25.355419+0000","last_became_peered":"2024-09-14T11:44:25.355419+0000","last_unstale":"2024-09-14T12:10:58.895544+0000","last_undegraded":"2024-09-14T12:10:58.895544+0000","last_fullsized":"2024-09-14T12:10:58.895544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:58.895381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:58.895381+0000","last_clean_scrub_stamp":"2024-09-14T12:10:58.895381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:35.930184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:54.932684+0000","last_change":"2024-09-14T12:10:54.932684+0000","last_active":"2024-09-14T12:10:54.932684+0000","last_peered":"2024-09-14T12:10:54.932684+0000","last_clean":"2024-09-14T12:10:54.932684+0000","last_became_active":"2024-09-14T11:28:36.365764+0000","last_became_peered":"2024-09-14T11:28:36.365764+0000","last_unstale":"2024-09-14T12:10:54.932684+0000","last_undegraded":"2024-09-14T12:10:54.932684+0000","last_fullsized":"2024-09-14T12:10:54.932684+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:54.932569+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:54.932569+0000","last_clean_scrub_stamp":"2024-09-14T12:10:54.932569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:45.838836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'2","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.107357+0000","last_change":"2024-09-14T12:10:42.107357+0000","last_active":"2024-09-14T12:10:42.107357+0000","last_peered":"2024-09-14T12:10:42.107357+0000","last_clean":"2024-09-14T12:10:42.107357+0000","last_became_active":"2024-09-14T11:28:33.228304+0000","last_became_peered":"2024-09-14T11:28:33.228304+0000","last_unstale":"2024-09-14T12:10:42.107357+0000","last_undegraded":"2024-09-14T12:10:42.107357+0000","last_fullsized":"2024-09-14T12:10:42.107357+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:42.107240+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:42.107240+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.107240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:09.779063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'52","reported_seq":205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.044244+0000","last_change":"2024-09-14T12:10:45.044244+0000","last_active":"2024-09-14T12:10:45.044244+0000","last_peered":"2024-09-14T12:10:45.044244+0000","last_clean":"2024-09-14T12:10:45.044244+0000","last_became_active":"2024-09-14T11:25:27.952783+0000","last_became_peered":"2024-09-14T11:25:27.952783+0000","last_unstale":"2024-09-14T12:10:45.044244+0000","last_undegraded":"2024-09-14T12:10:45.044244+0000","last_fullsized":"2024-09-14T12:10:45.044244+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T12:10:45.044151+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T12:10:45.044151+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.044151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:42.946720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":425,"num_read_kb":281,"num_write":132,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:11:00.977763+0000","last_change":"2024-09-14T12:11:00.977763+0000","last_active":"2024-09-14T12:11:00.977763+0000","last_peered":"2024-09-14T12:11:00.977763+0000","last_clean":"2024-09-14T12:11:00.977763+0000","last_became_active":"2024-09-14T11:44:25.354776+0000","last_became_peered":"2024-09-14T11:44:25.354776+0000","last_unstale":"2024-09-14T12:11:00.977763+0000","last_undegraded":"2024-09-14T12:11:00.977763+0000","last_fullsized":"2024-09-14T12:11:00.977763+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:11:00.977666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:11:00.977666+0000","last_clean_scrub_stamp":"2024-09-14T12:11:00.977666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:55.730502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.693157+0000","last_change":"2024-09-14T12:10:45.693157+0000","last_active":"2024-09-14T12:10:45.693157+0000","last_peered":"2024-09-14T12:10:45.693157+0000","last_clean":"2024-09-14T12:10:45.693157+0000","last_became_active":"2024-09-14T11:28:36.258824+0000","last_became_peered":"2024-09-14T11:28:36.258824+0000","last_unstale":"2024-09-14T12:10:45.693157+0000","last_undegraded":"2024-09-14T12:10:45.693157+0000","last_fullsized":"2024-09-14T12:10:45.693157+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:45.693075+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:45.693075+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.693075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:38.938774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.148608+0000","last_change":"2024-09-14T12:10:47.148608+0000","last_active":"2024-09-14T12:10:47.148608+0000","last_peered":"2024-09-14T12:10:47.148608+0000","last_clean":"2024-09-14T12:10:47.148608+0000","last_became_active":"2024-09-14T11:28:33.231250+0000","last_became_peered":"2024-09-14T11:28:33.231250+0000","last_unstale":"2024-09-14T12:10:47.148608+0000","last_undegraded":"2024-09-14T12:10:47.148608+0000","last_fullsized":"2024-09-14T12:10:47.148608+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:47.148499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:47.148499+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.148499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:39.688269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'10","reported_seq":89,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.002574+0000","last_change":"2024-09-14T12:10:47.002574+0000","last_active":"2024-09-14T12:10:47.002574+0000","last_peered":"2024-09-14T12:10:47.002574+0000","last_clean":"2024-09-14T12:10:47.002574+0000","last_became_active":"2024-09-14T11:25:27.952133+0000","last_became_peered":"2024-09-14T11:25:27.952133+0000","last_unstale":"2024-09-14T12:10:47.002574+0000","last_undegraded":"2024-09-14T12:10:47.002574+0000","last_fullsized":"2024-09-14T12:10:47.002574+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-14T12:10:47.002485+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-14T12:10:47.002485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.002485+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:22.206649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":53,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.011252+0000","last_change":"2024-09-14T12:10:40.011252+0000","last_active":"2024-09-14T12:10:40.011252+0000","last_peered":"2024-09-14T12:10:40.011252+0000","last_clean":"2024-09-14T12:10:40.011252+0000","last_became_active":"2024-09-14T11:44:25.349002+0000","last_became_peered":"2024-09-14T11:44:25.349002+0000","last_unstale":"2024-09-14T12:10:40.011252+0000","last_undegraded":"2024-09-14T12:10:40.011252+0000","last_fullsized":"2024-09-14T12:10:40.011252+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:40.011161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:40.011161+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.011161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.352660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.627784+0000","last_change":"2024-09-14T12:10:34.627784+0000","last_active":"2024-09-14T12:10:34.627784+0000","last_peered":"2024-09-14T12:10:34.627784+0000","last_clean":"2024-09-14T12:10:34.627784+0000","last_became_active":"2024-09-14T11:28:36.258998+0000","last_became_peered":"2024-09-14T11:28:36.258998+0000","last_unstale":"2024-09-14T12:10:34.627784+0000","last_undegraded":"2024-09-14T12:10:34.627784+0000","last_fullsized":"2024-09-14T12:10:34.627784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:34.627690+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:34.627690+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.627690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:11.119124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.072812+0000","last_change":"2024-09-14T12:10:41.072812+0000","last_active":"2024-09-14T12:10:41.072812+0000","last_peered":"2024-09-14T12:10:41.072812+0000","last_clean":"2024-09-14T12:10:41.072812+0000","last_became_active":"2024-09-14T11:28:33.227357+0000","last_became_peered":"2024-09-14T11:28:33.227357+0000","last_unstale":"2024-09-14T12:10:41.072812+0000","last_undegraded":"2024-09-14T12:10:41.072812+0000","last_fullsized":"2024-09-14T12:10:41.072812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:41.072718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:41.072718+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.072718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:12.565892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"262'16","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.472213+0000","last_change":"2024-09-14T12:10:27.472153+0000","last_active":"2024-09-14T12:10:27.472213+0000","last_peered":"2024-09-14T12:10:27.472213+0000","last_clean":"2024-09-14T12:10:27.472213+0000","last_became_active":"2024-09-14T11:25:27.951029+0000","last_became_peered":"2024-09-14T11:25:27.951029+0000","last_unstale":"2024-09-14T12:10:27.472213+0000","last_undegraded":"2024-09-14T12:10:27.472213+0000","last_fullsized":"2024-09-14T12:10:27.472213+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'16","last_scrub_stamp":"2024-09-14T12:10:27.472026+0000","last_deep_scrub":"262'16","last_deep_scrub_stamp":"2024-09-14T12:10:27.472026+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.472026+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:49.059641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":43,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:57.494333+0000","last_change":"2024-09-14T12:10:57.494333+0000","last_active":"2024-09-14T12:10:57.494333+0000","last_peered":"2024-09-14T12:10:57.494333+0000","last_clean":"2024-09-14T12:10:57.494333+0000","last_became_active":"2024-09-14T11:44:25.352198+0000","last_became_peered":"2024-09-14T11:44:25.352198+0000","last_unstale":"2024-09-14T12:10:57.494333+0000","last_undegraded":"2024-09-14T12:10:57.494333+0000","last_fullsized":"2024-09-14T12:10:57.494333+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:57.494250+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:57.494250+0000","last_clean_scrub_stamp":"2024-09-14T12:10:57.494250+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:50.748882+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"262'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.634797+0000","last_change":"2024-09-14T12:10:35.634693+0000","last_active":"2024-09-14T12:10:35.634797+0000","last_peered":"2024-09-14T12:10:35.634797+0000","last_clean":"2024-09-14T12:10:35.634797+0000","last_became_active":"2024-09-14T11:28:36.260766+0000","last_became_peered":"2024-09-14T11:28:36.260766+0000","last_unstale":"2024-09-14T12:10:35.634797+0000","last_undegraded":"2024-09-14T12:10:35.634797+0000","last_fullsized":"2024-09-14T12:10:35.634797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:35.634583+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:35.634583+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.634583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:42.017222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'9","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.030787+0000","last_change":"2024-09-14T12:10:40.030648+0000","last_active":"2024-09-14T12:10:40.030787+0000","last_peered":"2024-09-14T12:10:40.030787+0000","last_clean":"2024-09-14T12:10:40.030787+0000","last_became_active":"2024-09-14T11:28:33.231511+0000","last_became_peered":"2024-09-14T11:28:33.231511+0000","last_unstale":"2024-09-14T12:10:40.030787+0000","last_undegraded":"2024-09-14T12:10:40.030787+0000","last_fullsized":"2024-09-14T12:10:40.030787+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T12:10:40.030520+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T12:10:40.030520+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.030520+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:04.933574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16384,"num_write":9,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'42","reported_seq":167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.235452+0000","last_change":"2024-09-14T12:10:40.235452+0000","last_active":"2024-09-14T12:10:40.235452+0000","last_peered":"2024-09-14T12:10:40.235452+0000","last_clean":"2024-09-14T12:10:40.235452+0000","last_became_active":"2024-09-14T11:25:27.946644+0000","last_became_peered":"2024-09-14T11:25:27.946644+0000","last_unstale":"2024-09-14T12:10:40.235452+0000","last_undegraded":"2024-09-14T12:10:40.235452+0000","last_fullsized":"2024-09-14T12:10:40.235452+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-14T12:10:40.235367+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-14T12:10:40.235367+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.235367+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:55.287767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":188,"num_write":121,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:56.486040+0000","last_change":"2024-09-14T12:10:56.486040+0000","last_active":"2024-09-14T12:10:56.486040+0000","last_peered":"2024-09-14T12:10:56.486040+0000","last_clean":"2024-09-14T12:10:56.486040+0000","last_became_active":"2024-09-14T11:44:25.355072+0000","last_became_peered":"2024-09-14T11:44:25.355072+0000","last_unstale":"2024-09-14T12:10:56.486040+0000","last_undegraded":"2024-09-14T12:10:56.486040+0000","last_fullsized":"2024-09-14T12:10:56.486040+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:56.485940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:56.485940+0000","last_clean_scrub_stamp":"2024-09-14T12:10:56.485940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:20.362943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:53.934264+0000","last_change":"2024-09-14T12:10:53.934186+0000","last_active":"2024-09-14T12:10:53.934264+0000","last_peered":"2024-09-14T12:10:53.934264+0000","last_clean":"2024-09-14T12:10:53.934264+0000","last_became_active":"2024-09-14T11:28:36.254398+0000","last_became_peered":"2024-09-14T11:28:36.254398+0000","last_unstale":"2024-09-14T12:10:53.934264+0000","last_undegraded":"2024-09-14T12:10:53.934264+0000","last_fullsized":"2024-09-14T12:10:53.934264+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:53.934099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:53.934099+0000","last_clean_scrub_stamp":"2024-09-14T12:10:53.934099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:47.372149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"262'3","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:51.195701+0000","last_change":"2024-09-14T12:10:51.195606+0000","last_active":"2024-09-14T12:10:51.195701+0000","last_peered":"2024-09-14T12:10:51.195701+0000","last_clean":"2024-09-14T12:10:51.195701+0000","last_became_active":"2024-09-14T11:28:33.230318+0000","last_became_peered":"2024-09-14T11:28:33.230318+0000","last_unstale":"2024-09-14T12:10:51.195701+0000","last_undegraded":"2024-09-14T12:10:51.195701+0000","last_fullsized":"2024-09-14T12:10:51.195701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:51.195508+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:51.195508+0000","last_clean_scrub_stamp":"2024-09-14T12:10:51.195508+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:17.288233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'52","reported_seq":207,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.894280+0000","last_change":"2024-09-14T12:10:26.894280+0000","last_active":"2024-09-14T12:10:26.894280+0000","last_peered":"2024-09-14T12:10:26.894280+0000","last_clean":"2024-09-14T12:10:26.894280+0000","last_became_active":"2024-09-14T11:25:27.942280+0000","last_became_peered":"2024-09-14T11:25:27.942280+0000","last_unstale":"2024-09-14T12:10:26.894280+0000","last_undegraded":"2024-09-14T12:10:26.894280+0000","last_fullsized":"2024-09-14T12:10:26.894280+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-14T12:10:26.894190+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-14T12:10:26.894190+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.894190+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:35.886806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":333,"num_write":122,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.052903+0000","last_change":"2024-09-14T12:10:41.052903+0000","last_active":"2024-09-14T12:10:41.052903+0000","last_peered":"2024-09-14T12:10:41.052903+0000","last_clean":"2024-09-14T12:10:41.052903+0000","last_became_active":"2024-09-14T11:44:25.351439+0000","last_became_peered":"2024-09-14T11:44:25.351439+0000","last_unstale":"2024-09-14T12:10:41.052903+0000","last_undegraded":"2024-09-14T12:10:41.052903+0000","last_fullsized":"2024-09-14T12:10:41.052903+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:41.052796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:41.052796+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.052796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:11.933831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:52.973939+0000","last_change":"2024-09-14T12:10:52.973939+0000","last_active":"2024-09-14T12:10:52.973939+0000","last_peered":"2024-09-14T12:10:52.973939+0000","last_clean":"2024-09-14T12:10:52.973939+0000","last_became_active":"2024-09-14T11:28:36.368448+0000","last_became_peered":"2024-09-14T11:28:36.368448+0000","last_unstale":"2024-09-14T12:10:52.973939+0000","last_undegraded":"2024-09-14T12:10:52.973939+0000","last_fullsized":"2024-09-14T12:10:52.973939+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:52.973848+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:52.973848+0000","last_clean_scrub_stamp":"2024-09-14T12:10:52.973848+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:56.351575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"262'5","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.625892+0000","last_change":"2024-09-14T12:10:42.625892+0000","last_active":"2024-09-14T12:10:42.625892+0000","last_peered":"2024-09-14T12:10:42.625892+0000","last_clean":"2024-09-14T12:10:42.625892+0000","last_became_active":"2024-09-14T11:28:33.230981+0000","last_became_peered":"2024-09-14T11:28:33.230981+0000","last_unstale":"2024-09-14T12:10:42.625892+0000","last_undegraded":"2024-09-14T12:10:42.625892+0000","last_fullsized":"2024-09-14T12:10:42.625892+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:42.625803+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:42.625803+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.625803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:55:14.610136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'36","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.205010+0000","last_change":"2024-09-14T12:10:41.205010+0000","last_active":"2024-09-14T12:10:41.205010+0000","last_peered":"2024-09-14T12:10:41.205010+0000","last_clean":"2024-09-14T12:10:41.205010+0000","last_became_active":"2024-09-14T11:25:27.949695+0000","last_became_peered":"2024-09-14T11:25:27.949695+0000","last_unstale":"2024-09-14T12:10:41.205010+0000","last_undegraded":"2024-09-14T12:10:41.205010+0000","last_fullsized":"2024-09-14T12:10:41.205010+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-14T12:10:41.204917+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-14T12:10:41.204917+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.204917+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:24.550925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":178,"num_write":90,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.666439+0000","last_change":"2024-09-14T12:10:32.666439+0000","last_active":"2024-09-14T12:10:32.666439+0000","last_peered":"2024-09-14T12:10:32.666439+0000","last_clean":"2024-09-14T12:10:32.666439+0000","last_became_active":"2024-09-14T11:44:25.346230+0000","last_became_peered":"2024-09-14T11:44:25.346230+0000","last_unstale":"2024-09-14T12:10:32.666439+0000","last_undegraded":"2024-09-14T12:10:32.666439+0000","last_fullsized":"2024-09-14T12:10:32.666439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:32.666336+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:32.666336+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.666336+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.413521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:51.923723+0000","last_change":"2024-09-14T12:10:51.923723+0000","last_active":"2024-09-14T12:10:51.923723+0000","last_peered":"2024-09-14T12:10:51.923723+0000","last_clean":"2024-09-14T12:10:51.923723+0000","last_became_active":"2024-09-14T11:28:36.366901+0000","last_became_peered":"2024-09-14T11:28:36.366901+0000","last_unstale":"2024-09-14T12:10:51.923723+0000","last_undegraded":"2024-09-14T12:10:51.923723+0000","last_fullsized":"2024-09-14T12:10:51.923723+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:51.923620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:51.923620+0000","last_clean_scrub_stamp":"2024-09-14T12:10:51.923620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:15.874380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'5","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.552614+0000","last_change":"2024-09-14T12:10:46.552614+0000","last_active":"2024-09-14T12:10:46.552614+0000","last_peered":"2024-09-14T12:10:46.552614+0000","last_clean":"2024-09-14T12:10:46.552614+0000","last_became_active":"2024-09-14T11:28:33.228097+0000","last_became_peered":"2024-09-14T11:28:33.228097+0000","last_unstale":"2024-09-14T12:10:46.552614+0000","last_undegraded":"2024-09-14T12:10:46.552614+0000","last_fullsized":"2024-09-14T12:10:46.552614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:46.552523+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:46.552523+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.552523+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:10.981369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'25","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.133490+0000","last_change":"2024-09-14T12:10:41.133490+0000","last_active":"2024-09-14T12:10:41.133490+0000","last_peered":"2024-09-14T12:10:41.133490+0000","last_clean":"2024-09-14T12:10:41.133490+0000","last_became_active":"2024-09-14T11:25:27.953452+0000","last_became_peered":"2024-09-14T11:25:27.953452+0000","last_unstale":"2024-09-14T12:10:41.133490+0000","last_undegraded":"2024-09-14T12:10:41.133490+0000","last_fullsized":"2024-09-14T12:10:41.133490+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-14T12:10:41.133375+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-14T12:10:41.133375+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.133375+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:39.381972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":190,"num_read_kb":115,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:54.425090+0000","last_change":"2024-09-14T12:10:54.425090+0000","last_active":"2024-09-14T12:10:54.425090+0000","last_peered":"2024-09-14T12:10:54.425090+0000","last_clean":"2024-09-14T12:10:54.425090+0000","last_became_active":"2024-09-14T11:44:25.348307+0000","last_became_peered":"2024-09-14T11:44:25.348307+0000","last_unstale":"2024-09-14T12:10:54.425090+0000","last_undegraded":"2024-09-14T12:10:54.425090+0000","last_fullsized":"2024-09-14T12:10:54.425090+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:54.425003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:54.425003+0000","last_clean_scrub_stamp":"2024-09-14T12:10:54.425003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.181965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"262'8","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:57.895070+0000","last_change":"2024-09-14T12:10:57.895070+0000","last_active":"2024-09-14T12:10:57.895070+0000","last_peered":"2024-09-14T12:10:57.895070+0000","last_clean":"2024-09-14T12:10:57.895070+0000","last_became_active":"2024-09-14T11:28:36.368768+0000","last_became_peered":"2024-09-14T11:28:36.368768+0000","last_unstale":"2024-09-14T12:10:57.895070+0000","last_undegraded":"2024-09-14T12:10:57.895070+0000","last_fullsized":"2024-09-14T12:10:57.895070+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-14T12:10:57.894978+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-14T12:10:57.894978+0000","last_clean_scrub_stamp":"2024-09-14T12:10:57.894978+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:43.771232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.634499+0000","last_change":"2024-09-14T12:10:28.634499+0000","last_active":"2024-09-14T12:10:28.634499+0000","last_peered":"2024-09-14T12:10:28.634499+0000","last_clean":"2024-09-14T12:10:28.634499+0000","last_became_active":"2024-09-14T11:28:33.233063+0000","last_became_peered":"2024-09-14T11:28:33.233063+0000","last_unstale":"2024-09-14T12:10:28.634499+0000","last_undegraded":"2024-09-14T12:10:28.634499+0000","last_fullsized":"2024-09-14T12:10:28.634499+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.634405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.634405+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.634405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:01:48.158772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'34","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.651452+0000","last_change":"2024-09-14T12:10:25.651452+0000","last_active":"2024-09-14T12:10:25.651452+0000","last_peered":"2024-09-14T12:10:25.651452+0000","last_clean":"2024-09-14T12:10:25.651452+0000","last_became_active":"2024-09-14T11:25:27.945438+0000","last_became_peered":"2024-09-14T11:25:27.945438+0000","last_unstale":"2024-09-14T12:10:25.651452+0000","last_undegraded":"2024-09-14T12:10:25.651452+0000","last_fullsized":"2024-09-14T12:10:25.651452+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-14T12:10:25.651333+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-14T12:10:25.651333+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.651333+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:53.805989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":178,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.740972+0000","last_change":"2024-09-14T12:10:46.740972+0000","last_active":"2024-09-14T12:10:46.740972+0000","last_peered":"2024-09-14T12:10:46.740972+0000","last_clean":"2024-09-14T12:10:46.740972+0000","last_became_active":"2024-09-14T11:44:25.352620+0000","last_became_peered":"2024-09-14T11:44:25.352620+0000","last_unstale":"2024-09-14T12:10:46.740972+0000","last_undegraded":"2024-09-14T12:10:46.740972+0000","last_fullsized":"2024-09-14T12:10:46.740972+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:46.740882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:46.740882+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.740882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:59.294038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.123271+0000","last_change":"2024-09-14T12:10:45.123271+0000","last_active":"2024-09-14T12:10:45.123271+0000","last_peered":"2024-09-14T12:10:45.123271+0000","last_clean":"2024-09-14T12:10:45.123271+0000","last_became_active":"2024-09-14T11:28:36.261153+0000","last_became_peered":"2024-09-14T11:28:36.261153+0000","last_unstale":"2024-09-14T12:10:45.123271+0000","last_undegraded":"2024-09-14T12:10:45.123271+0000","last_fullsized":"2024-09-14T12:10:45.123271+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:45.123183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:45.123183+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.123183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:50.598100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'2","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.156538+0000","last_change":"2024-09-14T12:10:48.156538+0000","last_active":"2024-09-14T12:10:48.156538+0000","last_peered":"2024-09-14T12:10:48.156538+0000","last_clean":"2024-09-14T12:10:48.156538+0000","last_became_active":"2024-09-14T11:28:33.226440+0000","last_became_peered":"2024-09-14T11:28:33.226440+0000","last_unstale":"2024-09-14T12:10:48.156538+0000","last_undegraded":"2024-09-14T12:10:48.156538+0000","last_fullsized":"2024-09-14T12:10:48.156538+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:48.156437+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:48.156437+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.156437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:23.656429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"265'37","reported_seq":164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.572988+0000","last_change":"2024-09-14T12:10:40.572988+0000","last_active":"2024-09-14T12:10:40.572988+0000","last_peered":"2024-09-14T12:10:40.572988+0000","last_clean":"2024-09-14T12:10:40.572988+0000","last_became_active":"2024-09-14T11:25:27.950589+0000","last_became_peered":"2024-09-14T11:25:27.950589+0000","last_unstale":"2024-09-14T12:10:40.572988+0000","last_undegraded":"2024-09-14T12:10:40.572988+0000","last_fullsized":"2024-09-14T12:10:40.572988+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'37","last_scrub_stamp":"2024-09-14T12:10:40.572898+0000","last_deep_scrub":"265'37","last_deep_scrub_stamp":"2024-09-14T12:10:40.572898+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.572898+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:40.443983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":195,"num_write":95,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:59.945083+0000","last_change":"2024-09-14T12:10:59.945083+0000","last_active":"2024-09-14T12:10:59.945083+0000","last_peered":"2024-09-14T12:10:59.945083+0000","last_clean":"2024-09-14T12:10:59.945083+0000","last_became_active":"2024-09-14T11:44:25.346108+0000","last_became_peered":"2024-09-14T11:44:25.346108+0000","last_unstale":"2024-09-14T12:10:59.945083+0000","last_undegraded":"2024-09-14T12:10:59.945083+0000","last_fullsized":"2024-09-14T12:10:59.945083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:59.944990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:59.944990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:59.944990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:30.224011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.064545+0000","last_change":"2024-09-14T12:10:38.064545+0000","last_active":"2024-09-14T12:10:38.064545+0000","last_peered":"2024-09-14T12:10:38.064545+0000","last_clean":"2024-09-14T12:10:38.064545+0000","last_became_active":"2024-09-14T11:28:36.257026+0000","last_became_peered":"2024-09-14T11:28:36.257026+0000","last_unstale":"2024-09-14T12:10:38.064545+0000","last_undegraded":"2024-09-14T12:10:38.064545+0000","last_fullsized":"2024-09-14T12:10:38.064545+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:38.064437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:38.064437+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.064437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:11.519442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"262'2","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.076970+0000","last_change":"2024-09-14T12:10:38.076970+0000","last_active":"2024-09-14T12:10:38.076970+0000","last_peered":"2024-09-14T12:10:38.076970+0000","last_clean":"2024-09-14T12:10:38.076970+0000","last_became_active":"2024-09-14T11:28:33.232543+0000","last_became_peered":"2024-09-14T11:28:33.232543+0000","last_unstale":"2024-09-14T12:10:38.076970+0000","last_undegraded":"2024-09-14T12:10:38.076970+0000","last_fullsized":"2024-09-14T12:10:38.076970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:38.076864+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:38.076864+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.076864+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:26.235717+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":529,"num_write":2,"num_write_kb":529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'62","reported_seq":236,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.518682+0000","last_change":"2024-09-14T12:10:38.518682+0000","last_active":"2024-09-14T12:10:38.518682+0000","last_peered":"2024-09-14T12:10:38.518682+0000","last_clean":"2024-09-14T12:10:38.518682+0000","last_became_active":"2024-09-14T11:25:27.949583+0000","last_became_peered":"2024-09-14T11:25:27.949583+0000","last_unstale":"2024-09-14T12:10:38.518682+0000","last_undegraded":"2024-09-14T12:10:38.518682+0000","last_fullsized":"2024-09-14T12:10:38.518682+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'62","last_scrub_stamp":"2024-09-14T12:10:38.518602+0000","last_deep_scrub":"265'62","last_deep_scrub_stamp":"2024-09-14T12:10:38.518602+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.518602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:45.752697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":342,"num_write":148,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:57.165945+0000","last_change":"2024-09-14T12:10:57.165854+0000","last_active":"2024-09-14T12:10:57.165945+0000","last_peered":"2024-09-14T12:10:57.165945+0000","last_clean":"2024-09-14T12:10:57.165945+0000","last_became_active":"2024-09-14T11:44:25.355249+0000","last_became_peered":"2024-09-14T11:44:25.355249+0000","last_unstale":"2024-09-14T12:10:57.165945+0000","last_undegraded":"2024-09-14T12:10:57.165945+0000","last_fullsized":"2024-09-14T12:10:57.165945+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:57.165749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:57.165749+0000","last_clean_scrub_stamp":"2024-09-14T12:10:57.165749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.082241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.015006+0000","last_change":"2024-09-14T12:10:37.015006+0000","last_active":"2024-09-14T12:10:37.015006+0000","last_peered":"2024-09-14T12:10:37.015006+0000","last_clean":"2024-09-14T12:10:37.015006+0000","last_became_active":"2024-09-14T11:28:36.260660+0000","last_became_peered":"2024-09-14T11:28:36.260660+0000","last_unstale":"2024-09-14T12:10:37.015006+0000","last_undegraded":"2024-09-14T12:10:37.015006+0000","last_fullsized":"2024-09-14T12:10:37.015006+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:37.014890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:37.014890+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.014890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.635990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.070235+0000","last_change":"2024-09-14T12:10:44.070235+0000","last_active":"2024-09-14T12:10:44.070235+0000","last_peered":"2024-09-14T12:10:44.070235+0000","last_clean":"2024-09-14T12:10:44.070235+0000","last_became_active":"2024-09-14T11:28:33.229093+0000","last_became_peered":"2024-09-14T11:28:33.229093+0000","last_unstale":"2024-09-14T12:10:44.070235+0000","last_undegraded":"2024-09-14T12:10:44.070235+0000","last_fullsized":"2024-09-14T12:10:44.070235+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:44.070136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:44.070136+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.070136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:35.988653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"262'49","reported_seq":200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.245202+0000","last_change":"2024-09-14T12:10:39.245202+0000","last_active":"2024-09-14T12:10:39.245202+0000","last_peered":"2024-09-14T12:10:39.245202+0000","last_clean":"2024-09-14T12:10:39.245202+0000","last_became_active":"2024-09-14T11:25:27.945243+0000","last_became_peered":"2024-09-14T11:25:27.945243+0000","last_unstale":"2024-09-14T12:10:39.245202+0000","last_undegraded":"2024-09-14T12:10:39.245202+0000","last_fullsized":"2024-09-14T12:10:39.245202+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'49","last_scrub_stamp":"2024-09-14T12:10:39.245115+0000","last_deep_scrub":"262'49","last_deep_scrub_stamp":"2024-09-14T12:10:39.245115+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.245115+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:07.893173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":260,"num_write":121,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:56.208071+0000","last_change":"2024-09-14T12:10:56.208071+0000","last_active":"2024-09-14T12:10:56.208071+0000","last_peered":"2024-09-14T12:10:56.208071+0000","last_clean":"2024-09-14T12:10:56.208071+0000","last_became_active":"2024-09-14T11:44:25.351320+0000","last_became_peered":"2024-09-14T11:44:25.351320+0000","last_unstale":"2024-09-14T12:10:56.208071+0000","last_undegraded":"2024-09-14T12:10:56.208071+0000","last_fullsized":"2024-09-14T12:10:56.208071+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:56.207983+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:56.207983+0000","last_clean_scrub_stamp":"2024-09-14T12:10:56.207983+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:48.860096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:50.934210+0000","last_change":"2024-09-14T12:10:50.934210+0000","last_active":"2024-09-14T12:10:50.934210+0000","last_peered":"2024-09-14T12:10:50.934210+0000","last_clean":"2024-09-14T12:10:50.934210+0000","last_became_active":"2024-09-14T11:28:36.257170+0000","last_became_peered":"2024-09-14T11:28:36.257170+0000","last_unstale":"2024-09-14T12:10:50.934210+0000","last_undegraded":"2024-09-14T12:10:50.934210+0000","last_fullsized":"2024-09-14T12:10:50.934210+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:50.934106+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:50.934106+0000","last_clean_scrub_stamp":"2024-09-14T12:10:50.934106+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:14.700471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'3","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.524514+0000","last_change":"2024-09-14T12:10:30.524447+0000","last_active":"2024-09-14T12:10:30.524514+0000","last_peered":"2024-09-14T12:10:30.524514+0000","last_clean":"2024-09-14T12:10:30.524514+0000","last_became_active":"2024-09-14T11:28:33.226371+0000","last_became_peered":"2024-09-14T11:28:33.226371+0000","last_unstale":"2024-09-14T12:10:30.524514+0000","last_undegraded":"2024-09-14T12:10:30.524514+0000","last_fullsized":"2024-09-14T12:10:30.524514+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:30.524343+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:30.524343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.524343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:49.484368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'14","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.022994+0000","last_change":"2024-09-14T12:10:36.022994+0000","last_active":"2024-09-14T12:10:36.022994+0000","last_peered":"2024-09-14T12:10:36.022994+0000","last_clean":"2024-09-14T12:10:36.022994+0000","last_became_active":"2024-09-14T11:25:27.945791+0000","last_became_peered":"2024-09-14T11:25:27.945791+0000","last_unstale":"2024-09-14T12:10:36.022994+0000","last_undegraded":"2024-09-14T12:10:36.022994+0000","last_fullsized":"2024-09-14T12:10:36.022994+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:36.022906+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:36.022906+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.022906+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:48.376166+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":72,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:56.888822+0000","last_change":"2024-09-14T12:10:56.888700+0000","last_active":"2024-09-14T12:10:56.888822+0000","last_peered":"2024-09-14T12:10:56.888822+0000","last_clean":"2024-09-14T12:10:56.888822+0000","last_became_active":"2024-09-14T11:44:25.349651+0000","last_became_peered":"2024-09-14T11:44:25.349651+0000","last_unstale":"2024-09-14T12:10:56.888822+0000","last_undegraded":"2024-09-14T12:10:56.888822+0000","last_fullsized":"2024-09-14T12:10:56.888822+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:56.888597+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:56.888597+0000","last_clean_scrub_stamp":"2024-09-14T12:10:56.888597+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:06.823803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.632077+0000","last_change":"2024-09-14T12:10:33.632005+0000","last_active":"2024-09-14T12:10:33.632077+0000","last_peered":"2024-09-14T12:10:33.632077+0000","last_clean":"2024-09-14T12:10:33.632077+0000","last_became_active":"2024-09-14T11:28:36.254475+0000","last_became_peered":"2024-09-14T11:28:36.254475+0000","last_unstale":"2024-09-14T12:10:33.632077+0000","last_undegraded":"2024-09-14T12:10:33.632077+0000","last_fullsized":"2024-09-14T12:10:33.632077+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:33.631920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:33.631920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.631920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:31.081297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.577347+0000","last_change":"2024-09-14T12:10:40.577347+0000","last_active":"2024-09-14T12:10:40.577347+0000","last_peered":"2024-09-14T12:10:40.577347+0000","last_clean":"2024-09-14T12:10:40.577347+0000","last_became_active":"2024-09-14T11:28:33.230591+0000","last_became_peered":"2024-09-14T11:28:33.230591+0000","last_unstale":"2024-09-14T12:10:40.577347+0000","last_undegraded":"2024-09-14T12:10:40.577347+0000","last_fullsized":"2024-09-14T12:10:40.577347+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:40.577246+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:40.577246+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.577246+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:20.683725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'14","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.106225+0000","last_change":"2024-09-14T12:10:43.106225+0000","last_active":"2024-09-14T12:10:43.106225+0000","last_peered":"2024-09-14T12:10:43.106225+0000","last_clean":"2024-09-14T12:10:43.106225+0000","last_became_active":"2024-09-14T11:25:27.952771+0000","last_became_peered":"2024-09-14T11:25:27.952771+0000","last_unstale":"2024-09-14T12:10:43.106225+0000","last_undegraded":"2024-09-14T12:10:43.106225+0000","last_fullsized":"2024-09-14T12:10:43.106225+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-14T12:10:43.106139+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-14T12:10:43.106139+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.106139+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:48.676378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":71,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.703935+0000","last_change":"2024-09-14T12:10:30.703935+0000","last_active":"2024-09-14T12:10:30.703935+0000","last_peered":"2024-09-14T12:10:30.703935+0000","last_clean":"2024-09-14T12:10:30.703935+0000","last_became_active":"2024-09-14T11:44:25.346917+0000","last_became_peered":"2024-09-14T11:44:25.346917+0000","last_unstale":"2024-09-14T12:10:30.703935+0000","last_undegraded":"2024-09-14T12:10:30.703935+0000","last_fullsized":"2024-09-14T12:10:30.703935+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.703836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.703836+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.703836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:35.246152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.010507+0000","last_change":"2024-09-14T12:10:46.010507+0000","last_active":"2024-09-14T12:10:46.010507+0000","last_peered":"2024-09-14T12:10:46.010507+0000","last_clean":"2024-09-14T12:10:46.010507+0000","last_became_active":"2024-09-14T11:28:36.257119+0000","last_became_peered":"2024-09-14T11:28:36.257119+0000","last_unstale":"2024-09-14T12:10:46.010507+0000","last_undegraded":"2024-09-14T12:10:46.010507+0000","last_fullsized":"2024-09-14T12:10:46.010507+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:46.010413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:46.010413+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.010413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:15.494944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"265'13","reported_seq":82,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.507114+0000","last_change":"2024-09-14T12:10:45.507043+0000","last_active":"2024-09-14T12:10:45.507114+0000","last_peered":"2024-09-14T12:10:45.507114+0000","last_clean":"2024-09-14T12:10:45.507114+0000","last_became_active":"2024-09-14T11:28:33.233498+0000","last_became_peered":"2024-09-14T11:28:33.233498+0000","last_unstale":"2024-09-14T12:10:45.507114+0000","last_undegraded":"2024-09-14T12:10:45.507114+0000","last_fullsized":"2024-09-14T12:10:45.507114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'13","last_scrub_stamp":"2024-09-14T12:10:45.506950+0000","last_deep_scrub":"265'13","last_deep_scrub_stamp":"2024-09-14T12:10:45.506950+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.506950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:35.915610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":18,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'31","reported_seq":144,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:40.128734+0000","last_change":"2024-09-14T12:10:40.128734+0000","last_active":"2024-09-14T12:10:40.128734+0000","last_peered":"2024-09-14T12:10:40.128734+0000","last_clean":"2024-09-14T12:10:40.128734+0000","last_became_active":"2024-09-14T11:25:27.950237+0000","last_became_peered":"2024-09-14T11:25:27.950237+0000","last_unstale":"2024-09-14T12:10:40.128734+0000","last_undegraded":"2024-09-14T12:10:40.128734+0000","last_fullsized":"2024-09-14T12:10:40.128734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-14T12:10:40.128618+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-14T12:10:40.128618+0000","last_clean_scrub_stamp":"2024-09-14T12:10:40.128618+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:32.148044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":161,"num_write":76,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:53.454640+0000","last_change":"2024-09-14T12:10:53.454640+0000","last_active":"2024-09-14T12:10:53.454640+0000","last_peered":"2024-09-14T12:10:53.454640+0000","last_clean":"2024-09-14T12:10:53.454640+0000","last_became_active":"2024-09-14T11:44:25.353287+0000","last_became_peered":"2024-09-14T11:44:25.353287+0000","last_unstale":"2024-09-14T12:10:53.454640+0000","last_undegraded":"2024-09-14T12:10:53.454640+0000","last_fullsized":"2024-09-14T12:10:53.454640+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:53.454555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:53.454555+0000","last_clean_scrub_stamp":"2024-09-14T12:10:53.454555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:18.544162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.991310+0000","last_change":"2024-09-14T12:10:48.991310+0000","last_active":"2024-09-14T12:10:48.991310+0000","last_peered":"2024-09-14T12:10:48.991310+0000","last_clean":"2024-09-14T12:10:48.991310+0000","last_became_active":"2024-09-14T11:28:36.254489+0000","last_became_peered":"2024-09-14T11:28:36.254489+0000","last_unstale":"2024-09-14T12:10:48.991310+0000","last_undegraded":"2024-09-14T12:10:48.991310+0000","last_fullsized":"2024-09-14T12:10:48.991310+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.991222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.991222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.991222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:39.146791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.599300+0000","last_change":"2024-09-14T12:10:27.599235+0000","last_active":"2024-09-14T12:10:27.599300+0000","last_peered":"2024-09-14T12:10:27.599300+0000","last_clean":"2024-09-14T12:10:27.599300+0000","last_became_active":"2024-09-14T11:28:33.228096+0000","last_became_peered":"2024-09-14T11:28:33.228096+0000","last_unstale":"2024-09-14T12:10:27.599300+0000","last_undegraded":"2024-09-14T12:10:27.599300+0000","last_fullsized":"2024-09-14T12:10:27.599300+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:27.599137+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:27.599137+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.599137+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:18.228646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.576187+0000","last_change":"2024-09-14T12:10:41.576187+0000","last_active":"2024-09-14T12:10:41.576187+0000","last_peered":"2024-09-14T12:10:41.576187+0000","last_clean":"2024-09-14T12:10:41.576187+0000","last_became_active":"2024-09-14T11:25:27.949601+0000","last_became_peered":"2024-09-14T11:25:27.949601+0000","last_unstale":"2024-09-14T12:10:41.576187+0000","last_undegraded":"2024-09-14T12:10:41.576187+0000","last_fullsized":"2024-09-14T12:10:41.576187+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:41.576103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:41.576103+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.576103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:40.952126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.656553+0000","last_change":"2024-09-14T12:10:36.656553+0000","last_active":"2024-09-14T12:10:36.656553+0000","last_peered":"2024-09-14T12:10:36.656553+0000","last_clean":"2024-09-14T12:10:36.656553+0000","last_became_active":"2024-09-14T11:44:25.340397+0000","last_became_peered":"2024-09-14T11:44:25.340397+0000","last_unstale":"2024-09-14T12:10:36.656553+0000","last_undegraded":"2024-09-14T12:10:36.656553+0000","last_fullsized":"2024-09-14T12:10:36.656553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:36.656465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:36.656465+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.656465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:04.886372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.956830+0000","last_change":"2024-09-14T12:10:34.956830+0000","last_active":"2024-09-14T12:10:34.956830+0000","last_peered":"2024-09-14T12:10:34.956830+0000","last_clean":"2024-09-14T12:10:34.956830+0000","last_became_active":"2024-09-14T11:28:36.367311+0000","last_became_peered":"2024-09-14T11:28:36.367311+0000","last_unstale":"2024-09-14T12:10:34.956830+0000","last_undegraded":"2024-09-14T12:10:34.956830+0000","last_fullsized":"2024-09-14T12:10:34.956830+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:34.956716+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:34.956716+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.956716+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:57.306536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"262'2","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.154376+0000","last_change":"2024-09-14T12:10:46.154311+0000","last_active":"2024-09-14T12:10:46.154376+0000","last_peered":"2024-09-14T12:10:46.154376+0000","last_clean":"2024-09-14T12:10:46.154376+0000","last_became_active":"2024-09-14T11:28:33.231310+0000","last_became_peered":"2024-09-14T11:28:33.231310+0000","last_unstale":"2024-09-14T12:10:46.154376+0000","last_undegraded":"2024-09-14T12:10:46.154376+0000","last_fullsized":"2024-09-14T12:10:46.154376+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:46.154207+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:46.154207+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.154207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.720350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"265'34","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.487619+0000","last_change":"2024-09-14T12:10:26.487556+0000","last_active":"2024-09-14T12:10:26.487619+0000","last_peered":"2024-09-14T12:10:26.487619+0000","last_clean":"2024-09-14T12:10:26.487619+0000","last_became_active":"2024-09-14T11:25:27.950241+0000","last_became_peered":"2024-09-14T11:25:27.950241+0000","last_unstale":"2024-09-14T12:10:26.487619+0000","last_undegraded":"2024-09-14T12:10:26.487619+0000","last_fullsized":"2024-09-14T12:10:26.487619+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-14T12:10:26.487463+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-14T12:10:26.487463+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.487463+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:58.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":193,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:51.452306+0000","last_change":"2024-09-14T12:10:51.452306+0000","last_active":"2024-09-14T12:10:51.452306+0000","last_peered":"2024-09-14T12:10:51.452306+0000","last_clean":"2024-09-14T12:10:51.452306+0000","last_became_active":"2024-09-14T11:44:25.347041+0000","last_became_peered":"2024-09-14T11:44:25.347041+0000","last_unstale":"2024-09-14T12:10:51.452306+0000","last_undegraded":"2024-09-14T12:10:51.452306+0000","last_fullsized":"2024-09-14T12:10:51.452306+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:51.452214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:51.452214+0000","last_clean_scrub_stamp":"2024-09-14T12:10:51.452214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:43.571301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:49.944698+0000","last_change":"2024-09-14T12:10:49.944698+0000","last_active":"2024-09-14T12:10:49.944698+0000","last_peered":"2024-09-14T12:10:49.944698+0000","last_clean":"2024-09-14T12:10:49.944698+0000","last_became_active":"2024-09-14T11:28:36.256047+0000","last_became_peered":"2024-09-14T11:28:36.256047+0000","last_unstale":"2024-09-14T12:10:49.944698+0000","last_undegraded":"2024-09-14T12:10:49.944698+0000","last_fullsized":"2024-09-14T12:10:49.944698+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:49.944537+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:49.944537+0000","last_clean_scrub_stamp":"2024-09-14T12:10:49.944537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:26.096927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"265'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.945985+0000","last_change":"2024-09-14T12:10:31.945985+0000","last_active":"2024-09-14T12:10:31.945985+0000","last_peered":"2024-09-14T12:10:31.945985+0000","last_clean":"2024-09-14T12:10:31.945985+0000","last_became_active":"2024-09-14T11:28:33.227172+0000","last_became_peered":"2024-09-14T11:28:33.227172+0000","last_unstale":"2024-09-14T12:10:31.945985+0000","last_undegraded":"2024-09-14T12:10:31.945985+0000","last_fullsized":"2024-09-14T12:10:31.945985+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:31.945896+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:31.945896+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.945896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:23.234876+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"262'28","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.741384+0000","last_change":"2024-09-14T12:10:23.741291+0000","last_active":"2024-09-14T12:10:23.741384+0000","last_peered":"2024-09-14T12:10:23.741384+0000","last_clean":"2024-09-14T12:10:23.741384+0000","last_became_active":"2024-09-14T11:25:27.954147+0000","last_became_peered":"2024-09-14T11:25:27.954147+0000","last_unstale":"2024-09-14T12:10:23.741384+0000","last_undegraded":"2024-09-14T12:10:23.741384+0000","last_fullsized":"2024-09-14T12:10:23.741384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'28","last_scrub_stamp":"2024-09-14T12:10:23.741177+0000","last_deep_scrub":"262'28","last_deep_scrub_stamp":"2024-09-14T12:10:23.741177+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.741177+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:32.349253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":164,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:55.899645+0000","last_change":"2024-09-14T12:10:55.899645+0000","last_active":"2024-09-14T12:10:55.899645+0000","last_peered":"2024-09-14T12:10:55.899645+0000","last_clean":"2024-09-14T12:10:55.899645+0000","last_became_active":"2024-09-14T11:44:25.354396+0000","last_became_peered":"2024-09-14T11:44:25.354396+0000","last_unstale":"2024-09-14T12:10:55.899645+0000","last_undegraded":"2024-09-14T12:10:55.899645+0000","last_fullsized":"2024-09-14T12:10:55.899645+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:55.899540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:55.899540+0000","last_clean_scrub_stamp":"2024-09-14T12:10:55.899540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:49.785998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:46.160500+0000","last_change":"2024-09-14T12:10:46.160500+0000","last_active":"2024-09-14T12:10:46.160500+0000","last_peered":"2024-09-14T12:10:46.160500+0000","last_clean":"2024-09-14T12:10:46.160500+0000","last_became_active":"2024-09-14T11:28:36.259878+0000","last_became_peered":"2024-09-14T11:28:36.259878+0000","last_unstale":"2024-09-14T12:10:46.160500+0000","last_undegraded":"2024-09-14T12:10:46.160500+0000","last_fullsized":"2024-09-14T12:10:46.160500+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-14T12:10:46.160393+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-14T12:10:46.160393+0000","last_clean_scrub_stamp":"2024-09-14T12:10:46.160393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:50.385338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"262'2","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.200169+0000","last_change":"2024-09-14T12:10:43.200169+0000","last_active":"2024-09-14T12:10:43.200169+0000","last_peered":"2024-09-14T12:10:43.200169+0000","last_clean":"2024-09-14T12:10:43.200169+0000","last_became_active":"2024-09-14T11:28:33.229932+0000","last_became_peered":"2024-09-14T11:28:33.229932+0000","last_unstale":"2024-09-14T12:10:43.200169+0000","last_undegraded":"2024-09-14T12:10:43.200169+0000","last_fullsized":"2024-09-14T12:10:43.200169+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:43.200086+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:43.200086+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.200086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:17.908787+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'290","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.234013+0000","last_change":"2024-09-14T12:10:38.234013+0000","last_active":"2024-09-14T12:10:38.234013+0000","last_peered":"2024-09-14T12:10:38.234013+0000","last_clean":"2024-09-14T12:10:38.234013+0000","last_became_active":"2024-09-14T11:25:27.952267+0000","last_became_peered":"2024-09-14T11:25:27.952267+0000","last_unstale":"2024-09-14T12:10:38.234013+0000","last_undegraded":"2024-09-14T12:10:38.234013+0000","last_fullsized":"2024-09-14T12:10:38.234013+0000","mapping_epoch":252,"log_start":"262'200","ondisk_log_start":"262'200","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-14T12:10:38.233907+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-14T12:10:38.233907+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.233907+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:17.747594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2687,"num_read_kb":3328,"num_write":582,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:58.523813+0000","last_change":"2024-09-14T12:10:58.523813+0000","last_active":"2024-09-14T12:10:58.523813+0000","last_peered":"2024-09-14T12:10:58.523813+0000","last_clean":"2024-09-14T12:10:58.523813+0000","last_became_active":"2024-09-14T11:44:25.353561+0000","last_became_peered":"2024-09-14T11:44:25.353561+0000","last_unstale":"2024-09-14T12:10:58.523813+0000","last_undegraded":"2024-09-14T12:10:58.523813+0000","last_fullsized":"2024-09-14T12:10:58.523813+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:58.523685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:58.523685+0000","last_clean_scrub_stamp":"2024-09-14T12:10:58.523685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:15.370446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.555054+0000","last_change":"2024-09-14T12:10:48.555054+0000","last_active":"2024-09-14T12:10:48.555054+0000","last_peered":"2024-09-14T12:10:48.555054+0000","last_clean":"2024-09-14T12:10:48.555054+0000","last_became_active":"2024-09-14T11:28:36.365592+0000","last_became_peered":"2024-09-14T11:28:36.365592+0000","last_unstale":"2024-09-14T12:10:48.555054+0000","last_undegraded":"2024-09-14T12:10:48.555054+0000","last_fullsized":"2024-09-14T12:10:48.555054+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:48.554966+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:48.554966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.554966+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:58.079973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'3","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.903051+0000","last_change":"2024-09-14T12:10:30.903051+0000","last_active":"2024-09-14T12:10:30.903051+0000","last_peered":"2024-09-14T12:10:30.903051+0000","last_clean":"2024-09-14T12:10:30.903051+0000","last_became_active":"2024-09-14T11:28:33.227743+0000","last_became_peered":"2024-09-14T11:28:33.227743+0000","last_unstale":"2024-09-14T12:10:30.903051+0000","last_undegraded":"2024-09-14T12:10:30.903051+0000","last_fullsized":"2024-09-14T12:10:30.903051+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-14T12:10:30.902949+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-14T12:10:30.902949+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.902949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:54.542664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'12","reported_seq":97,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.483107+0000","last_change":"2024-09-14T12:10:37.483049+0000","last_active":"2024-09-14T12:10:37.483107+0000","last_peered":"2024-09-14T12:10:37.483107+0000","last_clean":"2024-09-14T12:10:37.483107+0000","last_became_active":"2024-09-14T11:25:27.949921+0000","last_became_peered":"2024-09-14T11:25:27.949921+0000","last_unstale":"2024-09-14T12:10:37.483107+0000","last_undegraded":"2024-09-14T12:10:37.483107+0000","last_fullsized":"2024-09-14T12:10:37.483107+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-14T12:10:37.482966+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-14T12:10:37.482966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.482966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:28.164284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:55.446736+0000","last_change":"2024-09-14T12:10:55.446736+0000","last_active":"2024-09-14T12:10:55.446736+0000","last_peered":"2024-09-14T12:10:55.446736+0000","last_clean":"2024-09-14T12:10:55.446736+0000","last_became_active":"2024-09-14T11:44:25.351413+0000","last_became_peered":"2024-09-14T11:44:25.351413+0000","last_unstale":"2024-09-14T12:10:55.446736+0000","last_undegraded":"2024-09-14T12:10:55.446736+0000","last_fullsized":"2024-09-14T12:10:55.446736+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:55.446636+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:55.446636+0000","last_clean_scrub_stamp":"2024-09-14T12:10:55.446636+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:08.136564+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"265'8","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.931956+0000","last_change":"2024-09-14T12:10:33.931874+0000","last_active":"2024-09-14T12:10:33.931956+0000","last_peered":"2024-09-14T12:10:33.931956+0000","last_clean":"2024-09-14T12:10:33.931956+0000","last_became_active":"2024-09-14T11:28:36.252387+0000","last_became_peered":"2024-09-14T11:28:36.252387+0000","last_unstale":"2024-09-14T12:10:33.931956+0000","last_undegraded":"2024-09-14T12:10:33.931956+0000","last_fullsized":"2024-09-14T12:10:33.931956+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T12:10:33.931788+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T12:10:33.931788+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.931788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:09.612933+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":17937,"num_write":8,"num_write_kb":11793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:45.138619+0000","last_change":"2024-09-14T12:10:45.138619+0000","last_active":"2024-09-14T12:10:45.138619+0000","last_peered":"2024-09-14T12:10:45.138619+0000","last_clean":"2024-09-14T12:10:45.138619+0000","last_became_active":"2024-09-14T11:28:33.228126+0000","last_became_peered":"2024-09-14T11:28:33.228126+0000","last_unstale":"2024-09-14T12:10:45.138619+0000","last_undegraded":"2024-09-14T12:10:45.138619+0000","last_fullsized":"2024-09-14T12:10:45.138619+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:45.138515+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:45.138515+0000","last_clean_scrub_stamp":"2024-09-14T12:10:45.138515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:51.617956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'17","reported_seq":109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.127259+0000","last_change":"2024-09-14T12:10:42.127178+0000","last_active":"2024-09-14T12:10:42.127259+0000","last_peered":"2024-09-14T12:10:42.127259+0000","last_clean":"2024-09-14T12:10:42.127259+0000","last_became_active":"2024-09-14T11:25:27.950446+0000","last_became_peered":"2024-09-14T11:25:27.950446+0000","last_unstale":"2024-09-14T12:10:42.127259+0000","last_undegraded":"2024-09-14T12:10:42.127259+0000","last_fullsized":"2024-09-14T12:10:42.127259+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-14T12:10:42.127079+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-14T12:10:42.127079+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.127079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:56.490021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":84,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:54.167689+0000","last_change":"2024-09-14T12:10:54.167689+0000","last_active":"2024-09-14T12:10:54.167689+0000","last_peered":"2024-09-14T12:10:54.167689+0000","last_clean":"2024-09-14T12:10:54.167689+0000","last_became_active":"2024-09-14T11:44:25.356279+0000","last_became_peered":"2024-09-14T11:44:25.356279+0000","last_unstale":"2024-09-14T12:10:54.167689+0000","last_undegraded":"2024-09-14T12:10:54.167689+0000","last_fullsized":"2024-09-14T12:10:54.167689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:54.167531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:54.167531+0000","last_clean_scrub_stamp":"2024-09-14T12:10:54.167531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:36.970872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:49.505982+0000","last_change":"2024-09-14T12:10:49.505982+0000","last_active":"2024-09-14T12:10:49.505982+0000","last_peered":"2024-09-14T12:10:49.505982+0000","last_clean":"2024-09-14T12:10:49.505982+0000","last_became_active":"2024-09-14T11:29:33.340153+0000","last_became_peered":"2024-09-14T11:29:33.340153+0000","last_unstale":"2024-09-14T12:10:49.505982+0000","last_undegraded":"2024-09-14T12:10:49.505982+0000","last_fullsized":"2024-09-14T12:10:49.505982+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:49.505888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:49.505888+0000","last_clean_scrub_stamp":"2024-09-14T12:10:49.505888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:58.875106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.061302+0000","last_change":"2024-09-14T12:10:39.061228+0000","last_active":"2024-09-14T12:10:39.061302+0000","last_peered":"2024-09-14T12:10:39.061302+0000","last_clean":"2024-09-14T12:10:39.061302+0000","last_became_active":"2024-09-14T11:28:33.230065+0000","last_became_peered":"2024-09-14T11:28:33.230065+0000","last_unstale":"2024-09-14T12:10:39.061302+0000","last_undegraded":"2024-09-14T12:10:39.061302+0000","last_fullsized":"2024-09-14T12:10:39.061302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.061111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.061111+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.061111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:40.612611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'36","reported_seq":160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.537833+0000","last_change":"2024-09-14T12:10:29.537776+0000","last_active":"2024-09-14T12:10:29.537833+0000","last_peered":"2024-09-14T12:10:29.537833+0000","last_clean":"2024-09-14T12:10:29.537833+0000","last_became_active":"2024-09-14T11:25:27.949339+0000","last_became_peered":"2024-09-14T11:25:27.949339+0000","last_unstale":"2024-09-14T12:10:29.537833+0000","last_undegraded":"2024-09-14T12:10:29.537833+0000","last_fullsized":"2024-09-14T12:10:29.537833+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'36","last_scrub_stamp":"2024-09-14T12:10:29.537674+0000","last_deep_scrub":"265'36","last_deep_scrub_stamp":"2024-09-14T12:10:29.537674+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.537674+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:55.031465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":169,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:50.458028+0000","last_change":"2024-09-14T12:10:50.458028+0000","last_active":"2024-09-14T12:10:50.458028+0000","last_peered":"2024-09-14T12:10:50.458028+0000","last_clean":"2024-09-14T12:10:50.458028+0000","last_became_active":"2024-09-14T11:44:25.351504+0000","last_became_peered":"2024-09-14T11:44:25.351504+0000","last_unstale":"2024-09-14T12:10:50.458028+0000","last_undegraded":"2024-09-14T12:10:50.458028+0000","last_fullsized":"2024-09-14T12:10:50.458028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:50.457928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:50.457928+0000","last_clean_scrub_stamp":"2024-09-14T12:10:50.457928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:58.222831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:50.147504+0000","last_change":"2024-09-14T12:10:50.147504+0000","last_active":"2024-09-14T12:10:50.147504+0000","last_peered":"2024-09-14T12:10:50.147504+0000","last_clean":"2024-09-14T12:10:50.147504+0000","last_became_active":"2024-09-14T11:28:36.251718+0000","last_became_peered":"2024-09-14T11:28:36.251718+0000","last_unstale":"2024-09-14T12:10:50.147504+0000","last_undegraded":"2024-09-14T12:10:50.147504+0000","last_fullsized":"2024-09-14T12:10:50.147504+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:50.147419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:50.147419+0000","last_clean_scrub_stamp":"2024-09-14T12:10:50.147419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:14.239274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"265'4","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.527041+0000","last_change":"2024-09-14T12:10:43.527041+0000","last_active":"2024-09-14T12:10:43.527041+0000","last_peered":"2024-09-14T12:10:43.527041+0000","last_clean":"2024-09-14T12:10:43.527041+0000","last_became_active":"2024-09-14T11:28:33.228840+0000","last_became_peered":"2024-09-14T11:28:33.228840+0000","last_unstale":"2024-09-14T12:10:43.527041+0000","last_undegraded":"2024-09-14T12:10:43.527041+0000","last_fullsized":"2024-09-14T12:10:43.527041+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:43.526957+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:43.526957+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.526957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:45.876471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'22","reported_seq":119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.194165+0000","last_change":"2024-09-14T12:10:37.194085+0000","last_active":"2024-09-14T12:10:37.194165+0000","last_peered":"2024-09-14T12:10:37.194165+0000","last_clean":"2024-09-14T12:10:37.194165+0000","last_became_active":"2024-09-14T11:25:27.948284+0000","last_became_peered":"2024-09-14T11:25:27.948284+0000","last_unstale":"2024-09-14T12:10:37.194165+0000","last_undegraded":"2024-09-14T12:10:37.194165+0000","last_fullsized":"2024-09-14T12:10:37.194165+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-14T12:10:37.193995+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-14T12:10:37.193995+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.193995+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:41.153802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":98,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.630179+0000","last_change":"2024-09-14T12:10:43.630179+0000","last_active":"2024-09-14T12:10:43.630179+0000","last_peered":"2024-09-14T12:10:43.630179+0000","last_clean":"2024-09-14T12:10:43.630179+0000","last_became_active":"2024-09-14T11:44:25.350176+0000","last_became_peered":"2024-09-14T11:44:25.350176+0000","last_unstale":"2024-09-14T12:10:43.630179+0000","last_undegraded":"2024-09-14T12:10:43.630179+0000","last_fullsized":"2024-09-14T12:10:43.630179+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:43.630095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:43.630095+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.630095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:37.614737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:49.112188+0000","last_change":"2024-09-14T12:10:49.112188+0000","last_active":"2024-09-14T12:10:49.112188+0000","last_peered":"2024-09-14T12:10:49.112188+0000","last_clean":"2024-09-14T12:10:49.112188+0000","last_became_active":"2024-09-14T11:28:36.365501+0000","last_became_peered":"2024-09-14T11:28:36.365501+0000","last_unstale":"2024-09-14T12:10:49.112188+0000","last_undegraded":"2024-09-14T12:10:49.112188+0000","last_fullsized":"2024-09-14T12:10:49.112188+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:49.112106+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:49.112106+0000","last_clean_scrub_stamp":"2024-09-14T12:10:49.112106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:02:44.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'3","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.604950+0000","last_change":"2024-09-14T12:10:26.604950+0000","last_active":"2024-09-14T12:10:26.604950+0000","last_peered":"2024-09-14T12:10:26.604950+0000","last_clean":"2024-09-14T12:10:26.604950+0000","last_became_active":"2024-09-14T11:28:33.227755+0000","last_became_peered":"2024-09-14T11:28:33.227755+0000","last_unstale":"2024-09-14T12:10:26.604950+0000","last_undegraded":"2024-09-14T12:10:26.604950+0000","last_fullsized":"2024-09-14T12:10:26.604950+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:26.604867+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:26.604867+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.604867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:23.881125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'2","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.437842+0000","last_change":"2024-09-14T12:10:25.437755+0000","last_active":"2024-09-14T12:10:25.437842+0000","last_peered":"2024-09-14T12:10:25.437842+0000","last_clean":"2024-09-14T12:10:25.437842+0000","last_became_active":"2024-09-14T11:25:27.948032+0000","last_became_peered":"2024-09-14T11:25:27.948032+0000","last_unstale":"2024-09-14T12:10:25.437842+0000","last_undegraded":"2024-09-14T12:10:25.437842+0000","last_fullsized":"2024-09-14T12:10:25.437842+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:25.437626+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:25.437626+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.437626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:14.993165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.056974+0000","last_change":"2024-09-14T12:10:39.056974+0000","last_active":"2024-09-14T12:10:39.056974+0000","last_peered":"2024-09-14T12:10:39.056974+0000","last_clean":"2024-09-14T12:10:39.056974+0000","last_became_active":"2024-09-14T11:44:25.350851+0000","last_became_peered":"2024-09-14T11:44:25.350851+0000","last_unstale":"2024-09-14T12:10:39.056974+0000","last_undegraded":"2024-09-14T12:10:39.056974+0000","last_fullsized":"2024-09-14T12:10:39.056974+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.056866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.056866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.056866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:46.111137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:47.514415+0000","last_change":"2024-09-14T12:10:47.514415+0000","last_active":"2024-09-14T12:10:47.514415+0000","last_peered":"2024-09-14T12:10:47.514415+0000","last_clean":"2024-09-14T12:10:47.514415+0000","last_became_active":"2024-09-14T11:28:36.366865+0000","last_became_peered":"2024-09-14T11:28:36.366865+0000","last_unstale":"2024-09-14T12:10:47.514415+0000","last_undegraded":"2024-09-14T12:10:47.514415+0000","last_fullsized":"2024-09-14T12:10:47.514415+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:47.514320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:47.514320+0000","last_clean_scrub_stamp":"2024-09-14T12:10:47.514320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:08.529818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.537112+0000","last_change":"2024-09-14T12:10:39.537112+0000","last_active":"2024-09-14T12:10:39.537112+0000","last_peered":"2024-09-14T12:10:39.537112+0000","last_clean":"2024-09-14T12:10:39.537112+0000","last_became_active":"2024-09-14T11:28:33.230757+0000","last_became_peered":"2024-09-14T11:28:33.230757+0000","last_unstale":"2024-09-14T12:10:39.537112+0000","last_undegraded":"2024-09-14T12:10:39.537112+0000","last_fullsized":"2024-09-14T12:10:39.537112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:39.537019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:39.537019+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.537019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:43.511738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'15","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.494266+0000","last_change":"2024-09-14T12:10:36.494266+0000","last_active":"2024-09-14T12:10:36.494266+0000","last_peered":"2024-09-14T12:10:36.494266+0000","last_clean":"2024-09-14T12:10:36.494266+0000","last_became_active":"2024-09-14T11:25:27.947900+0000","last_became_peered":"2024-09-14T11:25:27.947900+0000","last_unstale":"2024-09-14T12:10:36.494266+0000","last_undegraded":"2024-09-14T12:10:36.494266+0000","last_fullsized":"2024-09-14T12:10:36.494266+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-14T12:10:36.494160+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-14T12:10:36.494160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.494160+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:43.294501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:48.226881+0000","last_change":"2024-09-14T12:10:48.226881+0000","last_active":"2024-09-14T12:10:48.226881+0000","last_peered":"2024-09-14T12:10:48.226881+0000","last_clean":"2024-09-14T12:10:48.226881+0000","last_became_active":"2024-09-14T11:44:25.353790+0000","last_became_peered":"2024-09-14T11:44:25.353790+0000","last_unstale":"2024-09-14T12:10:48.226881+0000","last_undegraded":"2024-09-14T12:10:48.226881+0000","last_fullsized":"2024-09-14T12:10:48.226881+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:48.226800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:48.226800+0000","last_clean_scrub_stamp":"2024-09-14T12:10:48.226800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:05.123660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:43.144680+0000","last_change":"2024-09-14T12:10:43.144680+0000","last_active":"2024-09-14T12:10:43.144680+0000","last_peered":"2024-09-14T12:10:43.144680+0000","last_clean":"2024-09-14T12:10:43.144680+0000","last_became_active":"2024-09-14T11:28:36.259719+0000","last_became_peered":"2024-09-14T11:28:36.259719+0000","last_unstale":"2024-09-14T12:10:43.144680+0000","last_undegraded":"2024-09-14T12:10:43.144680+0000","last_fullsized":"2024-09-14T12:10:43.144680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-14T12:10:43.144593+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-14T12:10:43.144593+0000","last_clean_scrub_stamp":"2024-09-14T12:10:43.144593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:15.696044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.517899+0000","last_change":"2024-09-14T12:10:44.517899+0000","last_active":"2024-09-14T12:10:44.517899+0000","last_peered":"2024-09-14T12:10:44.517899+0000","last_clean":"2024-09-14T12:10:44.517899+0000","last_became_active":"2024-09-14T11:28:33.232663+0000","last_became_peered":"2024-09-14T11:28:33.232663+0000","last_unstale":"2024-09-14T12:10:44.517899+0000","last_undegraded":"2024-09-14T12:10:44.517899+0000","last_fullsized":"2024-09-14T12:10:44.517899+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:44.517817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:44.517817+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.517817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:17.656397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'29","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.919868+0000","last_change":"2024-09-14T12:10:27.919786+0000","last_active":"2024-09-14T12:10:27.919868+0000","last_peered":"2024-09-14T12:10:27.919868+0000","last_clean":"2024-09-14T12:10:27.919868+0000","last_became_active":"2024-09-14T11:25:27.948150+0000","last_became_peered":"2024-09-14T11:25:27.948150+0000","last_unstale":"2024-09-14T12:10:27.919868+0000","last_undegraded":"2024-09-14T12:10:27.919868+0000","last_fullsized":"2024-09-14T12:10:27.919868+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-14T12:10:27.919699+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-14T12:10:27.919699+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.919699+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:15.231975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":163,"num_write":69,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.715104+0000","last_change":"2024-09-14T12:10:31.715104+0000","last_active":"2024-09-14T12:10:31.715104+0000","last_peered":"2024-09-14T12:10:31.715104+0000","last_clean":"2024-09-14T12:10:31.715104+0000","last_became_active":"2024-09-14T11:44:25.347723+0000","last_became_peered":"2024-09-14T11:44:25.347723+0000","last_unstale":"2024-09-14T12:10:31.715104+0000","last_undegraded":"2024-09-14T12:10:31.715104+0000","last_fullsized":"2024-09-14T12:10:31.715104+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:31.715014+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:31.715014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.715014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:05.502111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.906639+0000","last_change":"2024-09-14T12:10:32.906639+0000","last_active":"2024-09-14T12:10:32.906639+0000","last_peered":"2024-09-14T12:10:32.906639+0000","last_clean":"2024-09-14T12:10:32.906639+0000","last_became_active":"2024-09-14T11:28:36.255578+0000","last_became_peered":"2024-09-14T11:28:36.255578+0000","last_unstale":"2024-09-14T12:10:32.906639+0000","last_undegraded":"2024-09-14T12:10:32.906639+0000","last_fullsized":"2024-09-14T12:10:32.906639+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:32.906554+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:32.906554+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.906554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:07.014171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"262'5","reported_seq":69,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:41.533797+0000","last_change":"2024-09-14T12:10:41.533797+0000","last_active":"2024-09-14T12:10:41.533797+0000","last_peered":"2024-09-14T12:10:41.533797+0000","last_clean":"2024-09-14T12:10:41.533797+0000","last_became_active":"2024-09-14T11:28:33.228087+0000","last_became_peered":"2024-09-14T11:28:33.228087+0000","last_unstale":"2024-09-14T12:10:41.533797+0000","last_undegraded":"2024-09-14T12:10:41.533797+0000","last_fullsized":"2024-09-14T12:10:41.533797+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-14T12:10:41.533688+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-14T12:10:41.533688+0000","last_clean_scrub_stamp":"2024-09-14T12:10:41.533688+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:06.473065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"265'21","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.585232+0000","last_change":"2024-09-14T12:10:38.585175+0000","last_active":"2024-09-14T12:10:38.585232+0000","last_peered":"2024-09-14T12:10:38.585232+0000","last_clean":"2024-09-14T12:10:38.585232+0000","last_became_active":"2024-09-14T11:25:27.948260+0000","last_became_peered":"2024-09-14T11:25:27.948260+0000","last_unstale":"2024-09-14T12:10:38.585232+0000","last_undegraded":"2024-09-14T12:10:38.585232+0000","last_fullsized":"2024-09-14T12:10:38.585232+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-14T12:10:38.585084+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-14T12:10:38.585084+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.585084+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:41.498626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":121,"num_write":53,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:55.188077+0000","last_change":"2024-09-14T12:10:55.188077+0000","last_active":"2024-09-14T12:10:55.188077+0000","last_peered":"2024-09-14T12:10:55.188077+0000","last_clean":"2024-09-14T12:10:55.188077+0000","last_became_active":"2024-09-14T11:44:25.352560+0000","last_became_peered":"2024-09-14T11:44:25.352560+0000","last_unstale":"2024-09-14T12:10:55.188077+0000","last_undegraded":"2024-09-14T12:10:55.188077+0000","last_fullsized":"2024-09-14T12:10:55.188077+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:55.187986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:55.187986+0000","last_clean_scrub_stamp":"2024-09-14T12:10:55.187986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:25.283496+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.671703+0000","last_change":"2024-09-14T12:10:44.671635+0000","last_active":"2024-09-14T12:10:44.671703+0000","last_peered":"2024-09-14T12:10:44.671703+0000","last_clean":"2024-09-14T12:10:44.671703+0000","last_became_active":"2024-09-14T11:28:36.256199+0000","last_became_peered":"2024-09-14T11:28:36.256199+0000","last_unstale":"2024-09-14T12:10:44.671703+0000","last_undegraded":"2024-09-14T12:10:44.671703+0000","last_fullsized":"2024-09-14T12:10:44.671703+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:44.671551+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:44.671551+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.671551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:31.136663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:42.522936+0000","last_change":"2024-09-14T12:10:42.522936+0000","last_active":"2024-09-14T12:10:42.522936+0000","last_peered":"2024-09-14T12:10:42.522936+0000","last_clean":"2024-09-14T12:10:42.522936+0000","last_became_active":"2024-09-14T11:28:33.232290+0000","last_became_peered":"2024-09-14T11:28:33.232290+0000","last_unstale":"2024-09-14T12:10:42.522936+0000","last_undegraded":"2024-09-14T12:10:42.522936+0000","last_fullsized":"2024-09-14T12:10:42.522936+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:42.522845+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:42.522845+0000","last_clean_scrub_stamp":"2024-09-14T12:10:42.522845+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:17.548786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'39","reported_seq":163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.057705+0000","last_change":"2024-09-14T12:10:37.057643+0000","last_active":"2024-09-14T12:10:37.057705+0000","last_peered":"2024-09-14T12:10:37.057705+0000","last_clean":"2024-09-14T12:10:37.057705+0000","last_became_active":"2024-09-14T11:25:27.949173+0000","last_became_peered":"2024-09-14T11:25:27.949173+0000","last_unstale":"2024-09-14T12:10:37.057705+0000","last_undegraded":"2024-09-14T12:10:37.057705+0000","last_fullsized":"2024-09-14T12:10:37.057705+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-14T12:10:37.057550+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-14T12:10:37.057550+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.057550+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:07.525476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":282,"num_read_kb":182,"num_write":99,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:53.146920+0000","last_change":"2024-09-14T12:10:53.146920+0000","last_active":"2024-09-14T12:10:53.146920+0000","last_peered":"2024-09-14T12:10:53.146920+0000","last_clean":"2024-09-14T12:10:53.146920+0000","last_became_active":"2024-09-14T11:44:25.351638+0000","last_became_peered":"2024-09-14T11:44:25.351638+0000","last_unstale":"2024-09-14T12:10:53.146920+0000","last_undegraded":"2024-09-14T12:10:53.146920+0000","last_fullsized":"2024-09-14T12:10:53.146920+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:53.146822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:53.146822+0000","last_clean_scrub_stamp":"2024-09-14T12:10:53.146822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.609634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.570057+0000","last_change":"2024-09-14T12:10:31.570057+0000","last_active":"2024-09-14T12:10:31.570057+0000","last_peered":"2024-09-14T12:10:31.570057+0000","last_clean":"2024-09-14T12:10:31.570057+0000","last_became_active":"2024-09-14T11:28:36.259028+0000","last_became_peered":"2024-09-14T11:28:36.259028+0000","last_unstale":"2024-09-14T12:10:31.570057+0000","last_undegraded":"2024-09-14T12:10:31.570057+0000","last_fullsized":"2024-09-14T12:10:31.570057+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-14T12:10:31.569964+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-14T12:10:31.569964+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.569964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:48.357791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'9","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.952201+0000","last_change":"2024-09-14T12:10:29.952201+0000","last_active":"2024-09-14T12:10:29.952201+0000","last_peered":"2024-09-14T12:10:29.952201+0000","last_clean":"2024-09-14T12:10:29.952201+0000","last_became_active":"2024-09-14T11:28:33.227553+0000","last_became_peered":"2024-09-14T11:28:33.227553+0000","last_unstale":"2024-09-14T12:10:29.952201+0000","last_undegraded":"2024-09-14T12:10:29.952201+0000","last_fullsized":"2024-09-14T12:10:29.952201+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-14T12:10:29.952118+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-14T12:10:29.952118+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.952118+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:40.168274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21504,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.435267+0000","last_change":"2024-09-14T12:10:24.435191+0000","last_active":"2024-09-14T12:10:24.435267+0000","last_peered":"2024-09-14T12:10:24.435267+0000","last_clean":"2024-09-14T12:10:24.435267+0000","last_became_active":"2024-09-14T11:25:27.946287+0000","last_became_peered":"2024-09-14T11:25:27.946287+0000","last_unstale":"2024-09-14T12:10:24.435267+0000","last_undegraded":"2024-09-14T12:10:24.435267+0000","last_fullsized":"2024-09-14T12:10:24.435267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:24.435114+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:24.435114+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.435114+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:38.814026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":233,"num_write":109,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:52.432103+0000","last_change":"2024-09-14T12:10:52.432103+0000","last_active":"2024-09-14T12:10:52.432103+0000","last_peered":"2024-09-14T12:10:52.432103+0000","last_clean":"2024-09-14T12:10:52.432103+0000","last_became_active":"2024-09-14T11:44:25.355125+0000","last_became_peered":"2024-09-14T11:44:25.355125+0000","last_unstale":"2024-09-14T12:10:52.432103+0000","last_undegraded":"2024-09-14T12:10:52.432103+0000","last_fullsized":"2024-09-14T12:10:52.432103+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:52.432013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:52.432013+0000","last_clean_scrub_stamp":"2024-09-14T12:10:52.432013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:00.921676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'3","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:44.124363+0000","last_change":"2024-09-14T12:10:44.124363+0000","last_active":"2024-09-14T12:10:44.124363+0000","last_peered":"2024-09-14T12:10:44.124363+0000","last_clean":"2024-09-14T12:10:44.124363+0000","last_became_active":"2024-09-14T11:28:36.260417+0000","last_became_peered":"2024-09-14T11:28:36.260417+0000","last_unstale":"2024-09-14T12:10:44.124363+0000","last_undegraded":"2024-09-14T12:10:44.124363+0000","last_fullsized":"2024-09-14T12:10:44.124363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:44.124256+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:44.124256+0000","last_clean_scrub_stamp":"2024-09-14T12:10:44.124256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:18.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.588628+0000","last_change":"2024-09-14T12:10:32.588628+0000","last_active":"2024-09-14T12:10:32.588628+0000","last_peered":"2024-09-14T12:10:32.588628+0000","last_clean":"2024-09-14T12:10:32.588628+0000","last_became_active":"2024-09-14T11:28:33.227893+0000","last_became_peered":"2024-09-14T11:28:33.227893+0000","last_unstale":"2024-09-14T12:10:32.588628+0000","last_undegraded":"2024-09-14T12:10:32.588628+0000","last_fullsized":"2024-09-14T12:10:32.588628+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.588504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.588504+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.588504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:19.828863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'19","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.563742+0000","last_change":"2024-09-14T12:10:39.563742+0000","last_active":"2024-09-14T12:10:39.563742+0000","last_peered":"2024-09-14T12:10:39.563742+0000","last_clean":"2024-09-14T12:10:39.563742+0000","last_became_active":"2024-09-14T11:25:27.948770+0000","last_became_peered":"2024-09-14T11:25:27.948770+0000","last_unstale":"2024-09-14T12:10:39.563742+0000","last_undegraded":"2024-09-14T12:10:39.563742+0000","last_fullsized":"2024-09-14T12:10:39.563742+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'19","last_scrub_stamp":"2024-09-14T12:10:39.563657+0000","last_deep_scrub":"265'19","last_deep_scrub_stamp":"2024-09-14T12:10:39.563657+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.563657+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:32.966571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":91,"num_write":51,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'367","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.459244+0000","last_change":"2024-09-14T12:10:14.459244+0000","last_active":"2024-09-14T12:10:14.459244+0000","last_peered":"2024-09-14T12:10:14.459244+0000","last_clean":"2024-09-14T12:10:14.459244+0000","last_became_active":"2024-09-14T11:10:56.611391+0000","last_became_peered":"2024-09-14T11:10:56.611391+0000","last_unstale":"2024-09-14T12:10:14.459244+0000","last_undegraded":"2024-09-14T12:10:14.459244+0000","last_fullsized":"2024-09-14T12:10:14.459244+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-14T12:10:14.459145+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.459145+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.624776+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":757,"num_read_kb":12872,"num_write":1136,"num_write_kb":19465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'172","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.668527+0000","last_change":"2024-09-14T12:10:19.668440+0000","last_active":"2024-09-14T12:10:19.668527+0000","last_peered":"2024-09-14T12:10:19.668527+0000","last_clean":"2024-09-14T12:10:19.668527+0000","last_became_active":"2024-09-14T11:10:58.598285+0000","last_became_peered":"2024-09-14T11:10:58.598285+0000","last_unstale":"2024-09-14T12:10:19.668527+0000","last_undegraded":"2024-09-14T12:10:19.668527+0000","last_fullsized":"2024-09-14T12:10:19.668527+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:19.668328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.668328+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:56.312199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":786,"num_read_kb":650,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'341","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.826945+0000","last_change":"2024-09-14T12:10:05.826945+0000","last_active":"2024-09-14T12:10:05.826945+0000","last_peered":"2024-09-14T12:10:05.826945+0000","last_clean":"2024-09-14T12:10:05.826945+0000","last_became_active":"2024-09-14T11:10:56.604954+0000","last_became_peered":"2024-09-14T11:10:56.604954+0000","last_unstale":"2024-09-14T12:10:05.826945+0000","last_undegraded":"2024-09-14T12:10:05.826945+0000","last_fullsized":"2024-09-14T12:10:05.826945+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.826834+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.826834+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:29.237796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":676,"num_read_kb":30246,"num_write":1175,"num_write_kb":34323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'109","reported_seq":708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.530701+0000","last_change":"2024-09-14T12:10:18.530643+0000","last_active":"2024-09-14T12:10:18.530701+0000","last_peered":"2024-09-14T12:10:18.530701+0000","last_clean":"2024-09-14T12:10:18.530701+0000","last_became_active":"2024-09-14T11:10:58.607941+0000","last_became_peered":"2024-09-14T11:10:58.607941+0000","last_unstale":"2024-09-14T12:10:18.530701+0000","last_undegraded":"2024-09-14T12:10:18.530701+0000","last_fullsized":"2024-09-14T12:10:18.530701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-14T12:10:18.530556+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.530556+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:40.837032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":484,"num_read_kb":408,"num_write":151,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'341","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.095197+0000","last_change":"2024-09-14T12:10:05.095197+0000","last_active":"2024-09-14T12:10:05.095197+0000","last_peered":"2024-09-14T12:10:05.095197+0000","last_clean":"2024-09-14T12:10:05.095197+0000","last_became_active":"2024-09-14T11:10:56.603960+0000","last_became_peered":"2024-09-14T11:10:56.603960+0000","last_unstale":"2024-09-14T12:10:05.095197+0000","last_undegraded":"2024-09-14T12:10:05.095197+0000","last_fullsized":"2024-09-14T12:10:05.095197+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-14T12:10:05.095059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.095059+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:45.483265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":582,"num_read_kb":3312,"num_write":1178,"num_write_kb":21751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'184","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.971082+0000","last_change":"2024-09-14T12:10:16.971020+0000","last_active":"2024-09-14T12:10:16.971082+0000","last_peered":"2024-09-14T12:10:16.971082+0000","last_clean":"2024-09-14T12:10:16.971082+0000","last_became_active":"2024-09-14T11:10:58.615317+0000","last_became_peered":"2024-09-14T11:10:58.615317+0000","last_unstale":"2024-09-14T12:10:16.971082+0000","last_undegraded":"2024-09-14T12:10:16.971082+0000","last_fullsized":"2024-09-14T12:10:16.971082+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:16.970940+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.970940+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.622124+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":801,"num_read_kb":665,"num_write":261,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'370","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.705694+0000","last_change":"2024-09-14T12:10:13.705623+0000","last_active":"2024-09-14T12:10:13.705694+0000","last_peered":"2024-09-14T12:10:13.705694+0000","last_clean":"2024-09-14T12:10:13.705694+0000","last_became_active":"2024-09-14T11:10:56.621987+0000","last_became_peered":"2024-09-14T11:10:56.621987+0000","last_unstale":"2024-09-14T12:10:13.705694+0000","last_undegraded":"2024-09-14T12:10:13.705694+0000","last_fullsized":"2024-09-14T12:10:13.705694+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-14T12:10:13.705505+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.705505+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:38.303648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":687,"num_read_kb":5058,"num_write":1126,"num_write_kb":30970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'80","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.214862+0000","last_change":"2024-09-14T12:10:14.214780+0000","last_active":"2024-09-14T12:10:14.214862+0000","last_peered":"2024-09-14T12:10:14.214862+0000","last_clean":"2024-09-14T12:10:14.214862+0000","last_became_active":"2024-09-14T11:10:58.615421+0000","last_became_peered":"2024-09-14T11:10:58.615421+0000","last_unstale":"2024-09-14T12:10:14.214862+0000","last_undegraded":"2024-09-14T12:10:14.214862+0000","last_fullsized":"2024-09-14T12:10:14.214862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'80","last_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_deep_scrub":"265'80","last_deep_scrub_stamp":"2024-09-14T12:10:14.214689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.214689+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:13.644836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":353,"num_read_kb":299,"num_write":127,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'332","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.452497+0000","last_change":"2024-09-14T12:10:13.452437+0000","last_active":"2024-09-14T12:10:13.452497+0000","last_peered":"2024-09-14T12:10:13.452497+0000","last_clean":"2024-09-14T12:10:13.452497+0000","last_became_active":"2024-09-14T11:10:56.605208+0000","last_became_peered":"2024-09-14T11:10:56.605208+0000","last_unstale":"2024-09-14T12:10:13.452497+0000","last_undegraded":"2024-09-14T12:10:13.452497+0000","last_fullsized":"2024-09-14T12:10:13.452497+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-14T12:10:13.452316+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.452316+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:51.046156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":522,"num_read_kb":17822,"num_write":1000,"num_write_kb":37632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'253","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.296460+0000","last_change":"2024-09-14T12:10:12.296368+0000","last_active":"2024-09-14T12:10:12.296460+0000","last_peered":"2024-09-14T12:10:12.296460+0000","last_clean":"2024-09-14T12:10:12.296460+0000","last_became_active":"2024-09-14T11:10:58.607573+0000","last_became_peered":"2024-09-14T11:10:58.607573+0000","last_unstale":"2024-09-14T12:10:12.296460+0000","last_undegraded":"2024-09-14T12:10:12.296460+0000","last_fullsized":"2024-09-14T12:10:12.296460+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'253","last_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_deep_scrub":"265'253","last_deep_scrub_stamp":"2024-09-14T12:10:12.296241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.296241+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:52.581921+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1174,"num_read_kb":977,"num_write":418,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'307","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.675440+0000","last_change":"2024-09-14T12:10:12.675366+0000","last_active":"2024-09-14T12:10:12.675440+0000","last_peered":"2024-09-14T12:10:12.675440+0000","last_clean":"2024-09-14T12:10:12.675440+0000","last_became_active":"2024-09-14T11:10:56.621949+0000","last_became_peered":"2024-09-14T11:10:56.621949+0000","last_unstale":"2024-09-14T12:10:12.675440+0000","last_undegraded":"2024-09-14T12:10:12.675440+0000","last_fullsized":"2024-09-14T12:10:12.675440+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'307","last_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_deep_scrub":"265'307","last_deep_scrub_stamp":"2024-09-14T12:10:12.675269+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.675269+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:51.405065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":58018,"num_write":1056,"num_write_kb":29121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'98","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.981965+0000","last_change":"2024-09-14T12:10:18.981965+0000","last_active":"2024-09-14T12:10:18.981965+0000","last_peered":"2024-09-14T12:10:18.981965+0000","last_clean":"2024-09-14T12:10:18.981965+0000","last_became_active":"2024-09-14T11:10:58.603854+0000","last_became_peered":"2024-09-14T11:10:58.603854+0000","last_unstale":"2024-09-14T12:10:18.981965+0000","last_undegraded":"2024-09-14T12:10:18.981965+0000","last_fullsized":"2024-09-14T12:10:18.981965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-14T12:10:18.981860+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.981860+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:07.103412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":158,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'350","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.486884+0000","last_change":"2024-09-14T12:10:12.486823+0000","last_active":"2024-09-14T12:10:12.486884+0000","last_peered":"2024-09-14T12:10:12.486884+0000","last_clean":"2024-09-14T12:10:12.486884+0000","last_became_active":"2024-09-14T11:11:32.790755+0000","last_became_peered":"2024-09-14T11:11:32.790755+0000","last_unstale":"2024-09-14T12:10:12.486884+0000","last_undegraded":"2024-09-14T12:10:12.486884+0000","last_fullsized":"2024-09-14T12:10:12.486884+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-14T12:10:12.486683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.486683+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:55.966016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":627,"num_read_kb":84521,"num_write":1155,"num_write_kb":49135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'320","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.679975+0000","last_change":"2024-09-14T12:10:20.679975+0000","last_active":"2024-09-14T12:10:20.679975+0000","last_peered":"2024-09-14T12:10:20.679975+0000","last_clean":"2024-09-14T12:10:20.679975+0000","last_became_active":"2024-09-14T11:10:58.601276+0000","last_became_peered":"2024-09-14T11:10:58.601276+0000","last_unstale":"2024-09-14T12:10:20.679975+0000","last_undegraded":"2024-09-14T12:10:20.679975+0000","last_fullsized":"2024-09-14T12:10:20.679975+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:20.679881+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:20.679881+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.679881+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:50.257170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1447,"num_read_kb":1189,"num_write":533,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'381","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.085667+0000","last_change":"2024-09-14T12:10:07.085587+0000","last_active":"2024-09-14T12:10:07.085667+0000","last_peered":"2024-09-14T12:10:07.085667+0000","last_clean":"2024-09-14T12:10:07.085667+0000","last_became_active":"2024-09-14T11:10:56.614477+0000","last_became_peered":"2024-09-14T11:10:56.614477+0000","last_unstale":"2024-09-14T12:10:07.085667+0000","last_undegraded":"2024-09-14T12:10:07.085667+0000","last_fullsized":"2024-09-14T12:10:07.085667+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'381","last_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_deep_scrub":"265'381","last_deep_scrub_stamp":"2024-09-14T12:10:07.085466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.085466+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.348034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":656,"num_read_kb":32328,"num_write":1139,"num_write_kb":29444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'180","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.664539+0000","last_change":"2024-09-14T12:10:12.664539+0000","last_active":"2024-09-14T12:10:12.664539+0000","last_peered":"2024-09-14T12:10:12.664539+0000","last_clean":"2024-09-14T12:10:12.664539+0000","last_became_active":"2024-09-14T11:10:58.612395+0000","last_became_peered":"2024-09-14T11:10:58.612395+0000","last_unstale":"2024-09-14T12:10:12.664539+0000","last_undegraded":"2024-09-14T12:10:12.664539+0000","last_fullsized":"2024-09-14T12:10:12.664539+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'180","last_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_deep_scrub":"265'180","last_deep_scrub_stamp":"2024-09-14T12:10:12.664453+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.664453+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:36.687451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":776,"num_read_kb":643,"num_write":277,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'104","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.967028+0000","last_change":"2024-09-14T12:10:15.967028+0000","last_active":"2024-09-14T12:10:15.967028+0000","last_peered":"2024-09-14T12:10:15.967028+0000","last_clean":"2024-09-14T12:10:15.967028+0000","last_became_active":"2024-09-14T11:10:58.613802+0000","last_became_peered":"2024-09-14T11:10:58.613802+0000","last_unstale":"2024-09-14T12:10:15.967028+0000","last_undegraded":"2024-09-14T12:10:15.967028+0000","last_fullsized":"2024-09-14T12:10:15.967028+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:15.966942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.966942+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:08.208593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":415,"num_write":153,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'376","reported_seq":1060,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.306614+0000","last_change":"2024-09-14T12:10:07.306614+0000","last_active":"2024-09-14T12:10:07.306614+0000","last_peered":"2024-09-14T12:10:07.306614+0000","last_clean":"2024-09-14T12:10:07.306614+0000","last_became_active":"2024-09-14T11:10:56.610791+0000","last_became_peered":"2024-09-14T11:10:56.610791+0000","last_unstale":"2024-09-14T12:10:07.306614+0000","last_undegraded":"2024-09-14T12:10:07.306614+0000","last_fullsized":"2024-09-14T12:10:07.306614+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:07.306483+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.306483+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:41.620701+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159838,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":669,"num_read_kb":4801,"num_write":1283,"num_write_kb":44506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'788","reported_seq":1378,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.461288+0000","last_change":"2024-09-14T12:10:16.461288+0000","last_active":"2024-09-14T12:10:16.461288+0000","last_peered":"2024-09-14T12:10:16.461288+0000","last_clean":"2024-09-14T12:10:16.461288+0000","last_became_active":"2024-09-14T11:10:58.607592+0000","last_became_peered":"2024-09-14T11:10:58.607592+0000","last_unstale":"2024-09-14T12:10:16.461288+0000","last_undegraded":"2024-09-14T12:10:16.461288+0000","last_fullsized":"2024-09-14T12:10:16.461288+0000","mapping_epoch":27,"log_start":"262'700","ondisk_log_start":"262'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'788","last_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_deep_scrub":"265'788","last_deep_scrub_stamp":"2024-09-14T12:10:16.461206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.461206+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:32.733748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6062,"num_read_kb":5461,"num_write":1487,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'314","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.261791+0000","last_change":"2024-09-14T12:10:09.261791+0000","last_active":"2024-09-14T12:10:09.261791+0000","last_peered":"2024-09-14T12:10:09.261791+0000","last_clean":"2024-09-14T12:10:09.261791+0000","last_became_active":"2024-09-14T11:10:56.610488+0000","last_became_peered":"2024-09-14T11:10:56.610488+0000","last_unstale":"2024-09-14T12:10:09.261791+0000","last_undegraded":"2024-09-14T12:10:09.261791+0000","last_fullsized":"2024-09-14T12:10:09.261791+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:09.261563+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.261563+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:34.016334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":568,"num_read_kb":2774,"num_write":998,"num_write_kb":17011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'97","reported_seq":679,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.641090+0000","last_change":"2024-09-14T12:10:17.641090+0000","last_active":"2024-09-14T12:10:17.641090+0000","last_peered":"2024-09-14T12:10:17.641090+0000","last_clean":"2024-09-14T12:10:17.641090+0000","last_became_active":"2024-09-14T11:10:58.602756+0000","last_became_peered":"2024-09-14T11:10:58.602756+0000","last_unstale":"2024-09-14T12:10:17.641090+0000","last_undegraded":"2024-09-14T12:10:17.641090+0000","last_fullsized":"2024-09-14T12:10:17.641090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-14T12:10:17.640942+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.640942+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.697431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":361,"num_write":150,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'334","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.289358+0000","last_change":"2024-09-14T12:10:05.289358+0000","last_active":"2024-09-14T12:10:05.289358+0000","last_peered":"2024-09-14T12:10:05.289358+0000","last_clean":"2024-09-14T12:10:05.289358+0000","last_became_active":"2024-09-14T11:10:56.617265+0000","last_became_peered":"2024-09-14T11:10:56.617265+0000","last_unstale":"2024-09-14T12:10:05.289358+0000","last_undegraded":"2024-09-14T12:10:05.289358+0000","last_fullsized":"2024-09-14T12:10:05.289358+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-14T12:10:05.289211+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.289211+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.228353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":731,"num_read_kb":52006,"num_write":1108,"num_write_kb":52567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'94","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.639093+0000","last_change":"2024-09-14T12:10:09.639093+0000","last_active":"2024-09-14T12:10:09.639093+0000","last_peered":"2024-09-14T12:10:09.639093+0000","last_clean":"2024-09-14T12:10:09.639093+0000","last_became_active":"2024-09-14T11:10:58.611933+0000","last_became_peered":"2024-09-14T11:10:58.611933+0000","last_unstale":"2024-09-14T12:10:09.639093+0000","last_undegraded":"2024-09-14T12:10:09.639093+0000","last_fullsized":"2024-09-14T12:10:09.639093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:09.638966+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.638966+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:04.748932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":427,"num_read_kb":354,"num_write":136,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'371","reported_seq":1127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.865158+0000","last_change":"2024-09-14T12:10:03.865158+0000","last_active":"2024-09-14T12:10:03.865158+0000","last_peered":"2024-09-14T12:10:03.865158+0000","last_clean":"2024-09-14T12:10:03.865158+0000","last_became_active":"2024-09-14T11:10:56.621673+0000","last_became_peered":"2024-09-14T11:10:56.621673+0000","last_unstale":"2024-09-14T12:10:03.865158+0000","last_undegraded":"2024-09-14T12:10:03.865158+0000","last_fullsized":"2024-09-14T12:10:03.865158+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-14T12:10:03.865003+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.865003+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:04.754565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1062,"num_read_kb":40711,"num_write":1149,"num_write_kb":62203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'118","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.649985+0000","last_change":"2024-09-14T12:10:14.649985+0000","last_active":"2024-09-14T12:10:14.649985+0000","last_peered":"2024-09-14T12:10:14.649985+0000","last_clean":"2024-09-14T12:10:14.649985+0000","last_became_active":"2024-09-14T11:10:58.606204+0000","last_became_peered":"2024-09-14T11:10:58.606204+0000","last_unstale":"2024-09-14T12:10:14.649985+0000","last_undegraded":"2024-09-14T12:10:14.649985+0000","last_fullsized":"2024-09-14T12:10:14.649985+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-14T12:10:14.649893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.649893+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:52.251100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":545,"num_read_kb":451,"num_write":185,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'337","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.094911+0000","last_change":"2024-09-14T12:10:12.094911+0000","last_active":"2024-09-14T12:10:12.094911+0000","last_peered":"2024-09-14T12:10:12.094911+0000","last_clean":"2024-09-14T12:10:12.094911+0000","last_became_active":"2024-09-14T11:10:56.617641+0000","last_became_peered":"2024-09-14T11:10:56.617641+0000","last_unstale":"2024-09-14T12:10:12.094911+0000","last_undegraded":"2024-09-14T12:10:12.094911+0000","last_fullsized":"2024-09-14T12:10:12.094911+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-14T12:10:12.094760+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.094760+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:34.754532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254516,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":58308,"num_write":1138,"num_write_kb":30195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'278","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.953578+0000","last_change":"2024-09-14T12:10:17.953578+0000","last_active":"2024-09-14T12:10:17.953578+0000","last_peered":"2024-09-14T12:10:17.953578+0000","last_clean":"2024-09-14T12:10:17.953578+0000","last_became_active":"2024-09-14T11:10:58.599344+0000","last_became_peered":"2024-09-14T11:10:58.599344+0000","last_unstale":"2024-09-14T12:10:17.953578+0000","last_undegraded":"2024-09-14T12:10:17.953578+0000","last_fullsized":"2024-09-14T12:10:17.953578+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'278","last_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_deep_scrub":"265'278","last_deep_scrub_stamp":"2024-09-14T12:10:17.953497+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.953497+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:54.258259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1171,"num_read_kb":950,"num_write":437,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'412","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.030763+0000","last_change":"2024-09-14T12:10:02.030763+0000","last_active":"2024-09-14T12:10:02.030763+0000","last_peered":"2024-09-14T12:10:02.030763+0000","last_clean":"2024-09-14T12:10:02.030763+0000","last_became_active":"2024-09-14T11:10:56.623514+0000","last_became_peered":"2024-09-14T11:10:56.623514+0000","last_unstale":"2024-09-14T12:10:02.030763+0000","last_undegraded":"2024-09-14T12:10:02.030763+0000","last_fullsized":"2024-09-14T12:10:02.030763+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'412","last_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_deep_scrub":"265'412","last_deep_scrub_stamp":"2024-09-14T12:10:02.030666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.030666+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:19.284654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":631,"num_read_kb":94295,"num_write":1155,"num_write_kb":39185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'191","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.991978+0000","last_change":"2024-09-14T12:10:33.991978+0000","last_active":"2024-09-14T12:10:33.991978+0000","last_peered":"2024-09-14T12:10:33.991978+0000","last_clean":"2024-09-14T12:10:33.991978+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T12:10:33.991978+0000","last_undegraded":"2024-09-14T12:10:33.991978+0000","last_fullsized":"2024-09-14T12:10:33.991978+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'191","last_scrub_stamp":"2024-09-14T12:10:33.991879+0000","last_deep_scrub":"265'191","last_deep_scrub_stamp":"2024-09-14T12:10:33.991879+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.991879+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:38.776578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":209,"num_write":427,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'123","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.666541+0000","last_change":"2024-09-14T12:10:10.666541+0000","last_active":"2024-09-14T12:10:10.666541+0000","last_peered":"2024-09-14T12:10:10.666541+0000","last_clean":"2024-09-14T12:10:10.666541+0000","last_became_active":"2024-09-14T11:11:32.678062+0000","last_became_peered":"2024-09-14T11:11:32.678062+0000","last_unstale":"2024-09-14T12:10:10.666541+0000","last_undegraded":"2024-09-14T12:10:10.666541+0000","last_fullsized":"2024-09-14T12:10:10.666541+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'123","last_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_deep_scrub":"265'123","last_deep_scrub_stamp":"2024-09-14T12:10:10.666460+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.666460+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:53.474495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":559,"num_read_kb":479,"num_write":166,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"265'488","reported_seq":1230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.285231+0000","last_change":"2024-09-14T12:10:06.285231+0000","last_active":"2024-09-14T12:10:06.285231+0000","last_peered":"2024-09-14T12:10:06.285231+0000","last_clean":"2024-09-14T12:10:06.285231+0000","last_became_active":"2024-09-14T11:10:56.613626+0000","last_became_peered":"2024-09-14T11:10:56.613626+0000","last_unstale":"2024-09-14T12:10:06.285231+0000","last_undegraded":"2024-09-14T12:10:06.285231+0000","last_fullsized":"2024-09-14T12:10:06.285231+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-14T12:10:06.285136+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.285136+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:30.855826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":951,"num_read_kb":68364,"num_write":1403,"num_write_kb":47494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.602188+0000","last_change":"2024-09-14T12:10:23.602188+0000","last_active":"2024-09-14T12:10:23.602188+0000","last_peered":"2024-09-14T12:10:23.602188+0000","last_clean":"2024-09-14T12:10:23.602188+0000","last_became_active":"2024-09-14T11:11:00.612055+0000","last_became_peered":"2024-09-14T11:11:00.612055+0000","last_unstale":"2024-09-14T12:10:23.602188+0000","last_undegraded":"2024-09-14T12:10:23.602188+0000","last_fullsized":"2024-09-14T12:10:23.602188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.602105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.602105+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.602105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:03.954310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'324","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.258264+0000","last_change":"2024-09-14T12:10:22.258264+0000","last_active":"2024-09-14T12:10:22.258264+0000","last_peered":"2024-09-14T12:10:22.258264+0000","last_clean":"2024-09-14T12:10:22.258264+0000","last_became_active":"2024-09-14T11:11:02.616593+0000","last_became_peered":"2024-09-14T11:11:02.616593+0000","last_unstale":"2024-09-14T12:10:22.258264+0000","last_undegraded":"2024-09-14T12:10:22.258264+0000","last_fullsized":"2024-09-14T12:10:22.258264+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-14T12:10:22.258164+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-14T12:10:22.258164+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.258164+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:20.928434+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1030,"num_write":396,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.464251+0000","last_change":"2024-09-14T12:10:32.464251+0000","last_active":"2024-09-14T12:10:32.464251+0000","last_peered":"2024-09-14T12:10:32.464251+0000","last_clean":"2024-09-14T12:10:32.464251+0000","last_became_active":"2024-09-14T11:11:04.629736+0000","last_became_peered":"2024-09-14T11:11:04.629736+0000","last_unstale":"2024-09-14T12:10:32.464251+0000","last_undegraded":"2024-09-14T12:10:32.464251+0000","last_fullsized":"2024-09-14T12:10:32.464251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.464135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.464135+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.464135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:13.501971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'132","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.562184+0000","last_change":"2024-09-14T12:10:36.562184+0000","last_active":"2024-09-14T12:10:36.562184+0000","last_peered":"2024-09-14T12:10:36.562184+0000","last_clean":"2024-09-14T12:10:36.562184+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:10:36.562184+0000","last_undegraded":"2024-09-14T12:10:36.562184+0000","last_fullsized":"2024-09-14T12:10:36.562184+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-14T12:10:36.562090+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-14T12:10:36.562090+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.562090+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.296268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":103,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'282","reported_seq":929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.667533+0000","last_change":"2024-09-14T12:10:14.667533+0000","last_active":"2024-09-14T12:10:14.667533+0000","last_peered":"2024-09-14T12:10:14.667533+0000","last_clean":"2024-09-14T12:10:14.667533+0000","last_became_active":"2024-09-14T11:10:58.598587+0000","last_became_peered":"2024-09-14T11:10:58.598587+0000","last_unstale":"2024-09-14T12:10:14.667533+0000","last_undegraded":"2024-09-14T12:10:14.667533+0000","last_fullsized":"2024-09-14T12:10:14.667533+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'282","last_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_deep_scrub":"265'282","last_deep_scrub_stamp":"2024-09-14T12:10:14.667432+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.667432+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:35.887947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1227,"num_read_kb":1004,"num_write":472,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'285","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.047316+0000","last_change":"2024-09-14T12:09:59.047316+0000","last_active":"2024-09-14T12:09:59.047316+0000","last_peered":"2024-09-14T12:09:59.047316+0000","last_clean":"2024-09-14T12:09:59.047316+0000","last_became_active":"2024-09-14T11:10:56.623073+0000","last_became_peered":"2024-09-14T11:10:56.623073+0000","last_unstale":"2024-09-14T12:09:59.047316+0000","last_undegraded":"2024-09-14T12:09:59.047316+0000","last_fullsized":"2024-09-14T12:09:59.047316+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'285","last_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_deep_scrub":"265'285","last_deep_scrub_stamp":"2024-09-14T12:09:59.047215+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.047215+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:06.088837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":825,"num_read_kb":44655,"num_write":1001,"num_write_kb":29251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.224044+0000","last_change":"2024-09-14T12:10:20.224044+0000","last_active":"2024-09-14T12:10:20.224044+0000","last_peered":"2024-09-14T12:10:20.224044+0000","last_clean":"2024-09-14T12:10:20.224044+0000","last_became_active":"2024-09-14T11:11:00.610439+0000","last_became_peered":"2024-09-14T11:11:00.610439+0000","last_unstale":"2024-09-14T12:10:20.224044+0000","last_undegraded":"2024-09-14T12:10:20.224044+0000","last_fullsized":"2024-09-14T12:10:20.224044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.223950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.223950+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.223950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:08.471542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'99","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.093239+0000","last_change":"2024-09-14T12:10:26.093239+0000","last_active":"2024-09-14T12:10:26.093239+0000","last_peered":"2024-09-14T12:10:26.093239+0000","last_clean":"2024-09-14T12:10:26.093239+0000","last_became_active":"2024-09-14T11:11:02.615801+0000","last_became_peered":"2024-09-14T11:11:02.615801+0000","last_unstale":"2024-09-14T12:10:26.093239+0000","last_undegraded":"2024-09-14T12:10:26.093239+0000","last_fullsized":"2024-09-14T12:10:26.093239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-14T12:10:26.093140+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-14T12:10:26.093140+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.093140+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:09.909515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":97,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.088634+0000","last_change":"2024-09-14T12:10:28.088634+0000","last_active":"2024-09-14T12:10:28.088634+0000","last_peered":"2024-09-14T12:10:28.088634+0000","last_clean":"2024-09-14T12:10:28.088634+0000","last_became_active":"2024-09-14T11:11:04.636041+0000","last_became_peered":"2024-09-14T11:11:04.636041+0000","last_unstale":"2024-09-14T12:10:28.088634+0000","last_undegraded":"2024-09-14T12:10:28.088634+0000","last_fullsized":"2024-09-14T12:10:28.088634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.088515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.088515+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.088515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:55.904182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'151","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.204745+0000","last_change":"2024-09-14T12:10:32.204685+0000","last_active":"2024-09-14T12:10:32.204745+0000","last_peered":"2024-09-14T12:10:32.204745+0000","last_clean":"2024-09-14T12:10:32.204745+0000","last_became_active":"2024-09-14T11:11:06.647058+0000","last_became_peered":"2024-09-14T11:11:06.647058+0000","last_unstale":"2024-09-14T12:10:32.204745+0000","last_undegraded":"2024-09-14T12:10:32.204745+0000","last_fullsized":"2024-09-14T12:10:32.204745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-14T12:10:32.204581+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-14T12:10:32.204581+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.204581+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:14.251567+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":336,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'243","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.148946+0000","last_change":"2024-09-14T12:10:10.148946+0000","last_active":"2024-09-14T12:10:10.148946+0000","last_peered":"2024-09-14T12:10:10.148946+0000","last_clean":"2024-09-14T12:10:10.148946+0000","last_became_active":"2024-09-14T11:10:58.615481+0000","last_became_peered":"2024-09-14T11:10:58.615481+0000","last_unstale":"2024-09-14T12:10:10.148946+0000","last_undegraded":"2024-09-14T12:10:10.148946+0000","last_fullsized":"2024-09-14T12:10:10.148946+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'243","last_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_deep_scrub":"265'243","last_deep_scrub_stamp":"2024-09-14T12:10:10.148844+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.148844+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:48.584464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1030,"num_read_kb":830,"num_write":375,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'405","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.397851+0000","last_change":"2024-09-14T12:10:10.397851+0000","last_active":"2024-09-14T12:10:10.397851+0000","last_peered":"2024-09-14T12:10:10.397851+0000","last_clean":"2024-09-14T12:10:10.397851+0000","last_became_active":"2024-09-14T11:10:56.613685+0000","last_became_peered":"2024-09-14T11:10:56.613685+0000","last_unstale":"2024-09-14T12:10:10.397851+0000","last_undegraded":"2024-09-14T12:10:10.397851+0000","last_fullsized":"2024-09-14T12:10:10.397851+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-14T12:10:10.397701+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.397701+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:07.184919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":632,"num_read_kb":37555,"num_write":1183,"num_write_kb":34261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.224896+0000","last_change":"2024-09-14T12:10:21.224896+0000","last_active":"2024-09-14T12:10:21.224896+0000","last_peered":"2024-09-14T12:10:21.224896+0000","last_clean":"2024-09-14T12:10:21.224896+0000","last_became_active":"2024-09-14T11:11:00.613348+0000","last_became_peered":"2024-09-14T11:11:00.613348+0000","last_unstale":"2024-09-14T12:10:21.224896+0000","last_undegraded":"2024-09-14T12:10:21.224896+0000","last_fullsized":"2024-09-14T12:10:21.224896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.224794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.224794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.224794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:51.879744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'122","reported_seq":670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.734696+0000","last_change":"2024-09-14T12:10:19.734696+0000","last_active":"2024-09-14T12:10:19.734696+0000","last_peered":"2024-09-14T12:10:19.734696+0000","last_clean":"2024-09-14T12:10:19.734696+0000","last_became_active":"2024-09-14T11:11:02.616230+0000","last_became_peered":"2024-09-14T11:11:02.616230+0000","last_unstale":"2024-09-14T12:10:19.734696+0000","last_undegraded":"2024-09-14T12:10:19.734696+0000","last_fullsized":"2024-09-14T12:10:19.734696+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-14T12:10:19.734578+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-14T12:10:19.734578+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.734578+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:55.917431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'771","reported_seq":2422,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.472135+0000","last_change":"2024-09-14T12:10:31.472135+0000","last_active":"2024-09-14T12:10:31.472135+0000","last_peered":"2024-09-14T12:10:31.472135+0000","last_clean":"2024-09-14T12:10:31.472135+0000","last_became_active":"2024-09-14T11:11:04.634381+0000","last_became_peered":"2024-09-14T11:11:04.634381+0000","last_unstale":"2024-09-14T12:10:31.472135+0000","last_undegraded":"2024-09-14T12:10:31.472135+0000","last_fullsized":"2024-09-14T12:10:31.472135+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-14T12:10:31.472023+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-14T12:10:31.472023+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.472023+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:18.719751+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'219","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.993686+0000","last_change":"2024-09-14T12:10:34.993612+0000","last_active":"2024-09-14T12:10:34.993686+0000","last_peered":"2024-09-14T12:10:34.993686+0000","last_clean":"2024-09-14T12:10:34.993686+0000","last_became_active":"2024-09-14T11:11:06.650279+0000","last_became_peered":"2024-09-14T11:11:06.650279+0000","last_unstale":"2024-09-14T12:10:34.993686+0000","last_undegraded":"2024-09-14T12:10:34.993686+0000","last_fullsized":"2024-09-14T12:10:34.993686+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'219","last_scrub_stamp":"2024-09-14T12:10:34.993525+0000","last_deep_scrub":"265'219","last_deep_scrub_stamp":"2024-09-14T12:10:34.993525+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.993525+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:16.682973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":598,"num_read_kb":596,"num_write":477,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'263","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.087612+0000","last_change":"2024-09-14T12:10:10.087612+0000","last_active":"2024-09-14T12:10:10.087612+0000","last_peered":"2024-09-14T12:10:10.087612+0000","last_clean":"2024-09-14T12:10:10.087612+0000","last_became_active":"2024-09-14T11:10:58.602511+0000","last_became_peered":"2024-09-14T11:10:58.602511+0000","last_unstale":"2024-09-14T12:10:10.087612+0000","last_undegraded":"2024-09-14T12:10:10.087612+0000","last_fullsized":"2024-09-14T12:10:10.087612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'263","last_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_deep_scrub":"265'263","last_deep_scrub_stamp":"2024-09-14T12:10:10.087521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.087521+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:48.169805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":921,"num_write":393,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'422","reported_seq":1130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.319589+0000","last_change":"2024-09-14T12:10:02.319589+0000","last_active":"2024-09-14T12:10:02.319589+0000","last_peered":"2024-09-14T12:10:02.319589+0000","last_clean":"2024-09-14T12:10:02.319589+0000","last_became_active":"2024-09-14T11:10:56.610971+0000","last_became_peered":"2024-09-14T11:10:56.610971+0000","last_unstale":"2024-09-14T12:10:02.319589+0000","last_undegraded":"2024-09-14T12:10:02.319589+0000","last_fullsized":"2024-09-14T12:10:02.319589+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'422","last_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_deep_scrub":"265'422","last_deep_scrub_stamp":"2024-09-14T12:10:02.319485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.319485+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:23.716370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1004,"num_read_kb":6071,"num_write":1268,"num_write_kb":30134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.599185+0000","last_change":"2024-09-14T12:10:24.599185+0000","last_active":"2024-09-14T12:10:24.599185+0000","last_peered":"2024-09-14T12:10:24.599185+0000","last_clean":"2024-09-14T12:10:24.599185+0000","last_became_active":"2024-09-14T11:11:00.611601+0000","last_became_peered":"2024-09-14T11:11:00.611601+0000","last_unstale":"2024-09-14T12:10:24.599185+0000","last_undegraded":"2024-09-14T12:10:24.599185+0000","last_fullsized":"2024-09-14T12:10:24.599185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:24.599092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:24.599092+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.599092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:25.066364+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'292","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.474782+0000","last_change":"2024-09-14T12:10:27.474782+0000","last_active":"2024-09-14T12:10:27.474782+0000","last_peered":"2024-09-14T12:10:27.474782+0000","last_clean":"2024-09-14T12:10:27.474782+0000","last_became_active":"2024-09-14T11:11:02.882719+0000","last_became_peered":"2024-09-14T11:11:02.882719+0000","last_unstale":"2024-09-14T12:10:27.474782+0000","last_undegraded":"2024-09-14T12:10:27.474782+0000","last_fullsized":"2024-09-14T12:10:27.474782+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'292","last_scrub_stamp":"2024-09-14T12:10:27.474683+0000","last_deep_scrub":"265'292","last_deep_scrub_stamp":"2024-09-14T12:10:27.474683+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.474683+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:48:12.392164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45066,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1093,"num_write":386,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'793","reported_seq":2497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.127033+0000","last_change":"2024-09-14T12:10:33.127033+0000","last_active":"2024-09-14T12:10:33.127033+0000","last_peered":"2024-09-14T12:10:33.127033+0000","last_clean":"2024-09-14T12:10:33.127033+0000","last_became_active":"2024-09-14T11:11:04.639455+0000","last_became_peered":"2024-09-14T11:11:04.639455+0000","last_unstale":"2024-09-14T12:10:33.127033+0000","last_undegraded":"2024-09-14T12:10:33.127033+0000","last_fullsized":"2024-09-14T12:10:33.127033+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-14T12:10:33.126938+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-14T12:10:33.126938+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.126938+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:43.707386+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'172","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666351+0000","last_change":"2024-09-14T12:10:15.666351+0000","last_active":"2024-09-14T12:10:15.666351+0000","last_peered":"2024-09-14T12:10:15.666351+0000","last_clean":"2024-09-14T12:10:15.666351+0000","last_became_active":"2024-09-14T11:10:58.597717+0000","last_became_peered":"2024-09-14T11:10:58.597717+0000","last_unstale":"2024-09-14T12:10:15.666351+0000","last_undegraded":"2024-09-14T12:10:15.666351+0000","last_fullsized":"2024-09-14T12:10:15.666351+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'172","last_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_deep_scrub":"265'172","last_deep_scrub_stamp":"2024-09-14T12:10:15.666266+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.666266+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:56.819864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":901,"num_read_kb":783,"num_write":301,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'373","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.247413+0000","last_change":"2024-09-14T12:10:03.247413+0000","last_active":"2024-09-14T12:10:03.247413+0000","last_peered":"2024-09-14T12:10:03.247413+0000","last_clean":"2024-09-14T12:10:03.247413+0000","last_became_active":"2024-09-14T11:10:56.615515+0000","last_became_peered":"2024-09-14T11:10:56.615515+0000","last_unstale":"2024-09-14T12:10:03.247413+0000","last_undegraded":"2024-09-14T12:10:03.247413+0000","last_fullsized":"2024-09-14T12:10:03.247413+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.247260+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.247260+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:03.568283+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343358,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":30361,"num_write":1111,"num_write_kb":20084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.563706+0000","last_change":"2024-09-14T12:10:19.563706+0000","last_active":"2024-09-14T12:10:19.563706+0000","last_peered":"2024-09-14T12:10:19.563706+0000","last_clean":"2024-09-14T12:10:19.563706+0000","last_became_active":"2024-09-14T11:11:00.603358+0000","last_became_peered":"2024-09-14T11:11:00.603358+0000","last_unstale":"2024-09-14T12:10:19.563706+0000","last_undegraded":"2024-09-14T12:10:19.563706+0000","last_fullsized":"2024-09-14T12:10:19.563706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.563568+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.563568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:52.176982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'389","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.697605+0000","last_change":"2024-09-14T12:10:28.697605+0000","last_active":"2024-09-14T12:10:28.697605+0000","last_peered":"2024-09-14T12:10:28.697605+0000","last_clean":"2024-09-14T12:10:28.697605+0000","last_became_active":"2024-09-14T11:11:02.882012+0000","last_became_peered":"2024-09-14T11:11:02.882012+0000","last_unstale":"2024-09-14T12:10:28.697605+0000","last_undegraded":"2024-09-14T12:10:28.697605+0000","last_fullsized":"2024-09-14T12:10:28.697605+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-14T12:10:28.697498+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-14T12:10:28.697498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.697498+0000","objects_scrubbed":9,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:12.455664+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":626,"num_read_kb":1304,"num_write":494,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.832140+0000","last_change":"2024-09-14T12:10:20.832140+0000","last_active":"2024-09-14T12:10:20.832140+0000","last_peered":"2024-09-14T12:10:20.832140+0000","last_clean":"2024-09-14T12:10:20.832140+0000","last_became_active":"2024-09-14T11:11:04.630439+0000","last_became_peered":"2024-09-14T11:11:04.630439+0000","last_unstale":"2024-09-14T12:10:20.832140+0000","last_undegraded":"2024-09-14T12:10:20.832140+0000","last_fullsized":"2024-09-14T12:10:20.832140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.832059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.832059+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.832059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:57.670837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'540","reported_seq":1365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.582821+0000","last_change":"2024-09-14T12:10:32.582821+0000","last_active":"2024-09-14T12:10:32.582821+0000","last_peered":"2024-09-14T12:10:32.582821+0000","last_clean":"2024-09-14T12:10:32.582821+0000","last_became_active":"2024-09-14T11:11:06.649868+0000","last_became_peered":"2024-09-14T11:11:06.649868+0000","last_unstale":"2024-09-14T12:10:32.582821+0000","last_undegraded":"2024-09-14T12:10:32.582821+0000","last_fullsized":"2024-09-14T12:10:32.582821+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-14T12:10:32.582710+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-14T12:10:32.582710+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.582710+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:15.319374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1273,"num_read_kb":1268,"num_write":1134,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'276","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.875048+0000","last_change":"2024-09-14T12:10:04.875048+0000","last_active":"2024-09-14T12:10:04.875048+0000","last_peered":"2024-09-14T12:10:04.875048+0000","last_clean":"2024-09-14T12:10:04.875048+0000","last_became_active":"2024-09-14T11:10:58.599325+0000","last_became_peered":"2024-09-14T11:10:58.599325+0000","last_unstale":"2024-09-14T12:10:04.875048+0000","last_undegraded":"2024-09-14T12:10:04.875048+0000","last_fullsized":"2024-09-14T12:10:04.875048+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-14T12:10:04.874958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.874958+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:10.686558+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1046,"num_write":425,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'384","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.371688+0000","last_change":"2024-09-14T12:10:09.371688+0000","last_active":"2024-09-14T12:10:09.371688+0000","last_peered":"2024-09-14T12:10:09.371688+0000","last_clean":"2024-09-14T12:10:09.371688+0000","last_became_active":"2024-09-14T11:10:56.607769+0000","last_became_peered":"2024-09-14T11:10:56.607769+0000","last_unstale":"2024-09-14T12:10:09.371688+0000","last_undegraded":"2024-09-14T12:10:09.371688+0000","last_fullsized":"2024-09-14T12:10:09.371688+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-14T12:10:09.371601+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.371601+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:05.670350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":916,"num_read_kb":57128,"num_write":1152,"num_write_kb":36640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.716284+0000","last_change":"2024-09-14T12:10:20.716284+0000","last_active":"2024-09-14T12:10:20.716284+0000","last_peered":"2024-09-14T12:10:20.716284+0000","last_clean":"2024-09-14T12:10:20.716284+0000","last_became_active":"2024-09-14T11:11:00.610083+0000","last_became_peered":"2024-09-14T11:11:00.610083+0000","last_unstale":"2024-09-14T12:10:20.716284+0000","last_undegraded":"2024-09-14T12:10:20.716284+0000","last_fullsized":"2024-09-14T12:10:20.716284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.716198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.716198+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.716198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:51.902300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'274","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.253520+0000","last_change":"2024-09-14T12:10:23.253520+0000","last_active":"2024-09-14T12:10:23.253520+0000","last_peered":"2024-09-14T12:10:23.253520+0000","last_clean":"2024-09-14T12:10:23.253520+0000","last_became_active":"2024-09-14T11:11:02.619809+0000","last_became_peered":"2024-09-14T11:11:02.619809+0000","last_unstale":"2024-09-14T12:10:23.253520+0000","last_undegraded":"2024-09-14T12:10:23.253520+0000","last_fullsized":"2024-09-14T12:10:23.253520+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:23.253433+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:23.253433+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.253433+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.585150+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45192,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":466,"num_read_kb":1099,"num_write":382,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.164088+0000","last_change":"2024-09-14T12:10:31.164088+0000","last_active":"2024-09-14T12:10:31.164088+0000","last_peered":"2024-09-14T12:10:31.164088+0000","last_clean":"2024-09-14T12:10:31.164088+0000","last_became_active":"2024-09-14T11:11:04.638483+0000","last_became_peered":"2024-09-14T11:11:04.638483+0000","last_unstale":"2024-09-14T12:10:31.164088+0000","last_undegraded":"2024-09-14T12:10:31.164088+0000","last_fullsized":"2024-09-14T12:10:31.164088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:31.163976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:31.163976+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.163976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:48.664750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'2498","reported_seq":4327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.435653+0000","last_change":"2024-09-14T12:10:23.435653+0000","last_active":"2024-09-14T12:10:23.435653+0000","last_peered":"2024-09-14T12:10:23.435653+0000","last_clean":"2024-09-14T12:10:23.435653+0000","last_became_active":"2024-09-14T11:11:06.650114+0000","last_became_peered":"2024-09-14T11:11:06.650114+0000","last_unstale":"2024-09-14T12:10:23.435653+0000","last_undegraded":"2024-09-14T12:10:23.435653+0000","last_fullsized":"2024-09-14T12:10:23.435653+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2498","last_scrub_stamp":"2024-09-14T12:10:23.435533+0000","last_deep_scrub":"265'2498","last_deep_scrub_stamp":"2024-09-14T12:10:23.435533+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.435533+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":2400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:39.924000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6181,"num_read_kb":6183,"num_write":5037,"num_write_kb":1851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'4178","reported_seq":4828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.262356+0000","last_change":"2024-09-14T12:10:08.262356+0000","last_active":"2024-09-14T12:10:08.262356+0000","last_peered":"2024-09-14T12:10:08.262356+0000","last_clean":"2024-09-14T12:10:08.262356+0000","last_became_active":"2024-09-14T11:10:58.612012+0000","last_became_peered":"2024-09-14T11:10:58.612012+0000","last_unstale":"2024-09-14T12:10:08.262356+0000","last_undegraded":"2024-09-14T12:10:08.262356+0000","last_fullsized":"2024-09-14T12:10:08.262356+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4178","last_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_deep_scrub":"265'4178","last_deep_scrub_stamp":"2024-09-14T12:10:08.262241+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.262241+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:42.755259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16812,"num_read_kb":14102,"num_write":6259,"num_write_kb":3114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'356","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.272037+0000","last_change":"2024-09-14T12:10:05.272037+0000","last_active":"2024-09-14T12:10:05.272037+0000","last_peered":"2024-09-14T12:10:05.272037+0000","last_clean":"2024-09-14T12:10:05.272037+0000","last_became_active":"2024-09-14T11:10:56.609151+0000","last_became_peered":"2024-09-14T11:10:56.609151+0000","last_unstale":"2024-09-14T12:10:05.272037+0000","last_undegraded":"2024-09-14T12:10:05.272037+0000","last_fullsized":"2024-09-14T12:10:05.272037+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.271893+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.271893+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.064154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":623,"num_read_kb":21988,"num_write":1237,"num_write_kb":51059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.666026+0000","last_change":"2024-09-14T12:10:15.666026+0000","last_active":"2024-09-14T12:10:15.666026+0000","last_peered":"2024-09-14T12:10:15.666026+0000","last_clean":"2024-09-14T12:10:15.666026+0000","last_became_active":"2024-09-14T11:11:00.609295+0000","last_became_peered":"2024-09-14T11:11:00.609295+0000","last_unstale":"2024-09-14T12:10:15.666026+0000","last_undegraded":"2024-09-14T12:10:15.666026+0000","last_fullsized":"2024-09-14T12:10:15.666026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.665936+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.665936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:15.551151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'317","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.497008+0000","last_change":"2024-09-14T12:10:25.497008+0000","last_active":"2024-09-14T12:10:25.497008+0000","last_peered":"2024-09-14T12:10:25.497008+0000","last_clean":"2024-09-14T12:10:25.497008+0000","last_became_active":"2024-09-14T11:11:02.614981+0000","last_became_peered":"2024-09-14T11:11:02.614981+0000","last_unstale":"2024-09-14T12:10:25.497008+0000","last_undegraded":"2024-09-14T12:10:25.497008+0000","last_fullsized":"2024-09-14T12:10:25.497008+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-14T12:10:25.496914+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-14T12:10:25.496914+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.496914+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:09.096079+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42392,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":493,"num_read_kb":1048,"num_write":394,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'781","reported_seq":2803,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.130857+0000","last_change":"2024-09-14T12:10:25.130857+0000","last_active":"2024-09-14T12:10:25.130857+0000","last_peered":"2024-09-14T12:10:25.130857+0000","last_clean":"2024-09-14T12:10:25.130857+0000","last_became_active":"2024-09-14T11:11:04.634013+0000","last_became_peered":"2024-09-14T11:11:04.634013+0000","last_unstale":"2024-09-14T12:10:25.130857+0000","last_undegraded":"2024-09-14T12:10:25.130857+0000","last_fullsized":"2024-09-14T12:10:25.130857+0000","mapping_epoch":33,"log_start":"265'701","ondisk_log_start":"265'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'781","last_scrub_stamp":"2024-09-14T12:10:25.130754+0000","last_deep_scrub":"265'781","last_deep_scrub_stamp":"2024-09-14T12:10:25.130754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.130754+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":701,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:22.723670+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'155","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.155833+0000","last_change":"2024-09-14T12:10:29.155833+0000","last_active":"2024-09-14T12:10:29.155833+0000","last_peered":"2024-09-14T12:10:29.155833+0000","last_clean":"2024-09-14T12:10:29.155833+0000","last_became_active":"2024-09-14T11:11:06.647911+0000","last_became_peered":"2024-09-14T11:11:06.647911+0000","last_unstale":"2024-09-14T12:10:29.155833+0000","last_undegraded":"2024-09-14T12:10:29.155833+0000","last_fullsized":"2024-09-14T12:10:29.155833+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'155","last_scrub_stamp":"2024-09-14T12:10:29.155743+0000","last_deep_scrub":"265'155","last_deep_scrub_stamp":"2024-09-14T12:10:29.155743+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.155743+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:29.322939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":366,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'114","reported_seq":711,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.120635+0000","last_change":"2024-09-14T12:10:09.120635+0000","last_active":"2024-09-14T12:10:09.120635+0000","last_peered":"2024-09-14T12:10:09.120635+0000","last_clean":"2024-09-14T12:10:09.120635+0000","last_became_active":"2024-09-14T11:10:58.614248+0000","last_became_peered":"2024-09-14T11:10:58.614248+0000","last_unstale":"2024-09-14T12:10:09.120635+0000","last_undegraded":"2024-09-14T12:10:09.120635+0000","last_fullsized":"2024-09-14T12:10:09.120635+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:09.120547+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.120547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:00.785994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":481,"num_read_kb":403,"num_write":156,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'364","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.791535+0000","last_change":"2024-09-14T12:10:04.791535+0000","last_active":"2024-09-14T12:10:04.791535+0000","last_peered":"2024-09-14T12:10:04.791535+0000","last_clean":"2024-09-14T12:10:04.791535+0000","last_became_active":"2024-09-14T11:10:56.621868+0000","last_became_peered":"2024-09-14T11:10:56.621868+0000","last_unstale":"2024-09-14T12:10:04.791535+0000","last_undegraded":"2024-09-14T12:10:04.791535+0000","last_fullsized":"2024-09-14T12:10:04.791535+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:04.791431+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.791431+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:20.658739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":676,"num_read_kb":27518,"num_write":1082,"num_write_kb":17940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.698872+0000","last_change":"2024-09-14T12:10:18.698872+0000","last_active":"2024-09-14T12:10:18.698872+0000","last_peered":"2024-09-14T12:10:18.698872+0000","last_clean":"2024-09-14T12:10:18.698872+0000","last_became_active":"2024-09-14T11:11:00.616712+0000","last_became_peered":"2024-09-14T11:11:00.616712+0000","last_unstale":"2024-09-14T12:10:18.698872+0000","last_undegraded":"2024-09-14T12:10:18.698872+0000","last_fullsized":"2024-09-14T12:10:18.698872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.698762+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.698762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:25.328497+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'483","reported_seq":1128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.266110+0000","last_change":"2024-09-14T12:10:20.266110+0000","last_active":"2024-09-14T12:10:20.266110+0000","last_peered":"2024-09-14T12:10:20.266110+0000","last_clean":"2024-09-14T12:10:20.266110+0000","last_became_active":"2024-09-14T11:11:02.616941+0000","last_became_peered":"2024-09-14T11:11:02.616941+0000","last_unstale":"2024-09-14T12:10:20.266110+0000","last_undegraded":"2024-09-14T12:10:20.266110+0000","last_fullsized":"2024-09-14T12:10:20.266110+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'483","last_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_deep_scrub":"265'483","last_deep_scrub_stamp":"2024-09-14T12:10:20.265983+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.265983+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:56.414346+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100274,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":841,"num_read_kb":1995,"num_write":694,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.712406+0000","last_change":"2024-09-14T12:10:21.712406+0000","last_active":"2024-09-14T12:10:21.712406+0000","last_peered":"2024-09-14T12:10:21.712406+0000","last_clean":"2024-09-14T12:10:21.712406+0000","last_became_active":"2024-09-14T11:11:04.628843+0000","last_became_peered":"2024-09-14T11:11:04.628843+0000","last_unstale":"2024-09-14T12:10:21.712406+0000","last_undegraded":"2024-09-14T12:10:21.712406+0000","last_fullsized":"2024-09-14T12:10:21.712406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.712312+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.712312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:54.774758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'176","reported_seq":701,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.884994+0000","last_change":"2024-09-14T12:10:24.884994+0000","last_active":"2024-09-14T12:10:24.884994+0000","last_peered":"2024-09-14T12:10:24.884994+0000","last_clean":"2024-09-14T12:10:24.884994+0000","last_became_active":"2024-09-14T11:11:06.652134+0000","last_became_peered":"2024-09-14T11:11:06.652134+0000","last_unstale":"2024-09-14T12:10:24.884994+0000","last_undegraded":"2024-09-14T12:10:24.884994+0000","last_fullsized":"2024-09-14T12:10:24.884994+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:24.884849+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:24.884849+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.884849+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:18.793560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":440,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'179","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.864662+0000","last_change":"2024-09-14T12:10:05.864662+0000","last_active":"2024-09-14T12:10:05.864662+0000","last_peered":"2024-09-14T12:10:05.864662+0000","last_clean":"2024-09-14T12:10:05.864662+0000","last_became_active":"2024-09-14T11:10:58.611998+0000","last_became_peered":"2024-09-14T11:10:58.611998+0000","last_unstale":"2024-09-14T12:10:05.864662+0000","last_undegraded":"2024-09-14T12:10:05.864662+0000","last_fullsized":"2024-09-14T12:10:05.864662+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'179","last_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_deep_scrub":"265'179","last_deep_scrub_stamp":"2024-09-14T12:10:05.864516+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.864516+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:37.987122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":671,"num_write":295,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'302","reported_seq":892,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.548979+0000","last_change":"2024-09-14T12:10:00.548905+0000","last_active":"2024-09-14T12:10:00.548979+0000","last_peered":"2024-09-14T12:10:00.548979+0000","last_clean":"2024-09-14T12:10:00.548979+0000","last_became_active":"2024-09-14T11:12:33.311017+0000","last_became_peered":"2024-09-14T11:12:33.311017+0000","last_unstale":"2024-09-14T12:10:00.548979+0000","last_undegraded":"2024-09-14T12:10:00.548979+0000","last_fullsized":"2024-09-14T12:10:00.548979+0000","mapping_epoch":40,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-14T12:10:00.548789+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.548789+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:47.038045+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":20886,"num_write":921,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.709439+0000","last_change":"2024-09-14T12:10:16.709439+0000","last_active":"2024-09-14T12:10:16.709439+0000","last_peered":"2024-09-14T12:10:16.709439+0000","last_clean":"2024-09-14T12:10:16.709439+0000","last_became_active":"2024-09-14T11:11:00.613301+0000","last_became_peered":"2024-09-14T11:11:00.613301+0000","last_unstale":"2024-09-14T12:10:16.709439+0000","last_undegraded":"2024-09-14T12:10:16.709439+0000","last_fullsized":"2024-09-14T12:10:16.709439+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.709344+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.709344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:41.114596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'287","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.116437+0000","last_change":"2024-09-14T12:10:24.116437+0000","last_active":"2024-09-14T12:10:24.116437+0000","last_peered":"2024-09-14T12:10:24.116437+0000","last_clean":"2024-09-14T12:10:24.116437+0000","last_became_active":"2024-09-14T11:11:02.616868+0000","last_became_peered":"2024-09-14T11:11:02.616868+0000","last_unstale":"2024-09-14T12:10:24.116437+0000","last_undegraded":"2024-09-14T12:10:24.116437+0000","last_fullsized":"2024-09-14T12:10:24.116437+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'287","last_scrub_stamp":"2024-09-14T12:10:24.116328+0000","last_deep_scrub":"265'287","last_deep_scrub_stamp":"2024-09-14T12:10:24.116328+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.116328+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:29.318558+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47173,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":486,"num_read_kb":1050,"num_write":432,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.091785+0000","last_change":"2024-09-14T12:10:26.091785+0000","last_active":"2024-09-14T12:10:26.091785+0000","last_peered":"2024-09-14T12:10:26.091785+0000","last_clean":"2024-09-14T12:10:26.091785+0000","last_became_active":"2024-09-14T11:11:04.638089+0000","last_became_peered":"2024-09-14T11:11:04.638089+0000","last_unstale":"2024-09-14T12:10:26.091785+0000","last_undegraded":"2024-09-14T12:10:26.091785+0000","last_fullsized":"2024-09-14T12:10:26.091785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:26.091699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:26.091699+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.091699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:46.567994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'99","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.120821+0000","last_change":"2024-09-14T12:10:35.120762+0000","last_active":"2024-09-14T12:10:35.120821+0000","last_peered":"2024-09-14T12:10:35.120821+0000","last_clean":"2024-09-14T12:10:35.120821+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:10:35.120821+0000","last_undegraded":"2024-09-14T12:10:35.120821+0000","last_fullsized":"2024-09-14T12:10:35.120821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'99","last_scrub_stamp":"2024-09-14T12:10:35.120667+0000","last_deep_scrub":"265'99","last_deep_scrub_stamp":"2024-09-14T12:10:35.120667+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.120667+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:51.522650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":104,"num_write":232,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'87","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.862166+0000","last_change":"2024-09-14T12:10:06.862166+0000","last_active":"2024-09-14T12:10:06.862166+0000","last_peered":"2024-09-14T12:10:06.862166+0000","last_clean":"2024-09-14T12:10:06.862166+0000","last_became_active":"2024-09-14T11:10:58.605275+0000","last_became_peered":"2024-09-14T11:10:58.605275+0000","last_unstale":"2024-09-14T12:10:06.862166+0000","last_undegraded":"2024-09-14T12:10:06.862166+0000","last_fullsized":"2024-09-14T12:10:06.862166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'87","last_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_deep_scrub":"265'87","last_deep_scrub_stamp":"2024-09-14T12:10:06.862087+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.862087+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:39.538988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":121,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'354","reported_seq":1087,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.319113+0000","last_change":"2024-09-14T12:10:03.319113+0000","last_active":"2024-09-14T12:10:03.319113+0000","last_peered":"2024-09-14T12:10:03.319113+0000","last_clean":"2024-09-14T12:10:03.319113+0000","last_became_active":"2024-09-14T11:10:56.604301+0000","last_became_peered":"2024-09-14T11:10:56.604301+0000","last_unstale":"2024-09-14T12:10:03.319113+0000","last_undegraded":"2024-09-14T12:10:03.319113+0000","last_fullsized":"2024-09-14T12:10:03.319113+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:03.318990+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.318990+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:10.334308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079947,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":695,"num_read_kb":12874,"num_write":1161,"num_write_kb":37160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"265'6","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.772240+0000","last_change":"2024-09-14T12:10:15.772240+0000","last_active":"2024-09-14T12:10:15.772240+0000","last_peered":"2024-09-14T12:10:15.772240+0000","last_clean":"2024-09-14T12:10:15.772240+0000","last_became_active":"2024-09-14T11:11:00.609163+0000","last_became_peered":"2024-09-14T11:11:00.609163+0000","last_unstale":"2024-09-14T12:10:15.772240+0000","last_undegraded":"2024-09-14T12:10:15.772240+0000","last_fullsized":"2024-09-14T12:10:15.772240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-14T12:10:15.772157+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.772157+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:51.427742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'323","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.688900+0000","last_change":"2024-09-14T12:10:17.688900+0000","last_active":"2024-09-14T12:10:17.688900+0000","last_peered":"2024-09-14T12:10:17.688900+0000","last_clean":"2024-09-14T12:10:17.688900+0000","last_became_active":"2024-09-14T11:11:02.621220+0000","last_became_peered":"2024-09-14T11:11:02.621220+0000","last_unstale":"2024-09-14T12:10:17.688900+0000","last_undegraded":"2024-09-14T12:10:17.688900+0000","last_fullsized":"2024-09-14T12:10:17.688900+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-14T12:10:17.688794+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.688794+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:29.306543+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":1209,"num_write":442,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'738","reported_seq":2487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.724781+0000","last_change":"2024-09-14T12:10:22.724781+0000","last_active":"2024-09-14T12:10:22.724781+0000","last_peered":"2024-09-14T12:10:22.724781+0000","last_clean":"2024-09-14T12:10:22.724781+0000","last_became_active":"2024-09-14T11:11:04.631748+0000","last_became_peered":"2024-09-14T11:11:04.631748+0000","last_unstale":"2024-09-14T12:10:22.724781+0000","last_undegraded":"2024-09-14T12:10:22.724781+0000","last_fullsized":"2024-09-14T12:10:22.724781+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'738","last_scrub_stamp":"2024-09-14T12:10:22.724704+0000","last_deep_scrub":"265'738","last_deep_scrub_stamp":"2024-09-14T12:10:22.724704+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.724704+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:32.922720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'143","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.908076+0000","last_change":"2024-09-14T12:10:28.908076+0000","last_active":"2024-09-14T12:10:28.908076+0000","last_peered":"2024-09-14T12:10:28.908076+0000","last_clean":"2024-09-14T12:10:28.908076+0000","last_became_active":"2024-09-14T11:11:06.644448+0000","last_became_peered":"2024-09-14T11:11:06.644448+0000","last_unstale":"2024-09-14T12:10:28.908076+0000","last_undegraded":"2024-09-14T12:10:28.908076+0000","last_fullsized":"2024-09-14T12:10:28.908076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-14T12:10:28.907985+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-14T12:10:28.907985+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.907985+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:26.854086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":147,"num_write":325,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'120","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.861006+0000","last_change":"2024-09-14T12:10:07.861006+0000","last_active":"2024-09-14T12:10:07.861006+0000","last_peered":"2024-09-14T12:10:07.861006+0000","last_clean":"2024-09-14T12:10:07.861006+0000","last_became_active":"2024-09-14T11:10:58.603730+0000","last_became_peered":"2024-09-14T11:10:58.603730+0000","last_unstale":"2024-09-14T12:10:07.861006+0000","last_undegraded":"2024-09-14T12:10:07.861006+0000","last_fullsized":"2024-09-14T12:10:07.861006+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-14T12:10:07.860920+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.860920+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:10.720698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":561,"num_read_kb":472,"num_write":174,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'309","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.813691+0000","last_change":"2024-09-14T12:09:59.813691+0000","last_active":"2024-09-14T12:09:59.813691+0000","last_peered":"2024-09-14T12:09:59.813691+0000","last_clean":"2024-09-14T12:09:59.813691+0000","last_became_active":"2024-09-14T11:10:56.613845+0000","last_became_peered":"2024-09-14T11:10:56.613845+0000","last_unstale":"2024-09-14T12:09:59.813691+0000","last_undegraded":"2024-09-14T12:09:59.813691+0000","last_fullsized":"2024-09-14T12:09:59.813691+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:09:59.813558+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.813558+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:42.477590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":37578,"num_write":940,"num_write_kb":22575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1471,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.646610+0000","last_change":"2024-09-14T12:10:22.646610+0000","last_active":"2024-09-14T12:10:22.646610+0000","last_peered":"2024-09-14T12:10:22.646610+0000","last_clean":"2024-09-14T12:10:22.646610+0000","last_became_active":"2024-09-14T11:11:00.612662+0000","last_became_peered":"2024-09-14T11:11:00.612662+0000","last_unstale":"2024-09-14T12:10:22.646610+0000","last_undegraded":"2024-09-14T12:10:22.646610+0000","last_fullsized":"2024-09-14T12:10:22.646610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:22.646521+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:22.646521+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.646521+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:20.953885+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":956,"num_read_kb":956,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'95","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.206287+0000","last_change":"2024-09-14T12:10:24.206287+0000","last_active":"2024-09-14T12:10:24.206287+0000","last_peered":"2024-09-14T12:10:24.206287+0000","last_clean":"2024-09-14T12:10:24.206287+0000","last_became_active":"2024-09-14T11:11:02.881867+0000","last_became_peered":"2024-09-14T11:11:02.881867+0000","last_unstale":"2024-09-14T12:10:24.206287+0000","last_undegraded":"2024-09-14T12:10:24.206287+0000","last_fullsized":"2024-09-14T12:10:24.206287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-14T12:10:24.206188+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-14T12:10:24.206188+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.206188+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:01.065950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'775","reported_seq":2480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.399320+0000","last_change":"2024-09-14T12:10:18.399320+0000","last_active":"2024-09-14T12:10:18.399320+0000","last_peered":"2024-09-14T12:10:18.399320+0000","last_clean":"2024-09-14T12:10:18.399320+0000","last_became_active":"2024-09-14T11:11:04.634356+0000","last_became_peered":"2024-09-14T11:11:04.634356+0000","last_unstale":"2024-09-14T12:10:18.399320+0000","last_undegraded":"2024-09-14T12:10:18.399320+0000","last_fullsized":"2024-09-14T12:10:18.399320+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'775","last_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_deep_scrub":"265'775","last_deep_scrub_stamp":"2024-09-14T12:10:18.399218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.399218+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:25.017139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'116","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.019590+0000","last_change":"2024-09-14T12:10:33.019590+0000","last_active":"2024-09-14T12:10:33.019590+0000","last_peered":"2024-09-14T12:10:33.019590+0000","last_clean":"2024-09-14T12:10:33.019590+0000","last_became_active":"2024-09-14T11:11:06.646390+0000","last_became_peered":"2024-09-14T11:11:06.646390+0000","last_unstale":"2024-09-14T12:10:33.019590+0000","last_undegraded":"2024-09-14T12:10:33.019590+0000","last_fullsized":"2024-09-14T12:10:33.019590+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-14T12:10:33.019500+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-14T12:10:33.019500+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.019500+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:04.431083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":259,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'142","reported_seq":744,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.733075+0000","last_change":"2024-09-14T12:10:11.733075+0000","last_active":"2024-09-14T12:10:11.733075+0000","last_peered":"2024-09-14T12:10:11.733075+0000","last_clean":"2024-09-14T12:10:11.733075+0000","last_became_active":"2024-09-14T11:10:58.603778+0000","last_became_peered":"2024-09-14T11:10:58.603778+0000","last_unstale":"2024-09-14T12:10:11.733075+0000","last_undegraded":"2024-09-14T12:10:11.733075+0000","last_fullsized":"2024-09-14T12:10:11.733075+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-14T12:10:11.732986+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.732986+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:16.340583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":651,"num_read_kb":533,"num_write":221,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'387","reported_seq":1083,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.032758+0000","last_change":"2024-09-14T12:10:05.032758+0000","last_active":"2024-09-14T12:10:05.032758+0000","last_peered":"2024-09-14T12:10:05.032758+0000","last_clean":"2024-09-14T12:10:05.032758+0000","last_became_active":"2024-09-14T11:10:56.621264+0000","last_became_peered":"2024-09-14T11:10:56.621264+0000","last_unstale":"2024-09-14T12:10:05.032758+0000","last_undegraded":"2024-09-14T12:10:05.032758+0000","last_fullsized":"2024-09-14T12:10:05.032758+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-14T12:10:05.032635+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.032635+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:29:23.135116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":824,"num_read_kb":8823,"num_write":1260,"num_write_kb":33640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.013381+0000","last_change":"2024-09-14T12:10:20.013381+0000","last_active":"2024-09-14T12:10:20.013381+0000","last_peered":"2024-09-14T12:10:20.013381+0000","last_clean":"2024-09-14T12:10:20.013381+0000","last_became_active":"2024-09-14T11:11:00.612492+0000","last_became_peered":"2024-09-14T11:11:00.612492+0000","last_unstale":"2024-09-14T12:10:20.013381+0000","last_undegraded":"2024-09-14T12:10:20.013381+0000","last_fullsized":"2024-09-14T12:10:20.013381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.013295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.013295+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.013295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:44.013025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'363","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.661632+0000","last_change":"2024-09-14T12:10:27.661632+0000","last_active":"2024-09-14T12:10:27.661632+0000","last_peered":"2024-09-14T12:10:27.661632+0000","last_clean":"2024-09-14T12:10:27.661632+0000","last_became_active":"2024-09-14T11:11:02.616304+0000","last_became_peered":"2024-09-14T11:11:02.616304+0000","last_unstale":"2024-09-14T12:10:27.661632+0000","last_undegraded":"2024-09-14T12:10:27.661632+0000","last_fullsized":"2024-09-14T12:10:27.661632+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'363","last_scrub_stamp":"2024-09-14T12:10:27.661537+0000","last_deep_scrub":"265'363","last_deep_scrub_stamp":"2024-09-14T12:10:27.661537+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.661537+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:11.232522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48493,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":585,"num_read_kb":1215,"num_write":460,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.399470+0000","last_change":"2024-09-14T12:10:17.399470+0000","last_active":"2024-09-14T12:10:17.399470+0000","last_peered":"2024-09-14T12:10:17.399470+0000","last_clean":"2024-09-14T12:10:17.399470+0000","last_became_active":"2024-09-14T11:11:04.634882+0000","last_became_peered":"2024-09-14T11:11:04.634882+0000","last_unstale":"2024-09-14T12:10:17.399470+0000","last_undegraded":"2024-09-14T12:10:17.399470+0000","last_fullsized":"2024-09-14T12:10:17.399470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:17.399343+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.399343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:00.798907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'140","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.870379+0000","last_change":"2024-09-14T12:10:23.870379+0000","last_active":"2024-09-14T12:10:23.870379+0000","last_peered":"2024-09-14T12:10:23.870379+0000","last_clean":"2024-09-14T12:10:23.870379+0000","last_became_active":"2024-09-14T11:11:06.645297+0000","last_became_peered":"2024-09-14T11:11:06.645297+0000","last_unstale":"2024-09-14T12:10:23.870379+0000","last_undegraded":"2024-09-14T12:10:23.870379+0000","last_fullsized":"2024-09-14T12:10:23.870379+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-14T12:10:23.870301+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-14T12:10:23.870301+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.870301+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:48.006161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":447,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":129,"num_write":311,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'106","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.223843+0000","last_change":"2024-09-14T12:10:07.223843+0000","last_active":"2024-09-14T12:10:07.223843+0000","last_peered":"2024-09-14T12:10:07.223843+0000","last_clean":"2024-09-14T12:10:07.223843+0000","last_became_active":"2024-09-14T11:10:58.605734+0000","last_became_peered":"2024-09-14T11:10:58.605734+0000","last_unstale":"2024-09-14T12:10:07.223843+0000","last_undegraded":"2024-09-14T12:10:07.223843+0000","last_fullsized":"2024-09-14T12:10:07.223843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'106","last_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_deep_scrub":"265'106","last_deep_scrub_stamp":"2024-09-14T12:10:07.223720+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.223720+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:16.297510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":406,"num_write":166,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.260992+0000","last_change":"2024-09-14T12:10:01.260893+0000","last_active":"2024-09-14T12:10:01.260992+0000","last_peered":"2024-09-14T12:10:01.260992+0000","last_clean":"2024-09-14T12:10:01.260992+0000","last_became_active":"2024-09-14T11:10:40.557309+0000","last_became_peered":"2024-09-14T11:10:40.557309+0000","last_unstale":"2024-09-14T12:10:01.260992+0000","last_undegraded":"2024-09-14T12:10:01.260992+0000","last_fullsized":"2024-09-14T12:10:01.260992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-14T12:10:01.260776+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.260776+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:12.451761+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":542,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.799367+0000","last_change":"2024-09-14T12:10:02.799298+0000","last_active":"2024-09-14T12:10:02.799367+0000","last_peered":"2024-09-14T12:10:02.799367+0000","last_clean":"2024-09-14T12:10:02.799367+0000","last_became_active":"2024-09-14T11:10:47.560695+0000","last_became_peered":"2024-09-14T11:10:47.560695+0000","last_unstale":"2024-09-14T12:10:02.799367+0000","last_undegraded":"2024-09-14T12:10:02.799367+0000","last_fullsized":"2024-09-14T12:10:02.799367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:02.799218+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.799218+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:43.571584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00063333900000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'318","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.019453+0000","last_change":"2024-09-14T12:10:01.019453+0000","last_active":"2024-09-14T12:10:01.019453+0000","last_peered":"2024-09-14T12:10:01.019453+0000","last_clean":"2024-09-14T12:10:01.019453+0000","last_became_active":"2024-09-14T11:10:56.613298+0000","last_became_peered":"2024-09-14T11:10:56.613298+0000","last_unstale":"2024-09-14T12:10:01.019453+0000","last_undegraded":"2024-09-14T12:10:01.019453+0000","last_fullsized":"2024-09-14T12:10:01.019453+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-14T12:10:01.019366+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.019366+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:16.170494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":21923,"num_write":1076,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.567257+0000","last_change":"2024-09-14T12:10:20.567257+0000","last_active":"2024-09-14T12:10:20.567257+0000","last_peered":"2024-09-14T12:10:20.567257+0000","last_clean":"2024-09-14T12:10:20.567257+0000","last_became_active":"2024-09-14T11:11:00.610023+0000","last_became_peered":"2024-09-14T11:11:00.610023+0000","last_unstale":"2024-09-14T12:10:20.567257+0000","last_undegraded":"2024-09-14T12:10:20.567257+0000","last_fullsized":"2024-09-14T12:10:20.567257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:20.567143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:20.567143+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.567143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:31.859917+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'768","reported_seq":1488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.645340+0000","last_change":"2024-09-14T12:10:26.645340+0000","last_active":"2024-09-14T12:10:26.645340+0000","last_peered":"2024-09-14T12:10:26.645340+0000","last_clean":"2024-09-14T12:10:26.645340+0000","last_became_active":"2024-09-14T11:11:02.620930+0000","last_became_peered":"2024-09-14T11:11:02.620930+0000","last_unstale":"2024-09-14T12:10:26.645340+0000","last_undegraded":"2024-09-14T12:10:26.645340+0000","last_fullsized":"2024-09-14T12:10:26.645340+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'768","last_scrub_stamp":"2024-09-14T12:10:26.645214+0000","last_deep_scrub":"265'768","last_deep_scrub_stamp":"2024-09-14T12:10:26.645214+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.645214+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:28.785218+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141706,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1491,"num_read_kb":3459,"num_write":1398,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89194,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.161498+0000","last_change":"2024-09-14T12:10:24.161498+0000","last_active":"2024-09-14T12:10:24.161498+0000","last_peered":"2024-09-14T12:10:24.161498+0000","last_clean":"2024-09-14T12:10:24.161498+0000","last_became_active":"2024-09-14T11:11:04.632672+0000","last_became_peered":"2024-09-14T11:11:04.632672+0000","last_unstale":"2024-09-14T12:10:24.161498+0000","last_undegraded":"2024-09-14T12:10:24.161498+0000","last_fullsized":"2024-09-14T12:10:24.161498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:24.161412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:24.161412+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.161412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:39.802744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'184","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.421056+0000","last_change":"2024-09-14T12:10:22.421056+0000","last_active":"2024-09-14T12:10:22.421056+0000","last_peered":"2024-09-14T12:10:22.421056+0000","last_clean":"2024-09-14T12:10:22.421056+0000","last_became_active":"2024-09-14T11:11:06.647170+0000","last_became_peered":"2024-09-14T11:11:06.647170+0000","last_unstale":"2024-09-14T12:10:22.421056+0000","last_undegraded":"2024-09-14T12:10:22.421056+0000","last_fullsized":"2024-09-14T12:10:22.421056+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-14T12:10:22.420953+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-14T12:10:22.420953+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.420953+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:22.371086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":417,"num_read_kb":413,"num_write":371,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'241","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.075205+0000","last_change":"2024-09-14T12:10:08.075205+0000","last_active":"2024-09-14T12:10:08.075205+0000","last_peered":"2024-09-14T12:10:08.075205+0000","last_clean":"2024-09-14T12:10:08.075205+0000","last_became_active":"2024-09-14T11:10:58.611671+0000","last_became_peered":"2024-09-14T11:10:58.611671+0000","last_unstale":"2024-09-14T12:10:08.075205+0000","last_undegraded":"2024-09-14T12:10:08.075205+0000","last_fullsized":"2024-09-14T12:10:08.075205+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'241","last_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_deep_scrub":"265'241","last_deep_scrub_stamp":"2024-09-14T12:10:08.075089+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.075089+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:14.415988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1047,"num_read_kb":850,"num_write":358,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.224738+0000","last_change":"2024-09-14T12:10:04.224677+0000","last_active":"2024-09-14T12:10:04.224738+0000","last_peered":"2024-09-14T12:10:04.224738+0000","last_clean":"2024-09-14T12:10:04.224738+0000","last_became_active":"2024-09-14T11:10:47.562241+0000","last_became_peered":"2024-09-14T11:10:47.562241+0000","last_unstale":"2024-09-14T12:10:04.224738+0000","last_undegraded":"2024-09-14T12:10:04.224738+0000","last_fullsized":"2024-09-14T12:10:04.224738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:04.224592+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.224592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.747913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047304500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'342","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.014417+0000","last_change":"2024-09-14T12:10:00.014417+0000","last_active":"2024-09-14T12:10:00.014417+0000","last_peered":"2024-09-14T12:10:00.014417+0000","last_clean":"2024-09-14T12:10:00.014417+0000","last_became_active":"2024-09-14T11:11:33.133705+0000","last_became_peered":"2024-09-14T11:11:33.133705+0000","last_unstale":"2024-09-14T12:10:00.014417+0000","last_undegraded":"2024-09-14T12:10:00.014417+0000","last_fullsized":"2024-09-14T12:10:00.014417+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:00.014290+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.014290+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:59.265225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":615,"num_read_kb":48298,"num_write":1181,"num_write_kb":22617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.673611+0000","last_change":"2024-09-14T12:10:21.673611+0000","last_active":"2024-09-14T12:10:21.673611+0000","last_peered":"2024-09-14T12:10:21.673611+0000","last_clean":"2024-09-14T12:10:21.673611+0000","last_became_active":"2024-09-14T11:11:00.610137+0000","last_became_peered":"2024-09-14T11:11:00.610137+0000","last_unstale":"2024-09-14T12:10:21.673611+0000","last_undegraded":"2024-09-14T12:10:21.673611+0000","last_fullsized":"2024-09-14T12:10:21.673611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.673525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.673525+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.673525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:37.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1284","reported_seq":2929,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.805274+0000","last_change":"2024-09-14T12:10:18.805274+0000","last_active":"2024-09-14T12:10:18.805274+0000","last_peered":"2024-09-14T12:10:18.805274+0000","last_clean":"2024-09-14T12:10:18.805274+0000","last_became_active":"2024-09-14T11:11:02.615917+0000","last_became_peered":"2024-09-14T11:11:02.615917+0000","last_unstale":"2024-09-14T12:10:18.805274+0000","last_undegraded":"2024-09-14T12:10:18.805274+0000","last_fullsized":"2024-09-14T12:10:18.805274+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1284","last_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_deep_scrub":"265'1284","last_deep_scrub_stamp":"2024-09-14T12:10:18.805160+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.805160+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":1200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:19.969704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140197,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2031,"num_read_kb":3753,"num_write":1136,"num_write_kb":956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.455486+0000","last_change":"2024-09-14T12:10:30.455486+0000","last_active":"2024-09-14T12:10:30.455486+0000","last_peered":"2024-09-14T12:10:30.455486+0000","last_clean":"2024-09-14T12:10:30.455486+0000","last_became_active":"2024-09-14T11:11:04.637818+0000","last_became_peered":"2024-09-14T11:11:04.637818+0000","last_unstale":"2024-09-14T12:10:30.455486+0000","last_undegraded":"2024-09-14T12:10:30.455486+0000","last_fullsized":"2024-09-14T12:10:30.455486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.455395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.455395+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.455395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:07:27.833412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'222","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.908479+0000","last_change":"2024-09-14T12:10:25.908479+0000","last_active":"2024-09-14T12:10:25.908479+0000","last_peered":"2024-09-14T12:10:25.908479+0000","last_clean":"2024-09-14T12:10:25.908479+0000","last_became_active":"2024-09-14T11:11:06.642474+0000","last_became_peered":"2024-09-14T11:11:06.642474+0000","last_unstale":"2024-09-14T12:10:25.908479+0000","last_undegraded":"2024-09-14T12:10:25.908479+0000","last_fullsized":"2024-09-14T12:10:25.908479+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'222","last_scrub_stamp":"2024-09-14T12:10:25.908376+0000","last_deep_scrub":"265'222","last_deep_scrub_stamp":"2024-09-14T12:10:25.908376+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.908376+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:14.573130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":335,"num_write":500,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'76","reported_seq":686,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.817859+0000","last_change":"2024-09-14T12:10:07.817859+0000","last_active":"2024-09-14T12:10:07.817859+0000","last_peered":"2024-09-14T12:10:07.817859+0000","last_clean":"2024-09-14T12:10:07.817859+0000","last_became_active":"2024-09-14T11:10:58.601416+0000","last_became_peered":"2024-09-14T11:10:58.601416+0000","last_unstale":"2024-09-14T12:10:07.817859+0000","last_undegraded":"2024-09-14T12:10:07.817859+0000","last_fullsized":"2024-09-14T12:10:07.817859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:07.817764+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.817764+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:01.265513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":370,"num_read_kb":324,"num_write":101,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.586704+0000","last_change":"2024-09-14T12:09:59.586595+0000","last_active":"2024-09-14T12:09:59.586704+0000","last_peered":"2024-09-14T12:09:59.586704+0000","last_clean":"2024-09-14T12:09:59.586704+0000","last_became_active":"2024-09-14T11:10:47.561065+0000","last_became_peered":"2024-09-14T11:10:47.561065+0000","last_unstale":"2024-09-14T12:09:59.586704+0000","last_undegraded":"2024-09-14T12:09:59.586704+0000","last_fullsized":"2024-09-14T12:09:59.586704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.586474+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.586474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:31.075728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000334352,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'377","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.870189+0000","last_change":"2024-09-14T12:09:58.870135+0000","last_active":"2024-09-14T12:09:58.870189+0000","last_peered":"2024-09-14T12:09:58.870189+0000","last_clean":"2024-09-14T12:09:58.870189+0000","last_became_active":"2024-09-14T11:10:56.603842+0000","last_became_peered":"2024-09-14T11:10:56.603842+0000","last_unstale":"2024-09-14T12:09:58.870189+0000","last_undegraded":"2024-09-14T12:09:58.870189+0000","last_fullsized":"2024-09-14T12:09:58.870189+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:09:58.870049+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.870049+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:28.701680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":652,"num_read_kb":34638,"num_write":1221,"num_write_kb":15658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.670856+0000","last_change":"2024-09-14T12:10:11.670856+0000","last_active":"2024-09-14T12:10:11.670856+0000","last_peered":"2024-09-14T12:10:11.670856+0000","last_clean":"2024-09-14T12:10:11.670856+0000","last_became_active":"2024-09-14T11:11:00.611398+0000","last_became_peered":"2024-09-14T11:11:00.611398+0000","last_unstale":"2024-09-14T12:10:11.670856+0000","last_undegraded":"2024-09-14T12:10:11.670856+0000","last_fullsized":"2024-09-14T12:10:11.670856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:11.670773+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.670773+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:07.716742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'255","reported_seq":1500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:24.523542+0000","last_change":"2024-09-14T12:10:24.523542+0000","last_active":"2024-09-14T12:10:24.523542+0000","last_peered":"2024-09-14T12:10:24.523542+0000","last_clean":"2024-09-14T12:10:24.523542+0000","last_became_active":"2024-09-14T11:11:02.886909+0000","last_became_peered":"2024-09-14T11:11:02.886909+0000","last_unstale":"2024-09-14T12:10:24.523542+0000","last_undegraded":"2024-09-14T12:10:24.523542+0000","last_fullsized":"2024-09-14T12:10:24.523542+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'255","last_scrub_stamp":"2024-09-14T12:10:24.523451+0000","last_deep_scrub":"265'255","last_deep_scrub_stamp":"2024-09-14T12:10:24.523451+0000","last_clean_scrub_stamp":"2024-09-14T12:10:24.523451+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:13.202729+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":215,"num_read_kb":205,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.108167+0000","last_change":"2024-09-14T12:10:27.108167+0000","last_active":"2024-09-14T12:10:27.108167+0000","last_peered":"2024-09-14T12:10:27.108167+0000","last_clean":"2024-09-14T12:10:27.108167+0000","last_became_active":"2024-09-14T11:11:04.635053+0000","last_became_peered":"2024-09-14T11:11:04.635053+0000","last_unstale":"2024-09-14T12:10:27.108167+0000","last_undegraded":"2024-09-14T12:10:27.108167+0000","last_fullsized":"2024-09-14T12:10:27.108167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:27.108062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:27.108062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.108062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:02.428040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'242","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.122139+0000","last_change":"2024-09-14T12:10:34.122139+0000","last_active":"2024-09-14T12:10:34.122139+0000","last_peered":"2024-09-14T12:10:34.122139+0000","last_clean":"2024-09-14T12:10:34.122139+0000","last_became_active":"2024-09-14T11:11:06.649716+0000","last_became_peered":"2024-09-14T11:11:06.649716+0000","last_unstale":"2024-09-14T12:10:34.122139+0000","last_undegraded":"2024-09-14T12:10:34.122139+0000","last_fullsized":"2024-09-14T12:10:34.122139+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-14T12:10:34.122053+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-14T12:10:34.122053+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.122053+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:35.602598+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":530,"num_read_kb":541,"num_write":536,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'299","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.796640+0000","last_change":"2024-09-14T12:10:04.796640+0000","last_active":"2024-09-14T12:10:04.796640+0000","last_peered":"2024-09-14T12:10:04.796640+0000","last_clean":"2024-09-14T12:10:04.796640+0000","last_became_active":"2024-09-14T11:10:58.609493+0000","last_became_peered":"2024-09-14T11:10:58.609493+0000","last_unstale":"2024-09-14T12:10:04.796640+0000","last_undegraded":"2024-09-14T12:10:04.796640+0000","last_fullsized":"2024-09-14T12:10:04.796640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'299","last_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_deep_scrub":"265'299","last_deep_scrub_stamp":"2024-09-14T12:10:04.796540+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.796540+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:34.364854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1312,"num_read_kb":1045,"num_write":495,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":543,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.780719+0000","last_change":"2024-09-14T12:10:01.780661+0000","last_active":"2024-09-14T12:10:01.780719+0000","last_peered":"2024-09-14T12:10:01.780719+0000","last_clean":"2024-09-14T12:10:01.780719+0000","last_became_active":"2024-09-14T11:10:47.559018+0000","last_became_peered":"2024-09-14T11:10:47.559018+0000","last_unstale":"2024-09-14T12:10:01.780719+0000","last_undegraded":"2024-09-14T12:10:01.780719+0000","last_fullsized":"2024-09-14T12:10:01.780719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-14T12:10:01.780573+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.780573+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:54.383561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061166400000000004,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'320","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.820112+0000","last_change":"2024-09-14T12:10:00.820112+0000","last_active":"2024-09-14T12:10:00.820112+0000","last_peered":"2024-09-14T12:10:00.820112+0000","last_clean":"2024-09-14T12:10:00.820112+0000","last_became_active":"2024-09-14T11:10:56.605291+0000","last_became_peered":"2024-09-14T11:10:56.605291+0000","last_unstale":"2024-09-14T12:10:00.820112+0000","last_undegraded":"2024-09-14T12:10:00.820112+0000","last_fullsized":"2024-09-14T12:10:00.820112+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:00.820017+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.820017+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:02.962307+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":663,"num_read_kb":8841,"num_write":1009,"num_write_kb":22509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"265'4","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.278392+0000","last_change":"2024-09-14T12:10:17.278392+0000","last_active":"2024-09-14T12:10:17.278392+0000","last_peered":"2024-09-14T12:10:17.278392+0000","last_clean":"2024-09-14T12:10:17.278392+0000","last_became_active":"2024-09-14T11:11:00.607110+0000","last_became_peered":"2024-09-14T11:11:00.607110+0000","last_unstale":"2024-09-14T12:10:17.278392+0000","last_undegraded":"2024-09-14T12:10:17.278392+0000","last_fullsized":"2024-09-14T12:10:17.278392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-14T12:10:17.278291+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.278291+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.269121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'148","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.221325+0000","last_change":"2024-09-14T12:10:22.221325+0000","last_active":"2024-09-14T12:10:22.221325+0000","last_peered":"2024-09-14T12:10:22.221325+0000","last_clean":"2024-09-14T12:10:22.221325+0000","last_became_active":"2024-09-14T11:11:02.619547+0000","last_became_peered":"2024-09-14T11:11:02.619547+0000","last_unstale":"2024-09-14T12:10:22.221325+0000","last_undegraded":"2024-09-14T12:10:22.221325+0000","last_fullsized":"2024-09-14T12:10:22.221325+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'148","last_scrub_stamp":"2024-09-14T12:10:22.221256+0000","last_deep_scrub":"265'148","last_deep_scrub_stamp":"2024-09-14T12:10:22.221256+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.221256+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:43.118211+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.368105+0000","last_change":"2024-09-14T12:10:16.368105+0000","last_active":"2024-09-14T12:10:16.368105+0000","last_peered":"2024-09-14T12:10:16.368105+0000","last_clean":"2024-09-14T12:10:16.368105+0000","last_became_active":"2024-09-14T11:11:04.632549+0000","last_became_peered":"2024-09-14T11:11:04.632549+0000","last_unstale":"2024-09-14T12:10:16.368105+0000","last_undegraded":"2024-09-14T12:10:16.368105+0000","last_fullsized":"2024-09-14T12:10:16.368105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.368014+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.368014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:07.077831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'127","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.539885+0000","last_change":"2024-09-14T12:10:33.539885+0000","last_active":"2024-09-14T12:10:33.539885+0000","last_peered":"2024-09-14T12:10:33.539885+0000","last_clean":"2024-09-14T12:10:33.539885+0000","last_became_active":"2024-09-14T11:11:06.652143+0000","last_became_peered":"2024-09-14T11:11:06.652143+0000","last_unstale":"2024-09-14T12:10:33.539885+0000","last_undegraded":"2024-09-14T12:10:33.539885+0000","last_fullsized":"2024-09-14T12:10:33.539885+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-14T12:10:33.539802+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-14T12:10:33.539802+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.539802+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:54.946538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":241,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'153","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.609490+0000","last_change":"2024-09-14T12:10:06.609490+0000","last_active":"2024-09-14T12:10:06.609490+0000","last_peered":"2024-09-14T12:10:06.609490+0000","last_clean":"2024-09-14T12:10:06.609490+0000","last_became_active":"2024-09-14T11:11:32.676306+0000","last_became_peered":"2024-09-14T11:11:32.676306+0000","last_unstale":"2024-09-14T12:10:06.609490+0000","last_undegraded":"2024-09-14T12:10:06.609490+0000","last_fullsized":"2024-09-14T12:10:06.609490+0000","mapping_epoch":38,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'153","last_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_deep_scrub":"265'153","last_deep_scrub_stamp":"2024-09-14T12:10:06.609384+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.609384+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:45.973252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":646,"num_read_kb":531,"num_write":243,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"265'386","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.734129+0000","last_change":"2024-09-14T12:10:00.734129+0000","last_active":"2024-09-14T12:10:00.734129+0000","last_peered":"2024-09-14T12:10:00.734129+0000","last_clean":"2024-09-14T12:10:00.734129+0000","last_became_active":"2024-09-14T11:10:56.607189+0000","last_became_peered":"2024-09-14T11:10:56.607189+0000","last_unstale":"2024-09-14T12:10:00.734129+0000","last_undegraded":"2024-09-14T12:10:00.734129+0000","last_fullsized":"2024-09-14T12:10:00.734129+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-14T12:10:00.734031+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.734031+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:49.843097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":3382,"num_write":1188,"num_write_kb":49697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.821163+0000","last_change":"2024-09-14T12:10:00.821103+0000","last_active":"2024-09-14T12:10:00.821163+0000","last_peered":"2024-09-14T12:10:00.821163+0000","last_clean":"2024-09-14T12:10:00.821163+0000","last_became_active":"2024-09-14T11:10:47.596429+0000","last_became_peered":"2024-09-14T11:10:47.596429+0000","last_unstale":"2024-09-14T12:10:00.821163+0000","last_undegraded":"2024-09-14T12:10:00.821163+0000","last_fullsized":"2024-09-14T12:10:00.821163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:00.821034+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.821034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:21.167595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047189699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.242975+0000","last_change":"2024-09-14T12:10:19.242975+0000","last_active":"2024-09-14T12:10:19.242975+0000","last_peered":"2024-09-14T12:10:19.242975+0000","last_clean":"2024-09-14T12:10:19.242975+0000","last_became_active":"2024-09-14T11:11:00.603975+0000","last_became_peered":"2024-09-14T11:11:00.603975+0000","last_unstale":"2024-09-14T12:10:19.242975+0000","last_undegraded":"2024-09-14T12:10:19.242975+0000","last_fullsized":"2024-09-14T12:10:19.242975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.242892+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.242892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:59.906575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1281,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.247962+0000","last_change":"2024-09-14T12:10:18.247855+0000","last_active":"2024-09-14T12:10:18.247962+0000","last_peered":"2024-09-14T12:10:18.247962+0000","last_clean":"2024-09-14T12:10:18.247962+0000","last_became_active":"2024-09-14T11:11:02.621446+0000","last_became_peered":"2024-09-14T11:11:02.621446+0000","last_unstale":"2024-09-14T12:10:18.247962+0000","last_undegraded":"2024-09-14T12:10:18.247962+0000","last_fullsized":"2024-09-14T12:10:18.247962+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'599","last_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_deep_scrub":"265'599","last_deep_scrub_stamp":"2024-09-14T12:10:18.247734+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.247734+0000","objects_scrubbed":10,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:14.437465+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115987,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1669,"num_read_kb":2890,"num_write":2218,"num_write_kb":2065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":537664,"num_omap_keys":1218,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.093496+0000","last_change":"2024-09-14T12:10:30.093496+0000","last_active":"2024-09-14T12:10:30.093496+0000","last_peered":"2024-09-14T12:10:30.093496+0000","last_clean":"2024-09-14T12:10:30.093496+0000","last_became_active":"2024-09-14T11:11:04.637589+0000","last_became_peered":"2024-09-14T11:11:04.637589+0000","last_unstale":"2024-09-14T12:10:30.093496+0000","last_undegraded":"2024-09-14T12:10:30.093496+0000","last_fullsized":"2024-09-14T12:10:30.093496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.093402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.093402+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.093402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:12.239531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'126","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.227318+0000","last_change":"2024-09-14T12:10:34.227318+0000","last_active":"2024-09-14T12:10:34.227318+0000","last_peered":"2024-09-14T12:10:34.227318+0000","last_clean":"2024-09-14T12:10:34.227318+0000","last_became_active":"2024-09-14T11:11:06.644266+0000","last_became_peered":"2024-09-14T11:11:06.644266+0000","last_unstale":"2024-09-14T12:10:34.227318+0000","last_undegraded":"2024-09-14T12:10:34.227318+0000","last_fullsized":"2024-09-14T12:10:34.227318+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-14T12:10:34.227217+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-14T12:10:34.227217+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.227217+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:34.630736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":278,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'314","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.057475+0000","last_change":"2024-09-14T12:10:07.057475+0000","last_active":"2024-09-14T12:10:07.057475+0000","last_peered":"2024-09-14T12:10:07.057475+0000","last_clean":"2024-09-14T12:10:07.057475+0000","last_became_active":"2024-09-14T11:10:58.609744+0000","last_became_peered":"2024-09-14T11:10:58.609744+0000","last_unstale":"2024-09-14T12:10:07.057475+0000","last_undegraded":"2024-09-14T12:10:07.057475+0000","last_fullsized":"2024-09-14T12:10:07.057475+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-14T12:10:07.057369+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.057369+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:52.846935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1390,"num_read_kb":1116,"num_write":518,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'378","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.805142+0000","last_change":"2024-09-14T12:10:01.805142+0000","last_active":"2024-09-14T12:10:01.805142+0000","last_peered":"2024-09-14T12:10:01.805142+0000","last_clean":"2024-09-14T12:10:01.805142+0000","last_became_active":"2024-09-14T11:10:56.601740+0000","last_became_peered":"2024-09-14T11:10:56.601740+0000","last_unstale":"2024-09-14T12:10:01.805142+0000","last_undegraded":"2024-09-14T12:10:01.805142+0000","last_fullsized":"2024-09-14T12:10:01.805142+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-14T12:10:01.805035+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.805035+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:40.071458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":671,"num_read_kb":35559,"num_write":1182,"num_write_kb":55005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.234636+0000","last_change":"2024-09-14T12:10:02.234636+0000","last_active":"2024-09-14T12:10:02.234636+0000","last_peered":"2024-09-14T12:10:02.234636+0000","last_clean":"2024-09-14T12:10:02.234636+0000","last_became_active":"2024-09-14T11:10:47.596761+0000","last_became_peered":"2024-09-14T11:10:47.596761+0000","last_unstale":"2024-09-14T12:10:02.234636+0000","last_undegraded":"2024-09-14T12:10:02.234636+0000","last_fullsized":"2024-09-14T12:10:02.234636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:02.234555+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.234555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:09.749698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046760299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.293819+0000","last_change":"2024-09-14T12:10:13.293819+0000","last_active":"2024-09-14T12:10:13.293819+0000","last_peered":"2024-09-14T12:10:13.293819+0000","last_clean":"2024-09-14T12:10:13.293819+0000","last_became_active":"2024-09-14T11:11:00.605122+0000","last_became_peered":"2024-09-14T11:11:00.605122+0000","last_unstale":"2024-09-14T12:10:13.293819+0000","last_undegraded":"2024-09-14T12:10:13.293819+0000","last_fullsized":"2024-09-14T12:10:13.293819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:13.293717+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.293717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:44.892162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.763162+0000","last_change":"2024-09-14T12:10:17.763162+0000","last_active":"2024-09-14T12:10:17.763162+0000","last_peered":"2024-09-14T12:10:17.763162+0000","last_clean":"2024-09-14T12:10:17.763162+0000","last_became_active":"2024-09-14T11:11:02.886919+0000","last_became_peered":"2024-09-14T11:11:02.886919+0000","last_unstale":"2024-09-14T12:10:17.763162+0000","last_undegraded":"2024-09-14T12:10:17.763162+0000","last_fullsized":"2024-09-14T12:10:17.763162+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:17.763047+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.763047+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:11.047981+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":208,"num_write":142,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.618739+0000","last_change":"2024-09-14T12:10:31.618674+0000","last_active":"2024-09-14T12:10:31.618739+0000","last_peered":"2024-09-14T12:10:31.618739+0000","last_clean":"2024-09-14T12:10:31.618739+0000","last_became_active":"2024-09-14T11:11:04.632418+0000","last_became_peered":"2024-09-14T11:11:04.632418+0000","last_unstale":"2024-09-14T12:10:31.618739+0000","last_undegraded":"2024-09-14T12:10:31.618739+0000","last_fullsized":"2024-09-14T12:10:31.618739+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-14T12:10:31.618581+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-14T12:10:31.618581+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.618581+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:04.564737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'125","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:39.173064+0000","last_change":"2024-09-14T12:10:39.173064+0000","last_active":"2024-09-14T12:10:39.173064+0000","last_peered":"2024-09-14T12:10:39.173064+0000","last_clean":"2024-09-14T12:10:39.173064+0000","last_became_active":"2024-09-14T11:11:06.650983+0000","last_became_peered":"2024-09-14T11:11:06.650983+0000","last_unstale":"2024-09-14T12:10:39.173064+0000","last_undegraded":"2024-09-14T12:10:39.173064+0000","last_fullsized":"2024-09-14T12:10:39.173064+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-14T12:10:39.172981+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-14T12:10:39.172981+0000","last_clean_scrub_stamp":"2024-09-14T12:10:39.172981+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:49.444193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'188","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.112633+0000","last_change":"2024-09-14T12:10:08.112509+0000","last_active":"2024-09-14T12:10:08.112633+0000","last_peered":"2024-09-14T12:10:08.112633+0000","last_clean":"2024-09-14T12:10:08.112633+0000","last_became_active":"2024-09-14T11:10:58.608004+0000","last_became_peered":"2024-09-14T11:10:58.608004+0000","last_unstale":"2024-09-14T12:10:08.112633+0000","last_undegraded":"2024-09-14T12:10:08.112633+0000","last_fullsized":"2024-09-14T12:10:08.112633+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-14T12:10:08.112409+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.112409+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:09.821615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":825,"num_read_kb":679,"num_write":271,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'327","reported_seq":1175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:00.001125+0000","last_change":"2024-09-14T12:10:00.001125+0000","last_active":"2024-09-14T12:10:00.001125+0000","last_peered":"2024-09-14T12:10:00.001125+0000","last_clean":"2024-09-14T12:10:00.001125+0000","last_became_active":"2024-09-14T11:10:56.617752+0000","last_became_peered":"2024-09-14T11:10:56.617752+0000","last_unstale":"2024-09-14T12:10:00.001125+0000","last_undegraded":"2024-09-14T12:10:00.001125+0000","last_fullsized":"2024-09-14T12:10:00.001125+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'327","last_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_deep_scrub":"265'327","last_deep_scrub_stamp":"2024-09-14T12:10:00.001028+0000","last_clean_scrub_stamp":"2024-09-14T12:10:00.001028+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:33.912729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1192,"num_read_kb":52121,"num_write":1075,"num_write_kb":35511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:59.836980+0000","last_change":"2024-09-14T12:09:59.836980+0000","last_active":"2024-09-14T12:09:59.836980+0000","last_peered":"2024-09-14T12:09:59.836980+0000","last_clean":"2024-09-14T12:09:59.836980+0000","last_became_active":"2024-09-14T11:10:47.565064+0000","last_became_peered":"2024-09-14T11:10:47.565064+0000","last_unstale":"2024-09-14T12:09:59.836980+0000","last_undegraded":"2024-09-14T12:09:59.836980+0000","last_fullsized":"2024-09-14T12:09:59.836980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:09:59.836907+0000","last_clean_scrub_stamp":"2024-09-14T12:09:59.836907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:32.571263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046289299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.062743+0000","last_change":"2024-09-14T12:10:21.062743+0000","last_active":"2024-09-14T12:10:21.062743+0000","last_peered":"2024-09-14T12:10:21.062743+0000","last_clean":"2024-09-14T12:10:21.062743+0000","last_became_active":"2024-09-14T11:11:00.610141+0000","last_became_peered":"2024-09-14T11:11:00.610141+0000","last_unstale":"2024-09-14T12:10:21.062743+0000","last_undegraded":"2024-09-14T12:10:21.062743+0000","last_fullsized":"2024-09-14T12:10:21.062743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.062656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.062656+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.062656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:51.112747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'125","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.142508+0000","last_change":"2024-09-14T12:10:25.142508+0000","last_active":"2024-09-14T12:10:25.142508+0000","last_peered":"2024-09-14T12:10:25.142508+0000","last_clean":"2024-09-14T12:10:25.142508+0000","last_became_active":"2024-09-14T11:11:02.618275+0000","last_became_peered":"2024-09-14T11:11:02.618275+0000","last_unstale":"2024-09-14T12:10:25.142508+0000","last_undegraded":"2024-09-14T12:10:25.142508+0000","last_fullsized":"2024-09-14T12:10:25.142508+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-14T12:10:25.142414+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-14T12:10:25.142414+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.142414+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:59.124812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":92,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'793","reported_seq":6731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.182101+0000","last_change":"2024-09-14T12:10:28.182101+0000","last_active":"2024-09-14T12:10:28.182101+0000","last_peered":"2024-09-14T12:10:28.182101+0000","last_clean":"2024-09-14T12:10:28.182101+0000","last_became_active":"2024-09-14T11:11:04.641147+0000","last_became_peered":"2024-09-14T11:11:04.641147+0000","last_unstale":"2024-09-14T12:10:28.182101+0000","last_undegraded":"2024-09-14T12:10:28.182101+0000","last_fullsized":"2024-09-14T12:10:28.182101+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-14T12:10:28.182006+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-14T12:10:28.182006+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.182006+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:08.785563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'217","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.167503+0000","last_change":"2024-09-14T12:10:31.167503+0000","last_active":"2024-09-14T12:10:31.167503+0000","last_peered":"2024-09-14T12:10:31.167503+0000","last_clean":"2024-09-14T12:10:31.167503+0000","last_became_active":"2024-09-14T11:11:06.651019+0000","last_became_peered":"2024-09-14T11:11:06.651019+0000","last_unstale":"2024-09-14T12:10:31.167503+0000","last_undegraded":"2024-09-14T12:10:31.167503+0000","last_fullsized":"2024-09-14T12:10:31.167503+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'217","last_scrub_stamp":"2024-09-14T12:10:31.167362+0000","last_deep_scrub":"265'217","last_deep_scrub_stamp":"2024-09-14T12:10:31.167362+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.167362+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:09.614038+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1087,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":174,"num_read_kb":164,"num_write":486,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'4144","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.833148+0000","last_change":"2024-09-14T12:10:02.833148+0000","last_active":"2024-09-14T12:10:02.833148+0000","last_peered":"2024-09-14T12:10:02.833148+0000","last_clean":"2024-09-14T12:10:02.833148+0000","last_became_active":"2024-09-14T11:10:58.600676+0000","last_became_peered":"2024-09-14T11:10:58.600676+0000","last_unstale":"2024-09-14T12:10:02.833148+0000","last_undegraded":"2024-09-14T12:10:02.833148+0000","last_fullsized":"2024-09-14T12:10:02.833148+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4144","last_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_deep_scrub":"265'4144","last_deep_scrub_stamp":"2024-09-14T12:10:02.833062+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.833062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":3000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:50.518946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16647,"num_read_kb":13958,"num_write":6215,"num_write_kb":3105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'380","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.549372+0000","last_change":"2024-09-14T12:10:03.549302+0000","last_active":"2024-09-14T12:10:03.549372+0000","last_peered":"2024-09-14T12:10:03.549372+0000","last_clean":"2024-09-14T12:10:03.549372+0000","last_became_active":"2024-09-14T11:11:32.790663+0000","last_became_peered":"2024-09-14T11:11:32.790663+0000","last_unstale":"2024-09-14T12:10:03.549372+0000","last_undegraded":"2024-09-14T12:10:03.549372+0000","last_fullsized":"2024-09-14T12:10:03.549372+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:03.549195+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.549195+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:33.120720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":755,"num_read_kb":5405,"num_write":1192,"num_write_kb":16618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.355045+0000","last_change":"2024-09-14T12:10:01.355045+0000","last_active":"2024-09-14T12:10:01.355045+0000","last_peered":"2024-09-14T12:10:01.355045+0000","last_clean":"2024-09-14T12:10:01.355045+0000","last_became_active":"2024-09-14T11:10:47.565033+0000","last_became_peered":"2024-09-14T11:10:47.565033+0000","last_unstale":"2024-09-14T12:10:01.355045+0000","last_undegraded":"2024-09-14T12:10:01.355045+0000","last_fullsized":"2024-09-14T12:10:01.355045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:01.354958+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.354958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:25.192772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061969900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.241237+0000","last_change":"2024-09-14T12:10:18.241169+0000","last_active":"2024-09-14T12:10:18.241237+0000","last_peered":"2024-09-14T12:10:18.241237+0000","last_clean":"2024-09-14T12:10:18.241237+0000","last_became_active":"2024-09-14T11:11:00.612373+0000","last_became_peered":"2024-09-14T11:11:00.612373+0000","last_unstale":"2024-09-14T12:10:18.241237+0000","last_undegraded":"2024-09-14T12:10:18.241237+0000","last_fullsized":"2024-09-14T12:10:18.241237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:18.241011+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.241011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:36.998156+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'800","reported_seq":1530,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.571305+0000","last_change":"2024-09-14T12:10:22.571305+0000","last_active":"2024-09-14T12:10:22.571305+0000","last_peered":"2024-09-14T12:10:22.571305+0000","last_clean":"2024-09-14T12:10:22.571305+0000","last_became_active":"2024-09-14T11:11:02.881983+0000","last_became_peered":"2024-09-14T11:11:02.881983+0000","last_unstale":"2024-09-14T12:10:22.571305+0000","last_undegraded":"2024-09-14T12:10:22.571305+0000","last_fullsized":"2024-09-14T12:10:22.571305+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'800","last_scrub_stamp":"2024-09-14T12:10:22.571194+0000","last_deep_scrub":"265'800","last_deep_scrub_stamp":"2024-09-14T12:10:22.571194+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.571194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:28.338770+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":248256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1449,"num_read_kb":3656,"num_write":1202,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.173127+0000","last_change":"2024-09-14T12:10:29.173127+0000","last_active":"2024-09-14T12:10:29.173127+0000","last_peered":"2024-09-14T12:10:29.173127+0000","last_clean":"2024-09-14T12:10:29.173127+0000","last_became_active":"2024-09-14T11:11:04.636052+0000","last_became_peered":"2024-09-14T11:11:04.636052+0000","last_unstale":"2024-09-14T12:10:29.173127+0000","last_undegraded":"2024-09-14T12:10:29.173127+0000","last_fullsized":"2024-09-14T12:10:29.173127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.173026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.173026+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.173026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:28.984503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'149","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.569999+0000","last_change":"2024-09-14T12:10:34.569999+0000","last_active":"2024-09-14T12:10:34.569999+0000","last_peered":"2024-09-14T12:10:34.569999+0000","last_clean":"2024-09-14T12:10:34.569999+0000","last_became_active":"2024-09-14T11:11:06.645394+0000","last_became_peered":"2024-09-14T11:11:06.645394+0000","last_unstale":"2024-09-14T12:10:34.569999+0000","last_undegraded":"2024-09-14T12:10:34.569999+0000","last_fullsized":"2024-09-14T12:10:34.569999+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'149","last_scrub_stamp":"2024-09-14T12:10:34.569906+0000","last_deep_scrub":"265'149","last_deep_scrub_stamp":"2024-09-14T12:10:34.569906+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.569906+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:33.194573+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":377,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'135","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.198485+0000","last_change":"2024-09-14T12:10:35.198485+0000","last_active":"2024-09-14T12:10:35.198485+0000","last_peered":"2024-09-14T12:10:35.198485+0000","last_clean":"2024-09-14T12:10:35.198485+0000","last_became_active":"2024-09-14T11:11:06.645814+0000","last_became_peered":"2024-09-14T11:11:06.645814+0000","last_unstale":"2024-09-14T12:10:35.198485+0000","last_undegraded":"2024-09-14T12:10:35.198485+0000","last_fullsized":"2024-09-14T12:10:35.198485+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-14T12:10:35.198397+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-14T12:10:35.198397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.198397+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:18.366891+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":228,"num_read_kb":220,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'73","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.867191+0000","last_change":"2024-09-14T12:10:10.867191+0000","last_active":"2024-09-14T12:10:10.867191+0000","last_peered":"2024-09-14T12:10:10.867191+0000","last_clean":"2024-09-14T12:10:10.867191+0000","last_became_active":"2024-09-14T11:10:58.603874+0000","last_became_peered":"2024-09-14T11:10:58.603874+0000","last_unstale":"2024-09-14T12:10:10.867191+0000","last_undegraded":"2024-09-14T12:10:10.867191+0000","last_fullsized":"2024-09-14T12:10:10.867191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-14T12:10:10.867096+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.867096+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:37.567590+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":282,"num_write":93,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'349","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.790676+0000","last_change":"2024-09-14T12:10:01.790676+0000","last_active":"2024-09-14T12:10:01.790676+0000","last_peered":"2024-09-14T12:10:01.790676+0000","last_clean":"2024-09-14T12:10:01.790676+0000","last_became_active":"2024-09-14T11:10:56.615487+0000","last_became_peered":"2024-09-14T11:10:56.615487+0000","last_unstale":"2024-09-14T12:10:01.790676+0000","last_undegraded":"2024-09-14T12:10:01.790676+0000","last_fullsized":"2024-09-14T12:10:01.790676+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:01.790549+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.790549+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.092776+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":5106,"num_write":1232,"num_write_kb":19683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.730899+0000","last_change":"2024-09-14T12:10:12.730899+0000","last_active":"2024-09-14T12:10:12.730899+0000","last_peered":"2024-09-14T12:10:12.730899+0000","last_clean":"2024-09-14T12:10:12.730899+0000","last_became_active":"2024-09-14T11:11:00.610397+0000","last_became_peered":"2024-09-14T11:11:00.610397+0000","last_unstale":"2024-09-14T12:10:12.730899+0000","last_undegraded":"2024-09-14T12:10:12.730899+0000","last_fullsized":"2024-09-14T12:10:12.730899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:12.730806+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.730806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:09.075497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'329","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.171310+0000","last_change":"2024-09-14T12:10:25.171310+0000","last_active":"2024-09-14T12:10:25.171310+0000","last_peered":"2024-09-14T12:10:25.171310+0000","last_clean":"2024-09-14T12:10:25.171310+0000","last_became_active":"2024-09-14T11:11:02.622050+0000","last_became_peered":"2024-09-14T11:11:02.622050+0000","last_unstale":"2024-09-14T12:10:25.171310+0000","last_undegraded":"2024-09-14T12:10:25.171310+0000","last_fullsized":"2024-09-14T12:10:25.171310+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-14T12:10:25.171217+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-14T12:10:25.171217+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.171217+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:27.217163+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48310,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":1141,"num_write":422,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.169739+0000","last_change":"2024-09-14T12:10:32.169739+0000","last_active":"2024-09-14T12:10:32.169739+0000","last_peered":"2024-09-14T12:10:32.169739+0000","last_clean":"2024-09-14T12:10:32.169739+0000","last_became_active":"2024-09-14T11:11:04.639467+0000","last_became_peered":"2024-09-14T11:11:04.639467+0000","last_unstale":"2024-09-14T12:10:32.169739+0000","last_undegraded":"2024-09-14T12:10:32.169739+0000","last_fullsized":"2024-09-14T12:10:32.169739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:32.169632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:32.169632+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.169632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:21.976939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'133","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:38.123000+0000","last_change":"2024-09-14T12:10:38.122891+0000","last_active":"2024-09-14T12:10:38.123000+0000","last_peered":"2024-09-14T12:10:38.123000+0000","last_clean":"2024-09-14T12:10:38.123000+0000","last_became_active":"2024-09-14T11:11:06.649663+0000","last_became_peered":"2024-09-14T11:11:06.649663+0000","last_unstale":"2024-09-14T12:10:38.123000+0000","last_undegraded":"2024-09-14T12:10:38.123000+0000","last_fullsized":"2024-09-14T12:10:38.123000+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:38.122784+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:38.122784+0000","last_clean_scrub_stamp":"2024-09-14T12:10:38.122784+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:12.978913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":128,"num_write":324,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'84","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.818239+0000","last_change":"2024-09-14T12:10:08.818239+0000","last_active":"2024-09-14T12:10:08.818239+0000","last_peered":"2024-09-14T12:10:08.818239+0000","last_clean":"2024-09-14T12:10:08.818239+0000","last_became_active":"2024-09-14T11:10:58.608929+0000","last_became_peered":"2024-09-14T11:10:58.608929+0000","last_unstale":"2024-09-14T12:10:08.818239+0000","last_undegraded":"2024-09-14T12:10:08.818239+0000","last_fullsized":"2024-09-14T12:10:08.818239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'84","last_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_deep_scrub":"265'84","last_deep_scrub_stamp":"2024-09-14T12:10:08.818146+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.818146+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:58.032521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":366,"num_read_kb":307,"num_write":123,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'348","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.325150+0000","last_change":"2024-09-14T12:10:08.325150+0000","last_active":"2024-09-14T12:10:08.325150+0000","last_peered":"2024-09-14T12:10:08.325150+0000","last_clean":"2024-09-14T12:10:08.325150+0000","last_became_active":"2024-09-14T11:10:56.618357+0000","last_became_peered":"2024-09-14T11:10:56.618357+0000","last_unstale":"2024-09-14T12:10:08.325150+0000","last_undegraded":"2024-09-14T12:10:08.325150+0000","last_fullsized":"2024-09-14T12:10:08.325150+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:08.325054+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.325054+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:38.981426+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":675,"num_read_kb":33435,"num_write":1030,"num_write_kb":35385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.215844+0000","last_change":"2024-09-14T12:10:19.215844+0000","last_active":"2024-09-14T12:10:19.215844+0000","last_peered":"2024-09-14T12:10:19.215844+0000","last_clean":"2024-09-14T12:10:19.215844+0000","last_became_active":"2024-09-14T11:11:00.610377+0000","last_became_peered":"2024-09-14T11:11:00.610377+0000","last_unstale":"2024-09-14T12:10:19.215844+0000","last_undegraded":"2024-09-14T12:10:19.215844+0000","last_fullsized":"2024-09-14T12:10:19.215844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.215754+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.215754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:04.064105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'50","reported_seq":565,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.282515+0000","last_change":"2024-09-14T12:10:21.282515+0000","last_active":"2024-09-14T12:10:21.282515+0000","last_peered":"2024-09-14T12:10:21.282515+0000","last_clean":"2024-09-14T12:10:21.282515+0000","last_became_active":"2024-09-14T11:11:02.616044+0000","last_became_peered":"2024-09-14T11:11:02.616044+0000","last_unstale":"2024-09-14T12:10:21.282515+0000","last_undegraded":"2024-09-14T12:10:21.282515+0000","last_fullsized":"2024-09-14T12:10:21.282515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-14T12:10:21.282415+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-14T12:10:21.282415+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.282415+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:42.993531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.488546+0000","last_change":"2024-09-14T12:10:29.488546+0000","last_active":"2024-09-14T12:10:29.488546+0000","last_peered":"2024-09-14T12:10:29.488546+0000","last_clean":"2024-09-14T12:10:29.488546+0000","last_became_active":"2024-09-14T11:11:04.630564+0000","last_became_peered":"2024-09-14T11:11:04.630564+0000","last_unstale":"2024-09-14T12:10:29.488546+0000","last_undegraded":"2024-09-14T12:10:29.488546+0000","last_fullsized":"2024-09-14T12:10:29.488546+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:29.488380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:29.488380+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.488380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:15.572534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'254","reported_seq":836,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.184118+0000","last_change":"2024-09-14T12:10:33.184053+0000","last_active":"2024-09-14T12:10:33.184118+0000","last_peered":"2024-09-14T12:10:33.184118+0000","last_clean":"2024-09-14T12:10:33.184118+0000","last_became_active":"2024-09-14T11:11:06.642600+0000","last_became_peered":"2024-09-14T11:11:06.642600+0000","last_unstale":"2024-09-14T12:10:33.184118+0000","last_undegraded":"2024-09-14T12:10:33.184118+0000","last_fullsized":"2024-09-14T12:10:33.184118+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'254","last_scrub_stamp":"2024-09-14T12:10:33.183967+0000","last_deep_scrub":"265'254","last_deep_scrub_stamp":"2024-09-14T12:10:33.183967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.183967+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:05.916700+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":484,"num_write":592,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'364","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.069541+0000","last_change":"2024-09-14T12:10:09.069541+0000","last_active":"2024-09-14T12:10:09.069541+0000","last_peered":"2024-09-14T12:10:09.069541+0000","last_clean":"2024-09-14T12:10:09.069541+0000","last_became_active":"2024-09-14T11:10:58.603591+0000","last_became_peered":"2024-09-14T11:10:58.603591+0000","last_unstale":"2024-09-14T12:10:09.069541+0000","last_undegraded":"2024-09-14T12:10:09.069541+0000","last_fullsized":"2024-09-14T12:10:09.069541+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.069447+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.069447+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:54.610666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1550,"num_read_kb":1262,"num_write":563,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'376","reported_seq":1258,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.804369+0000","last_change":"2024-09-14T12:10:03.804369+0000","last_active":"2024-09-14T12:10:03.804369+0000","last_peered":"2024-09-14T12:10:03.804369+0000","last_clean":"2024-09-14T12:10:03.804369+0000","last_became_active":"2024-09-14T11:10:56.600289+0000","last_became_peered":"2024-09-14T11:10:56.600289+0000","last_unstale":"2024-09-14T12:10:03.804369+0000","last_undegraded":"2024-09-14T12:10:03.804369+0000","last_fullsized":"2024-09-14T12:10:03.804369+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-14T12:10:03.804231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.804231+0000","objects_scrubbed":7,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:52.949022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1254,"num_read_kb":13175,"num_write":1299,"num_write_kb":52040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.588199+0000","last_change":"2024-09-14T12:10:21.588199+0000","last_active":"2024-09-14T12:10:21.588199+0000","last_peered":"2024-09-14T12:10:21.588199+0000","last_clean":"2024-09-14T12:10:21.588199+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:21.588199+0000","last_undegraded":"2024-09-14T12:10:21.588199+0000","last_fullsized":"2024-09-14T12:10:21.588199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.588115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.588115+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.588115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:54.368894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'312","reported_seq":913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.148522+0000","last_change":"2024-09-14T12:10:26.148522+0000","last_active":"2024-09-14T12:10:26.148522+0000","last_peered":"2024-09-14T12:10:26.148522+0000","last_clean":"2024-09-14T12:10:26.148522+0000","last_became_active":"2024-09-14T11:11:02.621214+0000","last_became_peered":"2024-09-14T11:11:02.621214+0000","last_unstale":"2024-09-14T12:10:26.148522+0000","last_undegraded":"2024-09-14T12:10:26.148522+0000","last_fullsized":"2024-09-14T12:10:26.148522+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-14T12:10:26.148430+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-14T12:10:26.148430+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.148430+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:20.299138+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":1114,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.420495+0000","last_change":"2024-09-14T12:10:21.420495+0000","last_active":"2024-09-14T12:10:21.420495+0000","last_peered":"2024-09-14T12:10:21.420495+0000","last_clean":"2024-09-14T12:10:21.420495+0000","last_became_active":"2024-09-14T11:11:04.632462+0000","last_became_peered":"2024-09-14T11:11:04.632462+0000","last_unstale":"2024-09-14T12:10:21.420495+0000","last_undegraded":"2024-09-14T12:10:21.420495+0000","last_fullsized":"2024-09-14T12:10:21.420495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.420410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.420410+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.420410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:41.884735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'112","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.608483+0000","last_change":"2024-09-14T12:10:37.608406+0000","last_active":"2024-09-14T12:10:37.608483+0000","last_peered":"2024-09-14T12:10:37.608483+0000","last_clean":"2024-09-14T12:10:37.608483+0000","last_became_active":"2024-09-14T11:11:06.645451+0000","last_became_peered":"2024-09-14T11:11:06.645451+0000","last_unstale":"2024-09-14T12:10:37.608483+0000","last_undegraded":"2024-09-14T12:10:37.608483+0000","last_fullsized":"2024-09-14T12:10:37.608483+0000","mapping_epoch":35,"log_start":"265'101","ondisk_log_start":"265'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-14T12:10:37.608319+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-14T12:10:37.608319+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.608319+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:41.341297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":125,"num_write":265,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'144","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.115730+0000","last_change":"2024-09-14T12:10:11.115730+0000","last_active":"2024-09-14T12:10:11.115730+0000","last_peered":"2024-09-14T12:10:11.115730+0000","last_clean":"2024-09-14T12:10:11.115730+0000","last_became_active":"2024-09-14T11:10:58.609596+0000","last_became_peered":"2024-09-14T11:10:58.609596+0000","last_unstale":"2024-09-14T12:10:11.115730+0000","last_undegraded":"2024-09-14T12:10:11.115730+0000","last_fullsized":"2024-09-14T12:10:11.115730+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-14T12:10:11.115619+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.115619+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:27.488762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":641,"num_read_kb":529,"num_write":238,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'377","reported_seq":1068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.003226+0000","last_change":"2024-09-14T12:10:01.003226+0000","last_active":"2024-09-14T12:10:01.003226+0000","last_peered":"2024-09-14T12:10:01.003226+0000","last_clean":"2024-09-14T12:10:01.003226+0000","last_became_active":"2024-09-14T11:10:56.623452+0000","last_became_peered":"2024-09-14T11:10:56.623452+0000","last_unstale":"2024-09-14T12:10:01.003226+0000","last_undegraded":"2024-09-14T12:10:01.003226+0000","last_fullsized":"2024-09-14T12:10:01.003226+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-14T12:10:01.003138+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.003138+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:56.741486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":721,"num_read_kb":71289,"num_write":1192,"num_write_kb":39973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.311021+0000","last_change":"2024-09-14T12:10:14.311021+0000","last_active":"2024-09-14T12:10:14.311021+0000","last_peered":"2024-09-14T12:10:14.311021+0000","last_clean":"2024-09-14T12:10:14.311021+0000","last_became_active":"2024-09-14T11:11:00.608354+0000","last_became_peered":"2024-09-14T11:11:00.608354+0000","last_unstale":"2024-09-14T12:10:14.311021+0000","last_undegraded":"2024-09-14T12:10:14.311021+0000","last_fullsized":"2024-09-14T12:10:14.311021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.310925+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.310925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:23.832794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'269","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:26.464707+0000","last_change":"2024-09-14T12:10:26.464707+0000","last_active":"2024-09-14T12:10:26.464707+0000","last_peered":"2024-09-14T12:10:26.464707+0000","last_clean":"2024-09-14T12:10:26.464707+0000","last_became_active":"2024-09-14T11:11:02.614913+0000","last_became_peered":"2024-09-14T11:11:02.614913+0000","last_unstale":"2024-09-14T12:10:26.464707+0000","last_undegraded":"2024-09-14T12:10:26.464707+0000","last_fullsized":"2024-09-14T12:10:26.464707+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'269","last_scrub_stamp":"2024-09-14T12:10:26.464613+0000","last_deep_scrub":"265'269","last_deep_scrub_stamp":"2024-09-14T12:10:26.464613+0000","last_clean_scrub_stamp":"2024-09-14T12:10:26.464613+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:58.834720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47004,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":999,"num_write":352,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.154161+0000","last_change":"2024-09-14T12:10:30.154161+0000","last_active":"2024-09-14T12:10:30.154161+0000","last_peered":"2024-09-14T12:10:30.154161+0000","last_clean":"2024-09-14T12:10:30.154161+0000","last_became_active":"2024-09-14T11:11:04.633551+0000","last_became_peered":"2024-09-14T11:11:04.633551+0000","last_unstale":"2024-09-14T12:10:30.154161+0000","last_undegraded":"2024-09-14T12:10:30.154161+0000","last_fullsized":"2024-09-14T12:10:30.154161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.154074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.154074+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.154074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:28.047612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'100","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.268794+0000","last_change":"2024-09-14T12:10:11.268794+0000","last_active":"2024-09-14T12:10:11.268794+0000","last_peered":"2024-09-14T12:10:11.268794+0000","last_clean":"2024-09-14T12:10:11.268794+0000","last_became_active":"2024-09-14T11:10:58.605951+0000","last_became_peered":"2024-09-14T11:10:58.605951+0000","last_unstale":"2024-09-14T12:10:11.268794+0000","last_undegraded":"2024-09-14T12:10:11.268794+0000","last_fullsized":"2024-09-14T12:10:11.268794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.268689+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.268689+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:54.243229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":436,"num_write":144,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'373","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.060204+0000","last_change":"2024-09-14T12:10:03.060204+0000","last_active":"2024-09-14T12:10:03.060204+0000","last_peered":"2024-09-14T12:10:03.060204+0000","last_clean":"2024-09-14T12:10:03.060204+0000","last_became_active":"2024-09-14T11:10:56.621645+0000","last_became_peered":"2024-09-14T11:10:56.621645+0000","last_unstale":"2024-09-14T12:10:03.060204+0000","last_undegraded":"2024-09-14T12:10:03.060204+0000","last_fullsized":"2024-09-14T12:10:03.060204+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:03.060083+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.060083+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.821132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":695,"num_read_kb":6455,"num_write":1238,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.291633+0000","last_change":"2024-09-14T12:10:16.291568+0000","last_active":"2024-09-14T12:10:16.291633+0000","last_peered":"2024-09-14T12:10:16.291633+0000","last_clean":"2024-09-14T12:10:16.291633+0000","last_became_active":"2024-09-14T11:11:00.602978+0000","last_became_peered":"2024-09-14T11:11:00.602978+0000","last_unstale":"2024-09-14T12:10:16.291633+0000","last_undegraded":"2024-09-14T12:10:16.291633+0000","last_fullsized":"2024-09-14T12:10:16.291633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:16.291473+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.291473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:05.832571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.809619+0000","last_change":"2024-09-14T12:10:19.809552+0000","last_active":"2024-09-14T12:10:19.809619+0000","last_peered":"2024-09-14T12:10:19.809619+0000","last_clean":"2024-09-14T12:10:19.809619+0000","last_became_active":"2024-09-14T11:11:02.615279+0000","last_became_peered":"2024-09-14T11:11:02.615279+0000","last_unstale":"2024-09-14T12:10:19.809619+0000","last_undegraded":"2024-09-14T12:10:19.809619+0000","last_fullsized":"2024-09-14T12:10:19.809619+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-14T12:10:19.809459+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.809459+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:52:21.052022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97591,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":912,"num_read_kb":2171,"num_write":788,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.658232+0000","last_change":"2024-09-14T12:10:30.658111+0000","last_active":"2024-09-14T12:10:30.658232+0000","last_peered":"2024-09-14T12:10:30.658232+0000","last_clean":"2024-09-14T12:10:30.658232+0000","last_became_active":"2024-09-14T11:11:04.636368+0000","last_became_peered":"2024-09-14T11:11:04.636368+0000","last_unstale":"2024-09-14T12:10:30.658232+0000","last_undegraded":"2024-09-14T12:10:30.658232+0000","last_fullsized":"2024-09-14T12:10:30.658232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:30.658016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:30.658016+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.658016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:29.843616+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'176","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.076865+0000","last_change":"2024-09-14T12:10:36.076865+0000","last_active":"2024-09-14T12:10:36.076865+0000","last_peered":"2024-09-14T12:10:36.076865+0000","last_clean":"2024-09-14T12:10:36.076865+0000","last_became_active":"2024-09-14T11:11:06.649754+0000","last_became_peered":"2024-09-14T11:11:06.649754+0000","last_unstale":"2024-09-14T12:10:36.076865+0000","last_undegraded":"2024-09-14T12:10:36.076865+0000","last_fullsized":"2024-09-14T12:10:36.076865+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-14T12:10:36.076779+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-14T12:10:36.076779+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.076779+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.804134+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":244,"num_write":394,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'260","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.138252+0000","last_change":"2024-09-14T12:10:12.138191+0000","last_active":"2024-09-14T12:10:12.138252+0000","last_peered":"2024-09-14T12:10:12.138252+0000","last_clean":"2024-09-14T12:10:12.138252+0000","last_became_active":"2024-09-14T11:10:58.606311+0000","last_became_peered":"2024-09-14T11:10:58.606311+0000","last_unstale":"2024-09-14T12:10:12.138252+0000","last_undegraded":"2024-09-14T12:10:12.138252+0000","last_fullsized":"2024-09-14T12:10:12.138252+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-14T12:10:12.138098+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.138098+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:11.397910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1138,"num_read_kb":935,"num_write":411,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'333","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.791625+0000","last_change":"2024-09-14T12:10:02.791625+0000","last_active":"2024-09-14T12:10:02.791625+0000","last_peered":"2024-09-14T12:10:02.791625+0000","last_clean":"2024-09-14T12:10:02.791625+0000","last_became_active":"2024-09-14T11:10:56.606241+0000","last_became_peered":"2024-09-14T11:10:56.606241+0000","last_unstale":"2024-09-14T12:10:02.791625+0000","last_undegraded":"2024-09-14T12:10:02.791625+0000","last_fullsized":"2024-09-14T12:10:02.791625+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-14T12:10:02.791485+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.791485+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:30.525115+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":4521,"num_write":984,"num_write_kb":22684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.329226+0000","last_change":"2024-09-14T12:10:15.329226+0000","last_active":"2024-09-14T12:10:15.329226+0000","last_peered":"2024-09-14T12:10:15.329226+0000","last_clean":"2024-09-14T12:10:15.329226+0000","last_became_active":"2024-09-14T11:11:00.608297+0000","last_became_peered":"2024-09-14T11:11:00.608297+0000","last_unstale":"2024-09-14T12:10:15.329226+0000","last_undegraded":"2024-09-14T12:10:15.329226+0000","last_fullsized":"2024-09-14T12:10:15.329226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:15.329133+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.329133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:37.556057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'320","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.515261+0000","last_change":"2024-09-14T12:10:28.515207+0000","last_active":"2024-09-14T12:10:28.515261+0000","last_peered":"2024-09-14T12:10:28.515261+0000","last_clean":"2024-09-14T12:10:28.515261+0000","last_became_active":"2024-09-14T11:11:02.610167+0000","last_became_peered":"2024-09-14T11:11:02.610167+0000","last_unstale":"2024-09-14T12:10:28.515261+0000","last_undegraded":"2024-09-14T12:10:28.515261+0000","last_fullsized":"2024-09-14T12:10:28.515261+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-14T12:10:28.515114+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-14T12:10:28.515114+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.515114+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:43.805134+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":1146,"num_write":444,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:21.824123+0000","last_change":"2024-09-14T12:10:21.824070+0000","last_active":"2024-09-14T12:10:21.824123+0000","last_peered":"2024-09-14T12:10:21.824123+0000","last_clean":"2024-09-14T12:10:21.824123+0000","last_became_active":"2024-09-14T11:11:04.630489+0000","last_became_peered":"2024-09-14T11:11:04.630489+0000","last_unstale":"2024-09-14T12:10:21.824123+0000","last_undegraded":"2024-09-14T12:10:21.824123+0000","last_fullsized":"2024-09-14T12:10:21.824123+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:21.823994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:21.823994+0000","last_clean_scrub_stamp":"2024-09-14T12:10:21.823994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:43.993330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'193","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.504212+0000","last_change":"2024-09-14T12:10:28.504212+0000","last_active":"2024-09-14T12:10:28.504212+0000","last_peered":"2024-09-14T12:10:28.504212+0000","last_clean":"2024-09-14T12:10:28.504212+0000","last_became_active":"2024-09-14T11:11:06.646872+0000","last_became_peered":"2024-09-14T11:11:06.646872+0000","last_unstale":"2024-09-14T12:10:28.504212+0000","last_undegraded":"2024-09-14T12:10:28.504212+0000","last_fullsized":"2024-09-14T12:10:28.504212+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'193","last_scrub_stamp":"2024-09-14T12:10:28.504112+0000","last_deep_scrub":"265'193","last_deep_scrub_stamp":"2024-09-14T12:10:28.504112+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.504112+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:54.702733+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1643,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":315,"num_read_kb":284,"num_write":549,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'251","reported_seq":868,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.129601+0000","last_change":"2024-09-14T12:10:14.129538+0000","last_active":"2024-09-14T12:10:14.129601+0000","last_peered":"2024-09-14T12:10:14.129601+0000","last_clean":"2024-09-14T12:10:14.129601+0000","last_became_active":"2024-09-14T11:10:58.602747+0000","last_became_peered":"2024-09-14T11:10:58.602747+0000","last_unstale":"2024-09-14T12:10:14.129601+0000","last_undegraded":"2024-09-14T12:10:14.129601+0000","last_fullsized":"2024-09-14T12:10:14.129601+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-14T12:10:14.129436+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.129436+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:00.790479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1089,"num_read_kb":881,"num_write":379,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'343","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:01.585762+0000","last_change":"2024-09-14T12:10:01.585762+0000","last_active":"2024-09-14T12:10:01.585762+0000","last_peered":"2024-09-14T12:10:01.585762+0000","last_clean":"2024-09-14T12:10:01.585762+0000","last_became_active":"2024-09-14T11:11:32.678959+0000","last_became_peered":"2024-09-14T11:11:32.678959+0000","last_unstale":"2024-09-14T12:10:01.585762+0000","last_undegraded":"2024-09-14T12:10:01.585762+0000","last_fullsized":"2024-09-14T12:10:01.585762+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-14T12:10:01.585672+0000","last_clean_scrub_stamp":"2024-09-14T12:10:01.585672+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.361742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386333,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":625,"num_read_kb":125003,"num_write":1056,"num_write_kb":67332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.102930+0000","last_change":"2024-09-14T12:10:23.102871+0000","last_active":"2024-09-14T12:10:23.102930+0000","last_peered":"2024-09-14T12:10:23.102930+0000","last_clean":"2024-09-14T12:10:23.102930+0000","last_became_active":"2024-09-14T11:11:00.610131+0000","last_became_peered":"2024-09-14T11:11:00.610131+0000","last_unstale":"2024-09-14T12:10:23.102930+0000","last_undegraded":"2024-09-14T12:10:23.102930+0000","last_fullsized":"2024-09-14T12:10:23.102930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.102779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.102779+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.102779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:26.238331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'309","reported_seq":897,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:30.209118+0000","last_change":"2024-09-14T12:10:30.209118+0000","last_active":"2024-09-14T12:10:30.209118+0000","last_peered":"2024-09-14T12:10:30.209118+0000","last_clean":"2024-09-14T12:10:30.209118+0000","last_became_active":"2024-09-14T11:11:02.881887+0000","last_became_peered":"2024-09-14T11:11:02.881887+0000","last_unstale":"2024-09-14T12:10:30.209118+0000","last_undegraded":"2024-09-14T12:10:30.209118+0000","last_fullsized":"2024-09-14T12:10:30.209118+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:10:30.209019+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:10:30.209019+0000","last_clean_scrub_stamp":"2024-09-14T12:10:30.209019+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:02.348494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48560,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":491,"num_read_kb":1115,"num_write":402,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.836913+0000","last_change":"2024-09-14T12:10:22.836816+0000","last_active":"2024-09-14T12:10:22.836913+0000","last_peered":"2024-09-14T12:10:22.836913+0000","last_clean":"2024-09-14T12:10:22.836913+0000","last_became_active":"2024-09-14T11:11:04.637384+0000","last_became_peered":"2024-09-14T11:11:04.637384+0000","last_unstale":"2024-09-14T12:10:22.836913+0000","last_undegraded":"2024-09-14T12:10:22.836913+0000","last_fullsized":"2024-09-14T12:10:22.836913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:22.836737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:22.836737+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.836737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:53.232235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'138","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.569934+0000","last_change":"2024-09-14T12:10:35.569934+0000","last_active":"2024-09-14T12:10:35.569934+0000","last_peered":"2024-09-14T12:10:35.569934+0000","last_clean":"2024-09-14T12:10:35.569934+0000","last_became_active":"2024-09-14T11:11:06.644173+0000","last_became_peered":"2024-09-14T11:11:06.644173+0000","last_unstale":"2024-09-14T12:10:35.569934+0000","last_undegraded":"2024-09-14T12:10:35.569934+0000","last_fullsized":"2024-09-14T12:10:35.569934+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-14T12:10:35.569829+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-14T12:10:35.569829+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.569829+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:57.670180+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'162","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.689718+0000","last_change":"2024-09-14T12:10:13.689637+0000","last_active":"2024-09-14T12:10:13.689718+0000","last_peered":"2024-09-14T12:10:13.689718+0000","last_clean":"2024-09-14T12:10:13.689718+0000","last_became_active":"2024-09-14T11:10:58.609095+0000","last_became_peered":"2024-09-14T11:10:58.609095+0000","last_unstale":"2024-09-14T12:10:13.689718+0000","last_undegraded":"2024-09-14T12:10:13.689718+0000","last_fullsized":"2024-09-14T12:10:13.689718+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-14T12:10:13.689552+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.689552+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:15.549909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":738,"num_read_kb":616,"num_write":252,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'420","reported_seq":1141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:09:58.035145+0000","last_change":"2024-09-14T12:09:58.035048+0000","last_active":"2024-09-14T12:09:58.035145+0000","last_peered":"2024-09-14T12:09:58.035145+0000","last_clean":"2024-09-14T12:09:58.035145+0000","last_became_active":"2024-09-14T11:10:56.610436+0000","last_became_peered":"2024-09-14T11:10:56.610436+0000","last_unstale":"2024-09-14T12:09:58.035145+0000","last_undegraded":"2024-09-14T12:09:58.035145+0000","last_fullsized":"2024-09-14T12:09:58.035145+0000","mapping_epoch":25,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'420","last_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_deep_scrub":"265'420","last_deep_scrub_stamp":"2024-09-14T12:09:58.034944+0000","last_clean_scrub_stamp":"2024-09-14T12:09:58.034944+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:02.918444+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":916,"num_read_kb":75270,"num_write":1291,"num_write_kb":31740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.727644+0000","last_change":"2024-09-14T12:10:14.727588+0000","last_active":"2024-09-14T12:10:14.727644+0000","last_peered":"2024-09-14T12:10:14.727644+0000","last_clean":"2024-09-14T12:10:14.727644+0000","last_became_active":"2024-09-14T11:11:00.608264+0000","last_became_peered":"2024-09-14T11:11:00.608264+0000","last_unstale":"2024-09-14T12:10:14.727644+0000","last_undegraded":"2024-09-14T12:10:14.727644+0000","last_fullsized":"2024-09-14T12:10:14.727644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:14.727491+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.727491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:45.961043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'114","reported_seq":643,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.102571+0000","last_change":"2024-09-14T12:10:27.102506+0000","last_active":"2024-09-14T12:10:27.102571+0000","last_peered":"2024-09-14T12:10:27.102571+0000","last_clean":"2024-09-14T12:10:27.102571+0000","last_became_active":"2024-09-14T11:11:02.881919+0000","last_became_peered":"2024-09-14T11:11:02.881919+0000","last_unstale":"2024-09-14T12:10:27.102571+0000","last_undegraded":"2024-09-14T12:10:27.102571+0000","last_fullsized":"2024-09-14T12:10:27.102571+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-14T12:10:27.102406+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-14T12:10:27.102406+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.102406+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:31.401975+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":125,"num_write":140,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'777","reported_seq":2377,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:20.392892+0000","last_change":"2024-09-14T12:10:20.392892+0000","last_active":"2024-09-14T12:10:20.392892+0000","last_peered":"2024-09-14T12:10:20.392892+0000","last_clean":"2024-09-14T12:10:20.392892+0000","last_became_active":"2024-09-14T11:11:04.633902+0000","last_became_peered":"2024-09-14T11:11:04.633902+0000","last_unstale":"2024-09-14T12:10:20.392892+0000","last_undegraded":"2024-09-14T12:10:20.392892+0000","last_fullsized":"2024-09-14T12:10:20.392892+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'777","last_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_deep_scrub":"265'777","last_deep_scrub_stamp":"2024-09-14T12:10:20.392801+0000","last_clean_scrub_stamp":"2024-09-14T12:10:20.392801+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:46.710130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'127","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:33.489519+0000","last_change":"2024-09-14T12:10:33.489519+0000","last_active":"2024-09-14T12:10:33.489519+0000","last_peered":"2024-09-14T12:10:33.489519+0000","last_clean":"2024-09-14T12:10:33.489519+0000","last_became_active":"2024-09-14T11:11:06.646176+0000","last_became_peered":"2024-09-14T11:11:06.646176+0000","last_unstale":"2024-09-14T12:10:33.489519+0000","last_undegraded":"2024-09-14T12:10:33.489519+0000","last_fullsized":"2024-09-14T12:10:33.489519+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-14T12:10:33.489423+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-14T12:10:33.489423+0000","last_clean_scrub_stamp":"2024-09-14T12:10:33.489423+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:49.539458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":170,"num_write":311,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'100","reported_seq":680,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.888232+0000","last_change":"2024-09-14T12:10:11.888161+0000","last_active":"2024-09-14T12:10:11.888232+0000","last_peered":"2024-09-14T12:10:11.888232+0000","last_clean":"2024-09-14T12:10:11.888232+0000","last_became_active":"2024-09-14T11:10:58.611647+0000","last_became_peered":"2024-09-14T11:10:58.611647+0000","last_unstale":"2024-09-14T12:10:11.888232+0000","last_undegraded":"2024-09-14T12:10:11.888232+0000","last_fullsized":"2024-09-14T12:10:11.888232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'100","last_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_deep_scrub":"265'100","last_deep_scrub_stamp":"2024-09-14T12:10:11.888043+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.888043+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:35:26.749909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":385,"num_write":144,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'295","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.716546+0000","last_change":"2024-09-14T12:10:06.716484+0000","last_active":"2024-09-14T12:10:06.716546+0000","last_peered":"2024-09-14T12:10:06.716546+0000","last_clean":"2024-09-14T12:10:06.716546+0000","last_became_active":"2024-09-14T11:10:56.601801+0000","last_became_peered":"2024-09-14T11:10:56.601801+0000","last_unstale":"2024-09-14T12:10:06.716546+0000","last_undegraded":"2024-09-14T12:10:06.716546+0000","last_fullsized":"2024-09-14T12:10:06.716546+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-14T12:10:06.716383+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.716383+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:44.130365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":547,"num_read_kb":114075,"num_write":994,"num_write_kb":47085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.523215+0000","last_change":"2024-09-14T12:10:23.523154+0000","last_active":"2024-09-14T12:10:23.523215+0000","last_peered":"2024-09-14T12:10:23.523215+0000","last_clean":"2024-09-14T12:10:23.523215+0000","last_became_active":"2024-09-14T11:11:00.608285+0000","last_became_peered":"2024-09-14T11:11:00.608285+0000","last_unstale":"2024-09-14T12:10:23.523215+0000","last_undegraded":"2024-09-14T12:10:23.523215+0000","last_fullsized":"2024-09-14T12:10:23.523215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:23.523074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:23.523074+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.523074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:22.174213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'309","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.710490+0000","last_change":"2024-09-14T12:10:29.710490+0000","last_active":"2024-09-14T12:10:29.710490+0000","last_peered":"2024-09-14T12:10:29.710490+0000","last_clean":"2024-09-14T12:10:29.710490+0000","last_became_active":"2024-09-14T11:11:02.616261+0000","last_became_peered":"2024-09-14T11:11:02.616261+0000","last_unstale":"2024-09-14T12:10:29.710490+0000","last_undegraded":"2024-09-14T12:10:29.710490+0000","last_fullsized":"2024-09-14T12:10:29.710490+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-14T12:10:29.710346+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-14T12:10:29.710346+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.710346+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:11.757953+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":481,"num_read_kb":1004,"num_write":382,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:28.107162+0000","last_change":"2024-09-14T12:10:28.107162+0000","last_active":"2024-09-14T12:10:28.107162+0000","last_peered":"2024-09-14T12:10:28.107162+0000","last_clean":"2024-09-14T12:10:28.107162+0000","last_became_active":"2024-09-14T11:11:04.634808+0000","last_became_peered":"2024-09-14T11:11:04.634808+0000","last_unstale":"2024-09-14T12:10:28.107162+0000","last_undegraded":"2024-09-14T12:10:28.107162+0000","last_fullsized":"2024-09-14T12:10:28.107162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:28.107065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:28.107065+0000","last_clean_scrub_stamp":"2024-09-14T12:10:28.107065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:25.172614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'104","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:34.479326+0000","last_change":"2024-09-14T12:10:34.479326+0000","last_active":"2024-09-14T12:10:34.479326+0000","last_peered":"2024-09-14T12:10:34.479326+0000","last_clean":"2024-09-14T12:10:34.479326+0000","last_became_active":"2024-09-14T11:11:06.648831+0000","last_became_peered":"2024-09-14T11:11:06.648831+0000","last_unstale":"2024-09-14T12:10:34.479326+0000","last_undegraded":"2024-09-14T12:10:34.479326+0000","last_fullsized":"2024-09-14T12:10:34.479326+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'104","last_scrub_stamp":"2024-09-14T12:10:34.479231+0000","last_deep_scrub":"265'104","last_deep_scrub_stamp":"2024-09-14T12:10:34.479231+0000","last_clean_scrub_stamp":"2024-09-14T12:10:34.479231+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:05.636206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":109,"num_read_kb":103,"num_write":249,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'224","reported_seq":809,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.902339+0000","last_change":"2024-09-14T12:10:09.902249+0000","last_active":"2024-09-14T12:10:09.902339+0000","last_peered":"2024-09-14T12:10:09.902339+0000","last_clean":"2024-09-14T12:10:09.902339+0000","last_became_active":"2024-09-14T11:10:58.611589+0000","last_became_peered":"2024-09-14T11:10:58.611589+0000","last_unstale":"2024-09-14T12:10:09.902339+0000","last_undegraded":"2024-09-14T12:10:09.902339+0000","last_fullsized":"2024-09-14T12:10:09.902339+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'224","last_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_deep_scrub":"265'224","last_deep_scrub_stamp":"2024-09-14T12:10:09.902123+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.902123+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:17.521695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":985,"num_read_kb":787,"num_write":358,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'364","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.657969+0000","last_change":"2024-09-14T12:10:09.657890+0000","last_active":"2024-09-14T12:10:09.657969+0000","last_peered":"2024-09-14T12:10:09.657969+0000","last_clean":"2024-09-14T12:10:09.657969+0000","last_became_active":"2024-09-14T11:12:32.771661+0000","last_became_peered":"2024-09-14T11:12:32.771661+0000","last_unstale":"2024-09-14T12:10:09.657969+0000","last_undegraded":"2024-09-14T12:10:09.657969+0000","last_fullsized":"2024-09-14T12:10:09.657969+0000","mapping_epoch":40,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-14T12:10:09.657777+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.657777+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:26.554926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":577,"num_read_kb":11549,"num_write":1068,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:25.624064+0000","last_change":"2024-09-14T12:10:25.624010+0000","last_active":"2024-09-14T12:10:25.624064+0000","last_peered":"2024-09-14T12:10:25.624064+0000","last_clean":"2024-09-14T12:10:25.624064+0000","last_became_active":"2024-09-14T11:11:00.610456+0000","last_became_peered":"2024-09-14T11:11:00.610456+0000","last_unstale":"2024-09-14T12:10:25.624064+0000","last_undegraded":"2024-09-14T12:10:25.624064+0000","last_fullsized":"2024-09-14T12:10:25.624064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:25.623907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:25.623907+0000","last_clean_scrub_stamp":"2024-09-14T12:10:25.623907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:56.414412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:23.210307+0000","last_change":"2024-09-14T12:10:23.210307+0000","last_active":"2024-09-14T12:10:23.210307+0000","last_peered":"2024-09-14T12:10:23.210307+0000","last_clean":"2024-09-14T12:10:23.210307+0000","last_became_active":"2024-09-14T11:11:02.617443+0000","last_became_peered":"2024-09-14T11:11:02.617443+0000","last_unstale":"2024-09-14T12:10:23.210307+0000","last_undegraded":"2024-09-14T12:10:23.210307+0000","last_fullsized":"2024-09-14T12:10:23.210307+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-14T12:10:23.210222+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-14T12:10:23.210222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:23.210222+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:40.458601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44701,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1000,"num_write":364,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:19.390487+0000","last_change":"2024-09-14T12:10:19.390487+0000","last_active":"2024-09-14T12:10:19.390487+0000","last_peered":"2024-09-14T12:10:19.390487+0000","last_clean":"2024-09-14T12:10:19.390487+0000","last_became_active":"2024-09-14T11:11:04.628993+0000","last_became_peered":"2024-09-14T11:11:04.628993+0000","last_unstale":"2024-09-14T12:10:19.390487+0000","last_undegraded":"2024-09-14T12:10:19.390487+0000","last_fullsized":"2024-09-14T12:10:19.390487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:19.390407+0000","last_clean_scrub_stamp":"2024-09-14T12:10:19.390407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:27.514718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'108","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:37.087993+0000","last_change":"2024-09-14T12:10:37.087993+0000","last_active":"2024-09-14T12:10:37.087993+0000","last_peered":"2024-09-14T12:10:37.087993+0000","last_clean":"2024-09-14T12:10:37.087993+0000","last_became_active":"2024-09-14T11:11:06.643923+0000","last_became_peered":"2024-09-14T11:11:06.643923+0000","last_unstale":"2024-09-14T12:10:37.087993+0000","last_undegraded":"2024-09-14T12:10:37.087993+0000","last_fullsized":"2024-09-14T12:10:37.087993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-14T12:10:37.087898+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-14T12:10:37.087898+0000","last_clean_scrub_stamp":"2024-09-14T12:10:37.087898+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:40.698273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":137,"num_write":240,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'441","reported_seq":1205,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.090742+0000","last_change":"2024-09-14T12:10:13.090742+0000","last_active":"2024-09-14T12:10:13.090742+0000","last_peered":"2024-09-14T12:10:13.090742+0000","last_clean":"2024-09-14T12:10:13.090742+0000","last_became_active":"2024-09-14T11:10:58.608047+0000","last_became_peered":"2024-09-14T11:10:58.608047+0000","last_unstale":"2024-09-14T12:10:13.090742+0000","last_undegraded":"2024-09-14T12:10:13.090742+0000","last_fullsized":"2024-09-14T12:10:13.090742+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'441","last_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_deep_scrub":"265'441","last_deep_scrub_stamp":"2024-09-14T12:10:13.090640+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.090640+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:48.381349+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2099,"num_read_kb":1793,"num_write":680,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25759,"num_omap_keys":101,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'351","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.065847+0000","last_change":"2024-09-14T12:10:02.065794+0000","last_active":"2024-09-14T12:10:02.065847+0000","last_peered":"2024-09-14T12:10:02.065847+0000","last_clean":"2024-09-14T12:10:02.065847+0000","last_became_active":"2024-09-14T11:10:56.618597+0000","last_became_peered":"2024-09-14T11:10:56.618597+0000","last_unstale":"2024-09-14T12:10:02.065847+0000","last_undegraded":"2024-09-14T12:10:02.065847+0000","last_fullsized":"2024-09-14T12:10:02.065847+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'351","last_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_deep_scrub":"265'351","last_deep_scrub_stamp":"2024-09-14T12:10:02.065711+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.065711+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:42.511318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":529,"num_read_kb":1479,"num_write":1091,"num_write_kb":20539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:22.083133+0000","last_change":"2024-09-14T12:10:22.083133+0000","last_active":"2024-09-14T12:10:22.083133+0000","last_peered":"2024-09-14T12:10:22.083133+0000","last_clean":"2024-09-14T12:10:22.083133+0000","last_became_active":"2024-09-14T11:11:00.613201+0000","last_became_peered":"2024-09-14T11:11:00.613201+0000","last_unstale":"2024-09-14T12:10:22.083133+0000","last_undegraded":"2024-09-14T12:10:22.083133+0000","last_fullsized":"2024-09-14T12:10:22.083133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:22.083055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:22.083055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:22.083055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:26.984342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'239","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:27.190215+0000","last_change":"2024-09-14T12:10:27.190156+0000","last_active":"2024-09-14T12:10:27.190215+0000","last_peered":"2024-09-14T12:10:27.190215+0000","last_clean":"2024-09-14T12:10:27.190215+0000","last_became_active":"2024-09-14T11:11:02.619761+0000","last_became_peered":"2024-09-14T11:11:02.619761+0000","last_unstale":"2024-09-14T12:10:27.190215+0000","last_undegraded":"2024-09-14T12:10:27.190215+0000","last_fullsized":"2024-09-14T12:10:27.190215+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'239","last_scrub_stamp":"2024-09-14T12:10:27.190067+0000","last_deep_scrub":"265'239","last_deep_scrub_stamp":"2024-09-14T12:10:27.190067+0000","last_clean_scrub_stamp":"2024-09-14T12:10:27.190067+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:54.545499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":394,"num_read_kb":952,"num_write":322,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:31.057085+0000","last_change":"2024-09-14T12:10:31.057034+0000","last_active":"2024-09-14T12:10:31.057085+0000","last_peered":"2024-09-14T12:10:31.057085+0000","last_clean":"2024-09-14T12:10:31.057085+0000","last_became_active":"2024-09-14T11:11:04.636622+0000","last_became_peered":"2024-09-14T11:11:04.636622+0000","last_unstale":"2024-09-14T12:10:31.057085+0000","last_undegraded":"2024-09-14T12:10:31.057085+0000","last_fullsized":"2024-09-14T12:10:31.057085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:31.056932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:31.056932+0000","last_clean_scrub_stamp":"2024-09-14T12:10:31.056932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:54.148855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'216","reported_seq":1696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:35.529583+0000","last_change":"2024-09-14T12:10:35.529583+0000","last_active":"2024-09-14T12:10:35.529583+0000","last_peered":"2024-09-14T12:10:35.529583+0000","last_clean":"2024-09-14T12:10:35.529583+0000","last_became_active":"2024-09-14T11:11:06.646057+0000","last_became_peered":"2024-09-14T11:11:06.646057+0000","last_unstale":"2024-09-14T12:10:35.529583+0000","last_undegraded":"2024-09-14T12:10:35.529583+0000","last_fullsized":"2024-09-14T12:10:35.529583+0000","mapping_epoch":35,"log_start":"265'201","ondisk_log_start":"265'201","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'216","last_scrub_stamp":"2024-09-14T12:10:35.529481+0000","last_deep_scrub":"265'216","last_deep_scrub_stamp":"2024-09-14T12:10:35.529481+0000","last_clean_scrub_stamp":"2024-09-14T12:10:35.529481+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":201,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:19.632377+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1236,"num_read_kb":1220,"num_write":420,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'192","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.885591+0000","last_change":"2024-09-14T12:10:08.885591+0000","last_active":"2024-09-14T12:10:08.885591+0000","last_peered":"2024-09-14T12:10:08.885591+0000","last_clean":"2024-09-14T12:10:08.885591+0000","last_became_active":"2024-09-14T11:10:58.602773+0000","last_became_peered":"2024-09-14T11:10:58.602773+0000","last_unstale":"2024-09-14T12:10:08.885591+0000","last_undegraded":"2024-09-14T12:10:08.885591+0000","last_fullsized":"2024-09-14T12:10:08.885591+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-14T12:10:08.885498+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.885498+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:11.730545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":868,"num_read_kb":720,"num_write":311,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'348","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.083183+0000","last_change":"2024-09-14T12:10:04.083183+0000","last_active":"2024-09-14T12:10:04.083183+0000","last_peered":"2024-09-14T12:10:04.083183+0000","last_clean":"2024-09-14T12:10:04.083183+0000","last_became_active":"2024-09-14T11:10:56.608860+0000","last_became_peered":"2024-09-14T11:10:56.608860+0000","last_unstale":"2024-09-14T12:10:04.083183+0000","last_undegraded":"2024-09-14T12:10:04.083183+0000","last_fullsized":"2024-09-14T12:10:04.083183+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:04.083077+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.083077+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:38.782611+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":4572,"num_write":1085,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.789830+0000","last_change":"2024-09-14T12:10:16.789830+0000","last_active":"2024-09-14T12:10:16.789830+0000","last_peered":"2024-09-14T12:10:16.789830+0000","last_clean":"2024-09-14T12:10:16.789830+0000","last_became_active":"2024-09-14T11:11:00.609776+0000","last_became_peered":"2024-09-14T11:11:00.609776+0000","last_unstale":"2024-09-14T12:10:16.789830+0000","last_undegraded":"2024-09-14T12:10:16.789830+0000","last_fullsized":"2024-09-14T12:10:16.789830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-14T12:10:16.789746+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.789746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:21.212395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'311","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:29.104527+0000","last_change":"2024-09-14T12:10:29.104466+0000","last_active":"2024-09-14T12:10:29.104527+0000","last_peered":"2024-09-14T12:10:29.104527+0000","last_clean":"2024-09-14T12:10:29.104527+0000","last_became_active":"2024-09-14T11:11:02.615570+0000","last_became_peered":"2024-09-14T11:11:02.615570+0000","last_unstale":"2024-09-14T12:10:29.104527+0000","last_undegraded":"2024-09-14T12:10:29.104527+0000","last_fullsized":"2024-09-14T12:10:29.104527+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-14T12:10:29.104374+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-14T12:10:29.104374+0000","last_clean_scrub_stamp":"2024-09-14T12:10:29.104374+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:59.515158+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47744,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":489,"num_read_kb":1041,"num_write":392,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:36.186924+0000","last_change":"2024-09-14T12:10:36.186869+0000","last_active":"2024-09-14T12:10:36.186924+0000","last_peered":"2024-09-14T12:10:36.186924+0000","last_clean":"2024-09-14T12:10:36.186924+0000","last_became_active":"2024-09-14T11:11:04.638072+0000","last_became_peered":"2024-09-14T11:11:04.638072+0000","last_unstale":"2024-09-14T12:10:36.186924+0000","last_undegraded":"2024-09-14T12:10:36.186924+0000","last_fullsized":"2024-09-14T12:10:36.186924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T12:10:36.186785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T12:10:36.186785+0000","last_clean_scrub_stamp":"2024-09-14T12:10:36.186785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.512864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'133","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:32.022815+0000","last_change":"2024-09-14T12:10:32.022815+0000","last_active":"2024-09-14T12:10:32.022815+0000","last_peered":"2024-09-14T12:10:32.022815+0000","last_clean":"2024-09-14T12:10:32.022815+0000","last_became_active":"2024-09-14T11:11:06.649880+0000","last_became_peered":"2024-09-14T11:11:06.649880+0000","last_unstale":"2024-09-14T12:10:32.022815+0000","last_undegraded":"2024-09-14T12:10:32.022815+0000","last_fullsized":"2024-09-14T12:10:32.022815+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:32.022721+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:32.022721+0000","last_clean_scrub_stamp":"2024-09-14T12:10:32.022721+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:48.560732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":114,"num_write":296,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'94","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.721989+0000","last_change":"2024-09-14T12:10:13.721989+0000","last_active":"2024-09-14T12:10:13.721989+0000","last_peered":"2024-09-14T12:10:13.721989+0000","last_clean":"2024-09-14T12:10:13.721989+0000","last_became_active":"2024-09-14T11:10:58.607556+0000","last_became_peered":"2024-09-14T11:10:58.607556+0000","last_unstale":"2024-09-14T12:10:13.721989+0000","last_undegraded":"2024-09-14T12:10:13.721989+0000","last_fullsized":"2024-09-14T12:10:13.721989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'94","last_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_deep_scrub":"265'94","last_deep_scrub_stamp":"2024-09-14T12:10:13.721897+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.721897+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:48.815645+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":347,"num_write":141,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'310","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.318587+0000","last_change":"2024-09-14T12:10:04.318587+0000","last_active":"2024-09-14T12:10:04.318587+0000","last_peered":"2024-09-14T12:10:04.318587+0000","last_clean":"2024-09-14T12:10:04.318587+0000","last_became_active":"2024-09-14T11:10:56.618162+0000","last_became_peered":"2024-09-14T11:10:56.618162+0000","last_unstale":"2024-09-14T12:10:04.318587+0000","last_undegraded":"2024-09-14T12:10:04.318587+0000","last_fullsized":"2024-09-14T12:10:04.318587+0000","mapping_epoch":25,"log_start":"265'200","ondisk_log_start":"265'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'310","last_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_deep_scrub":"265'310","last_deep_scrub_stamp":"2024-09-14T12:10:04.318456+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.318456+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:42.943217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":25535,"num_write":1011,"num_write_kb":32675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'181","reported_seq":797,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.772140+0000","last_change":"2024-09-14T12:10:10.772140+0000","last_active":"2024-09-14T12:10:10.772140+0000","last_peered":"2024-09-14T12:10:10.772140+0000","last_clean":"2024-09-14T12:10:10.772140+0000","last_became_active":"2024-09-14T11:10:58.609414+0000","last_became_peered":"2024-09-14T11:10:58.609414+0000","last_unstale":"2024-09-14T12:10:10.772140+0000","last_undegraded":"2024-09-14T12:10:10.772140+0000","last_fullsized":"2024-09-14T12:10:10.772140+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'181","last_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_deep_scrub":"265'181","last_deep_scrub_stamp":"2024-09-14T12:10:10.772052+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.772052+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.934951+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":627,"num_write":276,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'354","reported_seq":1089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:02.544506+0000","last_change":"2024-09-14T12:10:02.544506+0000","last_active":"2024-09-14T12:10:02.544506+0000","last_peered":"2024-09-14T12:10:02.544506+0000","last_clean":"2024-09-14T12:10:02.544506+0000","last_became_active":"2024-09-14T11:10:56.612359+0000","last_became_peered":"2024-09-14T11:10:56.612359+0000","last_unstale":"2024-09-14T12:10:02.544506+0000","last_undegraded":"2024-09-14T12:10:02.544506+0000","last_fullsized":"2024-09-14T12:10:02.544506+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-14T12:10:02.544370+0000","last_clean_scrub_stamp":"2024-09-14T12:10:02.544370+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:51.044659+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":943,"num_read_kb":26386,"num_write":1247,"num_write_kb":16736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'226","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.681166+0000","last_change":"2024-09-14T12:10:16.681166+0000","last_active":"2024-09-14T12:10:16.681166+0000","last_peered":"2024-09-14T12:10:16.681166+0000","last_clean":"2024-09-14T12:10:16.681166+0000","last_became_active":"2024-09-14T11:10:58.599682+0000","last_became_peered":"2024-09-14T11:10:58.599682+0000","last_unstale":"2024-09-14T12:10:16.681166+0000","last_undegraded":"2024-09-14T12:10:16.681166+0000","last_fullsized":"2024-09-14T12:10:16.681166+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-14T12:10:16.681055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.681055+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.774592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":978,"num_read_kb":812,"num_write":347,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'349","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.749863+0000","last_change":"2024-09-14T12:10:05.749863+0000","last_active":"2024-09-14T12:10:05.749863+0000","last_peered":"2024-09-14T12:10:05.749863+0000","last_clean":"2024-09-14T12:10:05.749863+0000","last_became_active":"2024-09-14T11:10:56.622323+0000","last_became_peered":"2024-09-14T11:10:56.622323+0000","last_unstale":"2024-09-14T12:10:05.749863+0000","last_undegraded":"2024-09-14T12:10:05.749863+0000","last_fullsized":"2024-09-14T12:10:05.749863+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'349","last_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_deep_scrub":"265'349","last_deep_scrub_stamp":"2024-09-14T12:10:05.749741+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.749741+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:29.820426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":18057,"num_write":1029,"num_write_kb":23362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'445","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:09.781574+0000","last_change":"2024-09-14T12:10:09.781574+0000","last_active":"2024-09-14T12:10:09.781574+0000","last_peered":"2024-09-14T12:10:09.781574+0000","last_clean":"2024-09-14T12:10:09.781574+0000","last_became_active":"2024-09-14T11:10:58.598521+0000","last_became_peered":"2024-09-14T11:10:58.598521+0000","last_unstale":"2024-09-14T12:10:09.781574+0000","last_undegraded":"2024-09-14T12:10:09.781574+0000","last_fullsized":"2024-09-14T12:10:09.781574+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'445","last_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_deep_scrub":"265'445","last_deep_scrub_stamp":"2024-09-14T12:10:09.781479+0000","last_clean_scrub_stamp":"2024-09-14T12:10:09.781479+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:34.531293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1431,"num_write":672,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'339","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.038240+0000","last_change":"2024-09-14T12:10:03.038240+0000","last_active":"2024-09-14T12:10:03.038240+0000","last_peered":"2024-09-14T12:10:03.038240+0000","last_clean":"2024-09-14T12:10:03.038240+0000","last_became_active":"2024-09-14T11:11:32.790033+0000","last_became_peered":"2024-09-14T11:11:32.790033+0000","last_unstale":"2024-09-14T12:10:03.038240+0000","last_undegraded":"2024-09-14T12:10:03.038240+0000","last_fullsized":"2024-09-14T12:10:03.038240+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'339","last_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_deep_scrub":"265'339","last_deep_scrub_stamp":"2024-09-14T12:10:03.038108+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.038108+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.535266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263498,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":9886,"num_write":1170,"num_write_kb":49140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'44","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:16.185314+0000","last_change":"2024-09-14T12:10:16.185314+0000","last_active":"2024-09-14T12:10:16.185314+0000","last_peered":"2024-09-14T12:10:16.185314+0000","last_clean":"2024-09-14T12:10:16.185314+0000","last_became_active":"2024-09-14T11:10:58.603104+0000","last_became_peered":"2024-09-14T11:10:58.603104+0000","last_unstale":"2024-09-14T12:10:16.185314+0000","last_undegraded":"2024-09-14T12:10:16.185314+0000","last_fullsized":"2024-09-14T12:10:16.185314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-14T12:10:16.185216+0000","last_clean_scrub_stamp":"2024-09-14T12:10:16.185216+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:09.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":193,"num_write":56,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'373","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.015350+0000","last_change":"2024-09-14T12:10:04.015350+0000","last_active":"2024-09-14T12:10:04.015350+0000","last_peered":"2024-09-14T12:10:04.015350+0000","last_clean":"2024-09-14T12:10:04.015350+0000","last_became_active":"2024-09-14T11:10:56.617302+0000","last_became_peered":"2024-09-14T11:10:56.617302+0000","last_unstale":"2024-09-14T12:10:04.015350+0000","last_undegraded":"2024-09-14T12:10:04.015350+0000","last_fullsized":"2024-09-14T12:10:04.015350+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-14T12:10:04.015227+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.015227+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:44.163154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":11859,"num_write":1346,"num_write_kb":27778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'248","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:12.883633+0000","last_change":"2024-09-14T12:10:12.883633+0000","last_active":"2024-09-14T12:10:12.883633+0000","last_peered":"2024-09-14T12:10:12.883633+0000","last_clean":"2024-09-14T12:10:12.883633+0000","last_became_active":"2024-09-14T11:10:58.603781+0000","last_became_peered":"2024-09-14T11:10:58.603781+0000","last_unstale":"2024-09-14T12:10:12.883633+0000","last_undegraded":"2024-09-14T12:10:12.883633+0000","last_fullsized":"2024-09-14T12:10:12.883633+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'248","last_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_deep_scrub":"265'248","last_deep_scrub_stamp":"2024-09-14T12:10:12.883551+0000","last_clean_scrub_stamp":"2024-09-14T12:10:12.883551+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:51.010155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1079,"num_read_kb":883,"num_write":377,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'322","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:03.798328+0000","last_change":"2024-09-14T12:10:03.798328+0000","last_active":"2024-09-14T12:10:03.798328+0000","last_peered":"2024-09-14T12:10:03.798328+0000","last_clean":"2024-09-14T12:10:03.798328+0000","last_became_active":"2024-09-14T11:10:56.607266+0000","last_became_peered":"2024-09-14T11:10:56.607266+0000","last_unstale":"2024-09-14T12:10:03.798328+0000","last_undegraded":"2024-09-14T12:10:03.798328+0000","last_fullsized":"2024-09-14T12:10:03.798328+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-14T12:10:03.798206+0000","last_clean_scrub_stamp":"2024-09-14T12:10:03.798206+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:42.809623+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":36459,"num_write":976,"num_write_kb":36658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'107","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.152436+0000","last_change":"2024-09-14T12:10:15.152436+0000","last_active":"2024-09-14T12:10:15.152436+0000","last_peered":"2024-09-14T12:10:15.152436+0000","last_clean":"2024-09-14T12:10:15.152436+0000","last_became_active":"2024-09-14T11:10:58.610518+0000","last_became_peered":"2024-09-14T11:10:58.610518+0000","last_unstale":"2024-09-14T12:10:15.152436+0000","last_undegraded":"2024-09-14T12:10:15.152436+0000","last_fullsized":"2024-09-14T12:10:15.152436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'107","last_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_deep_scrub":"265'107","last_deep_scrub_stamp":"2024-09-14T12:10:15.152342+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.152342+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:21.250556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":378,"num_write":166,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"265'380","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:04.594137+0000","last_change":"2024-09-14T12:10:04.594069+0000","last_active":"2024-09-14T12:10:04.594137+0000","last_peered":"2024-09-14T12:10:04.594137+0000","last_clean":"2024-09-14T12:10:04.594137+0000","last_became_active":"2024-09-14T11:11:32.790137+0000","last_became_peered":"2024-09-14T11:11:32.790137+0000","last_unstale":"2024-09-14T12:10:04.594137+0000","last_undegraded":"2024-09-14T12:10:04.594137+0000","last_fullsized":"2024-09-14T12:10:04.594137+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-14T12:10:04.593947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:04.593947+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:28.209010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":129855,"num_write":1253,"num_write_kb":41600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4],"acting":[2,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'124","reported_seq":728,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.293798+0000","last_change":"2024-09-14T12:10:10.293798+0000","last_active":"2024-09-14T12:10:10.293798+0000","last_peered":"2024-09-14T12:10:10.293798+0000","last_clean":"2024-09-14T12:10:10.293798+0000","last_became_active":"2024-09-14T11:10:58.606673+0000","last_became_peered":"2024-09-14T11:10:58.606673+0000","last_unstale":"2024-09-14T12:10:10.293798+0000","last_undegraded":"2024-09-14T12:10:10.293798+0000","last_fullsized":"2024-09-14T12:10:10.293798+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-14T12:10:10.293666+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.293666+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:00.336873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'359","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.079299+0000","last_change":"2024-09-14T12:10:06.079299+0000","last_active":"2024-09-14T12:10:06.079299+0000","last_peered":"2024-09-14T12:10:06.079299+0000","last_clean":"2024-09-14T12:10:06.079299+0000","last_became_active":"2024-09-14T11:10:56.618154+0000","last_became_peered":"2024-09-14T11:10:56.618154+0000","last_unstale":"2024-09-14T12:10:06.079299+0000","last_undegraded":"2024-09-14T12:10:06.079299+0000","last_fullsized":"2024-09-14T12:10:06.079299+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-14T12:10:06.079163+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.079163+0000","objects_scrubbed":9,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:31.178991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":616,"num_read_kb":2365,"num_write":1155,"num_write_kb":17954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'4110","reported_seq":4749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.179101+0000","last_change":"2024-09-14T12:10:13.179101+0000","last_active":"2024-09-14T12:10:13.179101+0000","last_peered":"2024-09-14T12:10:13.179101+0000","last_clean":"2024-09-14T12:10:13.179101+0000","last_became_active":"2024-09-14T11:10:58.613906+0000","last_became_peered":"2024-09-14T11:10:58.613906+0000","last_unstale":"2024-09-14T12:10:13.179101+0000","last_undegraded":"2024-09-14T12:10:13.179101+0000","last_fullsized":"2024-09-14T12:10:13.179101+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4110","last_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_deep_scrub":"265'4110","last_deep_scrub_stamp":"2024-09-14T12:10:13.179000+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.179000+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":3000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:04.053266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16529,"num_read_kb":13880,"num_write":6152,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'345","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.698323+0000","last_change":"2024-09-14T12:10:08.698323+0000","last_active":"2024-09-14T12:10:08.698323+0000","last_peered":"2024-09-14T12:10:08.698323+0000","last_clean":"2024-09-14T12:10:08.698323+0000","last_became_active":"2024-09-14T11:10:56.606074+0000","last_became_peered":"2024-09-14T11:10:56.606074+0000","last_unstale":"2024-09-14T12:10:08.698323+0000","last_undegraded":"2024-09-14T12:10:08.698323+0000","last_fullsized":"2024-09-14T12:10:08.698323+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-14T12:10:08.698222+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.698222+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:32.447428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":645,"num_read_kb":15479,"num_write":1162,"num_write_kb":18023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'76","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:14.966499+0000","last_change":"2024-09-14T12:10:14.966499+0000","last_active":"2024-09-14T12:10:14.966499+0000","last_peered":"2024-09-14T12:10:14.966499+0000","last_clean":"2024-09-14T12:10:14.966499+0000","last_became_active":"2024-09-14T11:10:58.608813+0000","last_became_peered":"2024-09-14T11:10:58.608813+0000","last_unstale":"2024-09-14T12:10:14.966499+0000","last_undegraded":"2024-09-14T12:10:14.966499+0000","last_fullsized":"2024-09-14T12:10:14.966499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'76","last_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_deep_scrub":"265'76","last_deep_scrub_stamp":"2024-09-14T12:10:14.966397+0000","last_clean_scrub_stamp":"2024-09-14T12:10:14.966397+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:03.981292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":369,"num_read_kb":318,"num_write":108,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'356","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:05.588883+0000","last_change":"2024-09-14T12:10:05.588883+0000","last_active":"2024-09-14T12:10:05.588883+0000","last_peered":"2024-09-14T12:10:05.588883+0000","last_clean":"2024-09-14T12:10:05.588883+0000","last_became_active":"2024-09-14T11:11:32.790635+0000","last_became_peered":"2024-09-14T11:11:32.790635+0000","last_unstale":"2024-09-14T12:10:05.588883+0000","last_undegraded":"2024-09-14T12:10:05.588883+0000","last_fullsized":"2024-09-14T12:10:05.588883+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-14T12:10:05.588778+0000","last_clean_scrub_stamp":"2024-09-14T12:10:05.588778+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:06.256609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":4745,"num_write":1096,"num_write_kb":30744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"265'456","reported_seq":1148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:08.620065+0000","last_change":"2024-09-14T12:10:08.620065+0000","last_active":"2024-09-14T12:10:08.620065+0000","last_peered":"2024-09-14T12:10:08.620065+0000","last_clean":"2024-09-14T12:10:08.620065+0000","last_became_active":"2024-09-14T11:10:58.606878+0000","last_became_peered":"2024-09-14T11:10:58.606878+0000","last_unstale":"2024-09-14T12:10:08.620065+0000","last_undegraded":"2024-09-14T12:10:08.620065+0000","last_fullsized":"2024-09-14T12:10:08.620065+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'456","last_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_deep_scrub":"265'456","last_deep_scrub_stamp":"2024-09-14T12:10:08.619947+0000","last_clean_scrub_stamp":"2024-09-14T12:10:08.619947+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.459276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1989,"num_read_kb":1617,"num_write":702,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'551","reported_seq":1361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.640999+0000","last_change":"2024-09-14T12:10:11.640999+0000","last_active":"2024-09-14T12:10:11.640999+0000","last_peered":"2024-09-14T12:10:11.640999+0000","last_clean":"2024-09-14T12:10:11.640999+0000","last_became_active":"2024-09-14T11:10:56.608925+0000","last_became_peered":"2024-09-14T11:10:56.608925+0000","last_unstale":"2024-09-14T12:10:11.640999+0000","last_undegraded":"2024-09-14T12:10:11.640999+0000","last_fullsized":"2024-09-14T12:10:11.640999+0000","mapping_epoch":25,"log_start":"265'500","ondisk_log_start":"265'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'551","last_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_deep_scrub":"265'551","last_deep_scrub_stamp":"2024-09-14T12:10:11.640830+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.640830+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:36.282096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1371,"num_read_kb":53620,"num_write":1733,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"265'708","reported_seq":1563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:13.931892+0000","last_change":"2024-09-14T12:10:13.931892+0000","last_active":"2024-09-14T12:10:13.931892+0000","last_peered":"2024-09-14T12:10:13.931892+0000","last_clean":"2024-09-14T12:10:13.931892+0000","last_became_active":"2024-09-14T11:10:58.605625+0000","last_became_peered":"2024-09-14T11:10:58.605625+0000","last_unstale":"2024-09-14T12:10:13.931892+0000","last_undegraded":"2024-09-14T12:10:13.931892+0000","last_fullsized":"2024-09-14T12:10:13.931892+0000","mapping_epoch":27,"log_start":"265'600","ondisk_log_start":"265'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'708","last_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_deep_scrub":"265'708","last_deep_scrub_stamp":"2024-09-14T12:10:13.931809+0000","last_clean_scrub_stamp":"2024-09-14T12:10:13.931809+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":600,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:18.907786+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3573,"num_read_kb":3079,"num_write":1266,"num_write_kb":789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'328","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.060187+0000","last_change":"2024-09-14T12:10:06.060187+0000","last_active":"2024-09-14T12:10:06.060187+0000","last_peered":"2024-09-14T12:10:06.060187+0000","last_clean":"2024-09-14T12:10:06.060187+0000","last_became_active":"2024-09-14T11:10:56.611726+0000","last_became_peered":"2024-09-14T11:10:56.611726+0000","last_unstale":"2024-09-14T12:10:06.060187+0000","last_undegraded":"2024-09-14T12:10:06.060187+0000","last_fullsized":"2024-09-14T12:10:06.060187+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'328","last_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_deep_scrub":"265'328","last_deep_scrub_stamp":"2024-09-14T12:10:06.060039+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.060039+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:17.060911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":10603,"num_write":1037,"num_write_kb":38611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'133","reported_seq":717,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.485953+0000","last_change":"2024-09-14T12:10:17.485953+0000","last_active":"2024-09-14T12:10:17.485953+0000","last_peered":"2024-09-14T12:10:17.485953+0000","last_clean":"2024-09-14T12:10:17.485953+0000","last_became_active":"2024-09-14T11:10:58.613077+0000","last_became_peered":"2024-09-14T11:10:58.613077+0000","last_unstale":"2024-09-14T12:10:17.485953+0000","last_undegraded":"2024-09-14T12:10:17.485953+0000","last_fullsized":"2024-09-14T12:10:17.485953+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-14T12:10:17.485872+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.485872+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:10.610144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":606,"num_read_kb":499,"num_write":220,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'348","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.246678+0000","last_change":"2024-09-14T12:10:06.246678+0000","last_active":"2024-09-14T12:10:06.246678+0000","last_peered":"2024-09-14T12:10:06.246678+0000","last_clean":"2024-09-14T12:10:06.246678+0000","last_became_active":"2024-09-14T11:10:56.618224+0000","last_became_peered":"2024-09-14T11:10:56.618224+0000","last_unstale":"2024-09-14T12:10:06.246678+0000","last_undegraded":"2024-09-14T12:10:06.246678+0000","last_fullsized":"2024-09-14T12:10:06.246678+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-14T12:10:06.246522+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.246522+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:24.006671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":576,"num_read_kb":12533,"num_write":1141,"num_write_kb":51642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'85","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.138876+0000","last_change":"2024-09-14T12:10:11.138876+0000","last_active":"2024-09-14T12:10:11.138876+0000","last_peered":"2024-09-14T12:10:11.138876+0000","last_clean":"2024-09-14T12:10:11.138876+0000","last_became_active":"2024-09-14T11:10:58.613409+0000","last_became_peered":"2024-09-14T11:10:58.613409+0000","last_unstale":"2024-09-14T12:10:11.138876+0000","last_undegraded":"2024-09-14T12:10:11.138876+0000","last_fullsized":"2024-09-14T12:10:11.138876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'85","last_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_deep_scrub":"265'85","last_deep_scrub_stamp":"2024-09-14T12:10:11.138758+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.138758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.430506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":400,"num_read_kb":338,"num_write":128,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'401","reported_seq":1028,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:11.436072+0000","last_change":"2024-09-14T12:10:11.436072+0000","last_active":"2024-09-14T12:10:11.436072+0000","last_peered":"2024-09-14T12:10:11.436072+0000","last_clean":"2024-09-14T12:10:11.436072+0000","last_became_active":"2024-09-14T11:10:56.605276+0000","last_became_peered":"2024-09-14T11:10:56.605276+0000","last_unstale":"2024-09-14T12:10:11.436072+0000","last_undegraded":"2024-09-14T12:10:11.436072+0000","last_fullsized":"2024-09-14T12:10:11.436072+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-14T12:10:11.435967+0000","last_clean_scrub_stamp":"2024-09-14T12:10:11.435967+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.312166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":13606,"num_write":1190,"num_write_kb":37201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'274","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:17.197307+0000","last_change":"2024-09-14T12:10:17.197307+0000","last_active":"2024-09-14T12:10:17.197307+0000","last_peered":"2024-09-14T12:10:17.197307+0000","last_clean":"2024-09-14T12:10:17.197307+0000","last_became_active":"2024-09-14T11:10:58.608344+0000","last_became_peered":"2024-09-14T11:10:58.608344+0000","last_unstale":"2024-09-14T12:10:17.197307+0000","last_undegraded":"2024-09-14T12:10:17.197307+0000","last_fullsized":"2024-09-14T12:10:17.197307+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'274","last_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_deep_scrub":"265'274","last_deep_scrub_stamp":"2024-09-14T12:10:17.197213+0000","last_clean_scrub_stamp":"2024-09-14T12:10:17.197213+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:00.401598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1179,"num_read_kb":963,"num_write":408,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'342","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.636571+0000","last_change":"2024-09-14T12:10:07.636571+0000","last_active":"2024-09-14T12:10:07.636571+0000","last_peered":"2024-09-14T12:10:07.636571+0000","last_clean":"2024-09-14T12:10:07.636571+0000","last_became_active":"2024-09-14T11:10:56.610566+0000","last_became_peered":"2024-09-14T11:10:56.610566+0000","last_unstale":"2024-09-14T12:10:07.636571+0000","last_undegraded":"2024-09-14T12:10:07.636571+0000","last_fullsized":"2024-09-14T12:10:07.636571+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'342","last_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_deep_scrub":"265'342","last_deep_scrub_stamp":"2024-09-14T12:10:07.636466+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.636466+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:24.340392+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":59967,"num_write":1134,"num_write_kb":34525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'394","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.458471+0000","last_change":"2024-09-14T12:10:15.458471+0000","last_active":"2024-09-14T12:10:15.458471+0000","last_peered":"2024-09-14T12:10:15.458471+0000","last_clean":"2024-09-14T12:10:15.458471+0000","last_became_active":"2024-09-14T11:10:58.613117+0000","last_became_peered":"2024-09-14T11:10:58.613117+0000","last_unstale":"2024-09-14T12:10:15.458471+0000","last_undegraded":"2024-09-14T12:10:15.458471+0000","last_fullsized":"2024-09-14T12:10:15.458471+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-14T12:10:15.458379+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.458379+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:39.482027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1924,"num_read_kb":1626,"num_write":709,"num_write_kb":454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3561,"num_omap_keys":15,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'331","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:07.715505+0000","last_change":"2024-09-14T12:10:07.715505+0000","last_active":"2024-09-14T12:10:07.715505+0000","last_peered":"2024-09-14T12:10:07.715505+0000","last_clean":"2024-09-14T12:10:07.715505+0000","last_became_active":"2024-09-14T11:10:56.608566+0000","last_became_peered":"2024-09-14T11:10:56.608566+0000","last_unstale":"2024-09-14T12:10:07.715505+0000","last_undegraded":"2024-09-14T12:10:07.715505+0000","last_fullsized":"2024-09-14T12:10:07.715505+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-14T12:10:07.715389+0000","last_clean_scrub_stamp":"2024-09-14T12:10:07.715389+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:27.252175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079931,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":656,"num_read_kb":22222,"num_write":1088,"num_write_kb":43535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'360","reported_seq":1054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:10.634166+0000","last_change":"2024-09-14T12:10:10.634166+0000","last_active":"2024-09-14T12:10:10.634166+0000","last_peered":"2024-09-14T12:10:10.634166+0000","last_clean":"2024-09-14T12:10:10.634166+0000","last_became_active":"2024-09-14T11:10:56.601906+0000","last_became_peered":"2024-09-14T11:10:56.601906+0000","last_unstale":"2024-09-14T12:10:10.634166+0000","last_undegraded":"2024-09-14T12:10:10.634166+0000","last_fullsized":"2024-09-14T12:10:10.634166+0000","mapping_epoch":25,"log_start":"265'300","ondisk_log_start":"265'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'360","last_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_deep_scrub":"265'360","last_deep_scrub_stamp":"2024-09-14T12:10:10.634055+0000","last_clean_scrub_stamp":"2024-09-14T12:10:10.634055+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:17.564902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":41589,"num_write":1192,"num_write_kb":20217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,0],"acting":[5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'88","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:15.262913+0000","last_change":"2024-09-14T12:10:15.262913+0000","last_active":"2024-09-14T12:10:15.262913+0000","last_peered":"2024-09-14T12:10:15.262913+0000","last_clean":"2024-09-14T12:10:15.262913+0000","last_became_active":"2024-09-14T11:10:58.614660+0000","last_became_peered":"2024-09-14T11:10:58.614660+0000","last_unstale":"2024-09-14T12:10:15.262913+0000","last_undegraded":"2024-09-14T12:10:15.262913+0000","last_fullsized":"2024-09-14T12:10:15.262913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'88","last_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_deep_scrub":"265'88","last_deep_scrub_stamp":"2024-09-14T12:10:15.262821+0000","last_clean_scrub_stamp":"2024-09-14T12:10:15.262821+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:00:29.014884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":406,"num_read_kb":336,"num_write":136,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'467","reported_seq":1150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:06.799973+0000","last_change":"2024-09-14T12:10:06.799973+0000","last_active":"2024-09-14T12:10:06.799973+0000","last_peered":"2024-09-14T12:10:06.799973+0000","last_clean":"2024-09-14T12:10:06.799973+0000","last_became_active":"2024-09-14T11:11:32.677580+0000","last_became_peered":"2024-09-14T11:11:32.677580+0000","last_unstale":"2024-09-14T12:10:06.799973+0000","last_undegraded":"2024-09-14T12:10:06.799973+0000","last_fullsized":"2024-09-14T12:10:06.799973+0000","mapping_epoch":38,"log_start":"265'400","ondisk_log_start":"265'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'467","last_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_deep_scrub":"265'467","last_deep_scrub_stamp":"2024-09-14T12:10:06.799866+0000","last_clean_scrub_stamp":"2024-09-14T12:10:06.799866+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:29.839357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":936,"num_read_kb":7353,"num_write":1336,"num_write_kb":49459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'82","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-14T12:10:18.681579+0000","last_change":"2024-09-14T12:10:18.681579+0000","last_active":"2024-09-14T12:10:18.681579+0000","last_peered":"2024-09-14T12:10:18.681579+0000","last_clean":"2024-09-14T12:10:18.681579+0000","last_became_active":"2024-09-14T11:10:58.606675+0000","last_became_peered":"2024-09-14T11:10:58.606675+0000","last_unstale":"2024-09-14T12:10:18.681579+0000","last_undegraded":"2024-09-14T12:10:18.681579+0000","last_fullsized":"2024-09-14T12:10:18.681579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-14T12:10:18.681470+0000","last_clean_scrub_stamp":"2024-09-14T12:10:18.681470+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:22.840994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":344,"num_write":109,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10922,"num_read_kb":9214,"num_write":3127,"num_write_kb":1015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15081,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15154,"num_read_kb":14815,"num_write":17077,"num_write_kb":4986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2585,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":30162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1579,"ondisk_log_size":1579,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":600,"ondisk_log_size":600,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1638457,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":18085,"num_read_kb":37656,"num_write":15239,"num_write_kb":11977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713492,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2412,"num_read_kb":2875,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":108314,"num_read_kb":90734,"num_write":38329,"num_write_kb":19341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36258,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4345,"ondisk_log_size":4345,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":32687811,"num_objects":281,"num_object_clones":0,"num_object_copies":843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44407,"num_read_kb":2049088,"num_write":73495,"num_write_kb":2179088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50442240,"data_stored":50442240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3782,"ondisk_log_size":3782,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":224799,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":204319,"num_write":164,"num_write_kb":145943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510173,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280296,"kb_used_data":10328,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94091544,"statfs":{"total":96636764160,"available":96349741056,"internally_reserved":0,"allocated":10575872,"data_stored":8512576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510173,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149360,"kb_used_data":9952,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":10190848,"data_stored":8104359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510173,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258536,"kb_used_data":14936,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94113304,"statfs":{"total":96636764160,"available":96372023296,"internally_reserved":0,"allocated":15294464,"data_stored":13168761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542876,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300892,"kb_used_data":12876,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94070948,"statfs":{"total":96636764160,"available":96328650752,"internally_reserved":0,"allocated":13185024,"data_stored":11050510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":294910411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542877,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144132,"kb_used_data":8884,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94227708,"statfs":{"total":96636764160,"available":96489172992,"internally_reserved":0,"allocated":9097216,"data_stored":6957133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542875,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130672,"kb_used_data":14816,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94241168,"statfs":{"total":96636764160,"available":96502956032,"internally_reserved":0,"allocated":15171584,"data_stored":13135603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542877,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280256,"kb_used_data":6192,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94091584,"statfs":{"total":96636764160,"available":96349782016,"internally_reserved":0,"allocated":6340608,"data_stored":4233902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542877,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91908,"kb_used_data":6644,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94279932,"statfs":{"total":96636764160,"available":96542650368,"internally_reserved":0,"allocated":6803456,"data_stored":4759690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10289152,"data_stored":10289152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5816320,"data_stored":5816320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2473984,"data_stored":2473984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":1945600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10850304,"data_stored":10850304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4669440,"data_stored":4669440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6225920,"data_stored":6225920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8171520,"data_stored":8171520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":5595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:11:23.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T12:11:23.607 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T12:11:23.608 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T12:11:23.608 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T12:11:23.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.670 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T12:11:23.670 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T12:11:23.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.731 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T12:11:23.732 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T12:11:23.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.775 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T12:11:23.775 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T12:11:23.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.817 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T12:11:23.817 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T12:11:23.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.854 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T12:11:23.854 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T12:11:23.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.936 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T12:11:23.936 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T12:11:23.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:23.983 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T12:11:23.983 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T12:11:23.984 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:24.035 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T12:11:24.035 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T12:11:24.035 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T12:11:24.035 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:24.061 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T12:11:24.061 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T12:11:24.061 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:24.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-14T12:11:24.091 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T12:11:24.091 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T12:11:24.091 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T12:11:24.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:24.118 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T12:11:24.118 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T12:11:24.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:24.171 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T12:11:24.172 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T12:11:24.172 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:11:24.184 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T12:11:24.184 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T12:11:24.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T12:11:24.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T12:11:24.256 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T12:11:24.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T12:11:24.413 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T12:11:24.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T12:11:24.521 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T12:11:24.601 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T12:11:24.601 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T12:11:24.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T12:11:24.687 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T12:11:24.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T12:11:24.835 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T12:11:24.921 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T12:11:24.921 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T12:11:25.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T12:11:25.012 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T12:11:25.093 INFO:tasks.ceph:Archiving mon data... 2024-09-14T12:11:25.094 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/data/mon.a.tgz 2024-09-14T12:11:25.094 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-09-14T12:11:25.126 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.AS9j0lYo7s 2024-09-14T12:11:25.126 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AS9j0lYo7s 2024-09-14T12:11:25.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.AS9j0lYo7s 2024-09-14T12:11:25.435 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.AS9j0lYo7s is 471KB 2024-09-14T12:11:25.532 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.AS9j0lYo7s 2024-09-14T12:11:25.561 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/data/mon.c.tgz 2024-09-14T12:11:25.561 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-09-14T12:11:25.630 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.2mW0JealX3 2024-09-14T12:11:25.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2mW0JealX3 2024-09-14T12:11:25.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.2mW0JealX3 2024-09-14T12:11:25.929 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.2mW0JealX3 is 488KB 2024-09-14T12:11:26.012 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.2mW0JealX3 2024-09-14T12:11:26.042 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/data/mon.b.tgz 2024-09-14T12:11:26.042 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-14T12:11:26.073 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.XcFzWyeRJR 2024-09-14T12:11:26.074 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XcFzWyeRJR 2024-09-14T12:11:26.274 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.XcFzWyeRJR 2024-09-14T12:11:26.384 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.XcFzWyeRJR is 488KB 2024-09-14T12:11:26.466 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.XcFzWyeRJR 2024-09-14T12:11:26.495 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T12:11:26.495 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:11:26.498 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:11:26.683 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:11:26.711 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:11:26.711 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T12:11:26.714 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/remote/smithi028/crash 2024-09-14T12:11:26.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:11:26.754 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/remote/smithi204/crash 2024-09-14T12:11:26.755 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:11:26.792 INFO:tasks.ceph:Compressing logs... 2024-09-14T12:11:26.792 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:11:26.799 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:11:26.870 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T12:11:26.870 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175067.log 2024-09-14T12:11:26.870 INFO:teuthology.orchestra.run.smithi028.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.0.184812.log 2024-09-14T12:11:26.870 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.175067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58473.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 83.8%/var/log/ceph/ceph-client.0.184812.log: -- replaced with /var/log/ceph/ceph-client.0.175067.log.gz 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53100.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.184812.log.gz 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.58473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61220.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58473.log.gz 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187216.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.53100.log.gz 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.61220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104358.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61220.log.gz 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190890.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187216.log.gz 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.104358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114960.log 2024-09-14T12:11:26.871 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104358.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113193.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190890.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.114960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187240.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.114960.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.113193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190199.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.113193.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109659.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.187240.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40007.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190199.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.109659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107303.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.109659.log.gz 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.40007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37394.log 2024-09-14T12:11:26.872 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.40007.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.107303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156195.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107303.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187876.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37394.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.156195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134988.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187876.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.156195.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.187876.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.113782.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.134988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127920.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.134988.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.113782.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26712.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.113782.log.gz 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.127920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57860.log 2024-09-14T12:11:26.873 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.tmp-client.admin.26712.log: 86.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.127920.log.gz -5 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.190798.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26712.log.gz 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.57860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.57860.log.gz 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163333.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190798.log.gz 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133810.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.163333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149716.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163333.log.gz 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56093.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.133810.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.133810.log.gz 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.149716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174428.log 2024-09-14T12:11:26.874 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.149716.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.56093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190291.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.56093.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.174428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52511.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174428.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77850.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190291.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.52511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185991.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.52511.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.77850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136755.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.77850.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.185991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37884.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.136755.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.185991.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177504.log 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.136755.log.gz 2024-09-14T12:11:26.875 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37884.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37884.log.gz 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.177504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134399.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.177504.log.gz 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76395.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.134399.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.134399.log.gz 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.76395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178113.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.76395.log.gz 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5/var/log/ceph/ops-log-ceph-client.0.log: --verbose -- /var/log/ceph/ceph-client.admin.83153.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.178113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93167.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.178113.log.gz 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.83153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38255.log 2024-09-14T12:11:26.876 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.83153.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.93167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37481.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93167.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190659.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38255.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37481.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153839.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139700.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190659.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.153839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106714.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.153839.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.139700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187925.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139700.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.106714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38772.log 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.106714.log.gz 2024-09-14T12:11:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187925.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140289.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38772.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73064.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.140289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82564.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.140289.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.73064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142056.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.73064.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.82564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161566.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.142056.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82564.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190337.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.142056.log.gz 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161518.log 2024-09-14T12:11:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.161566.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.161566.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187830.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190337.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62135.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.161518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161518.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88454.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187830.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.187830.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.62135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125564.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.62135.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.88454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100824.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88454.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79030.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.125564.log: /var/log/ceph/ceph-client.admin.100824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122619.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125564.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.100824.log.gz 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.79030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178722.log 2024-09-14T12:11:26.879 INFO:teuthology.orchestra.run.smithi028.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.79030.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48340.log 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.122619.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.122619.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.178722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38596.log 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147360.log 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.178722.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48340.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.48340.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41828.log 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38596.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116138.log 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.147360.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.147360.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.41828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38640.log 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.41828.log.gz 2024-09-14T12:11:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127331.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.116138.log: /var/log/ceph/ceph-client.admin.38640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38115.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.116138.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38640.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.127331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129687.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.127331.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38115.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.129687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77261.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.129687.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.49518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168382.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.77261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71292.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.77261.log.gz 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61408.log 2024-09-14T12:11:26.881 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.168382.log: /var/log/ceph/ceph-client.admin.71292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37892.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.71292.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.61408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37885.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.61408.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:gzip/var/log/ceph/ceph-client.admin.37892.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.126742.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37892.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.168382.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57271.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37885.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.126742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48929.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.126742.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.57271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158573.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.57271.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.48929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110248.log 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.48929.log.gz 2024-09-14T12:11:26.882 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.158573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62724.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.158573.log.gz 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.110248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143234.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110248.log.gz 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.62724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176285.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.143234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191088.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143234.log.gz 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.176285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139111.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.176285.log.gz 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.191088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150894.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191088.log.gz 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190995.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.139111.log: /var/log/ceph/ceph-client.admin.150894.log: gzip -5 87.2% --verbose -- /var/log/ceph/ceph-client.admin.111426.log 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139111.log.gz 2024-09-14T12:11:26.883 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190995.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84920.log 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.111426.log: -- /var/log/ceph/ceph-client.admin.90221.log 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.84920.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.111426.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.84920.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.60825.log 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.150894.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54867.log 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.90221.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.60825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60935.log 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.60825.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187900.log 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54867.log: /var/log/ceph/ceph-client.admin.60935.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.54867.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78441.log 56.2% 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60935.log.gz 2024-09-14T12:11:26.884 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137933.log 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187900.log.gz 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.78441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117316.log 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.78441.log.gz 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.137933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61282.log 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137933.log.gz 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr:gzip/var/log/ceph/ceph-client.admin.117316.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.190383.log 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.117316.log.gz 2024-09-14T12:11:26.885 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.61282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50155.log 2024-09-14T12:11:26.896 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32697.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32609.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32697.log.gz 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32609.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32609.log.gz 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32653.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32840.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32653.log: /var/log/ceph/ceph-client.admin.32840.log: 28.0% -- replaced with /var/log/ceph/ceph-client.admin.32653.log.gz 2024-09-14T12:11:26.897 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32840.log.gz 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32928.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32928.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32928.log.gz 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32752.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.32752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-09-14T12:11:26.898 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.b.log: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190383.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190383.log.gz 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73655.log 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50155.log: gzip -5 --verbose 81.3% -- /var/log/ceph/ceph-client.admin.47727.log 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.73655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38728.log 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.73655.log.gz 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47727.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33224.log 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47727.log.gz 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181767.log 2024-09-14T12:11:26.975 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38728.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110837.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33224.log: 0.0%/var/log/ceph/ceph-client.0.181767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90811.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33224.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.181767.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.110837.log: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110837.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.90811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68297.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179331.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90811.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.68297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187949.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.179331.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.179331.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32793.log 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187949.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68297.log.gz 2024-09-14T12:11:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.187949.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132043.log 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128509.log 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.132043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96701.log 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.132043.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.128509.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.128509.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.62724.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171570.log 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175676.log 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.96701.log: /var/log/ceph/ceph-client.admin.171570.log: gzip 81.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.132632.log 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96701.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.175676.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171570.log.gz 2024-09-14T12:11:26.977 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79619.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.175676.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:gzip/var/log/ceph/ceph-client.admin.132632.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.120261.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.79619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190844.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79619.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.120261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169598.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166613.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 86.0%/var/log/ceph/ceph-client.admin.190844.log: -- replaced with /var/log/ceph/ceph-client.admin.132632.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190844.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.169598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50744.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169598.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.166613.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.120261.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164559.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75734.log/var/log/ceph/ceph-client.admin.50744.log: 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.164559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123208.log 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.50744.log.gz 2024-09-14T12:11:26.978 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.164559.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.75734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190153.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr: 50.1% -- replaced with /var/log/ceph/ceph-client.admin.75734.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.123208.log: gzip -5 --verbose 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61282.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.143823.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.123208.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190153.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105536.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5/var/log/ceph/ceph-client.admin.143823.log: --verbose -- /var/log/ceph/ceph-client.admin.187852.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.105536.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143823.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157962.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37540.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.166613.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187852.log.gz 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.157962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190245.log 2024-09-14T12:11:26.979 INFO:teuthology.orchestra.run.smithi028.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.157962.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71881.log/var/log/ceph/ceph-client.admin.37540.log: 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37540.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.105536.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190245.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190061.log 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.71881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37632.log 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.71881.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190061.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162155.log 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37632.log.gz 2024-09-14T12:11:26.980 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.162155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99646.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.162155.log.gz 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38258.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38795.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.99646.log: /var/log/ceph/ceph-client.admin.38258.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99646.log.gz 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38258.log.gz 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158552.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.38795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190015.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.158552.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.158552.log.gz -5 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156784.log 2024-09-14T12:11:26.981 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190015.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.38795.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155017.log 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131454.log 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.156784.log: /var/log/ceph/ceph-client.admin.155017.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.156784.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162744.log 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.155017.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.131454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119083.log 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.131454.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.162744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85509.log 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.162744.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.119083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191132.log 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119083.log.gz 2024-09-14T12:11:26.982 INFO:teuthology.orchestra.run.smithi028.stderr:gzip/var/log/ceph/ceph-client.admin.85509.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.84331.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.191132.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.85509.log.gz 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191132.log.gz 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67059.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70200.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.84331.log: /var/log/ceph/ceph-client.admin.67059.log: 81.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145590.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84331.log.gz 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.70200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75024.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.70200.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190706.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz/var/log/ceph/ceph-client.admin.145590.log: 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.75024.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145590.log.gz 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.75024.log.gz 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190429.log 2024-09-14T12:11:26.983 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172786.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190706.log.gz 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38552.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190429.log.gz 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.172786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58497.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120850.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172786.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38552.log.gz 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.58497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87276.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.58497.log.gz 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.120850.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120850.log.gz 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108481.log 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.87276.log: /var/log/ceph/ceph-mon.c.log: gzip 84.9% -- replaced with /var/log/ceph/ceph-client.admin.87276.log.gz 2024-09-14T12:11:26.984 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.161542.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.108481.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108481.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.104947.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.161542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161542.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155606.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.104947.log: gzip -5 --verbose 82.1% -- replaced with /var/log/ceph/ceph-client.admin.104947.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.117905.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.155606.log: gzip -5 --verbose -- 82.0% -- replaced with /var/log/ceph/ceph-client.admin.155606.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr: /var/log/ceph/ceph-client.admin.74246.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.117905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117905.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.74246.log: 24.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81975.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74246.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-09-14T12:11:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5/var/log/ceph/ceph-client.admin.81975.log: --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47703.log: 80.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.81975.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.102002.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46525.log: -- /var/log/ceph/ceph-client.admin.59086.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182985.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.102002.log: /var/log/ceph/ceph-client.admin.59086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62023.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.182985.log: 87.4% 85.5% -- replaced with /var/log/ceph/ceph-client.admin.59086.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102002.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.182985.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43637.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.62023.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.62023.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41219.log 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.43637.log: gzip -5 --verbose 43.5% -- replaced with /var/log/ceph/ceph-client.0.43637.log.gz 2024-09-14T12:11:26.986 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.61959.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.41219.log: gzip 80.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.37586.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.0.41219.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.61959.log: gzip -5 --verbose 19.9% -- replaced with /var/log/ceph/ceph-client.admin.61959.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.50107.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37586.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130276.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50107.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81386.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.130276.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.130276.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.163970.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.81386.log: gzip -5 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81386.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.119672.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.163970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190521.log 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr: 86.7%/var/log/ceph/ceph-client.admin.119672.log: -- replaced with /var/log/ceph/ceph-client.admin.163970.log.gz 2024-09-14T12:11:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119672.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.37886.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190521.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133221.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.133221.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133221.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.56069.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.50131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186580.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.56069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56069.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165964.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.186580.log: gzip -5 --verbose 80.2% -- replaced with /var/log/ceph/ceph-client.admin.186580.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.160340.log 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.165964.log: gzip -5 --verbose 84.2% -- replaced with /var/log/ceph/ceph-client.0.165964.log.gz 2024-09-14T12:11:26.988 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.153250.log 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.160340.log: gzip -5 82.0% -- replaced with /var/log/ceph/ceph-client.admin.160340.log.gz 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.0.184203.log 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.153250.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.153250.log.gz 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.136166.log 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.184203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38253.log 83.9% -- replaced with /var/log/ceph/ceph-client.0.184203.log.gz 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.136166.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 85.2% -- replaced with /var/log/ceph/ceph-client.admin.136166.log.gz 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38253.log.gz 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89043.log 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75786.log 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42431.log 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89043.log: /var/log/ceph/ceph-client.0.75786.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.89043.log.gz 2024-09-14T12:11:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151483.log 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.42431.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.42431.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- 95.1% /var/log/ceph/ceph-client.admin.130865.log 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67059.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94934.log 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.75786.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.151483.log: /var/log/ceph/ceph-client.admin.130865.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.151483.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146179.log 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.130865.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.94934.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94934.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38684.log 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.146179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40616.log 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.146179.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38684.log.gz 2024-09-14T12:11:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102591.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179940.log/var/log/ceph/ceph-client.0.40616.log: 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40616.log.gz/var/log/ceph/ceph-client.admin.102591.log: 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:gzip 81.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.190107.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102591.log.gz 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.179940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67678.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.179940.log.gz 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37888.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190107.log: /var/log/ceph/ceph-client.admin.67678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190107.log.gz 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56045.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94345.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37888.log.gz 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.56045.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0%/var/log/ceph/ceph-client.admin.94345.log: -- replaced with /var/log/ceph/ceph-client.admin.56045.log.gz 2024-09-14T12:11:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.94345.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58449.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.67678.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173820.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.58449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58449.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38260.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80797.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38260.log: /var/log/ceph/ceph-client.admin.173820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38260.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54278.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.80797.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80797.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.54278.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.54278.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47114.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.173820.log.gz 2024-09-14T12:11:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146771.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64581.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr: 61.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.146771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163357.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.64581.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.146771.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129098.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.163357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163357.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112604.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.129098.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129098.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107892.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.112604.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.112604.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.107892.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107892.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189969.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mgr.y.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.64581.log.gz 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66440.log 2024-09-14T12:11:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.189969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189969.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37887.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.66440.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66440.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187170.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37887.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116727.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187170.log: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.187170.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135577.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.116727.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.116727.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51333.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.135577.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135577.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51333.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.51333.log.gz 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38506.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59675.log 2024-09-14T12:11:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38506.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176895.log 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.59675.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.59675.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182376.log 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.176895.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.176895.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137344.log 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.182376.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.182376.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190936.log 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.137344.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137344.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144412.log 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190936.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180549.log 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.144412.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.144412.log.gz 2024-09-14T12:11:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154428.log 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.180549.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.180549.log.gz 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149127.log 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.154428.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.154428.log.gz 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147949.log 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.149127.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.149127.log.gz 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91989.log 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.147949.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.147949.log.gz 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118494.log 2024-09-14T12:11:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.91989.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91989.log.gz 2024-09-14T12:11:27.041 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65821.log 2024-09-14T12:11:27.041 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.118494.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118494.log.gz 2024-09-14T12:11:27.041 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86687.log 2024-09-14T12:11:27.041 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.65821.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.65821.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97879.log 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.86687.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86687.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190567.log 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.97879.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97879.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43034.log 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190567.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98468.log 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr: 94.4%/var/log/ceph/ceph-client.0.43034.log: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.43034.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65201.log 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.98468.log: 81.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188644.log 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98468.log.gz 2024-09-14T12:11:27.042 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.65201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39404.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.188644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106125.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.188644.log.gz/var/log/ceph/ceph-client.0.39404.log: 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr: 44.6% -- replaced with /var/log/ceph/ceph-client.0.39404.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63343.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.106125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124386.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106125.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.63343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152072.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.124386.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.63343.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124386.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56682.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.152072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121441.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152072.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.56682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101413.log 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.121441.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.56682.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.65201.log.gz 2024-09-14T12:11:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.121441.log.gz 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55456.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.101413.log: /var/log/ceph/ceph-client.admin.47751.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.55456.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.101413.log.gz 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68916.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.55456.log.gz 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.47751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114371.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.68916.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.114371.log: /var/log/ceph/ceph-client.admin.93756.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114371.log.gz 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95523.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.93756.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68916.log.gzgzip 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.74415.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93756.log.gz 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115549.log 2024-09-14T12:11:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.95523.log: /var/log/ceph/ceph-client.0.74415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138522.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.115549.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.74415.log.gz 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95523.log.gz 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:gzip 85.4% -- replaced with /var/log/ceph/ceph-client.admin.115549.log.gz 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61346.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.138522.log: gzip 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138522.log.gz 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.168990.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.61346.log: gzip -5 54.9% -- replaced with /var/log/ceph/ceph-client.admin.61346.log.gz 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.86098.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.168990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152661.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168990.log.gz/var/log/ceph/ceph-client.admin.86098.log: 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose 82.0% -- replaced with /var/log/ceph/ceph-client.admin.86098.log.gz 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: -- /var/log/ceph/ceph-client.admin.72474.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.152661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61143.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.72474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80208.log 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.61143.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.61143.log.gz 2024-09-14T12:11:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72474.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152661.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:gzip/var/log/ceph/ceph-client.admin.80208.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.190752.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr: 81.6%/var/log/ceph/rgw.ceph.client.0.log: -- replaced with /var/log/ceph/ceph-client.admin.80208.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163381.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190752.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170962.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190752.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.163381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83742.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.170962.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163381.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.170962.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160929.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.83742.log: -- /var/log/ceph/ceph-client.admin.126153.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83742.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.160929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167221.log 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.126153.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.160929.log.gz 2024-09-14T12:11:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189337.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.167221.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.167221.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37891.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.126153.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.189337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187192.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37891.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190613.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.187192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187192.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100235.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190613.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150305.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.100235.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100235.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38116.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.150305.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.150305.log.gz 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2024-09-14T12:11:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38116.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159751.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.45936.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172178.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.159751.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.159751.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190475.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.172178.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172178.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148538.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.190475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190475.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141467.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.148538.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.148538.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109070.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.141467.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141467.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.109070.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.109070.log.gz 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63962.log 2024-09-14T12:11:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.37259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157373.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.63962.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.63962.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145001.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.157373.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.157373.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140878.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.145001.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145001.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53689.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.140878.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.140878.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87865.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.53689.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.53689.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103769.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.87865.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.87865.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91400.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.103769.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.103769.log.gz 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96112.log 2024-09-14T12:11:27.049 INFO:teuthology.orchestra.run.smithi028.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.0.189337.log.gz 2024-09-14T12:11:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.91400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33131.log 2024-09-14T12:11:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.96112.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.91400.log.gz 2024-09-14T12:11:27.050 INFO:teuthology.orchestra.run.smithi028.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96112.log.gz 2024-09-14T12:11:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181158.log 2024-09-14T12:11:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33131.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37890.log 2024-09-14T12:11:27.050 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33131.log.gz 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69535.log 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.181158.log: /var/log/ceph/ceph-client.admin.37890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37890.log.gz 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.181158.log.gz 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142645.log 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.69535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191042.log 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.142645.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.142645.log.gz 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38460.log 2024-09-14T12:11:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.191042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191042.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170206.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38460.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.170206.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.170206.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.3.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.69535.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99057.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.38254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124975.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.99057.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99057.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123797.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.124975.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.124975.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89632.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.123797.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.123797.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159162.log 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.89632.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89632.log.gz 2024-09-14T12:11:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51922.log 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.159162.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.159162.log.gz 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183594.log 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.51922.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.51922.log.gz 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92578.log 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.0.183594.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.183594.log.gz 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103180.log 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.92578.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.92578.log.gz 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60573.log 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.103180.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103180.log.gz 2024-09-14T12:11:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122030.log 2024-09-14T12:11:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.60573.log: 60.0% -- replaced with /var/log/ceph/ceph-client.admin.60573.log.gz 2024-09-14T12:11:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112015.log 2024-09-14T12:11:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.122030.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122030.log.gz 2024-09-14T12:11:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97290.log 2024-09-14T12:11:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.112015.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.112015.log.gz 2024-09-14T12:11:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.97290.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97290.log.gz 2024-09-14T12:11:27.452 INFO:teuthology.orchestra.run.smithi204.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T12:11:27.962 INFO:teuthology.orchestra.run.smithi204.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T12:11:28.010 INFO:teuthology.orchestra.run.smithi028.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T12:11:29.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-14T12:11:29.290 INFO:teuthology.orchestra.run.smithi028.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T12:11:30.858 INFO:teuthology.orchestra.run.smithi028.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T12:11:34.457 INFO:teuthology.orchestra.run.smithi028.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T12:11:35.358 INFO:teuthology.orchestra.run.smithi204.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T12:11:35.969 INFO:teuthology.orchestra.run.smithi204.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T12:11:36.099 INFO:teuthology.orchestra.run.smithi028.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T12:11:36.722 INFO:teuthology.orchestra.run.smithi204.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T12:11:40.080 INFO:teuthology.orchestra.run.smithi028.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T12:11:45.187 INFO:teuthology.orchestra.run.smithi204.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T12:11:45.189 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-14T12:11:45.189 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m18.327s 2024-09-14T12:11:45.189 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m45.689s 2024-09-14T12:11:45.189 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m1.658s 2024-09-14T12:11:50.214 INFO:teuthology.orchestra.run.smithi028.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T12:11:50.216 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-09-14T12:11:50.216 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m23.390s 2024-09-14T12:11:50.216 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m58.989s 2024-09-14T12:11:50.216 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m2.118s 2024-09-14T12:11:50.216 INFO:tasks.ceph:Archiving logs... 2024-09-14T12:11:50.217 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/remote/smithi028/log 2024-09-14T12:11:50.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:11:57.468 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/remote/smithi204/log 2024-09-14T12:11:57.469 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:12:03.424 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T12:12:03.433 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T12:12:03.433 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:12:03.436 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:12:03.536 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T12:12:03.547 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T12:12:03.547 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:12:03.550 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:12:03.579 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:12:03.580 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:12:03.584 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:12:03.584 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-09-14T12:12:03.584 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +1972us[+1973us] +/- 54ms 2024-09-14T12:12:03.584 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +3081us[+3082us] +/- 69ms 2024-09-14T12:12:03.585 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -9933us[-9933us] +/- 113ms 2024-09-14T12:12:03.585 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:12:03.586 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:12:03.586 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-09-14T12:12:03.586 INFO:teuthology.orchestra.run.smithi028.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +2316us[+2275us] +/- 54ms 2024-09-14T12:12:03.586 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 +3412us[+3412us] +/- 69ms 2024-09-14T12:12:03.587 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 73 -9617us[-9659us] +/- 112ms 2024-09-14T12:12:03.587 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:12:03.587 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T12:12:03.596 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T12:12:03.597 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T12:12:03.618 DEBUG:teuthology.orchestra.run.smithi028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:12:03.712 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:12:03.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:12:03.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:12:03.832 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:12:03.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:12:03.873 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T12:12:03.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T12:12:03.910 INFO:teuthology.task.internal:Duration was 4127.570069 seconds 2024-09-14T12:12:03.910 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T12:12:03.943 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T12:12:03.944 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:12:03.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:12:03.999 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:12:04.000 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:12:04.134 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T12:12:04.134 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-09-14T12:12:04.135 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:12:04.169 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-09-14T12:12:04.169 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:12:04.212 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T12:12:04.212 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:12:04.215 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:12:04.291 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T12:12:04.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:12:04.295 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:12:04.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T12:12:04.458 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T12:12:04.458 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:12:04.498 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:12:04.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T12:12:04.548 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:12:04.550 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:12:04.585 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-09-14T12:12:04.614 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-09-14T12:12:04.635 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:12:04.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:12:04.668 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:12:04.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:12:04.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T12:12:04.714 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T12:12:04.714 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/remote/smithi028 2024-09-14T12:12:04.715 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:12:04.765 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904169/remote/smithi204 2024-09-14T12:12:04.765 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:12:04.811 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T12:12:04.811 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:12:04.813 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:12:04.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T12:12:04.887 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T12:12:04.887 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T12:12:04.902 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T12:12:04.902 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:12:04.904 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:12:04.931 INFO:teuthology.orchestra.run.smithi028.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:12 /home/ubuntu/cephtest 2024-09-14T12:12:04.942 INFO:teuthology.orchestra.run.smithi204.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:12 /home/ubuntu/cephtest 2024-09-14T12:12:04.943 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T12:12:04.954 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T12:12:05.014 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4127.570069074631 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T12:12:05.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T12:12:05.101 INFO:teuthology.run:pass